Hi,
When crawling pages like dblp.org/db/conf/aaai/index.html, and following the “contents” links (one level only), I often get “Too big” log errors. I would like to know if there is a customizable size limit for this kind of situation. Or am I doing something obviously wrong?
Thanks in advance,
Best regards