can someone tell me the name of the crawl-robot in devonthink? i’d like to block it from downloading entire site… i’m soing some tries with my website, but i can’t get the name of the user agent… so it always downloads everything…
DEVONthink doesn’t have a unique user agent.