Deep scan slows to a crawl

DEVONagent Tips
1

After doing a deep scan for a while, DA v2.3.1 slows to a crawl and it appears to be due to many connections stuck in the CLOSED state. Below is the output of the “lsof -i4” command when the problem is occurring. I’m using OS X 10.5.6 and Little Snitch is set to allow queries for ports 80 and 443. Of course, quitting and relaunching DA fixes the problem but I’d like to find a fix that can address the root cause of the problem. Any ideas?


% lsof -i4
...
DEVONagen 45556 mikey   20u  IPv4 0x16704270      0t0  TCP 192.168.1.20:60457->yx-in-f103.google.com:http (CLOSED)
DEVONagen 45556 mikey   21u  IPv4 0x16d5c66c      0t0  TCP 192.168.1.20:60458->yx-in-f103.google.com:http (CLOSED)
DEVONagen 45556 mikey   23u  IPv4  0xda7ae64      0t0  TCP 192.168.1.20:60610->b3.5d.354a.static.theplanet.com:http (CLOSED)
DEVONagen 45556 mikey   24u  IPv4 0x16718a68      0t0  TCP 192.168.1.20:60645->66.70.29.131:http (CLOSED)
DEVONagen 45556 mikey   25u  IPv4 0x16d50e64      0t0  TCP 192.168.1.20:60461->milatours.com:http (CLOSED)
DEVONagen 45556 mikey   26u  IPv4 0x152a5270      0t0  TCP 192.168.1.20:61066->repec.econ.uconn.edu:http (CLOSE_WAIT)
DEVONagen 45556 mikey   27u  IPv4 0x16d65a68      0t0  TCP 192.168.1.20:60488->rci-in.rutgers.edu:http (CLOSED)
DEVONagen 45556 mikey   28u  IPv4 0x16d3c66c      0t0  TCP 192.168.1.20:60466->search.dmoz.aol.com:http (CLOSED)
DEVONagen 45556 mikey   29u  IPv4 0x16d61270      0t0  TCP 192.168.1.20:60476->cp94.webhost4life.com:http (CLOSED)
DEVONagen 45556 mikey   30u  IPv4 0x16d5fe64      0t0  TCP 192.168.1.20:60471->ec2-75-101-132-23.compute-1.amazonaws.com:http (CLOSED)
DEVONagen 45556 mikey   31u  IPv4 0x16d4e66c      0t0  TCP 192.168.1.20:60468->166-140.amazon.com:http (CLOSED)
DEVONagen 45556 mikey   32u  IPv4 0x16710e64      0t0  TCP 192.168.1.20:60469->72.21.211.32:http (CLOSED)
DEVONagen 45556 mikey   33u  IPv4 0x16d5a66c      0t0  TCP 192.168.1.20:60470->linkedin.com:http (CLOSED)
DEVONagen 45556 mikey   34u  IPv4 0x16d39e64      0t0  TCP 192.168.1.20:60637->208.48.254.112:http (CLOSED)
DEVONagen 45556 mikey   35u  IPv4 0x16d43a68      0t0  TCP 192.168.1.20:60538->mqfe-cs-mtc02.evip.aol.com:http (CLOSED)
DEVONagen 45556 mikey   36u  IPv4 0x1671ea68      0t0  TCP 192.168.1.20:60516->12.183.124.73:http (CLOSED)
DEVONagen 45556 mikey   37u  IPv4 0x16700270      0t0  TCP 192.168.1.20:60477->64-4-170-250.a:http (CLOSED)
DEVONagen 45556 mikey   38u  IPv4 0x16d55270      0t0  TCP 192.168.1.20:61133->names.whitepages.com:http (CLOSE_WAIT)
DEVONagen 45556 mikey   39u  IPv4 0x16d5a270      0t0  TCP 192.168.1.20:60486->64.213.163.112:http (CLOSED)
DEVONagen 45556 mikey   40u  IPv4 0x152abe64      0t0  TCP 192.168.1.20:61084->207.211.20.160:http (CLOSED)
DEVONagen 45556 mikey   41u  IPv4 0x16d3da68      0t0  TCP 192.168.1.20:60481->www.classmates.com:http (CLOSED)
DEVONagen 45556 mikey   42u  IPv4 0x1600ee64      0t0  TCP 192.168.1.20:61064->66.186.18.10:http (CLOSE_WAIT)
DEVONagen 45556 mikey   43u  IPv4 0x11a86a68      0t0  TCP 192.168.1.20:60490->64.213.163.73:http (CLOSED)
DEVONagen 45556 mikey   44u  IPv4 0x16d5d66c      0t0  TCP 192.168.1.20:61118->www.wink.com:http (CLOSE_WAIT)
DEVONagen 45556 mikey   45u  IPv4 0x16d5ea68      0t0  TCP 192.168.1.20:60493->38.113.185.60:http (CLOSED)
DEVONagen 45556 mikey   46u  IPv4 0x16d68a68      0t0  TCP 192.168.1.20:60534->63.240.4.124:http (CLOSED)
DEVONagen 45556 mikey   47u  IPv4 0x16d41a68      0t0  TCP 192.168.1.20:60976->208.237.178.123:http (CLOSED)
DEVONagen 45556 mikey   48u  IPv4 0x16d48270      0t0  TCP 192.168.1.20:60542->63.218.71.42:http (CLOSED)
DEVONagen 45556 mikey   49u  IPv4 0x16700e64      0t0  TCP 192.168.1.20:60497->secure.whitepages.com:https (CLOSED)
DEVONagen 45556 mikey   50u  IPv4 0x16711a68      0t0  TCP 192.168.1.20:60643->cedar.olemiss.edu:http (CLOSED)
DEVONagen 45556 mikey   51u  IPv4 0x16d59e64      0t0  TCP 192.168.1.20:60503->www-f.facebook.com:http (CLOSED)
DEVONagen 45556 mikey   52u  IPv4 0x16718e64      0t0  TCP 192.168.1.20:60622->207.36.175.70:http (CLOSED)
DEVONagen 45556 mikey   53u  IPv4 0x16d61a68      0t0  TCP 192.168.1.20:60508->p3swh078.shr.phx3.secureserver.net:http (CLOSED)
DEVONagen 45556 mikey   54u  IPv4 0x16d4b66c      0t0  TCP 192.168.1.20:60554->new.ratemds.com:http (CLOSED)
DEVONagen 45556 mikey   55u  IPv4 0x16714e64      0t0  TCP 192.168.1.20:60819->199.239.137.224:http (CLOSED)
DEVONagen 45556 mikey   56u  IPv4 0x16d50a68      0t0  TCP 192.168.1.20:60513->70.130.96.66.static.eigbox.net:http (CLOSED)
DEVONagen 45556 mikey   57u  IPv4 0x1670d66c      0t0  TCP 192.168.1.20:60609->www.questia.com:http (CLOSED)
DEVONagen 45556 mikey   58u  IPv4  0xda7a270      0t0  TCP 192.168.1.20:60519->63.240.4.97:http (CLOSED)
DEVONagen 45556 mikey   61u  IPv4 0x16d4166c      0t0  TCP 192.168.1.20:60520->www.forbes.com:http (CLOSED)
DEVONagen 45556 mikey   62u  IPv4 0x1671466c      0t0  TCP 192.168.1.20:60535->mail.djc.com:http (CLOSED)
DEVONagen 45556 mikey   63u  IPv4 0x16d6366c      0t0  TCP 192.168.1.20:60648->199.239.137.206:http (CLOSED)
DEVONagen 45556 mikey   64u  IPv4 0x16d4ba68      0t0  TCP 192.168.1.20:60604->199.239.136.92:http (CLOSED)
DEVONagen 45556 mikey   65u  IPv4 0x16d3ca68      0t0  TCP 192.168.1.20:60544->apache2-moon.ovaltine.dreamhost.com:http (CLOSED)
DEVONagen 45556 mikey   66u  IPv4 0x16d4da68      0t0  TCP 192.168.1.20:60592->63.211.255.103:http (CLOSED)
DEVONagen 45556 mikey   67u  IPv4 0x16d5466c      0t0  TCP 192.168.1.20:60546->www.whitepages.com:http (CLOSED)
DEVONagen 45556 mikey   68u  IPv4 0x16d58a68      0t0  TCP 192.168.1.20:60551->www.fangraphs.com:http (CLOSED)
DEVONagen 45556 mikey   69u  IPv4 0x1600d270      0t0  TCP 192.168.1.20:60646->216.71.215.112:http (CLOSED)
DEVONagen 45556 mikey   70u  IPv4 0x16d3d66c      0t0  TCP 192.168.1.20:60667->www.redwiredesign.com:http (CLOSED)
DEVONagen 45556 mikey   71u  IPv4 0x1600de64      0t0  TCP 192.168.1.20:60870->202-160-117-178.colo.onesquared.net:http (CLOSED)
DEVONagen 45556 mikey   72u  IPv4 0x152aa66c      0t0  TCP 192.168.1.20:60558->72.32.86.198:http (CLOSED)
DEVONagen 45556 mikey   73u  IPv4 0x16d44e64      0t0  TCP 192.168.1.20:61119->134.62.129.212.te-dns.org:http (SYN_SENT)
...
2

It’s been a while. Has anyone looked into this?

3

DEVONAgent is using Mac OS X’s networking, unfortunately the one of Leopard has several issues (e.g. random crashs).

4

Could I get more details about what you’ve uncovered about my particular issue? Is there a radar ticket open to Apple about it? Have you considered any workarounds? Have you looked at other tools that open/close lots of connections to see how they have worked around similar problems?

I am getting a little frustrated at the apparent apathy that is displayed in the answers to the various questions I have posted. Every answer is: you can’t do that or it’s not our fault or no answer at all. Grrr.

Is this the correct place to get problems addressed (not commented on, but addressed), or am I just wasting my time?

5

That’s the status quo and this won’t change until DEVONthink 2.0 will be final, I’m afraid.