Bonjour sync issues

Hi!

I have recently switched syncing method, as some of you know, from Cloud Kit to Bonjour, to sync DT3 with DTTG3.

I have also started unifying my databases, because I would like to make better use of duplicated files, e.g. duplicating a resource into a project group, instead of either relying on separate groups or creating a copy of said resource. I have had to unify the databases because duplication does not work across databases.

In doing so, I also indexed folders that historically contain a lot of files (but I didn’t think that would be a problem for DT) and, perhaps more of a problem, currently live in Apple iCloud documents or MS OneDrive (60K files out of 150K). All in all, that’s 75GB as reported by DT3 database properties. Unfortunately, I don’t get much of a say about where these files live, as they are from work.

I easily established a Bonjour sync with an iPhone, that I initiated before unifying the databases, and which caught up quite well, in seconds really. I also have no issue to report about the database itself at the moment, which is verified and repaired, optimised and everything.

I am now having problems syncing with an older iPad, using Bonjour + On Demand “shallow” syncing: the syncing is taking ages (in fact it has not finished yet), the Bonjour connection breaks down. I can think of many reasons why that would be, given the above. I have initiated the syncing over the weekend, and the little feedback I get is that the Bonjour connection times out once in a while.

Given the above,

  • Is that a good strategy? What would be a better strategy?
  • Why would the Bonjour server on the MacBook time out?
  • Does the Bonjour syncing resume when the connection is back up?
  • How can I monitor how things are going?

Thanks!
Have a fantastic week everyone!

Etienne

  • What is the reason for doing this?
  • Did you reading the In & Out > Importing & Indexing section of the built-in Help or manual?
  • Is that a good strategy? What would be a better strategy?

Are you asking about the Bonjour syncing or the indexing?

  • Why would the Bonjour server on the MacBook time out?
  • Are you on WiFi?
  • Is the Mac awake and running DEVONthink?
  • Does the Bonjour syncing resume when the connection is back up?

Yes.

  • How can I monitor how things are going?

There is an activity indicator at the bottom of the item list in DEVONthink To Go and the Window > Activity panel in DEVONthink.

  • Did you reading the In & Out > Importing & Indexing section of the built-in Help or manual?

(I am swapping the order of your questions!)
Yes, I did read both and also the Take Control of DT3 document, but it was a while back.

  • What is the reason for doing this?

As you prompted me to have a look at the above documents again, I realise I have been using the wrong vocab in my initial post: I want to be able to use replicates (not duplicates) of resources from resource groups, into project groups. And thus, some of the cloud-based (for lack of a better word) folders in Finder are indexed “resource” groups in my DT database, … or so I hoped.
Ideally, I would be able to keep the files in situ, within their home folders, and later create replicates in new projects groups if and when needed. Hence, unified my databases, as I don’t believe one can replicate a file across databases.

Me: Is that a good strategy? What would be a better strategy?
BLUEFROG: Are you asking about the Bonjour syncing or the indexing?

Both, I suppose.

  • Are you on WiFi?

Yes. I also had the iPad plugged with USB to the laptop, initially for charging but maybe Bonjour takes advantage of that direct line? (didn’t make a notable difference)

  • Is the Mac awake and running DEVONthink?

Ah good point. I imagined so, but perhaps not. It seems “Wake for network access” was set at “Only on Power Adapter”. I am not 100% certain that was the case.

There is an activity indicator at the bottom of the item list in DEVONthink To Go and the Window > Activity panel in DEVONthink.

Indeed, but I have not found them to be particularly verbose; e.g. I would have liked to be able to monitor the Bonjour connections. The more useful piece of information is the change of icons on DTTG3, but even that doesn’t quite explain what is going.

Thanks for your invaluable help, Jim! As usual!

What I will do:

  • Remove the indexed groups for now, to troubleshoot the Bonjour connection.
  • Progressively index distinct folders into my one database, to test the water. I had already been doing that, but perhaps I became a bit greedy, seeing as it all worked really smoothly.
  • Make sure both devices never sleep and ensure I get at least one full sync.

Anything else, I should keep in mind?

Etienne

You’re welcome :slight_smile:

Yes. I also had the iPad plugged with USB to the laptop, initially for charging but maybe Bonjour takes advantage of that direct line? (didn’t make a notable difference)

If WiFi is still on and Bonjour is allowed, it will take precedence over syncing-by-wire.

  • Remove the indexed groups for now, to troubleshoot the Bonjour connection.

Be careful here and recheck the Indexing and the filesystem subsection in the Help section I mentioned. Specifically look at the part about deletions. Removing the indexed parent is the safer bet.

  • Progressively index distinct folders into my one database, to test the water. I had already been doing that, but perhaps I became a bit greedy, seeing as it all worked really smoothly.

It’s often good to index more specific Finder folders. Again, see the documentation about deletions.

  • Make sure both devices never sleep and ensure I get at least one full sync.

While they do need to be on, on the same network, with DEVONthink or DEVONthink To Go open, you usually only need to babysit the devices on the initial sync.

Thanks! Yes, I’ll be careful with deletion.

Is it a stretch to think that DT3/DTTG3 can handle that many files?

Have an amazing week!

Etienne

Either can handle 60,000 files but ask yourself what you need to accomplish before you act on what you want.

Hehe yes, you are right. I am just trying things out at the moment.
Thanks again for your help!

Etienne

1 Like