DT# Indexing creating duplicates

I have tried several times to index a folder that has 39k+ items (all attachments to my Bookends bibliographic manager). The folder is on the iCloud Drive, and in the Index process a large number of duplicates are created – last effort there were more than 2500. I have cleaned up the folder itself so it contains no duplicates, and DT seems to be creating most of the remaining.

My naming protocol for most of the files in the folder is “name year”, e.g. Dubnick 2002. The duplicate created is usually the file with an additional year added, e.g., Dubnick 2003, which seems to indicate that DT is creating the duplicate and giving it the next number in sequence.

In searching in the forum I notice some similar issues (none recently), but they seem to be associated with the use of iCloud Drive folders.

Is it my settings? My use of the iCloud folder? Appreciate any advice.

DEVONthink doesn’t create or rename files automatically and uses a different numbering scheme when actually creating duplicates. Do you use any smart rules or scripts or any other automation tool?

I disabled/removed all smart rules and Started indexing a fresh database of folder – also closed Hazel which is the only other possible source of automation (that I am aware of).

Ran fresh database indexing of same folder with same results (still in process but already nearing 2000 duplicates, many of them “created” in same way.

Checked in with Jon at BE and he said it can’t be related to the iCloud folder…

Any further suggestions most welcome…
I will keep trying different possibilities…

[added: Jon meant it was not related to BE’s use of iCloud – may still be iCloud issue unrelated to BE]

This “year” number increase I’m 100% sure it is an iCloud Drive bug. It happens without the help of any 3rd party tool if the network connection is not much good. It seems is the remainder of something Apple tested and forgot to remove from some servers. I had it a lot of time, any file ended in 4 digits, started increasing numbers along time. However, one day it stopped doing it, and never happened anymore.

Edit to add: it happened not inside indexed DT folders, but in other folders not related to DT or any other program. I use to save my reading list, reading comments, and so in format, and suddenly I went in the future, having next year’s documents added from an Apple Time Machine. :sweat_smile: :joy:

4 Likes

Hold the Option key and choose Help > Report bug to start a support ticket. Include a screen capture of the Smart Rules section of the Navigate sidebar and a duplicate selected with the Generic Info inspector open. Thanks.

Took me awhile to get back to problem and tried various possible fixes – none worked. I have a bug report on its way to you…