Help.
I can no longer add and persist custom metadata and I lost custom metadata for hundreds of files. This only happened today. Was fine yesterday.
Devonthink 3.9.8
MacOS 15.1.1
Help.
I can no longer add and persist custom metadata and I lost custom metadata for hundreds of files. This only happened today. Was fine yesterday.
Devonthink 3.9.8
MacOS 15.1.1
Perhaps, if not done already, do a reboot of the machine?
Yes I did. I also updated to MacOS 15.2, no change.
I can try my backups when I get home.
After my moment of panic I did more checks. The inability to persist custom metadata only affects two databases, and unfortunately the two that are heavily dependent on them.
See the Troubleshooting section of the DEVONthink Manual (and in Help). Perhaps do a Verify and Repair, and if necessary and a Rebuild.
However, Iâd wait to do anything until others who certainly know more than me comment here.
Where are these databases located and whatâs their file extension (.dtBase2
or .dtSparse
)?
/Users/me/Databases
File extension is .dtBase2.
As reminded by @rmschne, I did a Verify and Repair. An issue came up when I tried âCheck File Integrityâ of the affected databases, it returned a huge number of âFile doesnât have checksum yetâ. Although it was okay when I last did the check for my last monthâs backup export.
Did DEVONthink or the computer freeze/crash? Has been always enough disk space available? There are probably only two options:
In both cases backing up the current database first (e.g. by duplicating or zipping it in the Finder while DEVONthink isnât running) is recommended.
I will give it a try and report back.
I should also add that last month I copied and transferred the databases to a new mac per this guide. Could it have affected the database? And no, neither the app nor computer crashed, there is sufficient disk space.
This shouldnât cause any issues as long as thereâs enough disk space, DEVONthink isnât running during the migration and the permissions arenât messed up afterwards.
Please select the database in the Finder, choose Show Package Contents in the contextual menu and then check the permissions of the .dtMeta
and .dtMetaStore
files inside the package. Do you have read/write permissions for all of them?
Yes I do have the necessary permissions.
I have sad news to report: my oldest backup created in end October has the missing metadata too. Which may suggest this issue started some time back.
However, rebuilding the my current database managed to return the function to add custom metadata. But Iâm worried. I do Verify and Repair Database and Verify File Integrity checks before doing my monthly backup with no issues. I also rebuild my databases quarterly.
Considering these databases were active for about 4 years, I wonder if creating a new database and transferring my files might help. Or if I should try reinstalling DT? Any suggestions?
Donât you run TimeMachine for semi-continuous backups? Or any other automatic service like Arq that regularly backs up everything at least once a day and keeps older backups around for some time?
Maybe you should.
Did you migrate before or after creating this backup?
I have two existing backups and they were made before the migration.
This is admittedly a lazy mistake on my part. I have daily time-machine backups for my old mac but have not setup for my new mac. This is a brutal reminder to get it rectified.
A good rule: If your data is important to you, a backup should be treated like auto insurance. You shouldnât drive before your car itâs insured and you shouldnât start actively using your Mac before getting your backups set up and started.
To be clear the problem is not with the documents. But the sudden disappearance of the custom metadata.
My use of the custom metadata are predominantly for reference purposes, which is relatively trivial to recreate per document and per needs basis. Itâs only a chore if I want to recreate them for all my documents at once â which is unnecessary.
My files, annotations and tags are still available, which are the most important parts. This is why after the initial panic I am not overly concerned with the lack of immediate backup. Also to be fair it wouldnât help in this particular case since the disappearing act seems to begin months ago. The next step for me is to go through the time-machine backup drive for my old mac to see if I can pinpoint the moment the issue occurred.
Now that I am calm, the issue I want to narrow down is how and why this happened, and how can I prevent it from happening again.
Can I ask if the meta data fields are still there and it is their content that has disappeared, or the metadata fields themselves? If content, I would suggest checking smart rules/scripts (if you have any) that populate these fields. It could be an accidental rerun on a document clears out data already in a metadata field (I had this happen as me as my selection didnât exclude documents with already populated fields and a second pass caused âblankâ to be written into/over what was previously there).
Okay, I did some further investigations and I want to apologise for some inaccurate information given earlier.
Database cannot add and retain new custom metadata values.
Fixed by rebuilding database.
Only affects databases that contain files with custom metadata values (added in old mac)
Check File Integrity yields multiple errors
Files that contained custom metadata values (added in old mac) yield the result âFile doesnât have a checksum yetâ.
Fixed by rebuilding database. But values are still missing.
Custom metadata values added in the old mac fail to migrate over
Given that the custom metadata are imported I think via the DT folder in Application Support, could there be some kind of a linking issue? Like the values still exist in some form in the older database, but this new DT installation doesnât know how to read it or map it.
(Iâm spitballing here, Iâm not a programmer. I donât know how any of these work.)
When you migrated the databases, exactly how did you do this.? Via a wire, disk, cloud service? And what did you copy? A zip archive copy of the database, or the database âpackageâ (e.g. file by file in package)?
And yes, IMHO, after creating a new database from another machine at minimum I would do a a verify and go from there (including repeating the copy).
Hi,
Maybe this is a âred herringâ but I had problems with my Custom Metadata some time ago. A reinstall of DT fixed that. Custom Metadata missing
Best regards,
Björn