# DEVONthink always reports indexed files moved in Finder or Obsidian as missing
**URL:** https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071
**Category:** Tips
**Tags:** automation, devonthink3
**Created:** [June 19, 2023, 2:13pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071 "2023-06-19T14:13:50Z")
**Posts on this page:** 20
**Page:** 2
### Author:  [@cgrunenberg](https://discourse.devontechnologies.com/u/cgrunenberg)
#### Post date: [June 22, 2023, 5:49am UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/21 "2023-06-22T05:49:42Z")
> [@codegeek](#):
>
> DEVONthink detected that they were missing, but “Update Indexed Items” didn’t resolve the problem.
Did you just index the files on their own or their enclosing folders? In which folder in the filesystem were the items actually located?
---
### Author:  [@codegeek](https://discourse.devontechnologies.com/u/codegeek)
#### Post date: [June 22, 2023, 12:31pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/22 "2023-06-22T12:31:04Z")
> I see above that your files are in Apple’s iCloud. My hunch is that if DEVONthink app thinks the files are “missing” it might be because iCloud deleted them on your local machine to “help” you with reducing local disk space.
Thanks, but this is not the issue. These are files I actually deleted from my vault because they were unneeded (mostly duplicates created by a flaky plugin a few months ago). So, it’s not just how iCloud is managing files; these actually should be gone.
> Also, do you really **need** the Obsidian files indexed into DEVONthink? Doesn’t Obsidian do a sufficient job of letting you find and manage the Obsidian files? Just wondering.
No, in the sense that I could survive without the indexing. And of course it’s easy to surface info from within Obsidian. But I _want_ to leverage DEVONthink’s ability to index files to bring together my imported files and other information that doesn’t “live” in DEVONthink, like all of the thinking, connecting ideas, and brainstorming I do in Obsidian.
It all works extremely well together, except for this nuisance of the index not corresponding to what’s actually on my drive by “remembering” deleted files.
---
### Author:  [@rmschne](https://discourse.devontechnologies.com/u/rmschne)
#### Post date: [June 22, 2023, 12:35pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/23 "2023-06-22T12:35:19Z")
thanks for the clarification.
---
### Author:  [@codegeek](https://discourse.devontechnologies.com/u/codegeek)
#### Post date: [June 22, 2023, 12:35pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/24 "2023-06-22T12:35:19Z")
I indexed the actual folder for my Obsidian vault, which lives in iCloud. That is, `/Users/my_user_name/Library/Mobile Documents/iCloud~md~obsidian/Documents/my_vault_folder`.
I have the same problem with other indexed folders not in a cloud storage, though. For example, `/Users/my_user_name/Documents/some_folder_I_want_to_index_in_DEVONthink`. If I use the finder or some other app to delete a file there, DEVONthink will report that file as missing. This happens less often because those folders are pretty static compared to my Obsidian vault, which changes constantly. But it’s still a hassle to find out that `Paper I Wrote 10 Years Ago copy NOT FINAL.docx` is “missing” because I did some minor housekeeping.
---
### Author:  [@cgrunenberg](https://discourse.devontechnologies.com/u/cgrunenberg)
#### Post date: [June 22, 2023, 12:50pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/25 "2023-06-22T12:50:34Z")
> [@codegeek](#):
>
> For example, `/Users/my_user_name/Documents/some_folder_I_want_to_index_in_DEVONthink`.
And the Documents folder isn’t also synchronized via iCloud Drive? Does selecting the indexed group containing the missing items in the item list (e.g. list view) and then using _File \> Update Indexed Items_ fix the issue?
---
### Author:  [@codegeek](https://discourse.devontechnologies.com/u/codegeek)
#### Post date: [June 22, 2023, 1:04pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/26 "2023-06-22T13:04:25Z")
> And the Documents folder isn’t also synchronized via iCloud Drive?
It is not.
> Does selecting the indexed group containing the missing items in the item list (e.g. list view) and then using _File \> Update Indexed Items_ fix the issue?
No. DEVONthink will report any deleted items as missing again the next time it tries to verify the database.
---
### Author:  [@cgrunenberg](https://discourse.devontechnologies.com/u/cgrunenberg)
#### Post date: [June 22, 2023, 1:05pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/27 "2023-06-22T13:05:09Z")
> [@codegeek](#):
>
> DEVONthink will report any deleted items as missing again the next time it tries to verify the database.
Even after trying to update the indexed group as suggested? Are the indexed folders again located on iCloud or local folders?
---
### Author:  [@BLUEFROG](https://discourse.devontechnologies.com/u/BLUEFROG)
#### Post date: [June 22, 2023, 1:32pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/28 "2023-06-22T13:32:25Z")
There are more variables at play here than you’re reporting.
Obsidian has three options on how to handle file deletions.
It’s unclear whether this is Obsidian not registering a filesystem event or DEVONthink not receiving one.
And yes @cgrunenberg, this is from an indexed Obsidian vault in iCloud Drive.
---
### Author:  [@codegeek](https://discourse.devontechnologies.com/u/codegeek)
#### Post date: [June 23, 2023, 12:28pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/29 "2023-06-23T12:28:24Z")
> Even after trying to update the indexed group as suggested?
Yes, unless I either (1) manually delete the missing files from DEVONthink or (2) remove the entire folder from the index and re-index it.
> Are the indexed folders again located on iCloud or local folders?
I have both kinds, but both have the same issue. For clarity and full disclosure: I have some indexed folders in DEVONthink that are located in local folders, one (the Obsidian vault) in iCloud, and a couple in Dropbox. All of them display identical behavior, so far as I can tell.
---
### Author:  [@codegeek](https://discourse.devontechnologies.com/u/codegeek)
#### Post date: [June 23, 2023, 1:30pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/30 "2023-06-23T13:30:45Z")
> There are more variables at play here than you’re reporting.
My apologies. I’m not trying to obscure anything or be difficult, so I apologize if that’s how anything above came across.
> Obsidian has three options on how to handle file deletions.
Mine is set to move files to system trash.
I just looked and do see the some of the files I deleted recently in the system trash. (Some were deleted by a shell script using `rm` and so are already gone forever, as expected.)
To try to figure this out and be as precise as possible, I just ran the following test:
1. Created three files in Obsidian (again, all in my main vault, which is in iCloud), each containing ~1 kB of dummy text:
- `File to Delete from Finder.md`
- `File to Delete from within Obsidian.md`
- `File to Delete via rm.md`
1. In DEVONthink, selected the group corresponding to my Obsidian vault, then _File \> Update Indexed Items._
2. Confirmed that DEVONthink has now indexed all three files.
3. Confirmed that all three files have synced with iCloud but are also still stored locally.
4. Deleted the new files, each via the indicated method (one from Finder, one from within Obsidian itself, and one via `rm` in the terminal). _← This is the point where I would expect DEVONthink to remove the files from the index automatically, just like they would no longer appear in Spotlight, Finder, etc._
5. Checked the status of all three files:
6. In DEVONthink, selected the group corresponding to my Obsidian vault, then _File \> Verify & Repair Database_, which reported 3 missing files:
7. Clicked “Repair,” which failed:
8. Clicked _File \> Update Indexed Items_, which succeeded this time:
9. For completeness, I did a similar test by creating a file in a local folder that is indexed in DEVONthink but is not stored in any cloud (`~/Documents/Some Folder/temp.txt`). When I deleted it in Finder, it also showed as “missing” in DEVONthink. After _File \> Update Indexed Items_, it did not, and subsequently clicking on _File \> Verify & Repair Database_ led to a successful verification.
So, on the upside, _Update Indexed Items_ worked this time, though it has definitely failed several times in just the past few days after similar deletions. I’m still surprised that DEVONthink requires that, though, especially for the local-only indexed folders. Is this expected behavior?
---
### Author:  [@cgrunenberg](https://discourse.devontechnologies.com/u/cgrunenberg)
#### Post date: [June 23, 2023, 1:48pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/31 "2023-06-23T13:48:26Z")
> [@codegeek](#):
>
> So, on the upside, _Update Indexed Items_ worked this time, though it has definitely failed several times in just the past few days after similar deletions. I’m still surprised that DEVONthink requires that, though, especially for the local-only indexed folders. Is this expected behavior?
Filesystem events in cloud folders are limited and files are not automatically removed from the indexed group and manually updating is indeed necessary.
The reason is that e.g. the item could have been moved into the database on a different Mac and the synchronization of the cloud folder & the filesystem event happen before the synchronization of DEVONthink’s database.
Unfortunately it’s impossible to ensure that filesystems events, DEVONthink’s synchronization and the cloud synchronization happen in the order required to handle deletions in indexed cloud folders automatically (and multiple devices and platforms like iPhone & iPad and multiple sync locations don’t simplify this).
---
### Author:  [@BLUEFROG](https://discourse.devontechnologies.com/u/BLUEFROG)
#### Post date: [June 23, 2023, 2:03pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/32 "2023-06-23T14:03:44Z")
> My apologies. I’m not trying to obscure anything or be difficult, so I apologize if that’s how anything above came across.
No worries and you didn’t come across in any bad light. I was just stating there is more at play than simply, _“I deleted a file in Obsidian…”_ as it has multiple options for deletion.
---
### Author:  [@codegeek](https://discourse.devontechnologies.com/u/codegeek)
#### Post date: [June 24, 2023, 1:23pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/33 "2023-06-24T13:23:57Z")
Thank you for this explanation.
Because I do a lot of work in these indexed folders outside of DEVONthink, this kind of thing happens daily. I’m thinking of mitigating it by running _Update Indexed Items_ automatically from time to time. In particular, I’d probably use Keyboard Maestro to run it a few minutes after my laptop boots or wakes, and I’d also assign a global shortcut key.
Do you see any cause for concern in that plan?
Thanks!
---
### Author:  [@codegeek](https://discourse.devontechnologies.com/u/codegeek)
#### Post date: [June 24, 2023, 1:24pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/34 "2023-06-24T13:24:28Z")
Thanks, @BLUEFROG! I really appreciate all your help here.
---
### Author:  [@BLUEFROG](https://discourse.devontechnologies.com/u/BLUEFROG)
#### Post date: [June 24, 2023, 2:14pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/35 "2023-06-24T14:14:58Z")
You’re welcome 🙂
Do you need to have the Obsidian vault in iCloud, e.g., you’re using their mobile app as well?
---
### Author:  [@codegeek](https://discourse.devontechnologies.com/u/codegeek)
#### Post date: [June 25, 2023, 4:11am UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/36 "2023-06-25T04:11:33Z")
> Do you need to have the Obsidian vault in iCloud, e.g., you’re using their mobile app as well?
I do, yes. I use the mobile app heavily, and I moved to iCloud after finding that Obsidian was a bit iffy on Dropbox, at least for me. It’s been a rock-solid setup except for this (the indexing in DEVONthink) piece of it.
---
### Author:  [@BLUEFROG](https://discourse.devontechnologies.com/u/BLUEFROG)
#### Post date: [June 25, 2023, 2:30pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/37 "2023-06-25T14:30:39Z")
I am curious how an alias would work in the situation, e.g., move the vault into its own folder in the root of your home directory, like a **Vaults** folder. Then alias that to the iCloud Drive folder.
Just a thought.
---
### Author:  [@Phileosophos](https://discourse.devontechnologies.com/u/Phileosophos)
#### Post date: [June 25, 2023, 7:09pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/38 "2023-06-25T19:09:51Z")
Thanks for the discussion of this topic, y’all! I just started using Obsidian and was thinking of ways I might leverage it with DT3 and some other tools. This will be helpful.
---
### Author:  [@Harold](https://discourse.devontechnologies.com/u/Harold)
#### Post date: [June 25, 2023, 10:07pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/39 "2023-06-25T22:07:48Z")
I have read through this thread with some puzzlement. I have my Obsidian vault (in iCloud) indexed in DT3. Everything I do to notes in Obsidian is reflected immediately in DT3. I guess I don’t try to perform the tasks that create problems for others, although I don’t understand why I would want to edit, move, add or remove links, etc to my Obsidian notes outside of Obsidian. To me the two programs are complementary. I see thematic connections to non-Obsidian items when I look at Obsidian notes in DT3. But I don’t see Obsidian as a place to store documents or manage records as I do in DT; it’s just my place for creative brainstorming, the place where can easily link up fragments and scraps I write that may eventually develop into something more focused or formal.
---
### Author:  [@Maria](https://discourse.devontechnologies.com/u/Maria)
#### Post date: [June 25, 2023, 11:19pm UTC](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071/40 "2023-06-25T23:19:21Z")
This thread is fantastic. I also use Obsidian for some time now – 2 years with interruptions testing other software; now, I have settled with Obsidian for half a year. I use it for planning, gtd, and note-taking with Obsidian. It is beautiful, flexible, has an excellent editor, and serves some additional purposes like gtd.
I also used to index my Obsidian vault in DTP for precisely the same reasons mentioned by several in this thread. Still, I also had missing files and errors in sync – Obsidian synched via iCloud and DTP via iCloudKit. Maybe the problem is that I sometimes like to work in the Obsidian vault from Devonthink.
Anyway, I ended up with a strict separation of both; my vault is not indexed anymore. When a particular area is finished, I import that into Devonthink for storage and retrieval.
But this makes Devonthink increasingly an archive rather than a working place.
I accepted that with quite some regret.
My PDF library and PDF reading process, e.g., has fully migrated to Zotero, and note-taking is post-processed in Obsidian. Only the results are archived in Devonthink.
Instead of ending up as an archive (valuable though, since it also stores documents and helpful information), I would like Devonthink to take the next steps and (a) either get the flexible and comfortable aspects of Obsidian introduced to Devonthink or (b) find a way to integrate well with the software. – I am not **informed** but only have the **impression** that Obsidian is a clear winner in the note-taking and note-management world and can be taken as a serious partner.
This would return Devonthink’s use cases to everyday work.
So far, some ideas early in the morning; love Devonthink!
Maria
[Previous page](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071.md?page=1)
[Next page](https://discourse.devontechnologies.com/t/devonthink-always-reports-indexed-files-moved-in-finder-or-obsidian-as-missing/76071.md?page=3)