As I am tagging via Chat my large collection of documents (select the documents → right click → Tags → Add Chat Suggestions …" , there are situations where some documents (all PDF) just hang and block processing of subsequent documents. I don’t think there is obvious logic for which documents this occurs.
Can you incorporate a time out feature which would then move on to the next document and log the document that was not processed?
Clarify what you’re doing here, e.g., one PDF at a time or trying to do them all at once?
Are these documents very long? In case of commercial models access might also be throttled.
Large conversion where I select multiple documents.
Not particularly. Most medical journal articles are 10 pages long or so. Once in a while they may be longer (such as clinical guidelines) but even then they don’t exceed 100 pages.
here is a PDF that is hanging up with anthropic
Thank you! Especially Claude 3.x Sonnet is frequently just overloaded. E.g. I get such errors right now too. In the morning (CET) it’s a lot better. One workaround is to use Claude 3.5 Haiku.
I am using Haiku 3.5 for the chat API, “cheapest” usage since I am really only looking for 80% quality on tagging (don’t need to spend the extra cost for marginal improvement in tagging results).
See screenshot;
Please have a look at the file ~/Library/Application Support/DEVONthink/Chat.log. Were any issues logged, e.g. that the service is overloaded?
