Ollama or lmstudio

DEVONthink Tips
1

what is your experience with local LLM and DTP4? do you use it for summarizing documents or anything else?

ollama or lmstudio?

which LLM?

or better just to use a cloud based LLM due to significantly better performance?

1 Like
2

Remember, these will be very subjective responses. There is a huge amount of variability in the environment, resources, and capabilities involved with local AI. True, there are some variables with a remote LLM as well, but by and large the commercial models will perform better.

1 Like
3

If you’re mainly interested in summarizing documents, consider using the Writing Tools that arrived with Sequoia. They are not universally wonderful – but even with limited utility they are free, easy to use, and might do what you want.

Writing Tools is in the Edit menu for DEVONthink and most macOS apps.

4

If you’re mentioning the sequoia writing tool integration, it doesn’t work with DT4, it throw an error when I want to use it

5

Which version of macOS do you use and what kind of document did you try? Does it work in e.g. TextEdit?

6

Tested again and it worked. I can’t recall my last update

I’m currently on 15.4.1 with the latest DT4 build