Hi folks,
I’ve not used AI much but the beta of DV 4 made me think it could be useful so I dug out my chatGPT free account details. DV wants to know which version I am using, in the settings, but ChatGPT told me it is using ‘GPT-4- turbo’ (not listed as an option).
It also promised they are planning to simplify the naming methods (which is a great relief, looking at the list of random suffixes they use).
Does it matter which one I put in DV settings?
Cheers,
J
First of all, you need an API key to use a commercial AI service. Just an account to chat with ChatGPT is not enough. And yes, this likely will incur extra costs for you.
There are specific models we make available, based on capability and cost.
Also, check out the Getting Started > AI Explained section in the Help.
Is there a way or plan to use Apple Intelligence in DT? I believe it’s a special fork of ChatGPT and doesn’t require any API to work, no?
No. Apple Intelligence is not an accessible API call to ChatGPT.
I’m curious which part of Apple Intelligence you were wanting to use in DT? I’ve found Apple’s implementation to be… let’s just call it underwhelming. Is there anything Apple’s AI can do that can’t be done better with any other AI? I’m not trying to be crass, I’m honestly curious.
That’s generous 
Apple Intelligence is much more transparent about when it is (and isn’t) transferring your data to another computer. Its “local-first” model is part of why it has underwhelming performance, I suspect.
Whether you care about that probably depends on the nature of your data.
Okay, but that doesn’t really answer the question. You can use a local LLM if you want privacy, so that’s not a reason to use Apple’s AI.
I’m genuinely curious why one would want that as their main AI. Maybe I missed something on what it does, and if so, I’d like to know.
Like many, I eagerly waited for Apple’s AI to be released, thinking that it was going to provide us the ability to use AI without worrying about privacy. Unfortunately, it is so much vaporware it’s not even worth considering, assuming I haven’t overlooked that killer feature of it.
With DT4 it seems there are AI functionalities one can use without having to subscribe to (another) AI model - am I correct? In other words, does DT4 itself incorporate a solid LLM-type sub-routine?
No, there is no LLM built into DEVONthink 4. Read the Getting Started > AI Explained section about how access to external AI is integrated.
With the trade-off of underwhelming performance, according to the posts here.
AFAICT, Apple’s AI does some basic stuff like image classification locally. I don’t know if translation is considered “AI”, but that happens locally, too.
The privacy vs performance issue is very much a having and eating a cake one, imo. One can do basic things on a local machine, apparently – privacy. But for anything interesting, a remote service must be used – no privacy.
Expecting to run a large, helpful LLM on a comparatively small machine is delusion.
Well since Apple has applie intelligence already on Mac, it’s a bit annoying to download a local LLM. And since I have a MacBook Air 2020, local LLM doesn’t perform well where I have no issues with Apple intelligence.
Let’s see how that will evolve in the future.
