Now that I’ve installed DT4 Beta, I’d like to test the AI functionality. Unfortunately, I get an “Unknown error” for every question I ask. It doesn’t matter whether I’m asking a general question about a city’s population or a database-related question (e.g., “Show me billings from Vodafone in 2024”). I’ve tried the question in German and English. I probably have a wrong setting. I’m using GPT4All with the “EM German Mistral” model. Does anyone know what’s wrong?
(with Google Translate)
Last time I checked this model (probably in 2023) it was a very poor one, I would recommend to try a different one. Or use LM Studio or Ollama with a modern model like Mistral Small 3.1 or Gemma 3.
When I ask “Show me billings from Vodafone in 2024,” I get the following result with Wizard 1.2:
“The Great Gatsby” by F. Scott Fitzgerald: This classic novel is a poignant exploration of the American Dream, love, and wealth in the Jazz Age. It’s set against the backdrop of…"
Under Snoozy, I get the error message “Unknow Error” again.
Okay, then I’ll take a look at the two alternatives mentioned in the next few days. I asked the question directly in the DT4 chat window, not in GPT4All. I used GPT4All because it is mentioned as compatible on their blog.
The next beta will work around some template issues of GPT4All when using old models like Mini Orca (Small) or EM German Mistral. In case of other models, e.g. Wizard v1.2, that’s not possible. Models based on LLama or DeepSeek work as expected already and are highly recommended instead.
Model recommendations are governed by the limited by your hardware. You’re not going to run a 32b model on anything less than a 32GB RAM machine, and even then it’s likely not going to be very performant.
In the view, for example. With DeepSeek, I get all the documents I’m looking for displayed in the DT document list. With other models, I only see a few links to the documents I’m looking for in the chat window.