How do I use Exa.ai

Yes, I’ve read the docs and already configured the settings in AI search. (screenshot)

I’ve searched the documentation for “deep research” but it only comes up in the latest release notes, a deep research model in Perplexity (where it says it is only available in the chat assistant) and mentioned as part of the AI Template > AI Research Report. And the AI research report doesn’t provide an option to select “exa.ai” just a prompt. (screenshots)

I have 3 questions:

1) Where in the interface (not settings) can you select exa.ai to run a deep research? It is not available to select in AI Models within chat interface like Perplexity Deep Research.

  1. If I select “DEVONthink” as my AI Search model, where do I initiate a search (not available as a model to select)?

  2. Is Deep Research mode only available with the 3 models (DT, Perplexity, exa.ai)? I’ve been prompting other LLM models (ChatGPT, Claude, Gemini) I’ve selected to do “deep research” on a topic and the LLM responds that it is doing deep research. Is that not accurate?

– Related, I’ve purchased and used DevonAgent Pro and have used it in the past. Now I prefer an AI tool for its Natural Language capabilities (less search term based). What’s the future for web research at Devon Technologies?

(Moved to the appropriate forum section. BLUEFROG)

Again, these are not chat models to interact with so you can’t “choose deep research with Exa”.

LLMs have their own dataset, even commercial ones like ChatGPT. They build their responses from that data and should require you to opt in to searching outside those confines. This is why web and Wikipedia searching is not assumed in DEVONthink and requires you to enable the options, if desired.

If you allow Web or Wikipedia in the AI > Search settings, the chosen Web & Wikipedia option will be used to perform that part of the search. That’s it.

Here are side-by-side examples of the same search performed with each option…

Thanks for the screenshots.

I understand that the AI Search setting will automatically set the search model. I won’t be prompted to pick a search model.

Can you show me where you entered the term you searched (Pickling?)

I’ve tried the two following methods:

  1. Using global search or search inspector, I just get results from my DT database.
  2. Using AI Chat, I am forced to pick a model (and exa.ai isn’t one of them).

I must be missing something, but I don’t see anything re: web, PubMed, database from DT4 documentation when searching for the term “search” other than AI search settings. I’ve gone through the first 10 results so far, and I am not finding it. (screenshot)

I’ve never used DT4 for web research. As I mentioned, I used Devon AgenyPro for this purpose but not DT4.

You can’t directly use this, only the chat assistant and likewise chat-related features in smart rules, batch processing, scripts and templates can use this for their research to get additional or more recent knowledge. E.g. just enter in the chat assistant a prompt to search the web for a certain topic and to summarize the results in a table.

Please clarify why you’re using the term search, i.e., how are you trying to use external AI ?


The documents I showed are made via the Chat assistant, in this case the Chat popover (which is inconsequential to the results).

I used a simple zero-shot prompt of “Tell me something about pickles.”, not a deep and recursive type request. But it does illustrate differences in the way the results are returned.

PS: Via the Help assistant

PPS: DEVONagent is doing things differently than an AI search.

I’m using the term “search” to within the search form at the top of DEVONthink help documentation. I don’t anything in the documentation that covers how to do a web search once you’ve set the AI Search Settings.

I’ve marked up your screenshot at the bottom of your search you have Claude 3 Haiku selected. Doesn’t that mean that you are using Claude to answer the question or the one set in AI search settings.

  • Note: Claude Haiku 3 is not longer an option in DT 4.2
  • I’ve rerun the same prompt “Does external ai search the web” using Claude 4.5 Haiku (because I must select a model) and getting different results.

I’ve also run the prompt “Tell me something about pickles” selecting only the web option within the chat interface. I still have to select a model and I’ve tried both Claude Haiku and Perplexity Deep Research.

As you can see I’m trying every step you’re recommending and getting very different results.

Doesn’t that mean that you are using Claude to answer the question or the one set in AI search settings.

I am using the Help assistant, not making a web search. The Help assistant specifically works with our documentation and DEVONthink chooses the most affordable but still effective available AI model for Help queries.

and getting different results.

You aren’t going to get the same exact results as I showed. Expect for very specific prompts, you won’t get the same results from the same AI query. If you’re expecting a static answer, you’re misunderstanding how AI works, especially with simple, barely-directed queries. The results you’re showing in the Chat assistant aren’t incorrect nor are they in any way surprising.

This is a more specific prompt but still with little direction: Give me a thorough analysis of the usefulness of candlesticks in day trading. Provide a chart of pros and cons. If they are effective, return some easy to implement tips on using them. Make sure to verify the tips are practical and cite your sources. The results of this query should contain replies about the topic with a chart/table (even this is ill-defined) somewhere in it. Run it multiple times and you will not get the same response each time.

See the results from from the Perplexity Deep Research prompt – sorry for pasting in the entire amount but I can’t upload a markdown file here – discourse caps at 3200 characters

9:59:05 AM (leehammond)

Tell me something about pickles.

10:00:47 AM (assistant)

The Comprehensive History, Science, and Cultural Significance of Pickles: From Ancient Mesopotamia to Modern Global Markets

Pickles represent one of humanity’s oldest and most versatile preserved foods, with evidence of their consumption dating back approximately four thousand years to ancient Mesopotamia around 2000 to 2400 B.C.[1][4][13] Today, pickles have evolved from a simple preservation necessity into a global culinary phenomenon that encompasses dozens of varieties, production methods, and flavor profiles, with Americans alone consuming over 2.5 billion pounds annually and the worldwide market valued at hundreds of millions of dollars.[16] This comprehensive exploration examines the historical development of pickles, the various production methodologies that create distinct flavor and texture profiles, the documented health benefits and nutritional considerations of different pickle varieties, the remarkable global diversity of pickled vegetables, and the contemporary market trends driving innovation in this ancient food category. The pickle’s journey from a practical food preservation method to a celebrated delicacy reflects broader shifts in consumer preferences toward fermented foods, organic products, and authentic culinary traditions, while simultaneously revealing the complex interplay between food science, cultural heritage, and modern marketing forces that continue to shape how this humble vegetable is produced, packaged, and consumed worldwide.

The Ancient Origins and Historical Development of Pickling

The history of pickling extends far deeper into human civilization than most food traditions, with anthropological evidence suggesting that the ancient Mesopotamians were among the first peoples to employ pickling as a preservation technique around 2400 B.C., using brine as a powerful food preservative to maintain vegetables through seasons of scarcity.[1][4][13] Archaeological records indicate that this practice emerged not as a culinary luxury but as a practical necessity in pre-refrigeration societies where preserving the harvest meant the difference between food security and potential starvation during harsh winters or periods of poor crops. The ancient Egyptians similarly embraced pickling, with historical records documenting that fish and other provisions were preserved in brine solutions, and intriguingly, the practice became associated with royalty and beauty rather than merely subsistence.[4][13] Cleopatra, the legendary Egyptian queen, was renowned for her belief that pickles contributed to health and beauty maintenance, allegedly incorporating these fermented delicacies into her personal regimen approximately two thousand years ago, establishing a cultural association between pickles and wellness that persists in contemporary health-conscious consumer segments.[1][16][38]

The expansion of pickling practices throughout ancient civilizations proceeded along trade routes and military campaigns, reflecting how this preservation method facilitated both commercial exchange and military logistics. Julius Caesar, recognizing the nutritional and practical benefits that pickles provided, famously distributed them to his Roman legions as they undertook long military campaigns, understanding that the combination of salt content and preserved nutrients made these brined vegetables ideal for maintaining soldier health and strength during extended deployments.[1][38] The Roman philosopher Aristotle, living approximately twenty-five centuries ago, similarly praised pickles for their purported healing and health-promoting properties, contributing to a philosophical and scientific tradition that positioned pickles as more than mere food but as medicinal substances worthy of scholarly attention.[16] This ancient recognition of pickle benefits laid the conceptual groundwork for modern nutritional science, which would eventually validate many of these historical claims through rigorous biochemical analysis. The practice became so embedded in Roman culture that it spread throughout the Roman Empire’s territorial expanse, eventually finding its way into Eastern European cuisines and becoming particularly prominent in regions where harsh winters necessitated extensive food preservation.[4]

The medieval period witnessed a crucial transformation in European pickle-making when dill, an aromatic herb native to Sumeria and Mesopotamia, began arriving in Europe via new trade routes approximately one thousand years ago around 900 A.D.[1][4] Dill’s journey from the Asian subcontinent to the Mediterranean and subsequently throughout Western Europe represented a pivotal moment in culinary history, as this single herb revolutionized European pickling traditions and established flavor profiles that would become canonical to Western pickle-making for centuries.[1] The arrival of dill coincided with and facilitated a resurgence of pickling practices across Europe, as the herb’s distinctive flavor proved capable of standing up to and counterbalancing the potent acidity of vinegar brines that had become standard in European preservation methods.[1] Unlike the fresh or lightly seasoned pickles of ancient Mesopotamia and Rome, medieval and early modern European pickles developed more complex flavor profiles through the combination of dill, various spices, and regional variations in brine composition. The relationship between dill and European pickling became so pronounced that dill remains the signature flavor of contemporary American pickles, a cultural inheritance traceable directly to medieval European innovations and subsequent immigrant communities’ preservation of these traditional recipes.

The colonial period and early American history witnessed the transformation of pickling from a regional European practice into a foundational element of American food culture, with Dutch settlers in New York during the mid-1600s establishing large-scale cucumber cultivation that would fuel the pickle industry.[1][4] These enterprising Dutch farmers produced massive quantities of cucumbers that were brined and sold on the streets of what would become modern Brooklyn, establishing pickles as one of America’s first recognizable street foods and creating a commercial market that would expand dramatically over subsequent centuries.[1] The word “pickle” itself derives from the Dutch term “pekel,” meaning brine, reflecting the linguistic and cultural imprint that Dutch and subsequently German and Eastern European Jewish immigrants left upon American pickle traditions.[16] The most transformative period in American pickle history occurred during the late nineteenth and early twentieth centuries when Eastern European Jewish immigrants, particularly those with Hungarian ancestry, arrived in New York and other American cities bringing with them centuries-old pickling traditions and expertise.[1][4][16] These immigrant communities introduced what became known as “kosher dill pickles,” fermented in salt brine rather than vinegar and seasoned with garlic, dill, and spices, initially selling their products from wooden barrels and pushcarts but eventually establishing commercial enterprises that would define American pickle culture.[1][35]

The industrialization of pickle production in America represented the final major transition in pickling history, fundamentally transforming the product from a laboriously crafted artisanal item into a mass-produced commodity accessible to the entire population. Nicholas Appert’s mid-nineteenth century discovery that sealing food in glass jars preserved it for extended periods revolutionized the pickle industry, as did John Mason’s invention of the self-sealing Mason jar with its paraffin wax seal.[1] However, the true architect of industrial pickle production was Henry J. Heinz, who recognized the massive commercial potential of pickles and combined traditional kosher dill recipes refined over thousands of years with cutting-edge canning technology and modern distribution networks.[1][16] At the 1893 World’s Columbian Exposition in Chicago, H.J. Heinz famously distributed over one million pickle-shaped pins to promote his brand, an innovative marketing strategy that capitalized on American curiosity and helped establish Heinz as the dominant pickle manufacturer in the United States.[1][16] This historical moment marks the transition from artisanal pickle-making to industrial-scale production, though it simultaneously preserved the kosher dill tradition that had become the gold standard for American pickle consumption. During World War II, the United States government recognized the importance of pickles to soldier morale and nutrition, rationing pickle production and allocating forty percent of national output to military ration kits, demonstrating how this ancient preservation technology remained relevant even in the age of modern refrigeration and alternative preservation methods.[13][16]

The Science and Methodology of Pickle Production

Contemporary pickle production employs three primary methods, each producing distinctly different flavor profiles, textures, and shelf-life characteristics, reflecting centuries of accumulated knowledge about preservation science combined with modern technological capabilities.[40] The refrigerated or fresh-pack method represents the quickest and most contemporary approach, wherein fresh cucumbers are placed directly into jars and covered with a heated pickling solution composed of vinegar and seasonings, with the jars being vacuum-sealed and rapidly pasteurized before cooling.[40] This process creates extra-crispy pickles that retain more of the fresh cucumber’s natural color and flavor while developing the characteristic tangy taste through vinegar’s acidity rather than through fermentation, and these pickles must be stored in refrigerated conditions to maintain food safety and prevent spoilage.[40][45] The fresh-pack method produces a less salty pickle compared to traditional methods, making them appealing to modern consumers concerned about sodium intake, though they lack the probiotic benefits associated with fermented varieties.[6][40]

The processed or fermented method represents the most ancient approach and requires substantially more time than fresh-pack methods, with cucumbers being submerged in salt brine solutions in large tanks where they undergo full fermentation over one to three months.[40][45] During this extended fermentation process, naturally occurring lactic acid bacteria present on the cucumber surface and in the brine convert the vegetable’s sugars into lactic acid through anaerobic conditions created by the salt brine, producing the characteristic sour taste and simultaneously generating beneficial probiotics that modern nutritional science has increasingly recognized as health-promoting.[2][9][40] The fermentation process is gradual and controlled, with salt being added progressively throughout the process to ensure even permeation throughout the cucumber tissue, and once fermentation is complete, the pickles are removed from tanks, rinsed of excess salt, and packed into jars with additional seasonings before distribution.[40] Processed pickles typically develop a darker green color and somewhat translucent appearance, with a sharper and more complex flavor profile compared to fresh-pack varieties, and they demonstrate remarkable shelf stability, capable of lasting up to two years when unopened and stored under appropriate conditions.[40][45]

The refrigerated or quick-pickle method exists as an intermediate approach, wherein fresh cucumbers are placed directly into jars and covered with a chilled pickling solution, with the entire fermentation process occurring under refrigeration conditions.[40] This method produces cucumbers that ferment only minimally, developing some of the flavor benefits of traditional fermentation while maintaining the enhanced crispness that refrigeration provides, and these pickles must remain refrigerated and typically carry an expiration date due to their shorter shelf life compared to processed varieties.[40] The choice between these three methods fundamentally shapes not only the final product’s characteristics but also its nutritional profile, cost structure, distribution network, and target consumer demographic.

The specific bacterial species involved in pickle fermentation have been extensively studied by food scientists seeking to understand and optimize the fermentation process for consistency and quality. The initial stages of fermentation are typically dominated by species including Enterococcus faecalis, Leuconostoc mesenteroides, Lactobacillus brevis, Pediococcus pentocaceus, Lactobacillus plantarum, and Lactobacillus pentosus, each contributing distinctive flavor compounds and preservation properties to the developing pickle.[25] As fermentation progresses, competition among these species results in certain organisms becoming dominant based on salt concentration, temperature, and other environmental factors, with Lactobacillus plantarum frequently emerging as the dominant species by fermentation’s conclusion due to its superior salt tolerance and acid resistance.[25] The bacterial metabolism during fermentation generates not only lactic acid, which creates the characteristic sour taste and preserves the pickle through pH reduction, but also numerous metabolic byproducts including acetic acid, formic acid, and various flavor compounds that create the complex taste profile that distinguishes fermented pickles from their vinegar-pickled counterparts.[25]

Types and Varieties of Pickles

The contemporary pickle market encompasses far greater diversity than the dill pickle that dominates American consciousness, with producers offering dozens of distinct varieties differentiated by cucumber type, fermentation method, flavor profile, and regional inspiration. Kosher dill pickles, despite their name not necessarily being certified kosher under Jewish dietary law, represent the most iconic American pickle variety, distinguished by their natural fermentation in salt brine and characteristic garlic and dill flavoring that developed during late nineteenth and early twentieth century Jewish immigrant communities’ preservation of their traditional Eastern European recipes.[32][35] The term “kosher” in the context of these pickles refers to a specific pickling style rather than adherence to Jewish dietary laws, though most major American kosher pickle producers are indeed certified kosher for those observing religious dietary requirements.[35] Genuine kosher pickles are fermented in salt brine rather than vinegar, a distinction that emerged from historical kashrut considerations regarding vinegar sourcing, though modern commercial producers have muddied this distinction by adding vinegar to many products marketed as kosher dill pickles.[32][35]

And what is specifically wrong with this?

PS: Perplexity Deep Research already does its own deep searching, so this is not the best example.

The problem is that it seems the responses coming back from chat use the model and not the search settings I configured (like Exa.ai)

Here’s the response coming from Clade Haiku 4.5

If both LLMs (Claude and Perplexity) are using Exa.ai to search why such wildly different results? (I’m fine with a little jitter in the response but this doesn’t make any sense to me)

This is Claude’s response to same prompt

11:39:38 AM (leehammond)

tell me about pickles

11:39:43 AM (assistant)

Pickles

Pickles are vegetables (typically cucumbers) that have been preserved through fermentation or by being submerged in an acidic brine solution. Here’s what you should know about them:

What They Are

Pickles are cucumbers that have undergone a preservation process, transforming their texture, flavor, and shelf-life. The most common type is the pickled cucumber, though other vegetables can also be pickled.

Preservation Methods

Fermentation (Traditional)

  • Uses salt brine to create an environment where beneficial bacteria (lactobacillus) ferment the vegetables
  • Develops complex, tangy flavors naturally
  • The fermentation process produces probiotics
  • Takes several days to weeks

Vinegar Pickling (Quick Method)

  • Uses vinegar, water, salt, and spices
  • Faster process (can be ready in hours)
  • Provides shelf stability through acidity
  • More straightforward flavor profile

Varieties

  • Dill pickles - flavored with dill and garlic
  • Bread and butter pickles - sweet and tangy
  • Kosher pickles - traditionally fermented with garlic and dill
  • Polish/half-sour pickles - lightly brined, crunchy
  • Refrigerator pickles - quick, no-cook versions

Nutritional Aspects

  • Low in calories
  • Fermented varieties contain beneficial probiotics
  • High in sodium (due to salt content)
  • Source of vitamins (especially if using whole vegetables)
  • Good source of antioxidants from spices and cucumbers

Cultural Significance

Pickles have been made for thousands of years across many cultures-from Eastern European to Indian cuisines-and remain a staple condiment worldwide.

Would you like more details about any specific aspect?

I’ve run another pickle prompt this time with ChatGPT 5 nano. See below.

Claude and ChatGPT don’t return any reference URLs, the Perplexity Deep Research model does But as you noted selecting the Perplexity Deep Research model is not a good example for comparison.

Shouldn’t deep research with exa.ai return references?

– Chat GPT Output:

11:54:35 AM (leehammond)

tell me about pickles

11:55:29 AM (assistant)

Here’s a concise overview of pickles, covering both the food and the Python serialization module. If you want depth on a specific part, tell me and I’ll dive in.

1) Pickles as Food

  • What it is: preserved vegetables (most often cucumbers) preserved in brine (saltwater) or vinegar, sometimes with sugar and spices to flavor.

  • Two main methods:

    • Fermentation (lacto-fermentation): vegetables sit in a salt brine. Beneficial bacteria convert sugars into lactic acid, which preserves the produce and gives a tangy flavor. No vinegar needed. Needs correct temperature and clean equipment.
    • Vinegar-based pickling (quick pickles): vegetables are preserved in a vinegar solution (often with salt, sugar, and spices). Usually refrigerated and ready faster.
  • Common varieties:

    • Cucumbers: dill pickles (classic), kosher/dill-speared, sour pickles, bread-and-butter (sweet and tangy), half-sours.
    • Non-cucumber options: pickled onions, beets, carrots, peppers, garlic, cornichons (tiny French pickles), okra, radishes.
    • Fermented/Traditional: sauerkraut (fermented cabbage), kimchi (Korean fermented vegetables with chili and seasonings), tsukemono (Japanese pickles).
  • Flavorings you’ll see: dill, garlic, mustard seeds, peppercorns, coriander, bay leaves, chili peppers, sugar.

  • Storage & safety:

    • Quick pickles: refrigerate; typical shelf life 2-4 weeks.
    • Fermented pickles: longer shelf life if properly salted and kept in a cool environment; once opened, refrigerate.
    • Safety: discard if off smell, slimy texture, or visible mold on the surface.
  • Quick recipe (Refrigerator Dill Pickles, makes about 1 quart)

    • Ingredients: 2 cups cucumber slices, 1 cup water, 1 cup white vinegar (5%), 1 tablespoon sugar, 1 tablespoon salt, 2 garlic cloves (sliced), 2 tablespoons fresh dill (or 1 tablespoon dill seeds), optional: 1 teaspoon mustard seeds, 1/2 teaspoon peppercorns.
    • Steps:
      1. Pack cucumbers with garlic and dill in a jar.
      2. Bring water, vinegar, sugar, and salt to a simmer until dissolved; pour hot brine over cucumbers.
      3. Let cool to room temp, then refrigerate. Flavor develops in 24 hours; keeps 2-4 weeks.
  • Quick note on fermentation vs. vinegar: fermentation builds acidity via biology (lactic acid), while vinegar pickles rely on acetic acid from the brine. Both preserve; fermentation can add probiotic notes, but accuracy in salt and temperature is key.

2) Pickle (Python)

  • What it is: Python’s standard library module for serializing and deserializing Python objects to and from a binary format. Useful for saving complex objects or sharing between processes.

  • Basic usage:

    • Serialize (save):

      import pickle
      
      data = {'name': 'Alice', 'numbers': [1, 2, 3]}
      with open('data.pkl', 'wb') as f:
          pickle.dump(data, f)
      
    • Deserialize (load):

      with open('data.pkl', 'rb') as f:
          data2 = pickle.load(f)
      print(data2)
      
  • Security caveat:

    • Never unpickle data from untrusted sources. Unpickling can execute arbitrary code. For untrusted data, prefer safer formats like JSON (if your data fits).
  • Alternatives:

    • json: portable, text-based, safer for untrusted input; limited to basic types.
    • dill: an extension of pickle that handles more Python objects.
    • Other formats (yaml, msgpack) for specific needs.
  • Use cases:

    • Caching Python results, persisting complex Python objects, inter-process communication where Python objects are exchanged.
  • Quick notes:

    • You can specify a protocol version (e.g., protocol=pickle.HIGHEST_PROTOCOL) for compatibility or efficiency.
    • Pickle is Python-specific; data picked in Python isn’t readily usable in other languages without custom tooling.

Would you like me to save this as a new note in your currently selected Markdown document, or tailor this to a particular cuisine, recipe, or Python use-case?

We aren’t controlling what the LLMs return. Could Exa return URLs? Yes, and they did in my test. However, were they listed out like using Perplexity’s web search? No. And honestly, my contrived example could certainly lead to different results. You are talking about different LLMs, with different datasets, built independently, and engineered to respond in their own ways.

I think you are expecting a uniformity that is not going to happen when varying models like this. In fact, what you’re doing is atypical (and I have to do it for support and documentation purposes): most people settle on an AI provider and stick with it.

1 Like

That’s what I’ve done, but I’m not hooked it into DEVONthink – for a number of reasons.

1 Like

No I’m not expecting uniformity of response across LLMs

I just want confirmation that exa.ai is overriding the selected models own database when performing a web search.

Is there anyway to verify this is the case via DT UX or DT logfile?

@rmschne thanks, I’m not testing out different models. Just the exa.ai feature that was added in latest release. I can’t tell if it’s working - no DT UX that indicates that.

If you find it please post a screenshot.

@BLUEFROG

I have a related question to the AI Settings that could explain my confusion:

Do the DT settings for Chat (Role), Search, and Summarization act as System level prompts for the AI model?

Does this mean that regardless of what is in my specific chat prompt the DT settings always override my specific chat prompt, For example:

  • I can’t declare a new role different within Chat
  • I can’t declare a search mode (deep research) or different Sources and Web Search AI engine (perplexity, DEVONthink, exa.ai)
  • I can’t declare a different Summarization format?

This might explain why I’m not seeing any feedback and some other issues I’m running into in other areas.

No, there is no user-facing information about this nor in the logs. Development would have to assess whether to add such info.

You can define what you want in a prompt, including a role, etc. However, you aren’t talking about the simple examples I’ve used here. And as far as targeting a specific search engine, I suppose it’s possible but it’s also the first such inquiry I’ve seen. That being said, you should still need to enable e.g, Web searching explicitly.

Is this what’s happening under the hood between exa.ai and the selected model.

  • Step 1. I just ran the same prompt “tell me something about pickles: at exa.ai website
  • Step 2. 20 URLs returned along with Title and Description (screeshots)
  • If the same process works within the DT4 Chat then is this correct:
  • Step 3. Exa.ai passes those URLs to the selected model.
  • Step 4. The model answers the questions only using those websites as sources.

If this is correct than can you share a few more details:

  1. Q: Are their any limits to how many URLs are returned from the selected search provider: DT, Perplexity, Exa.ai
  2. Q: What is DEVONthink own search index? Is it something that is cloud hosted?

Development would have to comment on specifics under-the-hood but no we are not hosting anything.