An academic workflow in DT: note-taking, references/bibliographies, and knowledge organization

Hello members of the DT community,

I’m new to the forum, but not to the software, which I used to write my dissertation in the past year and a half. I greatly benefited from this community, silently reading other users’ posts, questions, and comments, and I now want to give back sharing my academic research workflow :relaxed:.
I am a researcher in the field of ancient history, so I have some particular needs (I often deal with dead languages), but as others researchers I mainly read and annotate papers, take notes, link pieces of knowledge, organize them, and write. I discovered DT Pro Office after learning about Luhmann’s Zettelkasten: I started using it to organize my research while writing my dissertation and I will probably stick with it for the rest of my life. I am now on DT3, and could not be any happier with the new update. I am a paper enthusiast, but I also must acknowledge the fact that my life routines (commuting, moving between libraries, etc.) do not get along well with paper support. I thus went 90% digital: most of my research is on my computer.

There are several different pieces of software that I somehow integrated with DT and I use in my workflow: I am going to list them below, along with a description of how I use them.

First comes the reference management software. I tried almost all free(mium) reference management softwares (Mendeley, Paper, Bookends, JabRef, BibDesk), and Zotero has been my final choice mainly for two reasons: plugins and the community, which is very active. I add my references to Zotero, using ZotFile to rename them, and BetterBibTeX to produce customized citation-keys. As all of you know, DT integrates with Bookends but I still prefer Zotero’s flexibility and the possibility to also share my group libraries online (mainly for didactic purpose). Furthermore, Zotero goes well with other two tools I massively use: Atom and pandoc.

I use Atom to write markdown notes; my Atom setup includes Markdown Preview Enhanced package (to preview my notes when needed) and the zotero-citations package by retorquere. This last one is amazing, because it uses the BetterBibTex extension for Zotero to add citations pandoc-style in Atom via Zotero interface.[^1] For those who are not familiar with pandoc-citeproc (see below), it is a very useful way to add bibliographies/references to a document simply typing the citation key that has been generated by Zotero, and let pandoc do the dirty job. I created three DT templates (which I can quickly call with keyboard shortcuts) for my notes:

  • bibliography: to collect bibliographic references on a given topic;

  • quote: to archive pieces of things I read; this might seem an unnecessary or even detrimental habit, since I don’t re-elaborate the concepts I read writing a new note. However, it’s a fast and effective way of collecting materials: then I can stare at my quote-notes for hours while I elaborate concepts in my mind, quickly moving from a piece of knowledge to the other.

  • note: this is the most important (although most hard-working) part of my note taking system. I craft a note of my thoughts (complete with references), which in most cases I am then able to “recycle” when writing a scientific paper.

All notes have a similar title, such as 20200506-11:43:34-Main concepts.md (= %year%%month%%day%-%time%-title), but three different tags (bibliography, quote, note, attached to the template file, so that I don’t have to manually add them). Date and time in the title have the only goal of creating unique file names, even when two notes are about similar topics. In addition, it is important for me to see at later moments which path I followed (what I read, in which order, on which topics my attention was focused), and it is easier to do so if my files are stored in such a way.

The content of the template is quite simple:

---
link-citations: "true"
urlcolor: "red"
geometry:
- a5 paper
- landscape
- margin=1.5cm
---
# title
text

The YAML gives some additional information to pandoc (using LaTeX packages), like the A5 paper format that resembles the size of a real index card (just because I like it, there is no particular need for it actually :grin:).

As I said, I am a paper enthusiast, and I have some sort of eidetic memory for reading scientific papers; I thus use Goodnotes for iPad to annotate PDFs. I keep my annotated PDFs synced in a different folder: it happens often that I share my materials with colleagues and I want to have the possibility to share a clean copy of my files. These annotated PDFs are not in DT, since with time I noticed that I used them mostly through GoodNotes.

After a note is complete (bibliography and notes usually take some time to be finished) I run pandoc-citeproc: I use it both to export my notes inside DT and while writing scientific papers, since it frees me of the burden of writing never ending bibliographies and bibliographic references. I slightly modified a script I found in this forum to run pandoc-citeproc on my notes and export them to PDF. pandoc uses a .bib file I constantly update via Zotero to compile the references, while using a specific citation language style (I am a Chicago Style aficionada).
You might wonder why I write a note in markdown and then export it in PDF; it is mainly because I endlessly take notes on notes: I add comments, highlight text, and so on. Furthermore, the automatic WikiLinks feature with markdown files is are not very effective (in some cases is even misleading) because of the content of my notes (dead languages most often). I thus prefer to link documents using the “Link to” feature. Last but not least, I make large use of all possible formatting while studying documents written in ancient languages: superscript, subscript, italic, small caps, small caps italic, you name it. All this in markdown is fast to type, but hard to read.

After exporting a note to PDF I add tags, and archive it in a folder on the topic I am researching on. If I later discover that one note is interesting for more than one topic, I create a replicant and store it in another folder. I also create a Smart Group using tags if I want to quickly see all the material I collected on a specific topic.

After this whole workflow, the real job is done through DT: I archive my PDFs in a folder managed via Zotero using ZotFile. This same folder is added to DT via indexing, so that when I have a “question” I simply search into DT to find answers. I also index the folders in which I store my paper drafts, so that often DT suggests me note/scientific literature that it considers relevant for that particular topic. This last is for me the most important feature of DT.

I hope this might give other DT users new ideas on how to adapt DT to specific needs. And if you have suggestions, observations, or questions, please share.

All the best,

Erica


[^1]: Previoulsy to switching to Atom, I used Sublime Text which is a very good software. There is a very interesting package for ST which mimics Luhmann’s Zettelkasten features (sublime_zk), but I stick to Atom mainly thanks to the amazing zotero-citations package.

39 Likes

Welcome @palapapanda

Thanks for the thorough explanation of your use and process. I’m sure there are people here that will find inspiration in it.
:slight_smile:

3 Likes

Hi @palapapanda I know this is an old post but it sounds like you’re using Zotero and DT in ways similar to how I want to use them. One question: do you know of any way to enter metadata in DT and then use that to generate citations in Zotero? I want to do all my processing in DT but I want Zotero to generate citations and bibliographies when I’m done writing. Thank you!

If you’re using the Pro or Server edition, you can use custom metadata (see the Settings > Data) to assign arbitrary metadata.

Have you looked at this? It is an old post so I don’t know if it works anymore. Is this post by @rkaplan that is active here?

Yes it is by me. But that app will not work with the current version of Zotero 7, which was a major upgrade.

I do have a more recent version which I have been meaning to share - it works great in Zotero 7 but is not fully documented yet.

To clarify - this app copies data from Zotero to Devonthink (3 or 4). It does NOT copy data/metadata from Devonthink to Zotero.

For this version to work you need to first install the “Actions and Tags” Zotero plugion:

Then you install my Devonthink-Zotero-API as an action within the Actions/Tags plugin:

Then follow the instructions to install the Zotero translator:

README.md.zip (1.2 KB)

Once it is installed - within Zotero you can right-click on a collection and choose “Export to Devonthink”

That brings up the standard Devonthink group selector:

That will create a Devonthink subgroup in the destination of choice which contains each of the Zotero entries with its notes and underlying documents as welll as an HTML summary containing Zotero item links to get you back to the item in Zotero:

4 Likes

Just stumbled upon this thread after majorly changing my academic workflow, primarily to escape the continued enshitification of services I have been relying on.

After taking a good hard look at how I was working and all the fragility related to maintaining a workflow with multiple programs, I have boiled it down to a combination of DEVONthink and JabRef.

DEVONthink manages all reference materials and notes, while JabRef maintains the bibliography. One important caveat: I use JabRef with a PostgreSQL database to manage my bibliography, running on the same server as my webdav sync for DEVONthink - this allows me to sync both DEVONthink and JabRef between my iMac and macbook from anywhere (over encrypted connections).

When designing my workflow I gave myself the following constraints/requirements:

  • every Bib entry must have title, author, year
  • JabRef dictates the name of the file stored in DEVONthink
  • In the Papers group in DEVONthink the structure is [year]/[author][year] - [title] (the first year being a subgroup)
  • Summary notes are markdown files with the same name as the PDF (or epub)
  • JabRef has an additional field ‘DEVONthink’ containing the ‘x-DEVONthink-item://’ item link
  • JabRef uses /tmp as the local file directory
  • JabRef has a specific tab ‘localfile’ with citationkey, title, author, year, file, DEVONthink as fields
  • All annotations are done within DEVONthink or Preview based on the files stored in DEVONthink

My workflow is as follows:

  1. when I find an article of web-article, I download or create a PDF file immediately.
  2. I create a new entry in JabRef with at least title, author, year in the ‘localfile’ tab and generate the Citationkey
  3. From the downloads directory I drag & drop the newly created PDF file into the JabRef entry field. JabRef then creates a new entry in the /tmp directory
  4. From the /tmp/[year] directory, I drag & drop the newly created PDF file into the appropriate Papers/[year] group
  5. With a right-click I get the ‘copy item link’ for that new file in DEVONthink and update the field in JabRef
  6. In Notes/[year]/ I create a new markdown note with the same name and add the item link.
  7. All summaries and highlights are copied to the notes for easy reference.
  8. I delete the original PDFs in /tmp and ~/Downloads
  9. When I need to generate bibliography, I save a copy of the database to a local directory (~/Resources/Research/bibtex.bib) - my database is always leading.

This workflow has helped me tremendously. Since both the notes and the PDF’s all start with the Citationkey, it is very easy to find the citation key when using the search functionality to quickly verify a citation. The combination of identical names for notes and PDF’s also works really well, I frequently don’t read the PDF anymore, instead relying on my copied annotations and the summary in the markdown files (which act like Zettelkasten) and also contain links to other related topics.

As an aside - I also maintain a directory Zettelkasten that contains markdown files with my ideas about these papers and notes - but that is a different story.

Hope this helps someone…

4 Likes

Nice and thanks for sharing!
I’m curious if you’ve considered using an annotation file instead of manually creating a Markdown note ? It takes the name of the referring document and automatically has a backlink (when using a default built-in annotation template)..

Here is a simple smart rule that refiles an annotation file after it’s created.

And the result (and yes, it happens very quickly)

refile-annotation-files

2 Likes

Thanks BlueFrog,

The annotation file is a great suggestion - I think I was just carrying on with copying because that is what I grew into following my move to DEVONthink.

I’m following the ‘Building your Second Brain’ method of progressive summarization in the markdown Notes files, which is why having the summary and annotations copied was my goto behavior.

Let me work with the annotation file and see what that does for me. I’ll make a note and report back.

1 Like

You’re welcome and let us know how (if) it works out for you.