Searching Closed Captions in Video Files

I’m sure there are other workarounds, but it’d be awesome if there was a way for DEVONthink to be able to index and search embedded closed captions in .mp4 or .mov files. I like to save YouTube videos, etc. that sometimes have embedded closed captions to my database for later reference, and it’d be cool if all the content inside that video became part of DEVONthink’s database.

Never used this but if you could post a download link then I’ll check whether this might be doable in the future.

Sorry for the delay here. Did you want an example .mp4 with embedded captions? Or just an .srt file?

@cgrunenberg
I too would like to see DT search videos with embeded close captions. I see that the video player inside of DT can enable subtitles and DT can read SRT files. Attached are both a SRT file with sample captions and a mp4 embedded with those captions.

For the time being, I keep the captions as text inside of the mp4 file in the annotation section. The downside is that if I set the scope to the group containing the mp4, nothing is returned as annotations are kept in a different location. Searching annotations yields results but navigating to the video is too much hassle as it requires searching for the video which clears your search results and when found said video it requires scrolling to the timestamp noted in the SRT file.

It would be very helpful if DT could read a SRT file or mp4 with embedded captions and auto generate timestamp (frame links as referred in DT) inside of the annotion section of the mp4 with the captions.

Example.zip (12.6 MB)

I understand srt is a human readable text file. Would it work if you simply duplicate it, and rename the extension of the duplicate to txt?

I presume the real challenge is in embedded subtitles without an accompanying srt or something alike.

Yep, already doing that by copy & pasting the SRT contents into the mp4 annotations.

Yep, text annotations would be more helpful if they were links that DT auto creates/recognizes from SRT format shown below. Likened to the way PDFs can be OCR’d with a click of a button. The idea would be to take the start time and create a DT frame link. When the link is clicked, it would take you to the video, to that specific frame/time.

This can already be done manually by clicking the gear :gear: button of the video player and selecting copy frame link. However, aint nobody got time to be creating frame links for hundreds of individual captions for one video when you have hundreds of online course videos. :sweat_smile:

image

Are there any updates on this? Or did you still need me to upload a sample .mp4 with embedded captions?

This isn’t supported currently and the next release(s) won’t change this yet.

Okay thanks for the update.