I solved my earlier trouble to capture HTML page within DTP, so now I have my next mission to fix
Let’s say that I have a picture with name agkjkgjsdkgds.jpg and download the picture embedded from an html link that is for test.html with an url link to thisisatest.com/intro/test.html
The thing here for me is to with a help from an applecript to search inside the source code from multiple html files and if it’s find the picture with the name agkjkgjsdkgds.jpg it should take the url location to that picture from the html file it was downloaded from.
So the goal with this is to have for example 1000 html files with any name and search through all 1000 embedded pictures and copy the url to that embedded pictures it finds in the source code
I would really appreciate help with to build a code for this
I download only the HTML pages and when I download the embedded pictures inside the HTML pages.
But the thing here is that the picture link goes to thisisatest.com/fm/agkjkgjsdkgds.jpg But I don’t want that url link. I want the real url adress it come from the beginning. I hope you understand Christian how I mean?
It’s a complicated javascript from the html page but my solution would be to find in the source to the HTML page the pictures name. I know exactly what to do, just need some code to get it to work
I have try now to create an applescript for this feature in the whole day but I just failed on the code. So I really need your help now to correct this.
The code I have written is the following:
tell application id "DNtp"
set theSelection to the selection
if theSelection is not {} then
try
show progress indicator "Converting to url..." steps ( count of theSelection)
repeat with theRecord in theSelection
set theName to name of theRecord
--set theURL to URL of theRecord
set thehtmlsource to get source of theRecord as string
set theimagesource to URL of theRecord as string
set imageurl to get URL of theRecord as string
step progress indicator theSelection
if thehtmlsource contains theimagesource then
set theimagesource to (imageurl of theRecord where theimagesource of theRecord contains ".jpg") as string
else
display alert "Devonthink Pro" message "False:" & " The selection doesn't contain any html document with embedded images with the same name"
end if
end repeat
hide progress indicator
on error error_message number error_number
hide progress indicator
if the error_number is not -128 then display alert "DEVONthink Pro" message error_message as warning
end try
end if
end tell
I will be so appreciate if you can help me to solve this
I forget to say before that I can also get the url link like a spotlight comment or keyword if it’s trouble to change the link in the url location of an object
Scraping web content isn’t a simple matter, so coding this will not be a 100% solution.
This is a simple example…
property myURL : "https://www.automobilesreview.com/pictures/lamborghini/veneno/"
tell application id "DNtp"
repeat with thisRecord in (selection as list)
set docSource to source of thisRecord -- This is the HTML markup of the web page.
get links of docSource type "JPG" base URL myURL -- This is working with the markup from the page.
end repeat
end tell
--> {"https://www.automobilesreview.com/gallery/lamborghini-veneno/lamborghini-veneno-01.jpg", "https://www.automobilesreview.com/gallery/rinspeed-tatooocom/rinspeed-tatooocom-10.jpg"…}
-- Output truncated for clarity
Well, this script can download all embedded images of the page (requires a valid URL). However, there are hundreds of embedded images in the source and this simple approach probably won’t work. Efficiency doesn’t seem to be a priority of this website - the size of the page is 1.7 MB
tell application id "DNtp"
repeat with thisRecord in (selection as list)
set theURL to URL of thisRecord
set theName to name of thisRecord
set theSource to source of thisRecord
set theEmbeddedImages to get embedded images of theSource base URL theURL
repeat with thisEmbeddedImage in theEmbeddedImages
if thisEmbeddedImage begins with "https://images-wixmp" then
set thisImage to create record with {name:theName, type:picture, URL:theURL} in (parent 1 of thisRecord)
set theData to download URL thisEmbeddedImage referrer theURL
set data of thisImage to theData
end if
end repeat
end repeat
end tell
Oh this is a great thread. I’ve been meaning to make a script to scrape markdown files, download online images from them, store them in an ‘=images’ folder, and re-write them with the x-devonthink: url. This is a great start for this, thank you!
