Import website issue

DEVONthink
1

I have 4 websites, on the WordPress platform, of which two are private access only. All the sites are bespoke and my web developer has not used any plug-ins etc; modifications are bespoke code. As he says, the sites are unusually extremely secure.

Following a recent incident at the ISP’s server level (beyond my control) which resulted in the loss of one day’s work on one of the sites, to complement the ISP’s back-up once a day only, I am now using DT4 to import one or more of the sites whenever I want to save (possibly every minute or few minutes depending on how many changes I have made to content).

I have a DT4 database exclusively for the sites and import is efficient on first import, but not on subsequent imports of the same site while DT4 is open. I am finding that wanting to import the same site within minutes of an import of the same site doesn’t work. The only alternative i have found is to quit DT4 and start over. Is this a deliberate feature and if not then what do i need to do to be able to import the same site as often as I like?

[In DT4, I save the database to a combination of external HD and Dropbox]

2

The download manager skips already downloaded URLs as it’s not intended to periodically mirror a complete webiste.

1 Like
3

So the only solutions are to quit DT4 whenever I want to import a changed site or delete an already downloaded URL

4

Would you consider not using DEVONthink, and instead use “curl’“ or, my preference, “wget” which I’ve been using for years on my own websites when needed.

Both are command line programs built for the purpose you need as described. I understand “curl” provided by macOS and “wget” is installable. Help via internet search or perhaps better, from your web developer who should probably know of both.

5

Thank you. I’ve asked my web developer to let me know.

6

Last time I looked, WP served part or all of its content from a database. Mirroring your web site might not be the best approach to backup in this case.

7

In Download Manager’s Options, there is the setting to overwrite existing files…

ScreenFloat Shot of DEVONthink on 2025-11-10 at 10-44-07
ScreenFloat Shot of DEVONthink on 2025-11-10 at 10-44-07856×744 66.1 KB