DevonAgent seems to prematurely stop crawling

… in other words, I get more results with the search engine directly than with the plugin I am trying to develop (my first on DA) for that search engine.

The engine at hand is Oxford Music Online (, subscription required).

The plugin is as follows:

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "">
<plist version="1.0">
	<string>Rechercher sur le Web en utilisant &lt;;.</string>
	<string>Oxford Music Online Plugin</string>
	<string>Oxford Music Online</string>
	<string>"Next page"</string>

I tried with and without the NextLinkName tag but there was no difference whatsoever.

Any ideas?

Thank you.

Unfortunatley a subscription is required for the website. But how do the URLs of results look like? And what kind of results are skipped? Finally, you could also use the secondary query “*” (without quotes) to ensure that all results are used (even if they’re not matching).

The first page of results is the following:

The second page:

Once on the second page of result, clicking the “previous” button returns to the first page, but with the following URL:

As I understand it, DA returns 100 results whereas the webpage over 400. My impression is that DA simply does not press the “next” button more than four times :slight_smile:

Using the wildcard * as secondary search string didn’t influence the results. Maybe I am missing something?

By default plugins return up to 100 results. To get more results, you’d have to create a search set and adjust the number of results per plugin.