I am trying to create a custom search plugin for BASE, the Bielefeld Academic Search Engine.
To do this, I followed the example in the DEVONagent Pro manual, Chapter “Plugin Development”. When testing, step 3 of the tutorial asks to click the “Test” button and review the returned URLs. I got plenty, and as described in step 4, the goal was now to exclude all but the 10 relevant results that were to be expected on the first results page. After using the “Exclude Domain” and “Exclude URL” menus a few times and tweaking the resulting file by hand, this is the array of excluded domains:
<key>LinksNotMatching</key> <array> <string>*base-search.net*</string> <string>*lucene.apache.org*</string> <string>*maps.google.com*</string> <string>*openstreetmap.org*</string> <string>*twitter.com*</string> <string>*base-search.net/MyResearch/*</string> <string>*base-search.net/Record/*</string> </array>
However, I still see URLs like https://www.base-search.net/MyResearch/Home?delete=77059653afd28f4f31bbceaf60669d3656df05e0716f92b40b9673b4fb29c411&back=recordList in the list of URLs returned during a test. The exclusion does not seem to have any effect. I even added (manually) the following tags to denote “nothing of interest follows here”, as described in the manual.
That should exclude most URLs of the structure given above, but they still show up in the list:
Any ideas what might be going wrong here?