Christian just helped me with a similar issue.
As far as removing the duplicates, there is a command in the scripts menu in the data section “move duplicates to trash” or words to that effect. You’ll need to select entries in a group, then run the command. Non-duplicates will be left in place.