Ah OK, good to know - consider this a feature request then? Exposing the (currently internal) bi-directional annotation link creates some interesting possibilities, including this kind of “custom summary” workflow.
Noticed another place where this could be useful: using the “Summarize Highlights” feature. It would make sense to link the markdown or RTF file created by the “Summarize Highlights” script in the Annotations field