Cannot close annotation after declining deletion

I'm not sure this is a bug, for me it looks like an expected behaviour. Why would the annotation behave differently after opening the delete dialog and cancelling any action?
Was it different in previous versions?

From what I understand, the side improvement you mention is the main idea here

Note that the "add a close button in the annotation" is a part of what we aim in XWIKI-23740 .