The icon is part of the link because we want users to be able to click it to navigate. I think it's fair to underline it regarding accessibility.
However it looks a bit silly and could be a generic user experience problem. Updating the tags to reflect this.