Problem solved:
We moved our XWiki instance to a new domain with a new URL.
Apache and so on was fine, but we forgot the XWiki Descriptor and the alias within.
After correcting the alias, URL normalization works as expected.
There should be a big hint in the extension description to check for the alias