Perhaps slightly off-topic:
Our poor overworked sysadmin has been having the devil of a time keeping
up with the content of robots.txt. Since this file is public
information by nature, I had no problem composing a useful one for him
for our XWiki instances - simply copied from the one at
xwiki.org - but
he needs the same information for all the other apps deployed to his
Tomcat servers. Of course, he could do the same thing with the others,
if there were known to be accessible instances, but it really is outside
his normal purview, and it occurred to me that this is naturally a
component of an application's deployment.
So, my question is: Has anyone thought of putting an application's
description of searchable paths into a deployable file, to be appended
to (or better, merged into) robots.txt? and if so, is there a
more-or-less standard way of doing it? Less interesting at the moment
is: when will XWiki do this also? and is this JIRA fodder?
brain[sic]