On 9/6/06, THOMAS, BRIAN M (SBCSI) <bt0008(a)att.com> wrote:
  Perhaps slightly off-topic:
 Our poor overworked sysadmin has been having the devil of a time keeping
 up with the content of robots.txt.  Since this file is public
 information by nature, I had no problem composing a useful one for him
 for our XWiki instances - simply copied from the one at 
xwiki.org - but
 he needs the same information for all the other apps deployed to his
 Tomcat servers.  Of course, he could do the same thing with the others,
 if there were known to be accessible instances, but it really is outside
 his normal purview, and it occurred to me that this is naturally a
 component of an application's deployment.
 So, my question is:  Has anyone thought of putting an application's
 description of searchable paths into a deployable file, to be appended
 to (or better, merged into) robots.txt?  and if so, is there a
 more-or-less standard way of doing it?  Less interesting at the moment
 is:  when will XWiki do this also?  and is this JIRA fodder? 
Hi,
i've never heard about something like who do this. If you find a way
to do it, we can add it to XWiki.
Someone else have an idea?
jeremi