forbid web crawler bots from registering a page