I was looking at another discussion elsewhere and the OP found that adding a few extra rules to robots.txt helped with some bots. The phpBB equivalents would be:
This might also be useful. No harm in it anyway:
And now I'm thinking that if you're not allowing guests to view profiles you could also disallow ucp.php and memberlist.php. There are probably a few other things which could be usefully disallowed too. Obviously this will not help with bots that don't respect robots.txt, but it should help with the rest of the blighters.
Code:
Disallow: *sid=Disallow: */index.php?p=This might also be useful. No harm in it anyway:
Code:
Disallow: *view=unreadAnd now I'm thinking that if you're not allowing guests to view profiles you could also disallow ucp.php and memberlist.php. There are probably a few other things which could be usefully disallowed too. Obviously this will not help with bots that don't respect robots.txt, but it should help with the rest of the blighters.
Statistics: Posted by Gumboots — Mon Apr 28, 2025 12:01 am