vbulletin robots.txt Vb3, vb4, vb5
Recommended Robots.txt - Perfect VBulletin 4 robots.txt - XML Sitemaps and Vbulletin
Implementing a Robots.txt File With Your vBulletin Community
Best robots.txt for vBulletin forums - Vbulletin 4 robots txt?
I think this robots.txt suits for all vBulletin forums ..
If your forum in the main directory
if its in /forum:User-Agent: * allow: / Disallow: /cgi-bin/ Disallow: /ajax.php Disallow: /attachment.php Disallow: /calendar.php Disallow: /cron.php Disallow: /editpost.php Disallow: /global.php Disallow: /image.php Disallow: /inlinemod.php Disallow: /joinrequests.php Disallow: /login.php Disallow: /member.php Disallow: /memberlist.php Disallow: /misc.php Disallow: /moderator.php Disallow: /newattachment.php Disallow: /newreply.php Disallow: /newthread.php Disallow: /online.php Disallow: /poll.php Disallow: /postings.php Disallow: /printthread.php Disallow: /private.php Disallow: /profile.php Disallow: /register.php Disallow: /report.php Disallow: /reputation.php Disallow: /search.php Disallow: /sendmessage.php Disallow: /showgroups.php Disallow: /subscription.php Disallow: /threadrate.php Disallow: /usercp.php Disallow: /usernote.php
-------------------------------------------------------:User-Agent: * allow: / Disallow: /cgi-bin/ Disallow: /forum/ajax.php Disallow: /forum/archive/ Disallow: /forum/calendar.php Disallow: /forum/cron.php Disallow: /forum/editpost.php Disallow: /forum/global.php Disallow: /forum/image.php Disallow: /forum/inlinemod.php Disallow: /forum/joinrequests.php Disallow: /forum/login.php Disallow: /forum/member.php Disallow: /forum/memberlist.php Disallow: /forum/misc.php Disallow: /forum/moderator.php Disallow: /forum/newattachment.php Disallow: /forum/newreply.php Disallow: /forum/newthread.php Disallow: /forum/online.php Disallow: /forum/postings.php Disallow: /forum/printthread.php Disallow: /forum/private.php Disallow: /forum/profile.php Disallow: /forum/register.php Disallow: /forum/report.php Disallow: /forum/reputation.php Disallow: /forum/search.php Disallow: /forum/sendmessage.php Disallow: /forum/showpost.php Disallow: /forum/showgroups.php Disallow: /forum/subscription.php Disallow: /forum/threadrate.php Disallow: /forum/usercp.php Disallow: /forum/usernote.php
:
-------------------------------------------------------
user-agent: . .
Disallow:
Crawl-delay:
Request-rate:
Visit-time:
sitemap: .xml .xml.gz
-------------
:
-------------
1.
* .:User-agent: * Disallow:
2.
.:User-agent: * Disallow: /
3.
cgi-bin tmp:User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/
4.
:User-agent: * Disallow: /downloads/index.html
5.
:User-agent: BadBot Disallow: /
6.
:User-agent: ]DontLikeBot Disallow: /private/
7.
: 5 . 6 8 gmt:User-agent: * Disallow: / Request-rate: 1/5 Visit-time: 0600-0800
8.
msn .:User-agent: msnbot Crawl-delay: 120
9.
:Sitemap: http://www.ketaballah.net/sitemap.xml
10.
:User-agent: * Disallow: / User-agent: Googlebot Disallow: /cgi-bin/
cgi-bin
:
https://forums.digitalpoint.com/thre...forums.1468182
https://www.xml-sitemaps.com/forum/i...opic,241.html/
https://www.xml-sitemaps.com/forum/i...opic,2893.html
https://www.vbulletin.org/forum/showthread.php?t=302570
https://www.vbulletin.org/forum/showthread.php?t=302483
https://www.theadminzone.com/threads...lletin.117342/
https://seovb.com/use-robotstxt-to-p...icate-content/
https://vbulletin-mods.com/forum/showthread.php?t=1047


Digg
del.icio.us
StumbleUpon
Google
