ÇÚÏÇÏÇÊ ãáÝ vbulletin robots.txt ÇáÕÍÍíÉ ááãäÊÏí Vb3, vb4, vb5
Recommended Robots.txt - Perfect VBulletin 4 robots.txt - XML Sitemaps and Vbulletin
Implementing a Robots.txt File With Your vBulletin Community
Best robots.txt for vBulletin forums - Vbulletin 4 robots txt?
I think this robots.txt suits for all vBulletin forums ..

If your forum in the main directory

ßæÏ:
User-Agent: *
allow: /
Disallow: /cgi-bin/
Disallow: /ajax.php
Disallow: /attachment.php
Disallow: /calendar.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /global.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /member.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /subscription.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php
if its in /forum

ßæÏ:
User-Agent: *
allow: /
Disallow: /cgi-bin/
Disallow: /forum/ajax.php
Disallow: /forum/archive/
Disallow: /forum/calendar.php
Disallow: /forum/cron.php
Disallow: /forum/editpost.php
Disallow: /forum/global.php
Disallow: /forum/image.php
Disallow: /forum/inlinemod.php
Disallow: /forum/joinrequests.php
Disallow: /forum/login.php
Disallow: /forum/member.php
Disallow: /forum/memberlist.php
Disallow: /forum/misc.php
Disallow: /forum/moderator.php
Disallow: /forum/newattachment.php
Disallow: /forum/newreply.php
Disallow: /forum/newthread.php
Disallow: /forum/online.php
Disallow: /forum/postings.php
Disallow: /forum/printthread.php
Disallow: /forum/private.php
Disallow: /forum/profile.php
Disallow: /forum/register.php
Disallow: /forum/report.php
Disallow: /forum/reputation.php
Disallow: /forum/search.php
Disallow: /forum/sendmessage.php
Disallow: /forum/showpost.php
Disallow: /forum/showgroups.php
Disallow: /forum/subscription.php
Disallow: /forum/threadrate.php
Disallow: /forum/usercp.php
Disallow: /forum/usernote.php
-------------------------------------------------------
ÊÚÑíÝÇÊ:

-------------------------------------------------------
user-agent:åæ ÇÓã ÓÈíÏÑ Çæ ÇáãÊÕÝÍ ÇæÍÊì ÇáåÇÊÝ ÇáãÍãæá. ØÈÚÇ åäÇ äÍä äÊßáã Úä ÑæÈæÊÓ Ýåæ ÇÓã ÇáÓÈíÏÑ.

Disallow:ØÑíÞÉ ÇáãäÚ
Crawl-delay:ãÏÉ ÊÇÎíÑ Èíä ÒíÇÑÉ ÇÎÑì
Request-rate:ãÚÏá ØáÈ ÇáÕÝÍÉ
Visit-time:ÇáÇæÞÇÊ ÇáãÓãæÍ ÈåÇ ÈÇáÒíÇÑÉ
sitemap:ÎÇÑØÉ ÇáãæÞÚ ÈÕíÛÉ .xml Çæ .xml.gz


-------------
ÇáÇãËáÉ:
-------------

1.
ßæÏ:
User-agent: *
Disallow:
äÍä äÞæá áßá ÓÈíÏÑ íÒæÑ ÇáãæÞÚ ÈÓÈÈ * Çäå íãßä Çä íÊÕÝÍ ÇáãæÞÚ æÐáß áÇääÇ áã äÖÚ ÔíÁ ÇãÇã ÇáãäÚ.

2.
ßæÏ:
User-agent: *
Disallow: /
åäÇ äÍä äãäÚ ßá ÇáÓÈíÏÑ ãä ÒíÇÑÉ Çí ÕÝÍÉ Ýí ÇáãæÞÚ.

3.
ßæÏ:
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
ãäÚ ÇáÌãíÚ ãä ÒíÇÑÉ ãÌáÏíä cgi-bin æ tmp

4.
ßæÏ:
User-agent: *
Disallow: /downloads/index.html
äãäÚ ÇáÌãíÚ ãä ÒíÇÑÉ ÕÝÍÉ ãÚíäÉ

5.
ßæÏ:
User-agent: BadBot
Disallow: /
åÐÇ ÑÈæÊ ÓíÁ ÇãäÚå ãä ÏÎæá Çáí ÇáãæÞÚ

6.
ßæÏ:
User-agent: ]DontLikeBot
Disallow: /private/
ÇÑíÏ Çä ÇãäÚ åÐÇ ÇáÑæÈæÊ ãä ãÌáÏ æÇÍÏ ÝÞØ

7.
ßæÏ:
 
User-agent: *
Disallow: /
Request-rate: 1/5         
Visit-time: 0600-0800
ãÓãæÍ ÈÒíÇÑÉ ßá ÇáÓÈíÏÑ áßá ÕÝÍÇÊ ãæÞÚí ÈÓ ÈÇáÔÑæØ ÇáÊÇáíÉ: ãÚÏá ÇáæÞÊ ÇáãÓãæÍ åæ 5 ËæÇäí áßá ÕÝÍÉ æÇÍÏÉ. æÇíÖÇ ÇáæÞÊ ÇáãÓãæÍ Ýíå ÈÇáÒíÇÑÉ åæ ãä 6 Çáì 8 ÕÈÇÍÇ gmt

8.

ßæÏ:
 
User-agent: msnbot 
Crawl-delay: 120
ÓÈíÏÑ msn ãÒÚÌ æßËíÑ ÇáÒíÇÑÇÊ ÇäÇ ÇÑíÏÉ Çä áÇ íÒæÑ ÕÝÍÇÊ ãæÞÚí ÇáÇ ßá ÏÞíÞÊíä.

9.
ßæÏ:
Sitemap: http://www.ketaballah.net/sitemap.xml
áßá ÇáÓÈíÏÑÒ åÐÇ åæ ÑÇÈØ ÎÑíØÉ ãæÞÚí

10.
ßæÏ:
 
User-agent: *
Disallow: /
User-agent: Googlebot
Disallow: /cgi-bin/
äãäÚ ÇáÌãíÚ ãä ÇáÒíÇÑÉ ßá ÇáãæÞÚ
áßä äÓãÍ áÌæÌá ÈÒíÇÑÉ ßá ÇáãæÞÚ ãÇ ÚÏÇ cgi-bin


ÇáãÑÌÚ:
https://forums.digitalpoint.com/thre...forums.1468182
https://www.xml-sitemaps.com/forum/i...opic,241.html/
https://www.xml-sitemaps.com/forum/i...opic,2893.html
https://www.vbulletin.org/forum/showthread.php?t=302570
https://www.vbulletin.org/forum/showthread.php?t=302483
https://www.theadminzone.com/threads...lletin.117342/
https://seovb.com/use-robotstxt-to-p...icate-content/
https://vbulletin-mods.com/forum/showthread.php?t=1047