Author Topic: Looking for Robots.txt for phpBB forum?  (Read 200 times)

0 Members and 1 Guest are viewing this topic.

Offline h2obubbler

  • Full Member
  • *
  • Posts: 226
  • Karma: +0/-0
  • Life is like a box of chocolate.
    • View Profile
Looking for Robots.txt for phpBB forum?
« on: August 22, 2008, 05:43:15 AM »
Hi everyone, im currently starting a forum but don\'t know how to add robots.txt in it.

Just curious whether anybody here could suggest some good robots.txt scripts  for phpBB3 to exclude useless pages from index.

Many Thanks.

Techronnati | where technology never sleeps

Looking for Robots.txt for phpBB forum?
« on: August 22, 2008, 05:43:15 AM »

Mountain View

Offline CyborgRepublic

  • Full Member
  • *
  • Posts: 201
  • Karma: +0/-0
    • View Profile
Re: Looking for Robots.txt for phpBB forum?
« Reply #1 on: August 22, 2008, 05:51:54 AM »
hi h2obubbler,

You can try this one,

From the PHPBB Knowledgebase
Thwarting The Googlebot (and other helpful tips)

User-agent: Googlebot
Disallow: /posting.php
Disallow: /admin
Disallow: /privmsg.php
Disallow: /search.php
Disallow: /login.php
Disallow: /memberlist.php
Disallow: /images
Disallow: /includes
Disallow: /profile.php

There are other tips there as well, so be sure to read it.
http://www.phpbb.com/kb/article/thwarti ... pful-tips/

Good luck!  :D

 

Related Topics

  Subject / Started by Replies Last post
2 Replies
138 Views
Last post August 13, 2008, 12:17:12 PM
by JusticeLeague
1 Replies
223 Views
Last post October 04, 2008, 05:52:33 AM
by MoneyRepublic
0 Replies
106 Views
Last post December 16, 2008, 07:56:19 AM
by rpmolecule
1 Replies
214 Views
Last post December 19, 2008, 05:16:00 AM
by MrSpecialist
0 Replies
40 Views
Last post January 16, 2013, 07:27:33 AM
by Owen741

Posting Disclaimer: Any individual may post a message in this forum and may do so anonymously. Therefore, the sole author is exclusively and entirely responsible for all opinions in that message. They do not represent the official opinions of Techronnati, its administrators or moderators or the Techronnati Management. Techronnati is merely acting as an impartial conduit for constitutionally protected free speech and is not responsible and will not be held liable for the content of such messages. All images and service logos are trademarks of their respective owners.