RobotsDotTxt:Wikka

Revision [12240]

This is an old revision of RobotsDotTxt made by MinusF on 2005-12-12 23:15:51.

robots.txt is a file requested many times by bots like yahoo. It is assumed to be located at the root of web directory and to contain directives on which files and folders the search engine should be allowed or not to archive.
Generally, contents of /robots.txt should be something like :

User-agent : *
Disallow : UserSettings

If you want to know more about robots.txt and favicon.ico, search these terms with Google and add the definitions in this page.

The only thing I just want to say is about RewriteRule, see favicon.ico

the text above does not mention that the 1.1.6.0 default install rewrites requests for favicon.ico and robots.txt into wikka.php?wakka=robots.txt and wikka.php?wakka=favicon.ico, respectively. one way to get around this is to replace the last RewriteRule in wikka's .htaccess with this:

RewriteCond %{REQUEST_FILENAME} !robots.txt
RewriteCond %{REQUEST_FILENAME} !favicon.ico
RewriteRule ^(.*)$ wikka.php?wakka=$1 [QSA,L]

maybe you will also want to put

into actions/header.php

Wikka : RobotsDotTxt

Revision [12240]