# disallows robots from cgi-bin, functions, passwd, phpdistib, phpmyadmin, Pryces, organisation.txt. Amended July 2008 to disallow any .log files (such as WS_FTP.LOG) left in directories in error)
# Amended 23 July 2008 to in order to prevent session ID's causing multiple versions of same file being indexed, but to allow any file where ? is truly the final character.
# 28 July 2008 Reverted to original robots.txt as it isn't working in the way I expected.
# 10 March 2009: Line 21 added because PHPpages directory, which was on old site to contain the Members Only Section, is still there and includes  helix.inc which may be called by some of Steve's encyclopedia files so I dare not delete it. Neither am I certain that the M_only files are not called from third party websites, so I will do redirects to new index.php. 16 Sept 2009: PHPpages directory is now password protected, as is phpmyadmin and Pryces.
# 7 April 2009:  lines 23 - 30 (/resources/show-abstract-37.php?id=%20%20%20%20%20%20%20%20%20%2052, etc)were added due to duplication with /resources/show-abstract-37.php?id=52, etc. in Google Tools
# 14 April 2009: line 30 - I have revised /pages/meetings.php to incorporate some of the details that were on /pages/new-meet.php. As new-meet.php is not required I have deleted it from the site and from sitemap.xml and urllist.txt, but it may also already be cached. To be safe I have added it to the robots.txt
# 29 June 2009: Lines 31 & 32 added in effort to stop a page showing the files stored in the directories from being indexed and displayed as a directory index.
# 31 August 2009: Javascript redirects of the old filename.htm files have been eliminated since I have found that .htaccess file can be included at the root of our section of the server in order to do "proper" 301 redirects. The javascript filename.htm files on the website have been deleted, but I have kept them as JUNKfilename on this computer for the time being.

User-agent: *
Disallow: 
Disallow: /cgi-bin/
Disallow: /functions/
Disallow: /passwd/
Disallow: /phpdistib/
Disallow: /phpmyadmin/
Disallow: /Pryces/
Disallow: /organisation.txt
Disallow: /*.log$
Disallow: /Login.php
Disallow: /PHPpages/
Disallow: /pages/new-meet.php
Disallow: /recording/?M=D
Disallow: /pages/?M=D
Sitemap: http://www.conchsoc.org/sitemap.xml