# /robots.txt file for http://iodp.tamu.edu/ # User-agent: * Disallow: /curation/requests/ Disallow: /drafts/ Disallow: /include Disallow: /internal/ Disallow: /logreport.html Disallow: /publications/wiki/ Disallow: /publications/manuscripts/erb/ Disallow: /scienceops/precruise/ Disallow: /scienceops/postcruise/ Disallow: /janusweb