#-------------------------------------------------------------------------- # /robots.txt for http://www.eng.unimelb.edu.au/ # # Jan 1 2002, Ozcan Dogan # major update 15 September 2008 by Jo Dalvean, Multimedia Manager # # # The purpose of the "robots.txt" file is to keep these directories # from being indexed so that the average user doesn't stumble across them # while performing searches. # # # LAST UPDATE: 250309 #-------------------------------------------------------------------------- User-agent: * # No need for these directories to be indexed since they are # only relevant to the web server Disallow: /cgi-bin Disallow: /include Disallow: /javascripts Disallow: /Templates # Old content and does not need to be indexed Disallow: /courses Disallow: /current Disallow: /curriculum Disallow: /brochures #page contained incorrect content Disallow: /future/specialisations/informatics.html # No need for images to be indexed Disallow: /images # Staff only area which does not require indexing Disallow: /intranet Disallow: /casual_staff Disallow: /about/staff.html Disallow: /about/staffonly Disallow: /about/advancement.html Disallow: /about/dean_gm.html Disallow: /about/finance.html Disallow: /about/marketing.html Disallow: /about/research.html Disallow: /about/resources.html Disallow: /about/academic_services.html Disallow: /about/ehs.html Disallow: /about/safety/