# All robots will spider the domain User-agent: * Disallow: /.obsolete Disallow: /.old_includes Disallow: /cgi-bin Disallow: /d65b6770-f94f-11dd-87af-0800200c9a66 Disallow: /download Disallow: /feedline Disallow: /images Disallow: /includes Disallow: /lbxp Disallow: /system