# All robots will spider the domain User-agent: * Disallow: /blog Disallow: /portfolio Disallow: /trash Disallow: /Scripts Disallow: /jroxaff Disallow: /school User-agent: ia_archiver Disallow: /