# Allow crawling of all content User-agent: * Disallow: /admin/ Disallow: /ajax/ Disallow: /bin/ Disallow: /App_Data/ Disallow: /libs/ Disallow: /settings/