User-agent: * Disallow: /customer/* Disallow: /media/* Disallow: /sales/* Disallow: downloads/* Disallow: catalogsearch/* Disallow: directory/currency/* Disallow: checkout/cart/ Disallow: /js/ Disallow: /skin/frontend/adultshop/default/js/ Disallow: /skin/frontend/adultshop/default/css/ # Directories Disallow: /404/ Disallow: /app/ Disallow: /cgi-bin/ Disallow: /downloader/ Disallow: /errors/ Disallow: /feeds/ Disallow: /includes/ Disallow: /lib/ Disallow: /pkginfo/ Disallow: /report/ Disallow: /scripts/ Disallow: /shell/ Disallow: /stats/ Disallow: /var/ Disallow: /vendor/ Disallow: /build/ Disallow: /media/tmp/ Disallow: /media/xmlconnect/ Disallow: /snapshot # Files Disallow: /cron.php Disallow: /cron.sh Disallow: /error_log Disallow: /install.php Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_AFL.txt Disallow: /STATUS.txt Disallow: /composer.json Disallow: /composer.lock Disallow: /build.xml # Paths (no clean URLs) Disallow: /*.php