# Google Image Crawler Setup User-agent: Googlebot-Image Disallow: # Crawlers Setup User-agent: * # Default Magento 2 robots.txt Disallow: /*.php$ Disallow: /*? Disallow: /*SID= Disallow: /app/ Disallow: /catalog/ Disallow: /checkout/ Disallow: /customer/ Disallow: /index.php/ Disallow: /lib/ Disallow: /pkginfo/ Disallow: /report/ Disallow: /review/ Disallow: /sendfriend/ Disallow: /var/ # Paths Disallow: /*/l/* # Ignore faceted catalog navigation URLs. Disallow: /404/ Disallow: /catalogsearch/ Disallow: /contact/ Disallow: /control/ Disallow: /customize/ Disallow: /errors/ Disallow: /includes/ Disallow: /newsletter/ Disallow: /opt/ Disallow: /pkginfo/ Disallow: /poll/ Disallow: /privacy-policy.html Disallow: /recipes-wp/ Disallow: /scripts/ Disallow: /shell/ Disallow: /stats/ Disallow: /tag/ Disallow: /terms-conditions.html Disallow: /wishlist/ Disallow: /wp/