User-agent: * # Crawl budget controls # Search query/filter URLs return noindex, follow. Do not block them here: # Google must be able to crawl those existing URLs to process noindex and # remove stale search variants from its index. Clean search hubs and category # pages are indexable under the centralized policy in base/templatetags/seo.py. Disallow: /api/ Disallow: /swagger/ Disallow: /admin/ Disallow: /admin-tools/ Disallow: /accounts/ Disallow: /users/ Disallow: /dashboard/ Disallow: /battlestation/ Disallow: /warroom/ Disallow: /war_room/ Disallow: /payments/ Disallow: /checkout/ Disallow: /htmx/ Disallow: /utility/ Disallow: /__debug__/ Disallow: /age-verification/ # Seller/buyer flow pages (transactional, not indexable content) Disallow: /under_review/ Disallow: /submitted/ Disallow: /success/ Disallow: /listing_checkout/ Disallow: /new_listing_invoice/ Disallow: /verify/ Disallow: /stepone/ Disallow: /steptwo/ Disallow: /stepthree/ Disallow: /stepfour/ Disallow: /storecheckout/ Disallow: /storesuccess/ Disallow: /create_listing/ Disallow: /edit_listing/ Disallow: /welcome/ Disallow: /relist/ Disallow: /listings/confirm/ Disallow: /contact_seller/ Disallow: /storefront/ Disallow: /store/preview/ Disallow: /bulk_import/ Disallow: /superadmin/ Disallow: /scheduled_tasks/ Disallow: /notifications/ Disallow: /filter_calibers/ Disallow: /auction_relist_debug/ Disallow: /listing_util/ Disallow: /gunspot_error/ Disallow: /mobile_beta/ Disallow: /auct_test/ Disallow: /test/ Disallow: /beta/ Disallow: /partial_home_minis/ Disallow: /iauctions/ Disallow: /homepage/ # Legacy Academy preview URLs 301 to their canonical article URLs. Leave them # crawlable so Google can process the redirect and consolidate old entries. Disallow: /academy/dashboard/ Disallow: /academy_beta/ Disallow: /store-signup/ Disallow: /storesignup/ # Bare HTML fragments with no -- no canonical/robots meta to add, # block at the crawl level instead Disallow: /subguns/ Sitemap: https://gunspot.com/sitemap.xml