HoodiesGG crawler

If you saw HoodiesGG/1.0 in your logs, this is what it is and how to stop it.

User agent: HoodiesGG/1.0 (+https://hoodies.gg/bot)

It reads public product catalogues (for example Shopify's /products.json) and product pages, at most one request per second per site, usually once a day.
It obeys robots.txt (cached for up to a day) for every page, catalogue and image it fetches from a store's own site, and never submits forms, logs in or adds to carts.
Product images are resized and cached so your store is not hot-linked.

How often it visits

The crawler works on a few stores at a time and visits first the ones it saw longest ago. Within one store its requests go out one beat apart, never faster than one a second.

A well is one storeThe probe: one dip is one requestThe probe dips once per beat, so a store never sees more than one request every 1 s. A store is due again after 24 h, or 6 h if its products changed this week (60 min for a trending creator's store that changed); the one visited longest ago goes first. The gauges run 720 times faster than real time. Capped wells are stores that asked us to stop or whose address is not public: they are never fetched. The bench shows one probe; the real crawler runs a few at once, each keeping its own store to the same beat.

To opt out

Add User-agent: HoodiesGG / Disallow: / to your robots.txt, or tell us and we will remove your store and its images within a day.