Speshy About our bot

SpeshyWatcher

For site owners and hosting providers

If you found this page in your server logs, that was us. This page tells you exactly who we are, what we read, and how to allow or block us.

Our user agent

SpeshyWatcher/1.0 (+https://speshy.com.au/bot; price & stock watch on behalf of a subscriber)

Every request is signed with Web Bot Auth, so you can verify it really is us and not somebody using our name.

What Speshy is

Speshy is a consumer shopping site for Australia. A shopper searches for a product, sees the merchants selling it, and clicks through to that merchant to buy. They can also follow an item and be told when there is a deal on it.

That makes us a way for shoppers to find you. We list your products, with your own images, and send the shopper to your page. We are not a retailer, we do not compete with you, and we do not sell your prices to anyone else as data.

We are pre-launch and still building. Today the price-watching side is what runs; the product search and listing side is being built next.

What we read

Two things, and nothing else.

  • Your product list. Where you publish a product feed, a catalogue or a sitemap, we read that instead of your pages — one request instead of thousands. That is how your products come to be listed.
  • A page somebody is watching. When a subscriber follows one of your items, we read that one page at most once a day — once in total, not once per subscriber. A hundred people watching the same page is still one read.

What we do not do

  • We do not republish your pages. We hold the product, the price and a link back to you.
  • We do not log in, and we never read anything behind a login or a paywall.
  • We do not buy, add to cart, or submit any form.
  • We never disguise our requests. No residential proxies, no spoofed browser fingerprints, no challenge solving.
  • We do not try to get around a block. If you refuse us, we stop.

How we behave

  • We read and honour robots.txt, including Crawl-delay. If you disallow a path, we never request it.
  • If you return 403, we treat it as a refusal and stop asking.
  • If you return 429, we honour Retry-After and back off.
  • If we meet a challenge page, we record that we were turned away. We do not try to solve it.
  • We prefer your structured data — schema.org markup, or your platform’s product JSON — over reading your HTML, because it is cheaper for both of us.
  • Requests are paced per host. One request, short timeout, size-capped.

How to block us

Add this to your robots.txt and we will stop, usually within a day, and we will not ask again:

User-agent: SpeshyWatcher
Disallow: /

Or email [email protected] and we will remove your domain by hand. You do not need to justify it and we will not ask you to.

How to allow us

If your firewall or bot protection is turning us away and you would rather it did not, allowlist the user agent above, or get in touch and we will tell you the addresses we read from. If it is easier to hand us a product feed than to let us read your pages, we would prefer that too — it is fewer requests for you and better data for us.

Who we are

Speshy Pty Ltd, ABN 57 701 615 536, Sydney, Australia. A small independent Australian business. Questions, complaints, or a request to be removed: [email protected] — a person reads that address.

We identify ourselves honestly on every request and we never try to disguise what we are. If you have seen us behave otherwise, please tell us — that would be a bug, and we would want to know.
What Speshy is