Open Coffee Hub
OpenCoffeeHubBot, our crawler
What it reads on coffee roaster websites, what it keeps, and how to tell it no.
In short: we read the public pages of specialty coffee roasters and keep facts about their coffees, with a link to the roaster's page. We say who we are, follow robots.txt, never try to get around a block, delete our copies of your pages once we have read them, and stop when you ask us to.
1. Who is asking
Every request we send carries this identification, so you can find us in your logs and block us by name:
OpenCoffeeHubBot/1.0 (+https://opencoffeehub.com/crawler; mailto:hello@opencoffeehub.com)
- Operator
- Daniel Simon, Gilbachstraße 1, 50672 Köln, Germany
- Contact
- hello@opencoffeehub.com
2. How we visit
- We read public pages only, without images or video.
- We come back regularly and keep our visits light.
- We respect a Crawl-delay in your robots.txt. If your server starts refusing our requests, we slow down, and if it keeps refusing, we end the visit.
- We also request your robots.txt regularly and, where it allows us, now and then your homepage, to see whether you have asked us to stay away or are blocking us.
3. What we never do
- Log in, create accounts, submit forms or add anything to a cart.
- Solve CAPTCHAs or bot challenges.
- Use proxies, other IP addresses or another name, or try any other way to get around a block.
- Copy your photos.
4. What we keep, and what we delete
- Facts about your coffees and a link to the page they come from.
- On Open Coffee Hub we show only short passages from your page, always with your name and a link to your page.
- Copies of your pages: to read a page, we have to load it. We delete our copy once we have read it.
5. How to tell us no
Any one of these is enough.
-
robots.txt. These two lines stop us completely:
User-agent: OpenCoffeeHubBot Disallow: /
We follow robots.txt as described in RFC 9309. Rules for all bots (User-agent: *) apply to us too, unless you give us a group of our own. Once robots.txt shuts us out, we stop visiting, delete the copies of your pages we still hold and stop showing your coffees. - Email. Write to hello@opencoffeehub.com. We then promptly stop crawling your site, delete the copies of your pages we still hold, stop showing your coffees, and confirm by reply.
- Blocking us. If your server blocks us, we do not try to get around it and stop visiting your site. If you also want your coffees removed from Open Coffee Hub, write to us.
6. Corrections
If a fact about one of your coffees is wrong, write to hello@opencoffeehub.com with the page and the correct value. We correct it or remove it.
7. Personal data
Product pages sometimes name people, for example the producer who grew a coffee. We keep such names only as part of the facts about that coffee, as the roaster published them on its public website. The operator named above is responsible for this, based on our legitimate interest in showing where coffee comes from (Article 6(1)(f) GDPR). Service providers that work for us on hosting and on automated text analysis process this data for us, some of them outside the EU. We keep the names as long as the coffee is shown on Open Coffee Hub, including in its record of past coffees, or until you ask us to remove them.
You can ask us what we hold about you, and have it corrected, deleted or restricted, or object to its use, by writing to hello@opencoffeehub.com. You can also complain to a data protection authority.
This page sets no cookies, loads nothing from other servers, and we keep no access logs for it.
8. Why we do this
Open Coffee Hub shows where specialty coffee comes from, built from what roasters publish about their own coffees. Every listing links back to the roaster.