For site owners
About ChiveRecipeBot
What it is
ChiveRecipeBot is the crawler behind Chive's recipe search directory. It reads publicly listed recipe pages so people can discover them, and every result links back to the original page on your site. It identifies itself honestly in its user-agent string, which links here.
What it collects
Only the structured facts a page already publishes for search engines (schema.org Recipe data): the recipe name, description, times, yield, ingredients, nutrition, ratings, and the page URL. It does not store cooking instructions and it does not copy or re-host images; recipe photos are always loaded directly from your site by the reader's browser.
How it behaves
The bot obeys robots.txt (including Crawl-delay), discovers pages through your sitemaps, fetches at most one page at a time per site with a delay of several seconds between requests, uses conditional requests to avoid re-downloading unchanged pages, and backs off immediately when a site returns errors or rate-limit responses.
How to control or opt out
Add a rule for the ChiveRecipeBot user-agent to your robots.txt to limit or block crawling; changes are picked up within a day. To have existing pages removed from the directory, or for anything else, reach us through the contact channel on the Chive homepage and we will handle it promptly.
