SuumerBot
SuumerBot is the crawler for Suumer, a free local events listing with no ads. It reads public event pages and calendar feeds so people can find events, and every listing links back to the venue's own site. It never logs in, fills in forms, or reads anything that is not public. It also reads a venue's own menu and visitor pages, so people can find a place by what it serves (wings, tacos, vegan options) and see its happy hour, patio or cover charge. Each fact is checked against the venue's page, shows the day it was read and links back to that page. It never opens a venue's Facebook, Instagram or other social pages; it only notes the addresses the venue's own site links to.
How to recognize it
SuumerBot names itself in every request it sends:
Mozilla/5.0 (compatible; SuumerBot/1.0; +https://suumer.com/bot)It follows robots.txt
SuumerBot reads your robots.txt before anything else and follows it, including rules that cover the part of an address after a question mark.
Rules you wrote for our older names still work: SuumerResearchBot, SuumerResearch, SuumerOwnerCalendarReview and PublicCalendarResearch. SuumerBot follows the strictest rule that names any of them, or *. It also follows rules written for ClaudeBot and anthropic-ai, because Suumer's research is run with Claude.
To stop it, add these two lines:
User-agent: SuumerBot
Disallow: /How fast it goes
At most one request per second to any one site, and slower whenever your robots.txt sets a Crawl-delay.
Questions or removal
Own a site and want it off Suumer? Use the stop form. Listings from your site come off Suumer as soon as you send it, whether or not you change robots.txt.
Questions: email [email protected].
What it found: how many event listings online are already over.