About KendamaDBBot

KendamaDB crawls kendama shops and makers’ sites to collect product listings and prices. This page explains the program that does the crawling.

How it identifies itself

This is how it appears in your logs.

KendamaDBBot/0.1 (+https://kendamadb.com/about-bot)

The contact part is sometimes an email address instead. Both point at the same operator.

What it does

  • Reads product pages, or a published product feed (Shopify’s products.json and the like)
  • Takes facts only: product name, model number, price, stock, shipping, image URL, and the product page URL
  • Product descriptions are never stored or reproduced. Ratings and reviews are not collected either
  • Publishes what it collects grouped by kendama, so prices can be compared model by model
  • Every product page links out to the shops carrying that product. It never buys or pays for anything. It does not touch carts either

How it crawls

  • Always reads robots.txt first and obeys it. If it cannot be read, no crawl happens
  • Follows Crawl-delay where it is set. Where it is not, it waits at least one second per request (0.5s only for public APIs that return 250 items per call)
  • Each crawl has a page limit. It will not sweep a whole site in one go
  • The default interval between crawls of the same site is six hours
  • It does not visit pages behind a login, carts, orders, or admin screens

How to stop it

Add this to robots.txt. It is obeyed from the next crawl onward.

User-agent: KendamaDBBot
Disallow: /

You can also block only part of a site. If you want the listings themselves taken down, please use the contact address below — blocking in robots.txt and removing listings are two separate things.

Verifying that it is really us

There is no way to verify this crawler by IP address. It runs on Cloudflare Workers, so the source IP is in Cloudflare’s shared range. Neither a reverse DNS lookup nor a published IP range can prove it is genuine, the way other crawlers can.

Which means anyone can imitate it. If you are seeing a burst of traffic you cannot account for, do not trust the user agent — block it. Then get in touch below and we will check it against our own records.

Contact

Taking listings down, stopping the crawl, adjusting the interval, correcting something we got wrong — all of it goes here.

bot@kendamadb.com

Incoming mail only. To have listings removed, send the URL or the shop name; we will confirm and stop. No explanation needed.