Crawler
AureumBot
What it is
AureumBot is the crawler behind aureum.compare - it reads the public product and price pages of the bullion dealers we list, so buyers can compare them. It fetches politely, honors robots.txt, backs off on errors and rate limits, and never touches anything behind a login.
How it identifies
Mozilla/5.0 (compatible; AureumBot/1.0; +https://aureum.compare/bot; price comparison; contact@skylabs.foo)
Allow or block it
Target the AureumBot user-agent group in your robots.txt. We honor it either way:
User-agent: AureumBot Disallow: /checkout Allow: /
Where it calls from
Fixed addresses: 167.233.131.191 and 2.28.19.191