really didn't think we'd see the day amazonbot started playing nice, fingers crossed this is a real shift towards better web etiquette https://xeiaso.net/notes/2026/amazonbot-respecting-robots-txt/