1 comments

  • TimorousBestie 244 days ago
    LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.