Anubis

Weigh the soul of incoming HTTP requests using proof-of-work to stop AI crawler

LLM web spiders are creating troubles to tiny website, because they seems to ignore robots.txt directive and scrape all the website at the bild search of information to ingest.

Read More