Shalien Dear #fediadmin, regarding the current ongoing full force assault on our services by AI scrappers with all the risks associated (costs, services stability, data being stolen and so on) I can only recommend the setting up of #techaro #anubis requests filter to "weight the souls of incoming HTTP requests"
I tested it so far on #alpine #debian deployed services with either #caddy , #apache2 / #httpd and #nginx for the following services #nextcloud, #mastodon, #forgejo, #lemmy, #funkwhale, #bookwyrm and a #minecraft #mapviewer with little hassle and no big issues
Following the use of #anubis, all scrapper (AI and regular) logs dropped drastically and bandwitch usage was cut by two third on the mastodon instance and half for the others services
Do yourself and your users a favor try it : https://github.com/TecharoHQ/anubis
: