Today I had to deal with AI scrapers DDoSing my OpenGrok instance once again.Oh,how much I hate that.Can't they just,like,clone the Git repository...Today I had to deal with AI scrapers DDoSing my OpenGrok instance once again.Oh,how much I hate that.Can't they just,like,clone the Git repository as every normal person on the planet would do,rather than scraping every single source code page from the web view?My custom Nginx if rules worked well enough for the last months,but now that they started using residential proxys,literally thousands of random IPs,and their requests start to look more like those of a normal browser,I had to add annoying countermeasures.I tried to avoid something like Anubis as long as I could,but in the long run,there's no way around it.I deployed git.swee.codes/swee/sweetCAPTCHA ,which is more lightweight compared to Anubis,but follows the same core principles.It's easy to circumvent if you try,but it works perfectly fine against that stupid sort of bots for now.I hope the problem is now solved for a long time. Show more
Loading content, please wait.