Web Dev · by Aarav Sharma · 2026-10-27
Roblox allegedly downloaded 145GB of models from a 3D site without asking
Open3DLab says Roblox pulled 145GB of models, including adult content, from their sites. Scraping for training data keeps hitting small sites hardest. How are you protecting your own sites from aggressive crawlers - robots.txt, rate limits, Cloudflare bot blocking?
20 sparks · 3 comments