I wonder how many times over the internet has been copied by different actors
6104567411 on
Who cares? We allowed companies to steal our data time and time again.
DjScenester on
China gonna China
Thin-Concentrate5477 on
If it’s 25 times faster than it will match it in a couple of months, tops. Each month is equivalent to 2 years and one month of OpenAI scraping.
archangel_urea on
Is there any way to verify such claims?
rnilf on
> The Bytespider bot, much like those of OpenAI and Anthropic, does not respect robots.txt, the research shows.
Crawlers respecting the robots.txt was always out of politeness anyway, but it’s sooo cool to see even that’s been thrown out the window at this point.
dethb0y on
That poor fucking scraper, i can only imagine the absolute exabytes of spam it must chew through.
birdwatcher2022 on
That’s what happens when rules were burned down. The most ferocious and vicious monsters are going to win. Stupid suckers…
10 Comments
I wonder how many times over the internet has been copied by different actors
Who cares? We allowed companies to steal our data time and time again.
China gonna China
If it’s 25 times faster than it will match it in a couple of months, tops. Each month is equivalent to 2 years and one month of OpenAI scraping.
Is there any way to verify such claims?
> The Bytespider bot, much like those of OpenAI and Anthropic, does not respect robots.txt, the research shows.
Crawlers respecting the robots.txt was always out of politeness anyway, but it’s sooo cool to see even that’s been thrown out the window at this point.
That poor fucking scraper, i can only imagine the absolute exabytes of spam it must chew through.
That’s what happens when rules were burned down. The most ferocious and vicious monsters are going to win. Stupid suckers…
Hi scrapers! Bye scrapers..
All your data belongs to us now.