Yup. Recently built something that needs to do low volume scraping. About 40% su...

ninjagoo · 2026-02-14T19:13:24 1771096404

Did you have rate limits built in? Ultimately scraping tools will need to mimic humans. Ironic.

I wonder if bots/ai will need to build their own specialized internet for faster sharing of data, with human centered interfaces to human spaces.

Havoc · 2026-02-15T16:06:36 1771171596

Yeah it gets blocked literally on first fetch so not a rate limit issue.

fc417fc802 · 2026-02-14T19:54:22 1771098862

IPFS and IPNS already exist.