Protecting your platform against scrapping
Date : 2023-07-01
Tweet
Tweet in response to a claim that Twitter (now X) were limiting visibility to fight scrapping
It's hard to go into depth since this is an arms race situation. At a high-level though, aside from hardening your auth, there are 4 things you can do:
— Jared Palmer (@jaredpalmer) July 1, 2023
1) Use a rate limiter against IP and user ids
2) Block traffic from bad acting nation states
3) Only allow requests from real…
Recently on :
Artificial Intelligence
Security | Surveillance | Privacy
WEB - 2024-12-30
Fine-tune ModernBERT for text classification using synthetic data
David Berenstein explains how to finetune a ModernBERT model for text classification on a synthetic dataset generated from argi...
WEB - 2024-12-25
Fine-tune classifier with ModernBERT in 2025
In this blog post Philipp Schmid explains how to fine-tune ModernBERT, a refreshed version of BERT models, with 8192 token cont...
WEB - 2024-12-18
MordernBERT, finally a replacement for BERT
6 years after the release of BERT, answer.ai introduce ModernBERT, bringing modern model optimizations to encoder-only models a...
PITTI - 2024-09-19
A bubble in AI?
Bubble or true technological revolution? While the path forward isn't without obstacles, the value being created by AI extends ...
PITTI - 2024-09-08
Artificial Intelligence : what everyone can agree on
Artificial Intelligence is a divisive subject that sparks numerous debates about both its potential and its limitations. Howeve...