Web Scraping Prevention Test
If your site has data that is expensive to collect or compute, such as flight prices, someone will try to scrape it. CAPTCHAs cost you real users, and IP reputation alone misses bots on fresh addresses.
Use the demo below to see how ShieldLabs detects automated browsers and keeps them away from your data. The flights endpoint on this page only answers when the identification behind the request shows no browser automation.
How to use this demo
- Search for flights in your regular browser.
- Now try to scrape the results with an automation tool such as Selenium, Puppeteer, or Playwright. Every bot visit is recorded in the Bot Firewall demo.
- Requests from a bot get an error instead of prices. Try it with a headless browser on your machine.
- Try replacing the request ID, the request headers, or your IP address. The result is the same.
- To see the page without protection, reload it with
?protection=offin the URL.
Note
Detected bot visits are listed in the Bot Firewall demo, where you can block their IP addresses.
Acme Air flight search
Loading the flight search