Jump to content

Alright, so I work in Marketing as a SEO Assistant and we do a bit of scraping (we use Screaming Frog SEO Spider and a couple other applications).

So as we were testing some new XPath Code for the scraper we started wondering how many scrapers have to be active before a website takes a hit. Either just performance wise or completely crashing the site.

Is there a way to calculate this? I know it would be different like Facebook or Twitter would be impossible but maybe smaller sites could be susceptible to this.

 

No, I have no plans for this but I am just curious and it might help people protect against this even.

Link to comment
https://linustechtips.com/topic/1088313-scraping-and-ddos/
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×