Jump to content

Scraping and DDOS

Alright, so I work in Marketing as a SEO Assistant and we do a bit of scraping (we use Screaming Frog SEO Spider and a couple other applications).

So as we were testing some new XPath Code for the scraper we started wondering how many scrapers have to be active before a website takes a hit. Either just performance wise or completely crashing the site.

Is there a way to calculate this? I know it would be different like Facebook or Twitter would be impossible but maybe smaller sites could be susceptible to this.

 

No, I have no plans for this but I am just curious and it might help people protect against this even.

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×