What kind of magic does this website use to detect bots?

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP


What kind of magic does this website use to detect bots?



I'm currently working on a scarper.



While testing, I found this website: http:// a t c a v o c a t s .com/



This website works fine on a browser, but I get a timeout when scrapping.



No matter what I do: I follow redirects, I activated cookies, I use a keep-alive connection, and I'm using all headers that Chrome ordinarily use



{ 'Accept':
'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/;q=0.8',
'Accept-Encoding': 'gzip, deflate, sdch, br',
'Accept-Language': 'en-US,en;q=0.5',
'Referer': 'http://google.com/',
'Upgrade-Insecure-Requests': '1',
'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94
Safari/537.36'
}



, but still I get a page timeout.



What kind of magic does this website use?









By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Popular posts from this blog

C# - How to create a semi transparent or blurred backcolor on windows form

Will Oldham

Makefile test if variable is not empty