JL Forums

proxy breakdown on all fronts ...

0 Members and 1 Guest are viewing this topic.

proxy breakdown on all fronts ...
« on: March 15, 2017, 01:42:35 PM »
Hello,

This morning I got this message from my proxy provider:

>>>

Hello,
we have noticed in logs of proxies that you are sending a huge number of request per second to www.pinterest.com just for 5 proxies from your IP: xyz.abc.12.abc (<-- my VPS IP address)
please stop that because you are causing full subnet ban just with 5 proxies

<<<

I received that having just driven 45 minutes from my pc and committed to being there for at least another 10 hours.

I was left with no alternative than to write to them and ask them to dismantle the proxies as I could not get back to resolve this before some serious damage was caused to their operations

I dont know much about the technical issues this refers to but I would like someone to explain what happened, how it happened and how I can fix this and get things back on the move again.

Thank you for ny thought son this - it ended as a total breakdown. I am offline on all counts.

Thanks fr your early reply.

Sam Deane
London



Offline Jonathan Leger

  • *****
  • 8171
  • Here's to your success!
    • View Profile
    • Jonathan Leger's Blog
Re: proxy breakdown on all fronts ...
« Reply #1 on: March 15, 2017, 02:01:35 PM »
That means you're using a very poor quality proxy provider. SM2 sends a lot of requests, but the amount of data is very, very tiny per request (usually just a few hundred bytes at most). If your proxy provider has a problem with that level of data, they're not a good provider.

So stop running SM2, find a better quality provider and after a couple of days modify the proxies in SM2 and start it up again.

Re: proxy breakdown on all fronts ...
« Reply #2 on: March 15, 2017, 11:05:00 PM »
Thank Jonathan,

I am writing to them to ask what they think might have caused this sudden spike/problem - I recently introduced a client's genuinely aged pinterest account in to SM2 - there is maybe a challenge associated with that .

I have written to the proxy providers (Storm) for more answers and meanwhile popped everything on pause.

All the best

from Sam
London
« Last Edit: March 15, 2017, 11:25:00 PM by samdeane »

Re: proxy breakdown on all fronts ...
« Reply #3 on: March 16, 2017, 01:17:32 AM »
Reply from the proxy guy:

i don't know if your developer know how sites ban IP's !
the tool is making at least 100 requests/second for same URL, is not important how big the amount of data 1kb or 1MB, such huge requests will be recognized as DDOS attack by sites and cause IP's ban for our subnets.

--

Any thoughts on this?

All thebest

from Sam

Offline Jonathan Leger

  • *****
  • 8171
  • Here's to your success!
    • View Profile
    • Jonathan Leger's Blog
Re: proxy breakdown on all fronts ...
« Reply #4 on: March 16, 2017, 09:36:02 AM »
How many accounts are you running on SM2, and how many pin/follow jobs? There's no way it's making 100s of requests per second unless something is seriously wrong -- or the support guy isn't telling you the truth.

Plus, if SM2 was making hundreds of requests per second, unless you were running it on a super monster server, SM2 would slow to a crawl (or stop completely) because it's not designed to run hundreds of threads simultaneously.

Re: proxy breakdown on all fronts ...
« Reply #5 on: March 17, 2017, 06:03:23 AM »
How many accounts are you running on SM2? It was 5 at the time. I deleted two as they had been de-indexed by pinterest. Cant remember if it was before or after this incident. I think it was 5 at that time.

how many pin/follow jobs?  the new one was running 70/100 and the others were running to your advised limit 180/250 They have been going for 6 months or more

No  super monster server in sight 

Is it safe to start back up on different proxies?

Also, best practise if the new account is a UK based account? Should I in 100 times out of 100 set up a redirect for this as the proxies (these are basing in Dallas Texas) will look weird like provoking a red flag. Is there a way rather than redirect to make this work?

I am keeping things on hold until Im secure in my mind what is going on and my best safest course of action from there.

Thanks for your support Jon. Much appreciated.

All the best

Sam
London

Offline Jonathan Leger

  • *****
  • 8171
  • Here's to your success!
    • View Profile
    • Jonathan Leger's Blog
Re: proxy breakdown on all fronts ...
« Reply #6 on: March 17, 2017, 06:09:27 AM »
No way you were sending 100s of requests per second. I think the support person is full of baloney. Unless they provide actual logs showing 100s of requests to Pinterest per second I think they're just a low quality provider and you need a different one.

I've never run SM2 on UK accounts so I can't give you any guidance there.

Re: proxy breakdown on all fronts ...
« Reply #7 on: March 17, 2017, 08:18:35 AM »
I just cancelled from the old provider. They were very expensive as well as I discovered. No point arguing the toss with them. If the next lot come back with a similar concern we will have to look closer I think but if not, we can assume the previous proxy providers were losing the plot or whatever.

All the best

from Sam