This one. One of the best motivators. Sense of satisfaction when you get it working and you feel unstoppable (until the next subtle changes happens anyway)

I feel this

I successfully scraped millions of Amazon product listings simply by routing through TOR and cycling the exit node every 10 seconds.

You guys use IP’s?

Here take these: \\

13 years ago my god. I wonder what Jon Skeet is doing these days.

I remember when he passed me in the reputation ranking back in the early days and thinking that I needed to be a little bit more active on the site to catch him lol.

That was a great read. Thanks!

Go and look it up on stack overflow

In short, it’s the wrong tool for the job.

In practice, if your target is very limited and consistent, it’s probably fine. But as a general statement about someone’s behavior, it really sounds like someone is wasting a lot of time and regularly getting sub-par results.

uses curl manually instead

API starter kit

• Outdated and unsupported and hasn’t been replaced yet but is the standard way to use the service.
• Lots of authorization tokens.
• The example in the docs doesn’t work (if there is one).
• You have no idea where the online tutorial got the information because it doesn’t have links to resources and the docs have barely anything even though its giant.
• Uses asynchronous programming to make it faster but its still much much slower then scrapping without asynchronous programming.

Awk all the things!