Lets Build a Web Scraper in PHP and Python

How many total websites do you think there is on the internet? According to recent estimates, there is around 1.10 billion websites. This is also with new websites being added and old websites being removed everyday all the time. I doubt any of us can consider how much data that is floating around the internet. There is more data online than any one person could ever digest in a single lifetime, let alone 100 lifetimes. To be able to use all of that data, you need more than just getting access t

Read the full article →

Discussion thread — share findings, corrections and follow-ups below.