Recommendations for data crawlers

sadafr·Jan 06, 2021·1 reply

Hey, I'm working on a project for a client and need to extract contact details from multiple websites on mass. I've found a few data crawlers online that only do a limited number for free and I'm on a low budget. Can anyone recommend website/tool or technique that's both low cost and effective? There's hundreds of websites that need to be crawled for this information. Thanks in advance!Sadaf

prettycold

Sambhavi·Jan 07, 2021

prettycold

Sambhavi·Jan 07, 2021

Do you mean scraping? Check this podcast that explains all aspects (both tech and ethical) of scraping using Beautiful Soup. Hope this helps.https://realpython.com/podcasts/rpp/12/

share this article

read these next

Parenting in a Pandemic

Calling all small businesses

Office Hours: I'm the founder of CodeSee.io and chair for Executive Women in Product. I was formerly the head of product management at Lob and led product management teams at Docker and Cloudflare. I'm Shanea Leven.

Hiring full stack engineer and business development manager