Crowd Sourced, Open Sourced, Data Scraping Robots

January 02, 2025
by a professional from Northwestern University - Kellogg School of Management in Southborough, MA, USA
I found a ton of posts on here about people who are using list buying techniques, manual data collection and scraping, and different tips on lead list generation. Seems like we are all at the mercy of the bigger SaaS platforms.
Not sure what it is about it, but I hate paying per lead and I hate these monthly fees, etc. So, I am about to embark out on building a generative AI implementation of a data scraper, likely built on LangChain or something similar. We could then formalize the product to either hang up a shingle online to sell on a per lead basis, or just open source it and let the community to continue to improve upon the model.
First, does anyone know of a platform like this? I haven't been able to find one. If not, is there anyone out there willing or interested in going at this? I'd rather pay a few grand now to have something rough I can use than pay a Just an idea now, I have scripts written that are definitely not worth publishing yet because they're super specific to Houzz, etc.
from Wesleyan University in Needham, MA, USA
from Wesleyan University in Needham, MA, USA