Craigslist Website scraper! It’s developed in PHP and MySQL, and only needs a a hosting account to be installed on and run through, and will go through every Craigslist city’s website, and do a search query or pull up a certain category page etc., then it will scrape the results displayed and parse them then import the parsed data neatly into a database. It parses and stores: the specific Craigslist site/city, the Craigslist PostingID, posting title, email, posting content, any images included anywhere, and it will also parse the posting content to look for an email address and then store that. This script can be setup to run as a cron job, to constantly poll Craigslist for new postings that come up, and then you can do what you want from all the retrieved and parsed data.
NEW:
Now has:
- .csv Export, now organized by state and city
- Simple Admin screens
- Craigslist Query String Link Builder
- Quick & Simple 1-step Setup
Features Coming Soon:
- Password protected
- Proxies used for scraping
I also have a version of the CL scraper that is tailored to scraping autos and will scrape and store the following data:
- Year
- Make
- Mileage
- Price
- Phone
Contact me to purchase
If you have any questions about this script, drop a comment or contact me.
Thanks,
Josh
Video of newest version in action!
Video of Auto Specific version in action!
Showing actual scraped content for CL, (Notice 30K+ records!!)
