Automobile website parser
$30-250 USD
Pagado a la entrega
I need automotive social networking website parser. Attention: site is in russian language.
What you will need to do:
1) Parse country list and cities list from edit profile form (ajax-based)
2) Develop bot that will check all cars on the website. It takes list of manufacturers (for example: Acura, Honda, Mazda, etc), gets list of models by makes (like Acura RSX, Acura TSX, etc) and gets list of cars by model (html page with paginator). After this it checks all cars, and if there is some HTML tag on the car page (determines if car is for sale) then it saves information about this car to database (URL, make, model, country (ID in country list), city (ID in city list), car photo URL, additional photos urls (up to 5 photos), price (numeric), price currency, description, name). If car does not have "for sale" tag but it is already exist in our database - script should remove it (it means that car is already sold).
Bot should handle exceptions like server unavailability (500 error, for example). In that case bot should send notification by email. Also it should "remember" where he stops and continue from that car when server become available again. Script should have some delay (1-2 sec) between server requests.
Bot should scan 1 car per run, but it may be possible that few instances of bot will be executed simultaneously. It should handle this situation correctly (each new instance will take new car).
Site does not require authorization to view cars. Site HTML is clean and semantic, so parser will be quite simple. Also, I'll give developer structure of database for this script.
Details like site URL and tag to determine that car is for sale, as well as car info we'll discuss with selected developer.
Thank you!
Nº del proyecto: #1419826
Sobre el proyecto
7 freelancers están ofertando un promedio de $213 por este trabajo
We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.