Build a Property Aggregating Website pulling from about 5 different property agency website and blog.

Completado Publicado hace 7 años Pagado a la entrega
Completado Pagado a la entrega

We are doing a Proof of Concept project that would like to aggregating 5 different property agency sources of website and blog that I would like to be able to set the time of auto-scrape their content, e.g. daily or weekly. I can setup by a parameter.

We will provide the Raw table structure and each website field mapping. Most of the source sites don't have RSS feeds so they would need to be scraped by identify website content. Scraped content would remain in a database.

Parameter need to be set

Time Interval (hours): 24, means run every 24 hours

Source: From 0 to 5. 0 means run all source, 1 to 5 specific run individual source only

Top: 0 to 100, 0 means scrape all content until finished, 1 - 100 means top 1 to top 100 record only.

Output: DB or JSON. We can set the output as JSON or direct to our DB

HTML PHP Python Diseño de sitios web

Nº del proyecto: #10308573

Sobre el proyecto

8 propuestas Proyecto remoto Activo hace 7 años

Adjudicado a:

Verz1Lka

Hello! I'm web scraping expert and i can done your project. I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is re Más

$157 USD en 10 días
(42 comentarios)
5.7

8 freelancers están ofertando un promedio de $176 por este trabajo

pmrs1978

A proposal has not yet been provided

$166 USD en 5 días
(2 comentarios)
5.5
swatirewagad

A proposal has not yet been provided

$155 USD en 3 días
(0 comentarios)
0.0
Jawjawjaw

Hi , I have exeprience in web-scraping. I work as python developer. I could build webscrapers inserting to DB quickly and without any errors. MVC controller could be built in PHP cake or Django.

$144 USD en 3 días
(0 comentarios)
0.0