Data scraping from 3 websites
€250-750 EUR
Pagado a la entrega
Hi!
For marketing research we need to collect public data form three websites.
REQUIREMENTS MUST HAVE
* PHP as programming language
* Use CURL library for HTTP requests
* PHP script should be run in commandline
* Efficient crawler to minimize number of requests
* Store data in MySQL database
* Configuration part in the script which sets database user/pass/dbname and other settings in one place
REQUIREMETS NICE TO HAVE
* Possibility to extend with new websites
* Possibility to stop the script and to continue where is left off. Do not crawl already crawled data more than once.
FIELDS TO SCRAPE AND STORE
source_website = name of the website
scrape_url = url where data form scraped from
contact_name
visit_adress1
visit_zipcode
visit_city
visit_country
post_address1
post_zipcode
post_city
post_country
phone1
fax1
website
company_name
company_vat_number
company_coc_number
company_description
company_url_logo
company_size
company_start
member_from
member_status
category
DELIVERABLES
* Database structure for MySQL tables.
* One PHP script, which can be run in command line. This script fills the database with data from the websites.
PAYMENT
* 2 milestones; 1) 50% when script is running and working and 2) 50% when everything is checked to be working properly.
WEBSITES
== 1 ==
Index page:
[login to view URL]
Data page:
[login to view URL]
Data example:
* URL to company logo
* URL: [login to view URL]
== 2 ==
Index page:
[login to view URL]
Data page:
[login to view URL]
Data example:
* URL to company logo
* [login to view URL]
== 3 ==
Index page (use the # A B C D … subpages for all entries):
[login to view URL]
Data page:
[login to view URL],CompanyId
Data example:
* [login to view URL]
* [login to view URL]
Nº del proyecto: #1052711
Sobre el proyecto
17 freelancers están ofertando un promedio de €324 por este trabajo
We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.
Expert in PHP/MySQL and data scraping. Already successfully accomplished scraping for many different sites, wholesale, betting, companies info, ...
I am Saad, experienced PHP/ASP web developer and have developed many websites in my entire career, doing a great job in development. Currently i am scrapping data for http://www.locallite.com. it is an Business dir Más
Expert in data scraping.. Possibility of long term cooperation if interested and satisfied with results..
