Mass URL Scraper / Gatherer / Checker

I need experienced and reliable Python / PHP programmer/


Web-based software with 2 parts. App and spider. Spider scrapes the URLs, gathers data for them and displays them to the user. App is Laravel, spider is Python.

Spider not only scrapes URL one time. It also re-checks the URLs in the system every 24 hours.


Fix the current spider (stopped working)

Upgrade the spider to be able to handle 1 million URL every 24 hours (now it can handle like 50k)





Web Scraping

Terminal access

I personally consider it a simple task but your fee is upon agreement.

Also, can you please respond with the result of this?

4 + 5 = ?

Habilidades: Laravel, PHP, Python, Extracción de datos web

Ver más: BIDS/ENTRIES STARTED PRICE (INR) Odoo Accounting data migration I need an experienced Odoo implementer to help me migrate my , I need an experienced freelancer to fix some bugs on existing websites and an app, i need url, mysql, data processing, software architecture, python, linux, web scraping, scrapy, what i need after html and php to make website, i need a nigerian experienced writer for my book, i need someone highly experienced about undesrtand a site code in order to alterate some behavior to do some not natural actions, i need help with wordpress php, i need an experienced retired global health expert to volunteer in dallas, i need an experienced ebay seller, mass url checker keyword, help need experienced web programmer php xoops mysql, php google blogsearch url scraper, php google url scraper

Información del empleador:
( 6 comentarios ) Orchard Towers, Slovakia

Nº del proyecto: #17036840

Adjudicado a:


The answer is 9. Greetings of the day! Thank you for posting the job. Have gone through your requirements and would like to work on this. I would like to update you that I have been working on the similar requ Más

$250 USD en 15 días
(20 comentarios)

20 freelancers están ofertando el promedio de $209 para este trabajo


Dear proloa! I am highly proficient at building and customizing themes & plugins and also have an in depth understanding of PHP and its major CMS and frameworks. Our latest Slovakia's projects: [login to view URL] Más

$198 USD en 5 días
(725 comentarios)

9 Hello, I can help with you in your project Mass URL Scraper / Gatherer / Checker. I have more than 5 years of experience in Laravel, PHP, Python, Web Scraping. We have worked on several similar projects before! Más

$250 USD en 3 días
(57 comentarios)

Also, can you please respond with the result of this? 4 + 5 = 9 Hello, I read your job posting carefully and I'm interesting in your job. My major language for scraping is python/node/php with some packages(s Más

$222 USD en 3 días
(33 comentarios)

4 + 5 = ? Hi there, I have 3+ years experience at Web scraping with Scrapy. I have done some similar projects which scrape data from [login to view URL], [login to view URL], [login to view URL],... I think It is not easy to g Más

$500 USD en 3 días
(55 comentarios)

9 Dear I am an expert in web scraping. In before, I developed many spiders using scrapy. For example, I did scrape sites of products for CEOs(ebay, welivv and so on). Thanks.

$155 USD en 3 días
(56 comentarios)

Hello I am available right now, how are you? I have developed 100+ websites in many programming languages for clients all over the world. proloa could you please inbox me more detail about this project?

$155 USD en 8 días
(42 comentarios)

Hello, We are a hard-working web-development company We can develop cross-browser, W3C compliant good quality professional websites. We have gone through your requirement and have done this kind of work in th Más

$155 USD en 3 días
(10 comentarios)

hello. nice to meet you. I am a good scraping expert. I have a lot of experience in scraping by means of python(selenium, scrapy) and php(Laravel). I want to discuss about your project with you. If you hire me, I Más

$155 USD en 3 días
(14 comentarios)

4 + 5 = 8 + 1 Parallel programmer with experience in scraping in C,C++, Python, PHP and some others. I can look at your current spider code and make it parallel, or use other techniques to speed it up.

$150 USD en 4 días
(52 comentarios)

4 + 5 =9 Hi sir i can do this project easily please message me so that we can have discussion i am waiting for response Thanks

$155 USD en 3 días
(9 comentarios)

Dear Client, We are expertise in php, core php, CMS, HTML5, CSS3, bootstrap, WordPress, OpenCart, Magento, PSD to HTML, Angular JS, Node JS photoshop, OPencart, Codeignitor, Laravel and many other technologies. We have Más

$138 USD en 3 días
(76 comentarios)

we read your requirements about Mass URL Scraper / Gatherer / Checker cryptocurrency exchange like [login to view URL] here is our previous cryptocoin project please visit [login to view URL] [login to view URL] Más

$35 USD en 1 día
(18 comentarios)
$222 USD en 3 días
(2 comentarios)

Hello, i can fix your web interface and spider. I am an experienced Laravel - PHP developer. Also your answer for bots is 9 . Thanks.

$30 USD en 2 días
(9 comentarios)

Hi, I had a good look at your requirement, I have done similar kind of task in past on Laravel. I have high-level expertise in LARAVEL and keen to discuss your requirement in more detail. Sample Work Infocell Más

$277 USD en 3 días
(4 comentarios)

9 I have 6+ years of experience in Python and web-scraping using scrapy, spider.

$500 USD en 3 días
(8 comentarios)

4 + 5 = 9 Dear Client , Greeting from Prashant. I'm a expert web programmer, web designer, working mainly with Php,mysql,Laravel,Wordpress,UI/UX design,html5,css3,html,css,bootstrap,psd to html.i have 6+ year work Más

$155 USD en 7 días
(4 comentarios)

I have 6 year experience Freelancer,up work,Fiverr & 99design market place I have seen your project that i can to do easily because I have many experience to Graphic Design,Webdesign,Web Develop & programming .So I cou Más

$277 USD en 3 días
(0 comentarios)

I am experienced in python scrapy and php laravel. I can do your project with best quality. I will use scrapy framework for spider and latest version of laravel for web application considering all security and standar Más

$199 USD en 10 días
(0 comentarios)