Find Jobs
Hire Freelancers

Extend operation of Nokogiri scrapers (ruby)

$750-1500 AUD

Terminado
Publicado hace alrededor de 10 años

$750-1500 AUD

Pagado a la entrega
Stagecoach Software Pty Ltd requires extensions to the operation of two functioning nokogiri scrapers. Currently the scrapers extract certain specified data from a single website on a daily basis and store the data in a MySQL database. The scrapers currently run for several minutes each day on a daily cron job. The extensions required are: (1) to the geographical spread of the searches undertaken by the scrapers on the one website; (2) to the depth of the data, with at least 3 extra columns of data to be populated for each item; and (3) to obtain an additional type of data available from the same website. Some other minor sundry changes to the code and database will be required. Full access to the existing code will be provided. The freelancer must upload code changes to GitHub and provide his own development environment ensure that the database and existing scrapers continue to operate without interference throughout the project. The additional data obtained must be automatically parsed into the database and normalised. Some normalisation code is already functioning and may be re-used. This project follows freelancer Project ID’s 5129765, 5066285, and 4975478. Further projects similar to this one will be offered to the successful bidder if the project is completed successfully. Those projects will be followed by the creation of a RoR website that will present graphs showing aggregate and individual data obtained from the database and allowing user searches. Preference will be given to freelancers interested in and qualified to carry on work in the further back projects and subsequent building of the website. Bidders without demonstrable experience in Ruby, MySQL and Web Scraping will be rejected. Bids placed within minutes of the project being posted will also be rejected as indicative of no thought being applied to the project requirements. Full written instructions will be provided. Bidders are free to revise their bids upon studying the instructions or receiving further information.
ID del proyecto: 5477803

Información sobre el proyecto

15 propuestas
Proyecto remoto
Activo hace 10 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
Adjudicado a:
Avatar del usuario
just a bid until I can see more details so I can estimate the job properly ..........................................................................
$1.500 AUD en 21 días
4,9 (62 comentarios)
6,6
6,6
15 freelancers están ofertando un promedio de $1.254 AUD por este trabajo
Avatar del usuario
I am an expert in delivering custom projects and willing to deliver the scrapers to your specifications .
$1.289 AUD en 20 días
4,9 (83 comentarios)
7,0
7,0
Avatar del usuario
Hello, I am professional rails developer and graduated software engineer. I do quick and high quality work. You can check my profile reviews for more details. Thanks
$1.500 AUD en 10 días
5,0 (56 comentarios)
6,9
6,9
Avatar del usuario
Hi, Its Steve. Ready for the task. Please see my reviews and previous projects. Can we discuss the details further ? Waiting for your reply !
$1.092 AUD en 7 días
5,0 (31 comentarios)
6,3
6,3
Avatar del usuario
Sir: My name is Pankaj Garg. Can you explain this point: (1) to the geographical spread of the searches undertaken by the scrapers on the one website;
$1.159 AUD en 20 días
4,8 (16 comentarios)
5,9
5,9
Avatar del usuario
Hi, I'm new as a freelancer here, but I'm a web scraper expert (please check my reviews: 5 stars with 100% completion rate - all from scraping projects. Also just finished 3 bigger projects and I'm just waiting for the clients to check the results).. I have computer science degree (2007) + specialization in web engineering (2008) and over 14 years' experience with web development (almost 10 with web scraping).. If you're interested, please provide me more details.. Thanks for your time
$1.150 AUD en 15 días
5,0 (24 comentarios)
5,5
5,5
Avatar del usuario
A proposal has not yet been provided
$1.250 AUD en 10 días
4,6 (23 comentarios)
5,3
5,3
Avatar del usuario
Hi David, thanks for the invite. I've done a LOT of web scraping so I'd be interested to see how your system works. In the past I've looked into Nokogiri but moved away from it since it can't handle AJAX-loaded data as well as other tools can (e.g. a headless browser like Phantom). But it's an awesome tool if you don't need JS interaction, and I'm sure it'll be straight forward to extend. I'm also very experienced building apps in Rails and doing all kinds of data visualization, so I'd be more than capable of taking on your follow-up projects. Let me know if you want to set up a time to Skype; I'm on Central time and my skype username is paul.hiatt. If you can share your Github repo ahead of time it would be helpful for me to review it (I signed the NDA as part of the bid), my handle is hiattp. I look forward to hearing from you! -Paul
$1.300 AUD en 20 días
5,0 (4 comentarios)
4,6
4,6
Avatar del usuario
David, Thanks for inviting me to bid on this project. I have signed the NDA and would love to get further details for the bid and estimation. Do you have a deadline date in mind? Look forward to working with you. Pragnesh
$1.500 AUD en 20 días
5,0 (1 comentario)
2,7
2,7
Avatar del usuario
Hi I have some experience with ruby scrapers using following gems: httparty, mechanize and nokogiri.
$1.250 AUD en 20 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de AUSTRALIA
Idalia, Australia
5,0
53
Forma de pago verificada
Miembro desde feb 25, 2013

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.