Find Jobs
Hire Freelancers

Scrape newest real estate listings with Ruby and Active Admin as CRUD -- 2

$250-750 USD

Cerrado
Publicado hace alrededor de 4 años

$250-750 USD

Pagado a la entrega
We want to scrape real estate listings of 3 different websites. More websites will be added later. Ideally we can add more websites by configuration (ideally we can configure the regex for each variable). We will provide a briefing with all values marked on the respective listings pages. The goal for the tool is to scrape the newest listings so we can check them and if needed, post them on our own platform (of course with a reference to the source) instead of copy-paste them by hand. The scraper should have the following behavior: - 1st we scrape the index/result pages to find newly added listings - 2nd we visit and scrape individual listings The scraper should not scrape more than 5 listings per hour per website to prevent unnecessary load and the scraper from being banned. Scraper has to be developed in Ruby (or RoR) and we will use Active Admin as CRUD for the data management. Database will be PostgreSQL. You should also be able to set this up on Amazon AWS (EC2/RDS/S3). We might also integrate the tool you develop into an existing setup. In addition you know about using proxies and can implement that. Finally, please add the result of 6+5=? to your bid, so we know you're not a bid bot.
ID del proyecto: 24081228

Información sobre el proyecto

19 propuestas
Proyecto remoto
Activo hace 4 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
19 freelancers están ofertando un promedio de $588 USD por este trabajo
Avatar del usuario
result = 11 Hi, my name is Selim. I am from UK. I read your "Scrape newest real estate listings with Ruby and Active Admin as CRUD --2" project descriptions carefully before bidding. I checked your requirements as well... I got what you need and ready to go ahead as soon as we can clarify further project details. I am 5-star web scraping expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous businesses. I had many similar web scraping tasks, including extraction of large product data from various ecommerce websites, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I bid my best for you to start business, and I am ready to prepare a sample task for you to check & validate, once you give me a reply... Kind Regards, Selim
$550 USD en 7 días
5,0 (303 comentarios)
8,2
8,2
Avatar del usuario
11 Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. What are the URLs of those 3 websites ? Please feel free to initiate the chat so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$650 USD en 14 días
4,9 (169 comentarios)
8,0
8,0
Avatar del usuario
You can bank on me for the expertise in scrapers and crawlers I have. Having delivered many such similar projects in the past, I look forward to discuss and start the project inline to your requirements
$500 USD en 7 días
4,9 (66 comentarios)
6,7
6,7
Avatar del usuario
6+5=11 I have done this before for an Australian client, this is not very trivial and if you are not careful your IP would eventually get banned from their servers
$2.000 USD en 30 días
4,9 (27 comentarios)
6,3
6,3
Avatar del usuario
6+5=11 Hi, i'm good at web scraping . Last year, i created private ruby gem for scraping specific site. Experienced on ActiveAdmin Gem , Postgresql database. Also I can deploy it on EC2 . Thanks, Mezbah Alam
$500 USD en 7 días
5,0 (57 comentarios)
6,4
6,4
Avatar del usuario
Dear Client , Hope you are doing well, I have reviewed the job post and would like to join you as a fullstack ROR developer. I am full time and immediately available for this job (40 hrs in a week ) and having excellence communication skill, request you to please share some more details to get start the job. I am working in Ruby on Rails from last 10 years, I have done too many projects with different technologies as well as different types of servers, like Ubuntu, Centos, etc. And have full command on Server side configurations along with multiple databases. Like Mongo, Postgresql, mysql, redis, etc. As I have great expertise in : ----Core - Ruby and Ruby on Rails , react , react native ----Front end - JavaScript, Angular.js, React JS, Backbone.js, HTML, HTML5, Bootstrap, CSS3, ----Test Driven Development - RSpec, Capybara, Shoulda, FactoryGirl, Selenium, Poltergeist stack. ----Database - MySQL, PostgreSQL ----Middleware - Redis/Resque, Memcached, Sidekiq, Delayed_job ----Methodologies - Scrum/Agile, TDD, BDD, pair-programming ----Cloud server - EC-2, Digital Ocean, Heroku, Linod, Azure ----API Integration - Facebook, Twitter, Google, LinkedIn, Twilio, Sendgrid and other, Payment API. So please give me opportunity to proof you my skills. I hope you and i will go for longer relationship. Thanks.
$250 USD en 5 días
4,9 (56 comentarios)
6,4
6,4
Avatar del usuario
Hi, I will build the scraper in Java(although Ruby is not a problem. I have expertise building scrapers in Java). I will set up cron jobs on EC2 instance to trigger the "NEW LISTINGS" scraper each day and "INDIVIDUAL LISTINGS" scraper each day that scrapes only five listings per hour per website. I will automate the entire process. I have expertise in automating such tasks. Please contact me to discuss more about my proposal. Looking forward to hearing from you soon. Thank you.
$500 USD en 6 días
5,0 (12 comentarios)
6,0
6,0
Avatar del usuario
Hi, I can Scrape newest real estate listings with Ruby and Active Admin as CRUD for you on time and within your budget. Website design and development work portfolio: https://www.freelancer.com/u/webdroid Skills and expertise: HTML5 , CSS3, JAVASCRIPT,Jquery ,Bootstrap,ajax,PHP ,Mysql ,Laravel ,Codignator,ecommerce ,UI UX, API integration, payment module integration,Web scrapping. Let's connect in chat
$450 USD en 5 días
4,9 (5 comentarios)
5,2
5,2
Avatar del usuario
11 Hello there, Hope you are doing fine. I am a full-stack web developer with more than 6 years of experience in web scrapping Ruby and PostgreSQL. I can develop a perfect tool for you that will scrape the data from 3 websites listings. It will scrape the newest listings as per your requirements. And the scraper will not scrape more than 5 listings per hour per website. I understand your requirements and can do this job perfectly for you. Share that 3 websites and more details about it. Let's discuss it over chat. Waiting for your response
$250 USD en 2 días
5,0 (1 comentario)
4,4
4,4
Avatar del usuario
Nice to meet you I am an Amazon Cloud Architect for the web infrastructure serving 90 million page impressions and 12 TB Internet traffic per month. The AWS services I use are EC2, ELB, MySQL RDS, VPC, CloudFront, ElastiCache, CloudWatch, CloudFormation, OpsWorks, ElasticBeanstalk, CodeDeploy, S3, SES, SQS and SNS. I have 20 years of Linux SysAdmin experience. I currently use Apache, Nginx, Ldirectord, MySQL, Perl, PHP, Memcached, Sphinx, Bind, Typo3, WordPress, Send-mail, Postfix, NFS, Samba, Snort, Vsftpd, aide, Nagios, Cacti, Puppet and a bunch of other traditional Linux software. I am good at amazon-web-services,postgresql,ruby,ruby-on-rails,web-scraping If you’re looking for a developer that’s truly an expert, driven by passion, not afraid to take on a challenge, and will be there with you every step of the way then look no further as I’m your guy.
$637 USD en 9 días
4,8 (5 comentarios)
3,8
3,8
Avatar del usuario
I have gone through the above-mentioned details very well. I have got plenty of experience in ruby on rails, web scraping, amazon web services, postgresql, ruby kinds of works and I can assure you that I can reach your satisfaction level by providing you best results with ruby on rails, web scraping, amazon web services, postgresql, ruby Looking for a positive response Thanks
$456 USD en 7 días
5,0 (1 comentario)
3,2
3,2
Avatar del usuario
11 Hi, I can do that and have rich experience to scrape data from websites. Please contact me via private chat. Regards, Fan
$500 USD en 7 días
5,0 (1 comentario)
1,4
1,4
Avatar del usuario
Hello there, How are you doing? Just saw your project posted. I read the brief details and I felt I could help you with it. Lets start the chat and discuss it in detail. Please check my porfolio: My Portfolio: https://www.freelancer.com/u/AITSoft Availability timings: 8am-8pm EST Regards, Shamshad
$750 USD en 22 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de SWITZERLAND
Zollikon, Switzerland
5,0
29
Forma de pago verificada
Miembro desde sept 2, 2009

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.