Find Jobs
Hire Freelancers

Build a social networking hashtag crawler.

$1500-3000 USD

En curso
Publicado hace más de 8 años

$1500-3000 USD

Pagado a la entrega
This app will be responsible for fetching all images associated with a hashtag. Images will be grabbed from the following social sites: • Facebook • Flickr • Instagram • Tumblr • Twitter The app will be self-enclosed and will be communicated with through a restful API. The app must be designed for efficiency and to run fast. The app will also periodically re-crawl the social sites grabbing newly created hashtagged images. The following is a scenario for how the app will operate: 1) I add a hashtag to the app with the intention to download and process all images from the above social sites. 2) The app adds the hashtag to a list then processes it when it can. 3) When the time comes to fetch the images it goes through the above social sites indexing information about the images and locally downloads them. 4) I call the restful API to grab information about the hashtag and the images. 5) The app periodically re-crawls all the processed hashtags and fetches new images. The app will run on its own server and will also act as a CDN for the images it fetches. All interactions with the Social Hashtag App must be made through a restful API. A private key must be required to access the API. The restful API must also have a logical versioning system. The app must run like an engine. It must be able to gracefully start, shutdown and restart. Please see attached for more information.
ID del proyecto: 8603562

Información sobre el proyecto

18 propuestas
Proyecto remoto
Activo hace 8 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
Adjudicado a:
Avatar del usuario
Hi, I'm an expert and experienced REST API developer as well as web scraper. I have worked on numerous similar projects involving data mining from Twitter, Instagram & Facebook and developing REST APIs which is part of my full-time job. I went through the detail project description and I understand most of it and it looks to be an interesting & exciting one. I intend to develop the app using Node.js which would solve the following requirements: 1. Speed 2. App hosted on a server 3. Well-suited for developing REST APIs 4. Send HTTP requests and receiving the image data At the moment, I have these queries: 1. What/where the app will be hosted? 2. What database have you planned to use? 3. How the images are to be saved? Please get in touch with me for discussing further details. Thanks
$1.500 USD en 15 días
4,9 (9 comentarios)
4,8
4,8
18 freelancers están ofertando un promedio de $2.378 USD por este trabajo
Avatar del usuario
Hello, I'm bidding from phone and can't view attached doc, but if that does not differ too much from your project description - this is something I can help you with. If you don't have authorization from social networks to scrape them - this still can be done, but will require proxies to operate. Otherwise social networks will simply ban your ip. I've already done similar projects for wedding photographers where they required a solution for fast download of all images associated with some hashtag on instagram & facebook for printing. I have no problem creating APIs and have alot of experience building them. Let me know how many hashtags you plan to process daily and rough estimation of how many pics will be associated with each hashtag, so I can estimate server needs & amount of proxies you'll have to use. Thanks!
$2.368 USD en 15 días
5,0 (274 comentarios)
8,7
8,7
Avatar del usuario
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. I worked on many similar projects, I have big experience in data mining projects. I have written hundreds of web scrapers which scrape millions of pages each day. I'm ready to fulfill your requirement. I can finish this task in short time, with the best quality. I can assure 100% accuracy. Please give me the opportunity to do the work. With Kind Regards, Debdulal Roy Proshanta
$2.500 USD en 30 días
4,9 (70 comentarios)
7,2
7,2
Avatar del usuario
A proposal has not yet been provided
$2.368 USD en 30 días
4,9 (227 comentarios)
6,9
6,9
Avatar del usuario
Hi there, I have read Project Description & understand the overall scope of work but I wanted to discus with my technical team lead, so please allow some times, as I have already forwarded the attached document to my technical team lead. I shall get back to you soon with my precise estimate but meanwhile, please drop me message to keep in touch. At the moment, my bid is just a placeholder, as I cannot submit the proposal without entering any amount but once you respond us, we can then finalize the estimate. Look forward to hearing from you. Regards, YK LEADconcept
$5.670 USD en 60 días
5,0 (7 comentarios)
6,5
6,5
Avatar del usuario
Hi sir, I have more than 6+ years of experience in web and desktop technologies . I worked with java EE , asp.net and php for web. I also have great experience in web scrapping and web automation , and did that for social networks . I prefer to do that in asp.net but can do in any of them. I have an idea to build it in more generic way that accept any source website with changing some parameters I look forward to work for you and I will do my best. you don't need to pay anything until you got all the work done. also I'm open for any changes and will provide alot of ideas , and will provide support even if the project completed . Thank you.
$2.222 USD en 30 días
5,0 (4 comentarios)
4,0
4,0
Avatar del usuario
Hello, How are you? I found your freelancer.com job post and I’m very interested in your project. As a skilled Web / Database Programmer professional with experience developing web, I think you’ll find I have the skills you’re looking for. I have 10 years experience in IT Software Development and have built database desktop software, website and web application. Please take a look at my portfolio in my profile and my site : web-software-developer[dot]com to get an idea of the kind of software I have developed. I am looking for a long time relation with you and I think I can handle your project alone. I could provide a team too If you wish a team for your project development. Thank you for your time, I am looking forward to hear again from you Regards Michael
$1.500 USD en 30 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
A proposal has not yet been provided
$1.500 USD en 25 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
A proposal has not yet been provided
$1.666 USD en 7 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
Greetings, I can set this up for you with a Python & Django stack. No big questions, though you'll want to develop with one social site connection to start. Basic admin interface ok. Cloud server deployment no problem. My bid is the current average. Pay when it works or we can setup delivery milestones. Based in Toronto.
$2.377 USD en 30 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
A proposal has not yet been provided
$1.500 USD en 30 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de UNITED STATES
Commack, United States
4,7
16
Forma de pago verificada
Miembro desde nov 23, 2012

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.