Asynchronous URL fetcher for Windows

Cerrado Publicado Nov 15, 2009 Pagado a la entrega
Cerrado Pagado a la entrega

I need a Windows program that will periodically get a list of URLs of websites from a central server (which we call a JobServer), fetch the URLs' HTML or binary data efficiently & simultaneously, and progressively post the data back to the JobServer. Specific requirements: • the fetcher should install and work automatically on windows XP, Vista, and Windows 7 (double-click installation, no confirmation steps, *shouldn't* rely on prerequisites that are not part of a barebones XP/Vista/W7 installation). basically, it should just work with no caveats. • when getting more than one URL in the list from the JobServer, the URLs should be fetched simultaneously, up to eight at a time. • polling of the main server should be done once each hour, or immediately after the most recent post back to the JobServer. if the hourly fetching time happens to be in the middle of the processing of a previous job, the poll should still take place as scheduled and the new job's URLs should be fetched within a new set of up to eight downloads at a time. • posting of the responses back to the JobServer should be done progressively while the response from the website is being received by the fetcher. this is because some of the URLs fetched are huge files that can't be stored locally and therefore the situation of a fetch extending for more than an hour may happen as described in the previous bullet. • a detailed log of the fetcher's activity should be saved to a local file You may use any free libraries (GPL etc.) within this project. I don't have a mild preference that this be developed in C++ but am open for suggestions if you prefer to use some other platform. To bid on this project please specify: • which platform will you choose for development? • which libraries will you use? • how quickly can you deliver this project? Thanks!

## Deliverables

1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.

2) Deliverables must be in ready-to-run condition, as follows? (depending on the nature? of the deliverables):

a)? For web sites or? other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.

b) For all others including desktop software or software the buyer intends to distribute: A software? installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.

3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).

## Platform

Windows, either C++ or another language you may choose

Programación en C Microsoft Windows Desktop

Nº del proyecto: #2964308

Sobre el proyecto

17 propuestas Proyecto remoto Activo Jan 14, 2010

17 freelancers están ofertando un promedio de $242 por este trabajo

qgrabber

See private message.

$187 USD en 14 días
(53 comentarios)
5.4
mariusbucurvw

See private message.

$85 USD en 14 días
(26 comentarios)
4.7
burgervw

See private message.

$212.5 USD en 14 días
(9 comentarios)
4.3
strgazer

See private message.

$340 USD en 14 días
(7 comentarios)
4.3
ecuvw

See private message.

$255 USD en 14 días
(12 comentarios)
4.3
khalidsafwatvw

See private message.

$170 USD en 14 días
(9 comentarios)
3.9
GeroZink

See private message.

$127.5 USD en 14 días
(12 comentarios)
4.1
sagarshah1983

See private message.

$68 USD en 14 días
(8 comentarios)
3.1
rflanz

See private message.

$127.5 USD en 14 días
(2 comentarios)
1.5
isaacksl

See private message.

$191.25 USD en 14 días
(2 comentarios)
1.3
caponelli

See private message.

$493 USD en 14 días
(0 comentarios)
0.0
alienwebsl

See private message.

$153 USD en 14 días
(1 comentario)
0.0
apraman

See private message.

$340 USD en 14 días
(0 comentarios)
0.0
enginneradr

See private message.

$25.5 USD en 14 días
(1 comentario)
0.0
engmalaa

See private message.

$170 USD en 14 días
(1 comentario)
0.0
rhof

See private message.

$1020 USD en 14 días
(0 comentarios)
0.0
bhavesht

See private message.

$148.75 USD en 14 días
(0 comentarios)
0.0