Search multitudes of sites for free material

This is a very easy and straightforward software project for someone who has done this sort of work before. We are developing an online presence in a niche part of the recreation marketplace. We are seeking out all the free offerings from the thousands of websites that cater to that niche e.g. free ebooks, articles, software downloads, catalogues, screen savers, chat facilities and so on. We are doing that manually at the moment, visiting each site and trawling through all of the indexes and pages until we have a good overview of what is available that does not incur a fee. We then go through all of that information and place it into one 12 categories (software downloads, catalogues etc), capture the link, write a brief overview of what is there, put all the chat topics into a category master list, and write down the domain name for the overall site that the free information came from. We then sell that information to enthusiasts in that niche. What we are looking for is a software solution to automate as much of that process as possible. ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform Windows XP.