Capture Website Database Updates - Automated script

Hi, I got your message regarding posting of this project. I completely agree that you might be able to get different solution approaches that you can choose from. From what ever tool that I have built earlier, and understanding the complexity of this website, I know how I should try to solve this business problem. I have detailed below the steps considering the additional project description you have given. - Solution will use the existing tool - The existing tool will be enhanced to write all the records with no PR information to a CSV on a daily basis or what ever frequency you run the tool - The information will contain the unique key (Estate #, County) that can be used to retrieve the record from website - The existing program will be further enhanced to run a routine that will process the records from the CSV file that contains records with missing PR data. This routine will process the missing PR records from earlier runs only - If PR information is updated in website, the record is extracted in full from website as usual and the corresponding entry in the missing PR CSV file will be deleted - This way the CSV file will always contain the missing PR records only Please let me know if this solution works for you. Thanks & Regards Excel Solution

Hello, I can make this crawler for you with separate PR addon. However you'll need VPS or dedicated server for this script to work, that said it won't be able to run on godaddy's shared hosting.

Hi Can you accept a desktop application? I can work on a demo if you want. Thanks

Hi, I'm expert in web scraping that's why I'm sure you'll be impressed with my work. I have read you project description and I can provide you a program which will periodically check target site and find such updated fields. Each time it will process records it will compare current record state with previous saved state. If we have difference than the field was updated. To be honest such check is pretty easy if we have saved previous check state. I highly recommend to use database (like MySQL) to save data between each run because spreadsheet is not suitable for this. But of course you'll get all results (updated records) in any format you need. We will use database only to save check state. Thanks. Roman

Hello Sir/Madam, I am an expert in web scraping (ranked #1 for Web Scraping https://www.freelancer.com/freelancers/skills/Web_Scraping/). I have done many similar jobs. Ready to start. Thanks, Alex

A proposal has not yet been provided

Dear employer, I've gone through the attached PDF. I can design a tool that will check for whether the field has been populated or not and update the data. I can give you a java program which can be scheduled to run periodically. Please let me know if this works for you. I'm ready to start working on the project. Looking forward to working with you. Awaiting a positive reply from you. Thanking you Shaik Allabakash.

So the main problem is when the data is added in an already made database. Well that is easy. The Java app which I will make will have its own databse offline one. I will fetch the data from the site completely once every day and check whether its database is upto date. The ones which are new will be made into a new database with their ID numbers and the changes in them stored. Please view my profile and see my work. If you are interested hit me up!

Dear Hiring Manager, We can do this job efficiently and effectively Have a great day to you, I am interested to do this job, I have over 15 years experience in the field of web research, data collection, market research, email collection, data-entry in excel, social media research, Facebook marketing and as admin/ virtual assistant. And I am a computer and web savvy, my goals are to make the employer/ customer happy and give better quality of work and I am ready to dedicate time for this project. Thank you Kind regards Heric. P. Note: I am quick, detail oriented and have expert team members with me to do this job and have high speed internet connection and I look forward to hearing from you to start this job soon. Thanks

I have tested the site to retrieve the data you want by record ID. By my experience when dealing with an asp site like this, you can either try to do it the long way or the easy way. The long way being screen scraping, which is a tediously long process which will necessitate going through ALL of the data, or simply get all of the new records for the day, and check ONLY the data that you want to check. I have verified that the latter is possible on this site, so I actually know it is possible to do what you are requesting by the ID of each record individually. I'd be happy to discuss it with you, just contact me. Thanks, Warren

Hi There, How are you doing? I can finish this project within a few days and my price is negotiable. have 8+ years of experience in IT programming and good knowledge in VBA, Access/Excel , SQL and web development tools. Moreover have done a lot of similar scrapping automation projects in the past. You may find my profile overview with the good reviews - couple of projects received some bonus as well :-) have gone through the document - it is pretty details with the problem statement . << It can be done by incrementally checking based on the LAST UPDATE DATE and personal reps field of the record on every run of the script >> Please contact me to discuss further about the requirements in detail and get started. My goal is win-win for both of us to establish a long good standing relationship and gain good reputation. Wish you all success. Thank you .