Find Jobs
Hire Freelancers

Database and web scraping Project

$250-750 AUD

Terminado
Publicado hace más de 5 años

$250-750 AUD

Pagado a la entrega
Hi All, I have an existing Microsoft Access database that I would like either upgraded or converted to a quicker and less buggy database. It is currently cumbersome and often produces errors. The current database, which I will provide, downloads event related CSV files from one website, creates a unique Id for each row of the CSV file, and combines this file with a results file I download manually. The code for this is included in the database I will provide, as is the lookup table that matches the two files as they have different identifiers for location, e.g. Sydney = Syd. For this upgrade project I am happy to use a program other than Access, at your recommendation, and I would like the following improvements: - automate download of results files as well as just event files, - combine files, and once event and results files are combined, have them readily available for future analysis - ability to apply filters to database quickly and easily - easy download to CSV or excel format post application of filters (or in entirety) - additional columns, or a seperate database, that applies excel formulas to the raw database. These are generally sumifs/averageifs or one field minus another field. These formulas can be provided, and essentially compare one competitor to other competitors within that event.  I would need to be able to amend the relevant excel formulas over [login to view URL] ADVISE IF YOU DON'T BELIEVE THIS IMPROVEMENT IS POSSIBLE. I am happy with any database format that is user friendly on windows, and can continue to use Access if preferred. Note the database would be large with 400,000+ rows so not suited to excel. I would propose to pay 25% upfront, 25% at a milestone, 25% upon completion and a further 25% 3-6months later subject to your ongoing support. I would like the end product to include 1 year of recent data already completed. Please ensure you comment on how you would achieve the outcome of the project in your bid. Many thanks!
ID del proyecto: 17959776

Información sobre el proyecto

25 propuestas
Proyecto remoto
Activo hace 5 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
Adjudicado a:
Avatar del usuario
Hi, Quiet a interesting project. I have done this kind of work before. But mine was transporting data from Foxpro to Oracle (with code and UI). About me: I am having over 20 years of experience in IT field and last 10 years in large scale Data warehousing project and 6 years in Big Data implementation. Quiet proficient in Java, Scala, Python, R, Groovy languages and ETL tool like Pentaho and Talend. Database Postgresql Oracle, Mysql This can be done in Postgresql Database with Python at backend. 1. Data download and combining files can be done in Python. 2. Data can be uploaded to postgresql using python. Python has a very good interface with postgresql. 3. Postgresql has a very rich sql interface and complex algo can be implemented in pgplsql. 4. If you have any UI interface it can be implemented in wxPython. 5. Running your excel formulas on Postgresql is possible with ADO and ODBC. 6. Python seamlessly can ingest data from csv, Excel, TSV, JSON, YAML, XML On the sideways, if you have a hadoop implementation reading from CSV is more simpler in Hive. Just create an external table in Hive pointing to a hadoop folder. And drop all the csv files in that hadoop folder. Excel sheet can be converted to CSV file using python. And on the External hive table you execute your filters and queries. Hope to work with you in this project. Thanks and Regards Sumit Kumar Roy
$555 AUD en 20 días
5,0 (2 comentarios)
3,6
3,6
25 freelancers están ofertando un promedio de $523 AUD por este trabajo
Avatar del usuario
Hi, I am interested in your project related to build a scraper for events data from one website and put data to a local database. Please send me a message so that we can discuss all the details. Thanks, Ramzi
$750 AUD en 10 días
5,0 (465 comentarios)
8,4
8,4
Avatar del usuario
Hi, my name is Selim. I will write a java-based desktop app with a simple UI, which will perform the tasks and export the outcome into an access database, as you prefer... I read your "Database and web scraping Project" project descriptions carefully before bidding. I checked your requirements as well... I got what you need and ready to go ahead as soon as we can clarify further project details. I am 5-star web scraping & automation expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous businesses. I had many similar web scraping tasks, including extraction of large product databases from various ecommerce websites, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I bid my best for you to start business, and I am ready to prepare a sample task for you to check & validate, once you give me a reply...regards.
$555 AUD en 10 días
5,0 (376 comentarios)
8,2
8,2
Avatar del usuario
I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without changing my bid or playing games. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly and at my FIRST BID. I promise to deliver 100% Satisfaction.I have more than 5 year of experience in Database Development, Excel, Microsoft Access, Software Development, Web Scraping. Please ping me for more discussion.
$400 AUD en 5 días
4,9 (371 comentarios)
8,1
8,1
Avatar del usuario
Hi there, I can do database and web scraping for you. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir
$555 AUD en 10 días
4,9 (365 comentarios)
8,0
8,0
Avatar del usuario
Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within the agreed deadline. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$493 AUD en 10 días
4,9 (187 comentarios)
7,8
7,8
Avatar del usuario
Hi I can create a desktop application that scrapes the data and store it in Access or Mysql db. Can work on a demo if you like. Thanks
$1.000 AUD en 10 días
5,0 (113 comentarios)
7,6
7,6
Avatar del usuario
Dear, we are Team of French + US. I checked your project description, and I confirm I can develop your MS-Access program. Please give me more details about your project. I will focus on user friendly interface. As you can see I have very good rate, you can be sure I am serious. Regards, Fabrice
$277 AUD en 10 días
4,7 (90 comentarios)
7,4
7,4
Avatar del usuario
Hello, dear sir! I registered at the forum not so long ago, but I already have several completed projects on www.freelancer.com. I am ready to carry out your project in the reasonable price and in the shortest possible time and with the highest quality! I can offer assistance in correcting errors and updating the Access database. Give me a chance to show what I can do!
$500 AUD en 5 días
5,0 (203 comentarios)
6,8
6,8
Avatar del usuario
Hello sir, I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss details via pm. I look forward to hearing from you soon. Best Regards,
$599 AUD en 10 días
5,0 (44 comentarios)
5,7
5,7
Avatar del usuario
Greetings I am python developer and i have all the right tools for sorting yout your database. 1. Python a rich csv libary called pandas, that can be used for fixing existing database 2. When it comes to webscraping python has few libaries bs4, selenium and scrapy. 3. For excel sorting python has openPyxl. I think i am perfect candidate for this job. Sincerely Mladen
$722 AUD en 10 días
4,8 (65 comentarios)
5,8
5,8
Avatar del usuario
Sir,      I am well versed in these kind of jobs and can do your project as per requirement. I have over 12 years of experiences. I am very much able to work on this. ***I am ready to start Waiting to hear from you. with thanks and regards
$489 AUD en 14 días
4,7 (59 comentarios)
5,8
5,8
Avatar del usuario
hello, Im a database administrator engineer with 8 years of experience in this industry, I already worked on big database and developed many websites and desktop apps, I can do what you want just get in touch wth me to discuss more the project. best regards Fouad
$250 AUD en 20 días
5,0 (5 comentarios)
4,7
4,7
Avatar del usuario
Manual data scraping sir . Hello, sir! (First Bidder to offer this) I hope I will be awarded from you. ************I agree for any price you will set ** You can test me over chat before you award me! give it a try over chat before you award me! .. you will be %100 satisfied I saw your project and I would like to work on it . I am available 24 hours a day and I have fast response, I will be always there to fulfill your requirement. I always offer low cost and good perfect quality (Just try and see by yourself), I will make you get 100% satisfaction with the best quality service. I will be very happy to work with you, and I hope you too. Thank you
$250 AUD en 3 días
5,0 (19 comentarios)
4,4
4,4
Avatar del usuario
Hi, I am interested. I have considerable expertise in the design and development of MS Access databases. I would be happy to discuss about your requirement. Regards.
$490 AUD en 6 días
5,0 (8 comentarios)
4,4
4,4
Avatar del usuario
"Hi, I have just gone through your project description and reviewed everything. Yes, I’m able to work as per your instructions in your and able to provide accurate and quick service. You know! I’m efficient and experienced data entry worker. If you consider me for this job, I will try my level best to complete your project within our committed deadline. I look forward to hearing from you about the project. Regards"
$250 AUD en 3 días
5,0 (20 comentarios)
4,3
4,3
Avatar del usuario
Hi, I am a professional Access developer I have done many great projects in Access have a look at my profile Send me more details about the work
$611 AUD en 10 días
5,0 (7 comentarios)
3,8
3,8
Avatar del usuario
Hi there, The requiremens look quite clear. Rather than relying on Access I suggest you to create a program utilizing an embedded database(db). In this scenario, you don't have to deal with the db directly. The application will expose the features you need via a simple UI and drive the embedded db in the background. You mention that there'll be as much as 400,000+ rows but I don't know yet what each row composed of like how many fields are there, how long, its type, ect. We have several options for embedded db but it's better if we pick one after I take a look at your current db and possibly running some small tests on it. That'd also depend on your performance expectations like how quick would be quick enough for you, e.g for filtering - 1 sec. , 5 sec., ect. Excel formulas feature is another story. Obviously, we can't simply transfer the data into excel and apply the formulas, that'd be terribly slow. If there was only predefined formulas, not to be amended later, things'd be rather easy. To make that possible the program should at least understand a subset of excel formula directives. If there're not many you plan to use and/or the formulas are not too complex that's doable otherwise not, at least not within the scope of this project. No need to mention other requirements, it's all good and straightforward. I am planning to create this as a winforms application using c# to implement and expect this to take 15 days, thanks.
$1.500 AUD en 15 días
5,0 (4 comentarios)
3,6
3,6
Avatar del usuario
-----Hello Sir,I can do that your full project .Ready to start Now and completed ASAP "----------- Thanks Reply
$250 AUD en 10 días
5,0 (2 comentarios)
2,6
2,6
Avatar del usuario
Hi, I will convert all your access data into sql server then you can store large number of data and easy to maintain and use. I will do the Web scrapping using selenium in Windows applications. So it will be easy to use for you. I will also add option to merge, delete, insert data and download reports in excel or csv format. Let me know if you are interested Thanks, Rajesh
$722 AUD en 5 días
4,9 (3 comentarios)
2,6
2,6
Avatar del usuario
Hi there, I can convert this database in MYSql, if you prefer then please come on the chat to discuss, and i am okay with your payment terms as well. Thanks
$555 AUD en 10 días
0,0 (0 comentarios)
0,5
0,5

Sobre este cliente

Bandera de AUSTRALIA
Cammeray, Australia
5,0
3
Forma de pago verificada
Miembro desde nov 25, 2013

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.