Cerrado

PostgreSQL, Node.js, Javascript

JOB DESCRIPTION:

You are assigned to write the javascript code that will run on [url removed, login to view], which is a cloud scraping service based on [url removed, login to view] and store the result in a PostgreSQL database hosted on Amazon Web Services.

A script has alredy been developed that is 95% finished, which outputs the data as JSON, and can be accessed through [url removed, login to view]’s API. Your only job in terms of working with the code is to structure it and write comments in the code according to the tables that you will create in the database (For example: /***This block of code is inserted in the name_of_table***/) and also change the column names according to the Excel-document that will be provided to you.

The way you should populate the database is by writing a piece of Node.js code, utilizing the Lambda service on AWS ([url removed, login to view]) in order to fetch the data from Apifier's REST API, perform validation and cleansing of the data (e.g. remove duplicates with respect to your database) and store it into the database.

All the info about Apifier's REST API, how to call it etc., is available on the Apifier website under the documentation page ([url removed, login to view]).

For the database design we want you to design our database schema according to the best practices and we will send you a paper on how this has been done for another very similar service and bBefore you implement the database schema we would like to review it and understand your reasoning behind it. Information about the database needs to be well documented in terms of identification of the database, configuration files, database management system used, and schema design.

I will message the applicants I find interesting and you may ask me any questions you have about the project. Once you have feel that you have the information you need I would like you to provide me with an estimate of number of hours needed to complete the project. Your estimate will need to be within +- 10% of the final invoice. I will then create a new project with the requirements and specifications of the project that we both have agreed on. You will then bid on the new project according to the price and estimate number of hours and I will award it to you.

All communication should take place through [url removed, login to view] messaging system.

SKILLS NEEDED:

-PostgreSQL

[url removed, login to view]

-Webscraping

-Javascript (no Jquery)

WHEN TO START:

Right away, the sooner the better.

Habilidades: Javascript, node.js, PostgreSQL , Extracción de datos web

Ver más: writing job specifications, writing a review on amazon, writing an invoice, webscraping service, webscraping job, web scraping freelancers, web design info block, schema design of a web page, schema design, review javascript, rest api design, reasoning and writing, paper writing services, node lambda, node js job, node js best practices, node job, node excel, node data structure, need a cloud for web service

Información del empleador:
( 12 comentarios ) Stockholm, Sweden

Nº del proyecto: #9053216

6 freelancers están ofertando el promedio de $11/hora para este trabajo

readerzxy

Hi, We are a team of qualified front-end and server-side web developers and interested in working with you on your project. We would like to discuss some details mentioned in the description. Expertise, - NodeJ Más

$8 USD / hora
(5 comentarios)
5.2
agarwalankur58

I am experienced with database design, pure JS, Node JS applications. I currently work mainly on Node JS application development and NoSQL database design and I have experience of designing RDBMS databases in the past.

$8 USD / hora
(8 comentarios)
3.9
cracken

Hi, I, based on my 5 years of experience as a software engineer knowledgeable with tools automation, can handle this task pretty well. Let me know the best of your time so we can discuss further based on your requirem Más

$8 USD / hora
(2 comentarios)
1.7
chandramaran

I've some experience in AWS and just gained knowledge on Apifier . As per my understanding this project would take 50 to 60 hrs for me to complete. Implementation Plan • Do a kind of POC to get familiar with apif Más

$8 USD / hora
(0 comentarios)
0.0
anand997755

Hi , I am currently exploring myself as freelance developer. Following are the areas I have worked in the past : Programming : Java , J2ee , Jquery , Javascript , Unix and Linux Scripting Application Ser Más

$6 USD / hora
(0 comentarios)
0.0
venkisw

I assume it will involve a fair bit of exciting review of your existing script and changes there of. When someone else has developed code - specially in a type-less language like JavaScript, it is always a challenge to Más

$27 USD / hora
(0 comentarios)
0.0
gayathrisubash

Please find the github link of the samplecode i've done using node.js, [login to view URL] and mongoDB for device subscription in push notification service and batch processing, [login to view URL] I Más

$7 USD / hora
(0 comentarios)
0.0
avinashkumaranu

A proposal has not yet been provided

$8 USD / hora
(0 comentarios)
0.0