Hadoop Jobs

Cuento con experiencia en programación y deseo llevar mis habilidades de análisis de datos al siguiente nivel. Necesito que un especialista me capacite de forma práctica y estructurada en migración de datos hacia la nube, con enfoque intermedio y usando exclusivamente AWS, la plataforma que ya manejo. Lo que busco: • Sesiones guiadas, en línea, donde revisemos casos reales de migración de bases de datos y procesos ETL desde entornos on-premise a S3, EMR, Athena y DynamoDB. • Explicación paso a paso y mejores prácticas con SQL Server, Integration Services y Analysis Services para preparar los datos antes de moverlos. • Ejemplos de scripts en Python y R que automaticen validaciones y transformaciones dentro de Spark....

I am scheduled to sit the system-based SAP BTP CAPM certification exam on the latest version of the platform and need it taken for me from start to finish. The test spans the full syllabus—core concepts, advanced techniques, and integration scenarios—so I’m looking for someone thoroughly familiar with the current CAP model, CDS, Fiori elements, Node.js/Java runtimes, and the overall BTP landscape. You will receive: • My authorised exam access on the scheduled date • All study guides, sample questions, and reference notes I already have Your responsibility is to connect, complete every section confidently, and secure a passing score that issues the official certificate in my name. Proof of success—exam transcript or digital badge—will be the final...

This is a focused 1-day task. The LLM pipeline already exists in Python — I need it containerized with Docker and running live on AWS by end of day. No research, no exploration — come ready to execute. Deliverables: 1. Dockerfile & Docker Compose Write a production-grade Dockerfile for the LLM inference pipeline. Multi-stage if needed, minimal image size, env vars for config and secrets. 2. AWS deployment Deploy the container to AWS (ECS Fargate preferred, or EC2 if GPU required). Expose a working endpoint. Basic IAM role and security group setup. 3. Smoke test + handoff Confirm the endpoint is live and responding. Provide a short Bash script or README so I can redeploy independently. No undocumented magic. YOU'RE A FIT IF: ✔️ You've deployed a containerized ...

We are looking for a highly skilled Senior Data Engineer with 8+ years of experience in designing, developing, and modernizing enterprise-scale data platforms. The ideal candidate should have strong expertise in Google Cloud Platform (GCP) and hands-on experience building scalable data pipelines, data migration, and modernization initiatives. Key Responsibilities Design, develop, and optimize end-to-end data pipelines on Google Cloud Platform (GCP). Build and maintain scalable ETL/ELT solutions using GCP services such as BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Composer. Lead data modernization and migration projects from legacy/on-premise systems to GCP. Implement data integration, transformation, and orchestration processes for large-scale datasets. Ensure data quality,...

The Data Engineer is responsible for designing, constructing, and maintaining the systems and infrastructure required to process and analyze large volumes of data. This role will work closely with data scientists, analysts, and other stakeholders to ensure data is collected, stored, and processed efficiently. The Data Engineer will also develop and implement data pipelines, perform data quality checks, and optimize data storage and retrieval. Develop and maintain KPIs, metrics, and dashboards by leveraging diverse datasets. Ensure data quality and integrity through data validation, cleansing, and error handling. Design and implement back-end processes using data warehouse modeling techniques. Build and optimize ELT pipelines to capture and transform data for analytics and reporting. P...

I need a seasoned engineer (5 + years) who can take ownership of several production-grade Generative AI initiatives on AWS. Over a minimum six-month contract you will work fully remote, Monday–Friday, 5:30 PM – 1:30 AM IST, starting within the next two weeks. The engagement is budgeted at US $11 per hour, paid against agreed milestones. What you will build Our roadmap includes conversational assistants, RAG-style knowledge retrieval, intelligent automation flows, and the data engineering pipelines that feed them. Most of the heavy lifting will revolve around Amazon Bedrock—integrating foundation models, orchestrating agents, and delivering noticeably stronger natural-language understanding. Serverless patterns (Lambda, API Gateway, Step Functions) will host the APIs, w...

I’m working on my graduate-level capstone and have chosen to build a full-fledged recommendation system using a publicly available dataset (e.g., MovieLens, Amazon Reviews, Goodreads—whichever fits best once we outline the approach). The end goal is to demonstrate solid grasp of modern recommender techniques, from data preprocessing through model training, evaluation, and an easy-to-showcase demo. Scope of work The project has three pillars: 1. Data pipeline – ingest, clean, and transform the chosen public dataset so it’s ready for modelling while remaining fully reproducible (Python, pandas, SQL or Spark if scale requires). 2. Modelling – experiment with at least two algorithms that illustrate contrasting paradigms, for example matrix factorization (Su...

We are seeking an experienced Cloud Database & Process Intelligence Engineer with strong expertise in AWS database services, cloud infrastructure, automation, and platform operations. Experience in the Oil & Gas (Upstream) domain is an added advantage. Key Responsibilities: Manage and optimize AWS RDS/Aurora environments (Oracle, PostgreSQL, SQL Server) Handle database administration, schema management, backup & recovery, and performance tuning Provision and maintain AWS infrastructure using Terraform (IaC) Implement monitoring, security, compliance, and disaster recovery strategies Manage CI/CD pipelines using GitHub Actions and infrastructure code repositories Support cloud migrations, platform modernization, and operational excellence Ensure compliance with ISO, GDPR, and s...