hero

Career Central

Connecting people since 1887

Azure Data Engineer

Capgemini

Capgemini

Data Science
India
Posted on Oct 8, 2024

Job Description

As an Intermediate Azure Data Engineer, will be in charge methodology, developing, and maintaining robust data solutions using Azure technologies. Candidate will work closely with PowerBI, and other stakeholders to ensure data is accessible, reliable, and valuable for business insights.

Key Responsibilities:

Design and implement data pipelines using PySpark and SQL to ingest, transform, and load data from various sources into Azure Synapse or ADF

Implement and manage ETL end to end pipeline by using Synapse or ADF Pipeline activity for eg(Copy, foreach, if condition, lookup, metadata, dataflow and more…)

Job Description - Grade Specific

Develop and optimize data models in Azure Synapse to support efficient querying and reporting.

Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet their needs.

Implement and manage CI/CD pipelines for data solutions using Azure DevOps, ensuring smooth and efficient deployment processes.

Monitor and maintain data pipeline performance, troubleshooting and resolving any issues that arise.