hero

Career Central

Connecting people since 1887

Senior Data Engineer (AWS)

Capgemini

Capgemini

Data Science
Colombia
Posted on Oct 9, 2024

Senior Data Enginer (AWS) - Work from home

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unluck the value of technology and build a more sustainable, more inclusive world.

Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Quantum Data and AWS Cloud.
  • Manage and optimize MongoDB databases to ensure high performance and reliability.
  • Utilize SQL for data manipulation and analysis.
  • Implement data ingestion tools such as Kafka for real-time data processing.
  • Perform data cleanup and maintain data integrity across systems.
  • Address technical debt and refactor existing code for improved efficiency.
  • Develop data processing applications using PySpark and Python.
  • Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.

Qualifications:

  • Proficiency in Quantum Data, MongoDB, and AWS Cloud.
  • Strong SQL experience for data querying and management.
  • Familiarity with data ingestion tools, particularly Kafka.
  • Experience with data cleanup processes and addressing technical debt.
  • Proficiency in PySpark and Python for data processing.
  • Strong problem-solving skills and attention to detail.

ABOUT CAPGEMINI

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to lifesaving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

#LI-DC10

#LI-Remote