Data And Analytics - Azure Data Engineer - Senior - Ey Gds (Miguel Hidalgo) (Xico)

Overview

We are looking for a Senior Data Engineer with expertise in developing and managing Kafka‑based data pipelines, implementing complex stored procedures, and best practices with data warehouse and ETL concepts. The role includes deploying fully operational data warehouse solutions into production on Snowflake to join our GDS Mexico team. This is a fantastic opportunity to be part of a leading firm and instrumental in the growth of a new service offering.

Responsibilities

• Design and develop batch and streaming data processing.
• Build data systems and pipelines.
• Evaluate business needs and objectives.
• Prepare data for prescriptive and predictive modeling.
• Build algorithms and prototypes.
• Combine raw information from different sources.
• Explore ways to enhance data quality and reliability.
• Identify opportunities for data acquisition.
• Monitor and optimize data storage and data processing.
• Design and implement data security.

Skills and Attributes for Success

• 3–5 years of experience with Apache Kafka, Kafka Streams, and Azure Event Hub.
• 3–5 years of experience processing real‑time data.
• Advanced knowledge of processing large amounts of data (billions of records) in minutes.
• Deep understanding of producers (ACK/NACK), consumers, and brokers.
• Deep knowledge of topics, partitions, and segments.
• 3–5 years of advanced knowledge in SQL, Python programming, ETL, and ELT processes.
• Advanced knowledge of data structures, MPP databases, and Blob storage.
• 3–5 years of experience with Azure Data Lake Storage, Teradata, Snowflake, and Azure cloud.
• Previous experience as a data engineer or in a similar role.
• Data engineering certification (Azure Certified Data Engineer) is a plus.
• Adaptability, ability to work in ambiguous situations.
• Effective communication at all levels of the organization.
• Team player who works collaboratively.
• Willingness to learn.

Qualifications

• Bachelor's degree in technology, engineering, or a related field.
• Experience working with Azure and Snowflake technologies.
• Familiarity with agile methodologies.
• Familiarity with software such as Jira or Azure DevOps.

Benefits

• Support, coaching, and feedback from engaging colleagues.
• Opportunities to develop new skills and progress your career.
• Freedom and flexibility to handle your role in a way that's right for you.