Data Engineer II

Responsibilities

Deploying and supporting the end-to-end management of our data, including ETL/ELT, data warehouse/data lake, data staging, data governance, and managing the different layers of data required to ensure a successful BI and reporting for the Procurement Execution Center (PEC).

Build and design ETL/ELT processes with Azure Data Factory (ADF) and/or Python, schedule and execute them daily and weekly.

Assemble large, complex data sets that meet functional and non-functional business requirements.

Build infrastructure for optimal ETL/ELT of data from various sources using Azure SQL and ADF.

Develop data models for DataViz, reporting and advanced analytics, optimizing performance.

Maintain conceptual, logical, and physical data models with metadata.

Manage the DevOps pipeline deployment model, including automated testing.

Deploy data stewardship and governance across the data warehouse, cleansing and enhancing data.

Perform data ingestion, cleansing, transformation, and coding of business rules to support procurement bidding activities.

Support deployment of a global data standard for logistics.

Create data tools for analytics and data scientists to optimize our products.

Support Rate Repository management (including Rate Card uploads to our data warehouse).

Perform other procurement duties as assigned.

Qualifications

• Bachelor’s degree in Engineering, Computer Science, Data Science or similar.
• 3+ years of experience in BI Engineering, data modeling, data engineering, software engineering, or other relevant roles.
• Strong SQL knowledge and experience working with relational databases.
• Experience with DW/DL concepts, data marts, data modeling, ETL/ELT, data quality/stewardship, distributed systems, and metadata management.
• Experience building and optimizing data pipelines, architectures, and data sets.
• Azure Data Engineering certification preferred (DP‑203).
• ETL/ELT development experience (3+ years). SSIS or ADF preferred.
• Ability to resolve ETL/ELT problems by proposing and implementing tactical / strategic solutions.
• Strong project management and organizational skills.
• Experience with object‑oriented scripting languages such as Python, Scala, C#, etc.
• Experience with NoSQL databases is a plus.
• Excellent problem‑solving, critical thinking, and communication skills.
• Experience with Azure DevOps (CI/CD, git/repo management) is a plus.
• English language proficiency (global role).