Senior Data Engineer (Apache Spark) (Monterrey)

What you will do

• Maintain an evergrowing Datalake with a diverse set of data sources and data consumers;
• Help implement data governance initiative;
• Maintenance, deprecation, and eventual migration of legacy ETL jobs into a LakeHouse solution.

Must haves

• Airflow experience;
• Worked with Spark/Glue;
• IaC experience; CDK or Terraform;
• Familiar with Datalake/Datawarehouse/Lakehouse;
• Worked with Iceberg/Delta;
• Experience with AWS tools;
• Experience with data visualization tools;
• Experience with creating software for retrieving, parsing, and processing structured and unstructured data;
• Experience with building scalable ETL and ELT workflows for reporting and analytics;
• Experience with creating solutions in a collaborative, cross-functional team environment;
• Ability to develop scripts and programs for converting various data types into usable formats, support project team to scale, and monitor and operate data platforms;
• Ability to obtain a security clearance;
• Bachelor’s degree.

Nice to have

• Lake Formation experience;
• Worked with big data;
• DynamoDB/DMS experience;
• Experience with Python, SQL, Scala, or Java;
• Experience with UNIX and Linux, including basic commands and Shell scripting;
• Experience with AWS tools, including Quicksight and AWS Glue;
• Experience with distributed data and computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka;
• Experience with NoSQL implementation, including MongoDB or Cassandra;
• Experience with data warehousing using AWS Redshift, MySQL, or Snowflake;
• Experience with Agile engineering practices.

The benefits of joining us

• Professional growth
  Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
• Competitive compensation
  We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities
• A selection of exciting projects
  Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
• Flextime
  Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office - whatever makes you the happiest and most productive.

Job Types

Full-time, Contract

Work Location

In person