Senior Data Engineer ID65436

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

We are looking for a Senior Data Engineer to design and maintain scalable data pipelines and platforms supporting Accounting, Finance, Payments, and Tax functions within a large-scale financial systems platform. You will build ETL/ELT workflows using Python, dbt, and Airflow, working across Snowflake, Redshift, Kafka, and Spark to ensure data availability and reliability for critical business operations. The role operates in a cross‑functional Agile environment with direct stakeholder engagement across Engineering, Product, and Analytics teams.

WHAT YOU WILL DO

• Design, develop, and maintain scalable and reliable ETL/ELT pipelines;
• Build and optimize data workflows using tools such as dbt and Airflow;
• Develop and maintain data solutions leveraging technologies such as Snowflake, Redshift, Kafka, Spark, and Hive;
• Work with both SQL and NoSQL databases to support data ingestion, transformation, and analytics needs;
• Monitor, troubleshoot, and improve data pipeline performance, scalability, and reliability;
• Collaborate closely with cross‑functional teams including Engineering, Product, Analytics, and Business stakeholders;
• Participate in Agile ceremonies and contribute to sprint planning and delivery commitments;
• Manage multiple priorities effectively while ensuring timely and high‑quality deliverables;
• Contribute to data architecture discussions and help drive engineering best practices.

MUST HAVES

• 5+ years of professional experience in Data Engineering or Data Warehousing roles;
• Strong programming skills in Python;
• 5+ years of experience building data pipelines using ETL/ELT tools, with dbt preferred;
• 3+ years of hands‑on experience with big data technologies such as Snowflake, Redshift, Kafka, Spark, or Hive;
• Extensive experience working with both SQL and NoSQL databases;
• Strong expertise with workflow orchestration and pipeline management tools such as Airflow;
• Strong understanding of scalable data architecture and engineering best practices;
• Excellent communication and stakeholder management skills;
• Proven ability to manage competing priorities and deliver within agreed sprint commitments;
• Comfortable working in highly collaborative, cross‑functional Agile teams;
• Self‑starter mindset with strong analytical, problem‑solving, and critical‑thinking abilities;
• Master’s degree in Computer Science, Mathematics, Statistics, or a related technical field preferred, or Bachelor’s degree with relevant experience;

NICE TO HAVES

• Experience working in cloud‑based data environments;
• Familiarity with modern data warehousing and distributed systems concepts;
• Exposure to data governance, observability, or data quality frameworks.

PERKS AND BENEFITS

• Professional growth : Mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation : USD‑based pay with education, fitness, and team activity budgets.
• Exciting projects : Modern solutions with Fortune 500 and top product companies.
• Flextime : Flexible schedule with remote and office options.