Data Operations Engineer (Guadalajara)

Overview

As a Senior Data Operations Engineer hybrid, you will play a critical role in ensuring the reliability, scalability, and performance of our data platforms. This position is vital for our data platform team and overall data strategy, combining the responsibilities of maintaining high availability and operational excellence with optimizing data workflows and infrastructure. You will be crucial in maintaining the reliability of our data pipelines and infrastructure, and your contributions will directly impact the success of our data-driven decision-making processes.

Responsibilities

• On-Call Duties and Production Support: Provide on-call support to address and resolve production incidents related to data platforms and infrastructure. Perform root cause analysis and implement solutions to prevent recurrence of issues.
• Capacity Planning: Conduct capacity planning to anticipate future needs and scale infrastructure accordingly. Use performance data to make informed recommendations on scaling and resource allocation.
• System Reliability and Scalability: Ensure system reliability and scalability by implementing best practices in infrastructure management and performance tuning. Collaborate with engineering teams to design and deploy scalable and resilient data solutions.
• Infrastructure as Code (IaC): Use Terraform for provisioning and managing cloud infrastructure, ensuring that infrastructure changes are consistent, repeatable, and version-controlled.
• Cross-Functional Collaboration: Work closely with cross-functional teams, including data engineers, software developers, and product managers, to align on data platform requirements and deliver solutions that support business objectives.
• Problem Prevention: Engage in problem prevention activities, including capacity planning and creating and automating runbooks for known issues to drive self-healing capabilities.

Qualifications

• Demonstrated experience with Google Cloud Platform (GCP) and Amazon Web Services (AWS) for deploying and managing cloud-based data solutions and infrastructure.
• Proficiency in Python and Java for scripting, automation, and developing custom solutions.
• Strong understanding of API integrations and batch data processing.
• Experience with data orchestration tools such as Airflow and DBT.
• Hands-on experience with monitoring and observability tools like DataDog, Grafana, and Monte Carlo.
• Familiarity with Kubernetes for container orchestration and deployment.
• Experience with Terraform for managing cloud infrastructure as code.
• Experience with various relational and non-relational databases, including their management and optimization.
• Hands-on experience with SQL and dbt for data transformation and modeling.
• Experience with testing and quality assurance processes for data accuracy and system reliability.
• Experience with CI/CD pipelines and relevant tools such as Jenkins.
• Demonstrated ability to work effectively in cross-functional teams and to manage production support and incident response.
• Minimum of 5 years of experience in a similar role, combining SRE and data operations responsibilities. Proven track record of managing data platforms and infrastructure in cloud environments (GCP and AWS).
• Strong background in programming with Python and Java, as well as expertise in API and batch data workflows.
• Proficiency with Terraform for infrastructure management.

Additional Information

All qualified applicants are encouraged to apply. © Brightcove. Equal Opportunity Employer. #J-*****-Ljbffr