Big Data Lead
Pyramid Consulting, Inc
Job Title: Big data Lead role
Location: Remote
Job Summary
Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field; equivalent practical experience may be considered.
- 5+ years of experience developing and supporting data integration, ELT, or data engineering solutions.
- Demonstrated experience processing large data volumes in distributed or cloud-based environments.
- Strong proficiency in SQL and at least one programming language, such as Python, Java, Scala, or Spark SQL.
- Experience with orchestration and workflow tools such as Apache Airflow, Azure Data Factory, or AWS Step Functions.
- Working knowledge of relational and non-relational databases, data warehouses, and data lake architectures.
- Experience designing resilient data pipelines with logging, monitoring, retry logic, idempotency, and failure recovery.
- Strong analytical, troubleshooting, communication, and collaboration skills.
Preferred Qualifications
- Experience with cloud data platforms, particularly AWS.
- Experience with AWS services, including Lambda and Kafka.
- Knowledge of data modeling, metadata management, data governance, and master data management practices.
- Experience with containerization and deployment technologies, CI/CD pipelines, and infrastructure as code.
- Experience working in regulated environments, including financial services, healthcare, or other highly controlled industries.
Vacante publicada el 1 día atrás
Empleos similares que podrían interesarleBasado en la vacante Big Data Lead en México
- ...Nabla is seeking an experienced Principal Data Engineer to join our global data engineering team in Mexico City. In this role, you will... ...solutions. Strong programming skills in Python, SQL, and experience with Big Data frameworks are essential. The position offers a flexible...Big dataHorario flexible
Nabla
Ciudad de México2 días atrás - ...enfrentarás retos y trabajarás en la automatización de auditorías con pruebas basadas en datos, identificarás riesgos emergentes mediante Big Data y comunicarás resultados de forma ejecutiva a las Direcciones de Auditoría y áreas auditadas, promoviendo mejoras y capacitación...Big data
Grupo Financiero Banorte
México2 días atrás - ...Esta es tu oportunidad de integrarte a un entorno tecnológico de misión crítica, donde la ciberseguridad, el procesamiento de Big Data y la analítica avanzada son el corazón de la operación diaria. Trabajarás en proyectos de alto rigor técnico que impactan directamente...Big data
Sequoia Connect
Ciudad de México26 días atrás - ...dynamic, forward-thinking workplace where your growth is the priority, this is where you belong. We are currently searching for a Big Data Lead : Responsibilities Develop and support data integration, ELT, and data engineering solutions. Process large data...Big dataRemoto
Sequoia Connect
Ciudad de México17 días atrás - ...dynamic, forward-thinking workplace where your growth is the priority, this is where you belong. We are currently searching for a Big Data Lead / Data Analyst: The Challenge (Responsibilities) Translate business questions into analyses, KPIs, and dashboards. Query...Big dataRemotoTrabajo híbrido
Sequoia Connect
Ciudad de México28 días atrás - ...LICESNSES REQUIRED TO PERFORM THE JOB: • Computer Science concept of Data Structures in practical use cases • Problem solving in a... ...Financial Service Industry • Experience in Cluster Computing and Big Data solutions: Spark, Hadoop, HDSF, XRS using public cloud •...Big dataEmpleo permanente
Apexon
Guadalajara, Jal.2 días atrás - ...Job Title: Data Scientist Employment Type: Full-Time Location: Remote in Mexico Years of Experience: 4-5 years Language: Advance... ...language (Python, C,C++, Java, SQL) Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark...Big dataTiempo completoRemoto
Pyramid Consulting, Inc
México3 días atrás - ...Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine... ...tools like Qlik or Tableau ~ Exposure to cloud platforms and big data systems such as Hadoop HDFS, Hive is a plus ~ Ability to work...Big data
Tiger Analytics
Ciudad de México1 día atrás - ...Inteligencia Artifical / Aprendizaje de Máquina (Machine Learning) / Modelado y Optimización (Python, R, Tensor Flow) Tecnologías "Big Data Analysis" / Cómputo distribuido (Spark, Hadoop, SQL) Desarrollo / Arquitectura de software (GCP, AWS) Experiencia y en qué...Big dataAprendiz
GNP
México2 días atrás - ...HCLTech seeks a data engineering expert to design, build, and optimize large-scale data pipelines on Hadoop and cloud platforms like Databricks and Snowflake. You will work with Python, Spark, Hive, and Airflow to deliver robust data products and scalable ETL/ELT workflows...Big data
HCL Technologies Limited
Ciudad de México2 días atrás - ...Job Details The IT Data Engineer II advances by incorporating data architecture principles... .... Their skill set includes developing in big data technologies and enhancing their... ...ready to grow your career with an industry leader and want to positively impact the team and...Big dataTrabajo por turnos
Tyson Foods
Torreón, Coah.2 días atrás $30,000
...Mexico City. On site. ✨ Why Join Us? FinVolution Group is a leading fintech platform connecting millions of consumers with... ...NYSE (FINV), we leverage cutting-edge Artificial Intelligence and Big Data technologies to provide accessible financial services. Main...Big data信也科技
Ciudad de México5 horas atrás- ...FUNCIONES Tratamiento estadístico de datos (data mining) - Modelización predictiva mediante técnicas de machine learning y data science... ...(SAS, R, Python, Matlab, etc.) y herramientas y plataformas de big data (Hadoop, MongoDB, Cassandra, Pig, Hive, etc.) - Valorable la...Big dataAprendizTemporal
Management Solutions
Ciudad de México1 día atrás - ...Work with cutting-edge big data platforms (e.g., Databricks, Apache Spark) at large scale, pushing the boundaries of data processing and... ...than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI...Big data
HCL Technologies Limited
Ciudad de México2 días atrás - ...Data Analyst Virtualent About Us: We’re a leading IT Staffing company, and we are looking for a passionate Data Analyst who loves turning data into valuable... ...languages like Python or R. Familiarity with Big Data tools (Hadoop, Spark) and Data Warehousing...Big dataRemotoHorario flexible
Virtualent
Santiago Acahualtepec, Iztapalapa, D.F.4 días atrás - ...We are seeking a highly skilled and motivated Data Scientist to join our Data and Analytics team. This position will develop, implement... ...to develop reliable and scalable data solutions. Work with big data technologies and distributed processing frameworks such as...Big data
FlexTal Staffing LLC
Estado de Jalisco2 días atrás - ...instrumentation, complex equipment, connectivity and data management. Leads the Design & Automation team to create... ...in safety, quality and cost. Lead the Engineering team to implement the... ...applied to manufacturing. (IoT, Big Data, AI, automation) Experience in implementation...Big data
Chamberlain Group México
Nogales, Ver.5 horas atrás - ...Role Purpose The Lead Engineer IT Software Development & Maintenance role has the primary... ...of the following disciplines required: Data Warehousing, Business Intelligence, ETL... ...Identity Technologies’ Additional Skills Big Data Technologies (Hadoop, Spark, Kafka,...Big dataTrabajar en la oficinaOffshoreTrabajo híbrido
InterContinental Hotels Group
Estado de Jalisco5 horas atrás - A leading data and AI company is seeking an experienced pre-sales professional in Mexico City or Monterrey. In this role, you will guide enterprises... ...strategies, and mentoring team members. Strong background in big data, cloud technology, and customer relationship management is...Big data
Databricks Inc.
Ciudad de México5 horas atrás - ...bibliotecas de IA, como TensorFlow, PyTorch, Scikit-learn o Keras. Gestión de bases de datos y experiencia con herramientas de big data (ej. Hadoop, Spark). Conocimientos de DevOps, integración continua y despliegue de modelos de IA en producción. Familiaridad...Big data
PSC Industries
León de los Aldama, Gto.3 días atrás - ...Data Engineer Virtualent About Us: We’re a leading IT Staffing company dedicated to connecting top talent with the most innovative companies. If you're... ...management systems (SQL and NoSQL). Familiarity with Big Data tools like Hadoop, Spark, Kafka, etc....Big dataRemotoHorario flexible
Virtualent
Santiago Acahualtepec, Iztapalapa, D.F.4 días atrás - ...large enterprises become more data‑driven. Working with the Enterprise... ...for our important accounts, leading to more widespread use of our products... ...voice for Databricks. You lead your customers on a... ...path of success. Technical in big data, data science and cloud....Big data
Databricks Inc.
Ciudad de México1 día atrás - ...per shipment, air freight usage, customs lead times, and transportation utilization.... ...and/or exports. ~ Advanced English. ~ Data analysis and interpretation skills. ~ Advanced... .... At MKS, it's all about courage, big ideas, and a serious passion for innovation...Big data
MKS Instruments, Inc.
Querétaro, Qro.1 día atrás - ...Overview We are seeking a Java Engineer with Data Engineering experience to join our expert... ...progress and blockers clearly to team leads and project stakeholders Learn from... ...Familiarity with Apache Spark, PySpark or similar big data processing frameworks Experience...Big data
SPAN Digital
Centro (municipio)5 horas atrás - ...to excellence. Key Responsibilities Strong background leading 360° marketing strategies, brand launches, and performance-... ...focused commercial strategies. Experienced in tracking, analyzing BIG DATA, and reporting marketing performance metrics to optimize...Big data
FedEx
Miguel Hidalgo, Ciudad de México3 días atrás - ...Nabla is looking for a Big Data Software Engineer to join our team in Mexico, Ciudad de México. You'll design, build and maintain ETL pipelines, automate report generation, and troubleshoot data issues. With a focus on collaboration, the ideal candidate has 5+ years of...Big dataHorario flexible
Nabla
Ciudad de México1 día atrás - ...Inc. in Mexico is seeking a Senior Technologist to design and build the next-generation risk analytics platform. You will architect data pipelines ingesting billions of PV-like risk calculations from multiple engines and deliver fast, actionable insights to senior stakeholders...Big data
Citigroup Inc.
Morelia, Mich.3 días atrás - ...Databricks Lakehouse platform solves real workloads. You will design reference architectures, demo applications, and guide data engineers through big data pipelines, ML projects, and cloud integrations, travelling up to 50% as needed. Fluent SQL and strong coding in...Big data
Databricks Inc.
Ciudad de México5 horas atrás - ...Zillow Group Inc. is seeking a Senior Software Development Engineer specializing in Big Data to join its team in Mexico City. This role focuses on designing and optimizing data pipelines to enhance analytics and machine learning capabilities across the company. The...Big dataRemoto
Zillow Group Inc.
Ciudad de México5 horas atrás - ...About Arkham Arkham is a Data & AI Platform—a suite of powerful tools designed to help... ...and activation. Key Responsibilities Lead the next phase of our Data Platform –... ...services, including Glue, S3, and EMR. Big Data: Understanding of distributed data systems...Big dataPráctica
Arkham Technologies Inc.
Ciudad de México4 días atrás
¿Desea recibir más vacantes?
Suscríbase y reciba vacantes similares a Big Data Lead. ¡Sea el primero en aplicar!
