Big Data Pipeline Engineer - Spark, Kafka, Python/Java
Link-Worldwide
Link-Worldwide is looking for a Data Pipeline Developer in Valle de Chalco Solidaridad, Mexico. You'll design and improve large-scale data pipelines that process petabytes of data, ensuring fast and reliable datasets for data teams.
Idóneo candidates will have a Bachelor's in Computer Science, with over 3 years of experience in data-intensive applications. Proficiency with tools like Spark, Kafka, and SQL, along with strong programming skills in Python or Java, is required.
#J-18808-LjbffrVacante publicada el 4 días atrás
Empleos similares que podrían interesarleBasado en la vacante Big Data Pipeline Engineer - Spark, Kafka, Python/Java en Valle de Chalco Solidaridad, Méx.
- ...Data Engineer II, DASH Device Operations... ...time and batch pipelines, and enable AI-... ...able to think big while paying careful... ...sources using SQL, Python, and... ...SQL, Python, and Spark across batch and... ...language (Python/Java/Bash/Perl) experience... ...experience in Kafka. ~ Experience...Big dataPythonJavaKafkaSparkTrabajo híbrido
Amazon
Ciudad de México1 día atrás - ...Data Engineer Virtualent About Us: We’re a leading IT... ...robust and scalable data pipelines. Work with data... ...programming languages such as Python, Java, R, and/or C++.... ...NoSQL). Familiarity with Big Data tools like Hadoop, Spark, Kafka, etc. Knowledge of cloud...Big dataPythonJavaKafkaSparkRemotoHorario flexible
Virtualent
Santiago Acahualtepec, Iztapalapa, D.F.1 día atrás - ...Staff Software Engineer to strengthen our... ...estate MLS data platform squad.... ...build robust data pipelines and backend... ...event‑driven , Kafka‑based data flows... ...backend services (Python or Java) that expose... ...processing with Spark or Flink on... ...EMR or similar big‑data compute)...Big dataPythonJavaKafkaSparkRemotoTrabajo por turnos
Luxury Presence
Ciudad de México4 días atrás - ...desarrollo y optimización de pipelines de datos distribuidos y arquitecturas de Big Data dentro del Data Lake... ...utilizando Apache Spark (Core, SQL, DataFrames) empleando Scala, Python (PySpark) o Java. Procesamiento en... ...eventos utilizando Apache Kafka para la ingesta y...Big dataPythonJavaKafkaSparkInicio inmediato
Bluetab, an IBM Company
Ciudad de México26 días atrás - ...searching for a Data Engineer Sr.: Responsibilities... ...scalable data pipelines and infrastructure... ...skills in Python, PL/SQL, Java, or Scala. Experience with big data technologies (e.g., Hadoop, Spark, Databricks) and cloud... ...with streaming data (Kafka, Kinesis). Background...Big dataPythonJavaKafkaSparkRemoto
Sequoia Connect
Ciudad de México2 días atrás - ...Sr. Solutions Engineer at Databricks within... ...scalable data architectures using... ...consulting on big data... ...data engineering pipelines, and data science... ...source projects (Spark, Delta Lake, MLflow... ...Spark, Hadoop, Kafka) ● Data Warehousing... ...languages: Python, Scala, Java, or R. ● [...Big dataPythonJavaKafkaSpark
Databricks
Ciudad de México9 días atrás - ...for the Senior MLOps Engineer role at TRM Labs. TRM... ...leveraging blockchain data, threat intelligence,... ...latency, high-throughput pipelines to enable real-time AI... ...code. We mostly work in Python. However, languages... ...streaming workflows (e.G., Spark, Kafka, Flink); Deployment...PythonKafkaSparkTrabajo por turnos
Link-Worldwide
Valle de Chalco Solidaridad, Méx.10 horas atrás - ...calidad de datos , capaz de diseñar y optimizar pipelines de datos, automatizar procesos y construir... ...visualizaciones Lenguajes de Programación: Python, SQL. Big Data Technologies: Apache Spark, Hadoop, Hive, Kafka, PySpark. Herramientas ETL: Automic & Aorta...Big dataPythonKafkaSparkAprendiz
Inetum
Azcapotzalco, Ciudad de México3 días atrás - ...located in Mexico City is seeking a Sr. Data Engineer to take charge of high‑throughput streaming pipelines and enhance data operations using AI.... ...distributed data processing with tools like Spark and Kafka, and proficiency in Python. The role emphasizes collaboration in a...PythonKafkaSpark
Luxury Presence
Ciudad de México4 días atrás - ...Estamos en busca de un data engineer que: sea proactivo... ...comprensión básica de pipelines de integración y despliegue... ...sql y procesos en spark, garantizando... ...ingeniería de datos ~ python (procesamiento de datos... ...ecosistema azure). ~ java #J-18808-Ljbffr...PythonJavaSparkAprendizPrácticaTiempo completoContrato
Link-Worldwide
Valle de Chalco Solidaridad, Méx.4 días atrás - ...Arkham Arkham is a Data & AI Platform—a... ...for a Senior Data Engineer to own our high-performance... ...such as Apache Spark, Trino, and Delta... ...Data Ingestion Pipelines – Design and implement... ...Strong experience with Python for scripting and... ..., S3, and EMR. Big Data: Understanding...Big dataPythonSparkPráctica
Arkham Technologies Inc.
Ciudad de México1 día atrás - ...looking for a Sr Data Software Engineer to join our NIQ Activate... ...cutting-edge Big Data, real-time analytics... ...real-time data pipelines and lakehouse... ...~ Proficiency in Python; working proficiency... ...Data processing (Spark, DataBricks) and event streaming (Kafka). ~ Experience...Big dataPythonKafkaSparkPrácticaTiempo completoRemotoHorario flexible
NielsenIQ
Ciudad de México1 día atrás - ...currently hiring a: Data Engineer - Databricks... ...scalable data pipelines using Databricks and... ...platforms. Optimize Spark workloads and... ...Data Warehousing, or Big Data environments.... ...skills in Python and SQL. ~ Hands... ...technologies such as Kafka or Event Hubs....Big dataPythonKafkaSpark
Zurich
Ciudad de México2 días atrás - ...the role We’re looking for a Data Engineer to help design, build, and... ...solutions using analytics, big data, and automation. Understand... ...APIs, and data integration pipelines. Prepare and transform... ...Write and test code in SQL, Python, Java, C++, or similar languages...Big dataPythonJava
Walmart de México y Centroamérica
Ciudad de México2 días atrás - ...for real estate. As a Sr. Data Engineer, you'll be a technical... ...high‑throughput streaming pipelines. Design, implement, and operate... ...using Airflow, Spark Streaming, Kafka, and Iceberg—ensuring reliability... ...Kafka). ~ Proficiency in Python (Pydantic preferred) and familiarity...PythonKafkaSparkRemoto
Luxury Presence
Ciudad de México4 días atrás - ...Nexu estamos buscando un DATA ENGINEER que se obsesione con... ...el impacto de cada pipeline en el negocio y que no... ...datos. Programar en Python con buenas prácticas: OOP... ...certificaciones o estudios en Big Data, Cloud o Data... ...trabajado con streaming (Kafka, Kinesis, Pub/Sub)....Big dataPythonKafkaPrácticaTrabajo híbrido
Nexu
Cuauhtémoc, Ciudad de México2 días atrás - ...Studio and AI Engines, the company... ...massive volumes of data to developing... ...& Feature Pipelines Process... ...) using SQL, Python, and distributed... ...(e.g., Spark, Ray). Architect... ...(e.g., C++, Java, Scala, Go,... ...experience with big data... ...Apache Spark, Kafka, Flink) and complex...Big dataPythonJavaKafkaSparkTemporalTiempo completoRemotoTrabajo híbrido
Fusemachines
Ciudad de MéxicoHace un mes $45,000 - $50,000
...Conocimiento en middleware JBoss Desarrollo en Java y Spring Boot Experiencia con NiFi y Kafka Uso de ElasticSearch Servicios REST y pruebas con... ...tecnologías cloud (Anthos/Kubernetes) Desarrollo en Python Conocimientos en WebSphere, protocolo FIX Diseño...PythonJavaKafkaPrácticaTrabajo híbridoLink-Worldwide
Valle de Chalco Solidaridad, Méx.4 días atrás- ...Linux / Unix IntelliJ, NetBeans Java EE, JavaScript Python, Scala Perfil ideal del... ...Desarrollo de procesos ETL sobre plataformas Big Data (Cloudera, Oracle, IBM) - Conocimiento... ...de procesos de flujos masivos, Kafka, Hadoop, SQL y Scala/python. Oferta...Big dataPythonKafka
Grupo Salinas
Ciudad de México1 día atrás - ...analytical skills, and familiarity with analytic approaches and tools. Knowledge of programming languages such as R, Python, Spark or Java. Experience on data management tools like SQL, SAS, Teradata, Hadoop, Hive. Excellent written and oral communication skills with...PythonJavaSparkTiempo completoTrabajar en la oficina
Link-Worldwide
Valle de Chalco Solidaridad, Méx.4 días atrás - ...looking for a Senior Data Engineer to help design, build... ...scalable, reliable data pipelines and datasets that... ...Strong proficiency in Python for building data pipelines... .... Familiarity with big data or distributed... ...frameworks such as Spark (or equivalent). Experience...Big dataPythonSparkTrabajar en la oficina
Nelo
Ciudad de México1 día atrás $35,000 - $40,000
...Requisitos Indispensables Programación en Java 17 o superior. Experiencia con Spring... ...basadas en eventos/streaming (Kafka consumer/producer) y uso de Avro. Administración... ...Inglés B2. Deseable Programación en Python. Conocimiento en Nifi o alguna otra herramienta...PythonJavaKafkaTrabajo híbridoLink-Worldwide
Valle de Chalco Solidaridad, Méx.4 días atrás- ...planeta. Tu Reto: Desarrollar e implementar pipelines de datos robustos y escalables para... ...Modelado de datos, AWS Services, GIT, Programación, Big Data tools, API protocols Conocimiento avanzado de Python, SQL, Spark. Alguien que hable "negocio": Que sepa...Big dataPythonSparkPrácticaTemporal
Konfio MX
Ciudad de México4 días atrás - ...focused on designing, developing, and optimizing large data processing pipelines utilizing Apache Spark and Java. Applicants should have 5-8 years of relevant... ...equivalent. The role involves working closely with data engineers, influencing project management, and ensuring...JavaSpark
Link-Worldwide
Valle de Chalco Solidaridad, Méx.4 días atrás - ...Responsibilities Design, develop, and optimize big data processing pipelines using Apache Spark and Java. Work on batch and real-time data processing frameworks... ..., and Datasets. Collaborate with data engineers, architects, and analysts to ensure seamless data...Big dataJavaSparkTiempo completo
Link-Worldwide
Valle de Chalco Solidaridad, Méx.4 días atrás - ...Your Role The GCP Data Engineer is a hands-on delivery role... ...working with GCP, GCP Big Query ~ Experience working... ...with big data stack (Spark, PySpark, Hadoop, HIVE,... ...in building scalable ETL pipelines ~ Excellent programming skills (Python) including production...Big dataPythonSparkTiempo completo
Capgemini
Ciudad de MéxicoHace 2 meses $28,000 - $30,000
...servicio: Infraestructura, Redes, Seguridad, Soluciones Cloud y Big Data, además de soluciones administradas, te invitamos a integrarte... ...refinamiento de modelos. ~2 años de expérience en desarrollo con Python (manejo de Pandas, Numpy, Matplotlib o Seaborn) y consumo de...Big dataPythonAprendizOcasionalTrabajar en la oficinaRemotoTrabajo híbridoLunes a viernesLink-Worldwide
Valle de Chalco Solidaridad, Méx.4 días atrás- ...Socotra, Inc. is seeking a Data Engineer to join their Safety and Customer... ...role involves managing data pipelines that support both human and... ...is proficient in tools like Spark and Hadoop. Strong scripting skills in languages such as Python are required, along with the...PythonSpark
Socotra, Inc.
Ciudad de México1 día atrás - ...highly experienced and skilled Java Full Stack Developer to... ...communication skills, solid engineering practices, and frequent client... ...Skills • Experience with Kafka or other event streaming platforms... ...• Familiarity with CI/CD pipelines (Jenkins, GitLab CI, Azure DevOps...JavaKafkaContrato
Pyramid Consulting, Inc
Ciudad de México10 horas atrás - ...The Platform, Engineer V builds large-scale systems and creates... ...This includes building the data transport, collection, and orchestration... ...languages such as SQL, Python, Scala, Java, and C++ for various data... ...data technologies like Spark and Hadoop to handle large data...PythonJavaSparkTiempo completo
Link-Worldwide
Valle de Chalco Solidaridad, Méx.4 días atrás
¿Desea recibir más vacantes?
Suscríbase y reciba vacantes similares a Big Data Pipeline Engineer - Spark, Kafka, Python/Java. ¡Sea el primero en aplicar!
Búsquedas relacionadas
- data engineer Valle de Chalco Solidaridad, Méx.
- desarrollador python Valle de Chalco Solidaridad, Méx.
- programador python Valle de Chalco Solidaridad, Méx.
- backend developer java Valle de Chalco Solidaridad, Méx.
- java developer Valle de Chalco Solidaridad, Méx.
- big data Valle de Chalco Solidaridad, Méx.
- practicante-practicante-python Valle de Chalco Solidaridad, Méx.
- python Valle de Chalco Solidaridad, Méx.
- data engineer
- programador python sin experiencia