DevOps Engineer - AI Model Evaluator
$85 por horaMercor
- Trabajo remoto
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Mostrar correo electrónico
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$85 por hora
...technical talent with leading AI research labs. Headquartered... ...Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)... ...coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving...SugeridoTrabajo remotoTrabajo de veranoContrato- ...albo is seeking a DevOps Engineer to join our Platform Engineering team. You will enhance our Internal Developer Platform (Keymaker) and boost Developer Experience by integrating AI into CI/CD and enabling self-service capabilities for engineers. You will work with...Sugerido
- ...DevOps / Cloud Engineer – Systematic Commodities Hedge Fund Moreton Capital Partners (MCP) is a CFTC regulated systematic, technology... ...emerging data-rich asset classes. We combine quantitative modelling, agentic AI, and deep domain expertise to build strategies with...Sugerido
$50 por hora
...Pay: $50–$100/hr Role Title: DevOps Engineer Role Type: Contractor... ...expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform... ...# Previous AI training data or model evaluation work How to apply Apply...SugeridoTrabajo remotoContratista- ...About the role We are seeking a highly skilled and motivated DevOps Engineer to join our Platform Engineering team. Your primary customer... ...workflows (e.g., via Bitbucket PRs) to remove bottlenecks. AI Integration: Champion and leverage AI-assisted tools to optimize...Sugerido
- ...Partners. The role is based in Punto Polanco Mexico City on site work model. Be part of a proactive, passionate and creative team where... .... Strong knowledge of ingredients, formulations, sensory evaluation, and food regulations. Proven ability to influence customers...
- ...offering a collaborative environment that promotes professional development. Requirements ~5+ years professional experience in DevOps, SRE, or DevSecOps roles ~ Strong hands-on experience with AWS services (ECS/Fargate, RDS/Aurora, ALB, VPC, IAM, CloudWatch, KMS,...ContratoRemotoHorario flexible
- ...Bluelight Consulting is seeking a senior DevOps/SRE/DevSecOps engineer to join its rapidly growing team. You will design, build, and operate scalable cloud-native applications, streamline CI/CD pipelines, and ensure security-first practices across deployments. Ideal...Remoto
- ...Bluelight Consulting is seeking a seasoned DevOps professional to join our rapidly growing team. You will design and operate scalable infrastructure, implement CI/CD, and ensure security and reliability across projects. The ideal candidate has 5+ years in DevOps/SRE...Remoto
- ...Bluelight Consulting is expanding its software engineering team in Mexico. We seek a senior DevOps/SRE/DevSecOps professional to design, build, and operate high-quality, secure systems for diverse clients. You will work in a fast-paced, collaborative environment that values...RemotoHorario flexible
- ...AgileEngine LLC. is seeking a DevOps Engineer to manage migrations between environments and maintain reliability in production and staging systems. You will handle incident response, on‑call support, and improve observability, automation, and Kubernetes‑based infrastructure...PrácticaFin de semana
- ...Qualcomm Intl Inc., Mexico Branch Office is seeking an experienced DevOps Engineer – Security Assurance to build and operate secure, scalable CI/CD platforms with integrated AppSec practices. This role focuses on embedding SAST and SCA into enterprise pipelines to detect...Trabajar en la oficina
- ...y despliegue ¿Qué ofrecemos? Esquema 100% nómina Beneficios superiores a los de ley Requisitos: Experiencia como DevOps Engineer con Microsoft Azure, administrando infraestructura y servicios en cloud. (Key Vault, Azure AD/Entra ID, Monitor/Insights, AKS,...Tiempo completoRemoto
- ...Commit is seeking an experienced DevOps Engineer to modernize infrastructure, tighten production support, and drive a CI/CD transformation. You will build a mature DevOps function from the inside and collaborate daily with Oscar on the move to GitHub Actions. You will...
- ...Herramientas adicionales (plus): Groovy, Kusto, Node.js Perfil buscado Requisitos: ~+1 año de experiencia en desarrollo de software o DevOps. ~ Experiencia desarrollando o manteniendo aplicaciones en entornos cloud (Azure preferentemente, o AWS). ~ Experiencia...PrácticaEmpleo permanenteContrato
- ...Bluelight is seeking a seasoned DevOps/SRE/DevSecOps engineer to join our fast-paced consultancy teams. You will design and manage scalable cloud infrastructure on AWS, implement IaC with Terraform or CloudFormation, and maintain robust CI/CD pipelines. The ideal candidate...
- ...Bain & Company in Mexico is seeking a Staff Engineer for Coro's DevOps and Assurance team to design cloud infrastructure & automation at scale. You will drive Terraform, Azure services, AKS, and CI/CD practices, partnering with architects and engineers across the firm...
- ...AlertMedia is looking for a Manager, Software Engineering, to lead our Intelligence Center... ...example in adopting and operationalizing AI tools—both within the product and across... ...intelligence‑focused products, including the AI/ML models, pipelines, and platform capabilities...Empleo permanenteDesde casaRemoto
- Applaudo is seeking a results-driven Project Manager to bring structure, clarity, and momentum to complex software and digital initiatives. You will lead projects from planning through delivery, aligning teams and stakeholders around priorities, timelines, and measurable...
- ...Job Summary We are looking for a Principal DevOps Engineer who will have a holistic approach about systems when driving the definition, building, deployment, and operations of Solera applications in close collaboration with Dev, QA and Ops peers. We are seeking an individual...ContratistaSubcontratista
- Citi Value in Real Time busca un profesional para automatizar procesos de desarrollo, pruebas y despliegue, gestionar contenedores y administrar infraestructura en la nube. El puesto es remoto y con esquema 100% nómina en México. Se requiere experiencia en orquestación...Remoto
- ...systems such as POS, Clienteling, Loyalty and store payment systems In‑depth knowledge of the analysis, design, implementation and evaluation of IT systems Technical Expertise A good understanding of XML, JAVA, Rest API, Soap, API, JSON, React Good working...Tiempo completoEmpleo permanenteRemoto
- Arcadion is looking for a proactive DevOps Engineer in Mexico, Chiapas, to manage and automate infrastructure, improve deployment processes, and ensure system reliability. The ideal candidate will have 4-6 years of experience, strong skills in CI/CD pipelines, cloud platforms...
- ...Moreton Capital Partners in Mexico City is seeking a hands-on DevOps Engineer to join a small, fast-moving engineering team. You will own cloud infrastructure, automation, deployment, monitoring, and production reliability across AWS and data-tools. Our stack includes...
- ...Moreton Capital Partners is seeking a hands-on DevOps Engineer to join a small, fast-moving engineering team. You will own cloud infrastructure, automation, deployment, monitoring, and production reliability across AWS, Terraform, Docker, and Python tooling. The role...
- ...for? We are seeking a highly skilled and experienced Senior DevOps/Cloud Engineer/SRE with 7+ years of experience to become an integral part of... ...role, you will be instrumental in supporting cutting-edge AI SaaS and PaaS solutions. Please note: This position may require...PrácticaTemporal
- ...rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best... ...to meet you! ABOUT THE ROLE We are looking for a DevOps Engineer to manage application migrations between environments and maintain...PrácticaTiempo completoTrabajar en la oficinaDesde casaFin de semana
- ...repositorios Git y soporte a Docker y Kubernetes. El rol exige experiencia en infraestructura como código, virtualization (Sangfor/ VMware) y networking, con visión DevOps y capacidad para trabajar en equipo en una fintech en crecimiento en CDMX. #J-18808-Ljbffr...
- ...Sobre Kavak Como el primer unicornio mexicano, con presencia en varios países y un modelo de negocio AI‑first, en Kavak estamos redefiniendo el mercado de autos usados y la experiencia de millones de usuarios en LatAm. Hemos sido una de las compañías mejor valoradas...Tiempo completo
- ...IQVIA is seeking a DevOps Engineer to design, architect, and implement automated build and release pipelines across on-premise and cloud platforms. You will develop automated systems for deployment, monitoring, and fault tolerance, enabling efficient delivery from development...
¿Desea recibir más vacantes?
Suscríbase y reciba vacantes similares a DevOps Engineer - AI Model Evaluator. ¡Sea el primero en aplicar!

