DevOps Engineer - AI Model Evaluator
USD 85 par heureMercor
Zurich ZH
- Travail à distance
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes.
- Compare outputs from multiple frontier models and assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
- Work independently and asynchronously to meet sprint-based project deadlines.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling .
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task .
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Montrer un mail
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
L'offre d'emploi a été publiée Il y a 2 mois
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre DevOps Engineer - AI Model Evaluator à Zurich ZH
- ...AI DevOps-Solution Engineer / AI Engineer (w/m/d) 80% - 100% | IT / Business Engineering | Zürich | Berufserfahrene In unserer IT entwickeln wir mit über 1'000 Kolleginnen und Kollegen die Technologie von morgen – mitten im Herzen von Zürich. Gemeinsam mit...SuggéréDurée déterminée
- ...AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are... ...assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards,...SuggéréTravail à distanceRemote job
USD 43 par heure
...creative and technical talent with leading AI research labs. Headquartered in San... ...week Role Responsibilities Evaluate AI model output lyrics , voice generation, and... ...experience as a music producer, audio engineer, and/or sound mixer. ~ College degree...SuggéréTravail à distanceRemote jobRecrutement immédiatMercor
Zürich ZHIl y a 2 mois- We are seeking a skilled AI Agentic Developer in implementing solutions within... ...solutions and agents. As an AI Engineer, you’ll play a key role in driving innovation... ...capabilities, covering prompt and model configuration, evaluation, guardrails and monitoring....Suggéré
USD 60 - USD 70 par heure
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated responses for... ...domains. Apply and refine evaluation rubrics for RLHF , SFT , and... ...feedback to improve model alignment and safety performance...SuggéréTravail à distanceRemote jobMercor
Zürich ZHIl y a un mois- ...We are looking for a hands-on DevOps Engineer to join our Web Apps team, in our Zürich office. In this role, you will own our cloud infrastructure... ...We are building the leading software platform for AI-powered autonomous systems for enterprise and government customers...Remote jobHoraire flexible
- ...01 Zukünftiger Arbeitgeber Für ein namhaftes Dienstleistungsunternehmen im Raum Zürich suchen wir einen kompetenten DevOps System Engineer (m/w). Bei unserem Kunden bringen Sie Ihr Talent und Ihre Expertise in einem motivierten und flexiblen Arbeitsumfeld ein...Activité indépendanteRemote jobDurée déterminéeHoraire flexible
- ...DeepJudge is Switzerland’s leading AI and ICT scale-up,... ...Founded by former Google search engineers with PhDs in AI from ETH Zurich... ...firm can license the same AI models, but no two firms share the same... ...to building, deploying, evaluating, and improving the solution over...Temps plein
- ...2014 by Dr. Adam Back and a group of fellow cryptographers and engineers who are passionate about Bitcoin and its potential to change... ...enterprise-grade blockchain infrastructure. We are seeking a DevOps Engineer, responsible for building, automating, and operating...Temps plein
USD 50 par heure
...creative and technical talent with leading AI research labs. Headquartered in San... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...syntactic, and semantic features. Identify model errors and language gaps, and collaborate...Travail à distanceRemote jobMercor
Zürich ZHil y a 2 jours- ...computer vision, edge computing and distributed AI to make in-store audiences measurable and... ...AdTech integrations. That mix creates engineering challenges across physical stores and... ...in Zurich. Your role As a Platform/DevOps Engineer, you will build and evolve the infrastructure...Temps plein
- ...Robotics Engineer, Model Deployment Zürich AI & Software In office Full-time mimic is an early stage deep tech robotics & AI start-up based... ...of AI training methods, data pipelines, and model evaluation Ability to build repeatable and scalable solutions...Temps plein
- ...PKI & HSM Engineer (DevOps) (m/w/d) 80% - 100% | IT / Business Engineering | Zürich | Berufserfahrene Möchtest du die Zukunft unserer zentralen PKI- & HSM-Infrastrukturen aktiv mitgestalten? In einer Zeit, in der kontinuierliche Authentifizierung, Integritätssicherung...Temps partielTravail à domicileDurée déterminée
- ...mandate is pushing the company’s AI strategy forward:... ...cases across departments, engineering production-grade AI and automation... ...can be prototyped and evaluated. Maintain prompt and skill... ...documentation, risk classification, model cards, evaluation artifacts. Policy is set at...Temps plein
Crypto Finance Group
Zürich ZHIl y a un mois - ...one of the largest AI centers in Europe... ...As AI for Science Engineer you build the frontier... ..., curate data, evaluate models, or chain domain-... ...Contribute to the evaluation and benchmarking of... ...) and with model optimization and efficient... ..., workflow engines, or reasoning systems...Emploi postdocRecrutement immédiat
- ...work at scale. We set the standard for AI-powered contract work by offering a... ...1. You translate customer reality into engineering requirements — and into revenue. You sit... ...real customer workflows. You build the evaluation frameworks and test sets that prove they...Temps pleinFreelance
- ...DevOps Engineer Java Cyber Security (m/w/d) 100% | IT / Business Engineering | Zürich | Berufserfahrene Wir als eingespieltes... ...Architekturansätzen sind ein Plus Erfahrungen in Software-Entwicklung mit AI sind klar von Vorteil Du übernimmst gerne Verantwortung,...Travail à domicileDurée déterminéeHoraire flexible
- ...DevOps Engineer & Solution Architekt 80% - 100% | IT / Business Engineering | Zürich | Berufserfahrene Willkommen im DevOps Team... ...Wissen anzueignen Erfahrung in der Software-Entwicklung mit AI Gute Kenntnisse in Continuous Integration & Delivery (z....Au printempsDurée déterminée
- ...Required skills ~ Data & AI Occupancy: 100% / Start date: 01.06.2026/ Initial... ...(RAG). You will work in a collaborative DevOps environment, building scalable AI applications... ...GenAI and RAG solutions using modern AI engineering practices. Build scalable APIs, data...Au printemps
- Responsibilities Independently implement features and stories within a Scrum team. Understand and analyze business requirements in collaboration with business departments and IT specialists. Perform technical conception, analysis, and design for banking requirements...Temps pleinAu printempsRecrutement immédiat
- ...Bereit für Swisscom Als DevOps Engineer arbeitest du im agilen Team, entwickelst die SOC Plattform (SIEM/Splunk, SOAR) weiter, und stellst im täglichen Betrieb die Qualität unserer Security Services für unsere Geschäftskunden sicher. Du entwickelst unsere SOC Plattform...
- Ready for Swisscom Working as part of a team, you implement modern workspace technologies for our customers. M365 service developmentDevOps: We take responsibility for the solutions from set-up to operationDesigning the services of tomorrowContinuing education and exchange...
- ...by attackers. The team consists of experienced developers and engineers, who you work closely with to continually develop services to protect... ...security services to counter the associated cyber risks.As a DevOps Engineer in the Security Operation Centre, you are part of...
- Bereit für Swisscom Im Team bist du Umsetzer für die modern Workspace Technologien für unsere Kunden. M365 ServiceentwicklungDevOps: Wir verantworten die Lösungen vom Aufbau bis und mit BetriebServices von Morgen gestaltenWeiterbildung und Austausch über eine breite Basis...
- Bereit für Swisscom Wir entwickeln, testen und betreiben gemeinsam IP Connectivity Services für unsere Businesskundschaft. Wir bauen auf unseren Werten: Vertrauen, Neugierde und Wertschätzung im Team. Dynamisches Team Neueste Technologien Moderne Arbeitsweisen Was du draus...
- ...Zukunft. Für deine innovativen Ideen bieten wir dir viel Gestaltungsfreiraum in einem agilen Arbeitsumfeld. 2/3Die Themen Innerhalb des DevOps Teams sind Operations und Development Aufgaben gleichermassen wichtig. Im Betriebsteil unserer Aufgaben stellen wir sicher, dass...
- ...interpretable, and steerable AI systems. We want AI to... ...committed researchers, engineers, policy experts, and... ...Anthropic's production models undergo sophisticated... ...directly improve production model quality Design,... ...model fine-tuning and evaluation Develop tools to measure...Recrutement immédiatHoraire flexible
- ...den Herstellerfirmen zusammen und beschäftigst dich laufend mit den neuesten Microsoft-Technologien. 3/3Skill Check Als Workplace Engineer bietest du unserer Kundschaft Lösungen zu ihren Herausforderungen. Dank der Zusammenarbeit im Team feiern wir immer wieder Erfolge...
- ...Senior AI Engineer Zurich, Switzerland Product In office... ...technology company building a data engine that powers the future of... ...features end-to-end from design and evaluation through to deployment,... ...regulated domain. Working Model: This role is based on-site...Temps plein
- ...Applied AI Engineer Zürich AI & Software In office Full-time... ...and training through evaluation and deployment. Beyond individual... ...and continuously improve our models. Responsibilities Apply... ...robotic applications Own model training runs, evaluation, and...Temps plein
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à DevOps Engineer - AI Model Evaluator. Soyez parmi les premiers à postuler !
