Talent.com
Mercor
AI Safety Specialist - Evaluation ExpertMercor • Bucharest, Bucharest, Romania
AI Safety Specialist - Evaluation Expert

AI Safety Specialist - Evaluation Expert

Mercor • Bucharest, Bucharest, Romania
În urmă cu o zi
Tip loc de muncă
  • Quick Apply
Descrierea postului

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
  • Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
  • Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
  • Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
  • Provide structured feedback to improve model alignment and safety performance.
  • Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

Must-Have

  • Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
  • 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
  • Excellent written English, critical thinking, and analytical reasoning skills.
  • Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

  • Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
  • Familiarity with safety policies, content moderation, or evaluation rubric development.
  • Experience reviewing complex, high-risk, or ambiguous content.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Creați o alertă de locuri de muncă pentru această căutare

AI Safety Specialist - Evaluation Expert • Bucharest, Bucharest, Romania

Locuri de muncă similare

EV Charging Infrastructure: Project & Deployment Specialist

BYD EuropeBucurești, București, Romania

We are looking for talent that connects with this mission and want to create positive impact by joining a diverse and dynamic team.BYD is a leading, high-tech multinational, based in Shenzhen, Chin... Afișați mai multe

Performance Marketing Specialist (Paid Search & Social)

THE/STUDIOBucharest, Bucharest, Romania

At THE/STUDIO, our vision is to empower individuals, regardless of their expertise, to unleash their creativity and bring their unique ideas to life through the production of custom products.We are... Afișați mai multe

Design Verification Engineer

Sales ConsultingBucurești, București, Romania

As Design Verification Engineer, you will join leading-edge team responsible for the verification of advanced interconnect systems in state-of-the-art microprocessors.This role focuses on ensuring ... Afișați mai multe

Data Scientist

Shape Your Future with UsBucharest, Romania
Quick Apply

Apply advanced statistical and machine learning techniques to solve complex business challenges and identify opportunities for growth and optimisation.Design, develop, validate, and deploy predicti... Afișați mai multe

 • Ofertă nouă!

Data Quality Engineer (Python & Databricks)

AIDA RecruitmentBuharest, Romania
Quick Apply

Data Quality Engineer (Python & Databricks).In this role, you will be responsible for designing and maintaining automated data validation frameworks that ensure data consistency, accuracy, and ... Afișați mai multe

Recruitment Operations Specialist (AI & NATO Projects)

WLGBucharest, Bucharest, Romania

This is not a traditional recruitment role.You will not spend your days sourcing candidates on LinkedIn, negotiating offers, or running full recruitment processes.Instead, your focus will be buildi... Afișați mai multe

Data Quality Risk Supervisor

Sales ConsultingBucurești, București, Romania

Data Quality Risk Supervisor – Independent Assessment.First Line of Defense (1LOD) frameworks and practices related to data quality risk.You will apply established methodologies to challenge how 1L... Afișați mai multe

Compliance Expert

Huawei EuropeBucurești, București, Romania

Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices.With integrated solutions across four key domains – telecom networks, IT, sma... Afișați mai multe

IT Systems Administrator & Internal Software Engineer

Klass Wagen GroupOtopeni, Județul Ilfov, Romania

This is not a help-desk seat and it is not a junior cloud role.You will personally own the entire IT and internal software function for a company operating across four countries: the infrastructure... Afișați mai multe

Quantitative Developer / AI & Automation Specialist – Power Trading

Sales ConsultingBucurești, București, Romania

Develop AI models for forecasting consumption and production, including renewables;.Build predictive models for prices in DAM, IDM, and BRM markets;.Forecast imbalances and associated costs using a... Afișați mai multe

Cyber Risk Analyst – AI

Urban ConnectBucharest, Romania
Quick Apply

The Cyber Risk Analyst is also a subject matter expert leveraging a deep understanding of the enterprise risk discipline and regulatory compliance combining deep knowledge of theory and organizatio... Afișați mai multe

DevOps Engineer - AI Model Evaluator

MercorBucharest, Bucharest, Romania
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Afișați mai multe

AI Lead - Developer Productivity

EveryMatrixBucurești, București, Romania

EveryMatrix is a leading B2B SaaS provider delivering iGaming software, content and services.We provide casino, sports betting, platform and payments, and affiliate management to 300 customers worl... Afișați mai multe

UX Analyst position for EU Public Institutions - MAIA

The White TeamBucharest, Bucharest, Romania

Specific expertise requirements:.Microsoft Visio, Axure, Balsamiq, Adobe Photoshop, Adobe Illustrator, Adobe InDesign).Minimum Post-secondary Education and Experience in ICT:.At least 4 years of st... Afișați mai multe