AI Policy Reviewer – Remote

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely worldwide, you will act as a quality‑assurance gatekeeper, safeguarding model integrity and user safety.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness, and alignment with community guidelines.
• Identify over‑sensitive or under‑sensitive outputs, handle ambiguous edge cases, and make nuanced judgement calls.
• Analyze data to uncover systematic flaws, reporting bias, hallucination, or policy gaps to product and engineering teams.
• Collaborate with policy teams to refine evaluation rubrics and test teachability of policies for AI models.
• Participate in adversarial testing (red‑team) to expose vulnerabilities before product launch.
• Work closely with machine‑learning engineers, explaining rating decisions and helping adjust model behavior.
• Create high‑quality prompt‑response examples (golden sets) for training purposes.

Required profile

• Minimum 3 years experience in Trust & Safety Operations, Content Policy, Risk Analysis, or Legal/Compliance review.
• Deep knowledge of content moderation areas such as hate speech, harassment, misinformation, and graphic violence.
• Strong analytical ability to deconstruct AI outputs, spot logical flaws, hallucinations, and subtle biases.
• Excellent written communication to explain findings to engineers and policy experts.
• Emotional resilience and self‑care strategies for exposure to disturbing content.
• Familiarity with large language models (e.g., ChatGPT, Gemini) and ability to follow complex scoring rubrics consistently.

Required skills

• Experience with LLM platforms (ChatGPT, Gemini, etc.)
• Proficiency using dashboards and spreadsheets for data analysis
• Use of specialized review and annotation tools

What we offer

• Fully remote work with flexible hours
• Opportunity to shape responsible AI practices at scale
• Collaboration with cross‑functional product, policy, and engineering teams