Registered Nurse - AI ChatBot Reviewer (US, Remote)

This a Full Remote job, the offer is available from: United States

We are seeking experienced US registered nurses to review and assess AI-generated responses from a health coaching agent, with a focus on safety, regulatory compliance, and clinical content accuracy.

You will work asynchronously on a dedicated review platform, performing short, structured evaluations to help train and refine AI models for patient-facing health guidance.

This is a remote, flexible and short-term project.

Key Responsibilities:

• Structured Grading: Score AI agent responses against a pre-defined rubric, applying the highest-priority criteria consistently across a large volume of items.

• Safety Review: Identify responses that could cause patient harm missed red flags, unsafe advice, failure to escalate or signpost to care.

• Clinical Accuracy: Assess factual correctness, completeness and guideline alignment of clinical content.

• Written Feedback: Provide brief, specific rationale for each failed response and general guidance on how it could be improved.

Qualifications

• Licensure: Active RN license for US

• Experience: Minimum 2 years of clinical nursing practice.

• Knowledge: Strong grounding in clinical guidelines, patient safety and scope-of-practice boundaries.

• Attention to detail: Proven accuracy and consistency in clinical documentation or review work.

• Technical proficiency: Comfortable using structured review tools and digital platforms.

• Language: Native or near-native written English.

Legal Status

• You will have the right to work in your country of residence.

• You will work as an independent contractor.

Why Join Us?

• Flexible Work Arrangements: Part-time, remote and fully asynchronous.

• Competitive Compensation: Hourly rate

• Professional Development: Hands-on experience in AI evaluation and model fine-tuning, shaping how AI is deployed in patient care.