[Remote] Data Analyst (AI Evaluation) | $30–60/hr
Note: The job is a remote job and is open to candidates in USA. Codefeast is seeking a Data Analyst to support an AI training and data quality project. The role involves reviewing datasets and task outputs against detailed rubrics, identifying data issues, documenting decisions, escalating recurring problems, and providing actionable feedback.
Responsibilities
- Review datasets and task outputs for accuracy, completeness, and guideline adherence
- Flag inconsistencies, errors, and deviations from instructions
- Apply structured rubrics consistently across large datasets
- Document rationale in ambiguous scenarios
- Escalate recurring data issues for further analysis
- Provide clear, actionable feedback on issues and resolutions
Skills
- 3–5+ years in data review, data quality, QA, or analytical roles
- Strong ability to follow detailed instructions and apply evaluation rubrics precisely
- Comfortable making justifiable decisions with incomplete guidelines
- Advanced attention to detail across high-volume, repetitive work
- Strong written and verbal communication skills
- Spreheet fluency
- SQL or data querying experience is a plus
- Data annotation or rubric-based evaluation experience is advantageous
Company Overview