Odixcity Consulting is a Nigerian HR consulting and procurement firm that provides business solutions to companies, entrepreneurs, and SMEs. We offer a wide range of services including recruitment, performance management, training and development, compensation and benefits, payroll and benefits administration, and procurement of goods and services.
Job description:
We are seeking an experienced Technical QA Reviewer to oversee annotation quality standards, ensure decision consistency, and maintain evaluation integrity across AI data operations. This role serves as the final quality control layer before datasets and model evaluations are approved for production use.
Key Responsibilities:
- Review annotator and QA decisions for accuracy, consistency, and policy adherence
- Conduct meta-QA reviews to evaluate the quality of prior annotations
- Handle dispute resolution cases and ambiguous edge scenarios
- Set and enforce quality thresholds and performance benchmarks
- Perform structured quality audits through sampling and trend analysis
- Identify systemic annotation errors and recommend process improvements
- Train and mentor junior QA reviewers to ensure judgment consistency
- Contribute to annotation guideline refinement and process design
Required Skills & Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, or equivalent professional experience.
- 4+ years of deep experience in annotation workflows and QA review processes
- Strong consistency in judgment and decision-making
- Solid understanding of quality control frameworks and sampling methodologies
- Experience in dispute resolution and edge-case evaluation
- Process design and optimisation knowledge
- Excellent documentation and communication skills
Method of Application
Meet the Qualifications? Email your CVs and cover letters to [email protected] using the Job Title as the subject.