RITA RITA
25 Edmond Court, Dennetts Road, London SE14 5LG
Phone: 07540466171
Email: [Link]@[Link]
United Kingdom (Remote)
PROFESSIONAL SUMMARY
A results-driven AI Training Specialist with a 4-year track record of
supporting Large Language Model (LLM) development. Expert in
applying complex rubrics to score, rank, and refine AI outputs.
With a foundation in scientific analysis, this professional follows a
systematic workflow: analyzing user intent, applying strict
evaluation guidelines, verifying evidence, and documenting
detailed rationales to ensure data integrity in high-volume
environments.
Also an analytical thinker.
TARGET ROLES
AI Training & LLM Evaluation Specialist (Remote , Contract-based)
Seeking to support AI research teams by:
● Executing rubric-based scoring and preference ranking.
● Optimizing prompts and identifying model failure modes.
● Classifying error taxonomies and validating search
relevance.
● Performing dataset calibrations and structured QA
documentation.
KEY COMPETENCIES
LLM Training & Evaluation
● Model Assessment: Expert in evaluating models for
accuracy, reasoning depth, tone, and instruction-following.
● Response Optimization: Skilled in pairwise comparisons,
rewriting responses for neutrality, and validating constraint
adherence.
● Risk Mitigation: Proficient in hallucination detection, red-
teaming, and safety/policy compliance reviews.
● Hallucination detection and reasoning-gap identification
● Constraint adherence validation
● Safety and policy compliance review
● Red-teaming support and adversarial prompt analysis
Search Relevance & Intent Analysis
● Intent Classification: Categorizing queries (informational,
navigational, transactional) and validating local UK-based
search results.
● Quality Grading: Evaluating the ranking logic for media
(music, video, books)
● Data Integrity: Identifying outdated or duplicate entries
using evidence-backed scoring.
● Evidence-backed scoring rationale documentation
Data Annotation & Dataset Quality
● Managing structured labeling, JSON/YAML schema
verification, and SQL-supported dataset validation.
● Handling edge-case documentation, metadata completeness
checks, and batch consistency audits.
● Maintaining detailed decision logs and drafting structured
rationales for every evaluation.
QA & Documentation
● Recurring failure pattern analysis
● Audit-ready reporting
● Inter-reviewer consistency tracking
● Structured checklist implementation
TOOLS & WORKING STYLE
I utilize a data-driven approach to ensure high-quality outputs
across various platforms
.
● Proficient in web-based AI evaluation tools and collaborative
suites (Google Workspace, Microsoft Office) using advanced
features like Track Changes and Suggesting mode for peer
review.
● SQL for complex tasks including data filtering, anomaly
detection, and identifying duplicate entries.
● Conducts deep-dive research using credible public data and
manages high-volume tasks via batch-based tracking
systems.
Workflow Approach: Analysis of Intent → Framework
Application → Evidence Verification → Error Classification →
Rationale Documentation → Final Quality Pass.
PROFESSIONAL EXPERIENCE
AI Trainer & LLM Output Evaluator Remote—contract
| 2022 – Present
● Focused on the refinement of Large Language Models
through structured feedback loops.
● Critiqued AI responses based on factual correctness, logical
flow, and completeness.
● Supported Reinforcement Learning from Human Feedback
(RLHF) through pairwise rankings.
● Identified and corrected "hallucinations" or reasoning gaps
while rewriting content for better clarity without losing the
original meaning.
Data Annotation Specialist (Text & Multimodal) Remote—
Freelance | 2021 – Present
● Handled the foundational labeling required for machine
learning.
● Applied precise tags and quality flags to datasets under
rigorous specifications.
● Maintained high accuracy and consistency across massive
data volumes and complex edge cases.
Audio Transcription & Transcript QA Specialist Remote—
Project based | 2020 – Present
● Ensured the integrity of linguistic data.
● Reviewed transcripts for grammatical precision, speaker
identification, and formatting.
● Enhanced readability while preserving the speaker's original
intent and flagging low-confidence audio segments for
further review.
EDUCATION
Bachelor of Science (BSc) in Computer Science & Mathematics
Obafemi Awolowo University 2014 – 2019
● Core Focus: Machine Learning, Algorithms & Data
Structures, Statistical Methods, and Data Modeling.
PROFESSIONAL DEVELOPMENT
Continual upskilling in the evolving AI landscape, with
certifications and training in:
● Responsible AI & Ethics: Evaluation practices for safe and
unbiased model development.
● Prompt Engineering, SQL for Data QA, and Query Intent
Analysis.
● Data Annotation Quality Control and AI Risk Mitigation.
WORK PREFERENCES & AVAILABILITY
Remote-ready and Available for contract or long-term project-
based roles.
Equipped With A Dedicated Workspace And High-speed Internet
For Seamless Collaboration.
Adept At Handling Both High-intensity, One-Hour Focused
Evaluation Tasks And Sustained,Complex Research Engagements.