Arabic Data Annotator – Remote, $11/hr

About the role

We are looking for an Arabic‑speaking Data Annotator to help improve large language model (LLM) personalization. This short‑term remote contract involves designing conversational prompts and evaluating AI responses for relevance, grounding, and appropriate use of personal data.

Key responsibilities

• Design multi‑turn conversational prompts based on personal context.
• Evaluate AI responses for relevance, grounding, helpfulness, and correct use of personal data.
• Perform side‑by‑side (SxS) ranking of AI outputs and identify grounding errors or forced personalization.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations.

Required profile

• Fluent in Arabic (reading and writing).
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking and attention to detail.
• Ability to evaluate nuanced and ambiguous AI responses.
• BS/BA degree or equivalent analytical experience.
• Self‑motivated, independent worker with reliable internet and a desktop/laptop.

Required skills

• Arabic language proficiency.

What we offer

• Competitive hourly rate of $11.
• Immediate start and 2‑month engagement.
• Fully remote work with a 4‑hour overlap with PST.