Arabic LLM AI Quality Analyst – Remote, $11/hr
Crossing Hurdles · Jordanie
Job description
About the role
This short‑term contract position focuses on evaluating and improving personalized AI responses in Arabic. You will work remotely, collaborating with a team to design prompts, assess model outputs, and ensure data hygiene.
Key responsibilities
- Design multi‑turn conversational prompts that incorporate personal context.
- Evaluate AI responses for relevance, grounding, helpfulness, and correct use of personal data.
- Perform side‑by‑side (SxS) ranking of AI outputs and identify grounding errors or forced personalization.
- Write clear, structured rationales referencing specific conversation turns.
- Extract and verify model debug information and data source usage.
- Maintain strict data hygiene by deleting evaluation conversations.
Required profile
- Fluent in Arabic (reading and writing).
- Strong experience in data annotation, AI quality evaluation, content moderation, or related fields.
- Analytical mindset with attention to detail and ability to evaluate nuanced AI responses.
- BS/BA degree or equivalent experience in an analytical discipline.
- Excellent written communication and structured feedback skills.
- Self‑motivated, able to work independently with full‑time availability and a required 4‑hour overlap with PST.
- Reliable desktop/laptop and stable internet connection.
Required skills
- Arabic language proficiency.
What we offer
- Competitive hourly rate of $11.
- Remote work with flexible schedule.
- Opportunity to contribute to cutting‑edge LLM personalization research.
Questions fréquentes
Why are you reporting this job?
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Published 13 hours ago
Expires 1 month from now
5 views · 0 applications
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Crossing Hurdles
Jordanie