Senior External AI Advisor (Project Basis)

About the role

We are seeking a Senior External AI Advisor to conduct an independent technical review of our Arabic language-learning platform’s retrieval-augmented generation (RAG) system. The engagement is project-based, with Phase One focused on assessment and evidence-based recommendations; a possible Phase Two implementation may follow.

Key responsibilities

• Analyse confidence and refusal logic to propose reliable criteria and refusal rules.
• Review and improve evaluation methodology, metrics, and acceptance thresholds.
• Assess retrieval stability across varied phrasings and suggest robust solutions.
• Compare the current model against measured results and recommend alternatives across ten interface languages.
• Examine inference and serving configuration, including sampling parameters.
• Evaluate architecture, single‑GPU concurrency limits, and the suitability of dual serving paths.

Required profile

• Hands‑on production experience serving open‑weight LLMs with frameworks such as vLLM, TGI or SGLang.
• Deep expertise in Arabic NLP, especially Modern Standard Arabic; dialect experience is a plus.
• Production RAG experience, including retrieval diagnostics and reranking.
• Proven ability to select models based on measured evaluations and to design test sets with clear acceptance thresholds.
• Experience in GPU capacity planning and quantization trade‑offs for single‑GPU deployments.
• Strong analytical and communication skills.

Required skills

• vLLM
• TGI
• SGLang
• Arabic NLP
• Production RAG
• Retrieval and reranking
• Model evaluation and test‑set design
• GPU capacity planning
• Quantization
• LoRA / QLoRA fine‑tuning