Senior LLMOps Engineer
ARABWORK · Amman
Job description
About the role
An experienced LLMOps Engineer is sought to lead the deployment, operation, optimization and monitoring of Large Language Models (LLMs) and Generative AI applications in production. The role covers building scalable LLM applications, RAG pipelines, model evaluation and system optimization for performance, reliability and cost.
Key responsibilities
- Deploy, serve and manage LLMs in production environments
- Design, develop and maintain RAG applications and pipelines
- Build and optimize LLM inference and serving infrastructure
- Implement evaluation frameworks for accuracy, relevance, quality and reliability
- Monitor performance, latency, token usage and operational costs
- Optimize prompt engineering, context management and inference workflows
- Work with vector databases and embedding models for semantic search
- Set up observability, logging, monitoring and troubleshooting
- Optimize GPU utilization, model serving and resource allocation
- Build scalable APIs and integrate LLMs into enterprise applications
- Collaborate with AI engineers, data scientists, software engineers and DevOps teams
- Ensure security, scalability, reliability and governance of GenAI solutions
Required profile
- 5+ years of experience in AI/ML engineering, MLOps, software engineering or related fields
- Hands-on experience deploying and operating LLMs in production
- Strong understanding of Transformer architectures and modern LLM technologies
- Experience building RAG pipelines and LLM-powered applications
Required skills
- Python
- RAG pipelines; LangChain, LlamaIndex or similar
- Vector databases such as Pinecone, Weaviate, Milvus or Chroma
- Embedding models, semantic search and reranking
- Model serving: vLLM, Hugging Face TGI or NVIDIA Triton
- Docker, Kubernetes and CI/CD pipelines
- AWS, Azure or GCP
- API development and production infrastructure
- Good to have: LoRA/QLoRA, quantization, GPU infrastructure, Langfuse/LangSmith/Arize Phoenix, AI agents, responsible AI and guardrails
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Jordan.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 day ago
Expires 1 month from now
15 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
ARABWORK
Amman
Related job offers
-
AIOps Engineer
ARABWORK Amman -
Senior Business Analyst - Corporate Functions (HR, Legal & ESG)
Aramex Amman -
Quality Control Team Leader
Bank of Jordan Amman -
Senior Jira Administrator
Nextwo Co. Gouvernorat d'Amman -
Senior AI Engineer
Halian | Managed Services, Recruitment and Contract Staffing Gouvernorat d'Amman