Senior QA Engineer – AI Systems (AI Hub)

About the role

As a Senior QA Engineer in the AI Hub, you will ensure that AI products—including large language models, retrieval‑augmented generation, OCR, agents and traditional machine‑learning pipelines—meet the highest standards of reliability, safety and enterprise readiness before reaching clients.

Key responsibilities

• Partner with AI engineers, full‑stack, data and DevOps teams, product owners and security to define quality criteria and risk thresholds.
• Design and execute AI QA strategies for proofs‑of‑concept, MVPs and production releases.
• Build and maintain evaluation assets such as golden answers, synthetic edge‑case libraries and regression suites.
• Conduct LLM/GenAI testing (response quality, grounding, bias, safety, privacy), RAG testing (ingestion, indexing, relevance, citations), agent testing (tool calls, multi‑step tasks, error handling) and OCR/document‑intelligence testing (extraction accuracy, confidence scores).
• Perform traditional ML testing (data quality, performance thresholds, drift, calibration) and adversarial testing (prompt injection, jailbreaks, data poisoning).
• Integrate automated evaluations into CI/CD pipelines, create dashboards and feedback loops, and use logs to debug failures.
• Validate behavior across personas, languages, domains and client‑specific constraints, and ensure production readiness with observability and HITL mechanisms.

Required profile

• Senior‑level professional with proven experience in AI‑focused quality assurance.
• Strong analytical mindset and ability to translate business needs into measurable quality metrics.
• Excellent collaboration skills to work across engineering, product and security teams.

Required skills

• LLM/GenAI testing
• RAG (retrieval‑augmented generation) testing
• Agent testing
• OCR/document‑intelligence testing
• Traditional machine‑learning testing
• Adversarial/negative testing
• CI/CD integration and automated regression suites
• Evaluation metric design and implementation

What we offer

• Continuous professional development through world‑class learning and tailored coaching.
• Opportunity to work on cutting‑edge AI solutions for global clients.
• Collaborative environment that values innovation and leadership.