AI Test Engineer
Momento Cybertech Solutions · Hyderabad, Pune
- Company
- Momento Cybertech Solutions
- Type
- Job
- Work mode
- On-site
- Location
- Hyderabad, Pune
- Posted
- 20 Nov 2026
About this job
Role & responsibilities
- Hiring: AI Testing Engineer | GenAI | RAG | Agents | Python
- Experience: 4+ Years Interview Mode: Face-to-Face (F2F) Interviews Interview Slots: Limited slots available Location: [Chennai / Pune / Hyderabad]
- Notice Period: Immediate Joiners / November Joiners
- We are looking for experienced AI Testing / GenAI Assurance Engineers with hands-on experience in evaluating LLM, RAG-based applications and AI Agents.
Key Skills Required
- Strong Python programming skills.
- Hands-on experience with Ragas and/or DeepEval.
- Experience in LLM Evaluation and LLM-as-a-Judge.
- RAG application testing and evaluation.
- AI Agent / Agentic AI evaluation.
- Golden Dataset and Synthetic Dataset creation.
- AI Observability and tracing using OpenTelemetry (OTEL).
- Exposure to LangSmith, Langfuse, Arize, Galileo or Evidently.
- Responsible AI validation and AI quality assurance.
- CI/CD integration of AI evaluation frameworks.
Mandatory Screening Criteria
- 4+ years of relevant AI Assurance Testing experience.
- Python proficiency above 6/10.
- Hands-on implementation of Ragas or DeepEval.
- Experience using LLM Judges.
- Minimum 6 months of RAG evaluation experience with at least one project.
Listed from the company's public job post; the company is responsible for it. Always apply on the official page and never pay to apply. How listings work