Job

AI Test Engineer

Momento Cybertech Solutions · Hyderabad, Pune

Company
Momento Cybertech Solutions
Type
Job
Work mode
On-site
Location
Hyderabad, Pune
Posted
20 Nov 2026

About this job

Role & responsibilities

  • Hiring: AI Testing Engineer | GenAI | RAG | Agents | Python
  • Experience: 4+ Years Interview Mode: Face-to-Face (F2F) Interviews Interview Slots: Limited slots available Location: [Chennai / Pune / Hyderabad]
  • Notice Period: Immediate Joiners / November Joiners
  • We are looking for experienced AI Testing / GenAI Assurance Engineers with hands-on experience in evaluating LLM, RAG-based applications and AI Agents.

Key Skills Required

  • Strong Python programming skills.
  • Hands-on experience with Ragas and/or DeepEval.
  • Experience in LLM Evaluation and LLM-as-a-Judge.
  • RAG application testing and evaluation.
  • AI Agent / Agentic AI evaluation.
  • Golden Dataset and Synthetic Dataset creation.
  • AI Observability and tracing using OpenTelemetry (OTEL).
  • Exposure to LangSmith, Langfuse, Arize, Galileo or Evidently.
  • Responsible AI validation and AI quality assurance.
  • CI/CD integration of AI evaluation frameworks.

Mandatory Screening Criteria

  • 4+ years of relevant AI Assurance Testing experience.
  • Python proficiency above 6/10.
  • Hands-on implementation of Ragas or DeepEval.
  • Experience using LLM Judges.
  • Minimum 6 months of RAG evaluation experience with at least one project.

Listed from the company's public job post; the company is responsible for it. Always apply on the official page and never pay to apply. How listings work

Similar fresher jobs

See all AI & Machine Learning fresher jobs →