Supervisor III, Applications Development

About this job

The Opportunity

Oversees day-to-day operational objectives through the supervision of a team of application development engineers, ensuring efficient software build, release, deployment, and configuration management. Sets objectives that directly impact operational plans, contributing to the implementation of new applications, deployment frameworks, automation processes, and software quality standards. Evaluates and refines work methods, recommending enhancements to improve software implementation effectiveness, deployment efficiency, and system stability. Works on technical challenges that require data analysis, troubleshooting, and strategic consideration of infrastructure dependencies. Communicates regularly with internal teams, including QA, IT, and cloud operations, to align release strategies with organizational priorities. Engages external partners, vendors, and stakeholders to ensure smooth coordination in deployment efforts and software updates.

About the Role

We are converting this position from contract to full-time. Sanjay built the automation layer that now vets every release. We need someone who owns the quality strategy, manages a small team of test engineers, and keeps our AI-driven test infrastructure running as product demands grow.

You will report to the Senior QA Manager, Development team. You will work with product, platform, and DevOps teams. You decide what "good enough to ship" means for our applications; you build the systems that prove it.

What You'll Own

Automation architecture. Design and maintain test frameworks on the Appvance AI Quality Platform. You decide how tests get structured, how data flows through them, and where they plug into our release pipeline.

• Team management. Directly manage 2–4 test automation engineers. Set their weekly priorities. Review their pull requests. Run 1:1s. Write their annual performance reviews. You decide who takes which feature area. You decide whether their work meets our standards before it merges.
• AI application testing. Build test suites that validate LLM-based features. Test prompt regression. Verify RAG workflows. Detect hallucinations. Validate agent behavior. Use LangChain and LangSmith.
• Scripting and tooling. Write and review Appvance Designer Scripts. Write JavaScript/TypeScript code. Build API test suites for REST and GraphQL. You set the coding standards others follow.
• CI/CD integration. Wire tests into GitHub Actions, Jenkins, and AWS deployments. When a build fails, your tests tell us why within minutes.
• Cross-platform coverage. Ensure web, mobile, desktop, and API layers each have appropriate automated coverage. Cover functional, regression, smoke, integration, end-to-end, security, performance, and database scenarios.
• Quality metrics. Track failure rates, flakiness, coverage gaps, and release-blocking defects. Present these to leadership in plain language.
• Hiring and growth. Interview candidates for automation roles. Write growth plans for your reports. Push them toward harder problems. Do not let them stay comfortable.
• Incident support. Join production release calls. Respond to critical incidents when automation uncovers—or misses—something that hits customers.

What You've Done Before

• 2–3 years hands-on with the Appvance AI Quality Platform, including Appvance Designer Scripting.
• You write clean JavaScript ES6+ and TypeScript. You read production-grade code and you write it.
• You tested AI-powered applications with LangChain and LangSmith. You validated prompts. You checked response accuracy. You verified RAG pipelines.
• You built or maintained test frameworks for UI, API, database, and cross-browser scenarios.
• You integrated test suites into Git, GitHub, Jenkins, GitHub Actions, AWS, and CI/CD workflows.
• You worked with SQL (MySQL, PostgreSQL, SQL Server) and NoSQL (MongoDB) data stores.
• You know REST APIs, GraphQL, JSON/XML, OAuth 2.0, JWT.
• You worked…