AI Quality Engineering Leader focused on Agentic AI, LLM Reliability, and Scalable Test Automation.
I design, build, and validate AI QA agents for dev, stage and production environments, combining hands-on engineering with team leadership.
- Layer 1 - Local Developer Agents: Validate developer builds in the early stage, run pre-merge checks, and enforce shift-left quality gates.
- Layer 2 - QA Agents: Generate and maintain tests, execute intelligent regression, and validate workflows across UI, API, and LLM paths.
- Layer 3 - Vendor Agents (On Demand): Use specialized external agents for deep analysis, performance spikes, and targeted quality audits.
- Agentic quality frameworks for LLM, RAG, and MCP-based systems
- Evaluation pipelines for accuracy, hallucination, safety, latency, and cost
- AI-assisted test creation with human-in-the-loop controls
- Multi-agent orchestration for autonomous QA and release validation
- Security testing for AI systems: prompt injection, jailbreaks, and abuse cases
- AI/LLM Testing: prompt robustness, bias checks, factuality, guardrail validation
- Test Automation: Playwright, Cypress, Selenium, API and contract testing
- Programming: JavaScript, TypeScript, Java, Python
- Performance and Security: k6, JMeter, OWASP ZAP, Burp Suite
- Cloud and DevOps: AWS, Azure, Docker, GitHub Actions, CI/CD
- Leadership: engineering management, QA strategy, KPI ownership, stakeholder communication
- Agent Reliability Engineering
- AI Test Architecture and Governance
- Shift-Left and Continuous Quality for AI products
- Legacy-to-modern automation framework migration
- Scalable quality operations for fast-release teams
- AI QA Engineer
- Agent Reliability Engineer
- AI Test Architect
- SDET (AI and Cloud)
- Test Engineering Lead
- Engineering Manager - Quality and AI
padmaraj nidagundi at gmail.com