Untitled

Properties

title: Agentic QA Engineer
family: qa
maturity: emerging
owns: Owns quality assurance for non-deterministic agentic, LLM, and RAG systems, defining testing strategies, building automated evaluation pipelines and CI/CD quality gates, and validating agent behavior, tool usage, integrations, and safety before release.
skills: [test strategy for non-deterministic LLM and agent systems][automated eval pipeline and CI/CD quality gates][agent behavior, tool-usage, and integration validation][RAG and multi-agent system testing][test automation (Playwright, Python)][KPI and dashboard design for AI quality]
pay: low: 114000
high: 220000
currency: USD
basis: base
seniority: senior-ic
distinctFrom: Overlaps with the AI eval engineer (who builds eval infrastructure) and the AgentOps engineer (who observes agents in production); the agentic QA engineer focuses on pre-release testing strategy and quality gates that decide whether an agent is fit to ship. Distinctness from the eval engineer is the main review question.
source: Fieldguide 'AI Engineer, Quality (Evals)' (SF/Remote US), $170K-$220K
notes: Pay: Fieldguide AI Engineer, Quality (Evals) $170K-$220K (LangSmith, Langfuse); Realign Agentic QA Engineer about $114,617 (Dallas). Many current postings are India-based (EXL, Weekday AI). EXL's QA Engineer (C1) Agentic AI describes the role well: testing strategies for LLMs, multi-agent and RAG systems, automated eval pipelines, and CI/CD quality gates.

title: Agentic QA Engineer
family: qa
maturity: emerging
owns: Owns quality assurance for non-deterministic agentic, LLM, and RAG systems, defining testing strategies, building automated evaluation pipelines and CI/CD quality gates, and validating agent behavior, tool usage, integrations, and safety before release.
skills: [test strategy for non-deterministic LLM and agent systems][automated eval pipeline and CI/CD quality gates][agent behavior, tool-usage, and integration validation][RAG and multi-agent system testing][test automation (Playwright, Python)][KPI and dashboard design for AI quality]
pay: low: 114000
high: 220000
currency: USD
basis: base
seniority: senior-ic
distinctFrom: Overlaps with the AI eval engineer (who builds eval infrastructure) and the AgentOps engineer (who observes agents in production); the agentic QA engineer focuses on pre-release testing strategy and quality gates that decide whether an agent is fit to ship. Distinctness from the eval engineer is the main review question.
source: Fieldguide 'AI Engineer, Quality (Evals)' (SF/Remote US), $170K-$220K
notes: Pay: Fieldguide AI Engineer, Quality (Evals) $170K-$220K (LangSmith, Langfuse); Realign Agentic QA Engineer about $114,617 (Dallas). Many current postings are India-based (EXL, Weekday AI). EXL's QA Engineer (C1) Agentic AI describes the role well: testing strategies for LLMs, multi-agent and RAG systems, automated eval pipelines, and CI/CD quality gates.