SDET / AI Test Automation Engineer | GenAI, LLM & RAG | Healthcare Claims | In-Person Interview

Position Details: Job Title: SDET / Automation Engineer Location: DMV Area (Maryland, Washington, DC, and Virginia) Work Arrangement: Hybrid Interview Process: Two rounds — one virtual and one in-person Key Responsibilities: Design and execute test strategies for AI/ML and Generative AI applications. Validate LLM outputs, prompt behavior, RAG pipelines, and AI-generated responses.

Develop and maintain automated test suites using Selenium, BDD, and other automation tools. Perform manual, exploratory, UI, API, and backend testing. Write complex SQL queries to validate data across multiple databases, including Oracle.

Identify and evaluate model drift, AI hallucinations, bias, accuracy, relevance, and output safety. Test Salesforce applications integrated with AI/ML capabilities and external LLM services. Support quality assurance activities during Snowflake-to-AWS migration.

Collaborate with developers, data scientists, product owners, and business stakeholders.

Required Skills and Qualifications

• Strong SDET / Software QA / Automation Engineering experience.
• Mandatory healthcare claims industry experience.
• Hands-on experience testing AI/ML and Generative AI applications, including LLMs, RAG, and prompt engineering.
• Experience with AI test automation and validation of AI-generated outputs.
• Strong SQL skills and relational database experience; Oracle knowledge is important.
• Experience with Selenium and BDD automation frameworks.
• Experience testing Salesforce applications and AI-enabled features.
• Knowledge of AWS AI/ML services, particularly SageMaker and Bedrock, or equivalent platforms.
• Exposure to Snowflake, Databricks, Jenkins, or CloudBees is beneficial.
• Familiarity with Agile methodologies, Jira, and Confluence.
• Excellent analytical, communication, and problem-solving skills.
• Bachelor's degree required; a technical degree is preferred.

Ideal Candidate Profile

We are specifically seeking an SDET / Automation Engineer with a strong background in healthcare claims, AI/ML testing, GenAI, LLMs, RAG, prompt engineering, SQL, Salesforce, and test automation .