Untitled role

Senior AI Test Engineer (API & AI Validation) - OmegaHires - Career Page Skip To Job Description

Thanks for visiting our Career Page. Please review our open positions and apply to the positions that match your qualifications.

Senior AI Test Engineer (API & AI Validation)

• Houston, (Multiple states)

Contracted

Entry Level

Share

Senior AI Test Engineer (API & AI Validation)

Job Title

Senior AI Test Engineer (API & AI Validation)

Experience

10–12 Years Employment Type

Subcontractor Job

Summary

We are seeking an experienced Senior AI Test Engineer with 10–12 years of experience in Quality Engineering, including hands-on expertise in API testing and AI application validation. The ideal candidate should have strong experience testing AI/LLM-powered applications, validating REST APIs, designing automation frameworks, and ensuring the quality, reliability, security, and performance of modern AI-enabled systems. This role requires a blend of traditional testing expertise and knowledge of AI-specific validation techniques, including prompt testing, model evaluation, hallucination detection, and retrieval validation.

Key Responsibilities

- Define and implement end-to-end test strategies for AI-enabled applications.- Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.- Perform functional, integration, regression, system, and UAT testing.- Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.- Develop and maintain API automation frameworks.

- Validate AI model responses for

- Accuracy- Relevance- Consistency- Hallucinations- Bias- Toxicity- Test prompt engineering scenarios and optimize prompt quality.- Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.- Verify AI guardrails, content moderation, and responsible AI compliance.- Perform database validation using SQL.- Conduct performance and load testing for APIs and AI services.- Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers.

Share Apply

Apply for this position

Required*

First Name*

Last Name*

Email Address*

Phone*

Resume* We've received your resume. Click here to update it.

Attach resume or Paste resume

Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Desired Rate per hour ($)* -- No answer --$50-$70$70-$80$80-$90$90-$100$100-$120

Current contract end date*

Willing to relocate* Yes

Open to Travel (within United States)* Yes

Work Authorization*

Current Location*

Human Check*

Submit Application