QA Automation Engineer (AI Projects)

We’re looking for an experienced QA Automation Engineer to help ensure the quality and performance of advanced AI systems. You’ll work with Agentic Test Automation Frameworks that autonomously test and validate AI models, driving innovation in how we verify intelligent systems.
Key Responsibilities

Design & Develop Agentic Tests: Build autonomous test agents to explore and validate AI systems (LLMs, predictive or decision-making models).
Define AI Test Strategies: Ensure data integrity, fairness, model reliability, and performance under diverse conditions.
Automation Framework Development: Extend frameworks using Python, pytest, Playwright, or similar tools.
CI/CD Integration: Automate validation pipelines within Jenkins, GitLab, or GitHub Actions.
Debugging & Reporting: Analyze agent findings and collaborate with engineers to resolve complex issues.

Requirements

3+ years in QA, 2+ years in test automation.
Strong Python skills and experience with agent-based or intelligent test systems (e.g., LangChain, custom agents).
Familiarity with CI/CD, Git, and testing methodologies.
Basic understanding of AI/ML concepts (model behavior, data pipelines).

Nice to Have

Experience testing LLMs, Generative AI, or agentic architectures.
Knowledge of cloud platforms (AWS, Azure, GCP), Docker/Kubernetes, or MCP servers.
Background in data science or synthetic data generation for testing.

What We Offer

Competitive pay and growth opportunities.
Flexible, collaborative, and innovative environment.
Sponsored training and certifications.
Hands-on experience with AI and financial data systems.

How to Apply
If this sounds like a good fit, we’d love to hear from you!
Please reach out to hr@alliedtesting.careers for more details.