[Hiring] QA AI Testing & Automation Engineer @Resilinc
Apr 01, 2025 - Resilinc is hiring a remote QA AI Testing & Automation Engineer. 💸 Salary: unspecified. 📍Location: India.
Role Description
We are seeking a highly skilled Quality Assurance Engineer with expertise in testing AI models, Large Language Models (LLMs), AI agents, and Generative AI applications. The ideal candidate will have experience in validating AI-driven systems, ensuring model accuracy, performance, fairness, explainability, and robustness. Additionally, the candidate will be responsible for developing automation tests alongside their AI testing responsibilities.
The successful candidate will be self-motivated and proactive, demonstrating a strong sense of ownership and accountability while requiring minimal supervision.
What You Will Do
- Develop and implement QA strategies for AI-powered applications, focusing on accuracy, bias, fairness, robustness, and performance.
- Design and execute automated and manual test cases to validate AI Agents/LLM models, APIs, and data pipelines.
- Assess AI models using quality metrics such as precision/recall, and hallucination detection.
- Test AI models for bias, fairness, explainability (XAI), drift, and adversarial robustness.
- Validate prompt engineering, fine-tuning techniques, and model-generated responses for accuracy and ethical AI considerations.
- Conduct scalability, latency, and performance testing for AI-driven applications.
- Collaborate with data engineers to validate data pipelines, feature engineering processes, and model outputs.
- Design, develop, and maintain automation scripts using Selenium and Playwright for API and web testing.
- Work closely with cross-functional teams to integrate automation best practices into the development lifecycle.
- Identify, document, and track bugs while conducting detailed regression testing to ensure product quality.
Qualifications
- Proven expertise in testing AI models, LLMs, and Generative AI applications.
- Hands-on experience in AI evaluation metrics and testing tools like Arize, MAIHEM, and LangTest.
- Strong proficiency in Python for writing test scripts and automating model validation.
- Deep understanding of AI bias detection, adversarial testing, model explainability (XAI), and AI robustness.
- Strong SQL expertise for validating data integrity and backend processes, particularly in PostgreSQL and MySQL.
- Strong analytical and problem-solving skills with keen attention to detail.
- Excellent communication and documentation abilities to convey complex testing processes and results.
Similar Remote Jobs
More jobs at Resilinc
-
Data Analysis unspecified USAMar 20, 2025
-
Software Development unspecified IndiaFeb 24, 2025
More QA jobs
-
QA unspecified GermanyApr 06, 2025
More jobs in India
-
Product unspecified IndiaApr 06, 2025
-
All others unspecified IndiaApr 06, 2025
Kickstart Your Job Search
Unlock 55,371 additional remote jobs, advanced search & email notifications
Too many emails? Declutter your inbox with Meco
Your home for reading newsletters
| 📍 | Be aware of the location restriction for this remote position: India |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
|
Salary
💸
unspecified
|
Remote
Location
India
|
|
Job Type
full-time
|
Posted
Apr 01, 2025
|
| 📍 | Be aware of the location restriction for this remote position: India |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
