Back to Remote jobs >
QA
QE Architect
@WorkSpan
[Hiring] QE Architect @WorkSpan
Mar 12, 2025 - WorkSpan is hiring a remote QE Architect. 💸 Salary: unspecified. 📍Location: India.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Role Description
The QE Architect will be an exemplar in AI-driven quality engineering, responsible for reviewing and testing AI first knowledge products and agents. The person will review the underlying AI-based algorithms to ensure their correctness, robustness, and business impact.
- Review and test AI/ML algorithms to validate correctness, efficiency, and real-world performance.
- Collaborate with development teams to review system architectures, designs, and implementation from a quality perspective.
- Define and review test strategies, ensuring test cases align with customer expectations and real-world scenarios.
- Develop and apply mathematical and statistical models to validate AI performance and platform capabilities.
- Validate the correctness and performance of AI solutions leveraging AWS Bedrock, vectorized databases, and Sonnet/LLM algorithms.
- Lead the quality strategy for our Python-based automation framework and ensure the flexibility of our highly customizable platform for customer needs.
- Define and champion best practices for AI-driven quality engineering, ensuring high test coverage and automation.
- Validate AI models and platforms for scalability, performance, and edge-case handling.
- Serve as a mentor to quality engineers and developers, fostering a culture of quality and AI excellence.
- Define and publish key metrics for AI and Large Language Model (LLM) validations, ensuring transparency and continuous improvements in AI quality.
Qualifications
- 8+ years of experience in Quality Engineering, with at least 2+ years in testing products with statistical or OR-based algorithms.
- 1+ years of experience testing products using AI/ML will be a distinct plus.
- Strong knowledge of AI/ML algorithms and ability to validate their accuracy, bias, and performance.
- Experience in testing AI-driven applications, including data validation, model performance validation, and AI explainability.
- Strong analytical and problem-solving skills, with a deep understanding of AI risks and mitigation strategies.
- Ability to collaborate effectively across teams and influence engineering best practices.
Requirements
- Solid experience in reviewing architectures, test strategies, and automation frameworks.
- Knowledge of statistical analysis, probability, and mathematical modeling to validate AI systems.
- Experience with AWS Bedrock, vectorized databases, and Sonnet/LLM algorithms.
- Experience in performance testing of AI models and large-scale distributed systems.
Benefits
- Own your results and significantly impact the business.
- Gain deep GTM insights working closely with sales and marketing leadership.
- Collaborate with passionate, driven individuals daily.
- Be part of an ambitious and supportive team on a mission.
Similar Remote Jobs
More jobs at WorkSpan
-
Software Development competitive salary and performance-based incentives IndiaMar 05, 2025 -
Software Development competitive salary, equity, and performance bonus IndiaFeb 01, 2025
More QA jobs
More jobs in India
Kickstart Your Job Search
Need advice to apply?
Join our free
Webinar « 3
Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) »
Register for free
Unlock 55,192 additional remote jobs, advanced search & email notifications
Get Access Now
Too many emails? Declutter your inbox with Meco
Your home for reading newsletters
Try for free - no card required.
️
| 📍 | Be aware of the location restriction for this remote position: India |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
Back to Remote jobs >
QA
QA
|
Salary
💸
unspecified
|
Remote
Location
India
|
|
Job Type
full-time
|
Posted
Mar 12, 2025
|
️
| 📍 | Be aware of the location restriction for this remote position: India |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
