[Hiring] AI Quality and Automation Specialist @Patrianna

Role Description

You'll make sure our AI agents and critical workflows actually work by building smart automated testing and evaluation, then using AI to test AI.

• Build and maintain API, integration and end-to-end regression tests that keep our critical workflows rock solid.
• Evaluate AI agents on task completion, response quality, tool use and permissions, and measure how model, prompt and context changes affect results.
• Build quality checks into our CI/CD pipelines and turn every production defect into a regression case, so the same bug never bites twice.
• Put agents to work exploring workflows, generating tests and reproducing bugs, then rigorously check what they find.
• Share the tools and methods that work with the wider AI team and our central QA department, raising the bar for everyone.

Qualifications

• Strong test automation and programming skills in TypeScript or Python.
• Solid hands-on experience with web apps, APIs, Git and CI/CD.
• A structured approach to judging AI output against clear, measurable criteria.
• A knack for reproducing, isolating and pinning down bugs fast, with a sharp eye for root cause.
• A direct communicator who documents decisions and shares what works.
• Bonus: agentic browser testing, LLM evaluation frameworks, Supabase, Vercel or GCP.

Benefits

• You'll be at the cutting edge of AI agent evaluation.
• Real ownership with accountability and trust.
• Focus on progress over perfectionism with achievable deadlines.
• Genuinely open culture with transparent communication.
• No fluff; concise communication is valued.
• Work with great people under a strict no ass-hole policy.

Company Description

Patrianna is a fast-scaling product development company headquartered in Gibraltar, with a dynamic, global team powering our growth. We operate at the intersection of technology and entertainment, building innovative solutions that shape the future of social gaming and deliver outstanding experiences to millions of players worldwide.

We hire based on skills, drive, and ideas — nothing else. Your background, gender, age, race, ethnicity, disability, sexual orientation, religion, neurodiversity, or educational path will never be a barrier to joining us. We also welcome candidates from non-traditional career journeys and value diverse perspectives that challenge conventional thinking.