[Hiring] Product Data Scientist — AI Evaluation & Quality @Finom

Role Description

You'll join the AI Team — the group driving all AI products and technology at Finom. We build and ship AI across the company: AI financial co-pilot, voice agent, and internal AI-powered processes.

Your mission: own that eval loop across every AI product we ship — pre-launch quality gates, post-launch monitoring, continuous improvement.

You'll work directly with our AI Quality lead, Igor Kolodkin, and have close collaboration with AI engineers, Product, and domain experts across the company.

Core stack: Databricks, DeepEval, Claude Code.

What You Will Be Doing

• Own and extend our offline eval suite across products — datasets (capability + regression), judges, metrics.
• Build and maintain online quality dashboards: resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, latency.
• Close the production feedback loop: mine failure patterns from real traffic → turn them into regression cases → propose fixes to Product and domain experts.
• Harden methodology: judge stability, non-determinism handling.
• Translate numbers into decisions – weekly syncs, clear trade-offs, no dashboards for their own sake.

Qualifications

• Python and SQL — you can build an analysis end-to-end.
• Solid foundation in statistics — sampling, hypothesis testing, variance, understanding what a noisy metric is.
• Analytical mindset — you start from the business question, not from the tool.
• 3+ years in analyst / data scientist roles, at least one in a product context.

Requirements

• Experience in quality analytics for ML systems — ranking, recommendations, classification, etc.
• Hands-on experience evaluating LLM applications (RAG, agents, tool use, judges).
• Experience building LLM agents — side projects, toy builds, personal experiments all count.

Benefits

• Make a genuine impact on the product.
• Join our upward trajectory, and grow with us. We provide the resources and opportunities for continuous personal and professional development.
• Work in the EU with flexibility of traveling and working remotely or in a hybrid model across Europe.
• Become a stock options holder through our Stock Options Program.
• Receive unwavering support and care, reflecting our commitment to your well-being and success.
• Immerse yourself in our exclusive Work & Swim Program in Cyprus.

Equal Opportunity Statement

At Finom, we're an equal opportunity employer and value diversity at our company. We embrace diversity and invite applications from all walks of life. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, disability status, or other applicable legally protected characteristics.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.