[Hiring] Senior Databricks Engineer / Architect @Entrada AI

Role Description

As a Databricks Genie Architect , you will be the driving force behind building next-generation conversational data interfaces. Your primary focus will be designing, implementing, and scaling intelligent, natural-language data assistants using Genie .

You will bridge the gap between complex enterprise data warehouses and business users, enabling them to query databases using natural language. This role is a hybrid of cutting-edge Generative AI engineering and robust Data Engineering within the Databricks Lakehouse ecosystem.

Key Responsibilities

• Databricks Genie & Conversational AI Development (Core Focus)
  • Genie Space Architecture: Design, configure, and maintain high-performing Databricks Genie Spaces tailored to complex business domains.
  • Semantic Layer & Curation: Curate the semantic metadata, SQL queries, and golden instructions that guide Genie to ensure highly accurate, deterministic SQL generation.
  • Testing & Fine-Tuning: Proactively test, benchmark, and fine-tune Genie responses to handle complex business logic, edge cases, and multi-turn conversations.
  • Integration & Feedback: Connect Databricks Genie endpoints to custom web interfaces/external UIs and implement feedback loops to continuously improve accuracy.
• GenAI & Data Engineering Support
  • Data Pipelines & Spark: Build and optimize data pipelines using Python, SQL, and PySpark to ensure data in Delta Lake is perfectly structured and optimized for Genie's consumption.
  • GenAI Orchestration: Utilize LLMs on Databricks for metadata enrichment, automated data labeling, and semantic optimization.
• Collaboration & Implementation
  • Business Translation: Act as a translator between business users (understanding what questions they ask) and the data platform (structuring schemas so Genie can answer them easily).

Qualifications

• MUST HAVE
  • Databricks Mastery: 5+ years hands-on experience with the Databricks ecosystem, with specific focus on Databricks Genie (or equivalent Text-to-SQL/semantic-layer work), Unity Catalog, and Databricks SQL/Workflows.
  • Excellent SQL & Data Modeling: Expert-level SQL skills (writing complex, performant queries) and experience structuring data (star schemas, gold tables, views) to be "Genie-ready."
  • Production Python: Strong experience in writing clean, production-grade Python code.
  • GenAI / LLM Concepts: Strong understanding of Text-to-SQL paradigms, prompt engineering, semantic routing, and RAG architectures.
  • Big Data: Proficiency in Apache Spark (PySpark) for data transformation and orchestration.
  • API Integration: Experience working with REST APIs to integrate GenAI endpoints into external applications.
• NICE TO HAVE
  • MLflow & Model Serving: Manage model lifecycles and deploy endpoints utilizing the broader Databricks AI suite (MLflow, Databricks Model Serving).

Soft Skills

• Analytical & Precise: Strong attention to detail, especially when auditing Genie's generated SQL for business accuracy.
• Bridge Builder: Ability to communicate effectively with business stakeholders to understand their language and translate it into semantic data models.
• Continuous Learner: Enthusiasm for keeping up with the rapid pace of Databricks and GenAI product updates.

Benefits

• Cooperation Models:
  • Poland: Available via Employment Contract (UoP) or B2B.
  • Romania/ Greece: Available via B2B only.
• 100% Remote: Full flexibility to work from anywhere in Poland/ Romania / Greece.
• Schedule & Travel: This is a remote position, but it requires daily overlap with US Time for team syncs and collaborative work. Additionally, you should be prepared to travel to the US for client meetings.
• High-End Tech: Apple MacBook Air M4 15" provided to all engineers.
• Referral Bonus: Bonus for bringing other top-tier engineers to the team.
• Professional Growth:
  • Certification Support: Coverage for all Databricks technical certifications.
  • Industry Leadership: Support in reaching the highest tiers of Databricks expertise (such as the Champion program) tailored to your specific career track.
  • Personal Branding: Opportunities to present at global industry conferences and contribute to technical thought leadership.
  • Expert Mentorship: Direct collaboration with Databricks MVPs and core product teams, giving you a front-row seat to the platform's evolution.

Recruitment Process

• Introductory Call (20 min): Short conversation with our Recruiter to discuss your background and expectations.
• Technical Interview (60 min): Deep dive into your technical skills with our engineering team.
• Optional Client Interview: Required only in specific cases.
• Decision & Offer: We aim to close the process and provide feedback efficiently.