[Hiring] Principal Consultant -Data Quality Azure LLM Developer, Azure Open AI @BrightClaim

Role Description

We are seeking a skilled Data Quality Azure LLM Dev Ops Engineer who will be responsible for designing, deploying, and supporting Data Quality (DQ) platforms and LLM-based solutions on Azure. The role focuses on building AI-powered data validation, trust scoring, quality rules automation, DQ APIs, and CI/CD pipelines for DQ applications.

The engineer will support AMS operations, perform enhancements, automate DQ workflows, build new LLM microservices, and ensure stable production operations.

• Build and maintain Azure services such as Azure App Service/Azure Functions, AKS for LLM Microservices, Azure API management, Azure Open AI (GPT-4/5 embeddings, RAG pipelines)
• Design and develop LLM Driven DQ Engines, Data quality rule generation using LLM, automated DQ scoring, Data Anomaly detection with AI/ML, Data Quality recommendations and remediations using prompt engineering
• Integrate Azure Open AI with Data Lake, Synapse, Collibra, or Power BI
• Design & Build RAG (Retrieval-Augmented Generation) for metadata, business rules, and glossary-driven quality checks
• Implement enhancements to LLM based DQ frameworks as business evolves
• Develop new LLM-based DQ modules and microservices & LLM powered metadata search
• Collaborate closely with Business/Functional & technical stakeholders & translate transformational requirements into LLM driven DQ solutions
• Execute Model Tuning as applicable
• Participate in Agile ceremonies and LLM/AI/ML design sessions
• Provide SME guidance on best practices for Azure LLM and automated prescriptive solutions
• Maintain configuration repositories, versioning, and CI/CD pipelines
• Provide L2/L3 production support & Enhancements for LLM related incidents & adhere to SLA and metrics
• Manage service requests, Access requests, monitoring of Service Logs, Pipeline workload performance, and SLAs
• Maintain version control & promote builds across Dev, QA, Prod environments
• Create and maintain Technical Design Documents, Runbooks, Dashboard, User guides

Qualifications

• Bachelors - Business Analytics
• Bachelors - Computer Science
• Bachelors - Statistics
• Masters - Data Science
• Certifications:
  • Certified Data Management Professional - Riversand
  • Databricks Certified Associate Developer for Apache Spark 3.0 - Databricks Academy
  • Databricks Certified Associate Developer for Apache Spark - Databricks Academy
  • Microsoft Certified: Azure Data Engineer Associate - Microsoft
  • Oracle Database 12c Certified Implementation Specialist - Oracle

Requirements

• Agile Methodology
• Banking Capital Markets
• Client Relations
• Cloud Computing
• Collaboration Tools
• Commercial Sales
• Consumer Packaged Goods (CPG)
• Databricks Platform
• Data Engineering
• Data Literacy
• Design Thinking
• Electronic Hardware
• Executive Presence
• Inclusion
• Manufacturing Equipment
• People Leadership
• Personal Effectiveness
• Risk Management
• Semiconductors
• Snowflake (Platform)
• Sourcing and Procurement
• Storytelling

Benefits

• Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter
• Make an impact – Help global enterprises solve business challenges that matter
• Accelerate your career – Gain hands-on experience, mentorship, and world-class learning opportunities to stay ahead
• Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day
• Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress