[Hiring] Principal AI Engineer @CoverMyMeds

Role Description

The Principal AI Engineer provides the highest level of individual-contributor technical leadership for the company's AI platform, operating one level above the Lead AI Engineer role. This person sets the multi-year architecture strategy for agentic and LLM-powered systems — spanning model strategy, retrieval-augmented generation (RAG), tool/connector ecosystems, and evaluation/governance tooling — across every team that builds on the AI platform, not just one. In a highly regulated healthcare environment, the Principal AI Engineer resolves the hardest, most ambiguous technical problems facing the platform, is a primary technical voice with executive leadership on AI strategy and risk, and shapes how the entire engineering organization adopts AI safely and effectively.

Success is measured by the durability and adoption of the technical strategy this role sets across multiple teams, this role's ability to unblock cross-organizational technical risk before it becomes a delivery or compliance problem, and its influence on AI investment decisions at the executive level.

Qualifications

• Bachelor's degree or equivalent experience; typically 12+ years of software engineering experience, including 6+ years focused on AI/ML, LLM, or NLP systems in production and 3+ years operating as a senior individual-contributor technical leader. Fewer years required with a relevant Master's or Doctorate.
• One level of demonstrated technical leadership above a Lead AI Engineer.
• Proven track record setting technical strategy that multiple teams adopt.
• Deep, hands-on expertise building production LLM applications at scale.
• Experience with commercial large language model APIs and tool-integration protocols.
• Strong software engineering fundamentals.
• Experience with vector/graph retrieval systems, embeddings, and knowledge-base architectures.
• Deep working knowledge of LLMOps/MLOps.
• Demonstrated ability to influence and align senior engineering and executive stakeholders.
• Deep familiarity with regulated/healthcare data environments and AI governance frameworks.

Requirements

• Advanced degree (M.S. or Ph.D.) in Computer Science, AI/ML, or a related technical field.
• Prior experience as a Principal, Staff, or Distinguished Engineer setting AI/ML technical strategy across multiple teams inside healthcare IT or another highly regulated industry.
• Track record of publications, patents, open-source contributions, or industry speaking on applied AI/LLM systems.
• Experience shaping enterprise-wide AI governance policy in partnership with Legal, Compliance, and Privacy leadership.

Benefits

• Competitive compensation package.
• Base Pay Range: $195,000 - $325,000.
• Additional compensation such as annual bonus or long-term incentive opportunities may be offered.