[Hiring] Generative AI Engineer @Magpie Health Analytics

Role Description

Magpie Health Analytics is seeking an experienced AI Engineer to design, build, and operate secure, trustworthy generative AI solutions that help our healthcare clients deliver faster, more consistent access to authoritative program guidance.

• Design, develop, test, deploy, and maintain an AI-enabled decision-support capability for government health payers.
• Support internal customers initially, with plans to extend to external, public-facing users.
• Collaborate with project managers, data engineers, full stack developers, analysts, and client stakeholders.
• Design, develop, and maintain generative AI solutions that ground large language model (LLM) responses in authoritative source documentation.
• Build and maintain document ingestion pipelines, including:
  • Parsing
  • Chunking
  • Metadata tagging
  • Embedding generation
  • Vector/semantic search indexing
• Collaborate with cross-functional teams and subject matter experts to understand user needs.
• Implement responses with source citations and direct links to underlying documentation.
• Design and implement guardrails, including:
  • Content filtering
  • Scope restrictions
  • PII/PHI protections
  • Refusal handling for out-of-scope questions
• Develop evaluation frameworks and test sets to measure:
  • Retrieval quality
  • Answer accuracy
  • Groundedness
  • Consistency
• Deploy and operate solutions within approved AWS services and federal security controls.
• Implement logging, monitoring, and audit trails for transparency and responsible AI oversight.
• Write clean, reusable, and well-documented code, and participate in code reviews, testing, and deployment processes.
• Stay up to date with emerging AI technologies, models, and federal AI guidance.

Qualifications

• A master's degree in computer science, data science, engineering, or another relevant field.
• 5+ years of experience developing software and cloud-based solutions.
• Strong proficiency in Python and experience with modern LLM APIs, SDKs, orchestration frameworks, and AI/ML libraries.
• Hands-on experience designing and deploying generative AI solutions.
• Experience with AWS AI and data services.
• Experience with prompt and context engineering and LLM evaluation.
• Experience with Agile software development methodologies.
• Experience with building and maintaining CI/CD pipelines.
• Excellent problem-solving and communication skills.
• Ability to work independently and in a team, with strong attention to detail.

Requirements

• Experience supporting federal health programs.
• Experience deploying AI solutions in federal environments.
• Familiarity with responsible AI and federal AI governance frameworks.
• Understanding of security and compliance regulations in healthcare.
• Experience building conversational or search interfaces.
• Relevant AWS certification.