[Hiring] AI Engineer @Accuity

Role Description

The AI Engineer develops and operates the AI systems that support automation across Accuity’s clinical documentation and revenue cycle workflows. Reporting to the Vice President, Data Science and AI, this role builds production services using large language models, intelligent agents, retrieval systems, knowledge graphs, and traditional machine learning.

The AI Engineer owns the technical systems that allow applications to use AI reliably and securely. This includes:

• Model integration and adaptation
• Agent orchestration
• Retrieval-augmented generation
• Vector and graph-based knowledge systems
• Model Context Protocol services
• Evaluation pipelines
• Deployment automation
• Observability
• Production support

The role works across proprietary and open-source models and selects the appropriate approach for each problem. Depending on the use case, this may involve:

• Prompt and context engineering
• Retrieval
• Fine-tuning
• Tool integration
• Classical machine learning
• A combination of these methods

Success in this role is measured by the reliability, security, maintainability, and measurable workflow impact of the AI systems delivered across the Accuity ecosystem.

Responsibilities

• AI and Agent Engineering:
  • Build and maintain production systems using large language models, machine learning models, and intelligent agents.
  • Develop agent workflows that use tools, retrieval, structured outputs, state, and human approval controls.
  • Select and adapt models through prompting, retrieval, fine-tuning, or other appropriate techniques.
  • Integrate AI systems with internal applications, data sources, APIs, and approved external services.
  • Build reusable AI services with clear, stable interfaces for application teams.
• Retrieval and Knowledge Systems:
  • Develop retrieval-augmented generation systems using approved enterprise content and data.
  • Build and maintain document ingestion, embedding, indexing, search, reranking, and citation pipelines.
  • Implement vector databases, hybrid search, knowledge graphs, and graph-based retrieval where appropriate.
  • Maintain data provenance, access controls, and processes for keeping indexed information current.
  • Measure retrieval quality and correct missing, outdated, duplicated, or irrelevant results.
• Model Context Protocol and Tool Integration:
  • Build and maintain Model Context Protocol servers, clients, tools, and resources.
  • Define secure tool interfaces with clear schemas, permissions, validation, and failure handling.
  • Connect agents to approved applications, databases, APIs, and business systems.
  • Apply authentication, authorization, audit logging, and least-privilege access to agent tools.
  • Develop reusable integrations that can support multiple AI applications.
• AI and Machine Learning Operations:
  • Deploy and operate LLMs, agents, retrieval services, and machine learning models in production.
  • Maintain automated pipelines for testing, versioning, deployment, promotion, retraining, and rollback.
  • Track versions and lineage across models, prompts, tools, datasets, indexes, and configurations.
  • Implement monitoring for quality, reliability, latency, usage, and cost.
  • Investigate production failures and implement lasting corrective actions.
• Evaluation, Quality and Security:
  • Build automated evaluation and regression testing for models, prompts, agents, retrieval systems, and tools.
  • Work with Data Science to convert evaluation methods and production thresholds into release controls.
  • Test systems against representative, unusual, adversarial, and high-risk scenarios.
  • Implement safeguards against prompt injection, data leakage, unauthorized tool use, and unsafe outputs.
  • Ensure AI systems comply with HIPAA, HITRUST, PHI protection requirements, and Accuity policy.
  • Preserve human review, decision traceability, and audit logging where clinical or coding judgment is involved.
• Collaboration and System Ownership:
  • Partner with Data Science to move validated AI approaches into production.
  • Partner with Platform Management and Data Architecture on infrastructure, deployment, data access, and governance.
  • Partner with application teams to deliver AI capabilities through reliable and documented services.
  • Assume ownership of systems delivered by internal teams or external development partners.
  • Write clean, secure, version-controlled code and maintain documentation that another engineer can use to operate the system.
  • Communicate system behavior, limitations, risks, and tradeoffs clearly to technical, clinical, and business audiences.
• Other Duties as Assigned:
  • Perform additional responsibilities as needed to support data science, technology, and organizational goals.

Qualifications

• Master’s degree in computer science, artificial intelligence, machine learning, or a related technical field, or equivalent practical experience, required.
• PhD degree in computer science, artificial intelligence, machine learning, or a related field preferred.

Requirements

• 5+ years of experience in software, AI/ML, or platform engineering, including ownership of production systems.
• Hands-on experience developing and operating LLM applications, AI agents, and retrieval-augmented generation (RAG) solutions.
• Strong Python proficiency, including experience with AI/ML libraries, vector search, tool integration, and human-in-the-loop workflows.
• Experience deploying and maintaining AI/ML systems using automated testing, evaluation, CI/CD, monitoring, and production controls.
• Experience implementing AI observability, explainability, security, and governance practices.

Company Description

Accuity partners with hospitals and health systems through a technology-enabled, physician-led model that improves clinical documentation integrity, coding accuracy, reimbursement optimization, and quality outcomes.