[Hiring] AI/ML Data Specialist @Wintrio

Role Description

WINTrio LLC is seeking an experienced AI/ML Data Specialist to design and deploy advanced AI capabilities that improve data discovery, access, and operational efficiency for a federal agency. This role centers on building retrieval augmented generation (RAG) capabilities and secure AI driven knowledge access tools, all developed and governed in compliance with OMB M-26-04.

• Build automated document ingestion and indexing pipelines for unstructured content.
• Develop RAG capabilities to support internal information retrieval, combining retrieval of relevant internal documents or data with generation of summarized, cited answers. Models must not invent answers; they must read internal content and respond based on it, with citations and security trimming.
• Deploy secure AI driven knowledge base and query services appropriate for internal federal use.
• Define and implement evaluation metrics covering accuracy, reliability, bias, and error rate.
• Establish AI guardrails, including monitoring, usage boundaries, and human oversight where appropriate.
• Produce comprehensive documentation for models, data flows, interfaces, and evaluation results.
• Meet performance standards including 90%+ accuracy and reliability, Retrieval Precision of 0.90 or higher, and Citation coverage of 0.95 or higher.
• Ensure all AI solutions comply with OMB M-26-04 and other applicable federal requirements.

Qualifications

• Demonstrated experience building RAG pipelines, including retrieval and generation components with citation and security trimming.
• Experience with document ingestion, indexing, and unstructured data processing.
• Experience defining and applying AI evaluation metrics, including accuracy, bias, and reliability testing.
• Experience establishing AI guardrails, monitoring, and human oversight practices.
• Familiarity with federal AI governance requirements, including OMB M-26-04.
• Experience working in a federal or regulated environment with stakeholders, CORs, and structured deliverables.
• Must be eligible for a Moderate Risk (MBI) background investigation.

Requirements

• RAG & LLM Tooling: retrieval systems, generation models, citation and security trimming.
• Document Processing: ingestion and indexing pipelines for unstructured content.
• Evaluation & Guardrails: accuracy, reliability, bias, and error rate metrics; usage monitoring and human oversight.
• AWS Cloud Services (preferred): integration with existing AWS based data environment.
• Recommended Certifications (not mandatory): AWS Certified Machine Learning Specialty.

Benefits

• Healthcare (Medical, Dental, and Vision).
• Flexible Spending Account (FSA) and Health Savings Account (HSA).
• 401(k) and Retirement Savings Plan.
• Annual Bonus and Profit Sharing Opportunities.
• Paid Time Off (PTO) and Vacation.
• Employee Assistance Program (EAP).
• Life, Personal, and Voluntary Disability Insurance.