[Hiring] Data Scientist @OpenDataJobs

Role Description

Peregrine Advisors is seeking skilled individuals to build, evaluate, and put into production machine learning and generative AI models for federal agencies. This role involves:

• Taking models and AI agents from experiment to production on Azure Databricks.
• Developing and training machine learning models on Azure Databricks, tracking experiments, models, and versions in MLflow.
• Building reusable features in the Databricks Feature Store and serving models through Databricks Model Serving.
• Building retrieval and agent applications with Agent Bricks and Databricks AI Search, using Azure OpenAI models.
• Evaluating model and agent quality with MLflow evaluation, including large language model (LLM) judges, labeled test sets, and human review.
• Monitoring models in production for drift and quality, and writing the necessary documentation for model reviews.

This is a full-time W-2 position with a salary of $110,000 to $140,000 per year. It is a remote position. The initial engagement requires United States citizenship; dual citizenship and green card holders are prohibited by the contract terms. It also requires the ability to satisfy the required suitability, security, and access requirements.

Qualifications

• 4+ years of data science or machine learning engineering experience, including models deployed to production.
• Bachelor's degree.
• Proficiency in Python for data science and machine learning, including pandas, scikit-learn, and PySpark.
• Hands-on Azure Databricks work, including MLflow for experiment tracking and model management.
• Experience deploying and monitoring models in production, including model serving, versioning, and drift monitoring.
• Experience building LLM applications, including retrieval-augmented generation (RAG).
• Structured Query Language (SQL) and Git-based version control.
• Delivery experience in a federal government environment, working to its security, access, and review processes.
• Proficiency in writing, PowerPoint, and Excel.
• United States citizenship; dual citizenship and green card holders are prohibited by the contract terms.
• The ability to satisfy the required suitability, security, and access requirements.

Requirements

• Experience on a federal system accredited at Impact Level 5 (IL-5) or higher.
• Knowledge of Agent Bricks, Databricks AI Search, or MLflow 3 evaluation for generative AI.
• Experience with a second managed machine-learning platform, such as Azure Machine Learning, Amazon SageMaker, or Google Vertex AI.
• Familiarity with Azure OpenAI or other models in Microsoft Foundry.
• Databricks certification, or a Microsoft Azure AI or data science certification.
• Model risk management or model validation experience, including the documentation a model review asks for.
• Familiarity with artificial intelligence (AI)-assisted developer tooling.

Benefits

• Medical, dental, and vision with the employee premium fully paid and half of dependent premiums.
• Employer-paid life, accidental death, and short-term and long-term disability insurance.
• 401(k) with an employer match of up to 4% of salary.
• Unlimited paid time off.
• Sponsored professional certifications and continuing education.

Company Description

Peregrine Advisors is a rapidly growing AI and data innovation hub helping government solve hard problems and deliver better outcomes. We work across the full lifecycle—from strategy and governance through architecture, engineering, analytics, AI, visualization, and training—for clients including the SEC, PCAOB, DDOT, and DCAA.

• Winner of the United Nations COP27 Datathon.
• Exceptional CPARS ratings, SEC Chair’s Awards, and SEC Vision Award.
• First and only social enterprise organized as a Benefit Corporation and SBA 8(a) company focused on AI and data for government.