AI Platform Engineer @ZipStaff
Artificial Intelligence
Salary 62-63 per hour
Remote Location
πŸ‡ΊπŸ‡Έ USA Only
Employment Type contract
Posted YDay

[Hiring] AI Platform Engineer @ZipStaff

YDay - ZipStaff is hiring a remote AI Platform Engineer. πŸ’Έ Salary: 62-63 per hour πŸ“Location: USA

Role Description

ZipStaff is hiring an AI Platform Engineer for our client, a Fortune 10 healthcare and pharmacy leader. You'll build and operate a production agentic AI platform β€” the layer other engineers build on β€” and own its reliability, security, and cost. This is a fully remote contract-to-hire role. Candidates must be US citizens or green card holders; sponsorship is not available.

Responsibilities

  • Build and operate a production agentic AI platform: orchestration, model gateway, agent registry, retrieval, guardrails, evaluation, and observability.
  • Implement production multi-agent orchestration, including state management and retry/fallback design.
  • Operate model serving and gateway capabilities, including routing, fallback, rate limiting, token/usage capture, and serving of open-weight models.
  • Build retrieval-augmented generation, including vector stores, embedding models, chunking, hybrid and semantic search, reranking, and grounding-quality evaluation.
  • Implement agent infrastructure, including Model Context Protocol (MCP), tool/function-calling contracts, agent registries, permission enforcement, and separation of reasoning from acting agents.
  • Design evaluation and LLMOps practices, including eval harnesses, offline and online evaluation, regression suites, drift and hallucination detection, and experiment tracking.
  • Apply guardrails and AI security, including prompt-injection, jailbreak, and data-leakage defense, plus PII detection and redaction in prompts and responses.
  • Instrument observability for LLM and agent calls (token, latency, and cost telemetry) and quality-signal monitoring that feeds alerting.

Qualifications

  • US citizen or green card holder; sponsorship is not available.
  • 8+ years in software or platform engineering, with hands-on production ownership of AI or ML infrastructure.
  • Has built and operated agentic or LLM systems in production, not only prototyped them.
  • LLM and agent orchestration with LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or the Google Agent Development Kit (ADK).
  • Model serving and gateway experience (LiteLLM, Portkey, Kong AI Gateway, TrueFoundry, or Vertex AI Model Garden), including routing, fallback, rate limiting, token/usage capture, serving open-weight models (Llama, Mistral, Gemma, Qwen) via vLLM, TGI, Ollama, or Vertex endpoints, and LoRA/QLoRA adapters.
  • RAG experience with Vertex Vector Search, Pinecone, Weaviate, pgvector, or Elasticsearch.
  • Evaluation and LLMOps with RAGAS, DeepEval, Promptfoo, or OpenAI Evals, and experiment tracking with MLflow, LangSmith, Langfuse, Arize Phoenix, or Braintrust.
  • Guardrails and AI security experience with NeMo Guardrails, Guardrails AI, Model Armor, or Lakera.
  • Observability (OpenTelemetry tracing for LLM and agent calls); Kubernetes and containers; GCP preferred (GKE, Vertex AI, Cloud Run); Terraform, CI/CD, and SRE practice for production AI services.
  • Strong Python.

Preferred Qualifications

  • Go or Java for platform services.

Benefits

  • Health Insurance.
  • Dental Insurance.
  • Vision Insurance.
  • 401(k) + matching.
  • Paid time off.
  • Referral Program.

Company Description

ZipStaff connects skilled technology professionals with leading organizations across the United States, matching top talent with impactful contract and full-time opportunities.

To apply, submit your resume through this posting. Qualified candidates will be contacted by a ZipStaff recruiter.

Before You Apply
️
πŸ‡ΊπŸ‡Έ Be aware of the location restriction for this remote position: USA Only
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
AI Platform Engineer @ZipStaff
Artificial Intelligence
Salary 62-63 per hour
Remote Location
πŸ‡ΊπŸ‡Έ USA Only
Employment Type contract
Posted YDay
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 140,000+ Remote Jobs
️
πŸ‡ΊπŸ‡Έ Be aware of the location restriction for this remote position: USA Only
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 140,000+ Remote Jobs
Γ—
Apply to the best remote jobs
before everyone else

Access 140,000+ vetted remote jobs and get daily alerts.

4.9 β˜…β˜…β˜…β˜…β˜… from 500+ reviews

⚑ 141,364+ remote jobs, refreshed hourly

πŸ”” Real-time alerts: Apply first, direct to employer

πŸ›‘οΈ Vetted companies, no scams, true remote only

Unlock All Jobs Now

Maybe later