[Hiring] AI Context Engineer @CACI International

Role Description

Make a difference and join an enthusiastic team looking to make a difference in the lives of today’s military! CACI is looking for an experienced senior-level developer with strong interpersonal and communication skills as well as a record of accomplishment in successful project execution. The Developer must have independent drive if working remote. Working for DHA and Naval Information Warfare Center Atlantic for a Navy Medicine Online Project. The project is within the Defense Health Readiness Engineering portfolio.

Responsibilities

• Context Architecture & Design
  • Design and maintain context pipelines that retrieve, rank, compress, and assemble information for LLM inputs
  • Define and enforce context schemas, prompt templates, and structured data contracts across AI features
  • Develop strategies for dynamic context window management — balancing relevance, recency, and token budget
  • Architect retrieval-augmented generation (RAG) systems, including chunking strategies, embedding selection, and reranking layers
• Prompt Engineering & Optimization
  • Craft, iterate on, and systematically test system prompts and few-shot examples that reliably elicit desired model behaviors
  • Build evaluation frameworks to measure prompt quality, instruction-following accuracy, and output consistency
  • Identify and mitigate failure modes such as hallucination, instruction drift, context confusion, and context stuffing
  • Maintain a prompt library and versioning system to support reproducibility and regression testing
• Tooling & Infrastructure
  • Build internal tooling for context inspection, token counting, and prompt debugging
  • Integrate with vector databases (e.g., Pinecone, Weaviate, pgvector) and semantic search infrastructure
  • Implement memory systems, conversation state management, and session persistence for multi-turn AI applications
  • Collaborate with DevOps/MLOps to deploy and monitor context pipelines in production environments
• Research & Continuous Improvement
  • Stay current with LLM research: context window advances, long-context models, sparse attention, and retrieval techniques
  • Prototype and evaluate new approaches to context construction, summarization, and compression
  • Document findings, failure analyses, and architectural decisions for the broader team
  • Mentor junior engineers and contribute to internal knowledge sharing on prompt engineering

Qualifications

• Secret Clearance or the ability to obtain a secret clearance
• Develop and maintain software requirements as it relates to user requirements and existing software defects
• Knowledge of DevSecOps, agile development and the context engineering lifecycle
• Knowledge and experience with JavaScript
• Knowledge of JSON
• Knowledge of source code versioning
• System Test and Evaluation, planning execution and management

Requirements

• Demonstrated writing/editing skills
• Ability to work under pressure and multitask in a fast-paced environment
• Able to work with highly technical IT personnel, understand technical tasking, and explain technical activities to non-technical individuals
• Excellent interpersonal and communication skills

Education and Experience

• Education: University degree (BA/BS) or 5+ years of experience
• Experience: 3+ years of professional software engineering experience, with 1+ years working directly with large language models in production
• Demonstrable hands-on experience building or shipping LLM-powered applications or features
• Experience with at least one major LLM API platform: OpenAI, Anthropic, Google Gemini, Cohere, or equivalent
• Familiarity with prompt engineering techniques: chain-of-thought, few-shot prompting, structured output, tool/function calling

Benefits

• A culture of integrity
• An environment of trust
• A focus on continuous growth
• Competitive compensation, benefits, and learning and development opportunities
• Comprehensive benefits such as healthcare, wellness, financial, retirement, family support, continuing education, and time off benefits

Pay Range

The proposed salary range for this position is: $82,100-$172,400

Company Description

CACI is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, age, national origin, disability, status as a protected veteran, or any other protected characteristic.