[Hiring] Senior Data Pipeline Engineer @Serviss

Role Description

SERVISS is seeking a Senior Data Pipeline Engineer to join an established, mission-critical Pipeline team on the DHS CDM Data Services / BETSIE Program. In this senior role, you will take a leading technical role in the data ingestion and pipeline function that collects asset and cyber-intelligence data from SaaS platforms, primarily Armis and Axonius, and delivers it into Elasticsearch to power a unified single-pane-of-glass dashboard for agency stakeholders.

The selected candidate will:

• Architect, automate, and maintain scalable, fault-tolerant data processing pipelines that ingest asset, vulnerability, and configuration data from Armis, Axonius, and other SaaS/API sources into Elasticsearch.
• Handle high-volume, high-velocity data collection, processing, and indexing to support near-real-time visibility.
• Design Elasticsearch index strategies, mappings, ingest pipelines, and transforms; normalize disparate source data to a common schema (e.g., Elastic Common Schema) for consistent search, correlation, and reporting.
• Build and maintain Kibana dashboards and visualizations that deliver a true single-pane-of-glass view of the agency's technical posture.
• Own API integration patterns against evolving vendor APIs, including authentication and token management, pagination, rate limiting, incremental/delta ingestion, and resilient error handling and retry logic.
• Implement automated reconciliation and data-quality checks to ensure ingested data is complete, consistent, and accurate against source systems; document and maintain data lineage and traceability of transformed data back to source.
• Manage index lifecycle (ILM), retention, sharding, and cluster performance tuning for high-volume, low-latency operations.
• Instrument pipelines with monitoring, alerting, and logging so data-flow issues are detected and resolved before they reach stakeholders.
• Follow programming best practices, emphasizing code reusability and highly automated CI/CD pipelines for scalability.

Qualifications

• US citizenship with the ability to obtain Public Trust Suitability.
• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field (master's degree preferred).
• A minimum of six years of experience designing, implementing, and managing the technical delivery of large-scale data engineering or data pipeline services to diverse organizations.
• 4+ years hands-on with Elasticsearch or OpenSearch: index design, mappings, ingest pipelines, query/aggregation, and cluster performance tuning.
• Strong experience integrating REST APIs from SaaS platforms, including authentication, pagination, rate limiting, incremental ingestion, and resilient error handling.
• Proficiency with a scripting/pipeline language (Python strongly preferred) and with ETL/ELT tooling such as Logstash, Elastic Agent/Beats, or equivalent.
• Experience designing, implementing, and managing data schemas that comply with cyber-relevant data standards and frameworks, e.g., SCAP, STIX, OTEL, Elastic Common Schema, and Splunk Common Information Model.
• Knowledge of data transformation processes and experience documenting and maintaining data lineage, especially traceability of transformed data to source data.
• Solid data modeling and normalization skills for heterogeneous sources, including mapping to a common schema.
• Knowledge of Federal Cybersecurity and Risk Management policies and practices, including FISMA; NIST SP 800-37, 800-53, 800-30, and 800-39; and FedRAMP.
• Solid understanding of Git, version control workflows, and CI/CD.

Requirements

• Direct experience integrating Armis and/or Axonius, or comparable CAASM / asset-intelligence platforms (e.g., Tenable, Qualys, ServiceNow).
• Experience utilizing data cataloging and governance tools (e.g., Alation, Collibra).
• Containerization and orchestration (Docker, Kubernetes) and infrastructure-as-code (Terraform, Ansible).
• CI/CD tooling (GitLab CI, Jenkins) and DevSecOps practices in cloud (AWS GovCloud / Azure Government a plus).
• Experience with monitoring/observability tooling and data-reconciliation frameworks.
• Knowledge of cybersecurity tools and technologies.
• Active DHS Public Trust or prior EOD.
• Familiarity with Agile / SCRUM methodologies.
• Strong problem-solving and analytical skills, with a sense of urgency and the ability to prioritize and balance multiple tasks.

Benefits

• Highly competitive compensation and best in class benefits.
• 100% of medical, vision, dental, and life insurance premiums paid for by SERVISS.
• Be part of an exciting company with ground floor opportunities in the Equity Participation Program.
• Opportunities for annual performance bonuses and growth incentives.
• 401(k) retirement plan with 6% dollar for dollar match.