Back to Remote jobs >
Software Development
Data Engineer
@Armaments Research Company
[Hiring] Data Engineer @Armaments Research Company
Feb 26, 2025 - Armaments Research Company is hiring a remote Data Engineer. 💸 Salary: equity options and benefits included. 📍Location: USA.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Role Description
This Data Engineer will join our growing Data Science Team. Our data processing pipeline is implemented using AWS services and Apache Spark to post-process file-based and streaming inputs.
- Collaborate with multiple engineering teams to ensure viability of data solutions with data science, software engineers, devops, QA, and systems engineers.
- Participate in data processing architecture design discussions and documentation.
- Develop and implement scalable data processing capabilities, ingress and egress data storage and retrieval interfaces.
- Develop and maintain observability features that allow real-time insights into data processing status.
- Implement automated unit and integration tests to minimize regressions and accelerate the software release process.
- Hands-on experience with scaling from basic data warehousing problems to building and maintaining large-scale datalake ecosystems with complex system requirements.
Responsibilities - How You Will Make an Impact
-
Design & Optimize Data Pipelines:
- Develop, enhance, and refactor scalable ETL pipelines to handle large-scale IoT data.
- Optimize existing Apache Spark workflows for increased performance and reliability.
-
AWS Infrastructure Management:
- Manage and expand our AWS-based infrastructure (S3, EC2, Lambda, EMR, etc.) to support data storage, processing, and orchestration.
- Ensure cost-efficient resource utilization and scalability in the cloud environment.
-
Collaboration & Deployment:
- Act as primary liaison between software architects and data science team, refining solution designs to be “necessary and sufficient” with respect to both needs and constraints.
- Work closely with data scientists and ML engineers to integrate and deploy machine learning solutions into production.
- Implement CI/CD best practices for data pipelines and support rapid iteration cycles.
-
Performance Monitoring & Troubleshooting:
- Establish robust monitoring systems for data pipelines and cloud services.
- Diagnose and resolve performance bottlenecks and system issues proactively.
-
Data Quality & Security:
- Enforce data governance, quality checks, and security protocols across the data lifecycle.
- Ensure compliance with industry standards and regulatory requirements.
-
Innovation & Process Improvement:
- Stay abreast of emerging technologies and recommend improvements to scale and streamline our data architecture.
- Participate in code reviews and contribute to the development of best practices for data engineering.
- Deploy software using contemporary DevOps practices including multi-cloud, multi-tenant, and hybrid strategies.
Qualifications
- Bachelor's degree in computer science, computer engineering or equivalent practical experience
- 5+ years of experience as a data engineer
- Proven experience with Apache Spark and the Python data science ecosystem
- Demonstrated expertise in building and scaling data pipelines in a cloud environment, preferably AWS
- Strong understanding of distributed systems and big data processing
- Excellent problem-solving skills and the ability to work collaboratively in a fast-paced, agile environment
- Strong communication skills and a proactive attitude toward learning and innovation
- Experience working in a start-up environment
- Experience working for DoD or government contractor
- Ability to obtain a DoD security clearance
- Familiarity with IoT data ingestion and machine learning workflows is a plus
Requirements
- This position will require access to restricted information and facilities protected under U.S. laws and regulations, including the National Industrial Security Program Operating Manual (NISPOM).
- Citizenship Verification: This position requires verification of U.S. Citizenship to meet federal government security screening requirements required for this role.
Benefits
- Equity Options
- 401k plan
- Employer paid employee medical, dental and vision
- 12 paid holidays plus Flexible PTO Policy
Similar Remote Jobs
More jobs at Armaments Research Company
-
Software Development equity options and benefits included USAMar 25, 2025
More Software Development jobs
-
Software Development unspecified USAMar 31, 2025
More jobs in USA
-
Software Development unspecified USAMar 31, 2025
-
Sales / Business unspecified USAMar 31, 2025
-
Customer Service $70,000-$85,000/year, includes bonuses Northern America, Americas, USAMar 31, 2025
Kickstart Your Job Search
Need advice to apply?
Join our free
Webinar « 3
Mistakes to Avoid When Looking For A Remote Startup Job (And What To Do Instead) »
Register for free
Unlock 54,736 additional remote jobs, advanced search & email notifications
Get Access Now
Too many emails? Declutter your inbox with Meco
Your home for reading newsletters
Try for free - no card required.
️
| 📍 | Be aware of the location restriction for this remote position: USA |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
Back to Remote jobs >
Software Development
Software Development
|
Salary
💸
equity options and benefits included
|
Remote
Location
USA
|
|
Job Type
full-time
|
Posted
Feb 26, 2025
|
️
| 📍 | Be aware of the location restriction for this remote position: USA |
| ‼ | Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more. |
