[Hiring] Software Engineer @Analogy Group

Role Description

We are hiring a Software Engineer focused on Data Infrastructure and Acquisition to help us design the infrastructure and build scrapers for public data. This role is a mix of backend engineering, agentic AI engineering, and web scraping. Your work will directly contribute to making government data accessible and useful to help fight corruption, protect democracy, and enable citizens to understand their government.

This is a fully remote role for engineers based in India. We offer highly competitive, top-of-market compensation and are looking for candidates with a strong record of technical excellence.

What You’ll Do:

• Design, build, and maintain our data acquisition infrastructure using technologies such as Prefect, AWS, and Django.
• Develop clear, durable abstractions for scraping patterns and infrastructure, keeping the system manageable as we scale to thousands of data sources.
• Build AI-powered infrastructure for agentic, self-healing scrapers.
• Develop agents capable of creating new scrapers from established templates and validating their output.
• Build and test resilient scrapers for messy, difficult public data sources, including PDFs, videos, forms, and legacy government portals.
• Improve observability, retries, data validation, and failure recovery across our pipelines.
• Open-source selected parts of our work and write about what we learn.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or similar.
• 5+ years of professional software engineering experience, with strong Python skills and working knowledge of JavaScript or TypeScript.
• Experience designing and operating complex data pipelines.
• Experience with workflow orchestration platforms such as Temporal, Prefect, Dagster, or Airflow.
• Practical web-scraping experience, including headless browsers, retries, rate limiting, proxy rotation, and changing or unreliable source websites.
• Experience using coding agents such as Codex or Claude Code, including an understanding of what makes agent workflows reliable.
• Experience developing AI agents, agent tooling, evaluation systems, skills, or execution harnesses.
• Strong judgment about abstractions, testing, observability, and long-term system maintainability.

Requirements

• Experience extracting structured information from PDFs, scanned documents, audio, or video.
• Experience operating distributed systems or data infrastructure on AWS.
• Experience with Django and Prefect.
• Contributions to open-source software or published technical writing.
• An interest in government transparency, public-interest technology, politics, or civic data.