[Hiring] Senior Python Developer @Intelligent Audit

Role Description

As a Senior Python Developer, you will build and maintain backend systems focused on automating internal processes and supporting the Data Science team. Your primary responsibility will be developing scalable web scraping solutions and data pipelines to extract, transform, and load data from multiple external sources. You will use AI coding assistants and agents throughout the software development lifecycle to accelerate delivery, improve code quality, and automate repetitive engineering work, while maintaining ownership of technical decisions and production outcomes.

What You Will Do:

• Process Automation & Backend Development:
  • Design and develop automated systems for internal process optimization.
  • Build scalable backend services that integrate with existing infrastructure.
  • Ensure services are reliable, performant, and maintainable.
• Web Scraping & Data Extraction:
  • Develop and maintain web scraping solutions for multiple external websites.
  • Handle dynamic content, rate limiting, authentication, and anti-scraping measures.
  • Implement robust error handling, logging, and retry mechanisms.
• Data Manipulation & Processing:
  • Clean, transform, and process large volumes of structured and unstructured data.
  • Build and maintain data pipelines to deliver usable datasets to downstream systems.
• Monitoring & Observability:
  • Implement monitoring for system performance, data quality, and operational metrics (e.g., Datadog).
  • Create dashboards and alerts to ensure system reliability and data integrity.
• Data Science Team Support:
  • Provide backend infrastructure, data pipelines, and tooling for Data Science projects.
  • Collaborate with data scientists to deliver data and services that enable experimentation and model deployment.
• Code Quality & Best Practices:
  • Apply test-driven development and maintain solid unit/integration test coverage.
  • Perform code reviews using engineering judgment and AI-assisted review tools to identify defects, security issues, and maintainability concerns.
  • Validate AI-generated code through appropriate testing and inspection, and follow company policies for source code, credentials, and customer data when using AI tools.
  • Follow best practices in Python packaging, dependency management (e.g., uv, conda), and documentation.
• CI/CD & Infrastructure:
  • Design and maintain CI/CD pipelines (e.g., GitHub Actions) for automated testing and deployment.
  • Work with DevOps to support containerization and orchestration (Docker, Kubernetes).
• Lifecycle Management & Continuous Improvement:
  • Own the software lifecycle from development through deployment and maintenance.
  • Identify opportunities to reduce technical debt and improve performance and reliability.

Qualifications

• Advanced Python proficiency with experience in backend frameworks (e.g., FastAPI).
• Strong understanding of HTTP, RESTful API design, and general web technologies.
• Experience working in Linux-based environments.
• Hands-on experience with web scraping tools and libraries (e.g., BeautifulSoup, Scrapy, Selenium, Playwright).
• Ability to handle JavaScript-rendered content, cookies, sessions, and complex authentication flows.
• Strong experience with Python data libraries (e.g., pandas, polars, NumPy).
• Strong SQL skills and familiarity with common data formats (JSON, XML, CSV, HTML).
• Experience with monitoring and observability tools (e.g., Datadog).
• Experience with relational databases (e.g. PostgreSQL).
• Experience with automated build/test/deploy pipelines and containerized workloads.
• Understanding of data science workflows and model deployment needs.
• Use of AI development tools (e.g., Codex, Claude Code, Cursor) for implementation, debugging, refactoring, testing, and documentation.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
• 5+ years of professional Python backend development experience.
• 3+ years of experience with web scraping and data extraction from multiple sources.
• Demonstrated experience building scalable backend systems and automated processes.
• Experience with monitoring and observability tools (Datadog or similar).
• Strong SQL skills and experience with relational databases.
• Proficiency with Linux, Git, and Bash command-line tools.

Preferred Characteristics

• Experience with asynchronous and concurrent processing (e.g., asyncio, Celery).
• Prior exposure to logistics, freight, or supply chain domains.
• Experience with distributed systems and microservices architectures.
• Familiarity with data engineering tools and practices (e.g., dbt, Airflow, Prefect).
• Experience building APIs and services that integrate with machine learning models.
• Contributions to open-source projects related to web scraping, data engineering, or backend automation.

Monday-Friday EST Hours