[Hiring] Python Developer @PSignite

Role Description

We are looking for a Python Developer specializing in OCR and web scraping to join our Data Science team. Your primary focus will be building and maintaining reliable OCR and data scraping pipelines for selected web portals and integrating them with OCR tools to extract structured information from diverse sources.

Work Mode: Fully remote.

Key Responsibilities

• Web Scraping:
  • Design, develop, and maintain Python-based scrapers for targeted web portals, handling dynamic content, pagination, rate limiting, and anti-bot mechanisms.
• OCR Integration:
  • Connect scraping pipelines with OCR tools to extract text and structured data from images, scanned documents, and PDFs.
• Data Pipeline & Storage:
  • Build end-to-end data pipelines that collect, transform, and store scraped data in cloud storage, ensuring reliability and reproducibility.
• Cloud Infrastructure:
  • Deploy and manage scraping jobs on AWS (EC2, S3, Lambda) with appropriate scheduling, monitoring, and error handling.
• Data Quality:
  • Validate and clean extracted data, handle edge cases, and ensure output consistency across sources.
• Documentation:
  • Document scraper architecture, data schemas, and operational procedures for handover and long-term maintainability.

Qualifications

• Proficiency in Python with strong experience in web scraping libraries (e.g. Scrapy, BeautifulSoup, Selenium, Playwright).
• Practical experience integrating OCR tools into data pipelines (e.g. Tesseract, cloud-based OCR services).
• Working knowledge of AWS, especially S3, EC2, and basic networking/scheduling (Lambda, EventBridge, or cron-based).
• Solid understanding of HTTP, HTML/CSS structure, browser DevTools, and common anti-scraping patterns.
• Experience with data parsing and transformation (JSON, XML, CSV) and libraries such as pandas.
• Familiarity with version control (Git) and clean coding practices.
• Comfortable working in a Linux terminal environment.
• Communicative English, sufficient for reading documentation and coordinating with the team.

Nice to Have

• Experience with headless browser automation at scale.
• Familiarity with proxy management, CAPTCHA handling, and IP rotation strategies.
• Knowledge of Docker for containerizing scraping services.
• Experience with task orchestration tools (e.g. Airflow, Prefect, Step Functions).
• Familiarity with SQL databases for structured data storage.
• Background in CPG/FMCG or Retail data domains.

Benefits

• Fully remote work.
• Access to cloud infrastructure (AWS) for development and deployment.
• Collaboration with an experienced Data Science team working on real business problems in the CPG/Retail space.
• Clear project scope and technical support from the team.