[Hiring] Web Scraping Engineer @Nesso Labs
Web Scraping Engineer @Nesso Labs
Software Development
Salary idr 17,000,000 ..
Remote Location
Employment Type contract
Posted Today

[Hiring] Web Scraping Engineer @Nesso Labs

Today - Nesso Labs is hiring a remote Web Scraping Engineer. πŸ’Έ Salary: idr 17,000,000 - 21,000,000 per month πŸ“Location: Indonesia

Role Description

We're building the data backbone for European public procurement. Our platform aggregates tender data from 100+ e-procurement portals β€” each with its own quirks, anti-bot protections, and legacy HTML. We're looking for a scraping engineer who can navigate this landscape.

  • Build and maintain async scrapers (Python + Playwright) against Italian and later European public procurement portals (Maggioli PortaleAppalti, ANAC, MePA, and others)
  • Handle real-world challenges:
    • JSESSIONID session management
    • FriendlyCaptcha/Mosparo anti-bot
    • Cloudflare WAF
    • IP rotation with rate limit backoff
  • Parse Italian data formats β€” amounts (€ 1.234.567,89), dates (DD/MM/YYYY, textual), CIG/CUP identifiers with placeholder detection
  • Extract and process documents: PDF, .p7m (PKCS#7 signed), ZIP/7Z archives, with OCR fallback
  • Integrate scrapers into our Prefect orchestration pipeline with monitoring, alerting, and anomaly detection
  • Work with PostgreSQL, Supabase, Clickhouse, and S3 for dual-sink storage with upsert/idempotency patterns

Qualifications

  • Strong async Python β€” you think in asyncio, not time.sleep()
  • Playwright or Selenium experience β€” you've intercepted XHR responses, handled SPAs, and debugged timing issues
  • Resilience mindset β€” retry with backoff, graceful degradation, circuit breakers. Your scraper doesn't crash at 3 AM.
  • Comfort with messy HTML β€” you can write a multi-strategy extractor that handles / ,
    /
    , and
  • Data parsing skills β€” Italian locale, date formats, CIG validation, document type detection
  • Bonus: experience with Italian PA (Pubblica Amministrazione) portals, ANAC/PVL datasets, or OCDS data formats

Tech stack

  • Python 3.11+
  • Playwright
  • httpx
  • BeautifulSoup
  • Pydantic
  • SQLAlchemy 2.0
  • PostgreSQL
  • Prefect
  • AWS S3
  • Supabase

How we hire

No whiteboard algorithms. We'll send you a hands-on technical assessment: a mock procurement portal with real-world challenges. You build a scraper. We evaluate the code.

Before You Apply
️
remote Be aware of the location restriction for this remote position: Indonesia
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Web Scraping Engineer @Nesso Labs
Software Development
Salary idr 17,000,000 ..
Remote Location
Employment Type contract
Posted Today
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Unlock 150,000+ Remote Jobs
️
remote Be aware of the location restriction for this remote position: Indonesia
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Unlock 150,000+ Remote Jobs
Γ—

Apply to the best remote jobs
before everyone else

Access 150,000+ vetted remote jobs and get daily alerts.

4.9 β˜…β˜…β˜…β˜…β˜… from 500+ reviews
Unlock All Jobs Now

Maybe later