D

Mid-Level Data Engineer - Web Scraping & Data QA

dataweav • Canada
Remote
Apply
AI Summary

Build and maintain large-scale web data collection systems. Ensure data quality through rigorous QA processes. Use Python, browser automation, and AI-assisted development. Remote within Canada.

Key Highlights
Build and maintain web scrapers using Python and browser automation
Normalize and validate data at scale
Use AI-assisted development tools daily
Work remotely within Canada
Key Responsibilities
Build new scrapers using Python, browser automation, and HTTP APIs
Maintain existing scrapers and debug issues
Normalize raw scraped data into standardized schemas
Run QA checks to catch regressions, missing data, and corruption
Compare independent re-runs against vendor data to surface gaps and accuracy issues
Technical Skills Required
Python Browser automation (Playwright) Data processing and validation
Benefits & Perks
CAD $85,000 to $105,000 per year
Fully remote within Canada
Nice to Have
Experience with browser automation tools (Playwright, Puppeteer, Selenium)
Familiarity with proxy services and IP rotation strategies
Experience with data parsing (BeautifulSoup, lxml, JSON/API scraping)
Knowledge of anti-bot systems (Cloudflare, DataDome, PerimeterX)

Job Description


Dataweav is hiring a mid-level Data Engineer to build and maintain the systems behind our data collection and QA.


Dataweav runs large-scale web data collection and independently audits data quality: we operate 400+ live scraping sites, process 500M+ records a month, and catch the missing records, dropped fields, and accuracy issues that vendors miss. Reliable extraction and rigorous QA are the product, so the data engineering work sits at the center of the business.


You'll build and maintain scraping infrastructure across many platforms, and own the pipelines that extract, normalize, and validate data at scale. This is an AI-first team. We use Claude Code and AI assistants daily as core development tools.


Location: Remote within Canada. Our team is based in St. John's, Newfoundland and Labrador. You can work from anywhere in Canada, and we work across Canadian time zones.


Compensation: CAD $85,000 to $105,000 per year, based on experience. Fully remote within Canada.


What You'll Do

  • Build new scrapers using Python, browser automation (Playwright), and HTTP APIs
  • Maintain existing scrapers when target sites change structure or add anti-bot protections
  • Debug proxy, fingerprinting, and anti-bot detection issues
  • Normalize raw scraped data into standardized, versioned schemas
  • Build and run QA checks that catch regressions, missing data, dropped records, and corruption
  • Compare independent re-runs against vendor data to surface gaps and accuracy issues
  • Use AI-assisted development (Claude Code) as part of your daily workflow


What We're Looking For

  • Legally eligible to work in Canada (citizen, permanent resident, or valid open work permit)
  • 2+ years of professional experience in web scraping, data engineering, automation, or full stack development
  • Solid Python (async/await, HTTP libraries, data processing)
  • Working knowledge of HTML/CSS/JavaScript and browser DevTools
  • Able to debug network traffic: inspect requests, read API responses, understand HTTP headers
  • Comfortable reasoning about data quality: validation, deduplication, edge cases, and regression checks
  • Self-motivated and comfortable working independently
  • Comfortable using Claude Code


Nice to Have

  • Experience with browser automation tools (Playwright, Puppeteer, Selenium)
  • Familiarity with proxy services and IP rotation strategies
  • Experience with data parsing (BeautifulSoup, lxml, JSON/API scraping)
  • Knowledge of anti-bot systems (Cloudflare, DataDome, PerimeterX)
  • Experience with Git, SQLite or Postgres, Pydantic, or pytest
  • Experience building QA or data-validation systems, not just consuming data


Work Hours

  • Monday to Friday. We keep core overlap hours in the mornings (Atlantic and Newfoundland time) for team communication, with flexibility around the rest of your day.

Similar Jobs

Explore other opportunities that match your interests

Senior Data Analyst - Insurance

Data Science
•
5d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

Jobgether

Canada

Data Engineer, BI & Reporting

Data Science
•
5d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

Jobgether

Canada
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Associate

Jobgether

Canada

Subscribe our newsletter

New Things Will Always Update Regularly