Freelance Data Scraping Engineer (Python)

About the role

Mindrift is seeking experienced Python Data Scraping Engineers to work on the Tendem project. As an AI Pilot, you will partner with automated agents to design, execute, and validate high‑quality web extraction workflows. This part‑time, fully remote freelance position offers flexible scheduling for professionals comfortable with end‑to‑end data collection.

Key responsibilities

• Design and own complete data extraction pipelines for complex, dynamic websites.
• Utilize internal tools such as Apify and OpenRouter, as well as custom Python scripts, to gather and structure data.
• Handle JavaScript‑rendered content, AJAX calls, infinite scroll, and proxy management.
• Validate extracted datasets through cross‑source checks, formatting rules, and systematic verification.
• Scale scraping operations using batching, parallelization, and monitoring to ensure stability against site changes.

Required profile

• Minimum 3 years of experience in data engineering, web scraping, automation, or software development.
• Bachelor’s or Master’s degree in Computer Science, Engineering, Applied Mathematics, or a related field is a plus.
• Proven ability to deliver accurate, structured datasets under tight quality standards.

Required skills

• Python programming
• Web scraping libraries (BeautifulSoup, Selenium or equivalents)
• Experience with dynamic content handling (JavaScript, AJAX, infinite scroll)
• API integration and proxy usage
• Familiarity with Apify and OpenRouter platforms
• Data validation and quality‑control techniques
• Batch processing and parallel execution

What we offer

• Compensation up to $37 per hour, based on contribution level and pace.
• Fully remote work with flexible hours.
• Opportunity to collaborate on cutting‑edge AI‑augmented projects.