close

DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
I Rewrote Our Instagram Transcript Actor for Pay-Per-Event Pricing. The Economics Flipped.

I Rewrote Our Instagram Transcript Actor for Pay-Per-Event Pricing. The Economics Flipped.

Comments
4 min read
The Real Alternative Data Edge Isn't the Data — It's the Pipeline

The Real Alternative Data Edge Isn't the Data — It's the Pipeline

Comments
6 min read
instagrapi vs HikerAPI: Which Instagram API Approach Actually Works for Automation?

instagrapi vs HikerAPI: Which Instagram API Approach Actually Works for Automation?

Image 1
Comments
3 min read
Migrating reCAPTCHA solving off 2Captcha: the one-line swap (and what changes at volume)

Migrating reCAPTCHA solving off 2Captcha: the one-line swap (and what changes at volume)

Comments
2 min read
Network-layer scraping is fast, but the maintenance cost is the real decision

Network-layer scraping is fast, but the maintenance cost is the real decision

Comments
5 min read
How I killed my fragile Instagram scraper and collapsed data collection into one API call

How I killed my fragile Instagram scraper and collapsed data collection into one API call

Comments
1 min read
The real cost of solving reCAPTCHA at scale (per-1,000 vs thread-based)

The real cost of solving reCAPTCHA at scale (per-1,000 vs thread-based)

Comments
3 min read
From Crawler Chaos to Official API: How We Rebuilt Our Cross-Border E-Commerce Backend

From Crawler Chaos to Official API: How We Rebuilt Our Cross-Border E-Commerce Backend

Comments
2 min read
Benchmarking Residential Proxy Providers: A Reproducible Test Script

Benchmarking Residential Proxy Providers: A Reproducible Test Script

Comments
4 min read
I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media

I Built a Tool to Track Which World Cup Players Are Blowing Up on Social Media

Image 1
Comments
3 min read
5 lessons from 5 interviews on AI agents and web scraping

5 lessons from 5 interviews on AI agents and web scraping

Comments 2
5 min read
Migration Playbook: Cron Script Actor. Six Steps, No Rewrites.

Migration Playbook: Cron Script Actor. Six Steps, No Rewrites.

Image 1
Comments
4 min read
Anti bot protection

Anti bot protection

Comments
1 min read
How We Built a WAF-Resilient, Selector-Free Web Scraper in Python (Using Gemini 2.5 & Playwright)

How We Built a WAF-Resilient, Selector-Free Web Scraper in Python (Using Gemini 2.5 & Playwright)

Comments
3 min read
What DIY web scraping really costs (2026 TCO breakdown)

What DIY web scraping really costs (2026 TCO breakdown)

Comments
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.