close

DEV Community

Scraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to evaluate a search API for AI agents without confusing search with extraction
anakin_writers profile

How to evaluate a search API for AI agents without confusing search with extraction

#ai #api #webdev #scraping
Comments
4 min read
How to automatically detect any company's tech stack and logo from just their domain name
technicaldost profile

How to automatically detect any company's tech stack and logo from just their domain name

#webdev #api #scraping #productivity
Comments
1 min read
Booster Leboncoin: the Manifest V3 Chrome extension that bumps my ads and watches prospects for me
ohugonnot profile

Booster Leboncoin: the Manifest V3 Chrome extension that bumps my ads and watches prospects for me

#chromeextension #manifestv3 #leboncoin #scraping
Comments
7 min read
How I Finally Got Reliable Data from Messy HTML Tables
__c1b9e06dc90a7e0a676b profile

How I Finally Got Reliable Data from Messy HTML Tables

#webdev #ai #python #scraping
Comments
4 min read
Stop scraping the page when the data is already in the network tab
anakin_writers profile

Stop scraping the page when the data is already in the network tab

#webdev #scraping #automation #api
Comments
4 min read
I spent weeks scraping 50 websites—here's what finally worked
__c1b9e06dc90a7e0a676b profile

I spent weeks scraping 50 websites—here's what finally worked

#webdev #python #ai #scraping
Image 1
Comments
4 min read
I Built an API That Turns Any Website Into JSON Using Just CSS Selectors
sergio_morales_c705507bcd profile

I Built an API That Turns Any Website Into JSON Using Just CSS Selectors

#showdev #webdev #api #scraping
Comments
2 min read
Why I ditched regex scrapers for an LLM parser (and when you shouldn't)
__c1b9e06dc90a7e0a676b profile

Why I ditched regex scrapers for an LLM parser (and when you shouldn't)

#python #webdev #ai #scraping
Image 1
Comments
4 min read
How to Scrape Google Search Results with Python Without Getting Blocked (2026)
zyvop profile

How to Scrape Google Search Results with Python Without Getting Blocked (2026)

#pythongooglescraper2026 #googleserpscrapingpython #scraping #beautifulsoup4
Comments
10 min read
Proxy Rotation & Session Management for AI Web Agents
alterlab profile

Proxy Rotation & Session Management for AI Web Agents

#scraping #python #api #proxies
Comments
6 min read
I Built an API That Turns Any Website Into JSON Using Just CSS Selectors
sergio_morales_c705507bcd profile

I Built an API That Turns Any Website Into JSON Using Just CSS Selectors

#showdev #webdev #api #scraping
Comments
2 min read
Rate Limits & Anti-Bots in Agentic Scraping
alterlab profile

Rate Limits & Anti-Bots in Agentic Scraping

#antibot #scraping #ratelimiting #python
Image 1
Comments
5 min read
The Anti-Bot Detection Checklist I Use Before Every Scraping Project
charles_90891cea4a1800830 profile

The Anti-Bot Detection Checklist I Use Before Every Scraping Project

#scraping #bots #tutorial #node
Comments
4 min read
My Apify Promotion Filter: Scale Clean APIs, Hold Back Noisy Demand
the_aientrepreneur_7ae85 profile

My Apify Promotion Filter: Scale Clean APIs, Hold Back Noisy Demand

#webdev #api #apify #scraping
Comments
3 min read
Regex broke my scraper: Using LLMs for robust data extraction
__c1b9e06dc90a7e0a676b profile

Regex broke my scraper: Using LLMs for robust data extraction

#webdev #ai #python #scraping
Image 2
Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.