DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to Scrape Twitch with Go: Chat Logs over IRC WebSockets, Moderation Events, Full-Text Search, and Chat Stats (2026)

How to Scrape Twitch with Go: Chat Logs over IRC WebSockets, Moderation Events, Full-Text Search, and Chat Stats (2026)

Comments
25 min read
BeautifulSoup find() Returns None? Debug the HTML requests Got, Not the Page DevTools Shows

BeautifulSoup find() Returns None? Debug the HTML requests Got, Not the Page DevTools Shows

Comments
5 min read
I Asked Apple's Search API for 20 VPN Apps and Got 18. Asking for 200 Gets You 189

I Asked Apple's Search API for 20 VPN Apps and Got 18. Asking for 200 Gets You 189

Comments
7 min read
6 public job-board APIs that need no key, and an open list of 15,647 companies that use them

6 public job-board APIs that need no key, and an open list of 15,647 companies that use them

Comments
4 min read
587 of OpenAI's 840 Ashby Jobs Report isRemote: true. Twenty-Two Are Remote

587 of OpenAI's 840 Ashby Jobs Report isRemote: true. Twenty-Two Are Remote

Comments
7 min read
How to scrape LinkedIn and Indeed jobs into a spreadsheet with Python (no login)

How to scrape LinkedIn and Indeed jobs into a spreadsheet with Python (no login)

Comments
7 min read
What breaks when you run your own Google scraper, and how many engineering hours does it cost?

What breaks when you run your own Google scraper, and how many engineering hours does it cost?

Comments
8 min read
Find the published contact email, phone and socials for a list of domains

Find the published contact email, phone and socials for a list of domains

Comments
4 min read
No Otodom API? Warsaw flat prices per m by district with Python

No Otodom API? Warsaw flat prices per m by district with Python

Comments
4 min read
Go 爬虫第三讲:做一个"有礼貌"的爬虫

Go 爬虫第三讲:做一个"有礼貌"的爬虫

Comments
2 min read
Turn a documentation site into Markdown for RAG, without a headless browser

Turn a documentation site into Markdown for RAG, without a headless browser

Comments
3 min read
Tracking Sephora prices, sales and new launches with Python (no browser, no API key)

Tracking Sephora prices, sales and new launches with Python (no browser, no API key)

Comments
5 min read
How to Get Posts from Any Bluesky Account Without an API Key (Python and No-Code)

How to Get Posts from Any Bluesky Account Without an API Key (Python and No-Code)

Comments
3 min read
How to Extract Jobs & Salaries From Greenhouse, Lever, Ashby & SmartRecruiters JSON APIs (Plus Free n8n Workflows)

How to Extract Jobs & Salaries From Greenhouse, Lever, Ashby & SmartRecruiters JSON APIs (Plus Free n8n Workflows)

Comments
2 min read
Which SERP API is fastest, and which one fails least? 30 days of latency and success rates

Which SERP API is fastest, and which one fails least? 30 days of latency and success rates

Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.