Scraper System
Hub for scraper lessons and the live JSON runner
Scraper · Home · Lesson 1 — Music · Lesson 2 — Vacation
What this system does
The Spring scraper API accepts a JSON ScrapeRequest and returns scraped items. This project is the frontend + lessons for building those JSON files and testing them live.
| Piece | Location |
|---|---|
| Backend API | POST /api/scraper/run (Spring, port 8585 locally) |
| Runner UI | Below on this page |
| Lessons | Music · Vacation |
JSON request shape
Every payload uses the same five sections:
| Key | Purpose |
|---|---|
url |
Start page to scrape |
pagination |
How to follow “next page” links |
itemsSelector |
CSS selector for each repeated item on the page |
fields |
Named outputs (selector, mode, optional attr) |
limits |
maxPages, maxItems, maxConcurrency, timeoutMs |
Log in first so your JWT cookie is sent with the request.