Skip to main content

HTML to feed

Turn a dated news listing into JSON, RSS, Atom, or another supported format.

newsworker extract "https://example.com/news" --format rss --output feed.xml
newsworker extract "https://example.com/news" --format jsonfeed
newsworker extract "https://example.com/news" --limit 20 --since 2026-01-01

Follow pagination and optionally enrich full article text:

pip install "newsworker[fulltext]"
newsworker extract "https://example.com/news" --max-pages 3 --full-text --format atom

From Python:

from newsworker.service import FeedService
from newsworker.formats import format_feed

feed = FeedService().get_feed("https://example.com/news")
print(format_feed(feed, fmt="rss"))

See extract and output formats. If you will crawl the same layout again, switch to a parsing spec.