batch

Extracts feeds from a list of pages concurrently, writing one file per URL.

newsworker batch [OPTIONS]

Option	Alias	Default	Description
--urls-file		—	Text file with one page URL per line.
--from-opml		—	OPML file; each outline's htmlUrl (or xmlUrl) is used as the page URL.
--output-dir	-d	.	Directory for one output file per URL.
--format	-f	json	Output format (same set as extract).
--max-workers		4	Concurrent workers (thread pool, or aiohttp when --async).
--async		false	Use the optional aiohttp transport (newsworker[async]).
--manifest		—	Write a run manifest to this path.
--manifest-format		json	Manifest format: json or csv.
--failure-policy		strict	strict or partial-success.
--no-cache		false	Bypass caches for this run.
--config	-c	(default)	Path to settings YAML.
--verbose	-v	false	Verbose logging.

newsworker batch --urls-file urls.txt --output-dir out --format rss
newsworker batch --from-opml feeds.opml -d out -f json --max-workers 8
pip install 'newsworker[async]'
newsworker batch --urls-file urls.txt -d out --async

See batch manifests for artifact naming, record fields, and exit codes.