Compile JSONL crawl output into one JSON array
islamweb_compile_jsonCompiles a crawled JSONL dataset into a sorted, pretty-printed JSON array file. Use after a crawl to produce a clean snapshot of the compiled data.
Instructions
Reads a JSONL dataset file (one entry per line) and writes it out as a single sorted, pretty-printed JSON array file. Run this once a crawl has finished (or whenever you want a fresh snapshot).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| jsonFile | No | defaults to data/lisan-al-arab.json | |
| jsonlFile | No | defaults to data/lisan-al-arab.jsonl |