This system provides a generator to lazy read JSONL files with each line a separate definition. JSONL files are files with newline delimited JSON blobs and typically very large. This package provides a generator that allows a line by line parse reducing memory complexity for large data demand projects such as those for training deep learning models.
This system provides a generator to lazy read JSONL files with each line a separate definition. JSONL files are files with newline delimited JSON blobs and typically very large. This package provides a generator that allows a line by line parse reducing memory complexity for large data demand projects such as those for training deep learning models.
Author: Paul Landes License: MIT Source: https://github.com/plandes/cl-jsonl