How to answer a system design interview question about loading a file larger than memory, with a practical pipeline, backpressure, bulk writes and crash recovery.
Quick summary One record per line: JSONL stores a complete JSON value on each UTF-8 line, making large datasets easier to stream, append and inspect. Handle boundaries correctly: Buffer incomplete network chunks and validate each record against both JSON syntax and your data contract. Plan for failures: Define how to handle malformed lines, retries and […]