Post

HN
Hacker News

Kore: Binary File Format Optimized for Modern Data Systems (Open Source)

The fastest, most compressed columnar format for big data | v0.1.0

KORE is a high-performance binary file format optimized for analytical workloads. It provides:

Add this crate as a dependency (when published) or include from path:

See python/README.md for full PySpark documentation.

This workspace contains copies of the original KORE source files. Some long implementations were stubbed out in this initial export; if you want the full original source code included verbatim, I can replace the stubs with the complete implementations from the upstream project files.