You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Populate FileWriteMetadata.format_metadata with Thrift-serialized Parquet footer for FFI consumers #24010
PR #23656 added FileWriteMetadata with a format_metadata: Option<Bytes> field designed to carry format-specific metadata (e.g., Thrift-serialized Parquet FileMetaData). The current implementation sets this to None because the typed ParquetMetaData is already accessible via ParquetSink::written() for Rust consumers.
Proposal
When a concrete FFI use case emerges (e.g., Python via PyO3, or C via datafusion-ffi), serialize the Parquet FileMetaData using Thrift Compact Protocol and populate format_metadata so that non-Rust consumers can access per-file column statistics without re-reading file footers.
Activity
Fix cargo fmt, rename sink_tests to tests, update Cargo.lock, link tr…
Fix cargo fmt, rename sink_tests to tests, update Cargo.lock, link tr…