Repository navigation
[Python][Docs] use_content_defined_chunking not shown correctly for ParquetWriter / write_table #47477
Description
Describe the bug, including details regarding any error messages, version, and platform.
Was reading about Content-Defined Chunking which sounds very interesting!
Then I came across
https://arrow.apache.org/docs/python/generated/pyarrow.parquet.write_table.html etc
use_content_defined_chunking was documented in the docstring, but was not part of the APIs on the top of the page.
Also, it will be useful to have a note about the consequence of setting use_content_defined_chunking=True on systems that do not support CDC.
(final personal thought: should this filesystem-specific option to be set somewhere else? for now this is only relevant for Hugging face now?)
Component(s)
Parquet, Python
Activity
[-][Python][Doc] use_content_defined_chunking not shown correctly for ParquetWriter / write_table[/-][+][Python][Docs] use_content_defined_chunking not shown correctly for ParquetWriter / write_table[/+]tadeja commentedon Sep 17, 2026
This issue got resolved by #47498 as well.
The issue's side question:
was answered by @kszucs #47498 (comment)
For now no new notes in the docs for that, but welcome to open new follow-up requests.