CLN/DOC: DataFrame.to_parquet supports file-like objects #35235
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adds documentation and type-hints for supporting file-like objects when
engine == 'pyarrow'
; relevant to #30081. Tests for this behavior currently exist inio.test_parquet.py
:Perhaps the restrictions on the arguments when path is not a string:
should be checked directly in
DataFrame.to_parquet
, but I'm leaving this out as that is an API change that could be made in a subsequent PR. The latter gives the clear error messageTypeError: expected str, bytes or os.PathLike object, not _io.BytesIO
but the former raisesAttributeError: 'NoneType' object has no attribute '_isfilestore'
which is slightly confusing.Another API change that could be made subsequently is changing the
path
argument topath_or_buf
, consistent withDataFrame.to_csv
.