Skip to content

unit-prerelease fails with pyarrow 20.0.0.dev19 or newer versions #321

Closed
@chelsea-lin

Description

@chelsea-lin

The unit-prerelease job is failing with pyarrow version 20.0.0.dev19. The tests pass with earlier versions, specifically up to 20.0.0.dev18. The failure appears to be related to pyarrow misses RankQuantileOptions python class, causing a RuntimeWarning warning.

Here's the error output:

.nox/unit_prerelease/lib/python3.12/site-packages/pyarrow/compute.py:209: in _get_options_class
    return globals()[class_name]
E   KeyError: 'RankQuantileOptions'

During handling of the above exception, another exception occurred:
tests/unit/test_arrow.py:18: in <module>
    import pandas
.nox/unit_prerelease/lib/python3.12/site-packages/pandas/__init__.py:49: in <module>
    from pandas.core.api import (
.nox/unit_prerelease/lib/python3.12/site-packages/pandas/core/api.py:28: in <module>
    from pandas.core.arrays import Categorical
.nox/unit_prerelease/lib/python3.12/site-packages/pandas/core/arrays/__init__.py:1: in <module>
    from pandas.core.arrays.arrow import ArrowExtensionArray
.nox/unit_prerelease/lib/python3.12/site-packages/pandas/core/arrays/arrow/__init__.py:1: in <module>
    from pandas.core.arrays.arrow.accessors import (
.nox/unit_prerelease/lib/python3.12/site-packages/pandas/core/arrays/arrow/accessors.py:23: in <module>
    import pyarrow.compute as pc
.nox/unit_prerelease/lib/python3.12/site-packages/pyarrow/compute.py:336: in <module>
    _make_global_functions()
.nox/unit_prerelease/lib/python3.12/site-packages/pyarrow/compute.py:333: in _make_global_functions
    g[cpp_name] = g[name] = _wrap_function(name, func)
.nox/unit_prerelease/lib/python3.12/site-packages/pyarrow/compute.py:292: in _wrap_function
    options_class = _get_options_class(func)
.nox/unit_prerelease/lib/python3.12/site-packages/pyarrow/compute.py:211: in _get_options_class
    warnings.warn("Python binding for {} not exposed"
E   RuntimeWarning: Python binding for RankQuantileOptions not exposed

Steps to reproduce

The issue can be reproduce when importing pandas with pyarrow 20.0.0.dev19

>>> import pandas
/usr/local/google/home/chelsealin/src/python-db-dtypes-pandas/.nox/unit_prerelease/lib/python3.12/site-packages/pyarrow/compute.py:211: RuntimeWarning: Python binding for RankQuantileOptions not exposed
  warnings.warn("Python binding for {} not exposed"

Metadata

Metadata

Assignees

Labels

api: bigqueryIssues related to the googleapis/python-db-dtypes-pandas API.type: processA process-related concern. May include testing, release, or the like.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions