v0.12.3

Features

• Add support for resources for VolumeFile and VolumeArchive for external volume files.
• Implements method to write SQL result to table.
• [Experimental] Add support for auto-partition table.

Enhancements

• Ignore cases for column names in schema and record.
• Remove decimal precision & scale check to allow large decimal scale.
• Add config for logview latency and print final progress.
• Enhance DDL generation for ROW FORMAT SERDE clause.
• Add global compress options for tunnel.
• Add session refresh option for Storage API.
• Add unique identifier ID to instance job model.
• Automatically add default settings in xflow instances.
• Allow equality comparison of columns and records.
• Allow arrow instance tunnel to use multiple processes.
• Add anonymous placeholder for DBAPI SQL parameterized query.
• Allow specifying dict type for structs when options.struct_as_dict == True.
• Allow specifying table creation args and column types when calling write_table with create_table == True.
• Add raw error message to warning when PermissionError encountered in downloading data from instance tunnel.
• Automatically convert all settings to string in MaxFrame task to avoid unexpected behavior from server.
• Add cast for complex types to make sure arrow conversion returns correct result.
• Add create_partition argument for tunnel APIs.

Bugfixes

• Fix error when loading ODPS engine spec of superset.
• Fix cast for string column to new decimal type in arrow tunnel.
• Fix size check issue for varchar type with binary data.
• Fix error when None elements in complex types.
• Fix huge space between lines of repr(table) when name or type is long.
• Fix inferring table schema from arrow schema when struct type exists.

Documentations

• Add docs of table functions.
• Add docs for diagnosing slow SQL execution.
• Add docs of ODPS types.
• Add links to API references for object docs.
• Add API docs for tunnels and remove Mars docs.
• Mark PyODPS DataFrame as deprecated in documentation.

Compatibility issues

• Since PyODPS 0.12.3, column names with different capitalization are considered the same to make it compatible with behaviors of MaxCompute service. It may break some cases where capitalized column names are used.
• Since PyODPS 0.12.3, dict instead of OrderedDict is used by default for structs when options.struct_as_dict == True for Python>=3.7. Change to legacy behavior by setting options.struct_as_ordered_dict = True.