Skip to content

Conversation

@ryantqiu
Copy link
Contributor

@ryantqiu ryantqiu commented Oct 1, 2025

Recreated from original PR: databricks/koalas#2039

Adds basic extension dtypes support.

The following types are supported if the underlying pandas supports them:

  • pandas >= 0.24
    • Int8Dtype
    • Int16Dtype
    • Int32Dtype
    • Int64Dtype
  • pandas >= 1.0
    • BooleanDtype
    • StringDtype
  • pandas >= 1.2
    • Float32Dtype
    • Float64Dtype

Internally, index_dtypes and data_dtypes are introduced in InternalFrame.

>>> kdf = ks.DataFrame({'a': [1,2,None,3], 'b': [4,5,6,None]}).astype({'a': 'Int32', 'b':...

Original PR #2039 by ueshin
Original: databricks/koalas#2039
@ryantqiu ryantqiu merged commit b6a8171 into main Oct 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants