Skip to content

Arrow2: No conversion rule from Blob(true) for Arrow2TypeSystem #261

@Kipriz

Description

@Kipriz

I'm trying to use connectorx to read data from MySQL and mssql.
When I used return_type "arrow" I got truncated datetimes for all timestamps and datetimes columns.
To resolve this issue, I switched to "arrow2" type as suggested here #229
However, I faced with another exception when reading a column with "text" type from MySql database:

RuntimeError: No conversion rule from Blob(true) to connectorx::destinations::arrow2::typesystem::Arrow2TypeSystem.

Any suggestions how to deal with this issue?

Code sample:

conn = "mysql://user:password@localhost:3306/control_panel"
sql = """
select id, name, created_at, contact from cfg_rds_connection
"""
df = cx.read_sql(conn, sql, return_type="arrow2")
pq.write_table(df, './parquet/cfg_rds_connection_pyarrow_ts.parquet')

contact column has type text.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions