You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug, including details regarding any error messages, version, and platform.
This small examples fails with ValueError: Field pyarrow.Field<a: double not null> was non-nullable but pandas column had 1 null values on 16.1.0.
import pandas as pd
import pyarrow as pa
df = pd.DataFrame({"a": [1.0, float("nan")]})
schema = pa.schema([pa.field('a', pa.float64(), nullable=False)])
pa.Table.from_pandas(df, schema=schema)
I guess this seems like a bug to me, but I'm no pandas expert. It does feel like this makes roundtripping a non-null float column through pandas impossible?
Component(s)
Python
The text was updated successfully, but these errors were encountered:
amoeba
changed the title
Table.from_arrow can't import nan values into a non-null float column
[Python] Table.from_arrow can't import nan values into a non-null float column
May 25, 2024
Describe the bug, including details regarding any error messages, version, and platform.
This small examples fails with
ValueError: Field pyarrow.Field<a: double not null> was non-nullable but pandas column had 1 null values
on 16.1.0.I guess this seems like a bug to me, but I'm no pandas expert. It does feel like this makes roundtripping a non-null float column through pandas impossible?
Component(s)
Python
The text was updated successfully, but these errors were encountered: