Pydantic Support for Arrow Schema Definition and ORM

[everettVT]

LanceDB has a utility to convert pydantic objects to arrow schemas ( https://github.com/lancedb/lancedb/blob/main/python/python/lancedb/pydantic.py ), but I haven't seen arrow types implemented in pydantic attributes and fields outside my chats with LLMs.

Given many agentic and gen ai projects leverage pydantic for type validation, how would this best be implemented in Daft?

This speaks to the differences between OO and dataframe based processing, and I was looking for some wise words on the topic.

[jaychia]

Interesting thought -- any ideas for an API?

I could see this maybe being useful for DataType definitions for complex UDFs!