[Core feature] Add LazyFrame support for polars plugin

[cosmicBboy]

Motivation: Why do you think this is important?

Currently, the flytekit polars plugin only supports polars.DataFrame, but many polars users also use LazyFrames.

Goal: What should the final outcome look like, ideally?

The flytekit type transformers should support pl.LazyFrame annotation and StructuredDataset encoding/decoding

Describe alternatives you've considered

Today users can convert LazyFrames to DataFrame with a collect() call.

Propose: Link/Inline OR Additional context

No response

Are you sure this issue hasn't been raised already?

• Yes

Have you read the Code of Conduct?

• Yes

[runllm]

Currently, the Flytekit Polars plugin supports polars.DataFrame but not LazyFrame (source). Users can convert LazyFrame to DataFrame using the collect() method as a workaround.

Would you like more details on how to extend Flytekit to support LazyFrame?

Sources:

• Flyte Discussion on Polars DataFrame

---

This is an AI-generated response and your feedback is appreciated! Please leave a 👍 if this is helpful and 👎 if it is not.

Mention @RunLLM to ask follow-up questions. See runllm.com for more!