How to adjust the serialization format of datetime with UTC timezone for hive partitions

[ion-elgreco]

Describe the usage question you have. Please include as many useful details as possible.

In Delta-RS we are using pyarrow as engine to write with. It seems though that datetime partitions that have a UTC timezone are being serialized with a Z at that the end. So we get this 2022-01-01 03:00:00.000000Z.

We however need to write them without the Z at the end because that's how the Delta Protocol requires it to be.

Is there a way to adjust this partition serialization format in PyArrow dataset writer?

Component(s)

Python

Relevant issue in Delta-RS

delta-io/delta-rs#2384