Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[SPARK-48248][PYTHON] Fix nested array to respect legacy conf of infe…
…rArrayTypeFromFirstElement ### What changes were proposed in this pull request? This PR fixes a bug that does not respect `spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled` in nested arrays, introduced by apache#36545. ### Why are the changes needed? To have a way to restore the original behaviour. ### Does this PR introduce _any_ user-facing change? Yes, it fixes the regression when `spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled` is set to `True`. ### How was this patch tested? Unittest added. ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#46548 from HyukjinKwon/SPARK-48248. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]>
- Loading branch information