Replies: 1 comment
-
This setting appears to do the trick: |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I wish to increase the GS bandwidth in Gluten. The only prefetch controls that I can find are:
spark.gluten.sql.columnar.backend.velox.prefetchRowGroups
spark.gluten.sql.columnar.backend.velox.cachePrefetchMinPct
What values should be used to increase the GS bandwidth for TPCDS Q3 for example.
In the TPCH document I see
spark.gluten.sql.columnar.backend.velox.prefetchRowGroups=1
spark.gluten.sql.columnar.backend.velox.cachePrefetchMinPct=80
These don't appear to do anything to change the GS bandwith.
I've also played with executor/core settings but the GS bandwidth remains static.
Are there other configuration settings?
Beta Was this translation helpful? Give feedback.
All reactions