Skip to content

Commit

Permalink
fix(ingest/bigquery): use small batch size if use_tables_list_query_v…
Browse files Browse the repository at this point in the history
…2 is set (#11121)
  • Loading branch information
mayurinehate authored Aug 9, 2024
1 parent 840b150 commit 78336c9
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -985,7 +985,7 @@ def get_tables_for_dataset(
# https://cloud.google.com/bigquery/docs/information-schema-partitions
max_batch_size: int = (
self.config.number_of_datasets_process_in_batch
if not self.config.is_profiling_enabled()
if not self.config.have_table_data_read_permission
else self.config.number_of_datasets_process_in_batch_if_profiling_enabled
)

Expand Down

0 comments on commit 78336c9

Please sign in to comment.