[FEAT] IOStats for Native Reader

[samster25]

• Implements IOStats via atomics that will track the number of:
• GetRequests
• HeadRequests
• ListRequests
• BytesRead

When the IOStatsContext goes out of scope it will debug log its output:
For a parquet read:

IOStatsContext: read_parquet: for uri s3://eventual-dev-benchmarking-fixtures/parquet-benchmarking/tpch/200MB-2RG/daft_200MB_lineitem_chunk.RG-2.parquet, Gets: 17, Heads: 1, Lists: 0, BytesRead: 213627535, AvgGetSize: 12566325

For our io_glob:

IOStatsContext: io_glob for s3://daft-segment-data/segment-logs/**, Gets: 0, Heads: 0, Lists: 237, BytesRead: 0, AvgGetSize: 0

Currently the context is threaded through our python Apis for io_glob, read_parquet, and read_csv

IOStats is currently implemented for:

• S3
• GCS
• HTTP
• Azure

[codecov]

Codecov Report

Merging #1493 (8f765b5) into main (e1e5eaf) will decrease coverage by 0.02%.
The diff coverage is n/a.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1493      +/-   ##
==========================================
- Coverage   74.97%   74.96%   -0.02%     
==========================================
  Files          60       60              
  Lines        6123     6123              
==========================================
- Hits         4591     4590       -1     
- Misses       1532     1533       +1     

see 1 file with indirect coverage changes

[jaychia]

Looks great!

[samster25]

closes: #1456