Speed up dump for sql engine

[zhijian-pro]

Speed up for dbmeta

[codecov-commenter]

Codecov Report

Merging #1006 (0696061) into main (630263d) will increase coverage by 0.12%.
The diff coverage is 70.65%.

❗ Current head 0696061 differs from pull request most recent head a077919. Consider uploading reports for the commit a077919 to get more accurate results

@@             Coverage Diff              @@
##               main    #1006      +/-   ##
============================================
+ Coverage     37.20%   37.33%   +0.12%     
  Complexity       33       33              
============================================
  Files           146      146              
  Lines         23560    23682     +122     
  Branches        422      422              
============================================
+ Hits           8766     8841      +75     
- Misses        13617    13651      +34     
- Partials       1177     1190      +13     

Impacted Files	Coverage Δ
pkg/meta/dump.go	56.12% <ø> (-5.64%)	⬇️
pkg/meta/sql.go	67.07% <70.65%> (+<0.01%)	⬆️
pkg/meta/tkv_mem.go	86.71% <0.00%> (-0.70%)	⬇️
pkg/meta/tkv.go	72.71% <0.00%> (-0.31%)	⬇️
pkg/vfs/handle.go	77.31% <0.00%> (+0.84%)	⬆️
pkg/vfs/reader.go	66.05% <0.00%> (+1.27%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 630263d...a077919. Read the comment docs.

[davies]

Should we skip the edge and continue (log it as warning)?

[zhijian-pro]

It has been modified

[zhijian-pro]

Performance Testing

data and env:

1. A total of 1000000 empty files are evenly distributed in 200 local folders
2. Local mysql

result:

old version

• mysql dump: 3600s
• mysql load: 46m

new version

• mysql dump :25s
• mysql load: 8m

Test conclusion

• The performance of the dump operation is improved by 144 times
• The performance of the load operation is improved by 5 times