Nydus Image Service v2.3.0-alpha.0

Binaries download mirror (sync within a few hours): https://registry.npmmirror.com/binary.html?path=nydus/v2.3.0-alpha.0/

What's Changed

• Correctly generate mapped-blkaddr for RAFS devslot array by @jiangliu in #1108
• api: prepare for publishing v0.2.2 by @jiangliu in #1126
• deps: bump tempfile version to 3.4.0 to fix some security vulnerabilities by @adamqqqplay in #1123
• nydus: exclude some components when publishing crate by @jiangliu in #1127
• nydus-image: fix a underflow issue in get_compressed_size() by @jiangliu in #1130
• Prepare for exposing nydus images as block devices by @jiangliu in #1125
• readme: add a very brief section to introduce image optimizer by @changweige in #1140
• Minor improvements to nydus-image by @jiangliu in #1135
• Export Nydus images as block devices by using NBD by @jiangliu in #1139
• Move RAFS filesystem builder into nydus-rafs crate by @jiangliu in #1141
• api: fix a build error by @jiangliu in #1143
• builder: support --parent-bootstrap for merge by @imeoer in #1137
• Refine builder and rafs to prepare for tarfs by @jiangliu in #1144
• upgrad fuse-backend-rs to 0.10.2 by @jongwu in #1149
• rafs: fix amplify can not be skipped. by @ccx1024cc in #1150
• nydusify: fix pulling all platforms of source image by @imeoer in #1146
• utils: introduce methods and structures for encryption and decryption by @jiangliu in #1148
• Introduce new tarfs mode to Nydus by @jiangliu in #1147
• rafs: define dedicated RafsV6Inode to reduce memory consumption by @jiangliu in #1156
• Enhance nydus-image merge to support tarfs by @jiangliu in #1151
• rafs: only enable digest validate based on configuration by @imeoer in #1155
• Enhance FUSE implementation to support RAFS in TARFS mode by @jiangliu in #1158
• ci test: fix bug of compiling nydus-snapshotter by @yqleng1987 in #1161
• nydusify: fix oci media type handle by @imeoer in #1163
• nydusify: cleanup work directory when conversion finish by @imeoer in #1164
• rafs: fix a assertion failure in prefetch list generation by @jiangliu in #1165
• rafs: git rid of several unimplemented() by @jiangliu in #1166
• service: fix compilation failures on macos by @jiangliu in #1167
• rafs: fix incorrect blob id in merged TARFS by @jiangliu in #1168
• build(deps): bump google.golang.org/protobuf from 1.29.0 to 1.29.1 in /contrib/nydusify by @dependabot in #1170
• fix: stable/XXX branch not run ci by @ccx1024cc in #1172
• fix: master branch not run ci by @ccx1024cc in #1173
• service: clean clippy warnings for macos by @jiangliu in #1169
• service: Add a README.md to nydus-service by @taoohong in #1121
• deny: fix cargo deny warnings related to openssl by @jiangliu in #1175
• nydus-image: print mapped block address when inspecting blob info by @jiangliu in #1178
• nydus: fix a possible panic caused by SubCmdArgs::is_present() by @jiangliu in #1177
• Add export subcommand to nydus-image by @jiangliu in #1159
• storage: fix http fallback handle by @imeoer in #1186
• nydus-image: update documentation docs/nydus-image.md by @jiangliu in #1181
• build(deps): bump github.com/opencontainers/runc from 1.1.4 to 1.1.5 in /contrib/ctr-remote by @dependabot in #1185
• rafs: fix a incorrect mapped_blkaddr for multi layer images by @jiangliu in #1184
• docs: polish and simplify README.md by @adamqqqplay in #1183
• Add verity digests for exported block device by @jiangliu in #1176
• contrib: upgrade runc to v1.1.5 by @adamqqqplay in #1188
• macos: fix a build failure by @jiangliu in #1189
• doc: update descriptions about nydus-snapshotter by @changweige in #1153
• build(deps): bump spin from 0.9.3 to 0.9.8 in /contrib/nydus-backend-proxy by @dependabot in #1193
• action: upgrade golangci-lint to v1.51.2 by @imeoer in #1203
• service: add coco feature in Cargo.toml by @taoohong in #1200
• build(deps): bump github.com/docker/docker from 23.0.1+incompatible to 23.0.3+incompatible in /contrib/nydusify by @dependabot in #1197
• docs: add helm quickstart link to deploy Dragonfly+Nydus by @adamqqqplay in #1205
• add CoreWeave to the adopter list by @imeoer in #1207
• build(deps): bump h2 from 0.3.13 to 0.3.17 in /contrib/nydus-backend-proxy by @dependabot in #1212
• rafs: fix a possible bug in v6_dirent_size() by @jiangliu in #1208
• rafs: fix a regression caused by commit 2616fb2 by @jiangliu in #1213
• service: add a functoin to help create fuse vfs backend by @taoohong in #1218
• Enhance file cache to encrypt data written to the cache file by @jiangliu in #1192
• docs: add the tip for nydus-zran by @Desiki-high in #1224
• rafs: optimize Node::name() to reduce image build time by @jiangliu in #1222
• nydus-image: support small chunks mergence by @hangvane in #1202
• misc: update toolchain to 1.68.2 and fix clippy warnings by @eryugey in #1227
• action: add unit test coverage check workflow by @adamqqqplay in #1228
• feat: add more types of file to smoke by @ccx1024cc in #1229
• feat: add the benchmark test for nydus by @Desiki-high in #1219
• action: allow running smoke test for stable/* branch by @imeoer in #1232
• action: fix smoke test for branch pattern by @imeoer in #1235
• rafs: minor optimization for tarfs builder by @jiangliu in #1233
• action: fix checkout on pull_request_target by @imeoer in #1238
• docs: update the perf graph by @imeoer in #1241
• docs: add codecov label in readme by @Desiki-high in #1242
• action: add zran-no-prefetch benchmark and make smoke.yml tidy by @Desiki-high in #1239
• nydus-image: optimize the way to generate tarfs by @jiangliu in #1240
• action: add read-amount and read-count for benchmark by @Desiki-high in #1243
• ctr-remote: update contaeinrd to v1.7.0 and fix lint error by @adamqqqplay in #1245
• feat: support the arg batch-size for small chunks mergence for nydusify by @Desiki-high in #1206
• feat: compare benchmark between PR and master by @Desiki-high in #1244
• action: replace cargo test with cargo nextest in CI by @adamqqqplay in #1249
• action: make benchmark compare summary more clear by @Desiki-high in #1251
• storage: refine the way to define compression algorithms by @jiangliu in #1225
• contrib: support nydus-overlayfs and ctr-remote on different platforms by @mofishzz in #1256
• nydusify: add some unit tests and add test coverage output by @adamqqqplay in #1246
• action: add benchmark on schedule by @Desiki-high in #1254
• action: reuse rust caches by @Desiki-high in #1261
• action: fix benchmark on schedule without cache will panic by @Desiki-high in #1262
• fix warnings in Release and Integration Test by @Desiki-high in #1264
• feat: support more images for benchmark by @Desiki-high in #1259
• misc: reorganize the configuration file of nydusd by @adamqqqplay in #1266
• build(deps): bump github.com/docker/distribution from 2.8.1+incompatible to 2.8.2+incompatible in /contrib/nydusify by @dependabot in #1273
• feat: benchmark more images on schedule by @Desiki-high in #1271
• feat: nydusify can dump metrics created by converter by @Desiki-high in #1272
• Fixes two bugs for rafs v5 by @jiangliu in #1275
• smoke: no need to run vet and lint by @bergwolf in #1280
• action: convert ci can show the metrics collected during conversion by @Desiki-high in #1279
• action:clean cache after branch closes by @Desiki-high in #1281
• cargo: update fuse-backend-rs dependency by @bergwolf in #1283
• action: benchmark add description by @Desiki-high in #1282
• app: merge crate nydus-app into crate nydus by @jiangliu in #1287
• docs: add pull request and issue templates by @adamqqqplay in #1286
• cargo: fix fuse-backend-rs dependency in cargo.toml by @adamqqqplay in #1292
• blobfs: merge crate blobfs into crate rafs by @jiangliu in #1291
• Fix broken integration test for v5 image by @adamqqqplay in #1297
• Optimize RAFS filesystem builder by @jiangliu in #1257
• Optimize blobfs implementation by @jiangliu in #1295
• builder: delay free data structure to reduce image build time by @jiangliu in #1298
• error: merge crate nydus-error into nydus-utils and nydus-api by @jiangliu in #1299
• smoke: use v2.1.6 instead of v2.1.4 by @jiangliu in #1302
• builder: correctly generate nid for v6 inodes by @jiangliu in #1304
• builder: set the default compression algorithm for meta ci to lz4 by @mofishzz in #1308
• Rafs: Add missing prefix of hex by @liubogithub in #1309
• ci(release): add macos arm64 artifact by @killagu in #1293
• storage: add runtime support for batch chunk by @hangvane in #1289
• builder: split out builder into a dedicated crate by @jiangliu in #1321
• Publish nydus-service v0.3.0 by @jiangliu in #1323
• ci(release): fix macos nydusd rust target by @killagu in #1324
• fix some issue about the subcommand mount of nydusify by @lihuahua123 in #1319
• gha:add some descriptions for convert ci by @Desiki-high in #1335
• service: refine block device implementation by @jiangliu in #1332
• Define new feature flags to control crate dependencies by @jiangliu in #1325
• nydusify: update the doc of nydusify about the subcommand mount by @lihuahua123 in #1336
• rafs: add special handling of invalid zero blob index by @jiangliu in #1326
• nydusify: bump github.com/goharbor/acceleration-service v0.2.5 by @imeoer in #1331
• docs: update the OpenAnolis kernel installation guide in fscache doc. by @adamqqqplay in #1343
• fix: merge io from same blob panic by @ccx1024cc in #1347
• action: reduce the number of times the codecov tool sends comments by @adamqqqplay in #1350
• feat: nydus support encrypted images by @taoohong in #1333
• docs: add containerd runtime-level snapshotter usage for nydus by @Iamleos in #1353
• fix incidental bugs in ci test by @yqleng1987 in #1358
• nydus-image: add unit test for setting default compression algorithm by @xwb1136021767 in #1354
• fix: deprecated docker field leads to failure of nydusify check by @ccx1024cc in #1349
• fix: large files broke prefetch by @ccx1024cc in #1348
• fix: amplify io is too large to hold in fuse buffer by @ccx1024cc in #1311
• Makefile: allow to build debug version nydusd by @bergwolf in #1369
• change a new nydus image for ci test by @yqleng1987 in #1370
• Enhance localdisk storage backend to manually add blob objects by @jiangliu in #1337
• storage: simplify mirror implementation by @imeoer in #1375
• fixup nydusctl umount argument usage by @cntianci in #1377
• parse image pull auth from env by @sctb512 in #1382
• builder: optimize tarfs building speed by skipping file content by @jiangliu in #1376
• nydusify: support --with-referrer option by @imeoer in #1384
• deps: update tar-rs to handle very large uid/gid in image unpack by @adamqqqplay in #1387
• deps: Bump dependent crate versions by @justxuewei in #1390
• service: print more error message by @WeiZhang555 in #1388
• cargo: bump rafs/storage/api/utils crate version by @bergwolf in #1393
• builder: introduce chunkdict save subcommand by @cslinwang in #1305
• nydusify: introduce chunkdict generate subcommand by @newthifans in #1341
• deps: change tar-rs to upstream version by @adamqqqplay in #1396
• Fix image-create with ACLs. Fixes #1394. by @dhbaird in #1395
• nydusify: introduce copy subcommand by @imeoer in #1380
• Update cargo.lock and add vscode to gitignore by @zyfjeff in #1404
• Support use /dev/stdin as SOURCE path for image build by @zyfjeff in #1409
• bugfix: do not fill 0 buffer, and skip validate features by @zyfjeff in #1412
• add --original-blob-ids args for merge by @zyfjeff in #1408
• Add seekable method for TarReader use to determine whether the current reader supports seek by @zyfjeff in #1411
• storage: fix chunk map compatibility by @imeoer in #1417
• nydus-overlayfs: filter option "io.katacontainers.volume" by @jiangliu in #1418
• misc: rename vault to hashicorp/vault by @Desiki-high in #1420
• action: update test branch for integration by @imeoer in #1422
• nydus-image：optimize chunkdict save by @cslinwang in #1430
• Fix no export subcmd panic on mac by @An-DJ in #1429
• build(deps): bump github.com/cyphar/filepath-securejoin from 0.2.3 to 0.2.4 in /contrib/ctr-remote by @dependabot in #1428
• build(deps): bump github.com/cyphar/filepath-securejoin from 0.2.3 to 0.2.4 in /contrib/nydusify by @dependabot in #1427
• nydus-image: Fix blob unpacking bug in specified blob directory by @An-DJ in #1426
• Always use blob id as the name of the filecache when use separate blob by @zyfjeff in #1432
• feat: notifying incosistent fs version problem with exit code by @PerseidMeteor in #1424
• storage: fix auth compatibility for registry backend by @lihuahua123 in #1425

New Contributors

• @jongwu made their first contribution in #1149
• @hangvane made their first contribution in #1202
• @Iamleos made their first contribution in #1353
• @cntianci made their first contribution in #1377
• @WeiZhang555 made their first contribution in #1388
• @cslinwang made their first contribution in #1305
• @newthifans made their first contribution in #1341
• @dhbaird made their first contribution in #1395
• @An-DJ made their first contribution in #1429
• @PerseidMeteor made their first contribution in #1424

Full Changelog: v2.2.0...v2.3.0-alpha.0