Skip to content

v2.2.0 Redis File Locker

Compare
Choose a tag to compare
@cfarmer-fearless cfarmer-fearless released this 01 Jul 12:50
· 134 commits to main since this release

DEX Upload Release Notes - Version 2.2.0

Release Date: 2024-06-24

Version Number: Version 2.2.0

Release Changelog

API Swagger Documentation

DEX Upload API Github Releases

DEX Upload API Github Tags

Overview

The purpose of Enterprise Data Exchange (DEX) Upload release version 2.2.0 is to release an improvement to how the Upload API prevents file corruption when the service horizontally scales. This improvement is implemented in this release via a distributed file locker that uses a Redis cache to keep track of which Tus instance is currently working on a file, and makes sure another Tus instance doesn't work on the same file. Before this improvement, we were relying on Azure's internal blob storage implementation to prevent clusters of tus servers from corrupting files. This implementation is obscured from us and completely out of our control. This custom distributed lock with Redis gives us full control, and has even been adopted by the Tusd maintainers.

Enhancements

  • Improved reliability of horizontal scaling via a custom file locking mechanism that uses an external Redis cache.

Reporting Team