Skip to content

Amoro-0.5.0
Compare
Choose a tag to compare
@zhoujinsong zhoujinsong released this 10 Aug 02:39
· 705 commits to master since this release
v0.5.0
281c391

Changelog for v0.5.0

Features:

  • [Feature]: Support Spark 3.3 for Mixed format #261
  • [Feature]: Support Spark 3.2 for Mixed format #1383
  • [Feature]: Support MOR with Flink Engine in runtime batch mode for Mixed format #5
  • [Feature]: Support Iceberg on S3 or other non-hadoop storage system. #1476
  • [Feature]: Add self-optimizing detail in optimized tab of table  #1535
  • [Feature]: Support to manage optimizer groups in dashboard #1537
  • [Feature]: Remove the Independent DeleteFiles for the Iceberg Format Table #1628
  • [Feature]: Support lookup join on Mixed format tables with Flink #1322
  • [Subtask]: Make AMS as an Iceberg Catalog provider via implement RestCatalogAPI #1339

Imporvements:

  • [Improvement]: AMS module refactoring in 0.5 #1372
  • [Improvement]: Add new task allocation rules to make the number of concurrency and read cost more balanced #1311
  • [Improvement]: Improve query speed for Mixed tables in Spark #1349
  • [Spark][Improvement]: Add scala code style check for spark module #1059
  • [Improvement][Spark]: Speed up commit process for Mixed Hive format tables #1350
  • [Subtask]: Introdue the concept of the InternalCatalog and ExternalCatalog #1544
  • [Improvement]: Optimize the description of Spark CreateTableLike #1340
  • [Improvement]: Improve the project documentation #1510

BugFixs:

  • [Bug]: The position-delete written by iceberg directly through the base table cannot take effect when read by Arctic #1347
  • [Bug]: When AMS is deployed HA, use Kerberos to access non-Kerberos zookeeper will throw an exception #1346
  • [Bug]: High CPU occupancy of AMS #1332
  • [Bug]: jacoco-maven-plugin report EOFException in Flink Module CI #1330
  • [Bug]:[Spark] select failed after update on keyed table for kerberos auth failed. #488
  • [Bug]: The column ‘_transaction_id’ and '_change_action' will be null when querying change table with spark #1385
  • [Bug]: Hive function can't be used when using ArcticSparkSessionCatalog under spark 3.3 #1397
  • [Bug]: Find duplicate records when enable rocksdb map #1751
  • [Bug]: when partition value contains spaces, optimize can't process correctly #1653
  • [Bug]: Build failed when change hadoop version to 3.2.1 #1646
Assets 11
Loading
0 Join discussion