Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve optimal parser performance on small data #2771

Merged
merged 16 commits into from
Sep 14, 2021
Merged

Commits on Sep 3, 2021

  1. removed pretty-print of sizes in benchmark

    This is less appropriate for this mode :
    benchmark is about accuracy,
    it's important to read the exact values.
    Cyan4973 committed Sep 3, 2021
    Configuration menu
    Copy the full SHA
    eab6922 View commit details
    Browse the repository at this point in the history
  2. Disable console notification by default within the library

    As a library, the default shouldn't be to write anything on console.
    `cover` and `fastcover` have a `g_displayLevel` variable to control this behavior.
    It's now set to 0 (no display) by default.
    Setting notification to a higher level should be an explicit operation by a console application.
    Cyan4973 committed Sep 3, 2021
    Configuration menu
    Copy the full SHA
    f0fc8cb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    27a8bbe View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2021

  1. Configuration menu
    Copy the full SHA
    23a9368 View commit details
    Browse the repository at this point in the history
  2. new statistics update policy

    small general compression ratio improvement for btopt+ strategies/
    Cyan4973 committed Sep 4, 2021
    Configuration menu
    Copy the full SHA
    08ceda3 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2021

  1. updated regression tests

    Cyan4973 committed Sep 7, 2021
    Configuration menu
    Copy the full SHA
    b096a5c View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2021

  1. removed frequency booster for stat initialization of btultra2

    used to be necessary to counter-balance the fixed-weight frequency update
    which has been recently changed for an adaptive rate (targeting stable starting frequency stats).
    Cyan4973 committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    42a3ed7 View commit details
    Browse the repository at this point in the history
  2. change update rate to 11/10/10/10

    better for larger blocks,
    very small inefficiency on small block.
    Cyan4973 committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    ef78611 View commit details
    Browse the repository at this point in the history
  3. change update rate to 12/11/11/11

    better for large files, and sources with relatively "stable" entropy,
    like silesia.tar.
    slightly worse for files with rapidly changing entropy,
    like Calgary.tar/.
    
    Updated small files tests in fuzzer
    Cyan4973 committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    7fce9a4 View commit details
    Browse the repository at this point in the history
  4. update regression tests

    Cyan4973 committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    4f0b1b9 View commit details
    Browse the repository at this point in the history
  5. use ZSTD_memcpy() for better portability

    notably within kernel space
    Cyan4973 committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    b7f46eb View commit details
    Browse the repository at this point in the history
  6. make automated-benchmarking faster

    by employing parallel compilation of object files.
    Cyan4973 committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    5449ede View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2021

  1. fix automated_benchmarking

    make it able to process text output sent into either stdout or stderr
    Cyan4973 committed Sep 12, 2021
    Configuration menu
    Copy the full SHA
    640c5b1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f58e63b View commit details
    Browse the repository at this point in the history
  3. updated regression tests

    Cyan4973 committed Sep 12, 2021
    Configuration menu
    Copy the full SHA
    b6b2855 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2021

  1. Configuration menu
    Copy the full SHA
    fd94b9d View commit details
    Browse the repository at this point in the history