Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

re-pull-request allow tokens and hotwords be loaded from buffered string driectly #1339

Merged
merged 21 commits into from
Sep 13, 2024
Merged

re-pull-request allow tokens and hotwords be loaded from buffered string driectly #1339

merged 21 commits into from
Sep 13, 2024

Commits on Sep 8, 2024

  1. Allowing tokens and hotwords be initialized from buffered strings (ra… 

    …ther than from external files)

currently, only supported OnlineTransducer models
    xiao committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    610ab7e View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. add workflow c-api-test-loading-tokens-hotwords-from-memory.yaml, for… 

    … test streaming models loading tokens and hotworks from buffered strings directly
    xiao committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    ed4b2b5 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Update sherpa-onnx/csrc/online-model-config.h 

    Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 10, 2024
    Configuration menu
    Copy the full SHA
    7968192 View commit details
    Browse the repository at this point in the history

  2. Update sherpa-onnx/csrc/online-model-config.h 

    Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 10, 2024
    Configuration menu
    Copy the full SHA
    42b9a92 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'k2-fsa:master' into master

    @shawl336
    shawl336 authored Sep 10, 2024
    Configuration menu
    Copy the full SHA
    5b3e6c4 View commit details
    Browse the repository at this point in the history

  4. 1. added token_buf_size and hotwords_buf_size to avoid memory overflow 

    2. rewrite some code to make it more readable
3. updated the c-api-examples/streaming-zipformer-buffered-tokens-hotwords-c-api.c
    xiao committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    07a8cd7 View commit details
    Browse the repository at this point in the history

  5. 1. updated c-api-test-loading-tokens-hotwords-from-memory, tokens and… 

    … hotwords are read from files before being filled into buffers

2. updated the test yaml
    xiao committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    f309e1f View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. corrected const *hotwords_buf const* tokens_buf to const char*

    xiao committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    e5dd86e View commit details
    Browse the repository at this point in the history

  2. formated long lines with clang-format

    xiao committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    1254023 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. applied clang-format to all modified files

    xiao committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    da14d22 View commit details
    Browse the repository at this point in the history

  2. Update c-api-examples/streaming-zipformer-buffered-tokens-hotwords-c-… 

    …api.c

Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    ecaba64 View commit details
    Browse the repository at this point in the history

  3. Update c-api-examples/streaming-zipformer-buffered-tokens-hotwords-c-… 

    …api.c

Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    c212f71 View commit details
    Browse the repository at this point in the history

  4. Update sherpa-onnx/c-api/c-api.cc 

    Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    12572b4 View commit details
    Browse the repository at this point in the history

  5. Update c-api-examples/streaming-zipformer-buffered-tokens-hotwords-c-… 

    …api.c

Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    058696b View commit details
    Browse the repository at this point in the history

  6. Update sherpa-onnx/csrc/online-recognizer-transducer-impl.h 

    Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    08d59ff View commit details
    Browse the repository at this point in the history

  7. Update sherpa-onnx/csrc/online-recognizer.h 

    Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    353b025 View commit details
    Browse the repository at this point in the history

  8. Update sherpa-onnx/csrc/online-recognizer-transducer-impl.h 

    Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    71cd918 View commit details
    Browse the repository at this point in the history

  9. Update sherpa-onnx/csrc/online-recognizer-transducer-nemo-impl.h 

    Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    51b6cc6 View commit details
    Browse the repository at this point in the history

  10. Update sherpa-onnx/csrc/online-recognizer-transducer-nemo-impl.h 

    Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    719290b View commit details
    Browse the repository at this point in the history

  11. for the file "streaming-zipformer-buffered-tokens-hotwords-c-api.c" 

    1. tokens and hotwords buffers are freed once the recognizier creation is called
2. used ReadFile instead of read_file

3. fixed some other minor suggestions
    xiao committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    98fe5e1 View commit details
    Browse the repository at this point in the history

  12. Update sherpa-onnx/csrc/online-model-config.cc 

    Co-authored-by: Fangjun Kuang <[email protected]>
    @shawl336 @csukuangfj
    shawl336 and csukuangfj authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1cc767a View commit details
    Browse the repository at this point in the history