Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use FastSS for fast kNN over Levenshtein distance #3146

Merged
merged 27 commits into from
May 20, 2021
Merged

Use FastSS for fast kNN over Levenshtein distance #3146

merged 27 commits into from
May 20, 2021

Commits on May 15, 2021

  1. Use VP-Tree for fast kNN over Levenshtein distance

    @Witiko
    Witiko committed May 15, 2021
    Configuration menu
    Copy the full SHA
    af5833d View commit details
    Browse the repository at this point in the history

Commits on May 16, 2021

  1. Use DAWG for fast approximate kNN over Levenshtein distance

    @Witiko
    Witiko committed May 16, 2021
    1 Configuration menu
    Copy the full SHA
    fb98a43 View commit details
    Browse the repository at this point in the history

  2. Remove itertools import

    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    80ec65f View commit details
    Browse the repository at this point in the history

  3. Improve unit tests for the levenshtein module

    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    40b96bc View commit details
    Browse the repository at this point in the history

  4. Implement a back-off strategy for max_distance

    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    48cb664 View commit details
    Browse the repository at this point in the history

  5. Apply suggestions from code review 

    Co-authored-by: Radim Řehůřek <[email protected]>
    @Witiko @piskvorky
    Witiko and piskvorky committed May 16, 2021
    Configuration menu
    Copy the full SHA
    ba36d01 View commit details
    Browse the repository at this point in the history

  6. Replace DAWG with TinyFastSS

    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    567b0a4 View commit details
    Browse the repository at this point in the history

  7. clean up FastSS

    @piskvorky
    piskvorky committed May 16, 2021
    Configuration menu
    Copy the full SHA
    b675507 View commit details
    Browse the repository at this point in the history

  8. Return only similarities greater than zero

    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    6c2d033 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'levenshtein-ball-tree' of github.com:Witiko/gensim into… 

    … levenshtein-ball-tree
    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    80b99d0 View commit details
    Browse the repository at this point in the history

  10. reintroduce max_dist to FastSS query

    @piskvorky
    piskvorky committed May 16, 2021
    Configuration menu
    Copy the full SHA
    362f458 View commit details
    Browse the repository at this point in the history

  11. Silence flake8 about fastss

    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    22a0221 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'levenshtein-ball-tree' of github.com:Witiko/gensim into… 

    … levenshtein-ball-tree
    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    6350a22 View commit details
    Browse the repository at this point in the history

  13. Suggest max_distance <= 2

    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    e2e1d9f View commit details
    Browse the repository at this point in the history

  14. Suggest max_distance < 3

    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    80cdb7e View commit details
    Browse the repository at this point in the history

  15. Eagerly filter out zero similarities

    @Witiko
    Witiko committed May 16, 2021
    Configuration menu
    Copy the full SHA
    c91bda5 View commit details
    Browse the repository at this point in the history

  16. clarify + add comments

    @piskvorky
    piskvorky committed May 16, 2021
    Configuration menu
    Copy the full SHA
    18fe2a2 View commit details
    Browse the repository at this point in the history

  17. Merge branch 'levenshtein-ball-tree' of github.com:Witiko/gensim into… 

    … levenshtein-ball-tree
    @piskvorky
    piskvorky committed May 16, 2021
    Configuration menu
    Copy the full SHA
    9e614c0 View commit details
    Browse the repository at this point in the history

  18. update docs

    @piskvorky
    piskvorky committed May 16, 2021
    Configuration menu
    Copy the full SHA
    da501b5 View commit details
    Browse the repository at this point in the history

  19. minor doc fixes

    @piskvorky
    piskvorky committed May 16, 2021
    Configuration menu
    Copy the full SHA
    de2ec13 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2021

  1. clean up FastSS & logging

    @piskvorky
    piskvorky committed May 17, 2021
    Configuration menu
    Copy the full SHA
    6c4abc5 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2021

  1. cythonize FastSS

    @piskvorky
    piskvorky committed May 18, 2021
    Configuration menu
    Copy the full SHA
    05284d1 View commit details
    Browse the repository at this point in the history

  2. remove dead code

    @piskvorky
    piskvorky committed May 18, 2021
    Configuration menu
    Copy the full SHA
    9381965 View commit details
    Browse the repository at this point in the history

  3. update Cython to 0.29.23

    @piskvorky
    piskvorky committed May 18, 2021
    Configuration menu
    Copy the full SHA
    7054f90 View commit details
    Browse the repository at this point in the history

  4. make max_distance=2 the default in LevenshteinSimilarityIndex

    @piskvorky
    piskvorky committed May 18, 2021
    Configuration menu
    Copy the full SHA
    ae91204 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2021

  1. FastSS cleanup

    @piskvorky
    piskvorky committed May 19, 2021
    Configuration menu
    Copy the full SHA
    86e8a25 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2021

  1. rewrite the editdist function (Levenshtein) in C

    @piskvorky
    piskvorky committed May 20, 2021
    Configuration menu
    Copy the full SHA
    7655d75 View commit details
    Browse the repository at this point in the history