Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use fulltext corpus in MLLM tests which is much faster #570

Merged
merged 3 commits into from
Feb 11, 2022

Conversation

osma
Copy link
Member

@osma osma commented Feb 11, 2022

I noticed that the unit tests weren't making use of the small fulltext document corpus included in the test suite (tests/corpora/archaeology/fulltext/). In this PR, I've added a fixture to use it and switched the MLLM tests to use it instead of document_corpus. This speeds up the MLLM tests by a lot (24s -> 2s on my laptop).

@osma osma added this to the 0.57 milestone Feb 11, 2022
@osma osma self-assigned this Feb 11, 2022
@codecov
Copy link

codecov bot commented Feb 11, 2022

Codecov Report

Merging #570 (90f1537) into master (5948dee) will increase coverage by 0.00%.
The diff coverage is 100.00%.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #570   +/-   ##
=======================================
  Coverage   99.47%   99.47%           
=======================================
  Files          84       84           
  Lines        5565     5568    +3     
=======================================
+ Hits         5536     5539    +3     
  Misses         29       29           
Impacted Files Coverage Δ
annif/lexical/mllm.py 100.00% <ø> (ø)
annif/parallel.py 100.00% <ø> (ø)
tests/conftest.py 100.00% <100.00%> (ø)
tests/test_backend_mllm.py 100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5948dee...90f1537. Read the comment docs.

@sonarcloud
Copy link

sonarcloud bot commented Feb 11, 2022

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@osma osma merged commit 7f4fc02 into master Feb 11, 2022
@osma osma deleted the fix-tests-use-fulltext-corpus branch February 11, 2022 13:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant