Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BleiCorpus with an index #1

Closed
wants to merge 1 commit into from
Closed

BleiCorpus with an index #1

wants to merge 1 commit into from

Conversation

Dieterbe
Copy link
Contributor

No description provided.

Add corpus which extends BleiCorpus with an index
85e5b56 
The index can be used for fast retrieval of specific documents,
and for fast responses to len() queries
@piskvorky
Copy link
Owner

I'll think about how to do this more generally, for any *Corpus.

Just have to find a way to do it without breaking things or making them too complicated...

@piskvorky
Copy link
Owner

Ok, i wrote a draft of the functionality: i added a new class, corpora.IndexedCorpus. It's in the indexedcorpus branch.

I'll make every file-based corpus format inherit from IndexedCorpus, plus add the docbyoffset() method. That should be enough to index every corpus format, including a convenient save/load, unless i missed something.

@Dieterbe
Copy link
Contributor Author

your method is better indeed :) I'm removing this commit again from my branches

piskvorky pushed a commit that referenced this pull request Aug 12, 2012
@strongh
Merge pull request #1 from piskvorky/hashdictionary
42b6c44 
Hashdictionary
piskvorky pushed a commit that referenced this pull request Sep 7, 2012
@buma
Merge pull request #1 from piskvorky/buma
bb1124a 
make len(Dictionary.from_corpus) consistent with its content
piskvorky pushed a commit that referenced this pull request Oct 27, 2013
@zygmuntz
Merge pull request #1 from piskvorky/zygmuntz
8a507e3 
CSV clean up
piskvorky pushed a commit that referenced this pull request Apr 23, 2014
Merge pull request #1 from piskvorky/cythonize_setup
a9f24b5 
various fixes
piskvorky pushed a commit that referenced this pull request Jun 4, 2014
@gojomo
Merge pull request #1 from piskvorky/develop
4c92610 
catchup develop
piskvorky pushed a commit that referenced this pull request Sep 12, 2014
@ziky90
Merge pull request #1 from piskvorky/ziky90-develop
83dda8d 
fix bugs in state reset and state init
piskvorky pushed a commit that referenced this pull request Sep 17, 2014
@Arttii
Merge pull request #1 from piskvorky/dtm-interface
7b7fa08 
minor doc&format fixes in DTM model
piskvorky pushed a commit that referenced this pull request Oct 5, 2014
@temerick
Merge pull request #1 from ccri/doc2vec
ca950ba 
Doc2vec
@danwiesenthal danwiesenthal mentioned this pull request Oct 13, 2014
Closed
@lerela lerela mentioned this pull request Oct 16, 2014
Merged
@thomaskern thomaskern mentioned this pull request May 13, 2015
Closed
This was referenced Jul 1, 2015
Closed
Closed
Open
piskvorky pushed a commit that referenced this pull request Jul 5, 2015
@fbarrios
Merge pull request #1 from ziky90/summarization_fixes
fad4a10 
Consistency with gensim and pep 8
@gojomo gojomo mentioned this pull request Oct 18, 2015
Closed
piskvorky pushed a commit that referenced this pull request Nov 19, 2015
@olavurmortensen
Merge pull request #1 from piskvorky/batch_sentences
14888eb 
Simplify job loop + merge latest gensim
tmylk pushed a commit that referenced this pull request Mar 23, 2016
@manasRK
Merge pull request #1 from piskvorky/manas
4f4f6b6 
code style fixes to CLI scripts
tmylk pushed a commit that referenced this pull request Apr 3, 2016
@zer0n
Merge pull request #1 from tmylk/patch-1
334982a 
Added Changelog
@piskvorky piskvorky mentioned this pull request May 3, 2016
Closed
@hiral2cool hiral2cool mentioned this pull request Oct 14, 2016
Closed
@robguinness robguinness mentioned this pull request Jan 7, 2019
Closed
@dnabanita7 dnabanita7 mentioned this pull request Jan 22, 2019
Closed
@maplejia maplejia mentioned this pull request Jun 14, 2019
Closed
@aless80 aless80 mentioned this pull request Aug 9, 2019
Closed
@gojomo gojomo mentioned this pull request Jul 24, 2020
Closed
piskvorky pushed a commit that referenced this pull request Jul 26, 2020
@xh2
Merge pull request #1 from xh2/patch-1
7791b74 
Make docs clearer on `alpha` parameter in LDA model
@aristila aristila mentioned this pull request Sep 21, 2021
Closed
@lelandbatey lelandbatey mentioned this pull request Oct 30, 2021
Closed
piskvorky pushed a commit that referenced this pull request May 10, 2023
@ERijck
Merge pull request #1 from ERijck/pylint_fixes
9132451 
Pylint fixes
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Dieterbe @piskvorky