-
Notifications
You must be signed in to change notification settings - Fork 4
GPU CUDA implementation of CBOW word2vec. Which carefully checked. 22x faster compare to single thread CPU.
License
cudabigdata/word2vec_cuda
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
CUDA version of word2vec This CUDA version is carefully checked for correctness. Achieve about 2.8X faster than CPU-with 8 threads version. (22X faster compare to CPU single thread). Tools for computing distributed representtion of words ------------------------------------------------------ We provide an implementation of the Continuous Bag-of-Words (CBOW) and the Skip-gram model (SG), as well as several demo scripts. Given a text corpus, the word2vec tool learns a vector for every word in the vocabulary using the Continuous Bag-of-Words or the Skip-Gram neural network architectures. The user should to specify the following: - desired vector dimensionality - the size of the context window for either the Skip-Gram or the Continuous Bag-of-Words model - training algorithm: hierarchical softmax and / or negative sampling - threshold for downsampling the frequent words - number of threads to use - the format of the output word vector file (text or binary) Usually, the other hyper-parameters such as the learning rate do not need to be tuned for different training sets. The script demo-word.sh downloads a small (100MB) text corpus from the web, and trains a small word vector model. After the training is finished, the user can interactively explore the similarity of the words. More information about the scripts is provided at https://code.google.com/p/word2vec/
About
GPU CUDA implementation of CBOW word2vec. Which carefully checked. 22x faster compare to single thread CPU.
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published