Skip to content
This repository has been archived by the owner on Nov 20, 2023. It is now read-only.

carrotsearch/langid-java

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

langid-java
-----------

A somewhat changed Java port of langid.py (https://github.com/saffsd/langid.py)

Usage
-----

Fetch a JAR from Maven repositories (or compile it yourself). Then check out
the javadocs of ILangIdClassifier and LangIdV3.

Memory and Speed
----------------

Don't get fooled by the size of the JAR archive. The data model is LZMA 
compressed and will take about ~10MB of RAM. Speed wise this implementation
should be faster than anything else out there; if you have very large texts
you can sub-sample, append those fragments and classify without processing
the entire content.

Quality
-------

At the moment the detection/ performance quality is identical to langid.py
(the model and the math code is identical, even if written in a slightly
different way to speed up computations in Java).

About

Java port of langid.py (language identifier)

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages