Skip to content

RoDmitry/langram_models

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Langram models

You can download this repository, and remove some models ngrams locally (so that the final binary would be lighter), but remember that an ngram model len must be the same for all of the languages of the script (Hans, Hant, Kore, Jpan must be considered as the same script).

git clone https://github.com/RoDmitry/langram_models.git
git clone https://github.com/RoDmitry/langram.git
cd ./langram_models
# for big-endian targets: in Cargo.toml enable `rkyv::big_endian` feature
cargo run --release

Sources

Trained on OpenLID (201 languages).

About

Langram models

Resources

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT

Stars

Watchers

Forks

Languages