HeLI-OTS (off-the-shelf) is a language identifier with language models for 220 languages. The program will read the <infile> and classify the language of each line as one of the 220 languages it knows and writes the results, one ISO 639-3 code per line, into file <outfile>. It can identify c. 600-1700 sentences (averaging c. 150 characters) per second from a file using one core and around 4,3 gigabytes of memory on a modern laptop.
Producing and publishing this software has been partly supported by The Finnish Research Impact Foundation Tandem Industry Academia -funding in cooperation with Lingsoft, by the Kone Foundation, by the European Union – NextGenerationEU instrument, and by the Research Council of Finland under grant number 358720 (FIN-CLARIAH – Developing a Common RI for CLARIAH Finland).
Read more about HeLI–OTS, Off-the-shelf Language Identifier for Text
| Latest versions/subcorpora: | |
| HeLI-OTS 2.0 Metadata and license Attribution instructions |
Open the website |
| Look for all versions in META-SHARE |
Detailed information on the content of each version, user rights and licenses can be found from it’s specific metadata record in META-SHARE.
Links:
HeLI-OTS language identifier on hub.docker.com
Lingsoft
Finnish Research Impact Foundation
This resource group page has a Persistent Identifier: http://urn.fi/urn:nbn:fi:lb-2022011801
