Automatic language identification of written texts

ABSTRACT

Language identification is one of the search keys of most widespread use in the Internet. This article describes efficient and easily extensible solutions to the problem of identifying the language of written texts based on closed grammatical classes. An identification tool was developed for recognizing texts written in Portuguese, Spanish, French and English.

REFERENCES

• 1: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 2: Camelo, H. A. L., Lins, R. D. Uma Ferramenta de auxílio à Tradução Inglês-Português, in Actas do IV Encontro para o Processamento Computacional da Língua Portuguesa Escrita e Falada, pp 43--52, Évora, Portugal, 1999.
• 3: Camelo, H. A. L.; Lins, R. D. A proxy architecture for translating web pages, in Proceedings of XVIII SBRC, pp. 15--20, Belo Horizonte (Brazil), SBC, 2000 (in portuguese).
• 4: Gazdar, G., Mellish C.: Natural Language Processing in PROLOG - An Introduction to Computational Linguistics Addison-Wesley, Reading, 1989.
• 5: Altavista Web Search Http://www.altavista.com/
• 6: Google Web Search http://www.google.com/
• 7: Projeto Tradutor http://www.cin.ufpe.br/~tradutor/

INDEX TERMS

Keywords:
document analysis, language identification, text features