The multilingual analyzer

Multilingual analyzer was introduced in the first Crawl-Anywhere release. This first version of the anlyzer works with both Solr 1.4.1 and Solr 3.x.

This new version available Crawl-Anywhere 2.1.0 allows adjustable configuration for each language by using the solrconfig.xml file syntax.

Why a multilingual analyzer ?

[to complete]

How to configure it ?

[to complete]

If my content is only in one language or a couple of languages ?

[to complete]

How to detect new languages ?

Language detection uses (but not only) statistical algorithm based on language profile file. These profile files are located in config/profiles directory.

In order to more languages, it is possible to build new profile files with tools located in tools/langdetect directory. Read the readme.txt file in order to learn how use these tools.