4. Choosing languages and tools

In absolute terms, any programming language will do (Ruby, Python, R.). What's more, open source software tools, both free and fee-based, are also plentiful.

Among the projects, we can cite three examples.

• Lemur The Lemur project develops search engines, toolbars, text analysis tools, data resources to support research, the development of information retrieval and text mining software.

• Lucene Apache Lucene is a full-text search engine library written entirely in Java. It is a suitable technology for almost any application that requires full-text search, especially if it is multi-platform. Apache Lucene is an open source project available as...