Choosing languages and tools
Scraping, methods and tools for business intelligence

In absolute terms, any programming language will do (Ruby, Python, R.). What's more, open source software tools, both free and fee-based, are also plentiful.

Among the projects, we can cite three examples.

• Lemur The Lemur project develops search engines, toolbars, text analysis tools, data resources to support research, the development of information retrieval and text mining software.

• Lucene Apache Lucene is a full-text search engine library written entirely in Java. It is a suitable technology for almost any application that requires full-text search, especially if it is multi-platform. Apache Lucene is an open source project available as...