Extending term candidate scoring

Based on the framework of Apache Solr, term candidate extraction and frequency statistics are two separate process. This allows us to easily calculate association measures for arbitarary size n-gram candidate terms without requiring to rely on contingency tables.

<TO_BE_CONTINUED>