Token scores are not considered in the indexing process

Problem/Motivation

Token scores (= token boosts?) are not considered in the indexing process. For example, the token boosts which are calculated by the “HTML Filter” processor are not reflected in the index.

Proposed resolution

See the patch that I will attach in a minute: using token scores has probably been forgotten in the relevant search service class.

Remaining tasks

Someone with more insight into the module should review my patch to make sure I really understood the problem correctly. Perhaps some kind of unit test would be useful, too.

User interface changes

N/A

API changes

There are no changes to the API. Perhaps module users should update their search indexes after this change, though.