I had a message saying that I have too much content to use the More Like This feature of Apache Solr. I have now more than 500 000 nodes, hence using that feature would be extremely useful with such a massive amount of content...

It says that this limit is for perforamance reasons, but I was wondering what kind of system would be required to run this feature on say a million nodes?

Would you recommend trying it out, or it's not even worth it since it would completely break the site?

Thanks,
Patchak

Comments

robertdouglass’s picture

robertdouglass commented

Is this the message you saw?

'You have more than 20000 documents, so term frequencies are being omitted for performance reasons.

  $limit = variable_get('apachesolr_luke_limit', 20000);
  if (isset($data->index->numDocs) && $data->index->numDocs > $limit) {
    $output .= '<p>' . t('You have more than @limit documents, so term frequencies are being omitted for performance reasons.', array('@limit' => $limit)) . "</p>\n";
    $not_found = t('<em>Omitted</em>');
  }

If so then it doesn't mean you can't use the more like this feature. It just means that the module isn't collecting certain statistics for display about your terms.

socki’s picture

socki commented

I just downloaded the latest RC and have noticed that More like this is not currently included. Has it been decided to drop it? Will it eventually make it in? What is the status... maybe I can help push it along?

pwolanin’s picture

pwolanin commented
Status: Active » Fixed

the MLT functionality was incorporated into the main framework module - it is still available.

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.