Project:Apache Solr Search Integration
Version:5.x-2.x-dev
Component:Code
Category:feature request
Priority:critical
Assigned:claudiu.cristea
Status:closed (fixed)

Issue Summary

In response to some solr server setups that throttle operations, there may be a need for some people to limit the number of delete operations that are sent to the server on cron runs.

AttachmentSizeStatusTest resultOperations
apachesolr.nodeDeletionFix.patch1.36 KBIgnored: Check issue status.NoneNone

Comments

#1

I don't really like this implementation for the general public. Is it proven that anyone needs this protection on normal servers, or just servers that have throttling? Also seems like an odd thing to make a configuration for (not that this patch has configuration), so I wouldn't want to go down that route.

#2

Version:6.x-2.x-dev» 6.x-1.x-dev
Priority:normal» critical

Let's find a reasonable approach for this asap - it continues to be a problem.

I'm inclined to pt this patch in for the next RC if we don't have something better

#3

Here's a mostly untested patch that groups Solr deletes by 500 at a time rather than sending one delete query per node.

This should give better performance in almost all cases, and be more compatible with a limits on update queries.

AttachmentSizeStatusTest resultOperations
mass-delete-561082-3.patch6.18 KBIgnored: Check issue status.NoneNone

#4

That patch isn't really working and doesn't provide a useful count of nodes to be deleted. Here's a better one.

AttachmentSizeStatusTest resultOperations
throttle-561082-4.patch7.99 KBIgnored: Check issue status.NoneNone

#5

With update to README

AttachmentSizeStatusTest resultOperations
throttle-561082-5.patch7.99 KBIgnored: Check issue status.NoneNone

#6

oops - missed README changes

AttachmentSizeStatusTest resultOperations
throttle-561082-6.patch8.62 KBIgnored: Check issue status.NoneNone

#7

Title:Throttle deletes on cron run » consolidate Solr queries on cron run

minor tweak - stop sending updates on cron if one fails.

AttachmentSizeStatusTest resultOperations
throttle-561082-7.patch8.76 KBIgnored: Check issue status.NoneNone

#8

Version:6.x-1.x-dev» 6.x-2.x-dev
Status:needs review» patch (to be ported)

committed to 6.x-1.x

#9

Version:6.x-2.x-dev» 5.x-2.x-dev

And to DRUPAL-6--2

#10

Assigned to:Anonymous» claudiu.cristea

The patch for DRUPAL-5--2.

AttachmentSizeStatusTest resultOperations
throttle-561082-D5.patch16.99 KBIgnored: Check issue status.NoneNone

#11

Status:patch (to be ported)» fixed

Fixed in #278744.

#12

Status:fixed» closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.