We have found a small bug related to the XMLPipe generation of delta indexes.

A special attribute main_index_id is stored with documents on each index. This is used by the delta index generation process to build the list of NIDs that need to be re-indexed for each main index. This attribute is stored as an integer, and -1 is used for the ID of the delta index itself, so it does not conflict with the IDs used for main indexes.

The problem comes when this -1 is converted to 4294967295 on 64 bit architectures. I guess something on Sphinx internals has changed too. Then, the delta index generator tries to re-index NID that exist on previous deltas, and that's what's cauing the dup id warning.

Well, so we have to find a method to manage this delta index ID, so the XMLPipe generator is not confused anymore.

Comments

markus_petrux’s picture

markus_petrux commented
Status: Active » Fixed

Just applied a patch that should fix this issue.

- http://drupalcode.org/project/sphinxsearch.git/commit/10b5c86

Support for bigint has been added to the module, and the 'main_index_id' uses that.

Those who may find this issue should try the patch or install the next snapshot (or release) as soon as it is available, AND... also, rebuild the delta index. No need to rebuild all main indexes.

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.