Hello, I use leech on a drupal 5.1 site, has been running for 4 days and it has generated a lot of duplicates, as can be seen here for the word logiciel :

http://www.guide-depannage-informatique.com/tags/logiciel/logiciel.html

It creates multiples vocabulary entries for the same word and tag the same content with those multiple terms:
http://www.guide-depannage-informatique.com/tags/logiciel/logiciel.html-1
http://www.guide-depannage-informatique.com/tags/logiciel/logiciel.html-2
http://www.guide-depannage-informatique.com/tags/logiciel/logiciel.html-3
http://www.guide-depannage-informatique.com/tags/logiciel/logiciel.html-etc..

Could you give me a hint as to what is happening here?

Cheers,
James

Comments

alliax’s picture

alliax commented

I have been deleting those entries and trying harder to find anything to od with multiple entries for a same term in categories.

sorry but you guys are too slow to reply

aron novak’s picture

aron novak
Primary language Hungarian
Location Hungary, Budapest
commented

I commited a fix into the CVS, please see try out this file:http://cvs.drupal.org/viewcvs/drupal/contributions/modules/leech/leech_y...
Let me know if it solves the problem or not.
Thanks!

aron novak’s picture

aron novak
Primary language Hungarian
Location Hungary, Budapest
commented
Assigned: Unassigned » aron novak
Status: Active » Needs review

The link to the updated file (leech_yahoo_terms.module): http://cvs.drupal.org/viewcvs/drupal/contributions/modules/leech/leech_y...

alliax’s picture

alliax commented

I've been testing it for a couple of days and if there is a problem I'll report here.
But as you might know or not, there are more problems (error message when processing leech datas) with leech than just tags duplicate, especially on the sites where I use it (since only a couple of weeks)

Thank you for your patch.

aron novak’s picture

aron novak
Primary language Hungarian
Location Hungary, Budapest
commented

"error message when processing leech datas"
Can you share these messages here? I haven't experienced such a confusing behaviour of leech 5.x.

lunas’s picture

lunas commented

I just realized this was happening on my site and I've had Leech installed for a few weeks. As a result I have a huge vocabulary full of duplicate terms. I've installed this new module, hopefully that fixes it. Any suggestions as to how I can go about cleaning up the vocabulary. I don't want to delete the nodes associated with the terms, but I do want to delete the extra terms. From the database, I see that nid refers to a tid that refers to a vid. If I delete all the duplicate tids from the term_data table, I could end up with nids that refer to non-existant tids. What kind of problems would that cause? Using Drupal to manually delete each duplicate term will not only take me a lifetime, but will also delete the node associated with it. Any suggestions?

aron novak’s picture

aron novak
Primary language Hungarian
Location Hungary, Budapest
commented
Status: Needs review » Fixed

Thanks for let me know that the change works ok!
My advice:
At sql prompt:
delete from node_term;
delete term_node;

If you do not want to purge all the things from these tables, compose an SQL query like this:
delete from term_data where name LIKE '%stuff%';
And before that a joined query what remove the unneeded things from term_node.

term_node : assign terms to nodes
term_data : each terms has a line at this table

Anonymous’s picture

(not verified) commented
Status: Fixed » Closed (fixed)