Digests send all posts

marczak - September 25, 2006 - 19:28
Project:Organic groups list manager
Version:4.7.x-1.x-dev
Component:Code
Category:bug report
Priority:critical
Assigned:Unassigned
Status:closed
Description

Og2list digests send out *all* posts in a forum, not just the ones since last digest. So, in general, you receive a ton of posts, most of which you have already seen.

#1

Amazon - October 5, 2006 - 16:01
Version:HEAD» 4.7.x-1.x-dev
Priority:normal» critical

Confirming that mail-out.pl is in fact sending every mail everytime not just the new stuff since the last sending.

I confirmed a post from the 28th is being send every day. Moving to critical.

Kieran

#2

Amazon - October 15, 2006 - 23:36

What tables are necessary for a lightweight debugging environment? OG list manager takes a while to set-up and I'd like to quickly create an outbound mail only testing environment.

| og |
| og2list_groups |
| og2list_incoming_content |
| og2list_incoming_groups |
| og2list_msgid |
| og2list_outgoing_arguments |
| og2list_outgoing_content |
| og2list_outgoing_recipients |
| og2list_references |
| og_term |
| og_uid |
Node

Any other necessary tables?

#3

galapas - October 20, 2006 - 00:31

The code applied to the digest block of mail-out.pl was seemingly borrowed from single mails and was expecting a single mid instead of an array of mids.

I've changed the way the mids are passed to the various send methods, and under the assumption that there will be multiple mids for a given recipient, have changed the way the array of mids are parsed within each of the send methods.

I tested using only sendmail as I've not the ability to test other send methods or single mails.

Feedback is, clearly, greatly appreciated as I'm breaking new ground and trying to have an immediate positive effect using a limited test suite, as well as minimal understanding of the data model.

AttachmentSize
mail-out.85964.patch 2.75 KB

#4

Amazon - October 20, 2006 - 16:08

I tested the latest patch, one I got via email and it is now working as expected.

We probably want to revisit the testing methods to ensure this patch scales. In particular we need to ensure that group subscribers have digest selected.

#5

Amazon - October 21, 2006 - 15:56

We are currently testing the digest patch for performance. We are going to test with 10 000 users and 100 mails in a group. 5000 of the group members will use digests.

Kieran

#6

Amazon - October 21, 2006 - 16:52

Fixed hardcoded DB.

AttachmentSize
mail-out.85964-1.patch 3.64 KB

#7

galapas - October 25, 2006 - 23:22

Changes have been made to mail-out.pl to address the following:

a) Create the recipient list once per digest based on the unique recipients in the outgoing_recipients table for the nid
b) Do not rely on the combination of mid and recipient address as the means of flushing the outgoing_recipients table.
c) Clearing recipients is now done based on digests. Too, I've removed the logic where digest mids are cleared in conjunction to a 'send_' method.

d) Lastly, all changes have been applied to the do_digest block and will therefore can have no ill effect on legacy single mail behavior.

AttachmentSize
mail-out.85964-2.patch 3.88 KB

#8

Amazon - October 28, 2006 - 06:06

Could you detail all the testing steps, for each of the test cases? It sounded like there were some possibilities that users switching between direct mail and digests could lose mail.

Have you done any performance testing to make sure you algorithms scale?

#9

killes@www.drop.org - October 30, 2006 - 23:35

people could get some mails twice, but not lose any. if they change theor mode to digest after the last digest was sent but already new mail was sent to the group they will have receieved that mail already as single mails and will get it again as part of their digest.

#10

Gerhard Killesreiter - November 3, 2006 - 08:39
Status:active» fixed

applied second patch.

#11

Amazon - November 10, 2006 - 07:34

Waiting for some test results from others before closing.

#12

Anonymous - November 24, 2006 - 07:45
Status:fixed» closed
 
 

Drupal is a registered trademark of Dries Buytaert.