Closed (won't fix)
Project:
Simplenews Statistics
Version:
6.x-3.0-alpha3
Component:
Miscellaneous
Priority:
Normal
Category:
Support request
Assigned:
Unassigned
Reporter:
Created:
14 Apr 2012 at 22:43 UTC
Updated:
27 Feb 2014 at 15:08 UTC
Jump to comment: Most recent
Comments
Comment #1
weseze commentedThis is indeed normal behaviour. If you've sent 80k mails with 12links in each mail you'll get 960k shorturl's...
I currently don't know if this could become a problem...
Comment #2
weseze commentedComment #3
rogeriodec commentedWell, the problem is that my database who had a slow and steady growth, in a few weeks tripled in size, hindering the process of backup and making it very slow.
Is it really necessary to keep all these links?
It would be possible to choose to not use this table?
Comment #4
weseze commentedThe data is the basis to making the links actually work. So no, you can't just not use that table.
The D7 version will be completely overhauled on this front and will most likely produce much much less records.
But I will not be putting anymore time in the D6 version myself to handle issues like this. (strictly bugfixes for me) If you want to tackle this I would be more then happy to apply your patch. But I'm afraid that this simply can't be fixed without some major work...
Comment #5
rogeriodec commentedIt would be possible to create a hook_cron (like dblog module) to delete such records over 30 days?
Would this give some other side effect or just the statistics before 30 days would be lost?
Comment #6
weseze commentedStatistics will keep on working, but all the links in your newsletters will be broken.
Comment #7
rogeriodec commentedWell, this is sad.
Although statistics are interesting, now I'll be stuck with a massive database that will double in size every month ...
f there was a way to reduce it, but as you said, you just will stir it in D7 ... it's a shame ....
Comment #8
weseze commentedYou could delete links from old newsletters. I think it's safe to assume that in most cases users won't click on links in newsletters older then a few weeks.
But you'd have to keep track of wich links to delete by hand...
Comment #9
weseze commentedComment #10
Marko B commentedI dont understand why there is short URL for each email? If I have one NLetter with 12 links and send it to 100 000 people, that should still be 12 links? Why do we need to have so many links?
Comment #11
weseze commentedThis is beacause in the D6 version every link is unique to be able to track individual clicks for every user. This was done with RC4 encryption resulting in enormously long URL's. (something I inherited from the previous maintainer) I therefore pushed shorturl onto the module to make these URL's shorter and less "spammy". But the shorturl fix had the very negative side effect of storing everything in the database. (maybe you could try and disable this)
In the current D7 version this sytem has been thrown out and replaced by #1775364: Url shortener and encryption. In short: the URL is now constructed with 2 ID's. (1 for the user and 1 for the url) The pieces are just the plain ID's. (so only a list of all links is stored in the database)
Optionally these ID's can be encrypted by the provided encryption submodule (same algorithm as shorturl but without the need to store anything in database) or you could plugin your own encryption engine.
Comment #12
Marko B commentedMaybe this part of "able to track individual clicks for every user" should be as separate submodule. It is very powerful and give very precise data what specific user did, but I would say most user won't need that as they want to see just sent/open rate of NL.
Comment #13
weseze commentedI'll reopen this issue.
So there are 2 possible solutions for now:
1) Make shorturl not store everything in database
2) Disable tracking on a per user base
Comment #14
weseze commentedI've looked at this again in detail now.
It seems a very big task to try and do something about this and I'm not willing to put much effort in the D6 release anymore. So if anyone else wants to patch this I will commit it.
For now you'll just have to stick to a manual cleanup from time to time.
Comment #15
RAFA3L commentedHello weseze, my shorturl_link have now +4.5Gb of size, I would like to disable the module, is safe disable the module with this big size?
I'm planning move the site to D7
Thanks!
Comment #16
lavamind commentedIf you disable simplenews_statistics but want to keep the short URLs working, you need to keep the shorturl module activated. To save space you can use
myisampackon theshorturl_linktable. It will become read-only but you will save a lot of space.If you want to keep using simplenews_statistics, check out #2205731: Decrypt short URLs after N days.
Comment #17
RAFA3L commentedThanks lavamind! But I already disabled the module, I hope move the site to D7 soon, thanks again