Due to matrix computation and memory consumption problem addressed in #509424: too much memory consumption. It would be nice to compute data in one local server and then export/import the data to the other server.
Should write a script to automate this. Perhaps in Drush.
Comments
Comment #1
angusmccloud commentedDanithaca,
If it's useful, I added a new function to the module that's along those lines. It runs on my local machine (scheduled) and does the following:
* Queries the Production (not local) server to see if there are new ratings since the last time it ran
* If there are, it grabs the ratings from Production and does a delete/insert on the local machine of all ratings from those user(s) that have rated since the last run
* It runs the "single user approximation" for those users on the local machine
* Grabs all the recommendations for those users from the local machine, and does a delete insert on the recommendations table in Production
* Updates a variable for the last runtime on the Production database
For this to work you need the most recent similarity table to be on your local machine, and you need to have different connections setup in your settings.php file (locally). But i've been running this way for a few weeks and it seems to be working well.
If you want me to send it to you let me know.
-Connor
Comment #2
danithaca commentedThanks Connor. Mahout seems to support this. So 7.x-3.x and 7.x-3.x would support this by default. This won't get fixed in 6.x-2.x.
Comment #3
angusmccloud commentedThanks Dan.
That's fine that V6 won't handle this, I can keep doing stuff on the side until we're ready to go up to V7.
Comment #4
danithaca commentedThe Mahout support will be back port 6.x-3.x, but not 6.x-2.x. So 6.x will still have this feature.