This is a recurring issue. From time to time, the statistics page reporting the number of installs are not updated in a timely manner. It is fairly normal that these are reset to zero for the previous week on Sunday and not updated until Wednesday. However it is unusual that they are not updated by the next Sunday.

As for the current situation: At least the following two projects have a number of zero recorded for the last two weeks (March 23 and 30):

(As is the case with a number of other projects at the time of writing.)

The number of reported installs on the project page is also not updated when this happens. I believe the two are related.

I'm not sure of this is fixed, but it seems to involved one or more of: flushing queues, restarting servers, or other infrastructure tasks.

Comments

tvn’s picture

tvn commented
Status: Active » Fixed

This has been fixed yesterday #2128619: Project usage/download/install statistics not being generated in a timely manner.

ti2m’s picture

ti2m commented

Great, thanks for the feedback, seems to work now.

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.

gisle’s picture

gisle
he/him
Primary language Norwegian Bokmål
Location Norway
commented
Category: Bug report » Task
Issue summary: View changes
Status: Closed (fixed) » Active

It is happening again, so I'm reopening.

gisle’s picture

gisle
he/him
Primary language Norwegian Bokmål
Location Norway
commented
Issue summary: View changes
drumm’s picture

drumm
he/him
Location NY, US
commented
Assigned: Unassigned » basic

The cause right now is that our Mongo instance on util seemed to be causing problems, and was shut off.

We need to:

  • Short term: Migrate util's Mongo instance to a VM, with only minor upgrades. Util's settings.local.php can be pointed to that, and http://localhost:8080/job/util_parse_varnishlogs/ can be run.
  • Medium term: Make a staging Mongo VM, fully upgraded, and point staging.devdrupal.org's settings.local.php to it. It is expected that our very outdated Mongo instance is the source of plenty of problems.
basic’s picture

basic commented

I will put this on buildvm.drupal.org, but need to

- increase the size of the disks
- configure a puppet module for mongodb
- copy data from util

basic’s picture

basic commented

I've migrated our mongo data to buildvm.drupal.org and configured mongodb via puppet. The data is compatible between releases, and using the OS package (1.6.3) appears to be working:

> show dbs
download-statistics	0.953125GB
local	0.078125GB
update-backups	0.953125GB
update-statistics	31.9384765625GB
> use update-statistics
switched to db update-statistics
> show collections
1257033600
1257638400
1258243200
1391299200
1391904000
1392508800
1393113600
1393718400
1394323200
1394928000
1395532800
bdragontemp
processed-files
projects
releases
system.indexes
terms
drumm’s picture

drumm
he/him
Location NY, US
commented

Project module had assumed localhost. It is now configurable and running. If all goes well, stats will be parsed in ~3-6 hours. Caches will hold pages for up to 24 hours longer after that.

drumm’s picture

drumm
he/him
Location NY, US
commented
Status: Active » Fixed

Now fixed.

When/if this breaks again, please do not re-open this old issue. The problem will be a new cause. Look for an active one at https://drupal.org/project/issues/infrastructure, and file a fresh one if needed.

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.

dqd’s picture

dqd
Location London | N.Y.C | Paris | Hamburg | Berlin
commented
Title: Reported installs on project page not updating » Reported installs on project page not updating / not correct
Status: Closed (fixed) » Active

not sure but it seems the reported installs of all projects on d.o. go down since 1-2 weeks rapidly. Not sure if this is the issue connected to this behaviour or not. feel free to mark as dup o.s. if I missed sth.

dqd’s picture

dqd
Location London | N.Y.C | Paris | Hamburg | Berlin
commented
Status: Active » Closed (fixed)

ups, sry, read the #10 too late. ...

dqd’s picture

dqd
Location London | N.Y.C | Paris | Hamburg | Berlin
commented

ref to #2264811: Project usage statistics have dropped by 40%

Project: Drupal.org infrastructure » Drupal.org customizations
Component: Drupal.org module » Miscellaneous