Just had to do some before/after comparison on this registry followup since I was getting different results running all tests before and after. We realised that even if you get similar numbers, it's impossible to easily know which tests are failing and which are passing without looking through every test report and copy/pasting the results - even harder to do by assertion. It takes a very, long, time.

If it's not too complex, it'd be great to have a 'failure summary' which just lists all the failures at the top of the screen:

Failed:
foo.module
x failures
failed assertion
failed assertion
failed assertion
bar.module
x failures
failed assertion
failed assertion
failed assertion

Once we've got that, and once we have daily HEAD test runs going - we could log these and print them to a page on d.o somewhere, maybe with revisions for week by week comparison to see what's new/old etc.

Comments

boombatower’s picture

boombatower commented

This seems similar to what testing.drupal.org will be doing.

catch’s picture

catch
he/him
Primary language English
commented

Ahh, if that's already built in to testing.drupal.org we could probably won't fix this.

boombatower’s picture

boombatower commented
Status: Active » Postponed (maintainer needs more info)

Can anyone confirm this?

My understanding is t.d.o will provide both overview (what is requested in this issue) and detailed output (default SimpleTest dump).

boombatower’s picture

boombatower commented
Status: Postponed (maintainer needs more info) » Closed (won't fix)

Once test.drupal.org is up we can make issues as we see fit.