In #968044: devel_switch_user_list passes array to check_plain someone posted a patch against Devel 7.x-1.0-beta2, which is four months old, but the testbot apparently tested the patch against the tagged version and marked it PASSED.

Shouldn't the testbot always test against the tip of the branch, i.e. 7.x-1.x-dev in this case? After all, that's where the patch would be applied and nowhere else.

If it had tested against 7.x-1.x-dev, it would have found out that the patch doesn't apply (because the but was fixed three months ago).

The testbot isn't as useful as it could be, if it doesn't test against the tip of the branch.

Comments

jthorson’s picture

jthorson commented
Status: Active » Closed (works as designed)

Testbot will always test against the issue version ... this provides us flexibility for future capabilities (such as testing against a feature or 'in-development' branch) once we decouple the system's 'release' dependency.

(Just triaging this abandoned issue queue ... if you want to re-open, please move to the 'Testbots' project.)