#2171683: Remove all Simpletest overrides and rely on native multi-site functionality instead introduces a new configuration setting in simpletest.settings:

clear:
  artifacts: true
# @todo Move into 'clear'.
clear_results: true

For consistency, clear_results should be moved into clear.results.


That said, perhaps one more bigger question is: Why is the clear.results setting exposed in the Simpletest settings UI?

I bet that everyone who toggles that option is actually seeking for the clear.artifacts option. What's the use-case of retaining the simpletest assertion results in the simpletest database tables?

Support from Acquia helps fund testing for Drupal Acquia logo

Comments

sun’s picture

Title: Rename simpletest.settings:clear_result into clear.result » Rename simpletest.settings:clear_results into clear.results
tstoeckler’s picture

Status: Active » Postponed

I guess this is postponed for now.

sun’s picture

Status: Postponed » Needs review
FileSize
5.87 KB

This task is actually independent of the parent issue. There are conflicts in affected lines, but that's ok.

Attached patch renames the configuration key and goes ahead and removes the setting from the UI.

tstoeckler’s picture

+++ b/core/modules/simpletest/config/schema/simpletest.schema.yml
@@ -4,6 +4,13 @@ simpletest.settings:
     clear_results:
       type: boolean
       label: 'Clear results after each complete test suite run'

This should be removed.

Not sure about removing the setting from the UI. Isn't it somewhat useful to compare the test results between consecutive runs? I agree it's not the coolest feature in the world but, ...

jibran’s picture

Status: Needs review » Needs work

The last submitted patch, 3: drupal8.simpletest-clear-results.3.patch, failed testing.

sun’s picture

Assigned: Unassigned » sun
Status: Needs work » Needs review
FileSize
5.34 KB
amateescu’s picture

I agree with @tstoeckler, why do we need to remove the option from the UI?

sun’s picture

From the issue summary:

perhaps one more bigger question is: Why is the clear.results setting exposed in the Simpletest settings UI?

I bet that everyone who toggles that option is actually seeking for the clear.artifacts option. What's the use-case of retaining the simpletest assertion results in the simpletest database tables?

I bet I'm one of the advanced users of Simpletest facing the most advanced debugging scenarios that can possibly exist (because I'm developing Simpletest itself), and I never ever had a use-case for retaining/inspecting the test assertion results in the Simpletest module tables.

This setting pretty much only exists for (1) SimpleTestTest (testing the test runner itself) and (2) PIFR/testbots.

I'm happy to be convinced that I'm wrong, but in that case, please state that you have used this setting and you really would miss it in the UI (→ the run-tests.sh parameter is not removed)

amateescu’s picture

I bet != I know. That said, I'm curious how you plan to get everyone that ever used the simpletest module to state that they will never miss that option in the UI. For now, you only have two core developer who expressed their preference to not remove it.

sun’s picture

OK, let's end this debate. I'll file a separate issue to remove it.

Attached patch retains the UI setting, but performs the same usability change as in #2176023: Allow to keep artifacts after a test run (test site + database); i.e., the checkbox value is negated, because a checkbox setting like this should never be enabled by default, but instead, the user is able to enable a behavior that diverges from the default behavior. Likewise, the label and description is vastly shortened for readability.

sun’s picture

Sorry, I also wanted to remove the added @todos, as they're irrelevant here. Will cancel the test for the previous patch in a moment.

The last submitted patch, 11: drupal8.simpletest-clear-results.11.patch, failed testing.

The last submitted patch, 11: drupal8.simpletest-clear-results.11.patch, failed testing.

sun’s picture

Status: Needs review » Needs work

The last submitted patch, 12: drupal8.simpletest-clear-results.12.patch, failed testing.

sun’s picture

Status: Needs work » Needs review
FileSize
4.85 KB

Re-rolled against HEAD.

Status: Needs review » Needs work

The last submitted patch, 18: drupal8.simpletest-clear-results.18.patch, failed testing.

sun’s picture

Status: Needs work » Needs review
sun’s picture

Status: Needs review » Needs work

The last submitted patch, 18: drupal8.simpletest-clear-results.18.patch, failed testing.

tstoeckler’s picture

Status: Needs work » Needs review

Status: Needs review » Needs work

The last submitted patch, 18: drupal8.simpletest-clear-results.18.patch, failed testing.

larowlan’s picture

re-roll

larowlan’s picture

Status: Reviewed & tested by the community » Needs review

whoops

alansaviolobo’s picture

Status: Needs review » Needs work

The last submitted patch, 27: rename-2175151-27.patch, failed testing.

Status: Needs work » Needs review

Status: Needs review » Needs work

The last submitted patch, 27: rename-2175151-27.patch, failed testing.

alansaviolobo’s picture

Status: Needs work » Needs review
FileSize
4.96 KB

sorry. wrong patch uploaded earlier.

Status: Needs review » Needs work

The last submitted patch, 31: rename-2175151-31.patch, failed testing.

Version: 8.0.x-dev » 8.1.x-dev

Drupal 8.0.6 was released on April 6 and is the final bugfix release for the Drupal 8.0.x series. Drupal 8.0.x will not receive any further development aside from security fixes. Drupal 8.1.0-rc1 is now available and sites should prepare to update to 8.1.0.

Bug reports should be targeted against the 8.1.x-dev branch from now on, and new development or disruptive changes should be targeted against the 8.2.x-dev branch. For more information see the Drupal 8 minor version schedule and the Allowed changes during the Drupal 8 release cycle.

Version: 8.1.x-dev » 8.2.x-dev

Drupal 8.1.9 was released on September 7 and is the final bugfix release for the Drupal 8.1.x series. Drupal 8.1.x will not receive any further development aside from security fixes. Drupal 8.2.0-rc1 is now available and sites should prepare to upgrade to 8.2.0.

Bug reports should be targeted against the 8.2.x-dev branch from now on, and new development or disruptive changes should be targeted against the 8.3.x-dev branch. For more information see the Drupal 8 minor version schedule and the Allowed changes during the Drupal 8 release cycle.

Version: 8.2.x-dev » 8.3.x-dev

Drupal 8.2.6 was released on February 1, 2017 and is the final full bugfix release for the Drupal 8.2.x series. Drupal 8.2.x will not receive any further development aside from critical and security fixes. Sites should prepare to update to 8.3.0 on April 5, 2017. (Drupal 8.3.0-alpha1 is available for testing.)

Bug reports should be targeted against the 8.3.x-dev branch from now on, and new development or disruptive changes should be targeted against the 8.4.x-dev branch. For more information see the Drupal 8 minor version schedule and the Allowed changes during the Drupal 8 release cycle.

Version: 8.3.x-dev » 8.4.x-dev

Drupal 8.3.6 was released on August 2, 2017 and is the final full bugfix release for the Drupal 8.3.x series. Drupal 8.3.x will not receive any further development aside from critical and security fixes. Sites should prepare to update to 8.4.0 on October 4, 2017. (Drupal 8.4.0-alpha1 is available for testing.)

Bug reports should be targeted against the 8.4.x-dev branch from now on, and new development or disruptive changes should be targeted against the 8.5.x-dev branch. For more information see the Drupal 8 minor version schedule and the Allowed changes during the Drupal 8 release cycle.

Version: 8.4.x-dev » 8.5.x-dev

Drupal 8.4.4 was released on January 3, 2018 and is the final full bugfix release for the Drupal 8.4.x series. Drupal 8.4.x will not receive any further development aside from critical and security fixes. Sites should prepare to update to 8.5.0 on March 7, 2018. (Drupal 8.5.0-alpha1 is available for testing.)

Bug reports should be targeted against the 8.5.x-dev branch from now on, and new development or disruptive changes should be targeted against the 8.6.x-dev branch. For more information see the Drupal 8 minor version schedule and the Allowed changes during the Drupal 8 release cycle.

Version: 8.5.x-dev » 8.6.x-dev

Drupal 8.5.6 was released on August 1, 2018 and is the final bugfix release for the Drupal 8.5.x series. Drupal 8.5.x will not receive any further development aside from security fixes. Sites should prepare to update to 8.6.0 on September 5, 2018. (Drupal 8.6.0-rc1 is available for testing.)

Bug reports should be targeted against the 8.6.x-dev branch from now on, and new development or disruptive changes should be targeted against the 8.7.x-dev branch. For more information see the Drupal 8 minor version schedule and the Allowed changes during the Drupal 8 release cycle.

Version: 8.6.x-dev » 8.8.x-dev

Drupal 8.6.x will not receive any further development aside from security fixes. Bug reports should be targeted against the 8.8.x-dev branch from now on, and new development or disruptive changes should be targeted against the 8.9.x-dev branch. For more information see the Drupal 8 and 9 minor version schedule and the Allowed changes during the Drupal 8 and 9 release cycles.

Version: 8.8.x-dev » 8.9.x-dev

Drupal 8.8.7 was released on June 3, 2020 and is the final full bugfix release for the Drupal 8.8.x series. Drupal 8.8.x will not receive any further development aside from security fixes. Sites should prepare to update to Drupal 8.9.0 or Drupal 9.0.0 for ongoing support.

Bug reports should be targeted against the 8.9.x-dev branch from now on, and new development or disruptive changes should be targeted against the 9.1.x-dev branch. For more information see the Drupal 8 and 9 minor version schedule and the Allowed changes during the Drupal 8 and 9 release cycles.

quietone’s picture

Project: Drupal core » SimpleTest
Version: 8.9.x-dev » 8.x-3.x-dev
Component: simpletest.module » Code

Triaging issues in simpletest.module to determine if they should be in the Simpletest Project or core.

This looks like it a simpletest module issue, changing the project.