db sanitization queries for D7 infra.d.o [#2184025]

Comment #1

basic CreditAttribution: basic commented 30 January 2014 at 02:42

Started working on this today, and have a testing raw/sanitized db in progress. There is a bit of work to be done still to get the scripts to sanitize properly, including writing a handler to let us easily delete specific content types. halstead linked me to some examples here and here.

Log in or register to post comments

Comment #2

basic CreditAttribution: basic commented 31 January 2014 at 00:35

I have updated and added to the whitelist sanitization scripts. I believe these are working now, so the next steps are to add a jenkins job to create the sanitized development databases.

Log in or register to post comments

Comment #3

basic CreditAttribution: basic commented 1 February 2014 at 01:14

http://localhost:8080/view/Infra/job/infrastructure_database_snapshot/ now exists to create the dev snapshot. It uses the new sanitize_db.py script for this. I added a handler for infra_page content that should sanitize it from the dump.

I went ahead and deployed http://tvn-infrastructure.redesign.devdrupal.org/ for you to test with.

Log in or register to post comments

Comment #4

basic CreditAttribution: basic commented 4 February 2014 at 18:06

Status:

Active

» Fixed

Log in or register to post comments

Comment #5

tvn CreditAttribution: tvn commented 5 February 2014 at 13:34

Thanks basic. Overall the dev site looks good. Two things to check:
1. The content of 'infra_pages' is gone, however the titles are still there. Are we ok with leaving those?
If not, I would not want to delete the nodes completely, as they create the structure of infra team section of the site. Can we maybe replace the titles with some text e.g. 'infra page'.

2. BUEditor on this dev site has no button icons. On the live site the icons are located at sites/default/files/bueditor-icons. I think Bueditor then creates a sprite out of those somewhere in temp folder. So seems like icons and/or sprite image are missing.

Log in or register to post comments

Comment #6

tvn CreditAttribution: tvn commented 9 February 2014 at 15:09

Status:

Fixed

» Needs work

Log in or register to post comments

Comment #7

basic CreditAttribution: basic commented 21 February 2014 at 23:21

The content of 'infra_pages' is gone, however the titles are still there. Are we ok with leaving those?

I think these are safe to keep, we could sanitize them, but the titles aren't a concern IMO.

BUEditor on this dev site has no button icons. On the live site the icons are located at sites/default/files/bueditor-icons. I think Bueditor then creates a sprite out of those somewhere in temp folder. So seems like icons and/or sprite image are missing.

I just tracked this down, and it was due to a missing line in Jenkins stagingwww_sync_files, and missing rsync module for the infrastructure site. These have been added and should (hopefully) fix the missing files issue.