phpBB3 Support

I want to port this for Drupal 6 (with phpbb2) first.

If you want to help with phpbb3 support, you can help find out what tables have changed.

As a note phpbb3 has moved from storing its passwords as md5 hashes to salts. I do not know too much about cryptography, but passwords will need to be reset as import will not work.

Secondly phpbb3 uses utf-8 so this will eliminate the need to reincode the data.

It is extremely unlikely that a version will be released for Drupal 5 though.

Now that the Drupal-6.x-1.0 release is out, this is the new focus of development.

Some data from here:

First of all - it says that to continue, the proper tables need to be found. The two tables that aren't found from the phpbb3 installation is phpbb_posts_text and phpbb_categories.

As of phpbb3 the posts_text has been turned into a field in the phpbb_posts table called "post_text". Just let me know what other information you need regarding my database - and I can keep checking in to help get this module switched over for phpbb3.

Thanks!

It seems that the categories and forums tables have been merged, also posts and posts_text.

For those playing at home, can you try replacing the phpbb2drupal.pages.inc with the attached page (rename the file from ".txt" to ".inc") and see how fazr you get.

If I am lucky, you will get to successfully import the users, but fail at topic import. Any sql whizkids may want to look at this query (in phpbb2drupal.module line 612):

 $query = db_query('SELECT *
      FROM %stopics t
      INNER JOIN %sposts p ON t.topic_id = p.topic_id
      INNER JOIN %sposts_text pt ON p.post_id = pt.post_id                            
      WHERE p.post_id = t.topic_first_post_id
      AND t.topic_id = %d', $pre, $pre, $pre, $result->topic_id);

Can I just delete the INNER JOIN %sposts_text pt ON p.post_id = pt.post_id line or will it be more involved? (anyone playing along at home feel free to give that a try... you will have to do it a number of times as straight after this query is another with that same line to get topic copunt. and then the two are repeated for poll import if you get that far. Happy hacking)

There is one other thing which I am not sure of on how to continue - that is the module layout. Should I:

1. Have the 1.x series for phpbb 2.x, 2.x series for phpBB 3.x
2. Support both phpBB versions in the 2.x series through some magic (if phpbb version = 2 do this. Otherwise do that)
3. Add a third bundled module for phpbb3 import?

Hello,

Thanks for setting this up. I am running Drupal 6.1 and phpBB3. I installed the module version 6.x-1.0, and am currently going to test with your new .inc page.

UPDATE: Okay, I have gotten the module installed with your new .inc file - and it now says all of the tables are found. That solves at least one problem! :-) The next problem I am running into is BBCode. I don't have the BBCode module installed since it doesn't support version 6 of Drupal yet - so each time I try and run the migration it says i have to complete setup. When I travel to the setup page - the BBCode drop down is open and it says "Module bbcode is disabled." in red. So even though I have "Leave BBCode as is" as my set option, I still need BBCode installed? From the directions I thought that it said BBCode isn't needed with this option set as "Leave BBCode as is." So as of now - I am at a standstill. Any thoughts?

Looks like I need the Comment Upload module as well - which isn't supported by version 6 of Drupal.

BBCode has been released - there is just a problem which stops the release from being displayed You can get it from:

http://drupal.org/node/218901

(Not sure why you are getting that message though - it should not be needed yet if you leave the BBcode as is. Did you select an input format?)

Comment upload is only needed if you have attachments on your current setup that you want to migrate. For now, ignore that. Once everything else is done, we can work back to that.

Enabled the bbcode module, and now it says that bbcode is OK! in the BBCode settings area for the phpbb2drupal module. It still will not let me migrate though - due to the fact that the comments module isn't installed under ENCODING SETTINGS. In red it says, "Module comment_upload is disabled." Is there a hidden version of the comments module I am not seeing too? Checked the release area for the comment upload module, and couldn't find it. http://drupal.org/node/37197/release

Still cannot execute the migration - as it still says settings aren't finished. The comment upload module is the only setting in red at this point.

Just let me know what you would like me to do or test next.

In the settings, uncheck the attachments stuff for now.

Or you can try patching the comment_upload module using the patch on this queue:

http://drupal.org/node/197015

Awesome. Migration worked, and following is the synopsis of the process:

Users were imported perfectly into Drupal from phpBB3. No problem in this arena. Checked over the users in the database - and all information was accurate, and those users just need to reset their passwords.

It SAID that the category migrations worked successfully, but when I checked the Taxonomy for Drupal - only the Taxonomy Category FORUMS was available, and nothing else. No childen, etc...

For TOPICS it said that it found them, but successfully imported ZERO. Here is the error code that was produced on that page:

    * user warning: Unknown column 'topic_vote' in 'where clause' query: SELECT topic_id FROM testforum_topics WHERE topic_vote <> 1 ORDER BY topic_id in httpdocs/drupal/modules/phpbb2drupal/phpbb2drupal.module on line 582.
    * user warning: Unknown column 'topic_vote' in 'where clause' query: SELECT COUNT(topic_id) FROM testforum_topics WHERE topic_vote <> 1 ORDER BY topic_id in httpdocs/drupal/modules/phpbb2drupal/phpbb2drupal.module on line 584.

For the Polls, it produced this error code:

    * user warning: Unknown column 'topic_vote' in 'where clause' query: SELECT * FROM testforum_topics t WHERE topic_vote = 1 ORDER BY topic_id in httpdocs/drupal/modules/phpbb2drupal/phpbb2drupal.module on line 779.
    * user warning: Unknown column 'topic_vote' in 'where clause' query: SELECT COUNT(*) FROM testforum_topics t WHERE topic_vote = 1 ORDER BY topic_id in httpdocs/drupal/modules/phpbb2drupal/phpbb2drupal.module on line 780.

And for Posts it produced this error code:
user warning: Unknown column 'topic_vote' in 'field list' query: SELECT topic_id, topic_vote, topic_first_post_id, topic_last_post_id FROM testforum_topics WHERE topic_replies > 0 ORDER BY topic_id in httpdocs/drupal/modules/phpbb2drupal/phpbb2drupal.module on line 967.

Transform URLS gave no errors.

So this is all I have from here. let me know what to do next. i can do some testing with the phpbb3 and drupal I have running with this new migration test OR I would be happy to wipe them clean, reinstall, and try again with some new code. Just let me know what you need me to do.

P.S. Sorry for being a noob and not being able to figure out how to work the simple module! LOL :-)

I have looked over the testforum_topics table in my database - and the following columns are what's now included in phpBB3.

topic_id
forum_id
icon_id
topic_attachment
topic_approved
topic_reported
topic_title
topic_poster
topic_time
topic_time_limit
topic_views
topic_replies
topic_replies_real
topic_status
topic_type
topic_first_post_id
topic_first_poster_name
topic_first_poster_colour
topic_last_post_id
topic_last_poster_id
topic_last_poster_name
topic_last_poster_colour
topic_last_post_subject
topic_last_post_time
topic_last_view_time
topic_moved_id
topic_bumped
topic_bumper
poll_title
poll_start
poll_length
poll_max_options
poll_last_vote
poll_vote_change

If needed - I can get the column/field types for you for any of the columns needed. And once again - thanks for all of the work you are putting into this. Sorry I am not more of a help - as I am still learning MySQL and PHP. :-)

Also, there's a table called testforum_posts now in phpBB3. (is writing my table prefix "testforum" making this too confusing, or is it easily understandable?)

Included in the _posts table, the following columns reside:

post_id
topic_id
forum_id
poster_id
icon_id
poster_ip
post_time
post_approved
post_reported
enable_bbcode
enable_smilies
enable_magic_url
enable_sig
post_username
post_subject
post_text
post_checksum
post_attachment
bbcode_bitfield
bbcode_uid
post_postcount
post_edit_time
post_edit_reason
post_edit_user
post_edit_count
post_edit_locked

Don't worry - the module is not as simple as it should/could be.

You actually got further than I expected. Did you make any changes to the query (like deleting that line I mentioned in comment 4?)

The polls seems to have got a lot better in phpBB3 - something that may cause problems.

Previously (I think) the poll question and the topic titles were the same. Now they can be different. Should we go with the topic title, or the poll question?

I logged into my phpbb3 forum and you have the ability to have your own subject and THEN the poll question. So I would say just go with the poll question as the topic for the new forum post.

I did not delete the line you mentioned in comment 4. Will try. Any other info you need from other tables? I think I gave you enough to work with for a bit.

About the BBCode module being required even though "leave BBCode as is" was selected, I want to clarify that the logic was: since the BBCode would be left, the module would be required anyway post-migration, even though it is not required during the migration itself. I think it makes sense to leave the requirement as it is today. Maybe the message can be improved as to why/when it is required.

It is a common thing that modules require other modules. This module was drafted before the .install files were created, so the bbcode module can be added in the .install file instead.

Aah I see. Makes perfect sense when put into those terms. Thanks beginner. Still working on testing out the module removing that line...should have some more testing done by tonight.

I'm interested in this for 5.7 since i'm stuck on that til a few more contrib modules get 6.x-ified. I'm interested in helping with the 6 mod and forking that to make a 5.x mod after. What can i do to help?

P.S. i only need the categories and forums from phpbb3 to go into my drupal does this subset of the functionality by chance overlap for both 5 and 6?

yes, those bits do overlap. The functions do not need much change, just changes to some queries, wrapped inside if statements. (if phpbb version == 2.x do what we already do, if not, do this instead)

Currently the stage I am at is :

1. How to go about this. I will probably have to have a variable on the settings page to choose phpBB version.
2. adding categories will need to be changed, No tested myself as I am pretty busy atm, but these are now also stored in the forums table.
3. add a version check around the few variations of this line: $topic_ids = db_query('SELECT topic_id FROM %stopics WHERE topic_vote <> 1 ORDER BY topic_id', $pre); (for phpbb3 changing the WHERE bit to check for poll title should do.)
4. Test, test, test. Find errors, fix, test.

Not too much to do, its just the layout from step 1 that I am pondering over, which would not be a problem if we went for a clean break. (but that would cause oterh problems - I suspect that most phpBB users are still with the 2.x series.)

Is the phpbb version number stored in the db or the settings file that it can be "auto detected"?

My forum is a bit odd though its SMF -> phpbb3 migration then phpbb3 + drupal 5.x integrated, so i'm pretty much hoping that the previous 2 processes went well else i'll have some pretty unique problems.

Just so i'm clear which module version do i want to download to get started?

none yet (have some real world issues atm).

the phpbb version will have to be manually set on the setting page. In an option that is not there yet.

Sorry about being slow on this.

So on my copy i basically copied the encode settings form and replaced the variable names and array to give a check box asking if the use wants to select the phpbb version and a list of supported versions.

 //Version settings
   $form['version'] = array(
   '#type' => 'filedset',
   '#title'=> t('PHPBB Version Select'),
   '#collapsible' => TRUE,
   '#collapsed' => FALSE,
   );
   $output .= '<p>'.t('Select which phpbb version you are importing from.').'</p>';
   $form['version']['info'] = array('#value' => $output);
   $versions = array (
   'phpbb3.x' => 'PHPBB3',
   'phpbb2.x' => 'PHPBB2');
   
    $form['version']['phpbb2drupal_version_select'] = array(
    '#type' => 'checkbox',
    '#title' => t('Change version of the board you want to import'),
    '#default_value' => variable_get('phpbb2drupal_version_select', '1'),
  );
  $output .= '<p>'. t('This setting is useful if you have a phpbb3 forum.') .'</p>';
  
  $form['version']['phpbb2drupal_version'] = array(
    '#type' => 'select',
    '#title' => t('phpBB2 encoding'),
    '#default_value' => variable_get('phpbb2drupal_version', 'PHPBB2'),
    '#options' => $versions,
  );
  
  $form['version']['result'] = array('#value' => $output);
  

Right so after much noobing i realized that the module really doesn't seem to like my $form['version'] and hence doesn't display it... is there something basic i am missing?

Wow a spelling error on fieldset cause this much frothing on my part... I found the problem.

No problem i got real world issues of my own, i'll just go ahead with as much as i can and post the code(working) here maybe it will cut down on your work.

After i get the form behaving like it should i'll try to find out where i need to put those conditional branches. Or i may make another form to provide an interface for disabling everything but category and forum migration.

Oh btw i'm working from the following module

version = "5.x-3.0"
project = "phpbb2drupal"
datestamp = "1204243217"

Since this is what i need, so i'll work out on my own all of the stuff that is drupal 5 specific since this doesn't seem to be your current focus, and as i said i'm willing to help with all the phpbb3 related functionality even on the 6 version so just let me know what i can look into for you but it will still be up to you to update the code for the both modules if you so desire to have a working drupal 5 version. (I don't mind being the only one that has it though :D but that would be bad for open source)

Ok so forgive me for being a bit behind (and being talkative) but .pages.inc doesn't exist in 5.x-3 so i'm going to make that page for the 5.3 version since i assume that is how you would want it anyway. As far as i can tell its just the 1 function i'll keep posting as i make more progress (unless you want me to stop).

pages.inc is new in Drupal 6. In Drupal 5 those functions are in the main module file.

also, you will want to use radios instead of checkbox with #options for each version (otherwise someone could have both boxes ticked). In #default_value' => variable_get('phpbb2drupal_version_select', '1'), replace the 1 with whatever you are calling phpbb2.

Ok i see what you did there, the checkbox and droplist combo was indeed redundant. Thanks i'll hop to it.

OK so i manged to get the radio menu to work and depending on the selection the table prefix section knows what set of tabes to look for.

I created a patch using unxUtils for windows feel free to test it and let me know what's up.

What other differences are they between phpbb2 and 3 besides the categories and post_text table thing?

The method to check for polls.

instead of $topic_ids = db_query('SELECT topic_id FROM %stopics WHERE topic_vote <> 1 ORDER BY topic_id', $pre); for phpbb3 you will want to check for pollcreated date.

put an if around that statement (there will be two slightly different versions of it for topic import, two more for polls and I think one for comments) where if phpbb2 do the current thing, if phpbb3, change the end of that (ther WHERE statement) to look for a poll created date. In this instance something like:

$topic_ids = db_query('SELECT topic_id FROM %stopics WHERE poll_start < 0 ORDER BY topic_id', $pre);

Also, phpbb 3 is always utf-8, so need to to check for encoding settings,but this will probably stay in there in case someone has managed to use a different encoding. No idea if they can.

I have updated HEAD with a modified version of the patch in comment 26 (thanks rayneitami!). I have also added the relevant if's into the rest of the module. The changes are totally untested so there is a high chance that things will not work.

You can either check out head using some cvs software, or get the files individually from:

http://cvs.drupal.org/viewvc.py/drupal/contributions/modules/phpbb2drupal/

only two of the files have been changed: phpbb2drupal.module and phpbb2drupal.pages.inc

@rayneitami- if you want to backport the changes for the 5.x version, there are three places where I have made changes beyond your patch (one for topic, once for polls, once for comments), I have also made a few changes to your patch on the settings page - no need to check if a version has been selected as we do choose phpbb2.x by default. secondly I changed altered things in the fieldset such as the phpbb version names (eg "phpBB 3.x series" instead of "phpbb3.x").

And now I have just committed category support. Once again totally untested.

(As a word of note - sub forums will probably not work properly - as only children of categories are looked for, not children of forums. Someone a little cleverer than me will have to come up with the changes to properly look for children of forums)

Please test and let me know how much of a fool I am.

Ok i'll get on the back porting bit then look into the categories stuff. I should probably get cvs and setup a proper dev folder instead of hacking away since i should patch against versions on the server.

Hey nbz do you mind spliting the phpbb2drupal.module from 5.3 into a privatemsg and pages file and putting up a new revision? It would make things a lot simpler when backporting stuff from the HEAD revision.

Ok i got a whole bunch of errors testing the drupal 6 module

Import Categories:

* user warning: Unknown column 'cat_order' in 'order clause' query: SELECT * FROM pbb_forums WHERE forum_type = 0 ORDER BY cat_order in /phpbb2drupal/phpbb2drupal.module on line 479.
* warning: Invalid argument supplied for foreach() in /phpbb2drupal/phpbb2drupal.module on line 517.

user warning: Table 'itamio00_test6.pbb_posts_text' doesn't exist query: SELECT * FROM pbb_posts p, pbb_posts_text pt WHERE p.post_id = pt.post_id AND p.post_id = 29 in /home/itamio00/public_html/subdomains/test6/sites/all/modules/phpbb2drupal/phpbb2drupal.module on line 1030.

I if'ed out somemore of the select statements that reference posts_text but i don't know if my phpbb3 variants are correct in all cases.

Ok i've gotten some success with the forums but the categories since the show up blank. I tried some different SQL statements but after thinking about it some more this i realise you probably need to pull back all of the forums and go through the array several times to sort them as forums and subforums (where a sub forum is a forum whose parent is not a category) also i don't think the current script handles forums placed in the root instead of a category.

Anyway here is my patch from the original 5.x-3.0 i have done one from the head 6.x yet.

Thanks, having a quick look at the patch, it looks good.

For the category/setting up forums, I think we will need to rewrite the function to work in a different way. in the form of:

1. if phpbb3:
2. Get rows - order by parent_id
3. while there are rows:
4. Get a row from the forums table.
5. is it category? if so add it as a category. Is it a forum? add it as a forum? also get the parent.
6. Go back to three

Ok I'm back in action (was busy with real life and such) i'll try that out tonight if i have the chance to.

Totally untested(like all my other commits from this issue...), but something to play with:

<?php
  if (variable_get('phpbb2drupal_version', 'PHPBB2') == 'PHPBB3') {
    $results = db_query('SELECT * FROM %sforums ORDER BY parent_id', $pre);
    while ($result = db_fetch_array($results)) {
      if (!db_result(db_query('SELECT forum_id FROM {phpbb2drupal_temp_forum} WHERE forum_id = %d', $result->forum_id))) {
        if ($result->parent_id > 0) {
          $result->parent_id = db_query('SELECT tid FROM {phpbb2drupal_temp_forum} WHERE forum_id = %d', $result->parent_id);
        }
        $forum = array(
          'name' => $result->forum_name,
          'vid' => $forum_vid,
          'description' => $result->forum_desc,
          'parent' => $result->parent_id,
        );
        $forum['name'] = _phpbb2drupal_text_encode($forum_edit['name']);
        $forum['description'] = _phpbb2drupal_text_encode($forum_edit['description']);

        taxonomy_save_term($forum);
        
        // serialize the forum containers
        if ($result->forum_type == 0) {
          //This is a category
          $containers = variable_get('forum_containers', array());
          $containers[] = $forum['tid'];
          variable_set('forum_containers', $containers);
        }
        //save the container to the forum table - yes this is hackish.
        db_query('INSERT INTO {phpbb2drupal_temp_forum} (forum_id, tid) VALUES (%d, %d)', $forum->forum_id, $forum['tid']);
      }
    }
  }
?>

I have committed this to head. Someone please tell me I am sane. (or if there are errors, fix them up for me...)

For those playing at home, If this works, are there other things not working atm? (or is me asking this just being really lazy?)

EDIT - I have changed the quoted code to reduce duplication and fix an oops or few.

Ok i'll check it out, i was having some trouble with that section of code myself some of your changes look like what i started but i didn't know enough about drupal forums to make the category names and subforums work.

I got this when i tried to use it

user warning: Duplicate entry '0' for key 1 query: INSERT INTO dru_phpbb2drupal_temp_forum (forum_id, tid) VALUES (0, 2646) in /includes/database.mysql.inc on line 172.

mean anything to you?

forum_id should not be 0. Are any categories/forums being saved? (they should be... this is an error after the forums are being saved... so you can check by visiting the forums, or going into the forums admin section - but they should be badly ordered.). Change

<?php
db_query('INSERT INTO {phpbb2drupal_temp_forum} (forum_id, tid) VALUES (%d, %d)', $forum->forum_id, $forum['tid']);
?>

to

<?php
db_query('INSERT INTO {phpbb2drupal_temp_forum} (forum_id, tid) VALUES (%d, %d)', $result->forum_id, $forum['tid']);
?>

that should fix the error.

Just further info:

I think phpBB3 uses phpass as its crypto. There is a module available for this at http://drupal.org/project/phpass. Once installed, this module cannot be uninstalled as it changes all passwords from md5 to phpass.

Totally untested, but for those who are willing to investigate, the probable way to get this to work would be:

1. Install phpass. Does it need a crypto key? If so, use the same one from phpBB
2. Import users. Note - importing users first will probably not work as the phpass will re hash the passwords with phpass.
3. There may be other steps needed to let Drupal know that the newly imported passwords are already hashed,

Hi Nzb,

I managed to complete the process of migrating PHPBB3 to Drupal 5.7
Attached is the code I used for the module, I did many changes compared to the original you put on drupal.org - but the important ones are the SQLs and db_query thingys... The rest is just rubbish.

This code (as far as I can tell) does the following correctly
1. Imports Topics to nodes, with attachements (attachments didn't work) successfuly (again for me)
2. Imports Posts to comments with attachments successfuly (did not work correctly due to SQL issues)
3. Imports Private Messages (did not work at all due to SQL changes)
4. Some things in the check_tables code where irrelevant due to the above changes (tables not used anymore, etc)

I didn't fix or even try to fix the container code, or the poll code - as these are secondary issues for me, but I hope to fix them as well - soon.
However, this code is in no way tested, and will certainly not work for importing PHPBB2 to Drupal 5.7 - I personaly think that a split is needed for that (split the module into different versions for the different migrations - BB2 to 5.7, BB3 to 5.7, BB2 to 6.2 and BB3 to 6.2 (depending on need of course).

Another thing is that if you are using smilies in the PHPBB they don't transfer well (maybe need to add an option for this in the URL fixer and some explanations on how to move the images to Drupal) - same goes for attachments - the code doesn't transfer them to the Drupal directory and there is no mention that such an action is required (Avatars do have such a mention).

Hope this helps everybody - and that you manage to make sense of what I did.... my first contribution to open source!

hey, thanks for all that.

I will have a look through it and see what I can use.

(this module was also my first involvement in open source. Actually first proper involvement in coding altogether. :P)

For smileys, did you have the smileys.module installed? (I think it lacks a few smileys that phpbb provides by default, )

PS since you are already doing this, have you tested the phpass module? ( http://drupal.org/project/phpass ) I think enabling that before importing data should allow you to keep the user passwords. Any testing of this would be much appreciated.

As for simplifying things, I was considering dropping phpBB2 support once the phpBB3 works properly. Actually, not drop but have the 3.x version for phpbb2 only, have 4.x version for phpBB3 only. This will allow me to get rid of other code, add better dependencies etc etc. Not decided, but first I need to get the phpbb3 stuff to work.

I didn't use PHPPass, as all the users already existed in Drupal (I was using the phpbb module to integrate the two) so it currently seems that the passwords are still intact (original drupal passwords are in place...).

Can I just confirm that #40 is a PHPBB3 to DRUPAL5.7 modification? I've installed it and still get the same error messages I had with the original module....

/me scratches head

MY REQUIREMENTS:
I must run Drupal 5.7 because I am using UBERCART (amongst some other modules) which doesnt support 6 yet.
My existing Forum is PHPBB3.1 with around 30k posts.
Integrating them will make my website much easier to handle and it's been on my list for ages.

what error messages? did you replace the original phopbb2drupal.module file with that?

(sorry for dropping the ball on this. I need to pick it up again.)

Sorry - I'll clarify: I updated the module with the code from #40 but got the same errors reporting about missing tables... *THEN* I noticed the new section at the top of the module when running it letting me select PHPBB3... you cant even guess how excited I became after spending 2 days trying to get this working LOL.

Anyways... after a little dicking around I got it to run but hit quite a few errors... I had SQL errors reported for importing Users then the POST's import seemed to hang and after ten minutes or so just came back with a blank screen.....

the forum layout itself seems to have imported but no posts/topics whatsoever... NOW they DO exist but are just as un-connected ANONYMOUS comments floating around the system. v.strange. When I look at the forum I see no posting and get an SQL error:

user warning: You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near 'SELECT title, created AS time, query: SELECT n.title AS topictitle, r.title AS replytitle, r.time timestamp, r.type AS replytype, n.type AS topictype, n.nid AS topicid, t.tid, r.cid AS cid, r.uid, u.name FROM node AS n INNER JOIN ( (SELECT title, created AS time, nid, uid, type, 'cid' AS cid FROM node ) UNION (SELECT subject, timestamp, nid, uid, 'comment', cid FROM comments WHERE comments.status = 0 ) ORDER BY time DESC ) AS r ON n.nid=r.nid INNER JOIN term_node AS t ON n.nid = t.nid INNER JOIN users AS u ON r.uid = u.uid WHERE n.status = 1 GROUP BY tid; in www/includes/database.mysql.inc on line 172.

ANYWAYS... This error could be a result of dicking around so many times ;)

I'm in process of restoring a clean starting database and will then run again and report back more accurately....

OK so here it is step by step test of the PHPBB3.1 import into Drupal 5.7

1. I tidied up both the Drupal and PHPBB databases by removing users with no posts and removing articles that were no longer published etc....
2. I created copies of both databases in MySql4 on server
3. Logged into PHPBB2DRUPAL selected following options:
PHPBB Version Select- phpBB 3.x series
PHPBB Data in another SQL4 database on same server
everything else left to default
and *CLICK* lets see it run...

---- running -----

Step1 IMPORT 1500 USERS - Seemed to complete OK but reported SQL errors

Step2 CATEGORIES 8 IMPORTED OK

Step3 TOPICS 568 from 571 IMPORTED OK
NOTE: Lots of SQL error messages here:
user warning: You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near 'SELECT fid FROM profile_fields WHERE name = 'user_post_count') query: UPDATE profile_values SET value=45 WHERE fid = (SELECT fid FROM profile_fields WHERE name = 'user_post_count') AND uid=1 in /www/includes/database.mysql.inc on line 172.
user warning: You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near 'SELECT fid FROM profile_fields WHERE name = 'user_ip_address') query: UPDATE profile_values SET value='86.16.152.114' WHERE fid = (SELECT fid FROM profile_fields WHERE name = 'user_ip_address') AND uid=1 in /www/includes/database.mysql.inc on line 172.
These error were repeated around 200ish times on the screen....
But as it said 568 imported OK I thought I would continue....

Step4 POLLS FAILED
It found 7 polls and failed on all of them but I dont really mind about that.
user warning: Table 'Forums.phpbb_vote_desc' doesn't exist query: SELECT * FROM phpbb_vote_desc vd WHERE topic_id = 18 ORDER BY vote_id in /home/bullwork/www/www/includes/database.mysql.inc on line 172.

Step5 IMPORT POSTS Seemed to work fine

--------------

OK - final results look MUCH better than yesterday.
Forums have come in OK
Posts apear to be mostly OK but quite a bit of duplication for some reason... lots of the conversations threads have the first posting duplicated
Only mild annoyance is that every post is showing as ANONYMOUS :(

I'll do some sifting through the forums and see if there is anything else to report.

FINAL THOUGHTS:
It's a better script than nothing and must be worth releasing to the hordes as a DEV module. :)

Thanks for that info... I am planning a dev-release at some point, but when more things are working. Just need to find and put in a little more time into the module first.

Those error messages tell me where to look.

A separate question - did you try using the phpass module to keep the passwords? did it work?

(drupal uses md5, phpbb3 uses phpass. that module is supposed to convert existing passwords, then importing the userdata should work as expected - but I have not tested it.)

also, were there any users listed in the phpbb2drupal_temp_user table?

No - I didnt try the phpass module
No - tempo_user is empty

----------------------------

Now, as I know I had a problem when first running the user import step I'm going to clear and run the module again. I dont want to try the phpass module as it's adding a another layer of complexity - I might give it a shot when/if I get the user names imported as well!

;)

Naheem you're a STAR for making this module!
Moshe you're a STAR for making the little phpbb3 amendment!
It worked a treat. I just had to step back... take a deep breath and start from the beginning.

1. cleaned up both drupal and phpbb3 databases to remove redundant data and streamline the database sizes.
2. installed modules (included the excellent advanced Forum Module)
3. Installed vanilla php2drupal module and overwrote with Moshe's modification
4. Ran the upgrade... had a few minor problems (ie: a some intiial forum posts are duplicated) but on the whole it worked!!!

I now have all forums, users and posts. you can check it here http://www.bullworker.com/forum (attachments and polls didnt work but hey... in the words of Vicki Pollard - Do I look bovvered?)

Great Stuff.

So does this mean I can say now that I contributed something to the Drupal community? Ho, what a joyful day! HAPPY HAPPY JOY JOY

Request: Could it be set so that users with the same name aren't deleted, just the name changed?

Also, if two users have the same email, to be merged?

Can you put that in its own issue? This issue is only to do with supporting phpbb3.

Saying that, these little modifications for corner cases will probably not be coded for unless someone steps up to do the work.

If there are only a few duplicated accounts, you should be able enter "dummy" data into the phpbb2drupal_temp_user table to map the phpbb users to the same drupal account. (import users, for each duplicate, delete the user, in that table change the drupal user id to match the account you kept, then import the other stuff.)

that was my idea... but still, how do i import phpbb3? does this work yet? It isn't very clear...

that is still a work in progress. Some things work, others not so much. current status (for Drupal 5) is in comment 49.

Ok, Current HEAD *Should*:

1. Import Users, but the passwords will not work. If allowing import of users with 0 posts, the module will also import about 52 dummy accounts that phpbb 3 sets up for various crawlers/search engines.
2. Import forums and categories. It will also create a forum for each "link" forum in the phpBB forum. Not sure if this should be avoided or not.
3. Import all topics/polls as topics. If people want the poll data attached to the topic in phpbb3, create an additional module to do so (to adv_poll, not poll.module - there are subtle differences in how they work.)
4. Import comments.

I have no idea about the attachments - I have just fixed an obvious bug that may fix it, or it may not.

Private Message import will NOT work.

PS this is all for Drupal 6.

HEAD should now be totally phpbb3 ready.

1. the phpass module is a required dependency and user passwords are inserted into the user_phpass table. If properly set up this module should allow users to keep their passwords. This step will need to be documented.
2. Forums topic and polls are both treated as forum topics. The ability to import polls has been dropped. if it is wanted, someone can create a contrib module.
3. I have not tested the attachments import(i have also not tested the import from phpbb2 to drupal 6 either). It should work. If not, open a new bug report.

4. Private messages should be imported into the new privatemsg module. The current query to get the data is simplistic and only gets the data from one table (privmsgs), not the other (privmsgs_to, which contains data such as whether the message has been read or not) and will need to be improved once privatemsg starts to store such data. I am not much of a database person, so this will need to be done by someone else.

please test and let me know if it works or not.