Drupal Upgrade Plan 2010

From OSGeo
Revision as of 14:20, 7 October 2010 by Tmitchell (talk | contribs) (→‎web.osgeo.org server tasks: Adding a checklist for my sake :))
Jump to navigation Jump to search

Previous upgrade notes: Drupal Upgrade Plan

  • These notes are mostly just a copy of the previous upgrade, but are being modified still :)

Upgrading the OSGeo Drupal CMS is a complicated task further complicated by the use of multi-site configuration. To upgrade from current 5.3 (??) to the newest 6.x (??) version the following steps should be taken (doubles as a check list):

Time estimation

I estimate that the total read-only time for the OSGeo sites will be around 1 day if everything goes according to plan, this does not include the preliminary tasks which have to be completed prior to doing the upgrade.

Preliminary tasks

DNS Changes

Redirect any *test* instances?

Debian Package Installation

osgeo3/4 run debian linux OS. The server has no apache, drupal or any other packages already installed. Here is the list of packages to be installed to get support for our Drupal sites up and running:

  • apache2

UPDATE 6-Oct-10: The following packages have been installed: apache2 mysql5.1 php5-gd php5 php5-mysql php-5-cli

Review Module Availability

  • Which modules needed - check that all are available in 6.x

Current modules

Items marked with * are most important. Ones that are striked out are no longer needed.

Category Module 5.x version 6.x recommended version
*Administration ldapauth 5.x-1.3 6.x-1.0-beta2
ldapdata 5.x-1.3 above
ldapgroups 5.x-1.3 above
*CCK Content 5.x-1.6-1 6.x-2.8
Content Copy 5.x-1.6-1 ships with cck
Content Taxonomy 5.x-1.x-dev 6.x-1.0-rc2
Content Taxonomy Options 5.x-1.x-dev
Date 5.x-1.7 6.x-2.6
Date Copy 5.x-1.7
EMail 5.x-1.0 6.x-1.2
Fieldgroup 5.x-1.6-1 in cck main
Image (CCK module, not basic) 5.x-1.1 in cck??
Link 5.x-1.x-dev 6.x-2.9
Node Reference 5.x-1.6-1 in cck
Number 5.x-1.6-1 in cck?
Option Widgets 5.x-1.6-1 ?
Text 5.x-1.6-1 in cck?
User Reference 5.x-1.6-1 6.x-2.6
Core - optional *Aggregator 5.3 6.x-1.11 (requires PHP5 with curl support) Or is this in core already?
*Blog 5.3 in core?
Comment 5.3 in core?
Drupal 5.3
Help 5.3
*Locale 5.3 core?
*Menu-Localizer 5.3 core?
*Path 5.3 core?
*Profile 5.3 core?
Search 5.3 core?
*Statistics 5.3 core
*Taxonomy-Localizer 5.3 core
*Upload 5.3 core
*Event Basic event 5.x-1.0 6.x-2.x-dev See notes about upgrade troubles!
Event 5.x-1.0 above
Event All Day 5.x-1.0 above
Event Views 5.x-1.0 6.x-2.4
*Image Image 5.x-1.6 6.x-1.0-beta6
Image Attach 5.x-1.6 in above
Image Gallery 5.x-1.6 in above
Image Import 5.x-1.6 in above
*Localizer Localizer 5.x-1.10 NOT PORTED - development stopped
Localizer block 5.x-1.10
Localizer menu 5.x-1.10
Localizer node 5.x-1.10
Localizer taxonomy 5.x-1.10
Localizer user 5.x-1.10
Localizer variable 5.x-1.10
Localizer views 5.x-1.10
Mail Notify 5.x-1.x-dev 6.x-1.2
Other *Bookreview 5.x-1.x-dev Development stopped in 2010?
*Date API 5.x-1.7 ? which one? Date?
*Diff 5.x-1.1 6.x-2.1
*Feedback 5.x-1.x-dev 6.x-2.1
*Insert Block 5.x-1.x-dev 6.x-1.x-dev
*Insert view 5.x-1.x-dev 6.x-2.x-dev See security note
*[1] 5.x-1.2 6.x-3.7
*path_image 5.x-1.1 6.x-1.0
*Path Redirect 5.x-1.1-beta1 6.x-1.0-beta7
*PEAR Wiki filter 5.x-1.1 6.x-1.0-beta1 Note: site says to consider [http://drupal.org/project/flexifilter flexifilter instead
Permissions Sorter 5.x-1.x-dev No release after v5, no dev release
*Recent changes 5.x-1.1 6.x-1.x-dev Note: access check is broken at the moment
Search Engine Referers 5.x-1.0 6.x-1.2
Secure Pages 5.x-1.x-dev 6.x-1.8 Note: see installation notes on page for important notes
Site map 5.x-1.x-dev 6.x-2.1
*TinyMCE 5.x-1.9 6.x-1.1-dev Note: This module has been replaced by Wysiwyg API
Token 5.x-1.9 6.x-1.14
*Upload path 5.x-1.x-dev 6.x-1.0
*Spam control CAPTCHA 5.x-3.0 6.x-2.2 - NOTE: several other captcha modules listed on project page
Image CAPTCHA 5.x-3.0 ? part of above module?
Text CAPTCHA 5.x-3.0 ? part of above module?
*Syndication Syndication 5.x-1.x-dev 6.x-1.6
*Views Views 5.x-1.6 6.x-2.11
Views RSS 5.x-1.6 6.x-1.0-beta5
Views Theme Wizard 5.x-1.6 ?include in views module?
Views UI 5.x-1.6 ?include in views module?
Voting Fivestar 5.x-1.13 6.x-1.19
Fivestar Comments 5.x-1.13 Included in above?
Voting API Voting API 5.x-1.6 Deprecated?
*WebFM Web File Manager 5.x-2.4 5.x-2.x and 6.x-2.12 Note: See upgrade notes, must upgrade 5.x first

Current modules

...

Theme upgrade

Wave a magic wand to complete this step.

web.osgeo.org server tasks

  1. install packages
  2. setup webroot like this:
    • /var/www/drupal -> drupal-version
    • /var/www/site.osgeo.org (most of /var/www/drupal stuff symlinked here)
    • This way all sites have their own files directory for uploads and images)
  3. install drupal (old version) - copy over from current site (v5.3)
  4. copy all sites over
    • all
    • default
    • osgeo.org
    • fdo.osgeo.org
    • mapguide.osgeo.org
  1. upgrade to Drupal 6 (more details later) detailed guide here

Steps

  1. setup webroot as above
  2. copy osgeo1:/var/www/html over
  3. copy osgeo1:/var/www/*sites* over - HUGE
  4. osgeo1: mysqldump main site
  5. osgeo1: mysqldump multi sites
  6. create mysql db's
  7. import mysql dumps
  8. Test site works as currently
  9. check file perms
  10. Disable modules
  11. Upgrade to latest v5.x core files 5.23
  12. Upgrade module files as needed to latest v5.x
  13. run site.osgeo.org/update.php on each v5 site
  14. re-enable modules
  15. Test site works as currently

To v6.x

  1. change main drupal symlink to v6.x
  2. update module files to v6.x
  3. set up v6 sites folder for symlinks to /var/www/*sites*
  4. run update.php for each site as needed

osgeo2 server tasks

  1. download Drupal 4.7.8
  2. Download Drupal 5.3 and modules:
    • captcha
    • content (CCK)
      • date
      • imagefield
      • number (comes with CCK)
      • link (comes with CCK)
      • optionwidgets (comes with CCK)
      • text (comes with CCK)
    • diff
    • event
      • basicevent
    • feedback
    • image
      • image_gallery (part of image)
    • insert_block
    • LDAP Integration consists of:
      • ldapauth
      • ldapdata
      • ldapgroups
    • locale
      • localizer
        • localizerblock
        • localizermenu
        • localizernode
        • localizertaxonomy
        • localizeruser
        • localizerviews
    • path_image
    • pearwiki_filter
    • recent_changes
    • syndication
    • tinymce
      • imce
    • views
      • views_rss
      • views_theme_wizard
      • views_ui
    • webfm
  3. Build a new osgeo theme, visually the same as the old theme. Based on 5.3 bluemarine

These items still need doing

  1. create new directory structure
    • /var/www/drupal-5.3 (extracted from the tarball)
    • /var/www/drupal (symlnk to above)
    • /var/www/osgeo (symlink contents of drupal here)
      • /var/www/osgeo/files
    • /var/www/fdo (like osgeo)
    • /var/www/mapguide
    • /var/www/mapbender

Actual Upgrade sequence

osgeo1

  1. Make a Backup of all 4 Drupal databases and the files.
  2. Make all Drupal sites read-only by taking away write access

osgeo2

  1. Extract osgeo1 files to /var/www/drupal
  2. Create a new databases for the sites
    • drupal_osgeo
    • drupal_fdo
    • drupal_mapguide
    • drupal_mapbender
  3. Move old drupal test.osgeo.net to run on dev.osgeo.net
    1. Add dev.osgeo.conf to Apache
    2. Point osgeo.conf to /var/www/drupal
    3. Point fdo.conf to /var/www/drupal
    4. Point mapguide.conf to /var/www/drupal
    5. Point mapbender.conf to /var/www/drupal
  4. Upgrade Drupal to 4.7.8
    1. Untar drupal-4.7.8 to /var/www/drupal-4.7.8
    2. Log in as 'admin' to osgeo site
    3. Log in as 'admin' to fdo site
    4. Log in as 'admin' to mapguide site
    5. Log in as 'admin' to mapbender site
    6. Disable all non-core modules on osgeo (with mysql update) [see below]
    7. Disable all non-core modules on fdo (with mysql update) [see below]
    8. Disable all non-core modules on mapguide (with mysql update) [see below]
    9. Disable all non-core modules on mapbender (with mysql update) [see below]
    10. Switch to bluemarine theme (Drupal standard) on osgeo (with mysql update) [see below]
    11. Switch to bluemarine theme (Drupal standard) on fdo (with mysql update) [see below]
    12. Switch to bluemarine theme (Drupal standard) on mapguide (with mysql update) [see below]
    13. Switch to bluemarine theme (Drupal standard) on mapbender (with mysql update) [see below]
    14. mv /var/www/drupal /var/www/drupal-old
    15. ln -s /var/www/drupal-4.7.8 /var/www/drupal
    16. rm -rf /var/www/drupal-4.7.8/sites
    17. mv /var/www/drupal-old/sites /var/www/drupal-4.7.8
    18. point browser to test.drupal.org/update.php
    19. point browser to fdo-test.drupal.org/update.php
    20. point browser to mapguide-test.drupal.org/update.php
    21. point browser to mapbender-test.drupal.org/update.php
  5. Upgrade to 5.3
    1. log in as admin
    2. Untar drupal-5.3 to /var/www/drupal-5.3
    3. ln -s /var/www/drupal-5.3 /var/www/drupal
    4. rm -rf /var/www/drupal-5.3/sites
    5. mv /var/www/drupal-4.7.8/sites /var/www/drupal-5.3
    6. point browser to test.drupal.org/update.php
    7. point browser to fdo-test.drupal.org/update.php
    8. point browser to mapguide-test.drupal.org/update.php
    9. point browser to mapbender-test.drupal.org/update.php
  6. install missing modules
  7. enable required modules
  8. enable the osgeo theme on osgeo
  9. enable the osgeo theme on fdo
  10. enable the osgeo theme on mapguide
  11. enable the osgeo theme on mapbender
  12. dump databases and tar files and move the new site over to osgeo1


osgeo1

  1. load the new site files and databases
  2. edit apache config files to point to new sites.
    • www.drupal.org
    1. Point osgeo.conf to /var/www/drupal
    2. Point fdo.conf to /var/www/drupal
    3. Point mapguide.conf to /var/www/drupal
    4. Point mapbender.conf to /var/www/drupal

dev.osgeo.conf

 <VirtualHost 66.223.95.243:80>
   ServerName dev.osgeo.net
   DocumentRoot /var/www/html
   ErrorLog /var/log/httpd/osgeo-error_log
   CustomLog /var/log/httpd/osgeo-access_log common
  <Directory "/var/www/html">
    Options Indexes FollowSymLinks
    AllowOverride all
    Order allow,deny
    Allow from all
  </Directory>
 </VirtualHost>


edu.osgeo.conf

 <VirtualHost 66.223.95.243:80>
   ServerName edu.osgeo.net
   DocumentRoot /var/www/moodle
   ErrorLog /var/log/httpd/osgeo-error_log
   CustomLog /var/log/httpd/osgeo-access_log common
  <Directory "/var/www/moodle">
    Options Indexes FollowSymLinks
    AllowOverride all
    Order allow,deny
    Allow from all
  </Directory>
 </VirtualHost>


fdo-test.osgeo.conf

 <VirtualHost 66.223.95.243:80>
   ServerName fdo-test.osgeo.net
   DocumentRoot /var/www/fdo
   ErrorLog /var/log/httpd/osgeo-error_log
   CustomLog /var/log/httpd/osgeo-access_log common
  <Directory "/var/www/fdo">
    Options Indexes FollowSymLinks
    AllowOverride all
    Order allow,deny
    Allow from all
  </Directory>
 </VirtualHost>

mapbender.osgeo.conf

 <VirtualHost 66.223.95.243:80>
   ServerName mapbender-test.osgeo.net
   DocumentRoot /var/www/mapbender
   ErrorLog /var/log/httpd/osgeo-error_log
   CustomLog /var/log/httpd/osgeo-access_log common
  <Directory "/var/www/mapbender">
    Options Indexes FollowSymLinks
    AllowOverride all
    Order allow,deny
    Allow from all
  </Directory>
 </VirtualHost>

mapguide.osgeo.conf

 <VirtualHost 66.223.95.243:80>
   ServerName mapguide-test.osgeo.net
   DocumentRoot /var/www/mapguide
   ErrorLog /var/log/httpd/osgeo-error_log
   CustomLog /var/log/httpd/osgeo-access_log common
  <Directory "/var/www/mapguide">
    Options Indexes FollowSymLinks
    AllowOverride all
    Order allow,deny
    Allow from all
  </Directory>
 </VirtualHost>

SQL to disable all non-core modules

alter table system set status=0 where where name != 'aggregator' and
	name != 'block' and name != 'blog' and name != 'blogapi' and
	name != 'book' and name != 'comment' and name != 'contact' and
	name != 'drupal' and name != 'filter' and name != 'forum' and
	name != 'help' and name != 'legacy' and name != 'locale' and
	name != 'menu' and name != 'node' and name != 'path' and
	name != 'ping' and name != 'poll' and name != 'profile' and
	name != 'search' and name != 'statistics' and name != 'taxonomy' and
	name != 'throttle' and name != 'tracker' and name != 'upload' and
	name != 'user' and name != 'watchdog' and name != 'bluemarine';

SQL to set bluemarine as the default theme

alter table variable set value='s:10:"bluemarine";' where name='theme_default';
delete from cache;
Retrieved from "http://wiki.osgeo.org/w/index.php?title=Drupal_Upgrade_Plan_2010&oldid=50792"