Update Zimbra to 8.7 and Ubuntu 14.04 to 16.04 at the same time

[RoadRunnR]

Hi,

I recently updated our Zimbra 8.6 Patch 7 Server from Ubuntu 14.04 to 16.04 followed by a Zimbra Upgrade to 8.7. Here are some notes from the process in case anyone else want's to do the same thing.

1. shutdown Zimbra and disable autostart during the OS upgrade and make sure nobody can connect to it. Zimbra won't be able to start after the 16.04 upgrade is complete!
2. upgrade OS
3. zmcontrol won't start due to problems with perl native libraries. Unfortunately zmcontrol is needed during the update, to get it working again:
   • nuke the old perl native libraries:

     Code: Select all

     rm -rf /opt/zimbra/zimbramon/lib/x86_64-linux-gnu-thread-multi-*

   • install the required dpkg's:

     Code: Select all

     apt install libdata-uuid-perl libsocket-linux-perl

4. after that upgrade with the Zimbra 8.7 installer for Ubuntu 16.04 went through with minor warnings:
   • /usr/sbin/sendmail symlink needs fixing

     Code: Select all

     rm /usr/sbin/sendmail
     ln -s /opt/zimbra/common/sbin/sendmail /usr/sbin/sendmail
     

   • make sure you do the after upgrade steps from the official guide

Have Fun
Andreas

[rastabits]

Hello, let's see if you can help me out. We recently Upgrade our Ubuntu server from 12.X to 14.04, and as you already know Zimbra didn't start. By mistake we didn't notice that the mail server was running a the time of the ubuntu Update. Then we try to Upgrade zimbra, and some files were needed:
Checking for prerequisites...
FOUND: *.*
MISSING: libperl5.18
MISSING: libaio1
MISSING: unzip

Then we installed the missing files, OK, then proceded to Install:

root@mail:~/zcs-8.6.0_GA_1153.UBUNTU14_64.20141215151116# ./install.sh -s

Operations logged to /tmp/install.log.3270
Checking for existing installation...
zimbra-ldap...FOUND zimbra-ldap-8.0.5.GA.5839.UBUNTU12.64
zimbra-logger...FOUND zimbra-logger-8.0.5.GA.5839.UBUNTU12.64
zimbra-mta...FOUND zimbra-mta-8.0.5.GA.5839.UBUNTU12.64
zimbra-dnscache...NOT FOUND
zimbra-snmp...FOUND zimbra-snmp-8.0.5.GA.5839.UBUNTU12.64
zimbra-store...FOUND zimbra-store-8.0.5.GA.5839.UBUNTU12.64
zimbra-apache...FOUND zimbra-apache-8.0.5.GA.5839.UBUNTU12.64
zimbra-spell...FOUND zimbra-spell-8.0.5.GA.5839.UBUNTU12.64
zimbra-convertd...NOT FOUND
zimbra-memcached...NOT FOUND
zimbra-proxy...NOT FOUND
zimbra-archiving...NOT FOUND
zimbra-core...FOUND zimbra-core-8.0.5.GA.5839.UBUNTU12.64
ZCS upgrade from 8.0.5 to 8.6.0 will be performed.

Saving existing configuration file to /opt/zimbra/.saveconfig
PLEASE READ THIS AGREEMENT CAREFULLY BEFORE USING THE SOFTWARE.
Do you agree with the terms of the software license agreement? [N] y
Checking for prerequisites...
FOUND: *.*
Checking for suggested prerequisites...
FOUND: pax
FOUND: perl-5.18.2
FOUND: sysstat
FOUND: sqlite3
Prerequisite check complete.
Checking current number of databases...
Do you want to verify message store database integrity? [Y] n
Checking for installable packages

Found zimbra-core
Found zimbra-ldap
Found zimbra-logger
Found zimbra-mta
Found zimbra-dnscache
Found zimbra-snmp
Found zimbra-store
Found zimbra-apache
Found zimbra-spell
Found zimbra-memcached
Found zimbra-proxy
The Zimbra Collaboration Server appears already to be installed. It can be upgraded with no effect on existing accounts,
or the current installation can be completely removed prior to installation for a clean install.

Do you wish to upgrade? [Y] y

Select the packages to install
Upgrading zimbra-core
Upgrading zimbra-ldap
Upgrading zimbra-logger
Upgrading zimbra-mta
Install zimbra-dnscache [N]
Upgrading zimbra-snmp
Upgrading zimbra-store
Upgrading zimbra-apache
Upgrading zimbra-spell
Install zimbra-memcached [N] y
Install zimbra-proxy [N] y
Checking required space for zimbra-core
Checking space for zimbra-store
Checking required packages for zimbra-store
zimbra-store package check complete.

Installing:
*.*
The system will be modified. Continue? [N] y
Shutting down zimbra mail
Backing up the ldap database...done.
Removing existing packages
*.*
Removing deployed webapp directories
Installing packages
zimbra-core......zimbra-core_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done
zimbra-ldap......zimbra-ldap_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done
zimbra-logger......zimbra-logger_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done
zimbra-mta......zimbra-mta_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done
zimbra-snmp......zimbra-snmp_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done
zimbra-store......zimbra-store_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done
zimbra-apache......zimbra-apache_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done
zimbra-spell......zimbra-spell_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done
zimbra-memcached......zimbra-memcached_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done
zimbra-proxy......zimbra-proxy_8.6.0.GA.1153.UBUNTU14.64_amd64.deb...done

Setting defaults from saved config in /opt/zimbra/.saveconfig/config.save
HOSTNAME=mail.xxxx.gob.xx
LDAPHOST=mail.xxxx.gob.xx
LDAPPORT=389
SNMPTRAPHOST=mail.xxxx.gob.xx
SMTPSOURCE=admin@xxxx.gob.xx
SMTPDEST=admin@xxxx.gob.xx
SNMPNOTIFY=yes
SMTPNOTIFY=yes
LDAPROOTPW=Hj0XrUKb
LDAPZIMBRAPW=Hj0XrUKb
LDAPPOSTPW=Hj0XrUKb
LDAPREPPW=Hj0XrUKb
LDAPAMAVISPW=Hj0XrUKb
LDAPNGINXPW=Hj0XrUKb
Restoring existing configuration file from /opt/zimbra/.saveconfig/localconfig.xml...done

Software Installation complete!
************************************************
And although the Installation process looked like it went Ok, we ran into more problems.

Then we check: zimbra@mail:/root$ zmcontrol -v and got this message:

Perl API version v5.14.0 of Socket does not match v5.18.0 at /usr/share/perl/5.18/XSLoader.pm line 92.
Compilation failed in require at /usr/lib/perl/5.18/Sys/Syslog.pm line 10.
BEGIN failed--compilation aborted at /usr/lib/perl/5.18/Sys/Syslog.pm line 10.
Compilation failed in require at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Logger.pm line 21.
BEGIN failed--compilation aborted at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Logger.pm line 21.
Compilation failed in require at /opt/zimbra/bin/zmcontrol line 27.
BEGIN failed--compilation aborted at /opt/zimbra/bin/zmcontrol line 27.

Note: - We also update Perl-

Here is the Log of the Zimbra Install:

Jul 28 11:14:01 mail zmmailboxdmgr[30023]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jul 28 11:14:01 mail zmmailboxdmgr[30023]: assuming no other instance is running
Jul 28 11:14:01 mail zmmailboxdmgr[30023]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jul 28 11:14:01 mail zmmailboxdmgr[30023]: assuming no other instance is running
Jul 28 11:14:01 mail zmmailboxdmgr[30023]: no manager process is running
Jul 28 11:16:02 mail zmmailboxdmgr[30428]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
(Reading database ... 81643 files and directories currently installed.)
Preparing to unpack .../zimbra-snmp_8.6.0.GA.1153.UBUNTU14.64_amd64.deb ...
Unpacking zimbra-snmp (8.6.0.GA.1153.UBUNTU14.64) ...
Setting up zimbra-snmp (8.6.0.GA.1153.UBUNTU14.64) ...
Selecting previously unselected package zimbra-store.
(Reading database ... 82206 files and directories currently installed.)
Preparing to unpack .../zimbra-store_8.6.0.GA.1153.UBUNTU14.64_amd64.deb ...
Unpacking zimbra-store (8.6.0.GA.1153.UBUNTU14.64) ...
Setting up zimbra-store (8.6.0.GA.1153.UBUNTU14.64) ...
ln -s /opt/zimbra/jetty-distribution-7.6.12.v20130726 /opt/zimbra/jetty
Selecting previously unselected package zimbra-apache.
(Reading database ... 109745 files and directories currently installed.)
Preparing to unpack .../zimbra-apache_8.6.0.GA.1153.UBUNTU14.64_amd64.deb ...
Unpacking zimbra-apache (8.6.0.GA.1153.UBUNTU14.64) ...
Setting up zimbra-apache (8.6.0.GA.1153.UBUNTU14.64) ...
Selecting previously unselected package zimbra-spell.
(Reading database ... 111448 files and directories currently installed.)
Preparing to unpack .../zimbra-spell_8.6.0.GA.1153.UBUNTU14.64_amd64.deb ...
Unpacking zimbra-spell (8.6.0.GA.1153.UBUNTU14.64) ...
Setting up zimbra-spell (8.6.0.GA.1153.UBUNTU14.64) ...
Selecting previously unselected package zimbra-memcached.
(Reading database ... 111870 files and directories currently installed.)
Preparing to unpack .../zimbra-memcached_8.6.0.GA.1153.UBUNTU14.64_amd64.deb ...
Unpacking zimbra-memcached (8.6.0.GA.1153.UBUNTU14.64) ...
Setting up zimbra-memcached (8.6.0.GA.1153.UBUNTU14.64) ...
Selecting previously unselected package zimbra-proxy.
(Reading database ... 111936 files and directories currently installed.)
Preparing to unpack .../zimbra-proxy_8.6.0.GA.1153.UBUNTU14.64_amd64.deb ...
Unpacking zimbra-proxy (8.6.0.GA.1153.UBUNTU14.64) ...
Setting up zimbra-proxy (8.6.0.GA.1153.UBUNTU14.64) ...

Any Idea of what's the problem? I do certainly know about the Perl problem and the zmmailboxd_manager.pid not existing, but got no Clue on what to do first

Thank you in advanced!!
Rafael

[L. Mark Stone]

Not sure your subject line matches what I see in the logs, but that's not likely the core issue.

When you upgrade the operating system, the very next Zimbra install you need to do is the SAME Zimbra build as was on the old operating system, but compiled for the new operating system.

So, if you really did start at Ubuntu 12 and Zimbra 8.0.5, you should have:

- Upgraded Zimbra to 8.6.0 on Ubuntu 12.
- Upgraded Ubuntu 12 to Ubuntu 14.
- Installed Zimbra 8.6.0 compiled for Ubuntu 14.
- Upgraded Zimbra to 8.7.0 on Ubuntu 14.
- Upgraded Ubuntu 14 to Ubuntu 16.
- Installed Zimbra 8.7.0 compiled for Ubuntu 16 (beta).

Put differently, I don't believe Zimbra 8.6.0 compiled for Ubuntu 14 can successfully upgrade Zimbra 8.0.5 compiled for Ubuntu 12. I've never done that; probably best for you to open a support ticket with Zimbra to see if you can resurrect the system as it now stands.

Hope that helps,
Mark

[rastabits]

Thank you so much for such a fast answer Mark

I think we are really in trouble here. Is there by any chance a way to do a Fresh install of Zimbra and still use our existing accounts (with all their messages )?

Your suggestion of opening a "support ticket with Zimbra to see if you can resurrect the system as it now stands." althoug seems to be a nice idea, not sure if they can assist Us, as we are using a non paid version.

I was thinking to find out a way to get back to Ubuntu 12, and try to get zimbra back as it was before (sadly we don't have a backup), thus i will start googling to see what can i find. Sure i will open the ticket to see if can get help.

Again thank you so much!

[L. Mark Stone]

Thank you so much for such a fast answer Mark

I think we are really in trouble here. Is there by any chance a way to do a Fresh install of Zimbra and still use our existing accounts (with all their messages )?

Your suggestion of opening a "support ticket with Zimbra to see if you can resurrect the system as it now stands." althoug seems to be a nice idea, not sure if they can assist Us, as we are using a non paid version.

I was thinking to find out a way to get back to Ubuntu 12, and try to get zimbra back as it was before (sadly we don't have a backup), thus i will start googling to see what can i find. Sure i will open the ticket to see if can get help.

Again thank you so much!

Well I'm glad we identified the root cause of the issue but it is true with the OSE you have no support. I don't know how, or even if you can, downgrade the operating system. I also know Zimbra have repeatedly admonished users never to attempt a downgrade of Zimbra ever.

So I think you are at the point where you need a new Zimbra server, using the "install -s" migration strategy described here: https://wiki.zimbra.com/wiki/Ajcody-Not ... e-32-To-64

The process works like this (but be sure to follow the wiki for the exact procedures):

- Build a new Zimbra server and install the same version of Zimbra as you are currently running now using the -s switch (i.e. ./install.sh -s)
- Copy over /opt/zimbra/store and some other directories, including /opt/zimbra/.saveconfig from the old server
- Dump LDAP from the old server and import into the new server
- Rerun the installer on the new server, this time without the -s switch

Hope that helps,
Mark

[rastabits]

So I think you are at the point where you need a new Zimbra server, using the "install -s" migration strategy described here: https://wiki.zimbra.com/wiki/Ajcody-Not ... e-32-To-64
The process works like this (but be sure to follow the wiki for the exact procedures):
- Build a new Zimbra server and install the same version of Zimbra as you are currently running now using the -s switch (i.e. ./install.sh -s)
- Copy over /opt/zimbra/store and some other directories, including /opt/zimbra/.saveconfig from the old server
- Dump LDAP from the old server and import into the new server
- Rerun the installer on the new server, this time without the -s switch
Hope that helps,
Mark

I have to agree that this should be the best scenario. While reading about Ubuntu Downgrade i can ran into more problems than doing a fresh install. Let's see what can i do to solve this. Just hope the Import of mailboxes structure and messages between versions run as smooth as possibe to avoid data loss.

Thank you so much for your help Mark!


-------------------
Rafael

[rastabits]

So I think you are at the point where you need a new Zimbra server, using the "install -s" migration strategy described here: https://wiki.zimbra.com/wiki/Ajcody-Not ... e-32-To-64

The process works like this (but be sure to follow the wiki for the exact procedures):

- Build a new Zimbra server and install the same version of Zimbra as you are currently running now using the -s switch (i.e. ./install.sh -s)
- Copy over /opt/zimbra/store and some other directories, including /opt/zimbra/.saveconfig from the old server
- Dump LDAP from the old server and import into the new server
- Rerun the installer on the new server, this time without the -s switch

Hope that helps,
Mark

Hello Mark, finaly my problem got solved. Just before you suggest me to ask for Help @Zimbra, i asked them if they have some Support Trial service (which they don't), but although the answer was NO, they were very kind to listen to my problem, and then suggest me to do as follow:

./install.sh --skip-upgrade-check

And Voila! it started working again!

So this message here in is to Thank you for your kind support.


Qudos,

Rafael Mejia

[L. Mark Stone]

So I think you are at the point where you need a new Zimbra server, using the "install -s" migration strategy described here: https://wiki.zimbra.com/wiki/Ajcody-Not ... e-32-To-64

The process works like this (but be sure to follow the wiki for the exact procedures):

- Build a new Zimbra server and install the same version of Zimbra as you are currently running now using the -s switch (i.e. ./install.sh -s)
- Copy over /opt/zimbra/store and some other directories, including /opt/zimbra/.saveconfig from the old server
- Dump LDAP from the old server and import into the new server
- Rerun the installer on the new server, this time without the -s switch

Hope that helps,
Mark

Hello Mark, finaly my problem got solved. Just before you suggest me to ask for Help @Zimbra, i asked them if they have some Support Trial service (which they don't), but although the answer was NO, they were very kind to listen to my problem, and then suggest me to do as follow:

./install.sh --skip-upgrade-check

And Voila! it started working again!

So this message here in is to Thank you for your kind support.


Qudos,

Rafael Mejia

So glad that worked for you and that Zimbra is running now! And thanks for posting the solution here as well!

All the best,
Mark

[zaval4ik]

Hi guys!
Tell me what can be the problem zimbra 8.6.0 ubuntu 14.04 updated ubuntu 16.04. The zimbra service does not start!

[L. Mark Stone]

Hi guys!
Tell me what can be the problem zimbra 8.6.0 ubuntu 14.04 updated ubuntu 16.04. The zimbra service does not start!

Best to start by letting us know exactly what you did; log files, specific error messages etc.

Zimbra can fail to start for a number of reasons, so we need you to get us some specifics so we can help you narrow things down.

All the best,
Mark