Problem installing 9, NG Modules not installing. (Solved)

Ask questions about your setup or get help installing ZCS server (ZD section below).
yellowhousejake
Advanced member
Advanced member
Posts: 129
Joined: Tue Sep 09, 2014 9:57 am
ZCS/ZD Version: Release 10.0.1.GA.4518.UBUNTU20_64

Problem installing 9, NG Modules not installing. (Solved)

Post by yellowhousejake »

Good day,

zimbra@zimbra:~/migrate$ uname -a
Linux zimbra 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
zimbra@zimbra:~/migrate$ zmcontrol -v
Release 9.0.0.GA.4178.UBUNTU20.64 UBUNTU20_64 NETWORK edition, Patch 9.0.0_P30.

We are trying to build a new server to replace our 8.8.9 server and it's not going well. I have been in contact with support and found no solution. Currently, the install goes fine and everything starts up and runs. It seems like a clean installation. I have been working on migration scripts and I can move all our accounts and their preferences/filters/calendar/signatures/OOOReplies without problems. I have tested and completed a full maillbox export from the old server and import to the new server and all mail is properly moved. Other than some small issues like zmstats picking up the snap devices it has been painless.

Except, I cannot get the NG modules to "stick". The installer did not install or deploy them. The CLI commands support provided did not install and deploy them either. I can get them installed from the CLI with,

zmzimletctl deploy com_zextras_zextras.zip
zmmailboxdctl restart

I can then see HSM, Backup, Mobile, Admin, but the next time I login they are gone.

zmprov shows the modules are enabled. We have verified and activated our license multiple times with no change. At last contact support asked for log files and provided a ftp drop to me but the user/pass did not work. That was last week and I have not heard back from support.

Has anyone run into this behavior? Is there a fix? Can I provide more info?

Thank You,

DAve
Last edited by yellowhousejake on Thu Jun 01, 2023 3:11 pm, edited 1 time in total.
yellowhousejake
Advanced member
Advanced member
Posts: 129
Joined: Tue Sep 09, 2014 9:57 am
ZCS/ZD Version: Release 10.0.1.GA.4518.UBUNTU20_64

Re: Problem installing 9, NG Modules not installing.

Post by yellowhousejake »

Additional info, the NG modules were not available when I logged back into the admin portal after my last post.

zimbra@zimbra:~/migrate$ zmzimletctl listZimlets
Installed Zimlet files on this host:
com_zextras_zextras
com_zimbra_archive
com_zimbra_backuprestore
com_zimbra_connect_classic
com_zimbra_connect_modern
com_zimbra_convertd
com_zimbra_delegatedadmin
com_zimbra_hsm
com_zimbra_license
com_zimbra_mobilesync
com_zimbra_securemail
com_zimbra_smime
com_zimbra_smime_cert_admin
com_zimbra_two_factor_auth
com_zimbra_viewmail
com_zimbra_voiceprefs
com_zimbra_xmbxsearch
zimbra-zimlet-additional-signature-setting
zimbra-zimlet-calendar-subscription
zimbra-zimlet-date
zimbra-zimlet-emptysubject
zimbra-zimlet-install-pwa
zimbra-zimlet-restore-contacts
zimbra-zimlet-set-default-client
Installed Zimlets in LDAP:
com_zimbra_connect_classic
com_zimbra_connect_modern
com_zimbra_securemail
com_zimbra_smime
com_zimbra_voiceprefs
zimbra-zimlet-additional-signature-setting
zimbra-zimlet-calendar-subscription
zimbra-zimlet-date
zimbra-zimlet-emptysubject
zimbra-zimlet-install-pwa
zimbra-zimlet-restore-contacts
zimbra-zimlet-set-default-client
Available Zimlets in COS:
default:
com_zimbra_connect_classic
com_zimbra_connect_modern
com_zimbra_voiceprefs
zimbra-zimlet-additional-signature-setting
zimbra-zimlet-date
zimbra-zimlet-restore-contacts
zimbra-zimlet-set-default-client
defaultExternal:
no_list:

================= After I redeploy

zimbra@zimbra:~/migrate$ cd ../zimlets
zimbra@zimbra:~/zimlets$ zmzimletctl deploy com_zextras_zextras.zip
2023-05-09 15:13:58,069 [main] INFO : Deploying Zimlet com_zextras_zextras in LDAP.
2023-05-09 15:13:58,084 [main] INFO : Installing Zimlet com_zextras_zextras on this host.
zimbra@zimbra:~/zimlets$ zmstatctl restart
Terminating process 929066
Terminating process 929031
Terminating process 929018
Terminating process 929006
Terminating process 929023
Terminating process 929004
Terminating process 929089
Terminating process 929013
Terminating process 929002
Terminating process 929000
Terminating process 929042
Terminating process 928997
Terminating process 929009
Invoking: /opt/zimbra/libexec/zmstat-proc
Invoking: /opt/zimbra/libexec/zmstat-cpu
Invoking: /opt/zimbra/libexec/zmstat-vm
Invoking: /opt/zimbra/libexec/zmstat-io -x
Invoking: /opt/zimbra/libexec/zmstat-df
Invoking: /opt/zimbra/libexec/zmstat-io
Invoking: /opt/zimbra/libexec/zmstat-fd
Invoking: /opt/zimbra/libexec/zmstat-allprocs
Invoking: /opt/zimbra/libexec/zmstat-mysql
Invoking: /opt/zimbra/libexec/zmstat-convertd
Invoking: /opt/zimbra/libexec/zmstat-mtaqueue
Invoking: /opt/zimbra/libexec/zmstat-nginx
Invoking: /opt/zimbra/libexec/zmstat-ldap
zimbra@zimbra:~/zimlets$ zmzimletctl listZimlets
Installed Zimlet files on this host:
com_zextras_zextras
com_zimbra_archive
com_zimbra_backuprestore
com_zimbra_connect_classic
com_zimbra_connect_modern
com_zimbra_convertd
com_zimbra_delegatedadmin
com_zimbra_hsm
com_zimbra_license
com_zimbra_mobilesync
com_zimbra_securemail
com_zimbra_smime
com_zimbra_smime_cert_admin
com_zimbra_two_factor_auth
com_zimbra_viewmail
com_zimbra_voiceprefs
com_zimbra_xmbxsearch
zimbra-zimlet-additional-signature-setting
zimbra-zimlet-calendar-subscription
zimbra-zimlet-date
zimbra-zimlet-emptysubject
zimbra-zimlet-install-pwa
zimbra-zimlet-restore-contacts
zimbra-zimlet-set-default-client
Installed Zimlets in LDAP:
com_zimbra_connect_classic
com_zimbra_connect_modern
com_zimbra_securemail
com_zimbra_smime
com_zimbra_voiceprefs
zimbra-zimlet-additional-signature-setting
zimbra-zimlet-calendar-subscription
zimbra-zimlet-date
zimbra-zimlet-emptysubject
zimbra-zimlet-install-pwa
zimbra-zimlet-restore-contacts
zimbra-zimlet-set-default-client
Available Zimlets in COS:
default:
com_zimbra_connect_classic
com_zimbra_connect_modern
com_zimbra_voiceprefs
zimbra-zimlet-additional-signature-setting
zimbra-zimlet-date
zimbra-zimlet-restore-contacts
zimbra-zimlet-set-default-client
defaultExternal:
no_list:

NG Modules are available again, or until an amount of time passes.

DAve
pajari
Zimbra Employee
Zimbra Employee
Posts: 25
Joined: Mon Apr 09, 2018 10:27 am

Re: Problem installing 9, NG Modules not installing.

Post by pajari »

Hi Dave,

Do you see any errors related to NG extensions/zimlets in mailbox.log during startup or when you login to Admin console, Web client.

Issue you are facing looks similar to viewtopic.php?t=63954

If you are ok with NG packages upgrade, then you can refer
https://wiki.zimbra.com/wiki/Zimbra_Rel ... stallation >> Installing NG packages and upgrade zimbra-network-modules-ng and any other NG packages in use.

Code: Select all

apt-get update
apt-get install zimbra-network-modules-ng
apt-get install zimbra-connect
apt-get install <any other NG packages>

su - zimbra
zmmailboxdctl restart
Before upgrade, you can check if NG packages versions are latest (https://wiki.zimbra.com/wiki/Zimbra_Releases/9.0.0/P30). If not latest, then upgrade with above steps can be tried.

Thanks
yellowhousejake
Advanced member
Advanced member
Posts: 129
Joined: Tue Sep 09, 2014 9:57 am
ZCS/ZD Version: Release 10.0.1.GA.4518.UBUNTU20_64

Re: Problem installing 9, NG Modules not installing.

Post by yellowhousejake »

Pajari,

I believe support already had me do this. If I am wrong, please correct me and I will follow the instructions you provided. The below instructions had no effect.

------ Zimbra Support instructions followed on May 5th ------------
as root

apt-get update -y
apt-get install --reinstall zimbra-network-modules-ng

su - zimbra

for zimlet in `ls -1 /opt/zimbra/zimlets-deployed`; do zmzimletctl undeploy $zimlet; done

for zimlet in `ls -1 /opt/zimbra/zimlets | grep -v click2call | grep -v ucconfig`; do zmzimletctl deploy /opt/zimbra/zimlets/$zimlet; done

for zimlet in `ls -1 /opt/zimbra/zimlets-network | grep -v click2call | grep -v ucconfig`; do zmzimletctl deploy /opt/zimbra/zimlets-network/$zimlet; done

zmprov fc zimlet
zmmailboxdctl restart
yellowhousejake
Advanced member
Advanced member
Posts: 129
Joined: Tue Sep 09, 2014 9:57 am
ZCS/ZD Version: Release 10.0.1.GA.4518.UBUNTU20_64

Re: Problem installing 9, NG Modules not installing.

Post by yellowhousejake »

Pajari,

Looking at your post, I have two questions.

1) In /opt/zimbra/zimlets-deployed I have com_zextras_zextras.zip, but I also have com_zimbra_mobilesync.zip, com_zimbra_hsm.zip, com_zimbra_backuprestore.zip. I thought that hsm, mobile, and backup were part of zextras. My question - "What are the NG modules, are they not the zextras zimlets?"

2) In your post you referred me to the link for the Zimbra release for v9 patch 30. That is the version I have installed but the list of zimlets and the current version does not show any of the zimlets/NG Modules/Zextras I am having trouble with. I have not been able to find a list of current version numbers for each module/zimlet/zextra. My question - "Do you have a link to that information or does the package zimbra-network-modules-ng contain the all the zimlets?"

The link you provided shows the following.
zimbra-network-modules-ng -> 7.0.29.1672292651-1

When I check apt install apt-show-versions I show the following for that package.
zimbra-network-modules-ng:amd64/focal 7.0.30.1679933727-1.u20 uptodate

I believe I am up to date on the package/module/zimlets

Thanks for your response, I do appreciate it.

DAve
User avatar
L. Mark Stone
Ambassador
Ambassador
Posts: 2796
Joined: Wed Oct 09, 2013 11:35 am
Location: Portland, Maine, US
ZCS/ZD Version: 10.0.6 Network Edition
Contact:

Re: Problem installing 9, NG Modules not installing.

Post by L. Mark Stone »

For some reason, order of operations is critically important.

Support previously provided the following, which worked for our customer, starting as the root user:

Code: Select all

   apt-get remove zimbra-network-modules-ng
   su - zimbra
   zmzimletctl undeploy com_zextras_client
   zmzimletctl undeploy com_zextras_zextras
   zmmailboxdctl restart
   exit
   apt-get install zimbra-network-modules-ng
   su - zimbra
   zmmailboxdctl restart
Hope that helps,
Mark
___________________________________
L. Mark Stone
Mission Critical Email - Zimbra VAR/BSP/Training Partner https://www.missioncriticalemail.com/
AWS Certified Solutions Architect-Associate
yellowhousejake
Advanced member
Advanced member
Posts: 129
Joined: Tue Sep 09, 2014 9:57 am
ZCS/ZD Version: Release 10.0.1.GA.4518.UBUNTU20_64

Re: Problem installing 9, NG Modules not installing.

Post by yellowhousejake »

Mark,

I logged into the server this afternoon and the NG Modules were there in the left pane. That was a pleasant surprise, unfortunately they are not working. The backup module says it is not running and offers a button to start it, the button does nothing. Nothing is logged that I saw in the /var/log/zimbra.log.

I followed your procedure exactly, with the below results.

DAve

root@zimbra:/opt/zimbra/log# apt-get remove zimbra-network-modules-ng
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages will be REMOVED:
zimbra-connect zimbra-connect-modern zimbra-network-modules-ng
0 upgraded, 0 newly installed, 3 to remove and 30 not upgraded.
After this operation, 125 MB disk space will be freed.
Do you want to continue? [Y/n] y
(Reading database ... 156522 files and directories currently installed.)
Removing zimbra-connect (2.0.22.1635424388-1.u20) ...
Removing zimbra-connect-modern (1.0.22.1635424388-1.u20) ...
Removing zimbra-network-modules-ng (7.0.30.1679933727-1.u20) ...
root@zimbra:/opt/zimbra/log# su - zimbra
zimbra@zimbra:~$ zmzimletctl undeploy com_zextras_client
2023-05-10 12:05:11,900 [main] INFO : Uninstalling Zimlet com_zextras_client from LDAP.
2023-05-10 12:05:12,338 [main] INFO : undeploying zimlet com_zextras_client
2023-05-10 12:05:12,340 [main] INFO : zimlet directory com_zextras_client is deleted
zimbra@zimbra:~$ zmzimletctl undeploy com_zextras_zextras
2023-05-10 12:05:24,021 [main] INFO : Uninstalling Zimlet com_zextras_zextras from LDAP.
2023-05-10 12:05:24,510 [main] INFO : Removing Zimlet com_zextras_zextras from COS default
2023-05-10 12:05:24,530 [main] INFO : Removing Zimlet com_zextras_zextras from COS defaultExternal
2023-05-10 12:05:24,535 [main] INFO : Removing Zimlet com_zextras_zextras from COS no_list
2023-05-10 12:05:24,544 [main] INFO : undeploying zimlet com_zextras_zextras
2023-05-10 12:05:24,573 [main] INFO : zimlet directory com_zextras_zextras is deleted
zimbra@zimbra:~$ zmmailboxdctl restart
Stopping mailboxd...done.
Starting mailboxd...done.
zimbra@zimbra:~$ exit
logout
root@zimbra:/opt/zimbra/log# apt-get install zimbra-network-modules-ng
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
zimbra-network-modules-ng
0 upgraded, 1 newly installed, 0 to remove and 30 not upgraded.
Need to get 0 B/99.1 MB of archives.
After this operation, 110 MB of additional disk space will be used.
Selecting previously unselected package zimbra-network-modules-ng.
(Reading database ... 156507 files and directories currently installed.)
Preparing to unpack .../zimbra-network-modules-ng_7.0.30.1679933727-1.u20_amd64.deb ...
Installing zimbra-network-modules-ng
Unpacking zimbra-network-modules-ng (7.0.30.1679933727-1.u20) ...
Setting up zimbra-network-modules-ng (7.0.30.1679933727-1.u20) ...
Configuring zimbra-network-modules-ng
Checking mailboxd running.
mailboxd is running.
Deploying zimbra-network-modules-ng zimlets
2023-05-10 12:06:57,047 [main] INFO : Deploying Zimlet com_zextras_client in LDAP.
2023-05-10 12:06:57,106 [main] INFO : Installing Zimlet com_zextras_client on this host.
2023-05-10 12:06:57,148 [main] INFO : Upgrading Zimlet com_zextras_client to 3.16.1
2023-05-10 12:06:57,169 [main] INFO : Adding Zimlet com_zextras_client to COS default
2023-05-10 12:06:57,184 [main] INFO : Enabling Zimlet com_zextras_client
2023-05-10 12:06:59,069 [main] INFO : Deploying Zimlet com_zextras_zextras in LDAP.
2023-05-10 12:06:59,113 [main] INFO : Installing Zimlet com_zextras_zextras on this host.
2023-05-10 12:06:59,216 [main] INFO : Upgrading Zimlet com_zextras_zextras to 3.16.1
2023-05-10 12:06:59,231 [main] INFO : Enabling Zimlet com_zextras_zextras
Installation Completed.
Restart the mailbox service as zimbra user. Run
su - zimbra
zmmailboxdctl restart
root@zimbra:/opt/zimbra/log# su - zimbra
zimbra@zimbra:~$ zmmailboxdctl restart
Stopping mailboxd...done.
Starting mailboxd...done.
yellowhousejake
Advanced member
Advanced member
Posts: 129
Joined: Tue Sep 09, 2014 9:57 am
ZCS/ZD Version: Release 10.0.1.GA.4518.UBUNTU20_64

Re: Problem installing 9, NG Modules not installing.

Post by yellowhousejake »

Logged out, logged back in an hour later and the NG is gone from the left pane.

This is becoming silly. We have used Zimbra since 2014 and problems have never been a part of the Zimbra experience.

DAve
pajari
Zimbra Employee
Zimbra Employee
Posts: 25
Joined: Mon Apr 09, 2018 10:27 am

Re: Problem installing 9, NG Modules not installing.

Post by pajari »

Dave,

Can you please provide output for:

Code: Select all

zmprov gs `zmhostname`  | grep -i zimbranetwork
To answer your earlier question,
zimbra-network-modules-ng package installs NG modules and required admin extensions/user zimlets.
com_zextras_zextras admin extension is used for NG Admin UI.
com_zimbra_mobilesync.zip, com_zimbra_hsm.zip, com_zimbra_backuprestore.zip are legacy admin extensions and are loaded only if zimbraNetworkAdminEnabled server attribute is TRUE. In case of Zimbra server with NG installed, zimbraNetworkAdminEnabled should be FALSE and zimbraNetworkAdminNGEnabled should be TRUE on mailstore server.
pajari
Zimbra Employee
Zimbra Employee
Posts: 25
Joined: Mon Apr 09, 2018 10:27 am

Re: Problem installing 9, NG Modules not installing.

Post by pajari »

zimbraNetworkAdminEnabled attribute is deprecated in 9.0. So, if you have zimbraNetworkModulesNGEnabled=TRUE and zimbraNetworkAdminNGEnabled=TRUE, then NG Admin UI should be loaded.

Also, can you check if you do zmmailboxdctl restart and monitor /opt/zimbra/log/mailbox.log file, do you see any exceptions?
Post Reply