Revamped Zimbra live sync stuff

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
Post Reply
User avatar
maxxer
Outstanding Member
Outstanding Member
Posts: 224
Joined: Fri Oct 04, 2013 2:12 am
Contact:

Revamped Zimbra live sync stuff

Post by maxxer »

Hi.

I've resumed the Zimbra Live sync page and made scripts out of it, which are now live on GitLab.com open for collaboration!

From the wiki page:
This is an experimental solution to providing near-live synchronisation between two Zimbra servers so that one of them is live and the other is kept in a warm or very warm standby state.

The system is symmetrical. The sync can work in reverse when the mirror server becomes the active server. This allows easy fall-back to the original server once the failover condition is resolved.
Feedback and contributions are welcome.
myzamri
Posts: 20
Joined: Tue Mar 28, 2017 2:46 am

Re: Revamped Zimbra live sync stuff

Post by myzamri »

TQ. Does it work with recent zimbra?
User avatar
maxxer
Outstanding Member
Outstanding Member
Posts: 224
Joined: Fri Oct 04, 2013 2:12 am
Contact:

Re: Revamped Zimbra live sync stuff

Post by maxxer »

myzamri wrote:TQ. Does it work with recent zimbra?
Yes, it's agnostic about versions because it uses zimbra's tools. I'm using it on 8.7.11, but there should be no breaking change to 8.8
User avatar
zimico
Outstanding Member
Outstanding Member
Posts: 225
Joined: Mon Nov 14, 2016 8:03 am
Location: Vietnam
ZCS/ZD Version: 8.8.15 P3
Contact:

Re: Revamped Zimbra live sync stuff

Post by zimico »

Thank maxxer for your kind contribution.
Regards.
alogicking
Posts: 31
Joined: Tue Aug 14, 2018 12:53 pm
Location: India
ZCS/ZD Version: 8.8.15_GA_3829.RHEL7_64_FOSS P12

Re: Revamped Zimbra live sync stuff

Post by alogicking »

Hi All,

I am using a single server installation and was using the RHEL7_64 FOSS edition, Patch 8.8.9_P7 and Live sysnc script was working fine all this days.

Yesterday I upgraded my email server with RHEL7_64 FOSS edition, Patch 8.8.11_P2 and now while doing live sync, we are getting the below error in the live sync log:

Code: Select all

Sun Feb 10 03:47:04 PST 2019 :Syncing /opt/zimbra/redolog/redo.log
Sun Feb 10 03:47:04 PST 2019 :Syncing /opt/zimbra/redolog/redo.log done
Sun Feb 10 03:47:04 PST 2019 :Syncing redologs done
Sun Feb 10 03:47:04 PST 2019 :Purging redolog directory and archives
Sun Feb 10 03:47:04 PST 2019 :Purge redolog directory and archives done
Sun Feb 10 03:47:06 PST 2019 :Replaying redologs...
Exception in thread "main" java.lang.NoClassDefFoundError: graphql/GraphQLError
        at com.zimbra.graphql.resources.GQLExtension.init(GQLExtension.java:49)
        at com.zimbra.cs.extension.ExtensionUtil.initAllMatching(ExtensionUtil.java:128)
        at com.zimbra.cs.extension.ExtensionUtil.initAll(ExtensionUtil.java:154)
        at com.zimbra.cs.util.Zimbra.startup(Zimbra.java:267)
        at com.zimbra.cs.util.Zimbra.startupCLI(Zimbra.java:185)
        at com.zimbra.cs.redolog.util.PlaybackUtil.setup(PlaybackUtil.java:394)
        at com.zimbra.cs.redolog.util.PlaybackUtil.main(PlaybackUtil.java:369)
Caused by: java.lang.ClassNotFoundException: graphql.GraphQLError
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 7 more
Sun Feb 10 03:47:10 PST 2019 :Replay of redolog failed
Sun Feb 10 03:47:10 PST 2019 :Replaying redologs done
Sun Feb 10 03:47:10 PST 2019 :Re-starting Zimbra mailbox service
Sun Feb 10 03:47:37 PST 2019 :Purging remote redolog directory
Sun Feb 10 03:47:37 PST 2019 :Purging remote redolog directory done
Sun Feb 10 03:47:37 PST 2019 :Live streaming redolog
Sun Feb 10 03:47:42 PST 2019 :Live streaming redolog established

anyone has any clue about this error and any resolution for this.

Thanks in advance.
User avatar
maxxer
Outstanding Member
Outstanding Member
Posts: 224
Joined: Fri Oct 04, 2013 2:12 am
Contact:

Re: Revamped Zimbra live sync stuff

Post by maxxer »

alogicking wrote:Yesterday I upgraded my email server with RHEL7_64 FOSS edition, Patch 8.8.11_P2 and now while doing live sync, we are getting the below error in the live sync log:
Something similar has been reported on gitlab. It appears to be the output of zmplayredo command, but I cannot say what's causing it. You should search more about that command
alogicking
Posts: 31
Joined: Tue Aug 14, 2018 12:53 pm
Location: India
ZCS/ZD Version: 8.8.15_GA_3829.RHEL7_64_FOSS P12

Re: Revamped Zimbra live sync stuff

Post by alogicking »

maxxer wrote:
alogicking wrote:Yesterday I upgraded my email server with RHEL7_64 FOSS edition, Patch 8.8.11_P2 and now while doing live sync, we are getting the below error in the live sync log:
Something similar has been reported on gitlab. It appears to be the output of zmplayredo command, but I cannot say what's causing it. You should search more about that command
Thanks Maxxer, for your prompt response. I was going through the code of zmplayredo command could find that there were some jar file reference missing like: graphql-java-9.0.jar and others.

The development team need to fix it.
andrey.ivanov
Advanced member
Advanced member
Posts: 50
Joined: Wed Aug 08, 2018 8:44 am

Re: Revamped Zimbra live sync stuff

Post by andrey.ivanov »

Zimbra support has given us a fix to avoid the exception (java.lang.NoClassDefFoundError: graphql/GraphQLError) - you need simply to remove the contents of a folder :

Code: Select all

mv /opt/zimbra/lib/ext/zm-gql /tmp/backup/
It fixes the zmplayredo problem. According to Zimbra, GraphQL library is an experimental feature they have added in some tools but it is not yet production-ready.
alogicking
Posts: 31
Joined: Tue Aug 14, 2018 12:53 pm
Location: India
ZCS/ZD Version: 8.8.15_GA_3829.RHEL7_64_FOSS P12

Re: Revamped Zimbra live sync stuff

Post by alogicking »

Hi All,

again after upgrading to Release 8.8.12_GA_3794.RHEL7_64_20190329045002 RHEL7_64 FOSS edition, Patch 8.8.12_P1 proxy. edition, I am getting the below error while using live_sync

Code: Select all

which: no zmhsm in (/opt/zimbra/bin:/opt/zimbra/common/lib/jvm/java/bin:/opt/zimbra/common/bin:/opt/zimbra/common/sbin:/usr/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin)
Mon Jun 24 08:28:34 PDT 2019 :Syncing /opt/zimbra/redolog/redo.log
Mon Jun 24 08:28:34 PDT 2019 :Syncing /opt/zimbra/redolog/redo.log done
Mon Jun 24 08:28:34 PDT 2019 :Syncing redologs done
Mon Jun 24 08:28:34 PDT 2019 :Purging redolog directory and archives
Mon Jun 24 08:28:34 PDT 2019 :Purge redolog directory and archives done
Mon Jun 24 08:28:37 PDT 2019 :Replaying redologs...
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.openzal.zal.extension.StoreManagerImpl (file:/opt/zimbra/lib/ext/zimbradrive/zal.jar) to field java.lang.reflect.Method.modifiers
WARNING: Please consider reporting this to the maintainers of org.openzal.zal.extension.StoreManagerImpl
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/zimbra/lib/jars/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/zimbra/jetty_base/webapps/service/WEB-INF/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
Mon Jun 24 08:28:44 PDT 2019 :Replay of redolog failed
Mon Jun 24 08:28:44 PDT 2019 :Replaying redologs done
Mon Jun 24 08:28:44 PDT 2019 :Re-starting Zimbra mailbox service
Mon Jun 24 08:29:11 PDT 2019 :Purging remote redolog directory
Mon Jun 24 08:29:11 PDT 2019 :Purging remote redolog directory done
Mon Jun 24 08:29:11 PDT 2019 :Live streaming redolog
Mon Jun 24 08:29:16 PDT 2019 :Live streaming redolog established
Setting up watches.  Beware: since -r was given, this may take a while!
Watches established.
Anyone has any clue about it?

Thanks in advance.
siripuramravi
Posts: 1
Joined: Thu Aug 13, 2020 3:43 pm

Re: Revamped Zimbra live sync stuff

Post by siripuramravi »

it works in 8.8.15 version.
Post Reply