zmmailboxdctl is not running. Can anyone suggest why it fails shortly after starting?
Code: Select all
root@email:/opt/zimbra/log# less /opt/zimbra/log/zmmailboxd.out
[0.078s][info][gc] Using G1
OpenJDK 64-Bit Server VM warning: .hotspot_compiler file is present but has been ignored. Run with -XX:CompileCommandFile=.hotspot_compiler to load the file.
2019-10-01 21:37:39.663:INFO::main: Logging initialized @4262ms to org.eclipse.jetty.util.log.StdErrLog
[5.581s][info][gc] GC(0) Pause Young (Normal) (G1 Evacuation Pause) 41M->7M(820M) 55.957ms
JettyMonitor monitoring thread pool QueuedThreadPool[qtp954702563]@38e79ae3{STOPPED,10<=0<=250,i=0,r=-1,q=0}[NO_TRY]
[8.214s][info][gc] GC(1) Pause Young (Concurrent Start) (Metadata GC Threshold) 29M->10M(820M) 64.233ms
[8.214s][info][gc] GC(2) Concurrent Cycle
[8.294s][info][gc] GC(2) Pause Remark 10M->10M(820M) 15.840ms
[8.314s][info][gc] GC(2) Pause Cleanup 11M->11M(820M) 4.321ms
[8.343s][info][gc] GC(2) Concurrent Cycle 128.954ms
Zimbra server reserving server socket port=110 bindaddr=null ssl=false
Zimbra server reserving server socket port=995 bindaddr=null ssl=false
Zimbra server reserving server socket port=143 bindaddr=null ssl=false
Zimbra server reserving server socket port=993 bindaddr=null ssl=false
Zimbra server reserving server socket port=7025 bindaddr=null ssl=false
2019-10-01 21:37:43.843:INFO:oejs.SetUIDListener:main: Setting umask=027
2019-10-01 21:37:43.843:INFO:oejs.SetUIDListener:main: Current rlimit_nofiles (soft=524288, hard=524288)
2019-10-01 21:37:43.843:INFO:oejs.SetUIDListener:main: Set rlimit_nofiles (soft=65536, hard=65536)
2019-10-01 21:37:43.865:INFO:oejs.SetUIDListener:main: Opened ServerConnector@618425b5{HTTP/1.1,[http/1.1]}{localhost:80}
2019-10-01 21:37:43.865:INFO:oejs.SetUIDListener:main: Opened ServerConnector@75d3a5e0{SSL,[ssl, http/1.1]}{0.0.0.0:443}
2019-10-01 21:37:43.866:INFO:oejs.SetUIDListener:main: Opened ServerConnector@742ff096{SSL,[ssl, http/1.1]}{0.0.0.0:7071}
2019-10-01 21:37:43.866:INFO:oejs.SetUIDListener:main: Opened ServerConnector@1c5920df{SSL,[ssl, http/1.1]}{0.0.0.0:7073}
2019-10-01 21:37:43.866:INFO:oejs.SetUIDListener:main: Opened ServerConnector@196a42c3{SSL,[ssl, http/1.1]}{0.0.0.0:7072}
2019-10-01 21:37:43.866:INFO:oejs.SetUIDListener:main: Setting GID=1001
2019-10-01 21:37:43.875:INFO:oejs.SetUIDListener:main: Setting UID=1001
2019-10-01 21:37:43.890:INFO:oejs.Server:main: jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 11.0.2+9
2019-10-01 21:37:45.800:WARN:oeja.AnnotationParser:qtp954702563-21: org.eclipse.jetty.apache.jsp.JettyJasperInitializer$1 scanned from multiple locations: jar:file:///opt/zimbra/common/jetty_home/lib/apache-jsp/org.eclipse.jetty.apache-j
sp-9.3.5.v20151012.jar!/org/eclipse/jetty/apache/jsp/JettyJasperInitializer$1.class, jar:file:///opt/zimbra/common/jetty_home/lib/apache-jsp/org.eclipse.jetty.apache-jsp-9.4.18.v20190429.jar!/org/eclipse/jetty/apache/jsp/JettyJasperIniti
alizer$1.class
2019-10-01 21:37:45.843:WARN:oeja.AnnotationParser:qtp954702563-12: org.eclipse.jetty.apache.jsp.JettyJasperInitializer$NullTldScanner scanned from multiple locations: jar:file:///opt/zimbra/common/jetty_home/lib/apache-jsp/org.eclipse.j
etty.apache-jsp-9.4.18.v20190429.jar!/org/eclipse/jetty/apache/jsp/JettyJasperInitializer$NullTldScanner.class, jar:file:///opt/zimbra/common/jetty_home/lib/apache-jsp/org.eclipse.jetty.apache-jsp-9.3.5.v20151012.jar!/org/eclipse/jetty/a
pache/jsp/JettyJasperInitializer$NullTldScanner.class
2019-10-01 21:37:45.859:WARN:oeja.AnnotationParser:qtp954702563-21: org.eclipse.jetty.apache.jsp.JettyJasperInitializer scanned from multiple locations: jar:file:///opt/zimbra/common/jetty_home/lib/apache-jsp/org.eclipse.jetty.apache-jsp
-9.3.5.v20151012.jar!/org/eclipse/jetty/apache/jsp/JettyJasperInitializer.class, jar:file:///opt/zimbra/common/jetty_home/lib/apache-jsp/org.eclipse.jetty.apache-jsp-9.4.18.v20190429.jar!/org/eclipse/jetty/apache/jsp/JettyJasperInitializ
er.class
...
...ad infinitum until:
Code: Select all
...
at org.eclipse.jetty.start.Main.invokeMain(Main.java:220)
at org.eclipse.jetty.start.Main.start(Main.java:490)
at org.eclipse.jetty.start.Main.main(Main.java:77)
Caused by: java.lang.VerifyError: class org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection overrides final method org.eclipse.jetty.io.AbstractConnection.toString()Ljava/lang/String;
at java.base/java.lang.ClassLoader.defineClass1(Native Method)
at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1016)
...
... and it finally throws an error after hundreds of warnings:
Code: Select all
...
2019-10-01 21:37:51.102:WARN:oeja.AnnotationParser:qtp954702563-16: com.zimbra.buildinfo.Version scanned from multiple locations: jar:file:///opt/zimbra/jetty_base/webapps/service/WEB-INF/lib/zm-ews-stub-2.0.jar!/com/zimbra/buildinfo/Ver
sion.class, jar:file:///opt/zimbra/lib/jars/zimbrastore.jar!/com/zimbra/buildinfo/Version.class
[16.244s][info][gc] GC(9) Pause Young (Normal) (G1 Evacuation Pause) 101M->33M(820M) 125.315ms
[17.508s][info][gc] GC(10) Pause Young (Normal) (G1 Evacuation Pause) 101M->36M(820M) 63.030ms
2019-10-01 21:37:53.059:INFO:oeja.AnnotationConfiguration:main: Scanning elapsed time=7308ms
2019-10-01 21:37:54.011:WARN:oejw.WebAppContext:main: Failed startup of context o.e.j.w.WebAppContext@4b520ea8{Zimbra Service,/service,file:///opt/zimbra/jetty_base/webapps/service/,UNAVAILABLE}{/service}
java.lang.VerifyError: class org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection overrides final method org.eclipse.jetty.io.AbstractConnection.toString()Ljava/lang/String;
at java.base/java.lang.ClassLoader.defineClass1(Native Method)
at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1016)
at java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:174)
...
ANY suggestions are appreciated. #desperateNow