ZCS 8.8.8 P6 - Multiserver environment - admin console freezes (GetCertRequest) - Commercial Certificate

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
Post Reply
daniele.antolini
Posts: 36
Joined: Fri Jul 08, 2016 7:41 am

ZCS 8.8.8 P6 - Multiserver environment - admin console freezes (GetCertRequest) - Commercial Certificate

Post by daniele.antolini »

Hello,
I've upgraded a multi-server infrastrcture from 8.7.11 to 8.8.8 P6. I've some issues when I access to admin console via Proxy (504 Timeout). So I tried to connect directly to one of the mailbox server, problem is not present but if for example I go to "Class of Service" configurations, it tooks 3 minutes to open the page. So I've enabled debug log on mailbox server and I've discovered that during the SOAP call "/admin/soap/GetCertRequest" a zmrcd command is executed for EVERY server in the infrastructure. Here a portion of mailbox.log:


2018-07-09 13:49:55,241 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - executing shim command '/opt/zimbra/libexec/zmrcd' on {RemoteManager: nemailstore10.local->zimbra@neldap02.local:22}
2018-07-09 13:49:55,252 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - sending mgmt command 'HOST:neldap02.local zmcertmgr viewdeployedcrt mailboxd' on {RemoteManager: nemailstore10.local->zimbra@neldap02.local:22}
2018-07-09 13:49:58,716 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - executing shim command '/opt/zimbra/libexec/zmrcd' on {RemoteManager: nemailstore10.local->zimbra@neldap02.local:22}
2018-07-09 13:49:58,722 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - sending mgmt command 'HOST:neldap02.local zmcertmgr viewdeployedcrt mta' on {RemoteManager: nemailstore10.local->zimbra@neldap02.local:22}
2018-07-09 13:50:02,164 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - executing shim command '/opt/zimbra/libexec/zmrcd' on {RemoteManager: nemailstore10.local->zimbra@neldap02.local:22}
2018-07-09 13:50:02,169 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - sending mgmt command 'HOST:neldap02.local zmcertmgr viewdeployedcrt proxy' on {RemoteManager: nemailstore10.local->zimbra@neldap02.local:22}
2018-07-09 13:50:05,684 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - executing shim command '/opt/zimbra/libexec/zmrcd' on {RemoteManager: nemailstore10.local->zimbra@nemailstore01.local:22}
2018-07-09 13:50:05,689 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - sending mgmt command 'HOST:nemailstore01.local zmcertmgr viewdeployedcrt ldap' on {RemoteManager: nemailstore10.local->zimbra@nemailstore01.local:22}
2018-07-09 13:50:10,158 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - executing shim command '/opt/zimbra/libexec/zmrcd' on {RemoteManager: nemailstore10.local->zimbra@nemailstore01.local:22}

and so on. The last is (see timestamp):

2018-07-09 13:52:51,708 DEBUG [qtp335471116-213:https:https://x.x.x.x:7071/service/admin/soap/GetCertRequest] [name=admin@domain.local;mid=16660;ip=y.y.y.y;port=57400;ua=ZimbraWebClient - FF42 (Win);soapId=f09536;] rmgmt - sending mgmt command 'HOST:neproxy02.local zmcertmgr viewdeployedcrt proxy' on {RemoteManager: nemailstore10.local->zimbra@neproxy02.local:22}


This infrastructure is composed by 19 servers (2 ldap + 2 proxy+ 5 mta + 10 mailbox) so the command take 3 minutes to be executed.

I think this is a serious issue. Someone has the same problem?

Regards
daniele.antolini
Posts: 36
Joined: Fri Jul 08, 2016 7:41 am

Re: ZCS 8.8.8 P6 - Multiserver environment - admin console freezes (GetCertRequest) - Commercial Certificate

Post by daniele.antolini »

In a multiserver Zimbra 8.7.11 environment, behaviour is the same but admin console does not freeze during "GetCertRequest" SOAP call.
daniele.antolini
Posts: 36
Joined: Fri Jul 08, 2016 7:41 am

Re: ZCS 8.8.8 P6 - Multiserver environment - admin console freezes (GetCertRequest) - Commercial Certificate - Zextras S

Post by daniele.antolini »

I've discovered that there is a Zextras SOAP call (zxsuite core getLicenseInfo) with a Waiting (TTFB) of 3.3 minutes and then a GET method (http://data-img-1.zextras.com/l?..................)
daniele.antolini
Posts: 36
Joined: Fri Jul 08, 2016 7:41 am

Re: ZCS 8.8.8 P6 - Multiserver environment - admin console freezes (GetCertRequest) - Commercial Certificate

Post by daniele.antolini »

Last patch should resolve this issue!!

I'll let you know
Post Reply