zmmailbox import account read timeout

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
Post Reply
gamecounter
Posts: 4
Joined: Fri Feb 21, 2020 2:00 pm

zmmailbox import account read timeout

Post by gamecounter »

I'm usung zmmailbox to import accounts.

Code: Select all

 /opt/zimbra/bin/zmmailbox -z -t 0 -m user@domain.com postRestURL -u "https://domain.com" "//?fmt=tgz&resolve=reset" backup.tgz
After 60-90sec I get

Code: Select all

ERROR: zclient.IO_ERROR (Read timed out) (cause: java.net.SocketTimeoutException Read timed out)
I'm using
Release 8.8.15.GA.3869.UBUNTU18.64 UBUNTU18_64 FOSS edition, Patch 8.8.15_P7
mailbox.log shows:

Code: Select all

2020-03-08 17:57:05,519 WARN  [qtp1027591600-537:https://mail.domain.com/home/user@domain.com/?fmt=tgz&resolve=reset] [name=user@domain.com;mid=8;ip=10.0.0.100;port=55000;] misc - ArchiveFormatter addError:Early EOF: path=Sent/0000000947-Anfrage.eml
com.zimbra.cs.service.formatter.FormatterServiceException: Early EOF
ExceptionId:qtp1027591600-537:https://mail.domain.com/home/user@domain.com/?fmt=tgz&resolve=reset:1583690225519:d826ef9c8895324a
Code:formatter.UNKNOWN_ERROR Arg:(path, STR, "Sent/0000000947-Anfrage.eml")
        at com.zimbra.cs.service.formatter.FormatterServiceException.UNKNOWN_ERROR(FormatterServiceException.java:118)
        at com.zimbra.cs.service.formatter.ArchiveFormatter.addItem(ArchiveFormatter.java:1542)
        at com.zimbra.cs.service.formatter.ArchiveFormatter.saveCallback(ArchiveFormatter.java:983)
        at com.zimbra.cs.service.formatter.Formatter.save(Formatter.java:162)
        at com.zimbra.cs.service.UserServlet.doPost(UserServlet.java:709)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
        at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:214)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:214)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.CsrfFilter.doFilter(CsrfFilter.java:175)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.RequestStringFilter.doFilter(RequestStringFilter.java:54)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.common.filters.Base64Filter.doFilter(Base64Filter.java:63)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.SetHeaderFilter.doFilter(SetHeaderFilter.java:59)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.ETagHeaderFilter.doFilter(ETagHeaderFilter.java:47)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.ContextPathBasedThreadPoolBalancerFilter.doFilter(ContextPathBasedThreadPoolBalancerFilter.java:107)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.ZimbraQoSFilter.doFilter(ZimbraQoSFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.ZimbraInvalidLoginFilter.doFilter(ZimbraInvalidLoginFilter.java:117)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlets.DoSFilter.doFilterChain(DoSFilter.java:482)
        at org.eclipse.jetty.servlets.DoSFilter.doFilter(DoSFilter.java:327)
        at org.eclipse.jetty.servlets.DoSFilter.doFilter(DoSFilter.java:297)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1700)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:152)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
        at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:753)
        at org.eclipse.jetty.server.handler.DebugHandler.handle(DebugHandler.java:83)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:427)
        at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:321)
        at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:159)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:698)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:804)
        at java.base/java.lang.Thread.run(Thread.java:830)
Caused by: org.eclipse.jetty.io.EofException: Early EOF
        at org.eclipse.jetty.server.HttpInput$3.getError(HttpInput.java:1143)
        at org.eclipse.jetty.server.HttpInput$3.noContent(HttpInput.java:1131)
        at org.eclipse.jetty.server.HttpInput.read(HttpInput.java:318)
        at org.apache.commons.fileupload.MultipartStream$ItemInputStream.makeAvailable(MultipartStream.java:976)
        at org.apache.commons.fileupload.MultipartStream$ItemInputStream.read(MultipartStream.java:886)
        at com.zimbra.cs.service.UserServletContext$UploadInputStream.read(UserServletContext.java:708)
        at java.base/java.util.zip.InflaterInputStream.fill(InflaterInputStream.java:243)
        at java.base/java.util.zip.InflaterInputStream.read(InflaterInputStream.java:159)
        at java.base/java.util.zip.GZIPInputStream.read(GZIPInputStream.java:118)
        at com.zimbra.common.util.tar.TarBuffer.readBlock(TarBuffer.java:257)
        at com.zimbra.common.util.tar.TarBuffer.readRecord(TarBuffer.java:223)
        at com.zimbra.common.util.tar.TarInputStream.read(TarInputStream.java:349)
        at com.zimbra.common.util.CopyInputStream.read(CopyInputStream.java:72)
        at java.base/java.io.FilterInputStream.read(FilterInputStream.java:133)
        at com.zimbra.common.mime.Rfc822ValidationInputStream.read(Rfc822ValidationInputStream.java:55)
        at com.zimbra.common.mime.Rfc822ValidationInputStream.read(Rfc822ValidationInputStream.java:77)
        at com.zimbra.cs.store.BlobBuilder.append(BlobBuilder.java:138)
        at com.zimbra.cs.store.file.FileBlobStore.storeIncoming(FileBlobStore.java:108)
        at com.zimbra.cs.store.StoreManager.storeIncoming(StoreManager.java:158)
        at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:6043)
        at com.zimbra.cs.service.formatter.ArchiveFormatter.addItem(ArchiveFormatter.java:1404)
        ... 69 more
2020-03-08 17:57:05,521 WARN  [qtp1027591600-537:https://mail.domain.com/home/user@domain.com/?fmt=tgz&resolve=reset] [name=user@domain.com;mid=8;ip=10.0.0.100;port=55000;] misc - ArchiveFormatter addError:Early EOF
com.zimbra.cs.service.formatter.FormatterServiceException: Early EOF
ExceptionId:qtp1027591600-537:https://mail.domain.com/home/user@domain.com/?fmt=tgz&resolve=reset:1583690225521:d826ef9c8895324a
Code:formatter.UNKNOWN_ERROR
        at com.zimbra.cs.service.formatter.FormatterServiceException.UNKNOWN_ERROR(FormatterServiceException.java:108)
        at com.zimbra.cs.service.formatter.ArchiveFormatter.saveCallback(ArchiveFormatter.java:992)
        at com.zimbra.cs.service.formatter.Formatter.save(Formatter.java:162)
        at com.zimbra.cs.service.UserServlet.doPost(UserServlet.java:709)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
        at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:214)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:214)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.CsrfFilter.doFilter(CsrfFilter.java:175)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.RequestStringFilter.doFilter(RequestStringFilter.java:54)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.common.filters.Base64Filter.doFilter(Base64Filter.java:63)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.SetHeaderFilter.doFilter(SetHeaderFilter.java:59)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.ETagHeaderFilter.doFilter(ETagHeaderFilter.java:47)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.ContextPathBasedThreadPoolBalancerFilter.doFilter(ContextPathBasedThreadPoolBalancerFilter.java:107)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.ZimbraQoSFilter.doFilter(ZimbraQoSFilter.java:125)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at com.zimbra.cs.servlet.ZimbraInvalidLoginFilter.doFilter(ZimbraInvalidLoginFilter.java:117)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlets.DoSFilter.doFilterChain(DoSFilter.java:482)
        at org.eclipse.jetty.servlets.DoSFilter.doFilter(DoSFilter.java:327)
        at org.eclipse.jetty.servlets.DoSFilter.doFilter(DoSFilter.java:297)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1700)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:152)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
        at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:753)
        at org.eclipse.jetty.server.handler.DebugHandler.handle(DebugHandler.java:83)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:427)
        at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:321)
        at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:159)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:698)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:804)
        at java.base/java.lang.Thread.run(Thread.java:830)
Caused by: org.eclipse.jetty.io.EofException: Early EOF
        at org.eclipse.jetty.server.HttpInput$3.getError(HttpInput.java:1143)
        at org.eclipse.jetty.server.HttpInput$3.noContent(HttpInput.java:1131)
        at org.eclipse.jetty.server.HttpInput.read(HttpInput.java:318)
        at org.apache.commons.fileupload.MultipartStream$ItemInputStream.makeAvailable(MultipartStream.java:976)
        at org.apache.commons.fileupload.MultipartStream$ItemInputStream.read(MultipartStream.java:886)
        at com.zimbra.cs.service.UserServletContext$UploadInputStream.read(UserServletContext.java:708)
        at java.base/java.util.zip.InflaterInputStream.fill(InflaterInputStream.java:243)
        at java.base/java.util.zip.InflaterInputStream.read(InflaterInputStream.java:159)
        at java.base/java.util.zip.GZIPInputStream.read(GZIPInputStream.java:118)
        at com.zimbra.common.util.tar.TarBuffer.readBlock(TarBuffer.java:257)
        at com.zimbra.common.util.tar.TarBuffer.readRecord(TarBuffer.java:223)
        at com.zimbra.common.util.tar.TarInputStream.read(TarInputStream.java:349)
        at com.zimbra.common.util.tar.TarInputStream.skip(TarInputStream.java:173)
        at com.zimbra.common.util.tar.TarInputStream.getNextEntry(TarInputStream.java:235)
        at com.zimbra.cs.service.formatter.TarArchiveInputStream$TarArchiveInputEntry.<init>(TarArchiveInputStream.java:32)
        at com.zimbra.cs.service.formatter.TarArchiveInputStream.getNextEntry(TarArchiveInputStream.java:58)
        at com.zimbra.cs.service.formatter.ArchiveFormatter.saveCallback(ArchiveFormatter.java:949)
        ... 68 more
2020-03-08 17:57:05,522 INFO  [qtp1027591600-537:https://mail.domain.com/home/user@domain.com/?fmt=tgz&resolve=reset] [name=user@domain.com;mid=8;ip=10.0.0.100;port=55000;] index - indexSuspended set to false.  Current deferred count 613
2020-03-08 17:57:05,530 INFO  [qtp1027591600-537:https://mail.domain.com/home/user@domain.com/?fmt=tgz&resolve=reset] [name=user@domain.com;mid=8;ip=10.0.0.100;port=55000;] index - resumeIndexingAndDrainDeferred deferred count=613
2020-03-08 17:57:11,108 INFO  [Index-8] [name=user@domain.com;mid=8;] index - Batch complete processed=613,failed=0,elapsed=5584 (109.78 items/sec)
any ideas?
Top
User avatar
DualBoot
Elite member
Elite member
Posts: 1326
Joined: Mon Apr 18, 2016 8:18 pm
Location: France - Earth
ZCS/ZD Version: ZCS FLOSS - 8.8.15 Mutli servers
Contact:
Contact DualBoot

Re: zmmailbox import account read timeout

Post by DualBoot »

Hello,

maybe the embedded Zimbra DoSFilter ?

Regards,
Top
User avatar
gabrieles
Outstanding Member
Outstanding Member
Posts: 236
Joined: Tue Feb 14, 2017 9:40 am

Re: zmmailbox import account read timeout

Post by gabrieles »

Patch 7 introduces some changes that shoud solve the "read timeout" problem on zmmboxmove.
I found some other error unrelated to the pru-gru but similar.
I think that trying to solve the read timeout problem they added some sort of thread limiter that causes these problems.
Top
Dryctas
Posts: 2
Joined: Tue Apr 23, 2019 1:22 pm

Re: zmmailbox import account read timeout

Post by Dryctas »

I think I was able to work around this by importing the backup with curl.

Code: Select all

curl -k -u <username> -p -T /path/to/backup.tgz  "https://localhost:7071/service/home/<user>@<domain>/?fmt=tgz&resolve=skip"
Top
gamecounter
Posts: 4
Joined: Fri Feb 21, 2020 2:00 pm

Re: zmmailbox import account read timeout

Post by gamecounter »

Thanks for your hints:
Dos filter doesn't seem to be the problem (according to the log files described here: https://wiki.zimbra.com/wiki/DoSFilter)
Patch 7 is already applied as you can see in my version info

will try the workaround with curl
Top
gamecounter
Posts: 4
Joined: Fri Feb 21, 2020 2:00 pm

Re: zmmailbox import account read timeout

Post by gamecounter »

The curl solution worked for me ... thanks
Top
kusannaghi
Posts: 1
Joined: Mon May 11, 2020 11:39 am

Re: zmmailbox import account read timeout

Post by kusannaghi »

The curl ask me password of the user. But i dont have this passwords.
The command zmmailbox -z -t 0 -m user@domain postRestURL -u "https://server" "//?fmt=zip&resolve=reset" /backups/zmigrate/buzones/user@domain.zip dont work.

Somebody know what happen?
Top
User avatar
DualBoot
Elite member
Elite member
Posts: 1326
Joined: Mon Apr 18, 2016 8:18 pm
Location: France - Earth
ZCS/ZD Version: ZCS FLOSS - 8.8.15 Mutli servers
Contact:
Contact DualBoot

Re: zmmailbox import account read timeout

Post by DualBoot »

use user admin with his password. And for zmmailbox I am going to ask my cristal ball.
Top
Post Reply

Return to “Administrators”