Can't migrate user mailboxes from IMAP server to Zimbra

[Mr.Twister]

Hello!
I administer Zimbra Collaboration Server Open Source Edition 8 (VMware Zimbra 8.0.0_GA_5434.F, Version: OSS) on Ubuntu 10.04 LTS.

I need to migrate user mailboxes from Dovecot IMAP to ZCS using "Migration and Co-existence" tool.

I can't use imapsync because some users have folders with non-english names. Imapsync transfers then incorrectly.
Sometimes "Migration and Co-existence" can't start transfer with this error:

"Server error encountered

Message: data source already exists: __imap_import__ Error code: account.DATA_SOURCE_EXISTS Method: [unknown] Details:soap:Sender"
mailbox.log contains this:

2012-09-22 13:38:38,136 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=dterentieva@dom.ru

2012-09-22 13:38:38,139 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=fomin@dom.ru

2012-09-22 13:38:38,142 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=glebova@dom.ru

2012-09-22 13:38:38,145 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=hruk@dom.ru

2012-09-22 13:38:38,148 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=iakovleva@dom.ru

2012-09-22 13:38:38,151 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] soap - BulkIMAPDataImportRequest elapsed=15

2012-09-22 13:38:41,894 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=dterentieva@dom.ru

2012-09-22 13:38:41,894 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=fomin@dom.ru

2012-09-22 13:38:41,894 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=glebova@dom.ru

2012-09-22 13:38:41,894 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=hruk@dom.ru

2012-09-22 13:38:41,895 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] misc - delegated access: doc=BulkIMAPDataImport, authenticated account=avorobyov@domain.com, target account=iakovleva@dom.ru

2012-09-22 13:38:41,897 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] SoapEngine - handler exception

com.zimbra.cs.account.AccountServiceException: data source already exists: __imap_import__

ExceptionId:qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... 8d9cba1ef2

Code:account.DATA_SOURCE_EXISTS

at com.zimbra.cs.account.AccountServiceException.DATA_SOURCE_EXISTS(AccountServiceException.java:340)

at com.zimbra.cs.account.ldap.LdapProvisioning.createDataSource(LdapProvisioning.java:7333)

at com.zimbra.cs.account.ldap.LdapProvisioning.createDataSource(LdapProvisioning.java:7265)

at com.zimbra.cs.account.ldap.LdapProvisioning.createDataSource(LdapProvisioning.java:7257)

at com.zimbra.bp.BulkIMAPDataImport.createIMAPDataSource(BulkIMAPDataImport.java:614)

at com.zimbra.bp.BulkIMAPDataImport.handle(BulkIMAPDataImport.java:285)

at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEngine.java:421)

at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:284)

at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:157)

at com.zimbra.soap.SoapServlet.doWork(SoapServlet.java:290)

at com.zimbra.soap.SoapServlet.doPost(SoapServlet.java:206)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:727">HttpServlet.service(HttpServlet.java:727)

at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:208)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:820">HttpServlet.service(HttpServlet.java:820)

at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:565)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1361)

at com.zimbra.cs.servlet.SetHeaderFilter.doFilter(SetHeaderFilter.java:57)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1332)

at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:77)

at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:181)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1332)

at org.eclipse.jetty.servlets.DoSFilter.doFilterChain(DoSFilter.java:464)

at org.eclipse.jetty.servlets.DoSFilter.doFilter(DoSFilter.java:327)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1332)

at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:477)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)

at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)

at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1031)

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:406)

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:186)

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:965)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)

at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)

at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)

at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:312)

at org.eclipse.jetty.server.handler.DebugHandler.handle(DebugHandler.java:77)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)

at org.eclipse.jetty.server.Server.handle(Server.java:349)

at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:452)

at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:894)

at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:948)

at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)

at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)

at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:77)

at org.eclipse.jetty.io.nio.SslConnection.handle(SslConnection.java:191)

at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:606)

at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:46)

at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:603)

at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:538)

at java.lang.Thread.run(Thread.java:722)

2012-09-22 13:38:41,899 INFO [qtp2010258075-1192:https://46.46.111.111:7071/service/admi ... ortRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] soap - BulkIMAPDataImportRequest elapsed=6
"Tools and migration" => "Account migration" shows line with status of migration task. When I'm tryng to delete this task I recieve error:

"Server error encountered

Message: system failure: unable to delete data source: f2c0f8ca-6451-4d26-87fd-4bd4eff1613f Error code: service.FAILURE Method: [unknown] Details:soap:Receiver"
mailbox.log contains this:

2012-09-22 13:44:30,104 INFO [qtp2010258075-1194:https://46.46.111.111:7071/service/admi ... ersRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] soap - GetAllServersRequest elapsed=2

2012-09-22 13:44:30,123 INFO [qtp2010258075-1199:https://46.46.111.111:7071/service/admi ... istRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] soap - GetBulkIMAPImportTaskListRequest elapsed=0

2012-09-22 13:44:34,095 INFO [qtp2010258075-1200:https://46.46.111.111:7071/service/admi ... sksRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] SoapEngine - handler exception

com.zimbra.common.service.ServiceException: system failure: unable to delete data source: f2c0f8ca-6451-4d26-87fd-4bd4eff1613f

ExceptionId:qtp2010258075-1200:https://46.46.111.111:7071/service/admi ... 8d9cba1ef2

Code:service.FAILURE

at com.zimbra.common.service.ServiceException.FAILURE(ServiceException.java:258)

at com.zimbra.cs.account.ldap.LdapProvisioning.deleteDataSource(LdapProvisioning.java:7362)

at com.zimbra.bp.BulkIMAPImportTaskManager.cleanTaskQueue(BulkIMAPImportTaskManager.java:132)

at com.zimbra.bp.BulkIMAPImportTaskManager.purgeQueue(BulkIMAPImportTaskManager.java:96)

at com.zimbra.bp.PurgeIMAPImportTasks.handle(PurgeIMAPImportTasks.java:18)

at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEngine.java:421)

at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:284)

at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:157)

at com.zimbra.soap.SoapServlet.doWork(SoapServlet.java:290)

at com.zimbra.soap.SoapServlet.doPost(SoapServlet.java:206)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:727">HttpServlet.service(HttpServlet.java:727)

at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:208)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:820">HttpServlet.service(HttpServlet.java:820)

at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:565)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1361)

at com.zimbra.cs.servlet.SetHeaderFilter.doFilter(SetHeaderFilter.java:57)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1332)

at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:77)

at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:181)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1332)

at org.eclipse.jetty.servlets.DoSFilter.doFilterChain(DoSFilter.java:464)

at org.eclipse.jetty.servlets.DoSFilter.doFilter(DoSFilter.java:327)

at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1332)

at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:477)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)

at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)

at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:227)

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1031)

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:406)

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:186)

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:965)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)

at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)

at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)

at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:312)

at org.eclipse.jetty.server.handler.DebugHandler.handle(DebugHandler.java:77)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)

at org.eclipse.jetty.server.Server.handle(Server.java:349)

at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:452)

at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:894)

at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:948)

at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)

at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)

at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:77)

at org.eclipse.jetty.io.nio.SslConnection.handle(SslConnection.java:191)

at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:606)

at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:46)

at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:603)

at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:538)

at java.lang.Thread.run(Thread.java:722)

Caused by: com.zimbra.cs.account.AccountServiceException: no such data source: f2c0f8ca-6451-4d26-87fd-4bd4eff1613f

ExceptionId:qtp2010258075-1200:https://46.46.111.111:7071/service/admi ... 8d9cba1ef2

Code:account.NO_SUCH_DATA_SOURCE

at com.zimbra.cs.account.AccountServiceException.NO_SUCH_DATA_SOURCE(AccountServiceException.java:248)

at com.zimbra.cs.account.ldap.LdapProvisioning.deleteDataSource(LdapProvisioning.java:7358)

... 49 more

2012-09-22 13:44:34,097 INFO [qtp2010258075-1200:https://46.46.111.111:7071/service/admi ... sksRequest] [name=avorobyov@domain.com;mid=49;ip=81.25.11.11;ua=ZimbraWebClient - FF15 (Win);] soap - PurgeBulkIMAPImportTasksRequest elapsed=4
I've already transfered several domains and its mailboxes to Zimbra without problems. But sometimes I get troubles to start transfer. After some hours I can successfully start transfer but after another some hours - not.
Does anybody knows why this happens? What should I do to fix this?

Thanks for your answers.

[Mr.Twister]

EXAMPLE.

I STARTED MIGRATION WIZARD, USER ACCOUNTS ALREADY CREATED SO I SELECTED ACCOUNTS TO IMPORT (5 ACCOUNT IN THIS EXAMPLE) AND SPECIFIED IMAP SERVER NAME, MASTER USER LOGIN AND PASS.

I SELECTED 5 ACCOUNTS BUT WIZARD SHOWS 10 IN FIELD "NUMBER OF MAILBOXES". THERE IS NO CURRENTLY RUNNING IMPORT TASKS BUT WIZARD SHOWS 5 IN FIELD "MAILBOXES CURRENTLY RUNNING IMPORT".
error.jpg

[Mr.Twister]

Hello!
Do anybody knows why migration wizard sometimes doesn't work?

[bizza]

[quote user="Mr.Twister"]Hello!
Do anybody knows why migration wizard sometimes doesn't work?[/QUOTE]
I had your same problem, and I'm still not able to getting rid about it.

Can someone help us?
Regards

[Mr.Twister]

No

I think Zimbra creators can but they (I think) do not visit this forum...

[phoenix]

[quote user="Mr.Twister"]I think Zimbra creators can but they (I think) do not visit this forum... [/QUOTE]That would be beacuse these are Community Support forums not official Zimbra support. If you have a problem that isn't resolved in these forums you should raise a bug report in bugzilla and provide sufficient information so it can be reproduced.

[vadim_amet]

Have you found solution?

We faced with same issue. As far as I understand problem appears after fist unsuccessful import of the same single account. Is it possible to reset it somehow?

[vadim_amet]

8.6.0_GA_1169

The only solution I found is to delete early import-failed accounts and create a new ones (new IDs) and re-import again. Works!