Urgent Help!!! Server down due to I/O error

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
Post Reply
1437Azim
Posts: 33
Joined: Sat Sep 13, 2014 3:29 am

Urgent Help!!! Server down due to I/O error

Post by 1437Azim »

Hello,

I am in big trouble :(

I have installed Zimbra free version in Citrix xen server as virtual machine.

Everything was working proper but later I noticed that a couple of services was stopped and when I saw the console it was showing a lot of errors as below,

blk_update_request: I/O error, dev xvda, sector 1259509688

Buffer I/O error on device dm-0, logical block 157313271

Whenever I restart the zmcontron services , I see below status.

amavis Running
antispam Running
antivirus Running
ldap Running
logger Running
mailbox Running
memcached Running
mta Stopped
zmmilterctl is not running
zmsaslauthdctl is not running
postfix is not running
opendkim Running
proxy Running
service webapp Running
snmp Stopped
zmswatch is not running.
spell Stopped
zmapachectl is not running
stats Stopped
zimbra webapp Running
zimbraAdmin webapp Running
zimlet webapp Running
zmconfigd Running
User avatar
vavai
Advanced member
Advanced member
Posts: 174
Joined: Thu Nov 14, 2013 2:41 pm
Location: Indonesia
ZCS/ZD Version: 0
Contact:

Re: Urgent Help!!! Server down due to I/O error

Post by vavai »

Hi,

I/O errors means there is something wrong on a storage (virtual volume/physical storage). You can check storage status or trying to restart VM.
phoenix
Ambassador
Ambassador
Posts: 27272
Joined: Fri Sep 12, 2014 9:56 pm
Location: Liverpool, England

Re: Urgent Help!!! Server down due to I/O error

Post by phoenix »

I'd also add that you should shutdown ZCS and make an rsync copy of the ZCS directory structure to another server the n shutdown the VM and take a backup (or snapshot?) before you do anything else. Try restarting the VM after you've taken the backups and see what happens.
Regards

Bill

Rspamd: A high performance spamassassin replacement

Per ardua ad astra
1437Azim
Posts: 33
Joined: Sat Sep 13, 2014 3:29 am

Re: Urgent Help!!! Server down due to I/O error

Post by 1437Azim »

Hello,
Thanks for your reply.

I tried everything using FSCK command on whole citrix and on entire Zimbra server and it showing as clean partition.

Hence, there are no errors found while repairing the same.

On the same server, rest servers are working absolutely fine and only zimbra is showing this error.

Please suggest. Thanks.
1437Azim
Posts: 33
Joined: Sat Sep 13, 2014 3:29 am

Re: Urgent Help!!! Server down due to I/O error

Post by 1437Azim »

Hi,

Since my zimbra services are down.
Is there a possibility that I can export particular users mailbox to other location.
phoenix
Ambassador
Ambassador
Posts: 27272
Joined: Fri Sep 12, 2014 9:56 pm
Location: Liverpool, England

Re: Urgent Help!!! Server down due to I/O error

Post by phoenix »

Did you follow my suggestion and rsync a copy of the /opt/zimbra directory structure to another server then shut the VM & take a backup? Have you tried rebooting the VM and if so, what happens to Zimbra does it start at all and if not what's in the log files?
Regards

Bill

Rspamd: A high performance spamassassin replacement

Per ardua ad astra
1437Azim
Posts: 33
Joined: Sat Sep 13, 2014 3:29 am

Re: Urgent Help!!! Server down due to I/O error

Post by 1437Azim »

Actually, I have a started my backup server which I already created with Rsync but when I restored my backup server, I can see that there are around 10-15 mailbox which are empty .

Now the current server is not getting up and I have no clue how can I export only their mailbox from the backend because no services are running on earlier server.

Any suggestion on exporting particular mailbox.
1437Azim
Posts: 33
Joined: Sat Sep 13, 2014 3:29 am

Re: Urgent Help!!! Server down due to I/O error

Post by 1437Azim »

I tried this but it is failing

zmmailbox -z -m user@test.com getRestURL "//?fmt=tgz" > /tmp/user_test.com.tar.gz
User avatar
Pronix
Posts: 3
Joined: Sun Nov 04, 2018 3:55 am

Re: Urgent Help!!! Server down due to I/O error

Post by Pronix »

Post Reply