ldap database went from 97meg to 86gig

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
samgann
Posts: 17
Joined: Sat Sep 13, 2014 2:27 am

ldap database went from 97meg to 86gig

Postby samgann » Wed Nov 21, 2012 10:31 pm

I upgraded my zimbra server from 8.0 to 8.01 on Monday of this week.

No trouble with the upgrade.

I have for the last 10 mo rsync the main server to a backup server. And only took about 10min.

After upgrading the main server and the backup server to 8.01. I ran a rsync to the backup server.

This took about 2hrs. to finish.

I than again ran a rsync to the backup server and saw that the rsync took the longest to backup was the

dir /zimbra/data/idap/mdb/db/data.mdb. I than login to the server with wscp and went to that dir. That file was 86 GIG.

A folder /zimbra/data/idap/mdb/mdb.prev on the date that I upgraded was only 197 meg.

I am not have any problems with the email server. I am concerned about the 86 GIG file though.

Now every time I do a rsync to the backup server it takes about 2 hours.

Does anyone have a clue what is going on?
Thanks

Sam


samgann
Posts: 17
Joined: Sat Sep 13, 2014 2:27 am

ldap database went from 97meg to 86gig

Postby samgann » Thu Nov 22, 2012 12:22 am

I fixed the problem.
I removed the 86 gig file and replaced with the mdb.prev files.


All seems to be fine. I also rsync the main server to the backup server.
samgann
Posts: 17
Joined: Sat Sep 13, 2014 2:27 am

ldap database went from 97meg to 86gig

Postby samgann » Fri Nov 23, 2012 9:20 am

Ok now that i changed the files from mdb.prev the admin pannel says upgrade avaible. So on my backup server I upgraded the server again. still the same in the admin pannel.

But from the help menu say 8.01.

Is there a way to fix this?
winepress
Posts: 14
Joined: Sat Sep 13, 2014 3:00 am

ldap database went from 97meg to 86gig

Postby winepress » Fri Nov 23, 2012 10:19 am

Hi,
I ran into the exact same problem, except my mdb.prev size was only 6.7 MB and it's now 79 GB.
What's worse is it's causing my backups to run out of space, so the system's not getting backed up properly.
I don't know the solution. Has anyone else figured this out?
Thanks,

Kevin
User avatar
ccelis5215
Outstanding Member
Outstanding Member
Posts: 609
Joined: Sat Sep 13, 2014 2:04 am
Location: Caracas - Venezuela
ZCS/ZD Version: 8.0.9.GA.6191.UBUNTU12.64 FOSS

ldap database went from 97meg to 86gig

Postby ccelis5215 » Fri Nov 23, 2012 10:28 am

Hi all,
[QUOTE][root@mail ~]# ls -slth /opt/zimbra/data/ldap/mdb/db/total 3.4M

4.0K -rw------- 1 zimbra zimbra 8.0K Nov 23 12:03 lock.mdb

3.4M -rw------- 1 zimbra zimbra 80G Nov 23 12:02 data.mdb

[root@mail ~]#


[/QUOTE]
In my test server with 3 user accounts and 10 messages going to 8.0.1, in OpenLDAP Tuning Keys 8.0 - Zimbra :: Wiki explain about the size of data.mdb file.
But, the installer just checks 5 GB available on disk instead of 85 GB according this new requirement?
ccelis
kevindods
Advanced member
Advanced member
Posts: 164
Joined: Fri Sep 12, 2014 9:58 pm

ldap database went from 97meg to 86gig

Postby kevindods » Fri Nov 23, 2012 10:38 am

Hi We have a small dev server with a 50GB partition with 8.0.1 on it at it reports 5GB free. A ls -lah at /opt/zimbra/data/ldap/mdb/db/data.mdb tells me the MDB is 80GB... something is not telling us the truth methinks!
winepress
Posts: 14
Joined: Sat Sep 13, 2014 3:00 am

ldap database went from 97meg to 86gig

Postby winepress » Fri Nov 23, 2012 10:42 am

Hi ccelis,
I just read that document, and what I read it to say was:
* Default Maximum Size: 85899345920
* If your database actually reaches that size, data loss will occur (i.e. big problem)
What the upgrade from 8.0.0 to 8.0.1 did was to increase my data.mdb size to that maximum size--85899345920--that's the exact size of my file. This does not appear to be a new requirement, but on the contrary the document warns of data loss at that size. The implications of this are worse than I originally thought.
Is there some way to compact the file?
Thanks,

Kevin
kevindods
Advanced member
Advanced member
Posts: 164
Joined: Fri Sep 12, 2014 9:58 pm

ldap database went from 97meg to 86gig

Postby kevindods » Fri Nov 23, 2012 10:52 am

This is all a bit worrying we have one 8.0.1 live and a bunch of others scheduled to upgrade. We hadn't noticed this DB size issue as problem before but with something new and unpredictable it does concern us. Doing a copy of the file does indeed take 80GB so not entirely sure what is going on. Any Zimbra bods around looking in today?
User avatar
ccelis5215
Outstanding Member
Outstanding Member
Posts: 609
Joined: Sat Sep 13, 2014 2:04 am
Location: Caracas - Venezuela
ZCS/ZD Version: 8.0.9.GA.6191.UBUNTU12.64 FOSS

ldap database went from 97meg to 86gig

Postby ccelis5215 » Fri Nov 23, 2012 10:58 am

[quote user="winepress"]Hi ccelis,
I just read that document, and what I read it to say was:
* Default Maximum Size: 85899345920
* If your database actually reaches that size, data loss will occur (i.e. big problem)
What the upgrade from 8.0.0 to 8.0.1 did was to increase my data.mdb size to that maximum size--85899345920--that's the exact size of my file. This does not appear to be a new requirement, but on the contrary the document warns of data loss at that size. The implications of this are worse than I originally thought.
Is there some way to compact the file?
Thanks,

Kevin[/QUOTE]
Hi, in the same boat that you.
It seems there's 80GB allocated but just a few megs in use.
In my case, a FOSS user copying the file takes 80GB. As you have pointed there are two concerns about this issue, at least.
ccelis.
kevindods
Advanced member
Advanced member
Posts: 164
Joined: Fri Sep 12, 2014 9:58 pm

ldap database went from 97meg to 86gig

Postby kevindods » Fri Nov 23, 2012 11:12 am

Yep, FOSS here too. We are rebuilding a test of the service to see if we can work out why the file is misreporting to the OS. It makes managing storage a problem if you don't know what you don't know ;-) The test environment only has about 15GB of mailbox so proportionately it is very noticeably wrong now.

Return to “Administrators”

Who is online

Users browsing this forum: MSN [Bot] and 5 guests