A Grafana Dashboard for Zimbra Collaboration

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
User avatar
jorgedlcruz
Zimbra Employee
Zimbra Employee
Posts: 2661
Joined: Thu May 22, 2014 4:47 pm

A Grafana Dashboard for Zimbra Collaboration

Postby jorgedlcruz » Tue Aug 08, 2017 12:50 am

Hello everyone,
I've been working on a spare project using Grafana and Zimbra Collaboration. This dashboard, based on the well-known pflogsumm, contains multiples sections with the goal to monitor a full Zimbra Collaboration Server or Servers, we have some sections to monitor the Linux and machine overall performance, and one dedicated section just to monitor Zimbra Collaboration

Image

More information available in: https://github.com/jorgedlcruz/zimbra-grafana and on the official Grafana Dashboard page https://grafana.com/dashboards/2846

Zimbra Collaboration Performance:
* ZCS Version
* Received Megabytes
* Delivered Megabytes
* Total Emails/received
* Total Emails/Delivered
* Total Recipients
* Total Senders
* Forwarded
* Deferred
* Bounced
* Rejected
* Held
* Discarded
* Domains Receiving Emails
* Domains Sending Emails

Linux and machine performance:
* CPUs (defaults to all)
* Disks (per-disk IOPS)
* Network interfaces (packets, bandwidth, errors/drops)
* Mountpoints (space / inodes)

Coming next
This is just a v0.1 of this Dashboard, the next step will be to use the Zimbra SOAP API to obtain some extra information from the Zimbra Collaboration Environment, like:
* Number of Active Users
* Number of Inactive Users
* Number of Domains
* Number of Users with ActiveSync
* etc.

Wiki about this solution
* https://wiki.zimbra.com/wiki/Monitoring ... nd_Grafana

In next versions we will parse directly the logs and put the attempts of logins, and successful logins on a map.

As this is an open project, please feel free to share your ideas, feedback and if possible even help to make it better :) My MTA is really small, so I will appreciate a real feedback from a bigger MTA.

Thank you guys!


Jorge de la Cruz https://jorgedelacruz.es
Technical Marketing Manager at Zimbra/Synacor https://www.zimbra.com/
iomarmochtar
Posts: 41
Joined: Sat Sep 13, 2014 3:54 am
Location: Indonesia
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Postby iomarmochtar » Tue Aug 08, 2017 3:43 am

Cool dashboard,

Actually i just created the same but i'm using Icinga2 (for advance alert) then for every check command will fetch some metrics that will be visualized in Grafana.

Btw what's the purpose of command

Code: Select all

sed 's/........................//' /opt/zimbra/jetty/webapps/zimbra/downloads/.git/HEAD


since there is no git repository there.
User avatar
jorgedlcruz
Zimbra Employee
Zimbra Employee
Posts: 2661
Joined: Thu May 22, 2014 4:47 pm

Re: A Grafana Dashboard for Zimbra Collaboration

Postby jorgedlcruz » Tue Aug 08, 2017 8:34 am

Hello,
That line starting ZCS 8.7.3 gives you the ZCS version, which version do you have?

Best regards
Jorge de la Cruz https://jorgedelacruz.es
Technical Marketing Manager at Zimbra/Synacor https://www.zimbra.com/
iomarmochtar
Posts: 41
Joined: Sat Sep 13, 2014 3:54 am
Location: Indonesia
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Postby iomarmochtar » Tue Aug 08, 2017 11:28 am

I'm using version 8.6 in my RnD machine.
User avatar
L. Mark Stone
Elite member
Elite member
Posts: 1569
Joined: Wed Oct 09, 2013 11:35 am
Location: Portland, Maine
ZCS/ZD Version: 8.6.0 Patch 8
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Postby L. Mark Stone » Tue Aug 08, 2017 2:25 pm

Jorge,

Just looking at this now; seems very interesting and useful!

I'll look at the install details and see if I can't test this on a larger MTA.

Can you aggregate data in one Grafana Dashboard for a Zimbra Multi-Server Hosting Farm that has multiple MTA servers?

Thanks,
Mark
________________________________________________
L. Mark Stone, General Manager
reliable networks, a Division of OTT Communications
HIPAA-Compliant Zimbra Hosting Provider since 2006 http://www.reliablenetworks.com
Zeta Alliancehttp://www.zetalliance.org/
User avatar
jorgedlcruz
Zimbra Employee
Zimbra Employee
Posts: 2661
Joined: Thu May 22, 2014 4:47 pm

Re: A Grafana Dashboard for Zimbra Collaboration

Postby jorgedlcruz » Tue Aug 08, 2017 2:27 pm

Hi Mark,
Thank you for the help trying it. Yes, of course, you will need to tune a bit the selectors on the top, and every aspect where it says $server, I will try to test it with multiple MTAs as well.

Let me know once you try it :)

Best regards
Jorge de la Cruz https://jorgedelacruz.es
Technical Marketing Manager at Zimbra/Synacor https://www.zimbra.com/
User avatar
L. Mark Stone
Elite member
Elite member
Posts: 1569
Joined: Wed Oct 09, 2013 11:35 am
Location: Portland, Maine
ZCS/ZD Version: 8.6.0 Patch 8
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Postby L. Mark Stone » Tue Aug 08, 2017 2:37 pm

jorgedlcruz wrote:Hi Mark,
Thank you for the help trying it. Yes, of course, you will need to tune a bit the selectors on the top, and every aspect where it says $server, I will try to test it with multiple MTAs as well.

Let me know once you try it :)

Best regards


I'm confused because I don't see any Grafana docs for configuring the system to be monitored; I only see that I need to add a "Data Source".

Here's where I'm at:
I set up a free Grafana Hosted Cloud Server. I can download the pfloggsumm.pl file to a Zimbra MTA of course. What do I need to install/configure on the Zimbra MTA to point the output to my Grafana server?

Thanks!
Mark
________________________________________________
L. Mark Stone, General Manager
reliable networks, a Division of OTT Communications
HIPAA-Compliant Zimbra Hosting Provider since 2006 http://www.reliablenetworks.com
Zeta Alliancehttp://www.zetalliance.org/
User avatar
jorgedlcruz
Zimbra Employee
Zimbra Employee
Posts: 2661
Joined: Thu May 22, 2014 4:47 pm

Re: A Grafana Dashboard for Zimbra Collaboration

Postby jorgedlcruz » Tue Aug 08, 2017 3:50 pm

Hi Mark,
You will need to use the Telegraf service - https://docs.influxdata.com/telegraf/v1 ... tallation/

It's really easy to install, once installed you will want to take a look to the Collector Configuration Details section under https://grafana.com/dashboards/2846

Restart the telegraf service and go, you will find more information on the telegraf.log

Let me know
Jorge de la Cruz https://jorgedelacruz.es
Technical Marketing Manager at Zimbra/Synacor https://www.zimbra.com/
User avatar
jasggomes
Posts: 38
Joined: Sat Sep 13, 2014 12:59 am
Location: Lisbon, PT
ZCS/ZD Version: Release 8.7.11.GA.1854.UBUNTU14.64
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Postby jasggomes » Tue Aug 08, 2017 6:07 pm

Hi Jorge, sorry for this ...

I 'm very interested on this projecto of yours, so I've setup a free account on Grafana Labs, and can you please direct me to some how to for me to setup it?
If this question is not appropriate at this point, just let me know, and I'll figure it how, but I don't like to 'invent the wheel' if someone already done it.

Much appreciated for all of your excellent work on Zimbra projects.

Stay sharp and well.

Best regards.

Jorge Gomes
User avatar
jorgedlcruz
Zimbra Employee
Zimbra Employee
Posts: 2661
Joined: Thu May 22, 2014 4:47 pm

Re: A Grafana Dashboard for Zimbra Collaboration

Postby jorgedlcruz » Tue Aug 08, 2017 6:10 pm

Hi Jorge,
What do you need exactly at the moment? Install the whole Grafana, Telegraf on your side? Please let me know.

Best regards
Jorge de la Cruz https://jorgedelacruz.es
Technical Marketing Manager at Zimbra/Synacor https://www.zimbra.com/

Return to “Administrators”

Who is online

Users browsing this forum: No registered users and 19 guests