A Grafana Dashboard for Zimbra Collaboration

Discuss your pilot or production implementation with other Zimbra admins or our engineers.
Post Reply
User avatar
jorgedlcruz
Zimbra Alumni
Zimbra Alumni
Posts: 2782
Joined: Thu May 22, 2014 4:47 pm

A Grafana Dashboard for Zimbra Collaboration

Post by jorgedlcruz »

Hello everyone,
I've been working on a spare project using Grafana and Zimbra Collaboration. This dashboard, based on the well-known pflogsumm, contains multiples sections with the goal to monitor a full Zimbra Collaboration Server or Servers, we have some sections to monitor the Linux and machine overall performance, and one dedicated section just to monitor Zimbra Collaboration

Image

More information available in: https://github.com/jorgedlcruz/zimbra-grafana and on the official Grafana Dashboard page https://grafana.com/dashboards/2846

Zimbra Collaboration Performance:
* ZCS Version
* Received Megabytes
* Total Emails/received
* Deferred
* Bounced
* Rejected
* Held
* Discarded

Linux and machine performance:
* CPUs (defaults to all)
* Disks (per-disk IOPS)
* Network interfaces (packets, bandwidth, errors/drops)
* Mountpoints (space / inodes)

Coming next
This is just a v0.3 of this Dashboard, the next step will be to use the Zimbra SOAP API to obtain some extra information from the Zimbra Collaboration Environment, like:
* Number of Active Users
* Number of Inactive Users
* Number of Domains
* Number of Users with ActiveSync
* etc.

Wiki about this solution
* https://wiki.zimbra.com/wiki/Monitoring ... nd_Grafana

In next versions, we will parse directly the logs and put the attempts of logins, and successful logins on a map.

As this is an open project, please feel free to share your ideas, feedback and if possible even help to make it better :) My MTA is really small, so I will appreciate a real feedback from a bigger MTA.

Thank you, guys!
Jorge de la Cruz https://jorgedelacruz.es
Systems Engineer at Veeam Software https://www.veeam.com/
iomarmochtar
Posts: 41
Joined: Sat Sep 13, 2014 3:54 am
Location: Indonesia
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Post by iomarmochtar »

Cool dashboard,

Actually i just created the same but i'm using Icinga2 (for advance alert) then for every check command will fetch some metrics that will be visualized in Grafana.

Btw what's the purpose of command

Code: Select all

sed 's/........................//' /opt/zimbra/jetty/webapps/zimbra/downloads/.git/HEAD
since there is no git repository there.
User avatar
jorgedlcruz
Zimbra Alumni
Zimbra Alumni
Posts: 2782
Joined: Thu May 22, 2014 4:47 pm

Re: A Grafana Dashboard for Zimbra Collaboration

Post by jorgedlcruz »

Hello,
That line starting ZCS 8.7.3 gives you the ZCS version, which version do you have?

Best regards
Jorge de la Cruz https://jorgedelacruz.es
Systems Engineer at Veeam Software https://www.veeam.com/
iomarmochtar
Posts: 41
Joined: Sat Sep 13, 2014 3:54 am
Location: Indonesia
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Post by iomarmochtar »

I'm using version 8.6 in my RnD machine.
User avatar
L. Mark Stone
Ambassador
Ambassador
Posts: 2796
Joined: Wed Oct 09, 2013 11:35 am
Location: Portland, Maine, US
ZCS/ZD Version: 10.0.6 Network Edition
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Post by L. Mark Stone »

Jorge,

Just looking at this now; seems very interesting and useful!

I'll look at the install details and see if I can't test this on a larger MTA.

Can you aggregate data in one Grafana Dashboard for a Zimbra Multi-Server Hosting Farm that has multiple MTA servers?

Thanks,
Mark
___________________________________
L. Mark Stone
Mission Critical Email - Zimbra VAR/BSP/Training Partner https://www.missioncriticalemail.com/
AWS Certified Solutions Architect-Associate
User avatar
jorgedlcruz
Zimbra Alumni
Zimbra Alumni
Posts: 2782
Joined: Thu May 22, 2014 4:47 pm

Re: A Grafana Dashboard for Zimbra Collaboration

Post by jorgedlcruz »

Hi Mark,
Thank you for the help trying it. Yes, of course, you will need to tune a bit the selectors on the top, and every aspect where it says $server, I will try to test it with multiple MTAs as well.

Let me know once you try it :)

Best regards
Jorge de la Cruz https://jorgedelacruz.es
Systems Engineer at Veeam Software https://www.veeam.com/
User avatar
L. Mark Stone
Ambassador
Ambassador
Posts: 2796
Joined: Wed Oct 09, 2013 11:35 am
Location: Portland, Maine, US
ZCS/ZD Version: 10.0.6 Network Edition
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Post by L. Mark Stone »

jorgedlcruz wrote:Hi Mark,
Thank you for the help trying it. Yes, of course, you will need to tune a bit the selectors on the top, and every aspect where it says $server, I will try to test it with multiple MTAs as well.

Let me know once you try it :)

Best regards
I'm confused because I don't see any Grafana docs for configuring the system to be monitored; I only see that I need to add a "Data Source".

Here's where I'm at:
I set up a free Grafana Hosted Cloud Server. I can download the pfloggsumm.pl file to a Zimbra MTA of course. What do I need to install/configure on the Zimbra MTA to point the output to my Grafana server?

Thanks!
Mark
___________________________________
L. Mark Stone
Mission Critical Email - Zimbra VAR/BSP/Training Partner https://www.missioncriticalemail.com/
AWS Certified Solutions Architect-Associate
User avatar
jorgedlcruz
Zimbra Alumni
Zimbra Alumni
Posts: 2782
Joined: Thu May 22, 2014 4:47 pm

Re: A Grafana Dashboard for Zimbra Collaboration

Post by jorgedlcruz »

Hi Mark,
You will need to use the Telegraf service - https://docs.influxdata.com/telegraf/v1 ... tallation/

It's really easy to install, once installed you will want to take a look to the Collector Configuration Details section under https://grafana.com/dashboards/2846

Restart the telegraf service and go, you will find more information on the telegraf.log

Let me know
Jorge de la Cruz https://jorgedelacruz.es
Systems Engineer at Veeam Software https://www.veeam.com/
User avatar
jasggomes
Advanced member
Advanced member
Posts: 90
Joined: Sat Sep 13, 2014 12:59 am
Location: Lisbon, PT
ZCS/ZD Version: Release 8.7.11.GA.1854.UBUNTU14.64
Contact:

Re: A Grafana Dashboard for Zimbra Collaboration

Post by jasggomes »

Hi Jorge, sorry for this ...

I 'm very interested on this projecto of yours, so I've setup a free account on Grafana Labs, and can you please direct me to some how to for me to setup it?
If this question is not appropriate at this point, just let me know, and I'll figure it how, but I don't like to 'invent the wheel' if someone already done it.

Much appreciated for all of your excellent work on Zimbra projects.

Stay sharp and well.

Best regards.

Jorge Gomes
User avatar
jorgedlcruz
Zimbra Alumni
Zimbra Alumni
Posts: 2782
Joined: Thu May 22, 2014 4:47 pm

Re: A Grafana Dashboard for Zimbra Collaboration

Post by jorgedlcruz »

Hi Jorge,
What do you need exactly at the moment? Install the whole Grafana, Telegraf on your side? Please let me know.

Best regards
Jorge de la Cruz https://jorgedelacruz.es
Systems Engineer at Veeam Software https://www.veeam.com/
Post Reply