GRACC replacing Gratia as grid accounting system

Earlier this year the OSG deployed its new grid accounting system, GRACC. Developed by Fermilab with OSG collaborators, GRACC aims to provide a more flexible and scalable (and faster!) accounting system than its predecessor, Gratia.

More details about the motivation and design of GRACC are in the CHEP 2016 paper.

Fifemon dashboard showing various Wall time metrics on GPGrid/FermiGrid and on the OSG. These plots are populated with data from GRACC.

Why does accounting matter to FIFE users when there are great monitoring tools like Fifemon available? Monitoring is more focused on the current state of the batch system and jobs, while accounting is meant to be a reference of what has happened. Who ran jobs where and how well did they use the resources? With the move to GRACC it has become much easier to incorporate accounting data into monitoring, and many Fifemon dashboards actually combine local Fifemon data with GRACC records, for instance the Experiment Computing Summary.

Powered by Elasticsearch, GRACC makes accounting data readily accessible, with powerful open-source searching, filtering, and visualization tools. The primary interface to GRACC is a Grafana instance at https://gracc.opensciencegrid.org. There are a number of dashboards there that provide some typical filtering options via drop-down. For instance, the VO Summary dashboard can be used to see historical usage of OSG sites (including GPGrid/FermiGrid) for NO?A. Custom visualizations and queries are facilitated by the Kibana application, which is open for general read-only access (it does have a bit of a learning curve though!).

As always, if you have questions about how to utilize GRACC data, or have an idea for a dashboard in Fifemon, please feel free to open a request to Distributed Computing Support under Scientific Computing Services in ServiceNow.

–Kevin Retzke