Since the last FIFE Newsletter there have been two Fifemon updates, v3.2 and v3.3. Notable new features include: SAM project monitoring, Grafana update, batch history and much more.
The Continuous Integration (CI) project’s goal is to reduce the amount of human effort needed to verify each code release, and thus to reduce the frequency of wasted computing and human resources. The CI system is a set of tools, applications and machines that allows users to execute their validation tests with minimal effort. It is… More »
Every physics experiment plans several years in advance. Accurately understanding the needs and defining the computational requirements is fundamental to the discovery and success of the experiment. This planning process needs to account for several unknowns, project the technological advancements with a reasonable level of approximation and incorporate them in the planning process. This process… More »
The Distributed Computing Access with Federated Identities (DCAFI) Project has been moving full steam ahead this summer. The short-term goal of the project is to move all Fermilab users from Fermi KCA, which is being planned to shut down at the end of September, to the new Certificate service provided by the CILogon Basic CA…. More »
here’s a URL fun. Here’s a picture. some words to go with it. Useful ones, hopefully. can add more.
Computing in the MINOS/MINOS+ experiment has evolved greatly in the eleven years since it started taking data in the NuMI beam (April 2005). The scale has increased from the 50 core FNALU batch system to the 15000 cores of Fermigrid/GPGrid. As MINOS prepares to stop taking data at the 2016 Fermilab summer shutdown, another change will… More »
The annual FIFE Workshop will take place on June 20 and 21 this year with a focus on introducing new services and tutorials for current services. The talks on Monday are directed toward experiment Offline Coordinators and Production groups, and the talks on Tuesday are directed toward analyzers. The structure was chosen to allow attendees… More »
The most efficient experiments on GPGrid that used more than 100,000 hours since April 1, 2016 were CDMS (98.27%) and CDF (97.67%).
“There’s a dashboard for that” is the unofficial motto of Fifemon, and to that end we are constantly collecting more data and producing new dashboards. Since the last update, we have added nearly 20 new dashboards, including high-level computing summaries, dCache and SAM monitoring, and troubleshooting guides. In addition to these new dashboards, we have… More »
MicroBooNE began collecting Booster Neutrino Beam data on Oct. 15, 2015. The optical trigger system was commissioned on Feb. 10, 2016, and MicroBooNE has been collecting optically triggered data since then. Fig. 1 shows the volume of data in sam, showing an increased rate of data storage in early April corresponding to the reprocessing campaign. MicroBooNE has recently been… More »
The most efficient big non-production user on GPGrid who used more than 100,000 hours since April 1, 2016 was Willis K.Sakumoto with 100% efficiency. Number of users with efficiency more than 90% has doubled since March!
The use of containers, like Docker, could substantially reduce the effort required to create and validate new software product releases, since one build could be suitable for use on both grid machines (both FermiGrid and OSG) as well as any machine capable of running the Docker container.
The experiment with the most opportunistic hours on OSG between April 1, 2016 and May 31, 2016 was NOvA with 1,362,980 hours.
Recently, a group in SCD identified and mapped different components typically found in the Workflow Management Infrastructure (WMS) of HEP experiments. The fact finding exercise resulted in a document that can be found in the CD DOCDB: http://cd-docdb.fnal.gov/cgi-bin/ShowDocument?docid=5742. Beyond its initial goal of setting a common vocabulary, this document is also useful for identifying gaps in the functionality… More »
Huge amounts of computing resources are needed to process the data coming out of Intensity Frontier detectors. Although addressing different questions, most experiments have similarities in their workflows and computing needs. The OPOS team and the FIFE project capitalize on similarities with a set of tools and practices that incorporate lessons learned from previous experiments…. More »