Best in Class
The experiment with the most opportunistic hours on OSG between February 1, 2017 and April 1, 2017 was NOvA with 1,361,998 hours.
The most efficient big non-production user on GPGrid who used more than 100,000 hours for successful jobs since February 1, 2017 is James Sinclair with 97.4% efficiency.
The most efficient experiments on GPGrid that used more than 100,000 hours since February 1, 2017 were DarkSide (95.13%) and SBND (91.13%).
Thanks to recent advances in deep learning, we are able to distill the thousands of monitoring inputs received every second into a single, targeted heuristic that tells you what the state of the scientific computing systems, batch systems, and your jobs are right now.
Read more
This newsletter is brought to you by:
- Shreyas Bhat
- Joe Boyd
- Pengfei Ding
- Lisa Giacchetti
- Ken Herner
- Mike Kirby
- Tanya Levshina
- Anna Mazzacane
- Kevin Retzke
- Margaret Votava
We welcome articles you might want to submit. Please email fife-support@fnal.gov.
Feature Articles
The Scientific Computing - Portfolio Management Team (SC-PMT) 2017 review was held at the end of February. SC-PMT is the annual review for the computing divisions and experiments to ensure computing resources (both hardware and people) are aligned with both P5 and FNAL objectives.
Read moreIn early March, over 120 people gathered at the San Diego Supercomputer Center for the annual Open Science Grid All-Hands Meeting. The meeting brings researchers from all fields of science and distributed computing technicians together to learn about the numerous areas of science that the OSG impacts, both within and outside of the particle physics community, and new tools and techniques to improve the performance of the available computing resources. All talks are available from the FNAL Indico server:
https://indico.fnal.gov/conferenceTimeTable.py?confId=12973
Read moreWith an increasing demand from the production groups, the Production Operations Management System (POMS) is being extended to meet the Intensity Frontier (IF) experiments’ requirements for high scale production and distributed analysis processing.
Read moreSAM4Users is a toolset designed to help analyzers create and manage datasets that are of interest to their analysis. It helps a common user to leverage all the great features SAM provides on their personal data files. Creating, relocating and retiring datasets of data files are no longer tasks that can only be done by a few experts in the experiment’s production group. With the SAM4Users toolset, these tasks all become as simple as the use of one command.
Read moreFor the fifth year running, the FIFE group (http://fife.fnal.gov/) is holding an early summer workshop for experiment analyzers, offline coordinators and Scientific Computing Division service providers. The FIFE workshop will take place June 21-22, 2017 in the Building 327 video conference room (a.k.a. the CDF Big Room). Read moreIn the near future, the FIFE group will implement a Grid Computing efficiency policy to help ensure maximal utilization of computing resources. In the coming weeks, the FIFE Group will be configuring jobsub servers to send email notifications to all FIFEBatch users informing them of the efficiency of clusters in terms of CPU time, memory utilization and scratch disk requested.
Read more
About FIFE
FIFE provides collaborative scientific-data processing solutions for Frontier Experiments.
FIFE takes the collective experience from current and past experiments to provide options for designing offline computing for experiments. It is not a mandate from Scientific Computing Division about how an experiment should or should not design their offline computing. FIFE is modular so experiments can take what they need, and new tools from outside communities can be incorporated as they develop.
Please click HERE for detailed documentation on the FIFE services and tools.
