FIFE Notes – February 2016

Best in Class

​Recent Open Science Grid milestones

The Open Science Grid (OSG) has recently achieved a number of milestones and continues to provide distributed grid computing resources to scientists around the world at a record scale. hours-vo 2015 marked the first year since the OSG's inception a decade earlier that over 1 billion computational hours were consumed by OSG users.
Read more

Most efficient experiments on FermiGrid that used more than 500,000 hours

Most efficient experiments on FermiGrid that used more than 500,000 hours since Dec. 1, 2015 -  MINOS (98.72%) and MINERvA (85.80%) wall-hours
Read more

​​Most efficient big non-production users on FermiGrid

Most efficient big non-production users on FermiGrid who used more than 100,000 hours since Dec. 1, 2015 was Luri A. Oksuzian from MINOS with 98.9% efficiency.
Read more

​The experiment with the most opportunistic hours on OSG

The experiment with the most opportunistic hours on OSG between Dec. 1, 2015 and Jan. 31, 2016 was Mu2e with 13,960,877 hours. cycles2
Read more

This newsletter is brought to you by:

  • Mine Altunay
  • Ken Herner
  • Bo Jayatilaka
  • Mike Kirby
  • Katherine Lato
  • Tanya Levshina
  • Anna Mazzacane
  • Kevin Retzke
  • Brian P. Yanny

We welcome articles you might want to submit. Please email

Feature Articles

New sites for MicroBooNE

The MicroBooNE collaboration operates a 170 ton Liquid Argon Time Projection Chamber (LAr TPC) located on the Booster neutrino beam line at Fermilab. The experiment first started collecting neutrino data in October 2015. MicroBooNE measures low-energy neutrino cross sections and investigates the low-energy excess observed by the MiniBooNE experiment. The detector also serves as a next step in a phased program towards the construction of massive kiloton scale LAr TPC detectors for future long-baseline neutrino physics (DUNE) and is the first detector in the short-baseline neutrino program at Fermilab.

Read more

​Optimizing job submissions

Carefully tailoring your resource requests will increase your job throughput

With partitionable slots now the norm on GPGrid, it’s important to have a good understanding of resource requirements. The memory, disk, and maximum runtime available in free job slots changes as users submit jobs. As a result, there may be free slots that have ...

Read more

​Coming soon to Fifemon: job resource monitoring

Wondering why your jobs have been put on hold? Want to better set your resource requests to make more efficient use of the grid (and to get your jobs starting faster)? This information, and more, will be available in the FIFE monitoring application, Fifemon, soon, and is already available for testing in pre-production ( Starting with your User Batch Details dashboard, you can see what jobs have been put on hold and why, as well as a complete listing of job clusters currently in the system. Included in this table are the maximum resources used with how much was requested. If a cell is highlighted in red, it means the job has exceeded its request and has been put on hold, requiring intervention to either decrease the amount the job uses or increase the request. Please contact FIFE Support through ServiceNow if you need assistance. fifemon_job_table
Read more

Know before you go (on the OSG)​

FIFE has a Wiki page to help match resource requirements and availability at remote sites Previous editions of FIFE notes have shown glimpses of the tremendous computing resources available on the Open Science Grid. These resources come from a large number of remote sites, each of which has its own limitations and policies regarding opportunistic access. When users try to match their job requirements to sites, it can be a daunting task. In most situations, the FIFE Group recommends that users should not specify sites explicitly when submitting jobs to OSG locations in order to get the most resources. Instead, sit back, relax, and let the fifebatch system match your job to a free slot at an appropriate site. Occasionally, however, users want or need to send certain types of jobs only to a specific set of remote OSG sites.
Read more

​OPOS helping MINERvA with offline production

MINERvA has been using offline production from OPOS for over a year. The following picture shows almost 200,000 jobs from MINERvA between June and December of 2015. (Note: DUNE’s part of the graph only covers December since they started until OPOS on November 30, 2015.)

opos_jobs_jun19_dec31_2015Read more

Measuring the Universe — one galaxy at a time

The Dark Energy Survey (DES) is in its third year of gathering multi-colored digital images of large swaths of deep space with the 4m diameter mirror of the Blanco telescope on a mountaintop in Chile. The team of physicists, astrophysicists, engineers, computer professionals, technicians and managers who operate the survey are participants in a around-the-clock ...

Read more

Click here for archive of past FIFE notes.

About FIFE


Fife, Scotland: photo courtesy K. Lato

FIFE provides collaborative scientific-data processing solutions for Frontier Experiments.

FIFE takes the collective experience from current and past experiments to provide options for designing offline computing for experiments. It is not a mandate from Scientific Computing Division about how an experiment should or should not design their offline computing. FIFE is modular so experiments can take what they need, and new tools from outside communities can be incorporated as they develop.

Please click HERE for detailed documentation on the FIFE services and tools.