How to get a whole bunch of jobs going while everyone else is sipping eggnog While everyone enjoys a break from work this time of year, one thing that won’t be taking a break is grid computing. GPGrid will run at full capacity at all times, as will many of the usual offsite computing clusters…. More »

High-energy physics experiments have an ever-growing need for computing, but all the experiments don’t need all the cycles all the time. The need is driven by machine performance, experiment and conference schedules, and even new physics ideas. Computing facilities are purchased with the intention to meet peak workload rather than the average, which impacts the… More »

The HEP computing model is constantly evolving, and one change that is currently taking place is increased use of High Performance Computing (HPC) resources. Some of these HPC resources include supercomputing sites such as NERSC, as well as the EXtreme Science and Engineering Discovery Environment (XSEDE). XSEDE is actually a collection of several HPC resources,… More »

Since the first article appeared in the August 2016 edition of FIFE Notes, the Continuous Integration (CI) project has been implementing new features and on-boarding new experiments and collaborations. DUNE, GlideinWMS, MINERvA and GENIE are ready to try it out. NOvA is using CI extensively for their production releases. Alex Himmel, the NOvA production coordinator,… More »

Back in about 2012, when we were designing the IFDH layer to insulate experimenter’s code from the gory details of data handling and operating on the grid, I drew a diagram that included the ifdh copy utility logging all the copies to a central logging facility and an agent of the monitoring system scraping those logs to provide… More »