Heavy-ion fill in ATLAS

ATLAS Computing and Muon Calibration Center


SuperComputing 2015

SDN Optimized High-Performance Data Transfer Systems for Exascale Science

LHCONE Point2point Service with Data Transfer Nodes

Materials and photos from the HEPiX Fall 2013 Workshop at AGLT2 UM.

Current Statistics

We have 5983 Condor jobs (3717 running on 7609 cores, 1706 idle, 560 held)

Total Slots 4003, Cores 7799

Job status page

ATLAS Computing

AGLT2 Compute and Storage Nodes

AGLT2 provides more than 6600 CPU cores and 3.5 Petabytes of storage for ATLAS physics computing. Site infrastructure services for job management, storage management, and interfacing with the ATLAS computing cloud are managed at UM and computing/storage resources are located both at UM and at MSU.

To outside users of our site we appear as one entity. The collaboration between UM and MSU allows our site to provide double the resources than would otherwise be possible and increase our redundancy in the event that either site is unavailable.

ATLAS Muon System Calibration

Monitored Drift Tube diagram

To determine calibration compensations for ATLAS Monitored Drift Tubes a special data stream is sent to calibration centers in Michigan, Rome, and Munich.

Storage, CPU, and human resources at AGLT2 are dedicated to MDT calibration including dedicated hosts to process calibration data, a database replicated to CERN, and custom AGLT2 authored tools. The ATLAS calibration process occurs every day there is a beam in the LHC.


OSiRIS or MI-OSiRIS (Multi-Institutional Open Storage Research Infrastructure) will combine a number of innovative concepts to provide a distributed, multi-institutional storage infrastructure that will allow researchers at any of our three campuses to read, write, manage and share their data directly from their computing facility locations.

Our goal is to provide transparent, high-performance access to the same storage infrastructure from well-connected locations on any of our campuses. We intend to enable this via a combination of network discovery, monitoring and management tools and through the creative use of CEPH features.

By providing a single data infrastructure that supports computational access on the data "in-place", we can meet many of the data-intensive and collaboration challenges faced by our research communities and enable these communities to easily undertake research collaborations beyond the border of their own Universities.

Indiana UniversityMichigan State UniversityWayne State UniversityUniversity of MichiganNational Science Foundation

OSiRIS is a collaboration between University of Michigan, Wayne State University, Michigan State University, and Indiana University funded by the NSF under award number 1541335. Many other institutions will collaborate as scientific users as the project becomes established.


Pythia Network Diagnosis Infrastructure

PuNDIT will integrate and enhance several software tools needed by the High Energy Physics (HEP) community to provide an infrastructure for identifying, diagnosing and localizing network problems. In particular, the core of PuNDIT is the Pythia tool that uses perfSONAR data to detect, identify and locate network performance problems. The Pythia algorithms, originally based on one-way latency and packet loss, will be re-implemented incorporating the lessons learned from its first release and augmenting those algorithms with additional metrics from perfSONAR throughput and traceroute measurements. The PuNDIT infrastructure will build upon other popular open-source tools including smokeping, ESnet's Monitoring and Debugging Dashboard (MaDDash) and the Open Monitoring Distribution (OMD) to provide a user-friendly network diagnosis framework.

National Science Foundation

The PuNDIT research project is a collaboration between Georgia Tech and University of Michigan funded by the National Science Foundation under award numbers 1440571 and 1440585.

Georgia Tech College of Tech ComputingUniversity of Michigan

SuperComputing 2015

SuperComputing Conference 2015

SDN Optimized High-Performance Data Transfer Systems for Exascale Science
This demonstration focuses on network path-building and flow optimizations using SDN and intelligent traffic engineering techniques.

LHCONE Point2point Service with Data Transfer Nodes
A network services model that matches the requirements of LHC high energy physics research with emerging capabilities for programmable networking