%IF{"(NOT defined GROUP) OR $GROUP = ''" then=' How to add the first administrator If you haven\'t previously set up an administrator, follow these steps: (Note:...
List of Foswiki users Below is a list of users with accounts. If you want to edit topics or see protected areas of the site then you can get added to the list by ...
The following details the IPMI setup on the AFS file servers linat06, linat07 and linat08 (H8DAR T) Node Interface MAC Addr IP Addr SwitchPort Notes...
Michigan/AGLT2 SuperComputing 2015 Network Demonstrations This year the University of Michigan and AGLT2 are again participating in SuperComputing 2015. The venue...
The ATLAS LIVE monitor is a NEC P521 AVT purchased near the beginning of April 2011. It is located in the hallway just outside West Hall 348 (the Michigan ATLAS ...
Adding Files to Space Token Areas To add files already in dCache to space token areas we need to do a number of things: * Create a new space token to hold the ...
Adding New OSS to Lustre Below are the steps needed to add a new OSS (storage server) to Lustre * Install or re purpose an SL5.5 node * Update all BIOS/Firm...
Cleaning Up the srmspacefile Table (SRM Space token Allocations) We recently found out that our srmspacefile table in dcache was inconsistent with our actual spac...
Planning Condor Configuration Updates for AGLT2 Now that AGLT2 is running on an SL6.4 OS we can plan on implementing some new features in Condor that will take ad...
If a line starts with $ it is a command to be run as a normal user, if it starts with # it is a command to be run as root. * $ cd /net/data07/tests/stress_test/ ...
Upgading dCache Starting on the morning of May 4th 2009 AGLT2 began upgrading from dCache 1.8.0 15p12 to 1.9.2.5 as well as migrating to Chimera. This was motiva...
Upgrading dCache at AGLT2 from 2.10.55 1 to 2.13.23 1 We are upgrading to the next golden release of dCache on February 23, 2016. We have setup CFEngine to have t...
(Re)Configuring the log4j.properties in dCache to output to Syslog At AGLT2 we have setup a central loghost running syslog ng which also has a php syslog ng web i...
This page is OBSOLETE All site services now run at BNL. AGLT2 DQ2/DDM Verification and Debugging One of the central tasks for our Tier2 is to support a DQ2 ser...
Cacti Setup for Dell Nodes The Dell PE1950 and PE2950 nodes have a large number of fans and temperature probes which are not exposed via SNMP. The presents a pro...
Details on Configuring the /etc/multipath.conf for our Nexsan Setup The multipath v2 d with our configuration gives: root@umfs03 ~ # multipath v2 d create: m...
Installing DQ2 References * https://twiki.cern.ch/twiki/bin/view/Atlas/PandaDataService Procedure Shawn created a host cert from doegrids.org for umfs02.grid...
Setting up Two OSG Gatekeepers for a Single Condor Cluster We need to load balance access to our Condor cluster because of a possible time out issue we are seeing...
UMVM0x (ESX) Network Reconfiguration June 2011 The details about the network changes on the UMVM0x nodes are below organized by host with before and after NIC/por...
Dark Sector Event Generation This section describes getting Itay Yavin's dark sector event generation files into a format usable for ATLAS simulation. Itay's cod...
Extending LVM Disks on VMware VMs We sometimes have partitions fill during operations and when those partitions are on VMs and using LVM we can easily extend them...
FTS Channel Management Instructions The FTS channels for AGLT2 and be managed using the glite software. You will need an ATLAS VOMS production role (voms proxy i...
Fixing OMD Setup for AGLT2 Use cases There are a number of issues we are hitting as we try to setup OMD for AGLT2 use. Below are the current list of issues. When ...
Setting up gate02.grid.umich.edu as our AGL Tier2 Gatekeeper There are a number of steps we followed to get our new gatekeeper running. Hardware We had an Int...
Getting a Grid Certificate for ATLAS Use For getting a new certificate or renew a certificate,you can use the CERN CA to request the grid certificate: https://ca....
Setup of GRAM Auditing for AGLT2 (OSG 0.8.1) The current OSG installation (0.8.1) has Globus 4.0.5 which supports a new "auditing" feature. You can request that ...
The following is a copy of an email off the ROCKS mailing list from May 8, 2006: On Mon, 2006 05 08 at 23:04 1000, Jonathan.Ennis King #64;csiro.au wrote: I've...
How to add a new pool node to dCache/Chimera * Provision node via ROCKS (or other method) * Install correct kernel (if not done above): currently 2.6.38 UL5...
LOST all my edits by a key sequence...(from Emacs)... * First read dCache book for info: http://www.dcache.org/manuals/Book/start/in install.shtml http://www....
Implementing Network QoS at AGLT2 Recently we have seen periods where our LANs have been congested and packets are dropped. This has resulted in some of the monit...
Installing a Main line Kernel on Scientific Linux 6.4 or CentOS 7.2 64 bit To install a main line kernel kernel is as simple as putting in place the correct elrep...
Installation of OSG 0.6.0 on gate01.aglt2.org The installation procedure for OSG 0.6.0 on gate01.aglt2.org is below. It was installed on April 2nd, 2007. Please...
LFC SQL Queries Below are some potentially useful SQL queries to check the status of the LFC. These are my test queries and I don't guarantee they are correct ...
Install Problem (really libaio architecture issue) During the "Configuration Assistants" startup I have an error. The "Oracle Net Configuration Assistant" succee...
Lustre Configuration and Setup for AGLT2 In March 2010 we revisited our exploration of Lustre for use at AGLT2. This was motivated in part by the release of Lus...
Lustre Reinstall Notes After testing Lustre "in production" (mostly tests by Tiesheng) we have decided to go ahead with our plans to utilize Lustre to replace the...
Merging Existing Space Tokens When we setup space tokens for AGLT2 we assumed we needed a space token for each VO/Role that needed to be able to write to a space ...
Hardware Transition Planning from head01 (old R610) to head01 temp (new R630) We purchased a new Dell R630 to act as replacement hardware for our existing head01 ...
Results of the MySQL DQ2 tests: umfs02:~ # su dq2 umfs02:~ $ cd /opt/dq2 You have new mail in /var/spool/mail/dq2 umfs02:dq2 $ source config/AGLT2/environmen...
Network Issues at AGLT2 This page is intended to capture the network related issues at AGLT2 Network Issues after UltraLight Router at Starlight (R04CHI) was Ret...
Planning for the production network. NetworkHardwareInfo Near term To Do List Here is a list of network related items that need doing as of February 4, 2011: ...
Network Testing and Debugging for AGLT2 During the last year we have seen many indications that all is not right with our network connections to BNL (and perhaps ...
Network Tuning and Testing On September 18, 2007 Dimitri Katramatos, Kunal Shroff and Shawn McKee tried to test and tune the following machines at BNL and Michiga...
Creation of New dCache Headnodes (Dell R610) in January 2011 As part of our Fall 2010 procurements we purchased 2 Dell R610 nodes to host the dCache services (he...
Procedure to Migrate dCache headnodes (head01/head02.aglt2.org) to new hardware and operating system. During fall 2009 and winter 2010, AGLT2 is migrating all lin...
OSG Account Setup To support OSG VOs we must setup UNIX user/group accounts for the VOs. We have done this for the AGLT2 sites (UMATLAS and AGLT2_UM) and have o...
OSG CE 0.4.1 Install Instructions Introduction This document is intended for administrators responsible for installing and configuring: OSG Compute Element (CE) ...
The content below was copied from the OSG install Twiki page on June 5, 2006. This was done to allow us to use this Twiki to record install details for our OSG i...
Setting up Oracle on Linux The following documents the installation and setup of Oracle at the University of Michigan for use by the ATLAS Muon Calibration and Al...
Installing Updated Muon Calibration Schema New schema was made available in early February 2008. Since the changes were significant I totally removed the origin...
Some info on Oracle setup at AGLT2 * Oracle Installation on linux for the ATLAS Muon Calibration/Alignment centers. * Oracle MuonDB updated (new) schema Feb...
Oracle Upgrade from 10.2.0.2 to 10.2.0.3 Prior to installing the Rome muon calibration DB for replication we needed to update our Oracle installation. I received...
Installing pCache and LSM at AGLT2 We are interested in setting up both a Local Site Mover (LSM) and pCache on our worker nodes. The goals are: * Reduce the I...
Useful PNFS/Chimera SQL Queries NOTE: This page assumes you are running Chimera/PNFS rather than the older PNFS from dCache 1.8.x or earlier. First query: Fix PN...
See https://metalink.oracle.com/metalink/plsql/f?p=130:14:3681850522787148914::::p14_database_id,p14_docid,p14_show_header,p14_show_help,p14_black_frame,p14_font:...
Install Postgresql on CentOS/RHEL/SL with Replication for Esmond This Wiki topic covers installing Postgresql with replication to support the Esmond DB. You will ...
Upgrading Postgresql on CentOS/RHEL/SL with Hot standby Systems This Wiki topic covers upgrading our existing PostgreSQL version 9.3.11 on Scientific Linux 6.7 64...
Upgrading Postgresql from 9.5 to 10.5 We want to go to the most recent Postgresql for use by dCache, at least on head01.aglt2.org. Currently Postgresql is version...
Postgresql on ZFS AGLT2 has been running Postgresql on top of ZFS on our head01.aglt2.org (dCache headnode) for more than 1 year. Recently we came across an inter...
(Re)Configuration of gPlazma on AGLT2 Due to issues with SRM failing that were traced to probable issues in gPlazma we are planning to implement some changes to g...
Recovering from a Lost Pool When we lose a pool we need to do a number of things to recover. Once we determine we have really lost the pool we will need to find t...
Reinstallation of Oracle for the Muon Calibration Center On May 2nd, 2009 our primary Oracle server (umors.grid.umich.edu) was compromised because we had forgott...
Removing PNFS (Chimera) Ghosts There is the possibility that the chimera DB can become out of sync with the actual files stored on disk. The t_dirs table holds t...
Replicating the Oracle Controlfile For safety it is good to replicate the controlfile for an Oracle DB. Our muoncal instance (after reinstalling in May 2009)...
Reworking AGLT2's Logging Setup In upgrading atgrid we have an opportunity to migrate from syslog ng and php syslog ng to something new. The ELK stack (Elasticse...
Setup and Running ATLAS Software (from Ed Diehl email) I have found in the past that the validation scripts have errors themselves, or there are other obscure pro...
SEC.pl (System Event Correlator) There is a nice two part article on SEC which describes how it works and what it provides. I encourage you to look it over. Th...
AGLT2 SRM Hangs Starting in late April 2009 AGLT2 was having more and more dCache/SRM issues. One problem that significantly increased in frequency was SRM faili...
Security Monitoring: Setup and Configuration * Snort setup information and configuration * Syslog ng setup for AGLT2 * SEC setup and configuration usin...
Setting up ATLAS Area HOTDISK for AGLT2 As of mid September 2009 we need to provide a new space token area in Tiers of ATLAS call 'HOTDISK'. There are a few com...
Setup and Configuration of the AGLT2 MD3820i This details our installation and configuration of our new MD3820i (UMVMSTOR03). We received both units on August 4th...
Installing gssklog/gssklogd on our cluster We have user home spaces (including grid "group" accounts) in our AFS cell (atlas.umich.edu). Currently any user tryi...
Setting up LVS (Linux Virtual Server) for use with dCap Newer linux kernels have LVS built in (as well as our UltraLight kernels). See http://kb.linuxvirtualserv...
Setup and Configuration of the AGLT2 MD3600i July 25, 2011 This details our installation and configuration of our new MD3600i (UMVMSTOR02) plus MD1200 shelf. W...
Setting Up OMD on AGLT2 Systems Monitoring for AGLT2 has used lots of different software: Ganglia, Syslog ng, Cacti, Nagios, Shinken, Rancid, Monit/MMonit, OpenMa...
Setting up SSH Keys for AGLT2 SSH is able to use a variety of methods for authenticating users. Each method has security strengths and weaknesses. The normal user...
Notes on Building ShawnGenerator Below are the series of steps I used to create my "ShawnGenerator". This generator is based upon source code from Loek Hooft va...
This page keeps a "shopping list" of needed equipment and parts as well as a reference for suppliers. Add items with a date. When items are purchased, please ma...
HowTo Shutdown a Pool Node While In Production We sometimes need to restart/reboot pool nodes and would like to make this as least disruptive to the production sy...
Site Blacklisting via DQ2 Commands If you want to exclude your site from DQ2 you need to use the dq2 set location status command. The specific command is: dq2 set...
Using Slony to Replicate dCache Postgresql DBs We have been running postgresql 9.0.x on our dCacheheadnodes for almost two years. Currently we have have the follo...
Running ATLAS software on SLC43 x86_64 We had installed the mars01.cern.ch mars05.cern.ch systems with SLC43 and an experimental kernel. Though we could install ...
Testing of New dCache Storage Node Build Here is the testing result for a new storage node (summary: it works). After running \x91install_dcache.sh\x92 on UMFS16...
Installation Details for VDT v1.6.0 We are trying the VDT v1.6.0 installation on gate01.grid.umich.edu following instructions at the VDT 1.6.0 release note page. ...
AGLT2 Account and Resource Policy In order to meet the requirements placed upon our Tier2 we are implementing a GUMS/VOMS/PRIMA configuration (so called "Full Pri...
Track Transfers to dCache Just some quick notes on tracking specific transfers to dCache. * First, make sure the SRM logging is verbose enough (going to catali...
Syslog NG Log Processing on ATGRID The syslog ng software can generate a significant amount of data over time. On atgrid.grid.umich.edu we have a RAID5 system be...
Update Kerberos on our Servers The kerberos servers were installed long ago when DES was the primary encryption. We need to change to using newer more secure algo...
Updating LFC for AGLT2 The LFC host for AGLT2 is lfc.aglt2.org. This is a VMware VM (SL5.2/x86_64). As of September 13, 2009 the LFC software was installed in /...
Upgrading from GPlazma1 to GPlazma2 on dCache 2.2.12 In preparation for upgrading to dCache 2.6 we need to reconfigure our dCache GPlazma configuration to go from...
Upgrade Postgres on AGLT2 dCache ADMIN node During our recent upgrade of dCache we also ended up upgrading our Postgres installation on the dCache PNFS node (head...
On December 23, 2005 I "upgraded" umfs01.grid.umich.edu from the i686 (32 bit) version of Scientific Linux 4.1 to the x86_64 (64 bit) version of Scientific Linux ...
Updating and Upgrading dCache Headnodes for AGLT2 June 2013 The dCache headnodes head01.aglt2.org and head02.aglt2.org were transitioned to VMware VMs in 2012. As...
Upgrade Planning for AGLT2 SL5 Systems Introduction We need to upgrade our remaining SL5 systems to SL6 soon. We should use this page to track which systems stil...
Reconfigure dCacheConfig to use both Cell and Module As noted before, the preferred gPlazma configuration uses the cell method but it has been pointed out that th...
Using "Monit" for Monitoring and Repairing AGLT2 Services NOTE: THIS PAGE IS NOW MOSTLY OBSOLETE, WITH MONIT INSTALLED VIA CFENGINE The monit application monitors...
VMware perfSONAR Plots for Debugging Network Issues As part of AGLT2's VMware setup, we have created three ESX host specific perfSONAR instances running OWAMP (on...
VMWare Setup and Updates This page should keep track of VMware related setup/updates and information. Update to vSphere 5.1 This section will document the detail...
VMWare vSphere Upgrade at AGLT2 In September 2012 VMware release a signficant upgrade to vSphere: 5.1. There are a number of nice features that we want to benefit...
Virtuozzo Information and HowTo We have been testing Virtuozzo on our new virtualization hardware. Virtuozzo runs multiple "servers" on a host system, sharing t...
WLCG Accounting for Tier 2 Sites This page contains some plots showing WLCG Tier 2 accounting results for Tier 2's worldwide. Currently the plots are only availa...
Atlas Great Lakes Tier2 Web How to contact us * For problems, contact us through our signatures here: * Main.WenjingWu AGLT2 Manager and University of M...
Using ZFS on Linux for AGLT2 AFS Fileservers Recently ZFS on Linux became available. ZFS has lots of nice features including Copy On Write (COW), data integrity v...
PXE Boot the Dell Disk Firmware Update Dell has released a firmware update package for many types of hard disks. The update must be done with the disks offlne. ...
Install Open vSwitch on Scientific Linux 6.7 In preparation for testing OVS (Open vSwitch) for ATLAS use I am documenting what needs to be done to build the RPMS ...