Backlinks to Storage in AGLT2 Web (Search all webs)
Results from AGLT2 web retrieved at 17:27 (GMT)
AGISSchedConfig
The AGIS System and Changing SchedConfig Parameters at AGLT2 Why AGIS Information about changeover to AGIS came in this Email of 2/28/2013 Ladies and gentleme...
r2 - 10 Apr 2013 - 17:27 by BobBall
AGLTatSC15
Michigan/AGLT2 SuperComputing 2015 Network Demonstrations This year the University of Michigan and AGLT2 are again participating in SuperComputing 2015. The venue...
r6 - 24 Nov 2015 - 14:48 by ShawnMcKee
AddForeignDiskToRaid
Replaced Disks That Show "Foreign" Status Such a simple thing, but such a pain. We've all seen this, replace a failed disk in a RAID array with a salvaged disk, ...
NEW - 28 Oct 2015 - 15:32 by BobBall
AddingAnOSS
Adding New OSS to Lustre Below are the steps needed to add a new OSS (storage server) to Lustre * Install or re purpose an SL5.5 node * Update all BIOS/Firm...
r3 - 02 Sep 2010 - 19:19 by ShawnMcKee
AssociateDirectoryToPools
How a associate a directory to certain pools user case: we need to designate certain pools for sc07,which means when we write data to a certain directory, data wi...
r7 - 08 Apr 2009 - 23:36 by WenjingWu
BiweeklyNotes
Bi weekly AGLT2 site meeting notes Thursday, June 26, 2008 See SecurityPlanning Security Notes Need to check syslog ng configuration for all hosts and base on mo...
r10 - 14 Jun 2013 - 21:07 by BenMeekhof
CephCluster
CEPH cluster setup Docs http://ceph.com/docs/master/install/manual deployment/ System Provisioning CFengine Updated cfengine trunk to accommodate SL7 systems....
r11 - 02 Oct 2015 - 18:55 by BenMeekhof
Cfengine2to3Transition
Transition from CFEngine v2 to v3, and Build dCache Pool Servers Introduction As documented elsewhere in this Wiki, cfengine2 is currently (Oct 2012) in use to c...
r48 - 20 Sep 2017 - 15:24 by BobBall
CobblerInfrastructure
Manuals Cobbler manual: http://www.cobblerd.org/manuals/ For information on the Cheetah template language used in kickstart templates: http://www.cheetahtemplate....
r37 - 27 Oct 2019 - 12:39 by ShawnMcKee
ControlledShutdown
Shutdown/Startup procedures for AGLT2 Clusters Procedures to cleanly bring All AGLT2 activity to a halt * service cfengine3 stop * This prevents changes...
r3 - 10 Dec 2013 - 18:19 by BobBall
DCacheDatabaseToFilesystem
dCache Config Overview dCache from Database to Filesystem Below is a view of the chain of configuration for the dCache system starting with the PostgreSQL databa...
r16 - 18 Apr 2008 - 20:45 by TomRockwell
DCacheNotes
Table of Contents * Monitor * Aglt2 dCache Monitor Interface References * http://www.dcache.org/ * some dcache admin scripts dCache Upgrade May 20...
r59 - 12 Jan 2017 - 14:35 by BobBall
DCacheOfAGLT2
Dcache on AGLT2 service distribution: all the dcache services are physically distributed to 37 nodes. tow of them are head nodes(head01.aglt2.org and head02.aglt...
r4 - 24 Sep 2007 - 15:32 by WenjingWu
DDMdq2
This page is OBSOLETE All site services now run at BNL. AGLT2 DQ2/DDM Verification and Debugging One of the central tasks for our Tier2 is to support a DQ2 ser...
r28 - 23 May 2011 - 18:35 by ShawnMcKee
DataManagement
Just starting this out... Tom, May 21 Data Storage Locations What locations are in use and how they are used. We have a number of storage locations for AGLT2: ...
r7 - 16 Oct 2009 - 20:14 by TomRockwell
DellServerMD1000Provisioning
Provisioning the Dell 2950/MD1000 Storage Servers Recipe for getting a new PE2950 and MD1000 combination going as an fss nfs appliance in our ROCKS cluster. Refer...
r23 - 30 Oct 2008 - 16:46 by TomRockwell
DriveReplacementMD1000
Drive Replacement on the MD1000 Obviously, this needs some testing... A drive has failed and XFS got errors and took the filesystem offline. * unmounted filesy...
r2 - 29 Apr 2008 - 23:16 by TomRockwell
GangliaSetup
Ganglia See: * http://ganglia.info/ * http://drupal.star.bnl.gov/STAR/comp/sofi/tools/ganglia * http://www.ibm.com/developerworks/wikis/display/WikiPtype/g...
r12 - 01 Dec 2009 - 00:51 by TomRockwell
GlusterTesting
Testing Glusterfs For testing purposes only we used the Redhat Storage Appliance demo which has gluster tools pre installed. Docs are here: http://docs.redhat.com...
r6 - 27 Jun 2012 - 20:41 by BenMeekhof
HASetup
High Available Lustre MDS failover nodes with Redhat cluster tools Background: The Lustre Meta Data Server is integral to using Lustre. If it is not available...
r3 - 06 Apr 2010 - 18:45 by BenMeekhof
HardwareDeloyment
Hardware Deployment This page will discuss the steps to deploy new hardware in the MSU server room. Preparing for a purchase Determine resource usage * Where...
r4 - 21 Mar 2014 - 17:18 by JamesKoll
HowToAddNewPoolsToChimera
LOST all my edits by a key sequence...(from Emacs)... * First read dCache book for info: http://www.dcache.org/manuals/Book/start/in install.shtml http://www....
NEW - 19 Nov 2009 - 20:11 by ShawnMcKee
HowToAddNewStorage
How to Add New Storage to dCache We will look at the example of umfs16, where 12 new pools were added. Following the xfs file system creation, all disks were mou...
NEW - 12 Jan 2017 - 15:16 by BobBall
HowToDrainAndRemoveStorage
Directions on Draining then Removing a Pool Set pool readonly. Can start drain right away, but will likely miss a few files ssh to admin domain \c PoolManager \c...
r2 - 11 Jul 2017 - 14:58 by BobBall
HowToEasyMoveDataFromPoolToPool
Easy Move dcache data from pool to pool UserCase we want to retire non resilient pool umfs07_2 from dcache which holds 1.7TB data,so we need to move these data t...
r3 - 05 Apr 2008 - 20:56 by WenjingWu
HowToMoveDataFromPoolToPool
How to Move data from pool to pool (how to drain a pool) *usecase*: we want to retire the node c 2 33 from the pool nodes..so we need to move the data from po...
r12 - 29 Oct 2007 - 20:44 by WenjingWu
HowToUpgradeDcache
Procedure for Installing or Upgrading dCache Servers Procedure for installing dCache servers. This is tested for use on the dCache storage nodes / gridftp doors....
r5 - 28 May 2009 - 20:02 by TomRockwell
HowToUpgradeStorage
Upgrading dcache storage hardware This is a procedure to follow when you don't wish to create a new pool but instead copy an old one to new hardware and have it o...
r3 - 17 Dec 2010 - 19:37 by ShawnMcKee
IPAddresses
AGLT2 IP Addresses Information on IP addresses for the Tier2 For detail list of IPs at MSU see ask Tom for msu ips.ods or see configs/msu/network/msu ips.csv For ...
r11 - 25 Mar 2010 - 15:35 by TomRockwell
InstallAmandaOnCentos7
TOC% This document describes how to install amanda on Centos7, and also connect it to a new tape library EMC ML3. About EMC ML3 It has 2 drivers, It has 32 usabl...
r2 - 17 Sep 2019 - 19:35 by WenjingWu
LocalDQ2Tools
The desire was to set up a local installation of the dq2 tools, eg, dq2_get and dq2_ls. Previous setups used by the UM group did not work for a variety of reasons...
r29 - 21 Feb 2014 - 16:35 by BobBall
Lustre2_10_ZFS_0_7_1
Lustre 2.10 with ZFS 0.7.1 from standard repo This page documents building the Lustre 2.10 RPMs on CentOS 7.3 using the default yum install of ZFS 0.7.1. The ste...
r15 - 05 Jun 2018 - 20:27 by BobBall
LustreAtAglt2
Lustre At Aglt2 Lustre Deployment MDS(metadata Server) we have a failover pair of metadata servers,lmd01 and lmd02, both servers can access the same device (/...
NEW - 15 Dec 2008 - 23:02 by WenjingWu
LustreNew
Lustre Configuration and Setup for AGLT2 In March 2010 we revisited our exploration of Lustre for use at AGLT2. This was motivated in part by the release of Lus...
r10 - 18 Oct 2012 - 01:08 by BenMeekhof
LustreTestsZFS
Test results comparing zfs to ldiskfs The tests below run a test Lustre system (mgs umdist10) through its paces, starting with a zfs 0.6.4.2 straight up install...
r2 - 11 Sep 2015 - 01:14 by BobBall
LustreZFS
Notes on setting up and configuring Lustre version 2.7 Index of Sections Source rpms We have chosen to use the kernel distributed with the rpms from the Lustre ...
r47 - 25 Oct 2017 - 15:59 by BobBall
MD3460Install
Installation and Configuration of Dell MD3460 Storage Basic Hardware This page refers specifically to hardware purchased in August 2016 using RBD 2016 funds. A s...
r3 - 19 Sep 2016 - 19:41 by BobBall
MSUDZeroOsg
See also: * MSUDZeroOsgSE about the storage element * MSUDZeroOsgStartup Restarting the system * MSUDZeroOsgTests Testing the OSG site * MSUDZeroOsgJo...
r36 - 16 Oct 2009 - 20:14 by TomRockwell
MSUDZeroOsgSE
Storage Element An SRM/dCache instance is added to the site as a grid accessible Storage Element. dCache is a very flexible package for combining multiple filesy...
r40 - 18 Aug 2009 - 05:00 by TomRockwell
MSUDZeroOsgTests
Testing That OSG Site is Functional Central tests OSG centrally tests all sites a few time a day. * List of all sites * Current result for MSU OSG * C...
r5 - 17 Nov 2008 - 04:57 by TomRockwell
MSUFireDrill
These instructions use scripts and files found on senna at /home/koll/ * indicates step contains drill specific instructions Drill Preparation* * Check that ...
r12 - 21 Jun 2014 - 01:17 by JamesKoll
MSULustreBasics
Lustre Basics The Lustre file system is made of three types of servers: the management server (MGS), meta data servers (MDS), and object storage servers (OSS). Ea...
r4 - 25 Oct 2019 - 17:45 by ForrestPhillips
MSULustreLinks
Useful links for Lustre Lustre Homepage Lustre Manual ZFS on lustre wiki ZFS Wikipedia ZFS manual ZFS components ZFS manual creating ZFS pools Nice descriptio...
r4 - 04 Nov 2019 - 21:17 by ForrestPhillips
MSUSetupRackPDU
for big three phase PDUs The rearmost PDU is 1. In these racks the rearmost PDU is inverted (its cord comes out the top). * place label like "MAC 00:00:00:00...
r5 - 16 Oct 2009 - 20:14 by TomRockwell
MSUT3CondorExamples
Submiting Jobs Often you will find yourself with the need to run batch jobs on Condor. This should be done entirely on the tier3's work/fast disks instead of on g...
r13 - 22 Apr 2014 - 20:38 by JamesKoll
MSUTier3
User Info for MSU Tier3 Regulations Your usage of the cluster must conform with MSU's acceptible use statement http://www.msu.edu/au/ Privacy The cluster is a m...
r26 - 23 Apr 2014 - 15:17 by JamesKoll
MSUTier3Overview
Overview of MSU's Tier3 HTCondor Setup Intro Video for Admins Types of Machines on HTCondor HTCondor consists of three types of machines: submit nodes, worker n...
r4 - 10 Oct 2019 - 16:17 by ForrestPhillips
MSUTier3Storage
Overview DISK SIZE ( TB ) SPEED GROSS TOTAL USABLE TOTAL XRD 4 INTERNAL 12 2 7.2 24 20 XRD 4 TRAY A 12 3 7.2 36 30 XRD 4 TRAY B 12 3 7...
r9 - 09 May 2016 - 16:29 by RichardDrake
MSUTrippLiteUps
MSU Tripp Lite UPS The storage racks at MSU have Tripp Lite SU6000RT3UHV UPSs. These are 6KVA models. One of the two PDU (power strips) in the rack is fed from ...
r4 - 27 Jan 2014 - 22:59 by JamesKoll
MSUVMwareBackups
Backing up and moving VMs If the VM is running you need to pull a snapshot and backup, otherwise the .vmdk may not be consistent. Spaces in VM names for some back...
r2 - 24 Jun 2009 - 19:00 by TomRockwell
MSUZFSReplaceDisk
Replacing disk in zpool (potentially with larger disks) ZFS documentation Replacing disk in zpool (potentially with larger disks) Note: use "parted" "mklabel ...
r2 - 05 Nov 2019 - 18:36 by ForrestPhillips
ManagementofDcache
Management of Dcache main services to maintain head01 : dcache core head02: postgresql pnfs dcache core pool nodes: dcache core dcache pool main configurati...
r11 - 24 Jun 2009 - 15:10 by BenMeekhof
Md3460Benchmark
ZFS and RAID 10 Benchmarks for Dell MD3460 Common Configuration notes Tools Bonnie : 1.96 8.el7 (epel) Iozone: 3.424 2.el7.rf (rpmforge) Host system: Intel(R)...
r6 - 16 Nov 2014 - 23:06 by BenMeekhof
MigrateHardware
Hardware Transition Planning from head01 (old R610) to head01 temp (new R630) We purchased a new Dell R630 to act as replacement hardware for our existing head01 ...
r2 - 23 Oct 2015 - 17:25 by BobBall
Monitors
Local AGLT2 Monitors There are many monitors we've implemented. These include both AGLT2 and general USATLAS pages. Summaries * AGL Compute Summary page of Ph...
r104 - 24 Oct 2018 - 19:10 by BobBall
MsuOsgPolicy
MSU OSG OSG site information and policy. Currently the MSU OSG site is 100% allocated to "SAMGrid" processing for the DZero Experiment. An SRM/dCache v2.2 SE is l...
r7 - 16 Oct 2009 - 20:14 by TomRockwell
NetworkIssuesAfterULRetirement
Network Issues at AGLT2 This page is intended to capture the network related issues at AGLT2 Network Issues after UltraLight Router at Starlight (R04CHI) was Ret...
r5 - 10 Sep 2012 - 13:23 by ShawnMcKee
NetworkPlanning
Planning for the production network. NetworkHardwareInfo Near term To Do List Here is a list of network related items that need doing as of February 4, 2011: ...
r25 - 22 Feb 2011 - 03:52 by RoyHockett
NewGateKeeper
Procedures followed to bring gate03 online as a test gate keeper NOTE: This page is changing as the procedures and tests evolve. This note will be removed once te...
r7 - 17 Sep 2013 - 18:59 by BobBall
NewdCacheHeadNodesJan11
Creation of New dCache Headnodes (Dell R610) in January 2011 As part of our Fall 2010 procurements we purchased 2 Dell R610 nodes to host the dCache services (he...
NEW - 17 Jan 2011 - 15:34 by ShawnMcKee
NewdCacheNodes
Procedure to Migrate dCache headnodes (head01/head02.aglt2.org) to new hardware and operating system. During fall 2009 and winter 2010, AGLT2 is migrating all lin...
r15 - 12 Feb 2010 - 01:27 by ShawnMcKee
NexsanTesting
Evaluation and testing of Nexsan SATABeast with B60E expansion Unpacking and Installation See photos and some comments here: https://picasaweb.google.com/ben.mee...
r17 - 27 May 2011 - 13:31 by BenMeekhof
OSGInstallGate02
OSG CE 0.4.1 Install Instructions Introduction This document is intended for administrators responsible for installing and configuring: OSG Compute Element (CE) ...
r23 - 20 Aug 2007 - 16:29 by BobBall
OSGSetup
The content below was copied from the OSG install Twiki page on June 5, 2006. This was done to allow us to use this Twiki to record install details for our OSG i...
r6 - 16 Oct 2009 - 20:14 by TomRockwell
OracleInstall
Setting up Oracle on Linux The following documents the installation and setup of Oracle at the University of Michigan for use by the ATLAS Muon Calibration and Al...
r12 - 16 Oct 2009 - 20:14 by TomRockwell
OracleNotes
Some info on Oracle setup at AGLT2 * Oracle Installation on linux for the ATLAS Muon Calibration/Alignment centers. * Oracle MuonDB updated (new) schema Feb...
r22 - 01 Feb 2020 - 00:29 by PhilippeLaurens
PostgresqlUpgradeAug18
Upgrading Postgresql from 9.5 to 10.5 We want to go to the most recent Postgresql for use by dCache, at least on head01.aglt2.org. Currently Postgresql is version...
r3 - 22 Aug 2018 - 22:17 by ShawnMcKee
R5abHostConfigSvn
Host Configs in SVN Have modified host config files tracked in SVN. Also have ROCKS DB entries tracked. Pull these out and put on the frontend. Storage area We...
NEW - 18 Dec 2009 - 20:48 by TomRockwell
R5abVMWareFrontEnd
VMware Hosting of Frontend Wish to run the frontends in VMware ESXi. The primary benefit is server consolidation. This also provides a good way to make a full b...
r2 - 11 Nov 2009 - 03:41 by TomRockwell
ReFormatOST
How to empty all OST on an OSS, then re create the underlying Lustre file systems Motivation The underlying striping for a Lustre OST, as seen in the mail list, ...
r9 - 22 Mar 2017 - 17:15 by BobBall
ReconfgPlazma
(Re)Configuration of gPlazma on AGLT2 Due to issues with SRM failing that were traced to probable issues in gPlazma we are planning to implement some changes to g...
NEW - 09 May 2009 - 17:38 by ShawnMcKee
RecoverDrivesInForeignConfigState
Background Info: Unexpected Power Loss on file servers During backup generator test on 12 may 09 at the MSU BPS bldg , most UPSs received an errant EPO (Emergenc...
r3 - 15 May 2009 - 20:49 by PhilippeLaurens
ReinstallOracle
Reinstallation of Oracle for the Muon Calibration Center On May 2nd, 2009 our primary Oracle server (umors.grid.umich.edu) was compromised because we had forgott...
r7 - 05 May 2009 - 19:51 by ShawnMcKee
RocksAglReleases
Intro Here are listed releases or "tags" of the ROCKS installation. Issues with each can be added here. Summer 2011 making an attempt to maintain this page go...
r9 - 20 Jul 2011 - 16:23 by TomRockwell
SL6GateKeeper
Creation of gate04.aglt2.org, the SL6 gatekeeper Core dump style... Not bothering for now to make this pretty, just recording the actions taken 2 cd /etc/yu...
r8 - 26 Sep 2013 - 13:40 by BobBall
SL7IssuesFixes
Issues Fixed in CFEngine for SL7.3 Upgrade Known Issues Need to limit yum output on overnight updates so that so many Emails are not sent. The update_dell_firmwa...
r3 - 26 Oct 2017 - 13:18 by BobBall
SettingUpATLASHOTDISK
Setting up ATLAS Area HOTDISK for AGLT2 As of mid September 2009 we need to provide a new space token area in Tiers of ATLAS call 'HOTDISK'. There are a few com...
r3 - 19 Sep 2009 - 18:45 by ShawnMcKee
SetupDellMD3820i
Setup and Configuration of the AGLT2 MD3820i This details our installation and configuration of our new MD3820i (UMVMSTOR03). We received both units on August 4th...
r2 - 11 Aug 2015 - 14:05 by ShawnMcKee
SetupMD3600i
Setup and Configuration of the AGLT2 MD3600i July 25, 2011 This details our installation and configuration of our new MD3600i (UMVMSTOR02) plus MD1200 shelf. W...
NEW - 25 Jul 2011 - 18:02 by ShawnMcKee
SolarisOnPE2950
Solaris Installation notes A lot of this was compiled and figured out via extensive reading of this forum. There are a number of confusions and misleading direct...
r5 - 16 Oct 2009 - 20:14 by TomRockwell
StartupAndShutdown
Startup and Shutdown This page will describe the shutdown and start up procedures for the cluster Unplanned power problems This will be a discussion of how to gr...
r3 - 19 Mar 2014 - 18:25 by JamesKoll
SunBambi
Proxy server This system has no access to outside world, and in general systems can't talk to non edu locations. To be able to download things, use proxy server. ...
r10 - 09 Jan 2013 - 22:14 by BenMeekhof
SunX4540ConfigFreeBSD
Operational notes Setup zfs filesystems and quotas for users Mkdir as usual: mkdir /atlas/data19/bmeekhof chown bmeekhof:umatlas /atlas/data19/bmeekhof Set quota...
r13 - 18 May 2012 - 17:26 by BenMeekhof
TestingNewStorageBuild
Testing of New dCache Storage Node Build Here is the testing result for a new storage node (summary: it works). After running \x91install_dcache.sh\x92 on UMFS16...
NEW - 10 Feb 2010 - 20:47 by ShawnMcKee
Tier2Planning
AGL Tier2 Planning List * Hardware acquisition * Storage * Workstations * Testbed block. * Backup * Network equipment ...
r4 - 16 Oct 2009 - 20:14 by TomRockwell
Tier3ForBeginners
0. Useful webpages This webpage is a mix between a tutorial and reference. If you are just interested in a quick overview of useful condor commands, just google "...
r19 - 22 Oct 2009 - 17:27 by JamesKoll
UpgradeGPlazma
Upgrading from GPlazma1 to GPlazma2 on dCache 2.2.12 In preparation for upgrading to dCache 2.6 we need to reconfigure our dCache GPlazma configuration to go from...
r5 - 14 Jun 2013 - 15:52 by ShawnMcKee
UpgradingAllSL5
Upgrade Planning for AGLT2 SL5 Systems Introduction We need to upgrade our remaining SL5 systems to SL6 soon. We should use this page to track which systems stil...
r7 - 01 Aug 2014 - 16:23 by BenMeekhof
VMwareSetupandNotes
VMWare Setup and Updates This page should keep track of VMware related setup/updates and information. Update to vSphere 5.1 This section will document the detail...
r16 - 10 Aug 2015 - 14:28 by ShawnMcKee
VSphere51Update
VMWare vSphere Upgrade at AGLT2 In September 2012 VMware release a signficant upgrade to vSphere: 5.1. There are a number of nice features that we want to benefit...
r4 - 18 Sep 2012 - 11:34 by ShawnMcKee
VirtuozzoInfo
Virtuozzo Information and HowTo We have been testing Virtuozzo on our new virtualization hardware. Virtuozzo runs multiple "servers" on a host system, sharing t...
r23 - 16 Oct 2009 - 20:14 by TomRockwell
WebHome
Atlas Great Lakes Tier2 Web How to contact us * For problems, contact us through our signatures here: * Main.WenjingWu AGLT2 Manager and University of M...
r271 - 10 Sep 2020 - 00:40 by PhilippeLaurens
ZFsforAFS
Using ZFS on Linux for AGLT2 AFS Fileservers Recently ZFS on Linux became available. ZFS has lots of nice features including Copy On Write (COW), data integrity v...
r5 - 28 Apr 2015 - 01:31 by BobBall
Number of topics: 93
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding Foswiki? Send feedback