Setup of GRAM Auditing for AGLT2 (OSG 0.8.1)

The current OSG installation (0.8.1) has Globus 4.0.5 which supports a new "auditing" feature. You can request that the job manager emit auditing records to a directory of your choice by adding a -audit-directory /opt/OSG080/vdt-app-data/globus/audit line to the globus-job-manager.conf file. The resulting files can then be processed into a database.

The complete instructions are at: Audit Logging on the globus website.

For AGLT2 I setup the audit directory under the /opt/OSG080/vdt-app-data/globus directory by adding an audit subdirectory. The protections needed to be changed to allow things to work:

• chown globus.osg /opt/OSG080/vdt-app-data/globus/audit
• chmod +s /opt/OSG080/vdt-app-data/globus/audit
• chmod o+w /opt/OSG080/vdt-app-data/globus/audit

On AGLT2 the 'globus' user is a member of the 'osg' group.

We took advantage of the MySQL which is distributed as part of the OSG install. This runs on a non-standard port (and you need to make sure mysql is running). Our globus-job-manager-audit.conf looks like:

DRIVERCLASS:com.mysql.jdbc.Driver
USERNAME:globus
PASSWORD:xxxxxxxx
URL:jdbc:mysql://localhost:49153/auditDatabase

Note the addition of the specific port to the URL. Also make sure that only the globus user can read this file!

We followed the Globus link above to configure the initial MySQL database using the globus user. The remaining piece is to add a new crontab entry for the globus user like:

# Setup to gather Globus Audit logs
GLOBUS_LOCATION=/opt/OSG080/globus
JAVA_HOME=/opt/OSG080/jdk1.5
MAILTO=smckee@umich.edu
0,15,30,45 * * * * ${GLOBUS_LOCATION}/libexec/globus-gram-audit

An example of the kind of information you can query once this is running:

mysql> select job_grid_id, local_job_id, success_flag, finished_flag from gram_audit_table where success_flag="false";
+----------------------------------------------------+--------------+--------------+---------------+
| job_grid_id                                        | local_job_id | success_flag | finished_flag |
+----------------------------------------------------+--------------+--------------+---------------+
| https://gate01.aglt2.org:59167/1314219/1202736083/ | 331024       | false        | true          |
| https://gate01.aglt2.org:34855/1319996/1202736252/ | 331031       | false        | true          |
| https://gate01.aglt2.org:37181/1354058/1202737447/ | 331071       | false        | true          |
| https://gate01.aglt2.org:41202/1523179/1202743282/ | 331304       | false        | true          |
| https://gate01.aglt2.org:50414/1529658/1202743451/ | 331315       | false        | true          |
| https://gate01.aglt2.org:41370/1568419/1202744654/ | 331364       | false        | true          |
| https://gate01.aglt2.org:58674/1661022/1202747698/ | NULL         | false        | true          |
| https://gate01.aglt2.org:54504/1754971/1202750470/ | 331623       | false        | true          |
| https://gate01.aglt2.org:54496/1762406/1202750658/ | 331633       | false        | true          |
| https://gate01.aglt2.org:37257/1807488/1202751880/ | 331698       | false        | true          |
| https://gate01.aglt2.org:36794/1794377/1202751559/ | NULL         | false        | true          |
| https://gate01.aglt2.org:51994/1978185/1202757667/ | 331932       | false        | true          |
| https://gate01.aglt2.org:45094/1984474/1202757852/ | 331940       | false        | true          |
| https://gate01.aglt2.org:54126/2013291/1202759053/ | 331965       | false        | true          |
+----------------------------------------------------+--------------+--------------+---------------+
14 rows in set (0.01 sec)

-- ShawnMcKee - 11 Feb 2008