Sponsored by BMBF Logo

AstroGrid-D Usage Statistics

Job Monitoring

AstroGrid-D has implemented a stable job monitoring based on the Globus Audit Module and database triggers. Together with the Globus Toolkit developer team this solution is still being improved, and current statistics are preliminary examples from the AIP resources. The Charts below thus only offer an overview of Job statistics for the AstroGrid-D Data Storage Cluster and the Robotic Telescope Network, both at AIP. The results were collected withing the time period of three months (March to May 2008). Users with a CPU total of less than 100 jobs per month are not shown, which refers to twelve more users with a sum of 10 hours of CPU within the whole period.



 
This example shows that there are two main users: Engel, Radke. They are running the GEO600 use case. The other users do not show up in this diagram since their usage is too small.
 
 
This plot shows the average usage of CPU hours of a the jobs. The CPU usage of observations may not be confused with the actual duration of an observation which can be obtained from the Telescope Timeline.
The above information was obtained from the Information Service Stellaris via SPARQL queries.

Virtual Organisation

The AstroGrid-D adopted the Virtual Organisation Management Registration Service (VOMRS) from Fermilab with great success. It manages VO users and their registration data. The following statistics show the VOMRS entry dates of the currently active members. Suspended members (e.g. due to change or work place) and name changes are not taken into account. The total number of members was 86 as of June 1st, 2008. The second graph shows the distribution of members with regard to their scientific institution.


Hardware: MDS, Gram, Ganglia

Ganglia and other systems running on the AstroGrid-D resources collect detailed hardware information and publish them via MDS and GRAM (for services).

Current statistic machine data (source: MDS via Stellaris):

Current statistic data from file transfer (source: MDS via Stellaris):

Please see the hardware pages for more information.

Usage of the gac-grid.org Website

Web site usage statistics is gathered by Google Analytics. The data does exclude connections from AIP itself, but includes other AstroGrid-D members, for example ZAH. Certain other restrictions apply to the counting mechanism, e. g. JavaScript must be running.

The figures below give an overview of how the website gac-grid.org was accessed and used during the first five months of 2008. Two groups can easily be identified. Direct access is caused mainly by project members who edit project progress, whereas search engine and referral sites access reflect mostly external viewers. On a rough average the visitor stays four minutes and looks at four pages. In some more detail, most visitors just look at one page, whereas a large group looks at 20 or more. The latter of course reflects the site usage of the project members. The absolute numbers below refer to visits, i. e. a user connecting from an IP address who then looks at one or more pages.





The list of referrals, i. e. people following a link to the gac-grid.org pages, show that the site attracts attention from the wider community, e. g. referred from the Einstein @ Home application (GEO600 use case) or Wikipedia.

Source Visits Pages/Visit Avg. Time on Site % New Visits
1. 60 1.37 00:00:49 11.67%
2. 22 5.77 00:05:32 27.27%
3. 12 13.67 00:18:10 16.67%
4. 11 1.73 00:00:08 18.18%
5. 10 1.40 00:00:16 30.00%
6. 9 2.22 00:00:26 66.67%
7. 7 3.00 00:01:17 42.86%
8. 6 3.83 00:05:12 83.33%
9. 4 1.25 00:03:46 25.00%
10. 3 1.00 00:00:00 100.00%


The geographical distribution reflects that the project is a national project, since only 23% of the visits come from outside. Main visits come from Austria, the US, Russia, the Ukraine and many EU states.


Methods of Statistics collection

Information on AstroGrid-D is gathered by Ganglia and the Globus MDS module. Jobs on AstroGrid-D resources are monitored with the pre WS GRAM audit logging and the  WS GRAM audit logging module. The job information for AstroGrid-D VO is collected on the Stellaris server in semantic web language RDF. Virtual Organisation information is gathered from the VORMS database. Web Site Usage is logged via Google Analytics.

AstroGrid-D members: To enable Job Monitoring modules for Globus Toolkit >4.0.5, please follow these Installation instructions.