Platform Analytics 7 Dataflow

Hourly Hardware by Hostgroup datamart

Main ETL XML file

hostgroupHourly.xml

Output CSV files

hostgroupHourly.csv

Record sample

DATE,HOUR,WEEKDAY,COREHOUR,SHIFT,CLUSTERNAME,HOSTNAME,HOSTGROUPNAME,SAMPLINGCOUNTER,Maxmemory,Maxswap,Maxtmp,CPUutil,Memutil,Swaputil,R15s,R1m,R15m,Pg,Io,Ls,It,Mem,Swap,Tmp,Jobut,Jobmemory,Jobswap

"2005-10-31",17,2,0,"Shift 3","LSF62","ib01b14.lsf.platform.com","AllHosts",4.0,,,,,,,,,,,,,,,,,0,8545,25404

"2005-10-31",17,2,0,"Shift 3","LSF62","ib01b14.lsf.platform.com","AllHosts",7.0,4029,2557,27996,0.0803,0.0997,0.0004,0.21,0.11,0.03,199.44,3582,1,1.81,3627.43,2556,10368,,,

Column description

The Hourly Hardware by Hostgroup datamart get its information from the wi_hostmetrics and wi_hostgroupconf tables. The two tables are merged based on time_stamp, cluster_code, and host_code so that the proper hostgroup is retrieved.

The following table describes each column and its source:
Column name
Source and description
CLUSTERNAME
The source is the cluster_name in the wi_clustercode table, which is based on the cluster_code column in the wi_hostmetrics table.
COREHOUR
The source is the localized time_stamp in the wi_hostmetrics table. If the time_stamp is within the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise, it returns 0.
A value of 1 means that the data in this record is aggregated from the core_hour portion of the day (9am to 5pm, Monday to Friday).
CPUUTIL
This is the average value in the wi_hostmetrics table where the metric_code represents CPU utilization (ut). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column.
DATE
This is the date portion of the localized time_stamp in the wi_hostmetrics table, and the format is "YYYY-MM-DD".
HOUR
This is the hour portion of the localized time_stamp in the wi_hostmetrics table.
WEEKDAY
This is the weekday number from the localized time_stamp in the wi_hostmetrics table, where "1" is Sunday, "2" is Monday, etc.
SHIFT
This is based on the localized time_stamp in the wi_hostmetrics table.The shifts transformer maps the localized time_stamp based on shift mapping and returns the user-defined shift.
HOSTNAME
The source is the name in the wi_hostcode table, which is based on the host_code column in the wi_hostmetrics table.
HOSTGROUPNAME
The source is the hostgroup_name in the wi_hostgroupcode table, which is based on the hostgroup_code column in the wi_hostgroupconf table.
SAMPLINGCOUNT
This is the sampling_counter column in the wi_hostmetrics table.
MAXMEMORY
This is the maxvalue in the wi_hostmetrics table where the metric_code represents memory.
MAXSWAP
This is the maxvalue in the wi_hostmetrics table where the metric_code represents swap.
MAXTMP
This is the maxvalue in the wi_hostmetrics table where the metric_code represents temporary drive space.
MEMUTIL
This is the average value in the wi_hostmetrics table where the metric_code represents memory utilization (memutil). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the memutil metric.
SWAPUTIL
This is the average value in the wi_hostmetrics table where the metric_code represents SWAP utilization (swaputil). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the swaputil metric.
R15S
This is the average value in the wi_hostmetrics table where the metric_code represents R15s. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R15s metric.
R1m
This is the average value in the wi_hostmetrics table where the metric_code represents R1m. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R1m metric.
R15m
This is the average value in the wi_hostmetrics table where the metric_code represents R15m. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R15m metric.
PG
This is the average value in the wi_hostmetrics table where the metric_code represents Pg. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Pg metric.
IO
This is the average value in the wi_hostmetrics table where the metric_code represents Io. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Lo metric.
LS
This is the average value in the wi_hostmetrics table where the metric_code represents Ls. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Ls metric.
IT
This is the average value in the wi_hostmetrics table where the metric_code represents It. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Lt metric.
MEM
This is the average value in the wi_hostmetrics table where the metric_code represents Mem. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Mem metric.
SWAP
This is the average value in the wi_hostmetrics table where the metric_code represents Swap. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Swap metric.
TMP
This is the average value in the wi_hostmetrics table where the metric_code represents Tmp. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Tmp metric.
JOBUT
This is the average value in the wi_hostmetrics table where the metric_code represents "ut of jobs by host" (Jobut). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobut metric.
JOBMEMORY
This is the average value in the wi_hostmetrics table where the metric_code represents "Memory of jobs by host" (Jobmemory). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobmemory metric.
JOBSWAP
This is the average value in the wi_hostmetrics table where the metric_code represents "Swap of jobs by host" (Jobswap). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobswap metric.