Platform Analytics 7 Dataflow
Hourly Hardware by Hostgroup datamart
Main ETL XML file
hostgroupHourly.xml
Output CSV files
hostgroupHourly.csv
Record sample
DATE,HOUR,WEEKDAY,COREHOUR,SHIFT,CLUSTERNAME,HOSTNAME,HOSTGROUPNAME,SAMPLINGCOUNTER,Maxmemory,Maxswap,Maxtmp,CPUutil,Memutil,Swaputil,R15s,R1m,R15m,Pg,Io,Ls,It,Mem,Swap,Tmp,Jobut,Jobmemory,Jobswap
"2005-10-31",17,2,0,"Shift 3","LSF62","ib01b14.lsf.platform.com","AllHosts",4.0,,,,,,,,,,,,,,,,,0,8545,25404
"2005-10-31",17,2,0,"Shift 3","LSF62","ib01b14.lsf.platform.com","AllHosts",7.0,4029,2557,27996,0.0803,0.0997,0.0004,0.21,0.11,0.03,199.44,3582,1,1.81,3627.43,2556,10368,,,
Column description
The Hourly Hardware by Hostgroup datamart get its information from the wi_hostmetrics and wi_hostgroupconf tables. The two tables are merged based on time_stamp, cluster_code, and host_code so that the proper hostgroup is retrieved.
The following table describes each column and its source:
Column name |
Source and description |
CLUSTERNAME |
The source is the cluster_name in the wi_clustercode table, which is based on the cluster_code column in the wi_hostmetrics table. |
COREHOUR |
The source is the localized time_stamp in the wi_hostmetrics table. If the time_stamp is within the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise, it returns 0. A value of 1 means that the data in this record is aggregated from the core_hour portion of the day (9am to 5pm, Monday to Friday). |
CPUUTIL |
This is the average value in the wi_hostmetrics table where the metric_code represents CPU utilization (ut). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. |
DATE |
This is the date portion of the localized time_stamp in the wi_hostmetrics table, and the format is "YYYY-MM-DD". |
HOUR |
This is the hour portion of the localized time_stamp in the wi_hostmetrics table. |
WEEKDAY |
This is the weekday number from the localized time_stamp in the wi_hostmetrics table, where "1" is Sunday, "2" is Monday, etc. |
SHIFT |
This is based on the localized time_stamp in the wi_hostmetrics table.The shifts transformer maps the localized time_stamp based on shift mapping and returns the user-defined shift. |
HOSTNAME |
The source is the name in the wi_hostcode table, which is based on the host_code column in the wi_hostmetrics table. |
HOSTGROUPNAME |
The source is the hostgroup_name in the wi_hostgroupcode table, which is based on the hostgroup_code column in the wi_hostgroupconf table. |
SAMPLINGCOUNT |
This is the sampling_counter column in the wi_hostmetrics table. |
MAXMEMORY |
This is the maxvalue in the wi_hostmetrics table where the metric_code represents memory. |
MAXSWAP |
This is the maxvalue in the wi_hostmetrics table where the metric_code represents swap. |
MAXTMP |
This is the maxvalue in the wi_hostmetrics table where the metric_code represents temporary drive space. |
MEMUTIL |
This is the average value in the wi_hostmetrics table where the metric_code represents memory utilization (memutil). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the memutil metric. |
SWAPUTIL |
This is the average value in the wi_hostmetrics table where the metric_code represents SWAP utilization (swaputil). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the swaputil metric. |
R15S |
This is the average value in the wi_hostmetrics table where the metric_code represents R15s. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R15s metric. |
R1m |
This is the average value in the wi_hostmetrics table where the metric_code represents R1m. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R1m metric. |
R15m |
This is the average value in the wi_hostmetrics table where the metric_code represents R15m. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R15m metric. |
PG |
This is the average value in the wi_hostmetrics table where the metric_code represents Pg. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Pg metric. |
IO |
This is the average value in the wi_hostmetrics table where the metric_code represents Io. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Lo metric. |
LS |
This is the average value in the wi_hostmetrics table where the metric_code represents Ls. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Ls metric. |
IT |
This is the average value in the wi_hostmetrics table where the metric_code represents It. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Lt metric. |
MEM |
This is the average value in the wi_hostmetrics table where the metric_code represents Mem. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Mem metric. |
SWAP |
This is the average value in the wi_hostmetrics table where the metric_code represents Swap. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Swap metric. |
TMP |
This is the average value in the wi_hostmetrics table where the metric_code represents Tmp. The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Tmp metric. |
JOBUT |
This is the average value in the wi_hostmetrics table where the metric_code represents "ut of jobs by host" (Jobut). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobut metric. |
JOBMEMORY |
This is the average value in the wi_hostmetrics table where the metric_code represents "Memory of jobs by host" (Jobmemory). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobmemory metric. |
JOBSWAP |
This is the average value in the wi_hostmetrics table where the metric_code represents "Swap of jobs by host" (Jobswap). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobswap metric. |