
Platform Analytics 7
Dataflow
Hourly Hardware datamart
Main ETL XML file
hardwareHourly.xml
Output CSV files
hardwareHourly.csv
Record sample
DATE,HOUR,WEEKDAY,COREHOUR,SHIFT,CLUSTERNAME,HOSTNAME,SAMPLINGCOUNTER,Maxmemory,
Maxswap,Maxtmp,CPUutil,Memutil,Swaputil,R15s,R1m,R15m,Pg,Io,Ls,It,Mem,Swap,Tmp,Jobut,Jobmemory,Jobswap,
HOSTTYPE,HOSTMODEL,NPROCS;NCORES,NTHREADS
"2005-10-31",17,2,0,"Shift
3","LSF62","ib01b14.lsf.platform.com",4.0,,,,,,,,,,,,,,,,,0,8545,25404,
"UNKNOWN","UNKNOWN","UNKNOWN","UNKNOWN","
UNKNOWN"
"2005-10-31",17,2,0,"Shift
3","LSF62","ib01b14.lsf.platform.com",7.0,4029,2557,27996,0.0803,0.0997,0.0004,0.21,0.11,0.03,199.44,3582,1,1.81,3627.43,
2556,10368,,,
"LINUX86","LINUX86","1","2","3"
Column description
The Hourly Hardware datamart
gets its information from the wi_hostmetrics table.
The following table describes
each column and its source:
|
|
|
The cluster name comes
from the lookup of the name in the wi_clustercode table with cluster_code
which comes in the wi_hostmetrics table.
|
|
The source is the
localized time_stamp in the wi_hostmetrics table. If the time_stamp is within
the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise,
it returns 0.
A value of 1 means
that the data in this record is aggregated from the core_hour portion of the
day (9am to 5pm, Monday to Friday).
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents CPU
utilization (ut). The average is calculated by dividing the sum_value in the
wi_hostmetrics table by the sampling_counter column.
|
|
This is the date
portion of the localized time_stamp in the wi_hostmetrics table, and the
format is "YYYY-MM-DD".
|
|
This is the hour
portion of the localized time_stamp in the wi_hostmetrics table.
|
|
This is the weekday
number from the localized time_stamp in the wi_hostmetrics table, where
"1" is Sunday, "2" is Monday, etc.
|
|
This is based on the
localized time_stamp in the wi_hostmetrics table. The shifts transformer maps
the localized time_stamp based on shift mapping and returns the user-defined
shift.
|
|
This is the name in
the wi_hostcode table, which is based on the host_code column in the
wi_hostmetrics table.
|
|
This is the
sampling_counter column in the wi_hostmetrics table.
|
|
This is the maxvalue
in the wi_hostmetrics table where the metric_code represents memory.
|
|
This is the maxvalue
in the wi_hostmetrics table where the metric_code represents swap.
|
|
This is the maxvalue
in the wi_hostmetrics table where the metric_code represents temporary drive
space.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents memory
utilization (memutil). The average value is calculated by dividing the
sum_value in the wi_hostmetrics table by the sampling_counter column. This
field returns the average value if the metrics_code points to the memutil
metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents SWAP
utilization (swaputil). The average value is calculated by dividing the
sum_value in the wi_hostmetrics table by the sampling_counter column. This
field returns the average value if the metrics_code points to the swaputil
metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents R15s. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the R15s metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents R1m. The average value is calculated by
dividing the sum_value in the wi_hostmetrics table by the sampling_counter
column. This field returns the average value if the metrics_code points to
the R1m metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents R15m. The average value is calculated by
dividing the sum_value in the wi_hostmetrics table by the sampling_counter
column. This field returns the average value if the metrics_code points to
the R15m metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Pg. The
average value is calculated by dividing the sum_value in the wi_hostmetrics table
by the sampling_counter column. This field returns the average value if the
metrics_code points to the Pg metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Io. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Lo metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Ls. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Ls metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents It. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Lt metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Mem. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Mem metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Swap. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Swap metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Tmp. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Tmp metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents "ut
of jobs by host" (Jobut). The average value is calculated by dividing
the sum_value in the wi_hostmetrics table by the sampling_counter column.
This field returns the average value if the metrics_code points to the Jobut
metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents
"Memory of jobs by host" (Jobmemory). The average value is
calculated by dividing the sum_value in the wi_hostmetrics table by the
sampling_counter column. This field returns the average value if the
metrics_code points to the Jobmemory metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents "Swap
of jobs by host" (Jobswap). The average value is calculated by dividing
the sum_value in the wi_hostmetrics table by the sampling_counter column.
This field returns the average value if the metrics_code points to the
Jobswap metric.
|
HOSTTYPE
|
This is the type of
the host, which is got from lsfhost_type in wi_hostproperties table.
|
HOSTMODEL
|
This is the model of the host, which is
got from lsfhost_model in wi_hostproperties table.
|
NCPU
|
This is the max number of CPUs of the
host, which is got from ncpu in wi_hostproperties table.
|
NPROCS
|
This is the number of physical processors
of the host, which is got from nprocs in wi_hostproperties table.
|
NCORES
|
This is the number of cores per
processors of the host, which is got from ncores in wi_hostproperties table.
|
NTHREADS
|
This is the number of threads per core of
the host, which is got from nthreads in wi_hostproperties table.
|