
Platform Analytics 7
Dataflow
Hourly Hardware(with Boolean Resources)
datamart
Main ETL XML file
hardwareHourly-booleanres.xml
Output CSV files
hardwareHourly-booleanres.csv
Record sample
DATE,HOUR,WEEKDAY,COREHOUR,SHIFT,CLUSTERNAME,HOSTNAME,SAMPLINGCOUNTER,Maxmemory,
Maxswap,Maxtmp,CPUutil,Memutil,Swaputil,R15s,R1m,R15m,Pg,Io,Ls,It,Mem,Swap,Tmp,Jobut,Jobmemory,Jobswap,
BOOLEAN_RESOURCE,LSFCPUFACTOR,HOSTMODEL,HOSTTYPE,NPROCS,NCORES,NTHREADS
"2005-10-31",17,2,0,"Shift
3","LSF62","ib01b14.lsf.platform.com",4.0,,,,,,,,,,,,,,,,,0,8545,25404,"mg",116.1,
"UNKNOWN","UNKNOWN","UNKNOWN","UNKNOWN","
UNKNOWN"
?/span>
"2005-10-31",17,2,0,"Shift
3","LSF62","ib01b14.lsf.platform.com",7.0,4029,2557,27996,0.0803,0.0997,0.0004,0.21,0.11,0.03,199.44,3582,
1,1.81,3627.43,2556,10368,,,,"mg",116.1,"PC6000","LINUX86","1","2","3"
Column description
The Hourly Hardware(with
Boolean Resources) datamart gets its information from the table wi_hostmetrics
left outer join table wi_host_booleanres.
The following table describes
each column and its source:
|
|
|
The cluster name comes
from the lookup of the name in the wi_clustercode table with cluster_code
which comes in the wi_hostmetrics table.
|
|
The source is the
localized time_stamp in the wi_hostmetrics table. If the time_stamp is within
the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise,
it returns 0.
A value of 1 means
that the data in this record is aggregated from the core_hour portion of the
day (9am to 5pm, Monday to Friday).
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents CPU
utilization (ut). The average is calculated by dividing the sum_value in the
wi_hostmetrics table by the sampling_counter column.
|
|
This is the date
portion of the localized time_stamp in the wi_hostmetrics table, and the
format is "YYYY-MM-DD".
|
|
This is the hour
portion of the localized time_stamp in the wi_hostmetrics table.
|
|
This is the weekday
number from the localized time_stamp in the wi_hostmetrics table, where
"1" is Sunday, "2" is Monday, etc.
|
|
This is based on the
localized time_stamp in the wi_hostmetrics table. The shifts transformer maps
the localized time_stamp based on shift mapping and returns the user-defined
shift.
|
|
This is the name in
the wi_hostcode table, which is based on the host_code column in the
wi_hostmetrics table.
|
|
This is the
sampling_counter column in the wi_hostmetrics table.
|
|
This is the maxvalue
in the wi_hostmetrics table where the metric_code represents memory.
|
|
This is the maxvalue
in the wi_hostmetrics table where the metric_code represents swap.
|
|
This is the maxvalue
in the wi_hostmetrics table where the metric_code represents temporary drive
space.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents memory
utilization (memutil). The average value is calculated by dividing the
sum_value in the wi_hostmetrics table by the sampling_counter column. This
field returns the average value if the metrics_code points to the memutil
metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents SWAP
utilization (swaputil). The average value is calculated by dividing the
sum_value in the wi_hostmetrics table by the sampling_counter column. This
field returns the average value if the metrics_code points to the swaputil
metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents R15s. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the R15s metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents R1m. The average value is calculated by
dividing the sum_value in the wi_hostmetrics table by the sampling_counter
column. This field returns the average value if the metrics_code points to
the R1m metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents R15m. The average value is calculated by
dividing the sum_value in the wi_hostmetrics table by the sampling_counter
column. This field returns the average value if the metrics_code points to
the R15m metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Pg. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Pg metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Lo. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Lo metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Ls. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Ls metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Lt. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Lt metric.
|
|
This is the average value
in the wi_hostmetrics table where the metric_code represents Mem. The average
value is calculated by dividing the sum_value in the wi_hostmetrics table by
the sampling_counter column. This field returns the average value if the
metrics_code points to the Mem metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Swap. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Swap metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents Tmp. The
average value is calculated by dividing the sum_value in the wi_hostmetrics
table by the sampling_counter column. This field returns the average value if
the metrics_code points to the Tmp metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents "ut
of jobs by host" (Jobut). The average value is calculated by dividing
the sum_value in the wi_hostmetrics table by the sampling_counter column.
This field returns the average value if the metrics_code points to the Jobut
metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents
"Memory of jobs by host" (Jobmemory). The average value is
calculated by dividing the sum_value in the wi_hostmetrics table by the
sampling_counter column. This field returns the average value if the metrics_code
points to the Jobmemory metric.
|
|
This is the average
value in the wi_hostmetrics table where the metric_code represents "Swap
of jobs by host" (Jobswap). The average value is calculated by dividing
the sum_value in the wi_hostmetrics table by the sampling_counter column.
This field returns the average value if the metrics_code points to the
Jobswap metric.
|
|
This is a host-related
boolean resource name, it comes from the lookup of the name in the
wi_booleanres_code table with resource_code which comes in the
wi_host_booleanres table outer join wi_hostmetrics based on columns
time_stamp, cluster_code and host_code.
|
|
The LSF CPU factor
comes from the lookup of the column CPU_FACTOR in the wi_hostproperties table
based on the cluster_code and host_code column in the wi_hostmetrics table.
|
|
The HOSTMODEL factor
comes from the lookup of the column LSFHOST_MODEL in the wi_hostproperties
table based on the cluster_code and host_code column in the wi_hostmetrics
table.
|
|
The HOSTTYPE factor
comes from the lookup of the column LSFHOST_TYPE in the wi_hostproperties
table based on the cluster_code and host_code column in the wi_hostmetrics
table.
|
NCPU
|
This is the max number of CPUs of the
host, which is got from ncpu in wi_hostproperties table.
|
NPROCS
|
This is the number of physical processors
of the host, which is got from nprocs in wi_hostproperties table.
|
NCORES
|
This is the number of cores per
processors of the host, which is got from ncores in wi_hostproperties table.
|
NTHREADS
|
This is the number of threads per core of
the host, which is got from nthreads in wi_hostproperties table.
|