Platform Analytics 7 Dataflow

Previous Topic Next Topic Index

Hourly Hardware datamart

Main ETL XML file

hardwareHourly.xml

Output CSV files

hardwareHourly.csv

Record sample

DATE,HOUR,WEEKDAY,COREHOUR,SHIFT,CLUSTERNAME,HOSTNAME,SAMPLINGCOUNTER,Maxmemory, Maxswap,Maxtmp,CPUutil,Memutil,Swaputil,R15s,R1m,R15m,Pg,Io,Ls,It,Mem,Swap,Tmp,Jobut,Jobmemory,Jobswap, HOSTTYPE,HOSTMODEL,NPROCS;NCORES,NTHREADS

"2005-10-31",17,2,0,"Shift 3","LSF62","ib01b14.lsf.platform.com",4.0,,,,,,,,,,,,,,,,,0,8545,25404, "UNKNOWN","UNKNOWN","UNKNOWN","UNKNOWN"," UNKNOWN"

"2005-10-31",17,2,0,"Shift 3","LSF62","ib01b14.lsf.platform.com",7.0,4029,2557,27996,0.0803,0.0997,0.0004,0.21,0.11,0.03,199.44,3582,1,1.81,3627.43, 2556,10368,,, "LINUX86","LINUX86","1","2","3"

Column description

The Hourly Hardware datamart gets its information from the wi_hostmetrics table.

The following table describes each column and its source:

Column name

Source and description

CLUSTERNAME

The cluster name comes from the lookup of the name in the wi_clustercode table with cluster_code which comes in the wi_hostmetrics table.

COREHOUR

The source is the localized time_stamp in the wi_hostmetrics table. If the time_stamp is within the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise, it returns 0.

A value of 1 means that the data in this record is aggregated from the core_hour portion of the day (9am to 5pm, Monday to Friday).

CPUUTIL

This is the average value in the wi_hostmetrics table where the metric_code represents CPU utilization (ut). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column.

DATE

This is the date portion of the localized time_stamp in the wi_hostmetrics table, and the format is "YYYY-MM-DD".

HOUR

This is the hour portion of the localized time_stamp in the wi_hostmetrics table.

WEEKDAY

This is the weekday number from the localized time_stamp in the wi_hostmetrics table, where "1" is Sunday, "2" is Monday, etc.

SHIFT

This is based on the localized time_stamp in the wi_hostmetrics table. The shifts transformer maps the localized time_stamp based on shift mapping and returns the user-defined shift.

HOSTNAME

This is the name in the wi_hostcode table, which is based on the host_code column in the wi_hostmetrics table.

SAMPLINGCOUNT

This is the sampling_counter column in the wi_hostmetrics table.

MAXMEMORY

This is the maxvalue in the wi_hostmetrics table where the metric_code represents memory.

MAXSWAP

This is the maxvalue in the wi_hostmetrics table where the metric_code represents swap.

MAXTMP

This is the maxvalue in the wi_hostmetrics table where the metric_code represents temporary drive space.

MEMUTIL

This is the average value in the wi_hostmetrics table where the metric_code represents memory utilization (memutil). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the memutil metric.

SWAPUTIL

This is the average value in the wi_hostmetrics table where the metric_code represents SWAP utilization (swaputil). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the swaputil metric.

R15s

This is the average value in the wi_hostmetrics table where the metric_code represents R15s. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R15s metric.

R1m

This is the average value in the wi_hostmetrics table where the metric_code represents R1m. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R1m metric.

R15m

This is the average value in the wi_hostmetrics table where the metric_code represents R15m. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R15m metric.

PG

This is the average value in the wi_hostmetrics table where the metric_code represents Pg. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Pg metric.

IO

This is the average value in the wi_hostmetrics table where the metric_code represents Io. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Lo metric.

LS

This is the average value in the wi_hostmetrics table where the metric_code represents Ls. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Ls metric.

IT

This is the average value in the wi_hostmetrics table where the metric_code represents It. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Lt metric.

MEM

This is the average value in the wi_hostmetrics table where the metric_code represents Mem. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Mem metric.

SWAP

This is the average value in the wi_hostmetrics table where the metric_code represents Swap. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Swap metric.

TMP

This is the average value in the wi_hostmetrics table where the metric_code represents Tmp. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Tmp metric.

JOBUT

This is the average value in the wi_hostmetrics table where the metric_code represents "ut of jobs by host" (Jobut). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobut metric.

JOBMEMORY

This is the average value in the wi_hostmetrics table where the metric_code represents "Memory of jobs by host" (Jobmemory). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobmemory metric.

JOBSWAP

This is the average value in the wi_hostmetrics table where the metric_code represents "Swap of jobs by host" (Jobswap). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobswap metric.

HOSTTYPE

This is the type of the host, which is got from lsfhost_type in wi_hostproperties table.

HOSTMODEL

This is the model of the host, which is got from lsfhost_model in wi_hostproperties table.

NCPU

This is the max number of CPUs of the host, which is got from ncpu in wi_hostproperties table.

NPROCS

This is the number of physical processors of the host, which is got from nprocs in wi_hostproperties table.

NCORES

This is the number of cores per processors of the host, which is got from ncores in wi_hostproperties table.

NTHREADS

This is the number of threads per core of the host, which is got from nthreads in wi_hostproperties table.

Previous Topic Next Topic Index