Platform Analytics 7 Dataflow

Previous Topic Next Topic Index

Hourly Hardware(with Boolean Resources and Core Utilization) datamart

Main ETL XML file

hardwareHourly-booleanres-sp006.xml

Output CSV files

hardwareHourly-booleanres-sp006.csv

Record sample

DATE,HOUR,WEEKDAY,COREHOUR,SHIFT,CLUSTERNAME,HOSTNAME,SAMPLINGCOUNTER,Maxmemory, Maxswap,Maxtmp,CPUutil,Memutil,Swaputil,R15s,R1m,R15m,Pg,Io,Ls,It,Mem,Swap,Tmp,Jobut,Jobmemory,Jobswap, BOOLEAN_RESOURCE,LSFCPUFACTOR,HOSTMODEL,HOSTTYPE,NPROCS,NCORES,NTHREADS

 

"2005-10-31",17,2,0,"Shift 3","LSF62","ib01b14.lsf.platform.com",4.0,,,,,,,,,,,,,,,,,0,8545,25404,"mg",116.1, "UNKNOWN","UNKNOWN","UNKNOWN","UNKNOWN"," UNKNOWN"

?/span>

"2005-10-31",17,2,0,"Shift 3","LSF62","ib01b14.lsf.platform.com",7.0,4029,2557,27996,0.0803,0.0997,0.0004,0.21,0.11,0.03,199.44,3582, 1,1.81,3627.43,2556,10368,,,,"mg",116.1,"PC6000","LINUX86","1","2","3"

Column description

The Hourly Hardware(with Boolean Resources and Core Utilization) datamart gets its information from the table wi_hostmetrics left outer join table wi_host_booleanres.

The following table describes each column and its source:

Column name

Source and description

CLUSTERNAME

The cluster name comes from the lookup of the name in the wi_clustercode table with cluster_code which comes in the wi_hostmetrics table.

COREHOUR

The source is the localized time_stamp in the wi_hostmetrics table. If the time_stamp is within the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise, it returns 0.

A value of 1 means that the data in this record is aggregated from the core_hour portion of the day (9am to 5pm, Monday to Friday).

CPUUTIL

This is the average value in the wi_hostmetrics table where the metric_code represents CPU utilization (ut). The average is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column.

DATE

This is the date portion of the localized time_stamp in the wi_hostmetrics table, and the format is "YYYY-MM-DD".

HOUR

This is the hour portion of the localized time_stamp in the wi_hostmetrics table.

WEEKDAY

This is the weekday number from the localized time_stamp in the wi_hostmetrics table, where "1" is Sunday, "2" is Monday, etc.

SHIFT

This is based on the localized time_stamp in the wi_hostmetrics table. The shifts transformer maps the localized time_stamp based on shift mapping and returns the user-defined shift.

HOSTNAME

This is the name in the wi_hostcode table, which is based on the host_code column in the wi_hostmetrics table.

SAMPLINGCOUNT

This is the sampling_counter column in the wi_hostmetrics table.

MAXMEMORY

This is the maxvalue in the wi_hostmetrics table where the metric_code represents memory.

MAXSWAP

This is the maxvalue in the wi_hostmetrics table where the metric_code represents swap.

MAXTMP

This is the maxvalue in the wi_hostmetrics table where the metric_code represents temporary drive space.

MEMUTIL

This is the average value in the wi_hostmetrics table where the metric_code represents memory utilization (memutil). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the memutil metric.

SWAPUTIL

This is the average value in the wi_hostmetrics table where the metric_code represents SWAP utilization (swaputil). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the swaputil metric.

R15s

This is the average value in the wi_hostmetrics table where the metric_code represents R15s. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R15s metric.

R1m

This is the average value in the wi_hostmetrics table where the metric_code represents R1m. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R1m metric.

R15m

This is the average value in the wi_hostmetrics table where the metric_code represents R15m. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the R15m metric.

Pg

This is the average value in the wi_hostmetrics table where the metric_code represents Pg. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Pg metric.

Lo

This is the average value in the wi_hostmetrics table where the metric_code represents Lo. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Lo metric.

Ls

This is the average value in the wi_hostmetrics table where the metric_code represents Ls. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Ls metric.

Lt

This is the average value in the wi_hostmetrics table where the metric_code represents Lt. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Lt metric.

MEM

This is the average value in the wi_hostmetrics table where the metric_code represents Mem. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Mem metric.

SWAP

This is the average value in the wi_hostmetrics table where the metric_code represents Swap. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Swap metric.

TMP

This is the average value in the wi_hostmetrics table where the metric_code represents Tmp. The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Tmp metric.

JOBUT

This is the average value in the wi_hostmetrics table where the metric_code represents "ut of jobs by host" (Jobut). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobut metric.

JOBMEMORY

This is the average value in the wi_hostmetrics table where the metric_code represents "Memory of jobs by host" (Jobmemory). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobmemory metric.

JOBSWAP

This is the average value in the wi_hostmetrics table where the metric_code represents "Swap of jobs by host" (Jobswap). The average value is calculated by dividing the sum_value in the wi_hostmetrics table by the sampling_counter column. This field returns the average value if the metrics_code points to the Jobswap metric.

BOOLEAN_RESOURCE

This is a host-related boolean resource name, it comes from the lookup of the name in the wi_booleanres_code table with resource_code which comes in the wi_host_booleanres table outer join wi_hostmetrics based on columns time_stamp, cluster_code and host_code.

LSFCPUFACTOR

The LSF CPU factor comes from the lookup of the column CPU_FACTOR in the wi_hostproperties table based on the cluster_code and host_code column in the wi_hostmetrics table.

HOSTMODEL

The HOSTMODEL factor comes from the lookup of the column LSFHOST_MODEL in the wi_hostproperties table based on the cluster_code and host_code column in the wi_hostmetrics table.

HOSTTYPE

The HOSTTYPE factor comes from the lookup of the column LSFHOST_TYPE in the wi_hostproperties table based on the cluster_code and host_code column in the wi_hostmetrics table.

NCPU

This is the max number of CPUs of the host, which is got from ncpu in wi_hostproperties table.

NPROCS

This is the number of physical processors of the host, which is got from nprocs in wi_hostproperties table.

NCORES

This is the number of cores per processors of the host, which is got from ncores in wi_hostproperties table.

NTHREADS

This is the number of threads per core of the host, which is got from nthreads in wi_hostproperties table.

Previous Topic Next Topic Index