Platform Analytics 7 Dataflow

Previous Topic Next Topic Index

WI_JOBTHROUGHPUTDAILY table

This describes the wi_jobthroughputdaily table and how each column of data arises from WI_JOBTHROUGHPUT.

The wi_jobthroughputdaily get its data from the daily aggregation of the wi_jobthroughput table. The daily aggregation is part of the package being run everyday to aggregate jobs data. The daily aggregation range is between the last day of the wi_jobthroughputdaily table and the last second of yesterday (ie. 23:59:59).

The aggregation is grouped by "ClusterCode", "UserCode", "ProjectCode", "QueueCode", "HostCode", "ExecHostModelCode", "ExecHostTypeCode". The "ExecHostModelCode" and "ExecHostTypeCode" comes from the lookup of the LSFHOST_TYPE and LSFHOST_MODEL in the wi_hostproperties based on the host_name looked up from wi_hostcode based on the "HostCode" from wi_jobthroughput. The lookedup LSFHOST_TYPE and LSFHOST_MODEL then went through the code table transform into "ExecHostTypeCode" and "ExecHostModelCode". Any records that has no "ExecHostTypeCode" or "ExecHostModelCode" will be removed and will not be insert into this table.

This is the column description of each data column of WI_JOBTHROUGHPUTDAILY and how each column is filled with data.

Column Name

Description

Key

CLUSTER_CODE

This comes from the "Cluster_Code" field in the wi_jobthroughput table.

Primary key

TIME_PERIOD

This comes from the "Time_period" field in the wi_jobthroughput. The "Time_period" is transformed to local time and then truncated to the date (ie, set the hour part to midnight) and then transformed back to GMT time.

Primary key

USER_CODE

This comes from the "User_Code" field in the wi_jobthroughput table.

Primary key

PROJECT_CODE

This comes from the "Project_Code" field in the wi_jobthroughput table.

Primary key

HOST_CODE

This comes from the "EXECHOST_Code" field in the wi_jobthroughput table. If it is null, then the "Subhost_Code" field will be used.

Primary key

QUEUE_CODE

This comes from the "Queue_Code" field in the wi_jobthroughput table

Primary key

SUBMIT_NUM

This is how many jobs got submitted within this day in local server time.

 

EXIT_NUM

This is the number of jobs that have exited within this day in local server time.

 

HOSTTYPE_CODE

This comes from the "HOSTTYPE_CODE" field in the WI_HOSTTYPECODE

Primary key

 

HOSTMODEL_CODE

This comes from the "HOSTTYPE_CODE" field in the WI_HOSTMODELCODE table

Primary key

CORE_HOUR

The core hour is resulted from a mapping of the original time_stamp in local time. If the time_stamp is within the range from Monday to Friday, 9am to 5pm, then the core_hour will be 1, otherwise it will be 0.

Primary key

NPROCS

This is the number of physical processors per host.

 

NCORES

This is the number of cores per physical processor.

 

NTHREADS

This is the number of threads per core.

 

INSERT_SEQ

This is a system generated sequence number. For each new record inserted, an unique sequence number is being assigned to this column.

 

 

Previous Topic Next Topic Index