Platform Analytics 7 Dataflow

Previous Topic Next Topic Index

Daily Job Information datamart

Main ETL XML file

jobmartDaily.xml

Output CSV files

jobmartDaily.csv

Record sample

FINISHDATE;FINISHWEEKDAY;FINISHCOREHOUR;SUBMITDATE;SUBMITWEEKDAY;STARTDATE; STARTWEEKDAY;CLUSTERNAME;USERNAME;PROJECTNAME;QUEUENAME;SUBHOSTMAPNAME; EXECHOSTMAPNAME;EXECHOSTMODELNAME;EXECHOSTTYPENAME;JOBTYPE;NUMEXECPROCS; JOBEXITSTATUS;JOBEXITCODE;NUMPROCESS;CPUTIME;MEMUSAGE;SWAPUSAGE;RUNTIME;PENDINGTIME; NUMOFJOBS;PENDINGTIMECATEGORY;USERGROUPNAME;RUNTIMECATEGORY;MEMUSAGECATEGORY; PENDINGTIMERANKIDX;RUNTIMERANKIDX;MEMUSAGERANKIDX;JOBGROUP1;JOBGROUP2;JOBGROUP3; JOBGROUP4;CPUTIMERANKNAME;CPUTIMERANK_IDX;NPROCS;NCORES;NTHREADS;APPLICATION_TAG

"2008-06-25";4;1.0;"2008-06-25";4;"2008-06-25";"4";"cluster1";"sxu";"default";"normal";"labp01";"labp01";"UNKNOWN";"UNKNOWN";"00";1.0;"DONE";"0";;0.023996; 1.8203125;16.38671875;0.0333;0.05;1.0;"0 sec to < 5 sec";"-";"0 sec to < 1 min";"0 GB to < 1 GB"; 10.0;10.0;10.0;"";"";"";""; "Not available";0;"UNKNOWN";"UNKNOWN";" UNKNOWN";""

"2008-06-25";4;1.0;"2008-06-25";4;"2008-06-25";"4";"cluster1";"sxu";"default";"normal";"labp01";"labp01";"UNKNOWN";"UNKNOWN";"00";1.0;"DONE";"0";;0.020996; 1.859375;16.41015625;0.0333;0.0333;1.0;"0 sec to < 5 sec";"-";"0 sec to < 1 min";"0 GB to < 1 GB";"";10.0;10.0;10.0; "/a";"/a/b";"/a/b/c";"/a/b/c/d";"5 min to < 20 min";4;1;2;3;"app1"

Column description

The Daily Job Information datamart gets its information from the wi_jobmartdaily table.

The following table describes each column and its source: :

Column name

Source and description

FINISHDATE

This is the date portion of the localized finish_time in the wi_jobmartdaily table, and the format is "YYYY-MM-DD".

FINISHWEEKDAY

This is the weekday number from the localized finish_time in the wi_jobmartdaily table, where "1" is Sunday, "2" is Monday, etc.

FINISHCOREHOUR

The source is the localized finish_time in the wi_jobmartdaily table. If the finish_time is within the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise, it returns 0.

A value of 1 means that the data in this record is aggregated from the core_hour portion of the day (9am to 5pm, Monday to Friday).

SUBMITDATE

This is the date portion of the localized queue_time in the wi_jobmartdaily table, and the format is "YYYY-MM-DD".

SUBMITWEEKDAY

This is the weekday number from the localized queue_time in the wi_jobmartdaily table, where "1" is Sunday, "2" is Monday, etc.

STARTDATE

This is the date portion of the localized start_time in the wi_jobmartdaily table, and the format is "YYYY-MM-DD".

STARTWEEKDAY

This is the weekday number from the localized start_time in the wi_jobmartdaily table, where "1" is Sunday, "2" is Monday, etc.

CLUSTERNAME

This is the cluster_name in the wi_clustercode table, which is based on the cluster_code column in the wi_jobmartdaily table.

USERNAME

The source is the user_name column in the wi_usercode table, which is based on user_code column in the wi_jobmartdaily table.

PROJECTNAME

The source is the project_name column in the wi_projectcode table, which is based on the project_code column from wi_jobmartdaily table.

QUEUENAME

The source is the queue_name column in the wi_queuecode table, which is based on the queue_code column in the wi_jobmartdaily table.

SUBHOSTMAPNAME

This field comes from the mapping of subhost_name to a user defined name. The subhost_name itself comes from the lookup of host_name in the wi_hostcode table by using the subhost_code in the wi_jobmartdaily table.

EXECHOSTMAPNAME

The source of this is the mapping of exechost_name to a user defined name. The exechost_name comes from the host_name in the wi_hostcode table, which is based on the exechost_code column in the wi_jobmartdaily table.

EXECHOSTMODELNAME

The source of this is the hostmodel_name in the wi_hostmodelcode table, which is based on the exechostmodel_code column in the wi_jobmartdaily table.

EXECHOSTTYPENAME

The source of this is the hosttype_name in the wi_hosttypecode table, which is based on the exechosttype_code column in the wi_jobmartdaily table.

JOBEXITCODE

The source is the job_exit_code column in the wi_jobmartdaily table.

JOBEXITSTATUS

The source is the job_exit_status column in the wi_jobmartdaily table.

JOBTYPE

The source is the job_type column in the wi_jobmartdaily table.

CPUTIME

This is the cputime in the wi_jobmartdaily table.

MEMUSAGE

The source is the mem_usage column in the wi_jobmartdaily table.

NUMEXECPROCS

The source is the num_exec_procs column in the wi_jobmartdaily table.

NUMOFJOBS

The source is the num_of_job column in the wi_jobmartdaily table.

NUMPROCESS

This field is not used.

PENDINGTIME

The source is the pending_time column in the wi_jobmartdaily table.

PENDINGTIMECATEGORY

This field categorizes the pending_time into the following seven predefined levels:

"Not available", "0 sec to 5sec", "5 sec to 30 sec", "30 sec to 5 minutes", "5 minutes to 1 hour", "1 hour to 1 day", and "more then one day".

RUNTIME

This comes from the run_time column in the wi_jobmartdaily table.

SWAPUSAGE

The source is the swap_usage column in the wi_jobmartdaily table.

USERGROUPNAME

The source is the user_group_name in the wi_usergroupcode table, which is based on the user_group_code in the wi_jobmartdaily table.

RUNTIMECATEGORY

This field categorizes the run_time into the following eight predefined levels:

"Not available", "0 sec to < 1 min", "1 min to < 5 min", "5 min to < 20 min", "20 min to < 60 min", "60 min to < 4 hour", and "4 hour to < 1 day", "One day or more".

MEMUSAGECATEGORY

This field categorizes the mem_usage into the following seven predefined levels:

"Not available", "0 GB to < 1 GB", "1 GB to < 2 GB", "2 GB to < 4 GB", "4 GB to < 8 GB", "8 GB to < 16 GB", "16 GB to < 32 GB", and "32 GB or more".

CPUTIMECATEGORY

This field categorized the CPU time into the following eight predefined levels:

"Not available", "0 sec to < 1 min", "1 min to < 5 min", "5 min to < 20 min", "20 min to < 60 min", "60 min to < 4 hour", "4 hour to < 1 day", "One day or more";

PENDINGTIMERANKIDX

This columns is used to sort the Pending Time Rank dimension in the cube.

RUNTIMERANKIDX

This columns is used to sort the Run Time Rank dimension in the cube.

MEMUSAGERANKIDX

This columns is used to sort the Memory Usage Rank in the cube.

CPUTIMERANKIDX

This columns is used to sort the CPU Time Rank in the cube.

JOBGROUP1

The first level in the Job Group dimension.

JOBGROUP2

The second level in the Job Group dimension.

JOBGROUP3

The third level in the Job Group dimension.

JOBGROUP4

The fourth level in the Job Group dimension.

NPROCS

This is the number of physical processors of the host, which is got from nprocs in wi_hostproperties table.

NCORES

This is the number of cores per processors of the host, which is got from ncores in wi_hostproperties table.

NTHREADS

This is the number of threads per core of the host, which is got from nthreads in wi_hostproperties table.

APPLICATION_TAG

This is the application_tag in wi_applicationcode table, which is based on application _code in wi_jobmartdaily table.

Previous Topic Next Topic Index