Platform Analytics 7 Dataflow

Hourly Workload License datamart

Main ETL XML file

hourlyworkloadlicense.xml

Output CSV files

hourly_workload_license.csv

Record sample

FINISHDATE,FINISHHOUR,FINISHWEEKDAY,FINISHCOREHOUR,FINISHSHIFT,SUBMITDATE,SUBMITHOUR,SUBMITWEEKDAY,SUBMITCOREHOUR,STARTDATE,STARTHOUR,STARTWEEKDAY,STARTCOREHOUR,CLUSTERNAME,USERNAME,PROJECTNAME,QUEUENAME,SUBHOSTNAME,EXECHOSTNAME,JOBTYPE,NUMEXECPROCS,JOBEXITSTATUS,CPUTIME,MEMUSAGE,SWAPUSAGE,RUNTIME,PENDINGTIME,PENDINGTIMECATEGORY,JOBEXITCODE,VENDOR,FEATURE,SERVER,EVENT,EVENTREASON,DURATION,CHECKOUTNUM,CHECKOUTMAX,EVENTCOUNT,NUMOFJOB,JOBGROUP1,JOBGROUP2,JOBGROUP3,JOBGROUP4

"2008-06-25",16,4,1,"Shift 3","2008-06-25",16,4,1,"2008-06-25","16","4","1","cluster1","yuzhao","default","normal","labp01","labp01","00",1.0,"DONE",0.021,1.8594,16.4102,0.0333,0.0333,"0 sec to < 5 sec","0","lsf_ld","lsf_analytics_advanced_dm","perfqa05","USED","Normal",0.0,1.0,1.0,1.0,1.0,"/a","/a/b","/a/b/c","/a/b/c/d"

"2008-06-25",16,4,1,"Shift 3","2008-06-25",16,4,1,"2008-06-25","16","4","1","cluster1","yuzhao","default","normal","labp01","labp01","00",1.0,"DONE",0.024,1.8203,16.3867,0.0333,0.05,"0 sec to < 5 sec","0","lsf_ld","lsf_analytics_advanced_dm","perfqa05","USED","Normal",0.0,1.0,1.0,1.0,1.0,"","","",""

Column description

The Hourly Workload License datamart gets its information from the wi_lsfflexeventmart table.

The following table briefly describes each column and its source.
Column name
Source and description
FINISHCOREHOUR
The source is the localized finish_time in the wi_lsfflexeventmart table. If the finish_time is within the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise, it returns 0.
A value of 1 means that the data in this record is aggregated from the core_hour portion of the day (9am to 5pm, Monday to Friday).
FINISHDATE
This is the date portion of the localized finish_time in the wi_lsfflexeventmart table, and the format is "YYYY-MM-DD".
FINISHHOUR
This is the hour portion of the localized finish_time in the wi_lsfflexeventmart table.
FINISHSHIFT
This is based on the localized finish_time in the wi_lsfflexeventmart table. The shifts transformer maps the localized finish_time based on shift mapping and returns the user-defined shift.
FINISHWEEKDAY
This is the weekday number from the localized finish_time, where "1" is Sunday, "2" is Monday, etc.
SUBMITCOREHOUR
The source is the localized queue_time in the wi_lsfflexeventmart table. If the queue_time is within the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise, it returns 0.
A value of 1 means that the data in this record is aggregated from the core_hour portion of the day (9am to 5pm, Monday to Friday).
SUBMITDATE
This is the date portion of the localized finish_time in the wi_lsfflexeventmart table, and the format is "YYYY-MM-DD".
SUBMITHOUR
This is the hour portion of the localized finish_time in the wi_lsfflexeventmart table.
SUBMITWEEKDAY
This is the weekday number from the localized queue_time, where "1" is Sunday, "2" is Monday, etc.
STARTCOREHOUR
The source is the localized start_time in the wi_lsfflexeventmart table. If the start_time is within the range of 9am to 5pm on Monday to Friday, this field returns 1, otherwise, it returns 0.
A value of 1 means that the data in this record is aggregated from the core_hour portion of the day (9am to 5pm, Monday to Friday).
STARTDATE
This is the date portion of the localized start_time in the wi_lsfflexeventmart table, and the format is "YYYY-MM-DD".
STARTHOUR
This is the hour portion of the localized start_time in the wi_lsfflexeventmart table.
STARTWEEKDAY
This is the weekday number from the localized start_time, where "1" is Sunday, "2" is Monday, etc.
CLUSTERNAME
The source is the wi_clustercode table, as identified by cluster_code. The cluster_code source is the wi_lsfflexeventmart table.
USERNAME
The source is the wi_lsfflexeventmart table. User_code gets the user_name in the wi_usercode table, which is then put into this field.
PROJECTNAME
The source is the wi_projectcode table. The project_name uses the project_code in the wi_lsfflexeventmart table.
QUEUENAME
The source is the wi_queuecode table. The queue_name uses the queue_code from wi_lsfflexeventmart table.
SUBHOSTNAME
The source is subhost_code in the wi_lsfflexeventmart table. The subhost_code gets the host_name in the wi_hostcode table, which is then put into this column.
EXECHOSTNAME
The source is host_name in the wi_hostcode table. The exechost_code in the wi_lsfflexeventmart table gets the host_name, which is then put into this column.
JOBTYPE
The source is the job_type column in the wi_lsfflexeventmart table.
NUMEXECPROCS
The source is the num_exec_procs column in the wi_lsfflexeventmart table.
JOBEXITSTATUS
The source is the job_exit_status column in the wi_lsfflexeventmart table.
CPUTIME
The source is the cpu_time column in the wi_lsfflexeventmart table.
MEMUSAGE
The source is the mem_usage column in the wi_lsfflexeventmart table.
SWAPUSAGE
The source is the swap_usage column in the wi_lsfflexeventmart table.
RUNTIME
The source is the run_time column in the wi_lsfflexeventmart table.
PENDINGTIME
The source is the pending_time column in the wi_lsfflexeventmart table.
PENDINGTIMECATEGORY
This categorizes the pending_time into the following seven predefined levels or categories: "Not available," "0 sec to 5 sec," "5 sec to 30�sec," "30 sec to 5 minutes," "5 minutes to 1 hour," "1 hour to 1�day," and "More then one day."
Note that the categorizing is done through javascript.
JOBEXITCODE
The source is the job_exit_code column in the wi_lsfflexeventmart table.
VENDOR
The source is lic_vendor_name in the wi_licvendorcode table, which is based on lic_vendor_code in the wi_lsfflexeventmart table.
FEATURE
The source is lic_feature_name in the wi_licfeaturecode table, which is based on lic_feature_code in the wi_lsfflexeventmart table.
SERVER
The source is lic_server_name in the wi_licservercode table, which is based on lic_server_code in the wi_lsfflexeventmart table.
EVENT
The source islic_event_name in the wi_liceventcode table, which is based on lic_event_code in the wi_lsfflexeventmart table.
EVENTREASON
The source is lic_eventreason_name in the wi_liceventreasoncode table, which is based on lic_eventreason_code in the wi_lsfflexeventmart table.
DURATION
The source is the duration column in the wi_lsfflexeventmart table.
CHECKOUTNUM
The source is the check_out_num column in the wi_lsfflexeventmart table.
CHECKOUTMAX
The source is the check_out_max column in the wi_lsfflexeventmart table.
EVENTCOUNT
The source is the event_count column in the wi_lsfflexeventmart table.
NUMOFJOB
This column is always 1, and does not change.
JOBGROUP1
The first level in the Job Group dimension.
JOBGROUP2
The second level in the Job Group dimension.
JOBGROUP3
The third level in the Job Group dimension.
JOBGROUP4
The fourth level in the Job Group dimension.