Difference between revisions of "Analytics Data Model"

From Datonis
Jump to: navigation, search
m (Updated object model images)
(22 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
== Data Model ==
 
== Data Model ==
The Data Model is divided into 3 sections:
+
The Analytics Data Model is divided into 4 sections:
# '''Productivity Data Model'''
+
# '''Workcenter Shift Productivity Data Model'''
# '''CBM Data Model'''
+
# '''Part Shift Productivity Data Model'''
# '''Process Data Model'''
+
# '''Hourly Data Model'''
 +
# '''Policy Data Model'''
  
=== Productivity Data Model ===
+
=== Workcenter Shift Productivity Data Model ===
MInt Productivity data, that is data about performance, is available across two kinds of time dimensions. Data that is rolled up at the shift level for shift level productivity analysis and at the hour level for more granular hourly trends.
+
MInt Productivity data, that is data about performance. This data is rolled up at the shift level for shift level productivity analysis.
  
==== '''Productivity data at a Shift level''' ====
 
 
Here is a diagram that represents the data model. 
 
Here is a diagram that represents the data model. 
 +
[[File:MINT Analytics Data Model - WorkCenterShiftFact v2.png|none|thumb|500x500px|MINT Analytics Data Model - WorkCenterShiftFact]] 
  
[[File:Workcenter Shift Tables.png|600x600px]]
+
The main tables are:
  
The main tables are: 
+
'''WorkcenterShiftFact'':''''' Productivity data is centred around a 'workcenter' (essentially a machine that is performing the task). This table contains the primary shift-level productivity parameters.
  
''''''WorkcenterShiftFact:'''''' Productivity data is centered around a workcenter which is a machine that is performing the task. This table contains the primary shift level productivity parameters.
+
'''WorkcenterShiftDowntimeReasonsFact''': Downtime represents the time duration for which the machine was non-operational. This table contains information about durations and reasons for the downtimes of a workcenter for a given shift.
  
<Link to detailed documentation where you should describe every column and the information it contains for all tables. Use this as an opportunity to rename columns that sound confusing>
+
'''WorkcenterShiftRejectionsFact''': Rejections are the quality defects that occurred on a workcenter. The table contains information about these quality rejections for a workcenter for a shift and the reasons for it.
  
'''WorkcenterShiftDownTimeReasonsFact''': Downtimes represent durations when the machine was non-operational. This table contains information about the downtimes for a workcenter for a shift and the reasons for it.
+
'''WorkcenterShiftOperatorsFact''': This table contains information about the operators working on the workcenter for a given shift.
  
'''WorkcenterShiftRejectionsFact''': Rejections are quality defects on a workcenter. The table contains information about these quality rejections for a workcenter for a shift and the reasons for it.
+
'''WorkcenterShiftProductivityDowntimeReasonsFact''': Performance loss is the metric to highlight the less-than-ideal rate at which the machine was working. If the machine is working slower than the expected (ideal) rate, the user can book a performance loss and associate a reason for it. This table contains the performance loss downtime information.
  
'''WorkcenterShiftOperatorsFact''': This table contains information about the operators working on the workcenter for a given shift.
+
'''WorkcenterShiftProductionParametersFact''': The table contains Production parameter data at a shift level. Production parameters are used to store the production quantity in different units based on customer requirements.
 +
 
 +
e.g. Some customers want to measure production quantity in Batch Counts but for their internal assessment, they need Batch Weight. In such cases, MInt will show Batch Count and Batch Weight will be sent to their internal system (say the customer's ERP system).
 +
 
 +
Please refer to the following link for [[Data Model Column Descriptions|description of each table column]].
 +
 
 +
 
 +
'''Examples of using the object model to create a chart:'''
 +
 
 +
Here is an example video of how you can use the data model to analyze [[Create your own custom dashboards|average OEE by Workcenters]].
 +
 
 +
{{#ev:youtube|https://youtu.be/faSzdxPDy8s}}
  
'''*WorkcenterShiftProductivityDownTimeReasonsFact''': Captures details of all the downtime incidents occurring on a workcenter when it is running on a given day.
 
  
'''*WorkcenterShiftProductionParametersFact''': Captures details of all the production parameters produced on a workcenter when it's running on a given day.
 
  
'''Examples of using the object model to create dashboards:'''
+
=== Part Shift Productivity Data Model ===
# Here is an example of how you can use the data model to analyze [[Create your own custom dashboards|average OEE by Workcenters]].
+
MInt Part Productivity data gives insights about your part level performance. This data is rolled up at the shift level for doing shift level part productivity analysis.
  
==== '''Productivity data at the Hour level''' ====
 
 
Here is a diagram that represents the data model.
 
Here is a diagram that represents the data model.
 +
[[File:MINT Analytics Data Model - WorkcenterPartOperationShiftFact v2.png|none|thumb|500x500px|MINT Analytics Data Model - WorkcenterPartOperationShiftFact]]
  
== Star Schema of the MINT Analytics Data Model ==
+
The main tables are:
  
=== '''Faas Data''' ===
+
'''WorkcenterPartOperationShiftFact:''' The Part Productivity data is centred around a part that is being produced on the workcenter. This table contains the primary shift level part productivity parameters.
This is further divided into 2 models:
 
  
==== '''WorkcenterShiftFact''' ====
+
'''WorkcenterPartOperationShiftDownTimeReasonsFact:''' Downtime represents the time duration for which the machine was non-operational. This table contains information about the downtimes that occurred throughout the duration for which a part was booked within a shift and the reasons for those downtimes.
This model is used to create most of the Productivity related KPIs and Reports in existing MINT. The main dimensions (groupby) of this model are at Workenter, Shift and Working day (Calendar Date).
 
  
'''Note -''' Any categorical column can be used as a dimension.
+
'''WorkcenterPartOperationShiftRejectionsFact:''' Rejections are the quality defects that occurred on a workcenter. The table contains information about these quality rejections for a part for a shift and the reasons for it.
  
The proposed star schema has 6 main fact tables:
+
'''WorkcenterPartShiftProductionParametersFact:''' The table contains Production parameter data at a part and shift level. Production parameters are used to store the production quantity in different units based on customer requirements.
  
● '''WorkcenterShiftFact:''' Captures all the productivity parameters that can be used to calculate OEE, availability, performance and energy consumption ,etc.
+
e.g. Some customers want to measure production quantity in Batch Counts but for their internal assessment, they need Batch Weight. In such cases, MInt will show Batch Count and Batch Weight will be sent to their internal system (say the customer's ERP system).
  
● '''WorkcenterShiftDownTimeReasonsFact''': Captures details of all the downtime incidents occurring on a workcenter on a given day.
 
  
● '''WorkcenterShiftRejectionsFact''': Captures details of all the rejections on a workcenter.
+
'''Examples of using the object model to create a chart:'''
  
● '''WorkcenterShiftOperatorsFact''': Captures operators who have worked on a workcenter on a given day.
+
Here is an example video of how you can use the data model to analyze Part Cycle Times by Shift.
  
● '''WorkcenterShiftProductivityDownTimeReasonsFact''': Captures details of all the downtime incidents occurring on a workcenter when it is running on a given day.
+
{{#ev:youtube|https://youtu.be/JyZc0Y8lWfk}}
  
● '''WorkcenterShiftProductionParametersFact''': Captures details of all the production parameters produced on a workcenter when it's running on a given day.
 
  
This is the most insightful data model for overall productivity metrics and will let us create a lot of reports on a daily/weekly/monthly basis. This will also allow reports like QOQ comparison of cells/workcenters/shifts on productivity, quality and performance parameters.
 
  
'''Note -''' It is possible for the user to select any categorical column mentioned in the table as a groupby to the chart being created (e.g. machine_name, shift_name, category_code, etc).
+
=== Hourly Data Model ===
 +
MInt Hourly Data is aggregation of Condition Based Monitoring (CBM), Part Process Quality, and Performance. This data is rolled up at an hourly level.
  
Along with the groupby, the user will have to choose a numeric column from the table to view the details. This column will have an aggregation associated with it (e.g. if you select production_quantity; options like MIN, MAX, AVG, COUNT, etc will be shown) to be selected by the user.
+
Here is a diagram that represents the data model.
 +
[[File:MINT Analytics Data Model - WorkcenterHourlyFact v2.png|none|thumb|500x500px|MINT Analytics Data Model - WorkcenterHourlyFact]]
  
Additionally, the user can create custom metrics and/or KPIs to add business meaning to the charts (e.g. If the user wants to see specific energy consumption, he can create a metric by taking the ratio of electricity and production_quantity).
+
The main tables are:
  
==== '''WorkcenterPartRoutingShiftFact''' ====
+
'''WorkcenterHourlyFact:''' Productivity data is centred around a 'workcenter' (essentially a machine that is performing the task). This table contains the primary hourly level productivity parameters.
While the model above in (a) only provides roll up to a machine level, this model adds 2 more dimensions to the above model namely: Part and Routing.
 
  
Part can be compared to an SKU, Batch, Product (depending on the nomenclature each industry uses).
+
'''WorkcenterHourlyCbmParamsFact:''' Condition Based Monitoring (CBM) is the process of monitoring a key parameter in a workcenter (vibration, temperature etc.). This helps in locating a significant change which may be indicative of a developing fault in a machine. The table contains information about the CBM parameters, their control limits and details of violations.
  
Routing is a set of operations that a Part goes through in its lifecycle from Raw Material to Finished Good (e.g. In a bottling plant, each Part (bottle in this case) goes through Cleaning -> Filling -> Capping -> Sticker Printing -> Packing. These 5 are operations and the complete flow is called routing).
+
'''WorkcenterHourlyProcessParamsFact:''' Process parameters are the parameters dependant on the part (temperature of Part-1, temperature of Part-2 etc.). This helps in identifying a significant change that may be indicative of developing a quality defect. The table contains information about the Process parameters, their control limits and details of violations.
  
[[File:Workcenter Part Routing Shift Tables.png|600x600px]]
+
'''WorkcenterHourlyProcessOperationFact:''' The table contains Part - Operation information for each part at an hourly level.
  
The fact tables in the star schema for this model are:
+
'''WorkcenterPartHourlyProdParamsFact:''' The table contains production parameter data at a part and hourly level. Production parameters are used to store the production quantity in different units based on Customer requirements.
  
● '''WorkcenterPartRoutingDailyFact:''' Contains all the parameters (production, rejection, energy) for a part and routing for a day/shift on the machine on which it was produced.
+
e.g. Some customers want to measure production quantity in Batch Counts but for their internal assessment, they need Batch Weight. In such cases, MInt will show Batch Count and Batch Weight will be sent to their internal system (say the customer's ERP system).
  
● '''WorkcenterPartRoutingDownTimeReasonsDailyFact:''' Contains all the downtime reason details for each row in the part routing model.
 
  
● '''WorkcenterPartRoutingRejectionsDailyFact:''' Contains all the rejection details for each row in the part routing model.
+
'''Examples of using the object model to create a chart:'''
 +
 
 +
Here is an example video of how you can use the data model to analyze CBM Parameter Violations by Hour.
 +
 
 +
{{#ev:youtube|https://youtu.be/IifqrIOofP4}}
 +
 
 +
 
 +
 
 +
=== Policy Data Model ===
 +
MInt Policy data gives information about your manual policy bookings. For e.g. Safety Checksheets, Part Dimension Checklists, etc. This data is then used for correlations with other process/ productivity parameters or to create dashboards from your manual booking data.
 +
 
 +
Here is a diagram that represents the data model.
 +
[[File:MINT Analytics Data Model - Policy data.png|none|thumb|500x500px|MINT Analytics Data Model - Policy data]]
 +
The main tables are:
 +
 
 +
'''PolicySchedule:''' The table contains policy master data along with the schedule of the policy booking.
  
This data model will allow for reports on part level analytics w.r.t. the machines on which they are produced some of which include performance monitoring, specific energy consumption, Part rejections etc.
+
'''PolicyBooking:''' This table has the actual manually entered booking data for e.g. part length values, checklist values etc.

Revision as of 05:49, 30 July 2020

Data Model

The Analytics Data Model is divided into 4 sections:

  1. Workcenter Shift Productivity Data Model
  2. Part Shift Productivity Data Model
  3. Hourly Data Model
  4. Policy Data Model

Workcenter Shift Productivity Data Model

MInt Productivity data, that is data about performance. This data is rolled up at the shift level for shift level productivity analysis.

Here is a diagram that represents the data model. 

MINT Analytics Data Model - WorkCenterShiftFact
 

The main tables are:

WorkcenterShiftFact: Productivity data is centred around a 'workcenter' (essentially a machine that is performing the task). This table contains the primary shift-level productivity parameters.

WorkcenterShiftDowntimeReasonsFact: Downtime represents the time duration for which the machine was non-operational. This table contains information about durations and reasons for the downtimes of a workcenter for a given shift.

WorkcenterShiftRejectionsFact: Rejections are the quality defects that occurred on a workcenter. The table contains information about these quality rejections for a workcenter for a shift and the reasons for it.

WorkcenterShiftOperatorsFact: This table contains information about the operators working on the workcenter for a given shift.

WorkcenterShiftProductivityDowntimeReasonsFact: Performance loss is the metric to highlight the less-than-ideal rate at which the machine was working. If the machine is working slower than the expected (ideal) rate, the user can book a performance loss and associate a reason for it. This table contains the performance loss downtime information.

WorkcenterShiftProductionParametersFact: The table contains Production parameter data at a shift level. Production parameters are used to store the production quantity in different units based on customer requirements.

e.g. Some customers want to measure production quantity in Batch Counts but for their internal assessment, they need Batch Weight. In such cases, MInt will show Batch Count and Batch Weight will be sent to their internal system (say the customer's ERP system).

Please refer to the following link for description of each table column.


Examples of using the object model to create a chart:

Here is an example video of how you can use the data model to analyze average OEE by Workcenters.


Part Shift Productivity Data Model

MInt Part Productivity data gives insights about your part level performance. This data is rolled up at the shift level for doing shift level part productivity analysis.

Here is a diagram that represents the data model.

MINT Analytics Data Model - WorkcenterPartOperationShiftFact

The main tables are:

WorkcenterPartOperationShiftFact: The Part Productivity data is centred around a part that is being produced on the workcenter. This table contains the primary shift level part productivity parameters.

WorkcenterPartOperationShiftDownTimeReasonsFact: Downtime represents the time duration for which the machine was non-operational. This table contains information about the downtimes that occurred throughout the duration for which a part was booked within a shift and the reasons for those downtimes.

WorkcenterPartOperationShiftRejectionsFact: Rejections are the quality defects that occurred on a workcenter. The table contains information about these quality rejections for a part for a shift and the reasons for it.

WorkcenterPartShiftProductionParametersFact: The table contains Production parameter data at a part and shift level. Production parameters are used to store the production quantity in different units based on customer requirements.

e.g. Some customers want to measure production quantity in Batch Counts but for their internal assessment, they need Batch Weight. In such cases, MInt will show Batch Count and Batch Weight will be sent to their internal system (say the customer's ERP system).


Examples of using the object model to create a chart:

Here is an example video of how you can use the data model to analyze Part Cycle Times by Shift.


Hourly Data Model

MInt Hourly Data is aggregation of Condition Based Monitoring (CBM), Part Process Quality, and Performance. This data is rolled up at an hourly level.

Here is a diagram that represents the data model.

MINT Analytics Data Model - WorkcenterHourlyFact

The main tables are:

WorkcenterHourlyFact: Productivity data is centred around a 'workcenter' (essentially a machine that is performing the task). This table contains the primary hourly level productivity parameters.

WorkcenterHourlyCbmParamsFact: Condition Based Monitoring (CBM) is the process of monitoring a key parameter in a workcenter (vibration, temperature etc.). This helps in locating a significant change which may be indicative of a developing fault in a machine. The table contains information about the CBM parameters, their control limits and details of violations.

WorkcenterHourlyProcessParamsFact: Process parameters are the parameters dependant on the part (temperature of Part-1, temperature of Part-2 etc.). This helps in identifying a significant change that may be indicative of developing a quality defect. The table contains information about the Process parameters, their control limits and details of violations.

WorkcenterHourlyProcessOperationFact: The table contains Part - Operation information for each part at an hourly level.

WorkcenterPartHourlyProdParamsFact: The table contains production parameter data at a part and hourly level. Production parameters are used to store the production quantity in different units based on Customer requirements.

e.g. Some customers want to measure production quantity in Batch Counts but for their internal assessment, they need Batch Weight. In such cases, MInt will show Batch Count and Batch Weight will be sent to their internal system (say the customer's ERP system).


Examples of using the object model to create a chart:

Here is an example video of how you can use the data model to analyze CBM Parameter Violations by Hour.


Policy Data Model

MInt Policy data gives information about your manual policy bookings. For e.g. Safety Checksheets, Part Dimension Checklists, etc. This data is then used for correlations with other process/ productivity parameters or to create dashboards from your manual booking data.

Here is a diagram that represents the data model.

MINT Analytics Data Model - Policy data

The main tables are:

PolicySchedule: The table contains policy master data along with the schedule of the policy booking.

PolicyBooking: This table has the actual manually entered booking data for e.g. part length values, checklist values etc.