Humble Trader

Saturday, January 28, 2006

Dimension Documentation - Process

This section describes the process and mappings that populate the dimension. Potentially, data could come from different sources and at different times. In this case all processes and schedules should be described.

Process - Process A:

Schedule:

  • Once a day at approximately 1:00am / Ad-hoc, on demand / etc.
Pre-Processing:
  • Describes any processes that will be carried out before the mappings are started. Usually, this will consist of file handling rules and pre-requisite events.
Staging:
  • Describes and names mappings that will be deployed to Staging (sta). Usually, these will move data as-is into the sta tables and, for some feeds, deltas are generated.
Validation:
  • Describes and names mappings that will be deployed to Validation (val). Usually, these will be concerned with data validation.
ODS:
  • Describes and names mappings that will be deployed to the ODS (ods).
Warehouse:
  • Describes and names mappings that will be deployed to the Warehouse (whs). This is the final load into the data warehouse proper.
Post-processing:
  • This describes any processes that will be carried out after the load has completed. This includes notification and error reporting.
Process - Process B:

etc...

Next -

0 Comments:

Post a Comment

<< Home