Use the DQM Staging program to create the staged schema, B-Tree, and interMedia indexes. This program applies transformations to a portion of the data contained in the TCA Registry and generates a separate schema with the transformed and standardized data.
When you specify in the Staging Command parameter to create indexes, the DQM Index Creation program automatically runs to generate interMedia and B-Tree indexes for the staged schema. Invoke the DQM Index Creation program not just to create indexes for the first time, but also to reindex the entire staged schema whenever necessary.
Suggestion: You can use the HZ: DQM Index Creation Memory profile option to override the default amount of memory that is allocated for creating interMedia indexes. See: Profile Options and Profile Option Categories.
The time that the program takes to create the staged schema depends on the size of your database and the number of attributes and transformations that you defined. To decrease the amount of time, you can specify how many parallel workers to use when you run the DQM Staging program. Workers are processes that run at the same time to complete a task that would otherwise take longer with a single process. The DQM Staging program invokes the DQM Stage Worker, which spins off parallel workers for staging the data.
Aside from creating the entire staged schema and the interMedia indexes, you can also run the DQM Staging program to:
Stage data using only new transformations
Generate only mapping procedures, which map attributes to the source columns of the attribute values
Regenerate only missing or invalid interMedia indexes
Estimate the table disk space needed to stage all data and create indexes
You should estimate the disk space first before actually staging data. The report output displays, in megabytes, the space required to stage each entity and create all indexes, as well as the total for all entities and indexes.
Note: Run the DQM Staging program every time that you add or modify attributes or transformations. See: Defining Attributes and Transformations.
Before you submit the DQM Staging program, you must define attributes and transformations. See: Defining Attributes and Transformations.
Number of Parallel Staging Workers: Enter the number of parallel staging workers, between one and ten, that you want to use to create the staged schema, or leave the parameter blank. The DQM Stage Worker runs with one worker if you leave the parameter blank.
Staging Command: Enter what you want the program to accomplish. This table shows the options.
| Staging Command | Description |
|---|---|
| CREATE_INDEXES | Create Indexes: To invoke the DQM Index Creation program to generate indexes for the staged schema. |
| CREATE_MISSING_INVALID_INDEXES | Recreate Missing and Invalid DQM Indexes: To invoke the DQM Index Creation program to regenerate missing or invalid indexes |
| ESTIMATE_SIZE | Estimate Disk Size for Staging: To estimate the disk space required to stage all data and create indexes. |
| GENERATE_MAP_PROC | Generate mapping procedures: To generate only mapping procedures. |
| STAGE_ALL_DATA | Stage all data, create indexes, and generate map procedures: To stage all data, create indexes, and generate mapping procedures. |
| STAGE_NEW_TRANSFORMATIONS | Stage new transformations: To stage data using only new or modified transformations. |
| STAGE_NEW_TRANSFORMATIONS_NO_INDEXING | Stage new transformations with no indexing: To stage data using only new or modified transformations without rebuilding indexes. |
Continue previous execution: Enter Yes to continue running a previous DQM Staging program that did not finish. Enter No to run a new DQM Staging program.
Index Creation Tablespace: Enter the table space where the interMedia indexes are to be created in.
Index Creation: Enter PARALLEL to generate multiple indexes at the same time, based on the number of parallel workers that you specified. Enter SERIAL to create indexes one after another, even if you specified parallel workers.