System Duplicate Identification (SDI) is a process that produces batches of system-identified duplicates to merge. Each duplicate set within a batch can have either multiple parties to merge together or just one party to cleanse. De-duplication runs the DQM Duplicate Identification program to generate the duplicate sets in each batch, based on your criteria.
As part of creating an SDI batch, you can run Automerge to automatically merge definite duplicates. Parties are included in Automerge processing if they reach an automatic merge threshold. Parties that are not automatically merged are included in a new SDI batch.
Note: You can run Automerge only as part of creating an SDI batch. You cannot first create a batch and then run Automerge on it.
You can use any of the duplicate sets in an SDI batch as the basis of a new merge request. See: Merge Requests Overview and Creating Merge Requests.
From the System Duplicate Identification Batches page, you can:
Create New Batch: See: Creating System Duplicate Identification Batches.
Phase: Review the details of the DQM Duplicate Identification program, for example the error log.
Detail: See: Reviewing System Duplicate Identification Batches. You can also create merge requests based on duplicate sets from the SDI batch you are reviewing. See: System Duplicates.
View Report: See: Viewing System Duplicate Identification Batch Reports.
Administration: Manage the list of parties marked as not duplicates of selected parties. See: Administering Nonduplicate Mappings.
The System Duplicate Identification Batches page shows SDI batches created by the user. To restrict the list, you can search for batches by:
Batch Name: The name of the batch.
Batch ID: The number that is automatically appended to the batch name when the batch is created.
Phase: The status of the DQM Duplicate Identification program that generates the duplicate sets after the batch is submitted.
Running
Pending
Inactive
Completed
Note: Duplicate sets are sequentially generated and immediately available, even if the program is still identifying more duplicates.
Created By: The user who created the SDI batch.
The search results provide additional information about the SDI batches:
Status: Status of the phase of the DQM Duplicate Identification program, for example Normal or Error.
Source
Import: Batch was created as a result of Registry de-duplication during an import process. If Automerge was part of the de-duplication, the batch contains only the parties that were automatically merged.
Import AM: Batch was created as a result of Registry de-duplication, with Automerge, for an import process. This batch contains only parties that were not automatically merged.
See: Registry De-Duplication.
System: User manually created the batch. If Automerge was part of the batch creation, the batch contains only the parties that were automatically merged.
System AM: Batch was created as a result of Automerge run as part of creating a batch. This batch includes only parties that were not automatically merged.
Automerge: Batch contains duplicate sets that were automatically merged, when Automerge was run as part of:
Creating the SDI batch. See: Automerge in System Duplicate Identification.
Registry de-duplication for an import process. See: Registry De-Duplication.