erpware logo

Duplicate Check: application module


On this page you can find the user manual for the module Duplicate Check.

ID Validation Module Duplicate Check


The Duplicate Check has no default setting and can be configured individually for each check. Therefore, you will find an overview of all possibilities that can be performed on the module page.

Select all the rules for cleansing and duplicate checking that you want to perform in batch processing.


All cleanups are performed one after the other and are subsequently exported in new fields. If cleanups are performed, the duplicate check is performed afterwards.


The duplicate check checks all transferred data records one after the other and forms groups. Using these groups, all duplicate data records can be viewed and processed subsequently. Which rules were executed during the check of a duplicate is also output.

Batch processing

Select a file or drag and drop it to the “Import file” field and check it by pressing the “Check button”. This will start the verification of the entire file.

The process of checking takes some time depending on the size of the file.

The name of the duplicate export file is automatically assigned and generated in the identical format as the format passed. For example, if a file with the name “dubletten.json” is passed, the name of the log file will be “dubletten-log.json”.


Pre-checking of a duplicate import file can help you to check the format and the number of records found without performing any verification. The file will be analyzed and the result will be shown to you with a message.