Decrease the runtime of large Deduplicate jobs

When running a Deduplicate job, Plauti Deduplicate searches your database for duplicate records. The runtime of your Deduplicate job is affected by database size, the applied scenarios, the number of records that are returned in an index search and the status of the Salesforce servers. If you want to decrease the runtime of your Deduplicate job, read this article for some useful tips and tricks.

1 Database size

The more records in your database, the more records Deduplicate needs to compare every time you run a Deduplicate job. Pretty obvious. If you want to do a specific search in your database, you could decide to apply a filter to your job to run the job on a subset of your data. Ask yourself, is it really necessary to run this job in my entire database?

Learn more about the Deduplicate Job filter in this knowledge item.

2 Scenarios

Plauti Deduplicate identifies duplicate records based on the applied scenario. A scenario defines what fields, records should be compared on, to find and identify duplicate records. Our default scenario for Leads has defined 5 fields, so it will compare records based on 5 fields. If you apply a more extended scenario, or multiple scenarios, the runtime of your job will be extended as well.

These tests are executed in a test environment with dummy data (1275 Lead records, 20% duplicates). No rights can be derived from this information.

When running a Deduplicate Job, Plauti Deduplicate returns a number of potential duplicate records for every record in your Object in the duplicate detection process. This is a process that runs in the background and is not visible to the user. Out of those returned potential duplicate records, Deduplicate will define duplicate records that reach the threshold level. The number of records that are returned in that background process is defined in the Deduplicate Setup. Generally spoken, the more records you return in the index search, the better the duplicate results. However, returning more duplicate records will extend to the runtime of your Deduplicate job.

These tests are executed in a test environment with dummy data (1275 Lead records, 20% duplicates). No rights can be derived from this information.

4 Plauti Desktop

Plauti Deduplicate is a native Force.com application. That's pretty awesome since we're the only deduplication app that is native! The advantage of totally running on the Salesforce cloud is that we can analyze your data right where it is. The 'downside' is that fact that we depend on the Salesforce servers. Even though the uptime is great, the server speed is a bit variable. If the Salesforce servers have a bad day, Deduplicate is affected by that as well. Running a job could take a little longer than usual, but will always deliver results. So, we created Plauti Desktop, Plauti Server and Plauti Cloud, which process your data on a local computing machine or on a secure cloud server, and return the results to the Salesforce Cloud Service.

Learn more about Plauti Desktop, Plauti Server and Plauti Cloud here.