How do you identify duplicates? Can I get a list of the duplicates identified?

Duplicate detection and resolution are essential for ensuring a clean and accurate dataset in systematic reviews. EasySLR provides a robust de-duplication feature that helps identify, review, and manage duplicate records efficiently.

1. Setting Up Duplicate Detection Criteria

Before running the duplicate detection process, you can configure the criteria that EasySLR will use to identify duplicates. The system offers flexible options, allowing you to define rules that best suit your dataset.

Steps to Configure Duplicate Detection Criteria:

1. Access the "Duplicates Detection" Section
   
   • Navigate to Settings and Click on the Duplicates Detection tab.

2. Select the Matching Criteria
   
   • Choose one or more of the following fields for duplicate identification:
     
     
     • DOI (Digital Object Identifier) – Detects articles with the same DOI.
     • Title Similarity – Flag articles with identical titles.
     • Authors – Compare articles based on the same authors.
     • Abstract – Identify articles with a high percentage of overlap in abstracts.
     • Publication Year –  Compare articles based on the same publication year.
     • Volume – Matches based on the journal volume number.
     • Issue – Matches based on the journal issue number.
     • Journal – Matches articles from the same journal name.
     • Pages – Matches based on identical page numbers.
     • PMID – Matches articles using the unique PubMed ID.
       
       
3. Save and Apply Criteria
   
   • Once the parameters are selected, click Update to apply the detection rules.

2. Identifying Duplicates

Once the criteria are set, EasySLR will automatically scan the dataset and flag potential duplicates.

1. Confirming and Resolving Duplicates
   
   • Navigate to Review Duplicates section to view the list of potential duplicates identified based on the set criteria.
   • Click on "Mark All as Duplicate" to confirm all the listed articles as duplicates in a single action.

• Click on "Start Review" to manually review each potential duplicate pair.
• If you choose "Start Review," you will see two panes displaying the abstracts of the potentially duplicate articles. By default, the duplicate is shown on the right pane, and the original is on the left.

• Carefully analyse the articles listed as potential duplicates and choose the appropriate action:

If you confirm that the articles are indeed duplicates, select the "Confirm Duplicate" option. The article will then be moved to the "Confirmed Duplicates" section.

If, upon review, you determine that the articles are not duplicates, select the "Not Duplicate" option. The article will be moved back to the screening stage for further processing.

If necessary, you can switch the duplicate and original articles. If the article on the left pane should be marked as the duplicate instead, click the "Mark as Duplicate" option located in the left pane. The article on the right will then be considered the original.

3. Changing Criteria for Different Results

You can modify the duplicate detection criteria and re-run the process to generate an updated list. This allows you to experiment with different combinations to refine the search and take appropriate action accordingly.

Steps to Modify Criteria and Re-run Detection:

1. Click on the “Duplicates Detection” button on the Review Duplicates home page.

2. Select the fields and click update.

3. EasySLR will re-evaluate the articles based on the criteria set and will list potential duplicates.
4. Carefully analyse the articles listed as potential duplicates and choose the appropriate action.

4. Unmarking Duplicates

If an article was incorrectly marked as a duplicate, you can undo the action.

Steps to Unmark a Duplicate:

• Locate the article marked as a duplicate in the confirmed section.
• Use the new Unmark Duplicate option to modify or change your previous decision.

• Choose the applicable option to make changes in the previous decision.

You can also unmark duplicates in bulk by filtering the articles that were incorrectly marked and selecting them for unmarking. 

Once unmarked, these articles will move to the Title-Abstract screening stage.

For AI suggestions on these articles during screening, please rerun the AI by navigating to: Settings > AI Copilot > Titles Abstract AI Suggestions Refresh > Rerun AI > Pending AI Decision > Rerun.

If needed, you may adjust the duplicate detection criteria and reassess the articles accordingly.

Best Practices for De-duplication in EasySLR:

• Run de-duplication after importing all sources to ensure maximum efficiency.
• Review duplicate suggestions carefully before confirming, especially when using abstract similarity.
• If unsure, keep both articles  rather than confirming as duplicates.
• Periodically update criteria based on the nature of the dataset and project requirements.

If you need further clarification or assistance with duplicate detection and resolution, feel free to reach out to our support team.