KAPOW

Would you like to react to this message? Create an account in a few clicks or log in to continue.
KAPOW

Welcome to the Kapow forum. Here you can get help, use your skills to help others and enjoy hanging out in the company of other Kapow Robot Developers.


2 posters

    Duplicate records

    E^E_2016
    avatar
    E^E_2016


    Posts : 10
    Points : 3020
    Join date : 2016-08-29
    • Post n°1

    Duplicate records Empty Duplicate records

    Post by E^E_2016 Mon Nov 07, 2016 2:26 pm

    Hello,

    Please help me advice how can I configure robot in Kapow to eliminate duplicate records from crawled pages if they are the same URL links with same contents. Assuming these crawled items is stored in database.

    Appreciate your help.

    Thanks.
    • Back to top
    Shyam Kumar
    Shyam Kumar
    Shyam Kumar
    Ranks


    Posts : 113
    Points : 4344
    Join date : 2013-07-05
    Location : Kerala, India
    • Post n°2

    Duplicate records Empty Re: Duplicate records

    Post by Shyam Kumar Thu Nov 10, 2016 7:47 pm

    Hi,

    For avoiding duplicates you need to configure your database type.

    Just change the data base types you are used in the design studio,

    what are the fields you need to give a unique, you can give as part of database key.


    Thank you.


    Regards,

    Shyam kumar
    • Back to top
      Current date/time is Fri Nov 15, 2024 1:45 pm