Welcome to the Kapow forum. Here you can get help, use your skills to help others and enjoy hanging out in the company of other Kapow Robot Developers.

How to configure Kapow robot for URL blocking


Posts : 10
Points : 927
Join date : 2016-08-29

How to configure Kapow robot for URL blocking

Post by E^E_2016 on Mon 7 Nov 2016 - 14:29


Assuming that I am running the Kapow on scheduler hourly. In the next run, Google actually stops Kapow from crawling further due to some
security restriction etc. How can I fix this issue here? 

Appreciate your suggestions and recommendation.

Shyam Kumar
Shyam Kumar

Posts : 108
Points : 2243
Join date : 2013-07-05
Location : Kerala, India

Re: How to configure Kapow robot for URL blocking

Post by Shyam Kumar on Thu 10 Nov 2016 - 19:31


The currently working websites blocked mean you can configure the robot and change proxy. (Press Ctr R in design mode, and choose advanced tab, here you can check Use Proxy Server, then give Host and Port Number, if you have trusted proxy you need to give the user name and password.)

But if the website is blocked by running time, you can use change proxy action step, based on your logic you can change proxy.
(Uncheck Auto Select and give credentials by variable)

Thank you


Shyam kumar

    Current date/time is Fri 22 Feb 2019 - 10:21