search

oliviervanhees / friends4food

https://foodspots.me/
0 stars 0 forks source link

Prevent bots from crawling our website #45

Closed oliviervanhees closed 9 years ago

oliviervanhees commented 9 years ago

I am planing to add a lot of content from restaurants owners to our website (openings hours, menu, pictures, description, etc.). Since this content is rather unique (it costs us money/time to collect that data), I want to prevent other websites to crawl our website and copy that data. Is there a tool/module/technique to prevent others to crawl our website? Obviously, we have a login procedure with Facebook, but I am not sure if this is enough to prevent bots to crawl our website.

amitpatelx commented 9 years ago

I came across such kind of requirement first time. Give me some time to explore possible solution

oliviervanhees commented 9 years ago

if I am going for a native app, this is not high prio any more, so please give priority to the other question about the proximity marketing technology. I am really convinced that is the key to success :)