NikonGear'23

The NikonGear Office => Help Desk => Topic started by: Michael Erlewine on June 15, 2015, 02:26:06

Title: Robots
Post by: Michael Erlewine on June 15, 2015, 02:26:06
I would like to know if this site is going to be open to robots like Google. If not, I am probably not going to contribute much, since if I go to the trouble of writing a review, etc., I want it available. Please let me know what the policy is. I suggest we have robots please.
Title: Re: Robots
Post by: Bjørn Rørslett on June 15, 2015, 06:46:24
At present, no measures are taken to prevent spiders indexing the site. Google found us within 24 hours. I suspect the other major engines will follow suit quickly.
Title: Re: Robots
Post by: Michael Erlewine on June 15, 2015, 07:29:31
That's great, because Google is the best advertising we can get to direct folks to where our discussions take place. I am very glad you did this and I wrote to and encouraged Dallas to give you the URL for NikonGear.com straight-away. I hope that is what happened. We need a more technical venue like this. Thanks for doing it!
Title: Re: Robots
Post by: Bjørn Rørslett on June 15, 2015, 07:42:03
Well, it's NOT the way it happened, but never mind.

As per written agreement, Nikongear.com will be released by Dallas in mid September this year. That URL will be redirected to nikongear.net, so it won't matter which site address is used from then on.
Title: Re: Robots
Post by: Michael Erlewine on June 18, 2015, 13:53:35
However it happened, I am pleased that it did. I fought the demise of the first NIkonGear every step of the way. Perhaps now we can just get back to the way it was. Thanks.
Title: Re: Robots
Post by: Andrea B. on June 18, 2015, 17:45:28
I will eventually manage the Bots and Spiders. There are some rather destructive page scrapers which will get blocked. As a general rule, I allow Google, Yahoo, MSN/Bing and a couple of others. Google is the Ruler of the Universe when it come to statistics so it is beneficial to permit Google. I have not yet set up scrape rates or anything with Google for Nikongear.net, but it is on the ToDo List.  ;)
Title: Re: Robots
Post by: Michael Erlewine on June 18, 2015, 17:48:47
Agreed. Google is the one we need to get the word out with. Thanks. Michael