[ZendTo] Re: allow google to index the list?

[Jules]

Yes, but I only want to allow indexing of this list's archive and not 
anything else. I certainly don't want to allow indexing of the entire 
server, many of its lists are for our internal use only and we don't 
want to allow external access to them.

On 04/10/2012 07:34, Brendon Baumgartner wrote:
> I think this should do it. Also, here are the docs from google.
> https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt
>
>
> User-agent: googlebot
> Allow: /
>
> User-agent: ECSbot
> Allow: /
>
> User-agent: *
> Disallow: /
>
>
>
>
> On Thu, Sep 27, 2012 at 5:04 PM, Brendon Baumgartner <b at brendon.com 
> <mailto:b at brendon.com>> wrote:
>
>     Can you please allow google to index the list. I see you have it
>     disabled here:
>
>     http://mailman.ecs.soton.ac.uk/robots.txt
>
>     It would be nice to actually search the mailing list for past
>     problems/solutions.
>     Thanks
>     -Brendon
>
>
>
>
> _______________________________________________
> ZendTo mailing list
> ZendTo at zend.to
> http://mailman.ecs.soton.ac.uk/mailman/listinfo/zendto
>
> Jules
>
> -- 
> Julian Field MEng MBCS CITP CEng
> www.Zend.To
>
> Twitter: @JulesFM
> PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654
>
> 'A committee is a group of the unwilling, chosen from the unfit,
>   to do the unnecessary.' - Anon
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/zendto/attachments/20121004/6e593b48/attachment.html