[p2pu-dev] robots.txt

Ricardo Soares botequilha at gmail.com
Mon May 14 09:16:51 UTC 2012


Hi Dirk!

I Hope that's not too late for a suggestion :)
Regarding the robots.txt, I use to leave that work to apache by adding an
alias entrance to the vhost file.

Cheers,
Ricardo


On Mon, May 7, 2012 at 2:28 PM, Dirk Uys <dirk at p2pu.org> wrote:

> Hi
>
> Currently we don't have a robots.txt on p2pu.org. If you go to
> http://p2pu.org/robots.txt you get redirected to
> archive.p2pu.org/robots.txt which is the robots.txt for the old drupal
> site!
>
> I propose that we use django-robots to handle this for us?
> http://pypi.python.org/pypi/django-robots
>
> Does anyone have any experience/suggestions regarding this?
>
> Also, I noticed that we use django-wellknown. Are we currently using this?
>
> Another thing to consider is using the django sitemap contrib app?
> http://docs.djangoproject.com/en/dev/ref/contrib/sitemaps/
>
> Cheers
> Dirk
> _______________________________________________
> p2pu-dev mailing list
> p2pu-dev at lists.p2pu.org
> http://lists.p2pu.org/mailman/listinfo/p2pu-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.p2pu.org/pipermail/p2pu-dev/attachments/20120514/4ba78d97/attachment.html>


More information about the p2pu-dev mailing list