Conversation

Notices

1. hosh (hosh@hub.vikshepa.com)'s status on Friday, 09-Nov-2018 01:17:51 EST hosh
   !Hubzilla Support Forum
   Is there a way to get the noindex, nofollow metatags into hubzilla? If this needs to be done manually, which file(s) should be modified?
   1. hosh (hosh@hub.vikshepa.com)'s status on Friday, 09-Nov-2018 08:05:39 EST hosh

      in reply to
      For stuff that we are sharing anyway, it might be a lost cause to try to avoid having it indexed. I'm thinking more in terms of Articles and other content that doesn't get into the timeline (unless we put it there).
      
      In the spirit of "Do Not Feed the Google".
   2. hosh (hosh@hub.vikshepa.com)'s status on Friday, 09-Nov-2018 13:09:54 EST hosh

      in reply to
      OK - I'd forgotten that it's possible to use a robots.txt file, having previously only used meta tags. So I'll try that.
   3. hosh (hosh@hub.vikshepa.com)'s status on Friday, 09-Nov-2018 16:32:56 EST hosh

      in reply to
      like the NSA, for example...
   4. hosh (hosh@hub.vikshepa.com)'s status on Friday, 09-Nov-2018 17:02:20 EST hosh

      in reply to
      I've been doing some reading on the subject of the robots.txt, etc. and found:
      https://www.inmotionhosting.com/support/website/restricting-bots/how-to-stop-search-engines-from-crawling-your-website
      https://yoast.com/prevent-site-being-indexed/
      https://yoast.com/x-robots-tag-play/
      It looks as if using the X-robots Tag via .htaccess is preferable to using a "disallow" in the robots.txt file.