Join the community today
Register Now

Xenforo Robots.txt for manage Bots

Discussion in 'Forum software usage' started by R0rke, Oct 28, 2016.

  1. R0rke

    R0rke Member

    124
    17
    18
    Jun 2, 2016
    Iran
    Ratings:
    +28
    Local Time:
    2:26 AM
    1.11.1
    10.1
    Hello guys , this is an simple Xenforo Robots.txt file i found on the web .
    @eva2000 Please can you verify or edit this codes ?
    Code:
    Sitemap: YourURL !!
    Disallow: /attachments/
    Disallow: /misc/
    Disallow: /help/
    Disallow: /xentrade/
    Disallow: /unanswered/
    Disallow: /ReadPC/
    Disallow: /search/
    Disallow: /members/
    Disallow: /register/
    Disallow: /online/
    Disallow: /lost-password/
    Disallow: /recent-activity/
    Disallow: /account/
    Disallow: /admin.php
    Disallow: /conversations/
    Disallow: /events/birthdays/
    Disallow: /events/monthly
    Disallow: /events/weekly
    Disallow: /find-new/
    Disallow: /forums/-/
    Disallow: /goto/
    Disallow: /help/
    Disallow: /login/
    Disallow: /misc/style?*
    Disallow: /misc/quick-navigation-menu?*
    Disallow: /online/
    Disallow: /posts/
    Disallow: /ajax/
    Allow: /

     
..