Join the community today
Become a Member

Xenforo Robots.txt for manage Bots

Discussion in 'Forum software usage' started by R0rke, Oct 28, 2016.

  1. R0rke

    R0rke Member

    168
    22
    18
    Jun 2, 2016
    Iran
    Ratings:
    +37
    Local Time:
    4:00 AM
    2
    10
    Hello guys , this is an simple Xenforo Robots.txt file i found on the web .
    @eva2000 Please can you verify or edit this codes ?
    Code:
    Sitemap: YourURL !!
    Disallow: /attachments/
    Disallow: /misc/
    Disallow: /help/
    Disallow: /xentrade/
    Disallow: /unanswered/
    Disallow: /ReadPC/
    Disallow: /search/
    Disallow: /members/
    Disallow: /register/
    Disallow: /online/
    Disallow: /lost-password/
    Disallow: /recent-activity/
    Disallow: /account/
    Disallow: /admin.php
    Disallow: /conversations/
    Disallow: /events/birthdays/
    Disallow: /events/monthly
    Disallow: /events/weekly
    Disallow: /find-new/
    Disallow: /forums/-/
    Disallow: /goto/
    Disallow: /help/
    Disallow: /login/
    Disallow: /misc/style?*
    Disallow: /misc/quick-navigation-menu?*
    Disallow: /online/
    Disallow: /posts/
    Disallow: /ajax/
    Allow: /