/ Register

Get the most out of your Centmin Mod LEMP stack
Become a Member

Disable Bing bot from crawling my pages

Discussion in 'System Administration' started by pamamolf, Jul 19, 2014.

Previous Thread Next Thread
Loading...
  1. Jul 19, 2014 #1
    pamamolf

    pamamolf Premium Member Premium Member

    4,086
    428
    83
    May 31, 2014
    Ratings:
    +834
    Local Time:
    12:35 AM
    Nginx-1.25.x
    MariaDB 10.3.x
    Hi

    Is it possible to disable Bing from crawling my pages using maybe an Nginx trick or by csf?

    Thanks
     
  2. Jul 19, 2014 #2
    eva2000

    eva2000 Administrator Staff Member

    54,896
    12,240
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,811
    Local Time:
    8:35 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
  3. Jul 20, 2014 #3
    pamamolf

    pamamolf Premium Member Premium Member

    4,086
    428
    83
    May 31, 2014
    Ratings:
    +834
    Local Time:
    12:35 AM
    Nginx-1.25.x
    MariaDB 10.3.x
    I just don't want to get bing in my site :)
     
  4. Jul 20, 2014 #4
    eva2000

    eva2000 Administrator Staff Member

    54,896
    12,240
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,811
    Local Time:
    8:35 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
  5. Jul 20, 2014 #5
    pamamolf

    pamamolf Premium Member Premium Member

    4,086
    428
    83
    May 31, 2014
    Ratings:
    +834
    Local Time:
    12:35 AM
    Nginx-1.25.x
    MariaDB 10.3.x
    Bing doesn't respect robots.txt :(

    I was looking for an Nginx solution for it... :)
     
  6. Jul 20, 2014 #6
    eva2000

    eva2000 Administrator Staff Member

    54,896
    12,240
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,811
    Local Time:
    8:35 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
  7. Jul 20, 2014 #7
    pamamolf

    pamamolf Premium Member Premium Member

    4,086
    428
    83
    May 31, 2014
    Ratings:
    +834
    Local Time:
    12:35 AM
    Nginx-1.25.x
    MariaDB 10.3.x
    Ok thanks :)
     
  8. Jul 20, 2014 #8
    eva2000

    eva2000 Administrator Staff Member

    54,896
    12,240
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,811
    Local Time:
    8:35 AM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    personally Bing is my friend.. hoping it crawls more of my sites :D

    bing_webmastertools_dashboard.png

    bing_webmastertools_keywords.png
     
  9. Jul 20, 2014 #9
    Peter Downey

    Peter Downey Member

    64
    24
    8
    May 28, 2014
    Ratings:
    +27
    Local Time:
    6:35 PM
  10. Jul 20, 2014 #10
    rdan

    rdan Well-Known Member

    5,447
    1,408
    113
    May 25, 2014
    Ratings:
    +2,201
    Local Time:
    6:35 AM
    Mainline
    10.2
    Did you forgot we're on Lemp Stack?
    How come htaccess will work ;)
     
  11. Jul 20, 2014 #11
    Peter Downey

    Peter Downey Member

    64
    24
    8
    May 28, 2014
    Ratings:
    +27
    Local Time:
    6:35 PM
    I actually had no idea .htaccess didn't work with nginx, if that's the case my apologies. I'm still new to this nginx thing, clearly I'm learning new things every day lol.
     
Previous Thread Next Thread
Loading...

.