Learn about Centmin Mod LEMP Stack today
Become a Member

Disable Bing bot from crawling my pages

Discussion in 'System Administration' started by pamamolf, Jul 19, 2014.

  1. pamamolf

    pamamolf Well-Known Member

    2,903
    261
    83
    May 31, 2014
    Ratings:
    +464
    Local Time:
    5:13 AM
    Nginx-1.13.x
    MariaDB 10.1.x
    Hi

    Is it possible to disable Bing from crawling my pages using maybe an Nginx trick or by csf?

    Thanks
     
  2. eva2000

    eva2000 Administrator Staff Member

    31,650
    7,032
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,638
    Local Time:
    1:13 PM
    Nginx 1.13.x
    MariaDB 5.5
  3. pamamolf

    pamamolf Well-Known Member

    2,903
    261
    83
    May 31, 2014
    Ratings:
    +464
    Local Time:
    5:13 AM
    Nginx-1.13.x
    MariaDB 10.1.x
    I just don't want to get bing in my site :)
     
  4. eva2000

    eva2000 Administrator Staff Member

    31,650
    7,032
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,638
    Local Time:
    1:13 PM
    Nginx 1.13.x
    MariaDB 5.5
  5. pamamolf

    pamamolf Well-Known Member

    2,903
    261
    83
    May 31, 2014
    Ratings:
    +464
    Local Time:
    5:13 AM
    Nginx-1.13.x
    MariaDB 10.1.x
    Bing doesn't respect robots.txt :(

    I was looking for an Nginx solution for it... :)
     
  6. eva2000

    eva2000 Administrator Staff Member

    31,650
    7,032
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,638
    Local Time:
    1:13 PM
    Nginx 1.13.x
    MariaDB 5.5
    • Like Like x 1
  7. pamamolf

    pamamolf Well-Known Member

    2,903
    261
    83
    May 31, 2014
    Ratings:
    +464
    Local Time:
    5:13 AM
    Nginx-1.13.x
    MariaDB 10.1.x
    Ok thanks :)
     
  8. eva2000

    eva2000 Administrator Staff Member

    31,650
    7,032
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +10,638
    Local Time:
    1:13 PM
    Nginx 1.13.x
    MariaDB 5.5
    personally Bing is my friend.. hoping it crawls more of my sites :D

    bing_webmastertools_dashboard.png

    bing_webmastertools_keywords.png
     
  9. Peter Downey

    Peter Downey Member

    62
    23
    8
    May 28, 2014
    Ratings:
    +25
    Local Time:
    10:13 PM
  10. RoldanLT

    RoldanLT Well-Known Member

    4,020
    971
    113
    May 25, 2014
    Phillipines
    Ratings:
    +1,340
    Local Time:
    11:13 AM
    1.11
    10.2
    Did you forgot we're on Lemp Stack?
    How come htaccess will work ;)
     
  11. Peter Downey

    Peter Downey Member

    62
    23
    8
    May 28, 2014
    Ratings:
    +25
    Local Time:
    10:13 PM
    I actually had no idea .htaccess didn't work with nginx, if that's the case my apologies. I'm still new to this nginx thing, clearly I'm learning new things every day lol.
     
    • Like Like x 1