Welcome to Centmin Mod Community
Register Now

Sysadmin monitoring and alert tools?

Discussion in 'System Administration' started by Zykov, May 31, 2014.

  1. dorobo

    dorobo Active Member

    420
    104
    43
    Jun 6, 2014
    Ratings:
    +162
    Local Time:
    5:08 AM
    latest
    latest
    50 Free Uptime Monitoring Services

    Code:
    http://blog.woorank.com/2014/05/50-free-uptime-monitoring-services/
     
    • Like Like x 1
  2. Matt

    Matt Moderator Staff Member

    819
    360
    63
    May 25, 2014
    Rotherham, UK
    Ratings:
    +549
    Local Time:
    10:08 PM
    1.5.15
    MariaDB 10.2
    Yeah, we've just had to upgrade the VM it's running on, as we needed more CPU to allocate to the pollers

    upload_2014-6-26_12-19-45.png

    ^^ one of the dashboard we've built in it.
     
    • Like Like x 1
  3. palPalani

    palPalani Member

    30
    12
    8
    May 30, 2014
    Chennai, IN
    Ratings:
    +20
    Local Time:
    2:38 AM
    Nginx 1.7
    MariaDB 5.5
    • Like Like x 2
  4. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    thanks for sharing :)

    OPSView looks interesting http://www.opsview.com/technology/guides-help/monitoring-examples/application-monitoring

    OPSView install http://docs.opsview.com/doku.php?id=opsview-core:centos-installation and http://www.opsview.com/technology/guides-help/opsview-installation/centos

     
  5. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    • Winner Winner x 1
  6. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Last edited: Jun 30, 2014
  7. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Mmonit gave me an idea for custom shell script to check PHP uptime and status, checkphp.sh. Will expand it to add pushover notification support https://community.centminmod.com/threads/pushover.142/ :)

    i.e. checkphp.sh against 3x PHP-FPM TCP pools www, www2 and www3.

    Code:
    /root/tools/checkphp.sh
    /root/tools/checkphp.sh {ping|status}
    
    Code:
    /root/tools/checkphp.sh ping
    pong
    pong
    pong
    
    Code:
    /root/tools/checkphp.sh status
    pool:                 www
    process manager:      ondemand
    start time:           29/Jun/2014:14:04:52 +0000
    start since:          3115
    accepted conn:        247
    listen queue:         0
    max listen queue:     0
    listen queue len:     32724
    idle processes:       0
    active processes:     1
    total processes:      1
    max active processes: 1
    max children reached: 0
    slow requests:        0
    
    pool:                 www2
    process manager:      ondemand
    start time:           29/Jun/2014:14:04:52 +0000
    start since:          3115
    accepted conn:        437
    listen queue:         0
    max listen queue:     1
    listen queue len:     32724
    idle processes:       0
    active processes:     1
    total processes:      1
    max active processes: 3
    max children reached: 0
    slow requests:        0
    
    pool:                 www3
    process manager:      ondemand
    start time:           29/Jun/2014:14:04:52 +0000
    start since:          3115
    accepted conn:        244
    listen queue:         0
    max listen queue:     0
    listen queue len:     32724
    idle processes:       0
    active processes:     1
    total processes:      1
    max active processes: 1
    max children reached: 0
    slow requests:        0
     
  8. dorobo

    dorobo Active Member

    420
    104
    43
    Jun 6, 2014
    Ratings:
    +162
    Local Time:
    5:08 AM
    latest
    latest
    • Like Like x 1
  9. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    thanks to @Matt idea for using constellix to check if ipv6 is working (y)

    sslspdycom_ipv6_constellix3.png

    sslspdycom_ipv6_constellix2.png

    sslspdycom_ipv6_constellix.png
     
    Last edited: Aug 13, 2014
    • Like Like x 1
  10. Peter Downey

    Peter Downey Member

    64
    23
    8
    May 28, 2014
    Ratings:
    +26
    Local Time:
    5:08 PM
    I don't believe this was listed yet. Uptimerobot.com

    They have lots of configurable alert conditions as well as free text message, email, and twitter alerts when something goes down. Quite useful if you prefer SMS alerts.
     
    • Like Like x 1
  11. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Yup I alway use Uptimerobot as well monitoring and alert tools? | Centmin Mod Community :)
     
  12. Floren

    Floren Active Member

    148
    77
    28
    Jun 6, 2014
    Ratings:
    +77
    Local Time:
    5:08 PM
    @eva2000, those graphics are fancy but they don't do you any good. What if you want to see what process caused a load to the server at 0:48? Those tools don't do much good. I personally use Sealion as it reflects the true Linux processes and also allows you to customize everything based on your needs. Take a look at the custom top output I set:

    IMG_13082014_213651.png
     
    • Like Like x 2
  13. Floren

    Floren Active Member

    148
    77
    28
    Jun 6, 2014
    Ratings:
    +77
    Local Time:
    5:08 PM
    This is how I do it in Sealion:

    IMG_13082014_222338.png

    Terminal flavor, much better. :)
     
    Last edited: Aug 14, 2014
    • Like Like x 1
  14. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    Nice @Floren, the Constellix is only for uptime monitoring for cpu load there's other tools. But have to check out Sealion. Thanks for sharing :D
     
  15. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    @Floren I like :woot: (y)

    but don't think sealion likes that system has only 128MB memory - some zombied processes heh

    sealion_sslspdycom.png
     
  16. Floren

    Floren Active Member

    148
    77
    28
    Jun 6, 2014
    Ratings:
    +77
    Local Time:
    5:08 PM
    @eva2000 I posted into my review the commands we use at AXIVO. Try them and let me know if you get any zombies. IMO, they are due to the first initial load. Try:
    Code:
    # service sealion restart
     
  17. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    it's partly due to OpenVZ and how it handles memory used it counts VIRT as used memory and with CentOS default stack size of 10M can balloon memory. Tweaked stack size for Sealion process and now memory usage is better on OpenVZ :)
     
    • Like Like x 1
  18. Floren

    Floren Active Member

    148
    77
    28
    Jun 6, 2014
    Ratings:
    +77
    Local Time:
    5:08 PM
    @eva2000, get rid of all extra commands you don't need, many of default ones are redundant.
    Also for iostat, use:
    Their default value generates server load and does not truly show you valuable disk info. Modify the commands to match the ones I posted into review.
     
    • Like Like x 1
  19. deltahf

    deltahf Premium Member Premium Member

    324
    147
    43
    Jun 8, 2014
    Ratings:
    +235
    Local Time:
    5:08 PM
    I use NewRelic and I absolutely love it. :)
     
    • Like Like x 1
  20. eva2000

    eva2000 Administrator Staff Member

    40,187
    8,888
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +13,697
    Local Time:
    7:08 AM
    Nginx 1.15.x
    MariaDB 5.5/10.x
    yeah I use NewRelic too :)
     
    • Like Like x 1
..