Featured CentOS 7.x How to help test .08 CentOS 7 Betas with Github code ?

when you guys run

Code:

rm -rf /var/cache/yum/*

afterwards does this file exist /var/cache/yum/base/mirrorlist.txt ? it shouldn't

then try

---

Code:

yum clean all

 

@Andy and @Sebastian B. are these test VPS servers ? Could be problems specific to their default image templates ?

I tried RamNode and DigitalOcean without problems for CentOS 7

 

On unrelated matter, updated new EPEL 7 download location in inc/downloadlinks.inc

 

yeah unfortunately been ages since I touched my Rackspace Cloud account as there's better alternatives with RamNode and DigitalOcean and Vultr

 

Server hardware wise with latest Intel E3-12xx Xeons and E5-26xx Xeons.

Not sure what Rackspace are using now, when I tried them they had AMD Opterons and their bandwidth costs for Rackspace cloud where high around US$0.18/GB and limited you to fraction of full 1Gbit network connectivity.

looks like pretty much same for some stuff US$0.20/GB bandwidth and 200Mb/s bandwidth for network on lowest plan Pay-as-you-go pricing | Rackspace Hosting

so a performance1-4 4GB instance would cost US$115/month excluding bandwidth costs ! and only give 800Mb/s network connectivity ! Add bandwidth costs at US$200/TB for say 2TB/month = US$400/month in bandwidth costs + US$115/month for VPS = US$515/month !

 

nice catch @Sebastian B. it's probably related to old legacy yum.conf routine that originated from original Centmin script that comes with Centmin Mod from line 616 in centmin.sh which triggers when unattended mode (default now) + 64bit OS is detected to ensure 32bit packages are excluded and it's contents at centminmod/yum.conf at 123.08centos7beta01 · centminmod/centminmod · GitHub

need to fix this it seems for CentOS 7

indeed fresh CentOS 7 /etc/yum.conf contents before Centmin Mod touches it

Code:

[main]
cachedir=/var/cache/yum/$basearch/$releasever
keepcache=0
debuglevel=2
logfile=/var/log/yum.log
exactarch=1
obsoletes=1
gpgcheck=1
plugins=1
installonly_limit=5
bugtracker_url=http://bugs.centos.org/set_project.php?project_id=23&ref=http://bugs.centos.org/bug_report_page.php?category=yum
distroverpkg=centos-release


#  This is the default, if you make this bigger yum won't see if the metadata
# is newer on the remote and so you'll "gain" the bandwidth of not having to
# download the new metadata and "pay" for it by yum not having correct
# information.
#  It is esp. important, to have correct metadata, for distributions like
# Fedora which don't keep old packages around. If you don't like this checking
# interupting your command line usage, it's much better to have something
# manually check the metadata once an hour (yum-updatesd will do this).
# metadata_expire=90m

# PUT YOUR REPOS HERE OR IN separate files named file.repo
# in /etc/yum.repos.d

have a fix I will test out more

instead of replacing yum.conf with one provided by Centmin Mod, on the fly add the exclude 32bit packages and modifying existing /etc/yum.conf using command code

Code:

ex -s /etc/yum.conf << EOF
:/plugins=1/
:a
exclude=*.i386 *.i586 *.i686
.
:w
:q
EOF

that will append to end of plugins=1 the exclude line

Code:

[main]
cachedir=/var/cache/yum/$basearch/$releasever
keepcache=0
debuglevel=2
logfile=/var/log/yum.log
exactarch=1
obsoletes=1
gpgcheck=1
plugins=1
exclude=*.i386 *.i586 *.i686
installonly_limit=5
bugtracker_url=http://bugs.centos.org/set_project.php?project_id=23&ref=http://bugs.centos.org/bug_report_page.php?category=yum
distroverpkg=centos-release


#  This is the default, if you make this bigger yum won't see if the metadata
# is newer on the remote and so you'll "gain" the bandwidth of not having to
# download the new metadata and "pay" for it by yum not having correct
# information.
#  It is esp. important, to have correct metadata, for distributions like
# Fedora which don't keep old packages around. If you don't like this checking
# interupting your command line usage, it's much better to have something
# manually check the metadata once an hour (yum-updatesd will do this).
# metadata_expire=90m

# PUT YOUR REPOS HERE OR IN separate files named file.repo
# in /etc/yum.repos.d

Committed a fix to this .08 beta branch at CentOS 7 fix for /etc/yum.conf for 32bit excludes · c2f3eb5 · centminmod/centminmod · GitHub

 

In that case check out Linode - it's what this very forum uses to host on Upgraded Linode VPS from 2GB to 4GB plan

But Vultr is making a nice play for performance at a budget market Vultr - Vultr now with 24 cpu core and 64GB VPS options ! | Centmin Mod Community But out of them all, I have the most VPS with RamNode ~9 VPS around 6x OpenVZ and 3x KVM

Probably better to discuss in a thread at Virtual Private Server (VPS) hosting | Centmin Mod Community

 

Found problem with PHP at least, php folks changed the mirrors yet again, PHP: Hypertext Preprocessor no longer works, you need without www php.net

Updated all Centmin Mod .07 stable, .08 beta branches and zip files

• 123.08centos7beta01 commit update php.net download url · ae6a83a · centminmod/centminmod · GitHub
• 123.07stable commit which snuck in PHP 5.4.32 as well update php.net download url and version · 39ba223 · centminmod/centminmod · GitHub

 

Proposing changes to how Centmin Mod .08 configures and sets up /tmp directory on initial installs.

Thanks to @Josephm bug reports, it highlighted a problem I ran into when testing Centmin Mod .08 beta01 on CentOS 7.0 with RamNode 512MB CKVM VPS server - while doing PHP-FPM compile for initial install, I ran out of disk space in /tmp. This is a problem due to legacy code from original Centmin which automatically mounts and reconfigures /tmp by default to be mounted on a ramdisk, tmpfs system. And by default it creates the tmpfs filesystem to 1/2 the size of total memory. This means for a 512MB VPS, you would have 256MB tmpfs ramdisk based /tmp directory. On a 8GB VPS server, you would have a 4GB sizes tmpfs ramdisk for /tmp.

Original Centmin was born out of trying to tailor to <512MB systems and originally didn't have as extensive a feature set of compile options for PHP-FPM and Nginx as I have done with Centmin Mod forked LEMP stack. This wasn't a problem with CentOS 6.5 it seemed as I could compile PHP-FPM fine even on 128-256MB memory based system with CentOS 6.5 32bit. But seems CentOS 7.0 adds more overhead being 64bit only.

Centmin Mod while still tailors to low memory VPSes, it's more clear that larger sites/forums and web properties are starting to use Centmin Mod and their usage from my own experience would necessitate a much larger /tmp disk free space directory. At least 2-4GB sized usually.

To address this long term, I will be changing the Centmin Mod .08 beta initial install's /tmp configuration routine

1. So that /tmp will only be mounted on ramdisk tmpfs filesystem if the system's total memory is greater than 8GB (8,000,000 byes to be precise). So if you had 8GB of memory, you would get a 4GB sized ramdisk based tmpfs filesystem for /tmp. If you had 32GB of memory, /tmp will become a 16GB sized ramdisk using tmpfs filesystem.
2. If you have between 2GB and <8GB of memory on the system, you would have a non-ramdisk standard EXT4 setup at /home/usertmp_donotdelete mounted on /tmp setup with a size of 4GB. While you loose some performance going from ramdisk based to disk based, alot of new VPS are using faster SSD based storage so should be sufficient. I chose the location at /home/usertmp_donotdelete as /home would usually have the most free disk space and well the name is to ensure folks do not accidentally delete it So a 2GB, 4GB or 6GB sized VPS/server would all be configured with a EXT4 disk based /tmp with a size of 4GB as opposed to the old method where they would get a ramdisk based tmpfs /tmp of 1GB, 2GB and 3GB sizes respectively.
3. If you have less <2GB of memory on system, you would have a non-ramdisk standard EXT4 setup /tmp with a size of 2GB. So if you have 256MB VPS, 512MB VPS or 1GB or <2GB VPS you would still have a /tmp size that is 2GB as opposed to the old method of creating a ramdisk tmpfs /tmp of 1/2 the size of total memory, which would only give a 256MB VPS a 128MB sized /tmp or a 512MB VPS a 256MB sized /tmp and thereby running up against potential problems with running out of free disk space for /tmp.

The proposed changes is for centmin.sh around line 642 for this new code below

Code:

    # only mount /tmp on tmpfs if CentOS system
    # total memory size is greater than 8GB
    # will give /tmp a size equal to 1/2 total memory
    if [[ "$TOTALMEM" -ge '8000000' ]]; then
       rm -rf /tmp
       mkdir -p /tmp
       mount -t tmpfs -o rw,noexec,nosuid tmpfs /tmp
       chmod 1777 /tmp
       echo "tmpfs /tmp tmpfs rw,noexec,nosuid 0 0" >> /etc/fstab
       rm -rf /var/tmp
       ln -s /tmp /var/tmp
    elif [[ "$TOTALMEM" -ge '2000000' || "$TOTALMEM" -lt '8000000' ]]; then
       # set on disk non-tmpfs /tmp to 4GB size
       # if total memory is between 2GB and <8GB
       rm -rf /tmp
       dd if=/dev/zero of=/home/usertmp_donotdelete bs=1024 count=4000000
       echo Y | mkfs.ext4 /home/usertmp_donotdelete
       mkdir -p /tmp
       mount -t ext4 -o rw,noexec,nosuid /home/usertmp_donotdelete /tmp
       chmod 1777 /tmp
       echo "/home/usertmp_donotdelete /tmp ext4 rw,noexec,nosuid 0 0" >> /etc/fstab
       rm -rf /var/tmp
       ln -s /tmp /var/tmp
    elif [[ "$TOTALMEM" -le '2000000' ]]; then
       # set on disk non-tmpfs /tmp to 2GB size
       # if total memory is <2GB
       rm -rf /tmp
       dd if=/dev/zero of=/home/usertmp_donotdelete bs=1024 count=2000000
       echo Y | mkfs.ext4 /home/usertmp_donotdelete
       mkdir -p /tmp
       mount -t ext4 -o rw,noexec,nosuid /home/usertmp_donotdelete /tmp
       chmod 1777 /tmp
       echo "/home/usertmp_donotdelete /tmp ext4 rw,noexec,nosuid 0 0" >> /etc/fstab
       rm -rf /var/tmp
       ln -s /tmp /var/tmp
    fi

If folks have any further suggestions or tweaks to this formula, please let me know as I have yet to implement this in .08 beta

testing proposed changes on RamNode 512MB CKVM VPS CentOS 7.0 minimal install

/tmp size is on disk instead of ramdisk

Code:

df -hT
Filesystem     Type      Size  Used Avail Use% Mounted on
/dev/vda1      ext4       49G  4.1G   43G   9% /
devtmpfs       devtmpfs  240M     0  240M   0% /dev
tmpfs          tmpfs     246M     0  246M   0% /dev/shm
tmpfs          tmpfs     246M  8.3M  237M   4% /run
tmpfs          tmpfs     246M     0  246M   0% /sys/fs/cgroup
tmpfs          tmpfs     246M  8.3M  237M   4% /etc/machine-id
/dev/loop0     ext4      3.7G   16M  3.5G   1% /tmp

Code:

*************************************************
* Post-Install Check List....
*************************************************

--------------------------------------------------------
Check ccache Version:
--------------------------------------------------------
ccache version 3.1.9

Copyright (C) 2002-2007 Andrew Tridgell
Copyright (C) 2009-2011 Joel Rosdahl

This program is free software; you can redistribute it and/or modify it under
the terms of the GNU General Public License as published by the Free Software
Foundation; either version 3 of the License, or (at your option) any later
version.

--------------------------------------------------------
Check Nginx Version:
--------------------------------------------------------
nginx version: nginx/1.7.4
built by gcc 4.8.2 20140120 (Red Hat 4.8.2-16) (GCC)
TLS SNI support enabled
configure arguments: --sbin-path=/usr/local/sbin/nginx --conf-path=/usr/local/nginx/conf/nginx.conf --with-http_ssl_module --with-http_gzip_static_module --with-http_stub_status_module --with-http_sub_module --with-http_addition_module --with-http_image_filter_module --with-http_secure_link_module --with-http_flv_module --with-http_realip_module --with-openssl-opt=enable-tlsext --add-module=../ngx-fancyindex-ngx-fancyindex --add-module=../ngx_cache_purge-2.1 --add-module=../headers-more-nginx-module-0.25 --add-module=../nginx-accesskey-2.0.3 --add-module=../nginx-http-concat-master --with-http_dav_module --add-module=../nginx-dav-ext-module-0.0.3 --add-module=../openresty-memc-nginx-module-1518da4 --add-module=../openresty-srcache-nginx-module-ffa9ab7 --add-module=../nginx-sticky-module-1.2.5 --add-module=../nginx_upstream_check_module-0.1.9 --with-openssl=../openssl-1.0.1i --with-libatomic --with-pcre=../pcre-8.35 --with-pcre-jit --with-http_spdy_module --add-module=../ngx_pagespeed-release-1.8.31.4-beta

--------------------------------------------------------
Check PHP-FPM Version:
--------------------------------------------------------
PHP 5.4.32 (cli) (built: Sep  9 2014 16:10:08)
Copyright (c) 1997-2014 The PHP Group
Zend Engine v2.4.0, Copyright (c) 1998-2014 Zend Technologies

--------------------------------------------------------
Check MariaDB installed RPM Versions:
--------------------------------------------------------
MariaDB-server-10.0.13-1.el6.x86_64
MariaDB-client-10.0.13-1.el6.x86_64
MariaDB-compat-10.0.13-1.el6.x86_64
MariaDB-shared-10.0.13-1.el6.x86_64
MariaDB-common-10.0.13-1.el6.x86_64
MariaDB-devel-10.0.13-1.el6.x86_64

--------------------------------------------------------
Check Memcached Server Version:
--------------------------------------------------------
memcached 1.4.20

--------------------------------------------------------
Check CSF Firewall Version:
--------------------------------------------------------
csf: v7.15 (generic)

--------------------------------------------------------
Check Siege Benchmark Version:
--------------------------------------------------------
SIEGE 3.0.7

Copyright (C) 2014 by Jeffrey Fulmer, et al.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS
FOR A PARTICULAR PURPOSE.


--------------------------------------------------------
Check ngx_pagespeed Control Script:
http://centminmod.com/nginx_ngx_pagespeed.html
--------------------------------------------------------
Detected 7.0
pscontrol handler
pscontrol edit
pscontrol on
pscontrol off
pscontrol statson
pscontrol statsoff

--------------------------------------------------------
Check mysqlreport version:
--------------------------------------------------------
mysqlreport v3.5-maria11 Jul 4 2013

--------------------------------------------------------
Check NSD Bind Version:
--------------------------------------------------------
NSD version 3.2.17
Written by NLnet Labs.

Copyright (C) 2001-2011 NLnet Labs.  This is free software.
There is NO warranty; not even for MERCHANTABILITY or FITNESS
FOR A PARTICULAR PURPOSE.

--------------------------------------------------------
Check YUM Repo List
--------------------------------------------------------
Loaded plugins: fastestmirror, priorities
Loading mirror speeds from cached hostfile
* base: mirrors.usc.edu
* epel: mirrors.cat.pdx.edu
* extras: mirror.web-ster.com
* rpmforge: repoforge.eecs.wsu.edu
* updates: mirror.chpc.utah.edu
96 packages excluded due to repository priority protections
repo id            repo name                                         status
base/7/x86_64      CentOS-7 - Base                                   6,551+1,914
epel/x86_64        Extra Packages for Enterprise Linux 7 - x86_64      5,081+529
extras/7/x86_64    CentOS-7 - Extras                                          31
mariadb            MariaDB                                                  11+2
rpmforge           RHEL 7 - RPMforge.net - dag                            185+60
updates/7/x86_64   CentOS-7 - Updates                                    577+200
repolist: 12,436

 

for Centmin Mod it has YUM priority protection which you need to disable like at Updating OpenSSL 1.0.1i for Centmin Mod [discussion] | Centmin Mod Community

Code:

--disableplugin=priorities

so

Code:

yum --enablerepo=axivo install elasticsearch --disableplugin=priorities