Beta Branch update centmin.sh menu option 21 submenu 8, 9, 10 in 130.00beta01

update centmin.sh menu option 21 submenu 8, 9, 10 in 130.00beta01

- update centmin.sh menu option 21 submenu options 8, 9 and 10 for transferring directory data to remote server via SSH, transfer directory data to S3 buckets and transfer individual files to S3 buckets

Continue reading...

130.00beta01 branch

• Branch: https://github.com/centminmod/centminmod/tree/130.00beta01
• Commit History: https://github.com/centminmod/centminmod/commits/130.00beta01

Support Centmin Mod

If you find Centmin Mod useful, please help support Centmin Mod

---

 

Follow up prep from https://community.centminmod.com/th...ion-21-submenu-routine-in-130-00beta01.23773/

This update is for centmin.sh menu option 21 submenu options 8, 9 and 10

Code (Text):

--------------------------------------------------------
     Centmin Mod Data Management     
--------------------------------------------------------
1).   Manage SSH Keys
2).   Manage AWS CLI S3 Profile Credentials
3).   Migrate Centmin Mod Data To New Centmin Mod Server
4).   Backup Nginx Vhosts Data + MariaBackup MySQL Backups
5).   Backup Nginx Vhosts Data Only (no MariaDB MySQL backups)
6).   Backup MariaDB MySQL With MariaBackup Only (no Vhosts Data backups)
7).   Backup MariaDB MySQL With mysqldump only (no Vhosts Data backups)
8).   Transfer Directory Data To Remote Server Via SSH
9).   Transfer Directory Data To S3 Compatible Storage
10).  Transfer Files To S3 Compatible Storage
11).  Download S3 Compatible Stored Data To Server
12).  S3 To S3 Compatible Storage Transfers
13).  List S3 Storage Buckets
14).  Back to Main menu
--------------------------------------------------------
Enter option [ 1 - 14 ]
--------------------------------------------------------

subemnu option 8

Code (Text):

--------------------------------------------------------
     Centmin Mod Data Management     
--------------------------------------------------------
1).   Manage SSH Keys
2).   Manage AWS CLI S3 Profile Credentials
3).   Migrate Centmin Mod Data To New Centmin Mod Server
4).   Backup Nginx Vhosts Data + MariaBackup MySQL Backups
5).   Backup Nginx Vhosts Data Only (no MariaDB MySQL backups)
6).   Backup MariaDB MySQL With MariaBackup Only (no Vhosts Data backups)
7).   Backup MariaDB MySQL With mysqldump only (no Vhosts Data backups)
8).   Transfer Directory Data To Remote Server Via SSH
9).   Transfer Directory Data To S3 Compatible Storage
10).  Transfer Files To S3 Compatible Storage
11).  Download S3 Compatible Stored Data To Server
12).  S3 To S3 Compatible Storage Transfers
13).  List S3 Storage Buckets
14).  Back to Main menu
--------------------------------------------------------
Enter option [ 1 - 14 ] 8
--------------------------------------------------------

Code (Text):

Transfer Directory Data To Remote Server Via SSH

Description:
Option allows you to specify a full path to directory name for data transfer
to a remote server via SSH at speeds near network and disk line rates using
either netcat (nc) or socat compressed tunnel using zstd fast compression levels

Do you want to continue [y/n]: y
Remote server SSH port (default: 22): 22
Remote server SSH username (default: root): root
Remote server SSH hostname/IP address: 123.123.123.123
Tunnel method (nc or socat, default: nc): nc
Buffer size for socat (in bytes, e.g., 131072 for 128 KB): 262144
Listen port for nc or socat (default: 12345): 12345
Source backup directory: /home/mysqlbackup/mysql/030523-021726
Remote (destination) backup directory: /home/remotebackup
Path to the SSH private key: /root/.ssh/my1.key

Please confirm the entered information:
Remote server SSH port: 22
Remote server SSH username: root
Remote server SSH hostname/IP address: 123.123.123.123
Tunnel method: nc
Buffer size: 262144
Listen port: 12345
Source backup directory: /home/mysqlbackup/mysql/030523-021726
Remote (destination) backup directory: /home/remotebackup
Path to the SSH private key: /root/.ssh/my1.key

Is the information correct? [y/n]: y
/usr/local/src/centminmod/datamanagement/tunnel-transfers.sh -p 22 -u root -h 123.123.123.123 -m nc -b 262144 -l 12345 -s /home/mysqlbackup/mysql/030523-021726 -r /home/remotebackup -k /root/.ssh/my1.key
Transfer completed successfully

Remote directory confirmed transferred data

Code (Text):

ls -lAh /home/remotebackup/
total 520K
-rw-r--r-- 1 mysql mysql 489K May  3 02:17 master_data.sql
-rw-r--r-- 1 mysql mysql 1.2K May  3 02:17 master_info.log
drwxr-xr-x 2 mysql mysql 4.0K May  3 02:17 mysql
-rwxr-xr-x 1 mysql mysql 9.1K May  3 02:17 restore.sh
drwxr-xr-x 2 mysql mysql 4.0K May  3 02:17 sakila
drwxr-xr-x 2 mysql mysql 4.0K May  3 02:17 wp3233312196db_24171

Source data directory

Code (Text):

ls -lAh /home/mysqlbackup/mysql/030523-021726
total 520K
-rw-r--r-- 1 mysql mysql 489K May  3 02:17 master_data.sql
-rw-r--r-- 1 mysql mysql 1.2K May  3 02:17 master_info.log
drwxr-xr-x 2 mysql mysql 4.0K May  3 02:17 mysql
-rwxr-xr-x 1 mysql mysql 9.1K May  3 02:17 restore.sh
drwxr-xr-x 2 mysql mysql 4.0K May  3 02:17 sakila
drwxr-xr-x 2 mysql mysql 4.0K May  3 02:17 wp3233312196db_24171

 

submenu option 9

Code (Text):

--------------------------------------------------------
     Centmin Mod Data Management       
--------------------------------------------------------
1).   Manage SSH Keys
2).   Manage AWS CLI S3 Profile Credentials
3).   Migrate Centmin Mod Data To New Centmin Mod Server
4).   Backup Nginx Vhosts Data + MariaBackup MySQL Backups
5).   Backup Nginx Vhosts Data Only (no MariaDB MySQL backups)
6).   Backup MariaDB MySQL With MariaBackup Only (no Vhosts Data backups)
7).   Backup MariaDB MySQL With mysqldump only (no Vhosts Data backups)
8).   Transfer Directory Data To Remote Server Via SSH
9).   Transfer Directory Data To S3 Compatible Storage
10).  Transfer Files To S3 Compatible Storage
11).  Download S3 Compatible Stored Data To Server
12).  S3 To S3 Compatible Storage Transfers
13).  List S3 Storage Buckets
14).  Back to Main menu
--------------------------------------------------------
Enter option [ 1 - 14 ] 9
--------------------------------------------------------

Code (Text):

Transfer Directory Data To S3 Compatible Storage

Description:
Option allows you to specify a full path to directory name for data transfer
to a S3 compatible storage provider like Amazon S3, Cloudflare R2, Backblaze
DigitalOcean, Vultr, Linode

Do you want to continue [y/n]: Y
AWS CLI profile name: r2
S3 bucket name: BUCKETNAME
S3 endpoint URL: https://YOUR_CF_ACCOUNT_ID.r2.cloudflarestorage.com
Source directory path: /home/mysqlbackup/mysql/030523-021726

Please confirm the entered information:
AWS CLI profile name: r2
S3 bucket name: BUCKETNAME
S3 endpoint URL: https://YOUR_CF_ACCOUNT_ID.r2.cloudflarestorage.com
Source directory path: /home/mysqlbackup/mysql/030523-021726

Is the information correct? [y/n]: y
aws s3 sync --profile r2 --endpoint-url https://YOUR_CF_ACCOUNT_ID.r2.cloudflarestorage.com /home/mysqlbackup/mysql/030523-021726 s3://BUCKETNAME/
upload: ../../../../home/mysqlbackup/mysql/030523-021726/master_data.sql to s3://BUCKETNAME/master_data.sql
upload: ../../../../home/mysqlbackup/mysql/030523-021726/master_info.log to s3://BUCKETNAME/master_info.log
upload: ../../../../home/mysqlbackup/mysql/030523-021726/mysql/column_stats.sql to s3://BUCKETNAME/mysql/column_stats.sql
upload: ../../../../home/mysqlbackup/mysql/030523-021726/mysql/column_stats.txt.sha256 to s3://BUCKETNAME/mysql/column_stats.txt.sha256
upload: ../../../../home/mysqlbackup/mysql/030523-021726/mysql/column_stats.txt.zst to s3://BUCKETNAME/mysql/column_stats.txt.zst
upload: ../../../../home/mysqlbackup/mysql/030523-021726/mysql/columns_priv.txt.sha256 to s3://BUCKETNAME/mysql/columns_priv.txt.sha256

...

030523-021726/wp3233312196db_24171/wp3233312196db_24171-schema-only.sql to s3://BUCKETNAME/wp3233312196db_24171/wp3233312196db_24171-schema-only.sql
upload: ../../../../home/mysqlbackup/mysql/030523-021726/wp3233312196db_24171/wp3233312196db_24171-schema-only.sql.sha256 to s3://BUCKETNAME/wp3233312196db_24171/wp3233312196db_24171-schema-only.sql.sha256

 

submenu option 10

Code (Text):

--------------------------------------------------------
     Centmin Mod Data Management       
--------------------------------------------------------
1).   Manage SSH Keys
2).   Manage AWS CLI S3 Profile Credentials
3).   Migrate Centmin Mod Data To New Centmin Mod Server
4).   Backup Nginx Vhosts Data + MariaBackup MySQL Backups
5).   Backup Nginx Vhosts Data Only (no MariaDB MySQL backups)
6).   Backup MariaDB MySQL With MariaBackup Only (no Vhosts Data backups)
7).   Backup MariaDB MySQL With mysqldump only (no Vhosts Data backups)
8).   Transfer Directory Data To Remote Server Via SSH
9).   Transfer Directory Data To S3 Compatible Storage
10).  Transfer Files To S3 Compatible Storage
11).  Download S3 Compatible Stored Data To Server
12).  S3 To S3 Compatible Storage Transfers
13).  List S3 Storage Buckets
14).  Back to Main menu
--------------------------------------------------------
Enter option [ 1 - 14 ] 10
--------------------------------------------------------

Code (Text):

Transfer Files To S3 Compatible Storage

Description:
Option allows you to specify a specific filename(s) for data transfer
to a S3 compatible storage provider like Amazon S3, Cloudflare R2, Backblaze
DigitalOcean, Vultr, Linode

Do you want to continue [y/n]: Y
AWS CLI profile name: r2
S3 bucket name: BUCKETNAME
S3 endpoint URL: https://YOUR_CF_ACCOUNT_ID.r2.cloudflarestorage.com
File path to transfer: /home/mysqlbackup/mysql/030523-021726/master_info.log
Do you want to add additional files to transfer? [y/n]: n

Please confirm the entered information:
AWS CLI profile name: r2
S3 bucket name: BUCKETNAME
S3 endpoint URL: https://YOUR_CF_ACCOUNT_ID.r2.cloudflarestorage.com
Files to transfer:
  - /home/mysqlbackup/mysql/030523-021726/master_info.log

Is the information correct? [y/n]: y
aws s3 cp --profile r2 --endpoint-url https://YOUR_CF_ACCOUNT_ID.r2.cloudflarestorage.com /home/mysqlbackup/mysql/030523-021726/master_info.log s3://BUCKETNAME/
upload: ../../../../home/mysqlbackup/mysql/030523-021726/master_info.log to s3://BUCKETNAME/master_info.log