搭建
分布式Minio
啟動一個分布式Minio實例，你只需要把硬盤位置做為參數傳給minio server命令即可，然后，你需要在所有其它節點運行同樣的命令。
- 注意：
- 分布式Minio里所有的節點需要有同樣的access秘鑰和secret秘鑰，這樣這些節點才能建立聯接。為了實現這個，你需要在執行minio server命令之前，先將access秘鑰和secret秘鑰export成環境變量。
- 分布式Minio使用的磁盤里必須是干凈的，里面沒有數據。
- 分布式Minio里的節點時間差不能超過3秒，你可以使用NTP 來保證時間一致。
例子1：
四節點
cd /usr/minio
mkdir data1
mkdir data2
mkdir data3
mkdir data4
vim run.sh
chmod u+x *.sh
export MINIO_ACCESS_KEY="minio"
export MINIO_SECRET_KEY="minio123"
for i in {01..04}; do
nohup ./minio server --address ":90${i}" http://127.0.0.1:9001/usr/minio/data1 http://127.0.0.1:9002/usr/minio/data2 http://127.0.0.1:9003/usr/minio/data3 http://127.0.0.1:9004/usr/minio/data4 > "/usr/minio/90${i}.log"& 2>&1
done
export MINIO_ACCESS_KEY="minio"
export MINIO_SECRET_KEY="minio123"
nohup ./minio server --address ":9001" http://127.0.0.1:9001/usr/minio/data1 http://127.0.0.1:9002/usr/minio/data2 http://127.0.0.1:9003/usr/minio/data3 http://127.0.0.1:9004/usr/minio/data4 > "/usr/minio/9001.log"& 2>&1
nohup ./minio server --address ":9002" http://127.0.0.1:9001/usr/minio/data1 http://127.0.0.1:9002/usr/minio/data2 http://127.0.0.1:9003/usr/minio/data3 http://127.0.0.1:9004/usr/minio/data4 > "/usr/minio/9002.log"& 2>&1
nohup ./minio server --address ":9003" http://127.0.0.1:9001/usr/minio/data1 http://127.0.0.1:9002/usr/minio/data2 http://127.0.0.1:9003/usr/minio/data3 http://127.0.0.1:9004/usr/minio/data4 > "/usr/minio/9003.log"& 2>&1
nohup ./minio server --address ":9004" http://127.0.0.1:9001/usr/minio/data1 http://127.0.0.1:9002/usr/minio/data2 http://127.0.0.1:9003/usr/minio/data3 http://127.0.0.1:9004/usr/minio/data4 > "/usr/minio/9004.log"& 2>&1
例子2：
雙節點、雙掛載
#!/bin/bash
export MINIO_ACCESS_KEY="minio"
export MINIO_SECRET_KEY="minio123"
cd /usr/minio/
./minio server --address :9001 http://127.0.0.1:9001/usr/minio/data1 http://127.0.0.1:9001/usr/minio/data2 http://127.0.0.1:9002/usr/minio/data3 http://127.0.0.1:9002/usr/minio/data4 > /usr/minio/minio1.log 2>&1&
./minio server --address :9002 http://127.0.0.1:9001/usr/minio/data1 http://127.0.0.1:9001/usr/minio/data2 http://127.0.0.1:9002/usr/minio/data3 http://127.0.0.1:9002/usr/minio/data4 > /usr/minio/minio2.log 2>&1&
筆記：
- 集群服務意外停掉后，重啟文件自動會同步
- 雙掛載磁盤，每個磁盤都有備份
- 高可用，單機 Minio 服務存在單點故障，相反，如果是一個 N 節點的分布式 Minio ,只要有 N/2 節點在線，你的數據就是安全的。不過你需要至少有 N/2+1 個節點來創建新的對象。
https://blog.csdn.net/erdongxt/article/details/102997081
可擴容的方式，使用MinIO糾刪碼，如果想要擴容，必須使用這種方式
需要將新的MinIO節點架設好，假設原來是4臺機器，再加4臺機器進入節點即可完成擴容。
- 首次部署
export MINIO_ACCESS_KEY="minio"
export MINIO_SECRET_KEY="minio123"
#minio server http://host{1...32}/export{1...32}
./minio server http://192.168.1.{69...70}:9000/usr/minio/data{1...4}
- 擴容方式，在原命令最后一行末尾添加擴容的節點，重啟集群
export MINIO_ACCESS_KEY="minio"
export MINIO_SECRET_KEY="minio123"
#minio server http://host{1...32}/export{1...32} http://host{33...64}/export{1...32}
./minio server http://192.168.1.{69...70}:9000/usr/minio/data{1...4} http://192.168.1.{71...72}:9000/usr/minio/data{1...4}
掛載在根目錄下會報錯如下：
Disk /usr/minio/data1 is a root disk. Please ensure the disk is mounted properly, refusing to use root disk.
雙機Minio服務（生產）
#!/bin/bash
export MINIO_ACCESS_KEY="minio"
export MINIO_SECRET_KEY="handhand123"
cd /usr/local/minio/
./minio server --address :80 http://10.128.241.7:80/usr/local/minio/data1 http://10.128.241.7:80/usr/local/minio/data2 http://10.128.241.18:80/usr/local/minio/data1 http://10.128.241.18:80/usr/local/minio/data2 > /usr/local/minio/minio.log 2>&1&
nginx代理：
server {
listen 9000;
server_name localhost;
#charset koi8-r;
#access_log logs/host.access.log main;
client_max_body_size 100M;
location / {
proxy_pass http://updbackend;
proxy_set_header Host $http_host;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-Proto $scheme;
proxy_set_header X-Forwarded-Host $http_host;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
client_max_body_size 100m;
}
error_page 500 502 503 504 /50x.html;
location = /50x.html {
root html;
}
}
docker minio分布式
參考：https://docs.min.io/cn/deploy-minio-on-docker-compose.html
1
2
運行下面的命令
#拉鏡像
docker-compose pull
#啟動
docker-compose up
docker-compose -f docker-compose.yaml up -d
docker-compose.yaml
配置：
version: '3.7'
# starts 4 docker containers running minio server instances.
# using nginx reverse proxy, load balancing, you can access
# it through port 9000.
services:
minio1:
image: minio/minio:RELEASE.2020-12-26T01-35-54Z
volumes:
- data1-1:/data1
- data1-2:/data2
expose:
- "9000"
environment:
MINIO_ACCESS_KEY: minio
MINIO_SECRET_KEY: minio123
command: server http://minio{1...4}/data{1...2}
healthcheck:
test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
interval: 30s
timeout: 20s
retries: 3
minio2:
image: minio/minio:RELEASE.2020-12-26T01-35-54Z
volumes:
- data2-1:/data1
- data2-2:/data2
expose:
- "9000"
environment:
MINIO_ACCESS_KEY: minio
MINIO_SECRET_KEY: minio123
command: server http://minio{1...4}/data{1...2}
healthcheck:
test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
interval: 30s
timeout: 20s
retries: 3
minio3:
image: minio/minio:RELEASE.2020-12-26T01-35-54Z
volumes:
- data3-1:/data1
- data3-2:/data2
expose:
- "9000"
environment:
MINIO_ACCESS_KEY: minio
MINIO_SECRET_KEY: minio123
command: server http://minio{1...4}/data{1...2}
healthcheck:
test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
interval: 30s
timeout: 20s
retries: 3
minio4:
image: minio/minio:RELEASE.2020-12-26T01-35-54Z
volumes:
- data4-1:/data1
- data4-2:/data2
expose:
- "9000"
environment:
MINIO_ACCESS_KEY: minio
MINIO_SECRET_KEY: minio123
command: server http://minio{1...4}/data{1...2}
healthcheck:
test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
interval: 30s
timeout: 20s
retries: 3
nginx:
image: nginx:1.19.2-alpine
volumes:
- ./nginx.conf:/etc/nginx/nginx.conf:ro
ports:
- "9000:9000"
depends_on:
- minio1
- minio2
- minio3
- minio4
## By default this config uses default local driver,
## For custom volumes replace with volume driver configuration.
volumes:
data1-1:
data1-2:
data2-1:
data2-2:
data3-1:
data3-2:
data4-1:
data4-2:
