.net做网站用什么的多,免费的个人简历模板pdf,网站开发 chrome浏览器崩溃,网站子站点是什么意思Kubernetes概述 使用kubeadm快速部署一个k8s集群 Kubernetes高可用集群二进制部署#xff08;一#xff09;主机准备和负载均衡器安装 Kubernetes高可用集群二进制部署#xff08;二#xff09;ETCD集群部署 Kubernetes高可用集群二进制部署#xff08;三#xff09;部署…Kubernetes概述 使用kubeadm快速部署一个k8s集群 Kubernetes高可用集群二进制部署一主机准备和负载均衡器安装 Kubernetes高可用集群二进制部署二ETCD集群部署 Kubernetes高可用集群二进制部署三部署api-server Kubernetes高可用集群二进制部署四部署kubectl和kube-controller-manager、kube-scheduler Kubernetes高可用集群二进制部署五kubelet、kube-proxy、Calico、CoreDNS Kubernetes高可用集群二进制部署六Kubernetes集群节点添加
Kubernetes简称为k8s是Google在2014年6月开源的一个容器集群管理系统使用Go语言开发用于管理云平台中多个主机上的容器化的应用Kubernetes的目标是让部署容器化的应用简单并且高效,Kubernetes提供了资源调度、部署管理、服务发现、扩容缩容、监控维护等一整套功能努力成为跨主机集群的自动部署、扩展以及运行应用程序容器的平台。 它支持一系列容器工具, 包括Docker、Containerd等。
一、集群环境准备
1.1 主机规划
主机IP地址主机名主机配置主机角色软件列表192.168.10.103k8s-master12C4Gmaster workerkube-apiserver、kube-controller-manager、kube-scheduler、etcd、kubelet、kube-proxy、docker-ce192.168.10.104k8s-master22C4Gmaster workerkube-apiserver、kube-controller-manager、kube-scheduler、etcd、kubelet、kube-proxy、docker-ce192.168.10.105k8s-master32C4Gmaster workerkube-apiserver、kube-controller-manager、kube-scheduler、etcd、kubelet、kube-proxy、docker-ce192.168.10.106k8s-worker12C4Gworker1kubelet、kube-proxy、docker-ce192.168.10.107k8s-worker22C4Gworker2(备用工作节点集群搭建完成后作为新节点加入)kubelet、kube-proxy、docker-ce192.168.10.101ha11C2GLBhaproxy、keepalived192.168.10.102ha21C2GLBhaproxy、keepalived192.168.10.100//VIP(虚拟IP)
1.2 软件版本
软件名称版本备注CentOS7kernel版本5.16kubernetesv1.21.10etcdv3.5.2最新版本calicov3.19.4网络插件corednsv1.8.4docker-ce20.10.13YUM源默认haproxy5.18YUM源默认keepalived3.5YUM源默认
1.3 网络分配
网络名称网段备注Node网络192.168.10.101/107集群节点网络Service网络10.96.0.0/16实现服务发现时所使用的网络Pod网络10.244.0.0/16
二、集群部署
2.1主机准备
2.1.1 主机名设置
hostnamectl set-hostname xxx关于主机名参见1.1小节主机规划表2.1.2 主机与IP地址解析
cat /etc/hosts EOF
192.168.10.101 ha1
192.168.10.102 ha2
192.168.10.103 k8s-master1
192.168.10.104 k8s-master2
192.168.10.105 k8s-master3
192.168.10.106 k8s-worker1
EOF2.1.3 主机安全设置
2.1.3.1 关闭防火墙
systemctl stop firewalld
systemctl disable firewalld
firewall-cmd --state2.1.3.2 关闭selinux
setenforce 0
sed -ri s/SELINUXenforcing/SELINUXdisabled/ /etc/selinux/config
sestatus2.1.4 交换分区设置
swapoff -a
sed -ri s/.*swap.*/#/ /etc/fstab
echo vm.swappiness0 /etc/sysctl.conf
sysctl -p2.1.5 主机系统时间同步
安装软件
yum -y install ntpdate制定时间同步计划任务
crontab -e
0 */1 * * * ntpdate time1.aliyun.com2.1.6 主机系统优化 limit优化 ulimit -SHn 65535cat EOF /etc/security/limits.conf
* soft nofile 655360
* hard nofile 131072
* soft nproc 655350
* hard nproc 655350
* soft memlock unlimited
* hard memlock unlimited
EOF2.1.7 ipvs管理工具安装及模块加载 为集群节点安装负载均衡节点不用安装 yum -y install ipvsadm ipset sysstat conntrack libseccomp所有节点配置ipvs模块在内核4.19版本nf_conntrack_ipv4已经改为nf_conntrack 4.18以下使用nf_conntrack_ipv4即可 modprobe -- ip_vs
modprobe -- ip_vs_rr
modprobe -- ip_vs_wrr
modprobe -- ip_vs_sh
modprobe -- nf_conntrack 创建 /etc/modules-load.d/ipvs.conf 并加入以下内容
cat /etc/modules-load.d/ipvs.conf EOF
ip_vs
ip_vs_lc
ip_vs_wlc
ip_vs_rr
ip_vs_wrr
ip_vs_lblc
ip_vs_lblcr
ip_vs_dh
ip_vs_sh
ip_vs_fo
ip_vs_nq
ip_vs_sed
ip_vs_ftp
ip_vs_sh
nf_conntrack
ip_tables
ip_set
xt_set
ipt_set
ipt_rpfilter
ipt_REJECT
ipip
EOF设置为开机启动
systemctl enable --now systemd-modules-load.service如果执行开机启动失败了提示如下信息
Job for systemd-modules-load.service failed because the control process exited with error code. See systemctl status systemd-modules-load.service and journalctl -xe for details.Failed to find module ip_vs_fo具体原因是内核版本问题不过也可以将文件中的ip_vs_fo 去掉然后继续执行
2.1.8 Linux内核升级 在所有节点中安装,需要重新操作系统更换内核。 [rootlocalhost ~]# yum -y install perl[rootlocalhost ~]# rpm --import https://www.elrepo.org/RPM-GPG-KEY-elrepo.org[rootlocalhost ~]# yum -y install https://www.elrepo.org/elrepo-release-7.0-4.el7.elrepo.noarch.rpm
[rootlocalhost ~]# yum --enablerepoelrepo-kernel -y install kernel-ml.x86_64[rootlocalhost ~]# grub2-set-default 0[rootlocalhost ~]# grub2-mkconfig -o /boot/grub2/grub.cfg2.1.9 Linux内核优化
cat EOF /etc/sysctl.d/k8s.conf
net.ipv4.ip_forward 1
net.bridge.bridge-nf-call-iptables 1
net.bridge.bridge-nf-call-ip6tables 1
fs.may_detach_mounts 1
vm.overcommit_memory1
vm.panic_on_oom0
fs.inotify.max_user_watches89100
fs.file-max52706963
fs.nr_open52706963
net.netfilter.nf_conntrack_max2310720net.ipv4.tcp_keepalive_time 600
net.ipv4.tcp_keepalive_probes 3
net.ipv4.tcp_keepalive_intvl 15
net.ipv4.tcp_max_tw_buckets 36000
net.ipv4.tcp_tw_reuse 1
net.ipv4.tcp_max_orphans 327680
net.ipv4.tcp_orphan_retries 3
net.ipv4.tcp_syncookies 1
net.ipv4.tcp_max_syn_backlog 16384
net.ipv4.ip_conntrack_max 131072
net.ipv4.tcp_max_syn_backlog 16384
net.ipv4.tcp_timestamps 0
net.core.somaxconn 16384
EOFsysctl --system所有节点配置完内核后重启服务器保证重启后内核依旧加载
reboot -h now重启后查看结果
lsmod | grep --colorauto -e ip_vs -e nf_conntrack2.1.10 其它工具安装(选装)
yum install wget jq psmisc vim net-tools telnet yum-utils device-mapper-persistent-data lvm2 git lrzsz -y2.2 负载均衡器准备
2.2.1 安装haproxy与keepalived
在负载均衡两台服务器上安装
yum -y install haproxy keepalived2.2.2 HAProxy配置
cat /etc/haproxy/haproxy.cfgEOF
globalmaxconn 2000ulimit-n 16384log 127.0.0.1 local0 errstats timeout 30sdefaultslog globalmode httpoption httplogtimeout connect 5000timeout client 50000timeout server 50000timeout http-request 15stimeout http-keep-alive 15sfrontend monitor-inbind *:33305mode httpoption httplogmonitor-uri /monitorfrontend k8s-masterbind 0.0.0.0:6443bind 127.0.0.1:6443mode tcpoption tcplogtcp-request inspect-delay 5sdefault_backend k8s-masterbackend k8s-mastermode tcpoption tcplogoption tcp-checkbalance roundrobin #负载均衡策略default-server inter 10s downinter 5s rise 2 fall 2 slowstart 60s maxconn 250 maxqueue 256 weight 100server k8s-master1 192.168.10.103:6443 checkserver k8s-master2 192.168.10.104:6443 checkserver k8s-master3 192.168.10.105:6443 check
EOF2.2.3 KeepAlived 主从配置不一致需要注意。 KeepAlived主要是对haproxy进行监控
ha1:cat /etc/keepalived/keepalived.confEOF
! Configuration File for keepalived
global_defs {router_id LVS_DEVEL
script_user rootenable_script_security
}
vrrp_script chk_apiserver {script /etc/keepalived/check_apiserver.shinterval 5weight -5fall 2
rise 1
}
vrrp_instance VI_1 {state MASTER #指定主节点interface eth0 #网卡mcast_src_ip 192.168.10.101 #本机ipvirtual_router_id 51priority 100 #优先级advert_int 2authentication {auth_type PASSauth_pass K8SHA_KA_AUTH}virtual_ipaddress {192.168.10.100 #虚拟ip 主节点和备份节点一样的}track_script {chk_apiserver #通过脚本实现监控}
}
EOFha2:cat /etc/keepalived/keepalived.confEOF
! Configuration File for keepalived
global_defs {router_id LVS_DEVEL
script_user rootenable_script_security
}
vrrp_script chk_apiserver {script /etc/keepalived/check_apiserver.shinterval 5weight -5fall 2
rise 1
}
vrrp_instance VI_1 {state BACKUPinterface eth0mcast_src_ip 192.168.10.102virtual_router_id 51priority 99advert_int 2authentication {auth_type PASSauth_pass K8SHA_KA_AUTH}virtual_ipaddress {192.168.10.100}track_script {chk_apiserver}
}
EOF2.2.4 健康检查脚本 ha1及ha2均要配置相同 cat /etc/keepalived/check_apiserver.sh EOF
#!/bin/bash
err0 #定义变量
for k in $(seq 1 3)
docheck_code$(pgrep haproxy) #检查haproxy进程if [[ $check_code ]]; thenerr$(expr $err 1)sleep 1continueelseerr0breakfi
doneif [[ $err ! 0 ]]; thenecho systemctl stop keepalived/usr/bin/systemctl stop keepalivedexit 1
elseexit 0
fi
EOFchmod x /etc/keepalived/check_apiserver.sh2.2.5 启动服务并验证
systemctl daemon-reload
systemctl enable --now haproxy
systemctl enable --now keepalivedip address showss -anput | grep :6443http://192.168.10.101:33305/monitor
