Linux下安裝lvs和keeplived實(shí)現(xiàn)負(fù)載均衡

前言

在生產(chǎn)工作中,后端服務(wù)器并不可能永遠(yuǎn)都處于正常運(yùn)行狀態(tài),若服務(wù)器發(fā)生宕機(jī),為了不影響正在進(jìn)行的業(yè)務(wù)以及給用戶更好的體驗(yàn),我們可以通過keepalived監(jiān)控后臺服務(wù)器運(yùn)行情況,當(dāng)有服務(wù)器發(fā)生故障時,會從把該服務(wù)器剔除出lvs轉(zhuǎn)發(fā)策略;等到服務(wù)器恢復(fù)正常后,keepalived也會重新把該服務(wù)器加入LVS轉(zhuǎn)發(fā)策略中。

Linux下安裝lvs和keeplived實(shí)現(xiàn)負(fù)載均衡

系統(tǒng)介紹代碼語言:JavaScript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

虛擬VIP:192.168.1.231?ip地址:192.168.1.244  【mac地址:00:16:3E:98:07:E8 ,以下簡稱D1】?ip地址:192.168.1.233  【mac地址:00:16:3E:3B:60:AA,以下簡稱D1】?系統(tǒng): centos6
Linux下安裝lvs和keeplived實(shí)現(xiàn)負(fù)載均衡

安裝部署安裝keepalived代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

D1,D2服務(wù)器都要安裝keepalivedcd /data/software/rz 上傳文件keepalived-1.2.13.tar.gz# tar -zvxf keepalived-1.2.13.tar.gz # cd keepalived-1.2.13# ./configure --sysconf=/data/conf/ --prefix=/data/apps/keepalived/ ?# 如果報錯!!! ?OpenSSL is not properly installed on your system. !!! ?則執(zhí)行: ?# yum -y install openssl-devel

代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

makemake install?安裝完成ln -s /data/apps/keepalived/sbin/keepalived /sbin/keepalivedcp /home/data/conf/rc.d/init.d/keepalived  /etc/rc.d/init.d/cp /home/data/conf/sysconfig/keepalived /etc/sysconfig/mkdir /etc/keepalivedcp /home/data/conf/keepalived/keepalived.conf /data/conf/ln -s /data/conf/keepalived.conf  /etc/keepalived/keepalived.confrm -rf  /data/conf/keepalived /data/conf/rc.d /data/conf/sysconfig          echo "1" >/proc/sys/net/ipv4/ip_forward             # 開啟路由功能

安裝ipvs

D1,D2服務(wù)器都要安裝

檢查kernel是否已經(jīng)支持LVS的IPVS模塊

代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

modprobe -l | grep ipvs
Linux下安裝lvs和keeplived實(shí)現(xiàn)負(fù)載均衡

如果有類似上面的輸出則說明內(nèi)核已經(jīng)支持

安裝ipvs

代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

yum -y install ipvsadm?ipvsadm --help  (看到參數(shù)信息則說明安裝成功)
Linux下安裝lvs和keeplived實(shí)現(xiàn)負(fù)載均衡

防火墻規(guī)則代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

iptables -F -t mangle       # 清空mangle中的規(guī)則?iptables -t mangle -I PREROUTING -d 192.168.1.231 -p tcp -m tcp --dport 80 -m mac ! --mac-source 00:16:3E:3B:60:AA -j MARK --set-mark 1 【192.168.1.244服務(wù)器配置】?iptables -t mangle -I PREROUTING -d 192.168.1.231 -p tcp -m tcp --dport 80 -m mac ! --mac-source 00:16:3E:98:07:E8 -j MARK --set-mark 1 【192.168.1.233服務(wù)器配置】? ?# 目標(biāo)ip地址是192.168.1.231并且目標(biāo)端口為80的數(shù)據(jù)標(biāo)記為1(排除另外一臺lvs調(diào)度器 所以是排除另外一臺調(diào)度器的mac地址 兩臺lvs的set-mark 值不同 并且規(guī)則中都排除對端的mac地址)?service iptables save
Linux下安裝lvs和keeplived實(shí)現(xiàn)負(fù)載均衡

配置keepalived代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

vi /etc/keepalived/keepalived.conf ?修改配置信息參考:?192.168.1.244的配置:?! Configuration File for keepalived?global_defs {    notification_email {        linmaogan@gmail.com # 故障通知郵件地址,可以多個地址        liuxing007xing@163.com    }    notification_email_from linmaogan@163.com # 故障發(fā)送人    smtp_server smtp.163.com # 由163.com發(fā)送郵件    smtp_connect_timeout 30?    #運(yùn)行Keepalived服務(wù)器的一個標(biāo)識    #發(fā)郵件時顯示在郵件標(biāo)題中的信息    router_id LVS_BACKUP  #BACKUP上修改為LVS_BACKUP,網(wǎng)上資料說這個值也需要修改,具體不詳,之前我們線上的主備就一直是一樣的 ^ ^還是修改一下吧!}?# 監(jiān)測ipvsadm進(jìn)程狀態(tài),每3秒執(zhí)行一次vrrp_script chk_ipvsadm{    script "/data/conf/shell/chk_ipvsadm.sh"    interval 3    weight 3}?vrrp_instance VI_1 {    state MASTER    interface em1       【修改對應(yīng)的網(wǎng)卡或eth0】    virtual_router_id 51    priority 100    advert_int 1    authentication {        auth_type PASS        auth_pass PZFKD2wSUJ3swnPN    }    virtual_ipaddress {        192.168.1.231    }}?virtual_server fwmark 80 {    delay_loop 6    lb_algo wlc    lb_kind DR    persistence_timeout 1    nat_mask 255.255.255.0   #網(wǎng)絡(luò)掩碼    persistence_timeout 50     protocol TCP    real_server 192.168.1.244 80 {        weight 5        TCP_CHECK {            connect_timeout 3            nb_get_retry 3            delay_before_retry 3            connect_port 80                #健康檢查端口連接端口        }    }    real_server 192.168.1.233 80 {        weight 5        TCP_CHECK {            connect_timeout 3            nb_get_retry 3            delay_before_retry 3            connect_port 80                #健康檢查端口連接端口        }    }}

192.168.1.233的配置:

代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

! Configuration File for keepalived?global_defs {    notification_email {        linmaogan@gmail.com # 故障通知郵件地址,可以多個地址        liuxing007xing@163.com    }    notification_email_from linmaogan@163.com # 故障發(fā)送人    smtp_server smtp.163.com # 由163.com發(fā)送郵件    smtp_connect_timeout 30?    #運(yùn)行Keepalived服務(wù)器的一個標(biāo)識    #發(fā)郵件時顯示在郵件標(biāo)題中的信息    router_id LVS_BACKUP  #BACKUP上修改為LVS_BACKUP,網(wǎng)上資料說這個值也需要修改,具體不詳,之前我們線上的主備就一直是一樣的 ^ ^還是修改一下吧!}?# 監(jiān)測ipvsadm進(jìn)程狀態(tài),每3秒執(zhí)行一次vrrp_script chk_ipvsadm{    script "/data/conf/shell/chk_ipvsadm.sh"    interval 3    weight 3}?vrrp_instance VI_1 {    state BACKUP    interface em1           【修改對應(yīng)的網(wǎng)卡或eth0】    virtual_router_id 51    priority 80    advert_int 1    authentication {        auth_type PASS        auth_pass PZFKD2wSUJ3swnPN    }    virtual_ipaddress {        192.168.1.231    }}?virtual_server fwmark 80 {    delay_loop 6    lb_algo wlc    lb_kind DR    persistence_timeout 1    nat_mask 255.255.255.0   #網(wǎng)絡(luò)掩碼    persistence_timeout 50     protocol TCP    real_server 192.168.1.244 80 {        weight 5        TCP_CHECK {            connect_timeout 3            nb_get_retry 3            delay_before_retry 3            connect_port 80                #健康檢查端口連接端口        }    }    real_server 192.168.1.233 80 {        weight 5        TCP_CHECK {            connect_timeout 3            nb_get_retry 3            delay_before_retry 3            connect_port 80                #健康檢查端口連接端口        }    }}

D2上配值和D1基本相同只是state MASTER改成state BACKUP,priority 100 改成 priority 80

配置ipvs代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

vi /data/conf/shell/chk_ipvsadm.sh?插入配置信息#!/bin/bash# 定時查看ipvsadm是否存在,如果不存在則啟動ipvsadm,# 如果啟動失敗,則停止keepalivedstatus=$(ps aux|grep ipvsadm | grep -v grep | grep -v bash | wc -l)if [ "${status}" = "0" ]; then    service ipvsadm start    status2=$(ps aux|grep ipvsadm | grep -v grep | grep -v bash |wc -l)    if [ "${status2}" = "0"  ]; then    /etc/init.d/keepalived stop     fifi

Real_Server上的配置

在LVS的DR模式下,用戶的訪問請求到達(dá)Real Server 后,是直接返回給用戶的,不再經(jīng)過前端的Director Server,因此,需要在每個Real server節(jié)點(diǎn)上增加虛擬的VIP地址,這樣數(shù)據(jù)才能直接返回給用戶

代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

chmod 777 /etc/rc.d/init.d/functions ?vi /etc/init.d/lvsrs#!/bin/bash#把以下內(nèi)容保存成:lvsrs#并放置在/etc/init.d目錄下#如果想啟動LVS Server執(zhí)行:/etc/init.d/lvsrs start#如果想停止LVS Server執(zhí)行:/etc/init.d/lvsrs stopVIP=192.168.1.231  #虛擬IP,視具體情況而變. /etc/rc.d/init.d/functions   # 如果提示權(quán)限不夠,那么先在命令行執(zhí)行: chmod 777 /etc/rc.d/init.d/functions?case "$1" instart)    ifconfig lo:0 $VIP netmask 255.255.255.255 broadcast $VIP    /sbin/route add -host $VIP dev lo:0    echo "1" >/proc/sys/net/ipv4/conf/lo/arp_ignore    echo "2" >/proc/sys/net/ipv4/conf/lo/arp_announce    echo "1" >/proc/sys/net/ipv4/conf/all/arp_ignore    echo "2" >/proc/sys/net/ipv4/conf/all/arp_announce    sysctl -p >/dev/null 2>&1    echo "RealServer Start OK"    ;;stop)    ifconfig lo:0 down    route del $VIP >/dev/null 2>&1    echo "0" >/proc/sys/net/ipv4/conf/lo/arp_ignore    echo "0" >/proc/sys/net/ipv4/conf/lo/arp_announce    echo "0" >/proc/sys/net/ipv4/conf/all/arp_ignore    echo "0" >/proc/sys/net/ipv4/conf/all/arp_announce    echo "RealServer Stoped"    ;;    *)    echo "Usage: $0 {start|stop}"    exit 1esacexit 0

代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

chmod 755 /etc/init.d/lvsrs?service lvsrs start

管理lvs

以下D1,D2上都執(zhí)行

1)啟動lvs調(diào)度器

代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

service keepalived start                            # 開啟路由功能echo "1" >/proc/sys/net/ipv4/ip_forward

2) 關(guān)閉lvs調(diào)度器

代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

service keepalived stopecho "0" >/proc/sys/net/ipv4/ip_forward

添加開機(jī)啟動代碼語言:javascript代碼運(yùn)行次數(shù):0運(yùn)行復(fù)制

chkconfig --add keepalivedchkconfig keepalived on?vi /etc/rc.d/rc.local/etc/init.d/lvsrs start  # 添加這一行到末尾

ip a 查詢

Linux下安裝lvs和keeplived實(shí)現(xiàn)負(fù)載均衡

? 版權(quán)聲明
THE END
喜歡就支持一下吧
點(diǎn)贊11 分享