問題還原:
最近的docker容器經常被kill掉,k8s中該節(jié)點的pod也被驅趕。
解決方法:
使用以下命令查看被kill的所有進程
dmesg?|?grep?-i?-B100?'killed?process'
查看到pod被驅趕的原因:
[3899860.525793]?Out?of?memory:?Kill?process?64058?(nvidia-device-p)?score?999?or?sacrifice?child [3899860.526961]?Killed?process?64058?(nvidia-device-p)?total-vm:126548kB,?anon-rss:2080kB,?file-rss:0kB,?shmem-rss:0kB
查看到docker容器被kill 的原因:
[3899859.737598]?Out?of?memory:?Kill?process?27562?(jupyter-noteboo)?score?1000?or?sacrifice?child [3899859.738640]?Killed?process?27562?(jupyter-noteboo)?total-vm:215864kB,?anon-rss:45928kB,?file-rss:0kB,?shmem-rss:0kB
查看內存使用情況
tilyp@tilyp:~$?free?-h ??????????????total????????used????????free??????shared??buff/cache???available Mem:???????????251G?????????96G????????114G????????2.5M?????????41G????????153G Swap:????????????0B??????????0B??????????0B
推薦教程:docker教程
? 版權聲明
文章版權歸作者所有,未經允許請勿轉載。
THE END
喜歡就支持一下吧
相關推薦