操作命令:
ceph osd getcrushmap -o map_old 导出map
crushtool -d map_old -o map_old.txt 转化成可编辑格式
crushtool -c map_new.txt -o map_new 还原为map
ceph osd setcrushmap -i map_new 将map导入ceph
更改Crush map流程:
1、修改配置文件,防止ceph自动更新crushmap
echo 'osd_crush_update_on_start = false' >> /etc/ceph/ceph.conf/etc/init.d/ceph restart
2、导出map,并转化成可编辑格式
ceph osd getcrushmap -o map_oldcrushtool -d map_old -o map_old.txtcp map_old.txt map_new.txt
3、更改map_new.txt
如:
##################sashost node1-sas { id -2 # do not change unnecessarily # weight 0.120 alg straw hash 0 # rjenkins1 item osd.0 weight 0.040 item osd.1 weight 0.040}host node2-sas { id -3 # do not change unnecessarily # weight 0.120 alg straw hash 0 # rjenkins1 item osd.3 weight 0.040 item osd.4 weight 0.040}##################ssdhost node1-ssd { id -5 # do not change unnecessarily # weight 0.120 alg straw hash 0 # rjenkins1 item osd.2 weight 0.040}host node2-ssd { id -6 # do not change unnecessarily # weight 0.120 alg straw hash 0 # rjenkins1 item osd.5 weight 0.040}#################poolroot sas-pool { id -1 # do not change unnecessarily # weight 0.360 alg straw hash 0 # rjenkins1 item node1-sas weight 0.080 item node2-sas weight 0.080}root ssd-pool { id -8 # do not change unnecessarily # weight 0.360 alg straw hash 0 # rjenkins1 item node1-ssd weight 0.040 item node2-ssd weight 0.040}##################rulerule sas { ruleset 0 type replicated min_size 1 max_size 10 step take sas-pool step choose firstn 0 type osd step emit}rule ssd { ruleset 1 type replicated min_size 1 max_size 10 step take ssd-pool step choose firstn 0 type osd step emit}
4、将修改后的crushmap编译并且注入集群中
crushtool -c map_new.txt -o map_newceph osd setcrushmap -i map_newceph osd tree
5、创建资源池,使用新创建的规则
ceph osd pool create sas 128 128ceph osd pool create ssd 128 128ceph osd pool set sas crush_ruleset 0ceph osd pool set ssd crush_ruleset 1
6、重新对pool授权(如果对接过openstack)
ceph auth del client.cinderceph auth get-or-create client.cinder mon 'allow r' osd 'allow class-read object_prefix rbd_children,allow rwx pool=volumes, \allow rwx pool=vms, allow rx pool=images, allow rwx pool=ssd'
更改Monitor IP流程:
1、获取monmap,并查看
ceph mon getmap -o map monmaptool --print map
2、删除旧的map配置,新增配置到map
monmaptool --rm node1 --rm node2 --rm node3 mapmonmaptool --add node1 10.0.2.21:6789 --add node2 10.0.2.22:6789 --add node3 10.0.2.23:6789 map monmaptool --print map
3、复制新map到所有mon节点
scp mon node2:~scp mon node3:~
4、更改/etc/ceph/ceph.conf中的mon_host(所有mon节点执行)
vim /etc/ceph/ceph.conf mon_host= new1_ip:6789,new2_ip:6789,new3_ip:6789:
5、停止mon进程(所有mon节点执行)
/etc/init.d/ceph stop mon
6、载入新的monmap(所有mon节点执行)
ceph-mon -i node1 --inject-monmap map
7、启动mon(所有mon节点执行)
/etc/init.d/ceph start mon
本文出自 “Just For Fun!” 博客,请务必保留此出处http://linuxnote.blog.51cto.com/9876511/1790758