53.MFS分布式文件系统

MFS分布式文件系统

MFS分布式文件系统是一个具有容错性的网络分布式文件系统，它把数据分散存放在多个物理服务器上，而呈现给用户的则是一个统一的资源。

MFS分布式操作系统搭建过程：

v 搭建master服务器

#iptables -F

#setenforce 0

#yum -y install zlib-devel

#useradd mfs -s  /sbin/nologin

#tar xzvf mfs-1.6.27-5.tar.gz

#cd mfs.1.6.27

#./configure –prefix=/usr/local/mfs –with-default-user=mfs –with-default-group=mfs –disable-mfschunkserver –disable-mfsmount

#make && make install

#cp /usr/local/mfs/etc/mfs/mfsmaster.cfg.dist  /usr/local/mfs/etc/mfs/mfsmaster.cfg

#cp /usr/local/mfs/etc/mfs/mfsexports.cfg.dist  /usr/local/mfs/etc/mfs/mfsexports.cfg

#cp /usr/local/mfs/etc/mfs/mfstopology.cfg.dist  /usr/local/mfs/etc/mfs/mfstopology.cfg

#cp /usr/local/mfs/var/mfs/metadata.mfs.empty  /usr/local/mfs/var/mfs/metadata.mfs

#ln -s /usr/local/mfs/sbin/mfsmaster /usr/local/sbin

#mfsmaster start

#netstat -lnupt |grep mfs

v 搭建metalogger服务器

#iptables -F

#setenforce 0

#yum -y install zlib-devel

#useradd mfs -s  /sbin/nologin

#tar xzvf mfs-1.6.27-5.tar.gz

#cd mfs.1.6.27

#./configure –prefix=/usr/local/mfs –with-default-user=mfs –with-default-group=mfs –disable-mfschunkserver  –disable-mfsmount

#make && make install

#cp /usr/local/mfs/etc/mfs/mfsmetapology.cfg.dist  /usr/local/mfs/etc/mfs/mfsmetapology.cfg

#vim /usr/local/mfs/etc/mfs/mfsmetapology.cfg

修改内容：

MASTER_HOST=1.1.1.1                  指定maser server的IP地址

#ln -s /usr/local/mfs/sbin/mfsmaster /usr/local/sbin

#mfsmetalogger -s

#mfsmetalogger start

#ps aux |grep mfs

v 搭建chunk服务器

#iptables -F

#setenforce 0

#yum -y install zlib-devel

#useradd mfs -s  /sbin/nologin

#tar xzvf mfs-1.6.27-5.tar.gz

#cd mfs.1.6.27

#./configure –prefix=/usr/local/mfs –with-default-user=mfs –with-default-group=mfs –disable-mfsmaster  –disable-mfsmount

#make && make install

#cp /usr/local/mfs/etc/mfs/mfstchunkserver.cfg.dist  /usr/local/mfs/etc/mfs/mfschunkserver.cfg

#cp /usr/local/mfs/etc/mfs/mfshdd.cfg.dist  /usr/local/mfs/etc/mfs/mfshdd.cfg

#vim /usr/local/mfs/etc/mfs/mfschunkserver.cfg

修改内容：

MASTER_HOST =1.1.1.1              指定master server的IP地址

/data                             给MFS一个分区

#mkdir /data

#chown -R mfs.mfs /data

#ps aux | grep mfs

v 客户端安装FUSE软件，安装MFS客户端

#iptables -F

#setenforce 0

#yum -y install zlib-devel

#tar xzvf fuse-2.9.2.tar.gz

#cd fuse.2.9.2

#./configure && make && make install

#echo ‘export  PKG_CONFIG_PATH=/usr/local/lib/pkgconfig:$PKG_CONFIG_PATH’  >>  /etc/profile

#source /etc/profile

#useradd mfs -s  /sbin/nologin

#tar xzvf mfs-1.6.27-5.tar.gz

#cd mfs.1.6.27

#./configure –prefix=/usr/local/mfs –with-default-user=mfs –with-default-group=mfs –disable-mfsmaster –disable-mfschunkserver  –disable-mfsmount

#make && make install

#ln -s /usr/local/mfs/bin/*    /usr/local/bin

#modprobe fuse

#mfsmount -H 1.1.1.1 /mnt

#df

MFS监控

#mfscgiserv

注：

通过浏览器访问http：//1.1.1.1：9245

Info显示MFS的基本信息

Servers列出现有的chunk server

Disks列出现有chunk server的硬盘信息

Exports列出可被挂载的目录

Mounts列出被挂载的目录

Operations显示正在执行的操作

Mater MFS服务器配置文件解析：mfsmaster.cfg是主配置文件，mfsexports.cfg是被挂载目录和权限目录。

mfsmaster.cfg文件内容：

#WORKING_USER = mfs                                          运行用户

# WORKING_GROUP = mfs                                        运行用户组

# SYSLOG_IDENT = mfsmaster                                     标识

# LOCK_MEMORY = 0                          是否执行mlocalall ，0表示避免进程溢出

# NICE_LEVEL = -19                                             运行的优先级

# EXPORTS_FILENAME = /usr/local/mfs/etc/mfs/mfsexports.cfg          被挂载和权限目录

# TOPOLOGY_FILENAME = /usr/local/mfs/etc/mfs/mfstopology.cfg       

# DATA_PATH = /usr/local/mfs/var/mfs                              数据存放路径

# BACK_LOGS = 50                                              改变的log文件数目

# BACK_META_KEEP_PREVIOUS = 1                                

# REPLICATIONS_DELAY_INIT = 300                                 延迟复制的时间

# REPLICATIONS_DELAY_DISCONNECT = 3600                 chunk服务器断开的复制延迟

# MATOML_LISTEN_HOST = *                           metalogger监听的IP地址

# MATOML_LISTEN_PORT = 9419                        metalogger监听的端口地址

# MATOML_LOG_PRESERVE_SECONDS = 600                  

# MATOCS_LISTEN_HOST = *                            chunk服务器连接的IP地址

# MATOCS_LISTEN_PORT = 9420                         chunk服务器连接的端口地址

# MATOCL_LISTEN_HOST = *                            用于客户端连接的IP地址

# MATOCL_LISTEN_PORT = 9421                         用于客户端连接的端口地址

# CHUNKS_LOOP_MAX_CPS = 100000

# CHUNKS_LOOP_MIN_TIME = 300                       chunks的回环频率

# CHUNKS_SOFT_DEL_LIMIT = 10

# CHUNKS_HARD_DEL_LIMIT = 25

# CHUNKS_WRITE_REP_LIMIT = 2                从客户端写入chunk服务器的最大连接数

# CHUNKS_READ_REP_LIMIT = 10                从chunk服务器读取内容的最大连接数

# ACCEPTABLE_DIFFERENCE = 0.1

# SESSION_SUSTAIN_TIME = 86400

# REJECT_OLD_CLIENTS = 0                     弹出低于1.6.0的客户端挂接

mfsexports.cfg文件内容：

# Allow everything but “meta”.

*                       /       rw,alldirs,maproot=0

# Allow “meta”.

*                       .       rw