{"id":713,"date":"2013-03-16T03:31:49","date_gmt":"2013-03-16T01:31:49","guid":{"rendered":"http:\/\/www.koraykey.com\/?p=713"},"modified":"2013-07-01T20:01:20","modified_gmt":"2013-07-01T17:01:20","slug":"linux-isletim-sistemlerinde-multipath-yapilandirmasi","status":"publish","type":"post","link":"https:\/\/www.koraykey.com\/?p=713","title":{"rendered":"Linux \u0130\u015fletim Sistemlerinde Multipath Yap\u0131land\u0131rmas\u0131"},"content":{"rendered":"

\"Multipath\"<\/a><\/span><\/p>\n

Bu makalemizde Linux \u0130\u015fletim Sistemlerinde SAN ortamlar\u0131ndaki depolama \u00fcnitelerinde ba\u011flant\u0131 y\u00f6ntemi olan “Multipath” yap\u0131land\u0131rmas\u0131n\u0131 inceleyece\u011fiz.<\/span><\/p>\n

Multipath Nedir ?<\/strong><\/span><\/p>\n

Multipath SAN (Storage Area Network) ortamlar\u0131nda sunucular HBA (Host Bus Adaptor) kart\u0131, SAN switch, Storage controller gibi bile\u015fenlerden biri ar\u0131zalansa bile SAN disklere eri\u015fimin devam etmesini sa\u011flayan teknolojidir. Windows, Unix ve Linux ortamlar\u0131 i\u00e7in de\u011fi\u015fik \u00fcr\u00fcnler olmas\u0131na ra\u011fmen biz Linux ortamlar\u0131nda i\u015fletim sistemiyle birlikte gelen “device mapper multipath” \u00e7\u00f6z\u00fcm\u00fcn\u00fc inceleyece\u011fiz. \u00d6nce Sunucu (HBA) – SAN switch – SAN Storage \u015feklinde bir yap\u0131n\u0131z\u0131n ve bu yap\u0131 i\u00e7erisinde \u00e7oklu yollar\u0131n olmas\u0131 gerekir. Bununla kastetti\u011fim \u015fey birden \u00e7ok HBA, SAN swicth ve SAN storage controller \u00fcnitelerinin olmas\u0131. En az biri i\u00e7in bu olmal\u0131. Depolama y\u00f6neticisi (Storage Admin) size istedi\u011finiz diski SAN storage \u00fczerinden tahsis ederler. Bu a\u015famadan sonra art\u0131k bizim multipath’i sunucumuzun i\u015fletim sisteminde yap\u0131land\u0131rmam\u0131z gerekmektedir. Bu yap\u0131land\u0131rmalar her depolama \u00fcnitesi i\u00e7in birbirine \u00e7ok yak\u0131n yap\u0131land\u0131rmalard\u0131r. Biz \u00f6rnek olarak\u00a0Linux i\u015fletim sistemine ba\u011fl\u0131\u00a0NetAPP depolama sunucusu \u00fczerindeki yap\u0131land\u0131rmam\u0131z\u0131 uygulayaca\u011f\u0131z.<\/span><\/p>\n

1. \u00d6ncelikle sunucumuza gerekli olan multipath paketlerini kuraca\u011f\u0131z.<\/span><\/p>\n

# yum install device-mapper\r\nLoaded plugins: aliases, changelog, downloadonly, kabi, \r\npresto, refresh-packagekit, security, tmprepo, verify,\r\nLoading support for kernel ABI\r\nSetting up Install Process\r\nPackage device-mapper-1.02.77-9.el6.x86_64\r\nalready installed and latest version\r\nNothing to do\r\n\r\n# yum install device-mapper-multipath\r\nLoaded plugins: aliases, changelog, downloadonly, kabi, \r\npresto, refresh-packagekit, security, tmprepo, verify,\r\nLoading support for kernel ABI\r\nSetting up Install Process\r\nPackage device-mapper-multipath-0.4.9-64.0.1.el6.x86_64\r\nalready installed and latest version\r\nNothing to do\r\n\r\n-- Benim sunucumda daha \u00f6nce kurulu oldu\u011fu i\u00e7in bu uyar\u0131lar\u0131 veriyor.<\/span><\/pre>\n
2. \u0130htiyac\u0131m\u0131z olabilir d\u00fc\u015f\u00fcncesiyle “DevMapper” haricinde depolama \u00fcnitesi \u00fcreticisi taraf\u0131ndan \u00e7\u0131kar\u0131lm\u0131\u015f olan “Host Utility” paketini kuruyoruz. Biz \u00f6rnek kurulumuzu NetAPP depolama \u00fcnitesi \u00fczerinde yapt\u0131\u011f\u0131m\u0131z i\u00e7in i\u015fletim sistemimize uygun “Netapp Host Utility”<\/a>\u00a0paketini\u00a0 “NetAPP Support” hesab\u0131m\u0131zla indirip kuruyoruz.<\/span><\/p>\n
-- Paketimizi koydu\u011fumuz dizine ge\u00e7iyoruz.\r\n\r\n# cd \/u01\/orainstall\/netapp\/\r\n# ls\r\nnetapp_linux_host_utilities-6-1.x86_64.rpm\r\n\r\n-- Paketin kurulumunu yap\u0131yoruz.\r\n\r\n# rpm -i netapp_linux_host_utilities-6-1.x86_64.rpm\r\n\r\n-- Herhangi bir ba\u011f\u0131ml\u0131l\u0131k ihtiyac\u0131 veya sorun yoksa paketimiz kuruluyor.<\/span><\/pre>\n
3. Sunucumuz LUN ba\u011flant\u0131lar\u0131n\u0131 g\u00f6r\u00fcyormu kontrol ediyoruz.<\/span><\/p>\n
# sanlun lun show\r\n\r\n<\/span><\/span>controller:\tlun-pathname          \t\tdevice filename  adapter  protocol     lun size            lun state\r\nnetapp1:\t\/vol\/ASLDWH01\/dwh_DWH01_lun0  \t\/dev\/sde         host3    FCP          2t (2040130437120)  GOOD    <\/span><\/pre>\n
4. Sunucumuzun LUN ba\u011flant\u0131lar\u0131n\u0131n anl\u0131k durumunu listeleyelim.<\/span><\/p>\n
# sanlun lun show -p\r\nnetapp1\t:\t\/vol\/servervol\/serverlun (LUN 0) Lun state: GOOD\r\nLun Size:\t100g (107374182400) Controller_CF_State: Cluster Enabled\r\n\r\nProtocol: FCP Controller Partner: netapp2\r\nMultipath-provider: NONE<\/span><\/pre>\n
5. Multipath servisimizi ba\u015flatal\u0131m ve sunucumuz yeniden ba\u015flad\u0131\u011f\u0131nda otomatik a\u00e7\u0131lmas\u0131 i\u00e7in gerekli ayarlar\u0131 yapal\u0131m.<\/span><\/p>\n
# service multipathd start\r\nStarting multipathd daemon: [  OK  ]\r\n\r\n# chkconfig --add multipathd\r\n# chkconfig multipathd on<\/span><\/pre>\n
6. Multipath yap\u0131land\u0131rma dosyas\u0131na eklemek i\u00e7in disklerimizin “WWID” numaralar\u0131n\u0131 bulmal\u0131y\u0131z. \u015euan sunucumuz ka\u00e7 kanaldan diske gidiyorsa o kadar disk varm\u0131\u015f gibi g\u00f6r\u00fcyor multipath yap\u0131land\u0131rma ayarlar\u0131m\u0131zdan sonra bu diskleri tek diskmi\u015f gibi g\u00f6rece\u011fiz.<\/span><\/p>\n
-- Bunu anlamak i\u00e7in a\u015fa\u011f\u0131daki komutu \u00e7al\u0131\u015ft\u0131rd\u0131\u011f\u0131m\u0131zda \r\nayn\u0131 disk \u00fcnitesinden atanm\u0131\u015f olan disklerden birden\r\nfazla varm\u0131\u015f gibi g\u00f6rece\u011fiz.\r\n\r\n# fdisk -l\r\n\r\n-- Disklerimizin \"WWID\" numaralar\u0131n\u0131 bulabilmek i\u00e7in\r\n\r\n# multipath -v3\r\n\r\nveya\r\n\r\n# multipath -ll\r\ndisk1 (3600a0b800047683200001c3f4bfcc7f6)\r\n\r\nveya\r\n\r\n# cd \/dev\/disk\/by-path\r\n# ll\r\nscsi-3600a0b800047683200001c3f4bfcc7f6 -> ..\/..\/sde\r\n\r\n-- komutlar\u0131ndan istedi\u011fimizi \u00e7al\u0131\u015ft\u0131r\u0131yoruz.<\/span><\/pre>\n
7. \u015eimdi “\/etc\/multipath.conf” dosyam\u0131z\u0131 yap\u0131land\u0131rabiliriz. Burada dikkat edece\u011fimiz “Blacklist” dedi\u011fimiz sat\u0131rlara sistem disklerimizi yaz\u0131yoruz yani sunucumuzda bulunan bu SAN yap\u0131land\u0131rmas\u0131 ile alakas\u0131 olmayan diskler.\u00a0Bunlar sda vb. gibi i\u015fletim sisteminin kulland\u0131\u011f\u0131 diskler olabilir. Bunlar\u0131n hangileri oldu\u011funu tespit edip “blacklist” olarak a\u015fa\u011f\u0131daki \u00f6rne\u011fimizdeki gibi yaz\u0131yoruz.<\/span><\/p>\n
-- Multipath yap\u0131land\u0131rma dosyam\u0131z\u0131 a\u00e7\u0131yoruz.\r\n\r\n#vim \/etc\/multipath.conf\r\n\r\n-- A\u015fa\u011f\u0131daki sat\u0131rlar\u0131 kendi sunucumuza g\u00f6re yap\u0131land\u0131r\u0131p\r\ndosyam\u0131za yaz\u0131yoruz.\r\n\r\ndefaults\r\n{\r\nuser_friendly_names yes\r\nmax_fds max\r\nqueue_without_daemon no\r\n}\r\nblacklist {\r\n###devnode \u201c*\u201d\r\ndevnode \u201c^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*\u201d\r\ndevnode \u201c^sda\u201d\r\ndevnode \u201c^hd[a-z]\u201d\r\ndevnode \u201c^cciss!c[0-9]d[0-9]*\u201d # Note the cciss, usual in HP\r\n}\r\nmultipaths {\r\nmultipath {\r\nwwid  3600a0b800047683200001c3f4bfcc7f6  # \u00f6nceden buldu\u011funuz WWID\r\nalias asmdisk1 #  buradaki alias name size kalm\u0131\u015f. \r\n# server LUN on NETAPPFILER\r\n}\r\n}\r\ndevices\r\n{\r\ndevice\r\n{\r\nvendor \u201cNETAPP\u201d #Storage \u00fcreticimiz\r\nproduct \u201cLUN\u201d\r\ngetuid_callout \u201c\/sbin\/scsi_id -g -u -s \/block\/%n\u201d\r\nprio_callout \u201c\/sbin\/mpath_prio_ontap \/dev\/%n\u201d\r\nfeatures \u201c1 queue_if_no_path\u201d\r\nhardware_handler \u201c0\u2033\r\npath_grouping_policy group_by_prio\r\nfailback immediate\r\nrr_weight uniform\r\nrr_min_io 128\r\npath_checker directio\r\nflush_on_last_del yes\r\n}\r\n}<\/span><\/pre>\n
8. De\u011fi\u015fikliklerin uygulanabilmesi i\u00e7in “multipath” servisimizi yeniden ba\u015flat\u0131yoruz.<\/span><\/p>\n
# service multipathd restart\r\nok\r\nStopping multipathd daemon: [  OK  ]\r\nStarting multipathd daemon: [  OK  ]<\/span><\/pre>\n
9. Disklerimizin multipath yap\u0131land\u0131rmas\u0131n\u0131 kontrol edelim.<\/span><\/p>\n
# multipath -l \r\nnetapp (3600a0b800047683200001c3f4bfcc7f6) dm-2 NETAPP,LUN\r\n[size=100G][features=1 queue_if_no_path][hwhandler=0][rw]\r\n\\_ round-robin 0 [prio=0][active]\r\n\\_ 4:0:1:0 sdd 8:16 [active][undef]\r\n\\_ 5:0:1:0 sdd 8:48 [active][undef]\r\n\\_ 6:0:1:0 sdf 8:80 [active][undef]\r\n\r\n-- E\u011fer bu komutun \u00e7\u0131kt\u0131s\u0131n\u0131 g\u00f6remiyorsan\u0131z \u015funu deneyebilirsiniz.\r\n\r\n# vim \/etc\/lvm\/lvm.conf\r\n\r\n-- Dosyas\u0131na a\u015fa\u011f\u0131daki sat\u0131rlar\u0131 ekleyebilirsiniz.\r\nDosya biraz b\u00fcy\u00fck oldu\u011fu i\u00e7in VI edit\u00f6r\u00fc komut\r\nmodundayken \"shift+g\" tu\u015flar\u0131na ayn\u0131 anda basarak\r\nsayfa sonuna gidebilirsiniz.\r\n\r\nfilter = [ \"a\/mapper\/\", \"r\/.*\/\" ]\r\n\r\ntypes = [ \"device-mapper\", 1]\r\n\r\n-- Bu i\u015flemimiz sonras\u0131 de\u011fi\u015fikliklerin ge\u00e7erli olabilmesi i\u00e7in\r\nmultipath servisimizi yeniden ba\u015flat\u0131yoruz.\r\n\r\n# service multipathd restart\r\nok\r\nStopping multipathd daemon: [\u00a0 OK\u00a0 ]\r\nStarting multipathd daemon: [\u00a0 OK\u00a0 ]<\/span><\/pre>\n
11. \u0130stersek “Netapp Hosts Utility” arac\u0131 ile multipath durumunu kontrol edebiliriz.<\/span><\/p>\n
# sanlun lun show -p\r\n\r\nNETAPPFILER:\/vol\/servervol\/serverlun (LUN 0) Lun state: GOOD\r\nLun Size: 100g (107374182400) Controller_CF_State: Cluster Enabled\r\nProtocol: FCP Controller Partner: NETAPPFILER2\r\nDM-MP DevName: netapp (3600a0b800047683200001c3f4bfcc7f6) dm-2\r\nMultipath-provider: NATIVE<\/span><\/pre>\n
12. Art\u0131k birden fazlaym\u0131\u015f gibi g\u00f6rd\u00fc\u011f\u00fcm\u00fcz disklerimizin tek bir disk olarak g\u00f6r\u00fcnd\u00fc\u011f\u00fcn\u00fc sorgulayabiliriz.<\/span><\/p>\n
# fdisk -l\r\n\r\nKomutunu \u00e7al\u0131\u015ft\u0131rd\u0131\u011f\u0131m\u0131zda disklerimizin tek bir olarak listelendi\u011fini\r\ng\u00f6rece\u011fiz.<\/span><\/pre>\n
13. Olu\u015fan Lun yap\u0131land\u0131rmas\u0131na a\u015fa\u011f\u0131daki dizini listeleyerek ula\u015fabiliriz.<\/span><\/p>\n
# ls -l \/dev\/mapper\r\nbrw-rw\u2014- 1 root disk 253,  Dec 21 10:54 netapp<\/span> <\/span><\/pre>\n
14. Disklerimizi istersek formatlay\u0131p sonrada “\/” dizini alt\u0131na ba\u011flayarak kullanmaya ba\u015flayabiliriz. Bununla ilgili yap\u0131land\u0131rmay\u0131 daha \u00f6nce yay\u0131nlanm\u0131\u015f olan<\/a> makalemizdeki 3, 4, 5, 6 ve 7. ad\u0131mlar\u0131 uygulayarak yapabiliriz. Ancak disklerimizi “Oracle ASM” i\u00e7in kullanacaksak\u00a0 “UDEV”<\/a> veya “Oracle ASM Library”<\/a> ile yap\u0131land\u0131rmal\u0131y\u0131z.<\/span><\/p>\n
15. Yap\u0131land\u0131rmay\u0131 ve disklerimizi silmek i\u00e7inde a\u015fa\u011f\u0131daki komutu kullanabiliriz.<\/span><\/p>\n
# multipath -F<\/span><\/pre>\n
Linux \u0130\u015fletim Sistemlerinde “multipath” yap\u0131land\u0131rmam\u0131z\u0131 tamamlad\u0131k art\u0131k kullanabilir. <\/span>Burada uygulanan ad\u0131mlar Oracle Enterprise Linux 6.4 64 Bit \u00fczerinde denenmi\u015ftir. Ayn\u0131 zamanda di\u011fer Linux s\u00fcr\u00fcmleriyle uyumludur.<\/span><\/p>\n
Hp-Ux \u0130\u015fletim Sistemi kullananlar i\u00e7inde ufak bir hat\u0131rlatma yapal\u0131m. Multipath yap\u0131land\u0131rmas\u0131\u00a0 i\u00e7in “Hp-Ux 11.31” \u00f6ncesi\u00a0i\u015fletim sistemlerinde\u00a0“Secure Path” <\/a>\u00a0yaz\u0131l\u0131m\u0131n\u0131n kurulmas\u0131 gerekmektedir. Ancak Hp-Ux 11.31 i\u015fletim sisteminde bu paket entegre olarak geldi ve i\u015fletim sistemi kuruldu\u011funda otomatik y\u00fcklenmi\u015f oluyor bizim ayr\u0131ca bir y\u00fckleme yapmam\u0131za gerek kalm\u0131yor. Sadece kullanm\u0131\u015f oldu\u011fumuz depolama \u00fcnitesine g\u00f6re “host utility” gibi ara\u00e7lar kurulabilir.<\/span><\/p>\n
Ba\u015fka bir makalede g\u00f6r\u00fc\u015fmek \u00fczere\u2026<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"
Bu makalemizde Linux \u0130\u015fletim Sistemlerinde SAN ortamlar\u0131ndaki depolama \u00fcnitelerinde ba\u011flant\u0131 y\u00f6ntemi olan “Multipath” yap\u0131land\u0131rmas\u0131n\u0131 inceleyece\u011fiz. Multipath Nedir ? Multipath SAN (Storage Area Network) ortamlar\u0131nda sunucular HBA (Host Bus Adaptor) kart\u0131, SAN switch, Storage controller gibi bile\u015fenlerden biri ar\u0131zalansa bile SAN … Okumaya devam et →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[21,290,422,63,20,19,649,423,365,366,59,421,61],"class_list":["post-713","post","type-post","status-publish","format-standard","hentry","category-unix-linux","tag-h-koray-gunduz","tag-halil-koray-gunduz","tag-hp-secure-path","tag-hp-ux-secure-path","tag-koray-gunduz","tag-koraykey","tag-linux-multipath-ayarlari","tag-linux-multipath-nedir","tag-linux-storage","tag-linux-storage-ayarlari","tag-multipath","tag-multipath-nedir","tag-multipath-yapilandirmasi"],"_links":{"self":[{"href":"https:\/\/www.koraykey.com\/index.php?rest_route=\/wp\/v2\/posts\/713","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.koraykey.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.koraykey.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.koraykey.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.koraykey.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=713"}],"version-history":[{"count":0,"href":"https:\/\/www.koraykey.com\/index.php?rest_route=\/wp\/v2\/posts\/713\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.koraykey.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=713"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.koraykey.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=713"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.koraykey.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=713"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}