刀片服务器基本配置手册
V1.0
liuxyn@digitalchina.com
2011.8.25
UCS
目 录
0 UCS测试前准备工作 ...............................................................................................................1
确认现场是否具备测试环境 ................................................................................................... 1
电源环境 ........................................................................................................................... 1 网络环境 ........................................................................................................................... 1 设备拆箱所需工具 ........................................................................................................... 1 检查设备及相关配件 ............................................................................................................... 1 IP地址规划............................................................................................................................... 1 1 UCS Manager 密码重置 .........................................................................................................2 2 UCS Manager删除配置 ............................................................................................................6 3 UCS Manger 初始化配置 .........................................................................................................8 4 UCS Manager web 管理 ...........................................................................................................9 5 配置上联口(GLC-T)千兆上联到网络交换机 .................................................................... 12 6配置Server Port ..................................................................................................................... 14 7 配置管理IP 使用KVM,Vmedia ............................................................................................ 15 8 配置Profile 模板 .................................................................................................................. 15 9 根据profile模板生成profile................................................................................................ 15 10 profile 关联刀片 .................................................................................................................. 15 11 安装操作系统 ..................................................................................................................... 15 12 MDS 9124 系统恢复 ............................................................................................................ 15 13 MDS 9124 初始化配置 ........................................................................................................ 16
0 UCS测试前准备工作
确认现场是否具备测试环境 电源环境
5108 刀片机箱电源线为16A 插头,确认用户现场有16A插口的插线板 6120 功率 350W左右
5108 功率最大功率2500W ,实际功耗取决于刀片多少
网络环境
6120 接5108刀片机箱最少需要1个万兆口互联
6120 上联到网络交换机千兆连接需要GLC-T模块连到网络交换机的千兆电口,或使用一对GLC-SX-MM模块+光纤跳线连到网络交换机的千兆SFP接口
6120 上联到SAN交换机 需要4Gb的SFP模块 和光纤跳线(如果刀片上没有配硬盘、或需要和存储互联做相关测试,需要有MDS9124或其他厂商的SAN交换机)
设备拆箱所需工具
美工刀、平口螺丝刀、十字螺丝刀、老虎钳
检查设备及相关配件
电源线(10A/16A)
模块(GLC-T或GLC-SX-MM),4Gb FC模块 网线、光纤跳线
IP地址规划
UCS6120 管理口IP地址
MDS9124 管理地址
存储设备 管理地址
1
刀片KVM管理地址 服务器操作系统IP地址 其他应用或业务IP地址 如果UCS测试设备要和用户现有网络互联,找用户相关负责人要IP地址段 如果UCS测试设备不需要和用户现有网络互联,以上所有地址建议在一个网段,这样做最简单 1 UCS Manager 密码重置 UCS B系列测试机全国各地巡演,有的设备是是DC自有的,也有的是借的其他代理商的,往往问不到设备的密码,自力更生,还是重置密码最快 6120没有电源开关,直接拔掉电源线关机(console线、超级终端准备就绪),再插上电源线 按ctrl+shift+r 多按几次 屏幕出现 User break with default console settings Loader Version pr-1.3 loader> 查看系统里面的IOS文件 loader> dir bootflash: lost+found ucs-6100-k9-kickstart.4.1.3.N2.1.3c.bin ucs-6100-k9-system.4.1.3.N2.1.3c.bin sysdebug chassis.img nuova-sim-mgmt-nsg.0.1.0.001.bin pnuos installables mts.log vdc_2 vdc_3 vdc_4 loader> boot ucs-6100-k9-kickstart.4.1.3.N2.1.3c.bin Booting kickstart image: ucs-6100-k9-kickstart.4.1.3.N2.1.3c.bin.... ....................................................................Image verif 2 批注 [liuxinyu1]: 用kickstart文件启动系统 ication OK Starting kernel... Usage: init 0123456SsQqAaBbCcUu INIT: version 2.85 booting Starting Nexus5010 POST... Executing Mod 1 1 SEEPROM Test......done Executing Mod 1 1 GigE Port Test.......done Executing Mod 1 1 Inband GigE Test.....done Executing Mod 1 1 NVRAM Test....done Executing Mod 1 1 PCIE Test..............................done Mod 1 1 Post Completed Successfully Mod 2 Post Completed Successfully POST is completed Creating /callhome.. Mounting /callhome.. Creating /callhome done. Callhome spool file system init done. Checking all filesystems....r.r done. Checking NVRAM block device ... done The startup-config won't be used until the next reboot. . Loading system software INIT: Sending processes the KILL signalkernel daemon...don Cisco Nexus Operating System (NX-OS) Software TAC support: http://www.cisco.com/tac Copyright (c) 2002-2010, Cisco Systems, Inc. All rights reserved. The copyrights to certain works contained in this software are owned by other third parties and used and distributed under license. Certain components of this software are licensed under the GNU General Public License (GPL) version 2.0 or the GNU Lesser General Public License (LGPL) Version 2.1. A copy of each such license is available at http://www.opensource.org/licenses/gpl-2.0.php and http://www.opensource.org/licenses/lgpl-2.1.php switch(boot)# config t switch(boot)(config)# admin-password cisco.123 switch(boot)(config)# exit switch(boot)# dir 18261815 Mar 30 2011 04:19:25 chassis.img 4096 Jan 13 2011 03:18:28 distributables/ 104 Mar 17 2011 08:21:54 initial_setup.log 4096 Jan 13 2011 03:06:52 installables/ 49152 Jan 13 2011 03:20:08 lost+found/ 3 批注 [liuxinyu2]: 进入配置模式 批注 [liuxinyu3]: 重置密码 批注 [liuxinyu4]: 查看IOS 3038 Mar 30 2011 04:19:33 mts.log 115468140 Jan 13 2011 03:03:00 nuova-sim-mgmt-nsg.0.1.0.001.bin 4096 Mar 30 2011 04:19:26 pnuos/ 4096 Mar 30 2011 04:19:26 sysdebug/ 20998656 Jan 13 2011 03:01:45 ucs-6100-k9-kickstart.4.1.3.N2.1.3c.bin 157619246 Jan 13 2011 03:02:26 ucs-6100-k9-system.4.1.3.N2.1.3c.bin 4096 Jan 13 2011 03:07:16 vdc_2/ 4096 Jan 13 2011 03:07:16 vdc_3/ 4096 Jan 13 2011 03:07:16 vdc_4/ Usage for bootflash: filesystem 1411239936 bytes total used 7801516032 bytes free 9212755968 bytes available switch(boot)# load ucs-6100-k9-system.4.1.3.N2.1.3c.bin Uncompressing system image: bootflash:/ucs-6100-k9-system.4.1.3.N2.1.3c.bin Loading plugin 0: core_plugin... plugin_link_to_exec_path: plugin_path = /isan/plugin/0, tar_log = /isan/plugin_extract_log/0 Loading plugin 1: eth_plugin... plugin_link_to_exec_path: plugin_path = /isan/plugin/1, tar_log = /isan/plugin_extract_log/1 plugin_file_is_excluded_from_exec_path: /boot/ is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/ is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so.0.0.0 is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so.0 is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/etc/ is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/etc/plugin_exclude.conf is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/ is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/ is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so.0.0.0 is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so.0 is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/etc/ is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/etc/plugin_exclude.conf is excluded from linking Loading plugin 2: fc_plugin... plugin_link_to_exec_path: plugin_path = /isan/plugin/2, tar_log = /isan/plugin_extract_log/2 plugin_file_is_excluded_from_exec_path: /boot/ is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/ is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so.0.0.0 is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so.0 is excluded from linking 4 批注 [liuxinyu5]: 加载系统IOS,启动6120 plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/etc/ is excluded from linking
plugin_file_is_excluded_from_exec_path: /boot/etc/plugin_exclude.conf is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/ is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/ is excluded from linking
plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so.0.0.0 is excluded from linking
plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so.0 is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/lib/libplugin_sysreg.so is excluded from linking plugin_file_is_excluded_from_exec_path: /boot/etc/ is excluded from linking
plugin_file_is_excluded_from_exec_path: /boot/etc/plugin_exclude.conf is excluded from linking 145680+1 records in 145680+1 records out
ethernet end-host mode on CA FC end-host mode on CA n_port virtualizer mode.
--------------------------------------------------------------- ln: `/isan/etc/sysmgr.d//fcfwd.conf': File exists ethernet end-host mode INIT: Switching to runlevel: 3
INIT: Sending processes the TERM signal INIT: (boot)#
Exporting directories for NFS kernel daemon...done. Starting NFS kernel daemon:rpc.nfsd. rpc.mountddone.
Set name-type for VLAN subsystem. Should be visible in /proc/net/vlan/config Added VLAN with VID == 4042 to IF -:muxif:- --------------------- enabled fc feature ---------------------
2011 Mar 30 04:30:33 %$ VDC-1 %$ %KERN-2-SYSTEM_MSG: Starting kernel... - kernel Executing Port Power On Tests.......System is coming up ... Please wait ... System is coming up ... Please wait ... .System is coming up ... Please wait ... .System is coming up ... Please wait ... .System is coming up ... Please wait ... .System is coming up ... Please wait ... .System is coming up ... Please wait ... Done
System is coming up ... Please wait ... System is coming up ... Please wait ... System is coming up ... Please wait ... System is coming up ... Please wait ...
5
System is coming up ... Please wait ...
2011 Mar 30 04:32:44 %$ VDC-1 %$ %VDC_MGR-2-VDC_ONLINE: vdc 1 has come online
Cisco UCS 6100 Series Fabric Interconnect Switchi-A-A login: admin Password:
Cisco UCS 6100 Series Fabric Interconnect
TAC support: http://www.cisco.com/tac
Copyright (c) 2009, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained herein are owned by other third parties and are used and distributed under license. Some parts of this software may be covered under the GNU Public License or the GNU Lesser General Public License. A copy of each such license is available at
http://www.gnu.org/licenses/gpl.html and http://www.gnu.org/licenses/lgpl.html
2 UCS Manager删除配置
清掉UCS配置信息,一切重头开始 Cisco UCS 6100 Series Fabric Interconnect Switchi-A-A login: admin Password:
Cisco UCS 6100 Series Fabric Interconnect
TAC support: http://www.cisco.com/tac
Copyright (c) 2009, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained herein are owned by other third parties and are used and distributed under license. Some parts of this software may be covered under the GNU Public License or the GNU Lesser General Public License. A copy of each such license is available at
http://www.gnu.org/licenses/gpl.html and http://www.gnu.org/licenses/lgpl.html
6
Switchi-A-A# connect local-mgmt Cisco UCS 6100 Series Fabric Interconnect TAC support: http://www.cisco.com/tac Copyright (c) 2009, Cisco Systems, Inc. All rights reserved. The copyrights to certain works contained herein are owned by other third parties and are used and distributed under license. Some parts of this software may be covered under the GNU Public License or the GNU Lesser General Public License. A copy of each such license is available at http://www.gnu.org/licenses/gpl.html and http://www.gnu.org/licenses/lgpl.html Switchi-A-A(local-mgmt)# erase configuration All UCS configurations will be erased and system will reboot. Are you sure? (yes/no): yes Removing all the configuration. Please wait.... Configurations are cleaned up. Rebooting.... writing reset reason 9, Broadcast message from root (ttyS0) (Wed Mar 30 04:39:09 2011): INIT: Sending processes the TERM signal Mar 30 04:39:09 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service \"licmgr\" (PID 2977) is forced exit. Mar 30 04:39:09 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service \"Security Daemon\" (PID 3050) is forced eMar 30 04:39:09 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service \"vshd\" (PID 2972) is forced exit. Mar 30 04:39:09 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service \"vlan_mgr\" (PID 3073) is forced exit. Mar 30 04:39:09 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service \"smm\" (PID 2973) is forced exit. Mar 30 04:39:09 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service \"res_mgr\" (PID 3024) is forced exit. Mar 30 04:39:09 %LIBSYSMGR-3-SIGTERM_FORCE_EXIT Service \"l3vm\" (PID 3055) is forced exit. 批注 [liuxinyu6]: 进入UCS本地管理配置界面 批注 [liuxinyu7]: 清除配置 批注 [liuxinyu8]: 确认 7 3 UCS Manger 初始化配置 ---- Basic System Configuration Dialog ---- This setup utility will guide you through the basic configuration of the system. Only minimal configuration including IP connectivity to the Fabric interconnect and its clustering mode is performed through these steps. Type Ctrl-C at any time to abort configuration and reboot system. To back track or make modifications to already entered values, complete input till end of section and answer no when prompted to apply configuration. Enter the configuration method. (console/gui) ? console Enter the setup mode; setup newly or restore from backup. (setup/restore) ? setup You have chosen to setup a new Fabric interconnect. Continue? (y/n): y Enter the password for \"admin\": Confirm the password for \"admin\": Is this Fabric interconnect part of a cluster(select 'no' for standalone)? (yes/no) [n]: no Fabric interconnect will be in stand alone mode Enter the system name: Fab-SW-A Physical Switch Mgmt0 IPv4 address : 10.192.36.50 Physical Switch Mgmt0 IPv4 netmask : 255.255.255.0 IPv4 address of the default gateway : 10.192.36.1 Configure the DNS Server IPv4 address? (yes/no) [n]: n Configure the default domain name? (yes/no) [n]: n Following configurations will be applied: Switch Fabric=A System Name=Fab-SW-A 8 批注 [liuxinyu9]: 配置方式选console 批注 [liuxinyu10]: 设置模式选,setup 批注 [liuxinyu11]: yes 批注 [liuxinyu12]: 设置管理员admin的登录密码 批注 [liuxinyu13]: 配置主机名 批注 [liuxinyu14]: 配置管理IP信息 批注 [liuxinyu15]: Physical Switch Mgmt0 IP Address=10.192.36.50 Physical Switch Mgmt0 IP Netmask=255.255.255.0 Default Gateway=10.192.36.1 Apply and save the configuration (select 'no' if you want to re-enter)? (yes/no): yes Applying configuration. Please wait. Configuration file - Ok Cisco UCS 6100 Series Fabric Interconnect Fab-SW-A-A login: admin Password: Cisco UCS 6100 Series Fabric Interconnect TAC support: http://www.cisco.com/tac Copyright (c) 2009, Cisco Systems, Inc. All rights reserved. The copyrights to certain works contained herein are owned by other third parties and are used and distributed under license. Some parts of this software may be covered under the GNU Public License or the GNU Lesser General Public License. A copy of each such license is available at http://www.gnu.org/licenses/gpl.html and http://www.gnu.org/licenses/lgpl.html Fab-SW-A-A# 4 UCS Manager web 管理 https://10.192.36.50/ 9 批注 [liuxinyu16]: 保存配置 批注 [liuxinyu17]: UCSmanager图形界面需要java环境,运行前请装好java 10
11
5 配置上联口(GLC-T)千兆上联到网络交换机 批注 [liuxinyu18]: 定义与网络交换机互联的接口为uplink口 12 批注 [liuxinyu19]: 接口默认启用的万兆,改为千兆 13
6配置Server Port
6-11 请参考《UCS系统部署技术手册ver6》,《UCS_Vmware测试模板v07-1》
14
7 配置管理IP 使用KVM,Vmedia 8 配置Profile 模板 9 根据profile模板生成profile 10 profile 关联刀片 11 安装操作系统 12 MDS 9124 系统恢复 MDS9124无法正常启动进入loader界面,可以通过TFTP upload IOS恢复 Network --ip =192.168.1.2 Network --nm=255.255.255.0 Network --gw=192.168.1.1 Boot tftp://192.168.1.10/ m9100-s2ek9-kickstart-mz.4.2.3a.bin switch(boot)# dir 12288 Apr 06 2011 22:04:12 lost+found/ Usage for bootflash: filesystem 4226048 bytes total used 147681280 bytes free 160177152 bytes available switch(boot)(config)# int mgmt 0 switch(boot)(config-if)# ip add 192.168.1.2 255.255.255.0 switch(boot)(config-if)#no shut switch(boot)#copy tftp://192.168.1.1/ m9100-s2ek9-kickstart-mz.4.2.3a.bin bootflash: 15 批注 [liuxinyu20]: 配置管理口IP信息 批注 [liuxinyu21]: 从TFTP的kickstart文件启动 批注 [liuxinyu22]: 进入boot界面后,再配置管理IP信息 switch(boot)#copy tftp://192.168.1.1/ m9100-s2ek9-mz.4.2.3a.bin bootflash: switch(boot)# dir 12288 Apr 06 2011 22:04:12 lost+found/ 18704896 Aug 14 2011 22:04:58 m9100-s2ek9-kickstart-mz.4.2.3a.bin 52770824 Aug 14 2011 22:06:29 m9100-s2ek9-mz.4.2.3a.bin Usage for bootflash: filesystem 75985920 bytes total used 75921408 bytes free 160177152 bytes available switch(boot)# load bootflash:m9100-s2ek9-mz.4.2.3a.bin Uncompressing system image: bootflash:/m9100-s2ek9-mz.4.2.3a.bin CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC INIT: Switching to runlevel: 3 INIT: Sending processes the TERM signal INItch(boot)# Starting NFS servers: nfsd mountd. 批注 [liuxinyu23]: 把IOS上传到bootflash 批注 [liuxinyu24]: 加载IOS,启动系统 13 MDS 9124 初始化配置 Enter the password for \"admin\": Confirm the password for \"admin\": ---- Basic System Configuration Dialog ---- This setup utility will guide you through the basic configuration of the system. Setup configures only enough connectivity for management of the system. Please register Cisco MDS 9000 Family devices promptly with your supplier. Failure to register may affect response times for initial service calls. MDS devices must be registered to receive entitled support services. Press Enter at anytime to skip a dialog. Use ctrl-c at anytime 16 to skip the remaining dialogs.
Would you like to enter the basic configuration dialog (yes/no): yes
Create another login account (yes/no) [n]: n
Configure read-only SNMP community string (yes/no) [n]: n
Configure read-write SNMP community string (yes/no) [n]: y
SNMP community string : cisco
Enter the switch name : MDS9124-A
Continue with Out-of-band (mgmt0) management configuration? (yes/no) [y]: Y
Mgmt0 IPv4 address : 192.168.1.2
Mgmt0 IPv4 netmask : 255.255.255.0
Configure the default gateway? (yes/no) [y]: y
IPv4 address of the default gateway : 192.168.1.254
Configure advanced IP options? (yes/no) [n]: n
Enable the ssh service? (yes/no) [y]: y
Type of ssh key you would like to generate (dsa/rsa) [rsa]:
Number of rsa key bits <768-2048> [1024]:
Enable the telnet service? (yes/no) [n]: yes
Enable the http-server? (yes/no) [y]: y
Configure clock? (yes/no) [n]: y
Clock config format [HH:MM:SS Day Mon YYYY] :
Enter clock config :14:20:40 15 August 2011
17
Configure timezone? (yes/no) [n]: yes
Enter timezone config :UTC 8
Configure summertime? (yes/no) [n]: N
Configure the ntp server? (yes/no) [n]: n
Configure default switchport interface state (shut/noshut) [shut]: noshut
Configure default switchport trunk mode (on/off/auto) [on]:
Configure default switchport port mode F (yes/no) [n]: Y
Configure default zone policy (permit/deny) [deny]: permit
Enable full zoneset distribution? (yes/no) [n]: y
Configure default zone mode (basic/enhanced) [basic]:
The following configuration will be applied: password strength-check
snmp-server community cisco rw switchname MDS9124-A interface mgmt0
ip address 192.168.1.2 255.255.255.0 no shutdown
ip default-gateway 192.168.1.254 ssh key rsa 1024 force feature ssh feature telnet
feature http-server
clock set 14:20:40 15 August 2011 clock timezone UTC 8
no system default switchport shutdown system default switchport trunk mode on system default switchport mode F
system default zone default-zone permit system default zone distribute full
no system default zone mode enhanced
Would you like to edit the configuration? (yes/no) [n]: n
18
Use this configuration and save it? (yes/no) [y]: y
Error: There was an error executing at least one of the commands Please verify the following log for the command execution errors. Disabling ssh: as its enabled right now: deleting old rsa key.....
generating rsa key(1024 bits)..... .
generated rsa key
Enabling ssh: as it has been disabled Mon Aug 15 14:20:40 UTC 2011
Syntax error while parsing 'clock timezone UTC 8'
Would you like to save the running-config to startup-config? (yes/no) [n]: y
[########################################] 100%
User Access Verification MDS9124-A login: admin Password:
Cisco Nexus Operating System (NX-OS) Software TAC support: http://www.cisco.com/tac
Copyright (c) 2002-2009, Cisco Systems, Inc. All rights reserved. The copyrights to certain works contained in this software are owned by other third parties and used and distributed under license. Certain components of this software are licensed under the GNU General Public License (GPL) version 2.0 or the GNU Lesser General Public License (LGPL) Version 2.1. A copy of each such license is available at
http://www.opensource.org/licenses/gpl-2.0.php and http://www.opensource.org/licenses/lgpl-2.1.php
19
因篇幅问题不能全部显示,请点此查看更多更全内容