配置Exadata上的万兆模块和测试万兆

下面的是一个例子：

例如，电口的eth0（用于连接内置的Cisco）：

[root@dm01db02 ~]# ethtool eth0 Settings for eth0:         Supported ports: [ TP ]         Supported link modes:   100baseT/Full           1000baseT/Full           10000baseT/Full          Supported pause frame use: No         Supports auto-negotiation: Yes         Advertised link modes:  100baseT/Full           1000baseT/Full           10000baseT/Full          Advertised pause frame use: No         Advertised auto-negotiation: Yes         Speed: 1000Mb/s         Duplex: Full         Port: Twisted Pair         PHYAD: 0         Transceiver: external         Auto-negotiation: on         MDI-X: Unknown         Supports Wake-on: d         Wake-on: d         Current message level: 0x00000007 (7)         drv probe link         Link detected: yes [root@dm01db02 ~]# 

连接了万兆的eth4：

[root@dm01db01 ~]# ethtool eth4 Settings for eth4:  Supported ports: [ FIBRE ]  Supported link modes:   10000baseT/Full   Supported pause frame use: No  Supports auto-negotiation: No  Advertised link modes:  10000baseT/Full   Advertised pause frame use: No  Advertised auto-negotiation: No  Speed: 10000Mb/s   ------------这里显示为万兆  Duplex: Full   -----------全双工  Port: Other  PHYAD: 0  Transceiver: external  Auto-negotiation: off  Supports Wake-on: d  Wake-on: d  Current message level: 0x00000007 (7)           drv probe link  Link detected: yes   [root@dm01db01 ~]# 

然后设置一下IP，按照linux上绑定网卡的方法将eth4和eth5绑定即可。

万兆配置好了，测试了一下万兆的效率（还没时间做测试跨机房）：下载了iperf安装在exadata上：

[root@dm01db01 tmp]# mkdir lunar [root@dm01db01 tmp]# mv iperf-3.0.tar.gz lunar/ [root@dm01db01 tmp]# cd lunar/ [root@dm01db01 lunar]# ls iperf-3.0.tar.gz [root@dm01db01 lunar]# tar zxvf iperf-3.0.tar.gz  。。。。 [root@dm01db01 lunar]# cd iperf [root@dm01db01 iperf]# ./configure checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a thread-safe mkdir -p... /bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking build system type... x86_64-unknown-linux-gnu checking host system type... x86_64-unknown-linux-gnu checking for gcc... gcc checking for C compiler default output file name... a.out .................. checking whether to build shared libraries... yes checking whether to build static libraries... yes checking for ANSI C header files... (cached) yes checking for library containing nanosleep... none required checking for library containing hstrerror... none required checking for an ANSI C-conforming const... yes configure: creating ./config.status config.status: creating Makefile config.status: creating src/Makefile config.status: creating src/config.h config.status: src/config.h is unchanged config.status: executing depfiles commands config.status: executing libtool commands [root@dm01db01 iperf]# make && make install Making all in src make[1]: Entering directory `/tmp/lunar/iperf/src' make  all-am make[2]: Entering directory `/tmp/lunar/iperf/src' gcc -DHAVE_CONFIG_H -I.     -g -O2 -MT cjson.o -MD -MP -MF .deps/cjson.Tpo -c -o cjson.o cjson.c mv -f .deps/cjson.Tpo .deps/cjson.Po gcc -DHAVE_CONFIG_H -I.     -g -O2 -MT iperf_api.o -MD -MP -MF .deps/iperf_api.Tpo -c -o iperf_api.o iperf_api.c mv -f .deps/iperf_api.Tpo .deps/iperf_api.Po gcc -DHAVE_CONFIG_H -I.     -g -O2 -MT iperf_error.o -MD -MP -MF .deps/iperf_error.Tpo -c -o iperf_error.o iperf_error.c mv -f .deps/iperf_error.Tpo .deps/iperf_error.Po gcc -DHAVE_CONFIG_H -I.     -g -O2 -MT iperf_client_api.o -MD -MP -MF .deps/iperf_client_api.Tpo -c -o iperf_client_api.o iperf_client_api.c 。。。。。。。。。。。。。。。。  /usr/bin/install -c -m 644 'iperf_api.h' '/usr/local/include/iperf_api.h' test -z "/usr/local/share/man/man1" || /bin/mkdir -p "/usr/local/share/man/man1"  /usr/bin/install -c -m 644 './iperf3.1' '/usr/local/share/man/man1/iperf3.1' test -z "/usr/local/share/man/man3" || /bin/mkdir -p "/usr/local/share/man/man3"  /usr/bin/install -c -m 644 './libiperf.3' '/usr/local/share/man/man3/libiperf.3' make[2]: Leaving directory `/tmp/lunar/iperf/src' make[1]: Leaving directory `/tmp/lunar/iperf/src' make[1]: Entering directory `/tmp/lunar/iperf' make[2]: Entering directory `/tmp/lunar/iperf' make[2]: Nothing to be done for `install-exec-am'. make[2]: Nothing to be done for `install-data-am'. make[2]: Leaving directory `/tmp/lunar/iperf' make[1]: Leaving directory `/tmp/lunar/iperf' [root@dm01db01 iperf]# which iperf3 /usr/local/bin/iperf3 [root@dm01db01 iperf]#

测试了一下，每秒基本上可以达到7Gb(大概7Gb/8≈700MB/s)：

[root@dm01db01 modprobe.d]# iperf3 -c 10.10.10.12 -n 30G  Connecting to host 10.10.10.12, port 5201 [  4] local 10.10.10.11 port 42491 connected to 10.10.10.12 port 5201 [ ID] Interval           Transfer     Bandwidth       Retransmits [  4]   0.00-1.00   sec   619 MBytes  5.19 Gbits/sec   16          [  4]   1.00-2.00   sec   696 MBytes  5.84 Gbits/sec   17          [  4]   2.00-3.00   sec   680 MBytes  5.70 Gbits/sec   12          [  4]   3.00-4.00   sec   746 MBytes  6.26 Gbits/sec    8          [  4]   4.00-5.00   sec   741 MBytes  6.22 Gbits/sec    9          [  4]   5.00-6.00   sec   750 MBytes  6.29 Gbits/sec    9          [  4]   6.00-7.00   sec   783 MBytes  6.57 Gbits/sec    6          [  4]   7.00-8.00   sec   838 MBytes  7.03 Gbits/sec    4          [  4]   8.00-9.00   sec   838 MBytes  7.03 Gbits/sec    8          [  4]   9.00-10.00  sec   838 MBytes  7.03 Gbits/sec    3          [  4]  10.00-11.00  sec   827 MBytes  6.94 Gbits/sec    5          [  4]  11.00-12.00  sec   898 MBytes  7.53 Gbits/sec    6          [  4]  12.00-13.00  sec   905 MBytes  7.59 Gbits/sec    2          [  4]  13.00-14.00  sec  1.01 GBytes  8.71 Gbits/sec    0          [  4]  14.00-15.00  sec   967 MBytes  8.11 Gbits/sec    6          [  4]  15.00-16.00  sec   933 MBytes  7.83 Gbits/sec    0          [  4]  16.00-17.00  sec  1.01 GBytes  8.65 Gbits/sec    1          [  4]  17.00-18.00  sec   913 MBytes  7.66 Gbits/sec    2          [  4]  18.00-19.00  sec  1018 MBytes  8.54 Gbits/sec    1          [  4]  19.00-20.00  sec   928 MBytes  7.79 Gbits/sec    1          [  4]  20.00-21.00  sec  1.01 GBytes  8.66 Gbits/sec    2          [  4]  21.00-22.00  sec  1.03 GBytes  8.81 Gbits/sec    0          [  4]  22.00-23.00  sec  1.02 GBytes  8.73 Gbits/sec    3          [  4]  23.00-24.00  sec  1.03 GBytes  8.82 Gbits/sec    0          [  4]  24.00-25.00  sec   928 MBytes  7.78 Gbits/sec    3          [  4]  25.00-26.00  sec   805 MBytes  6.75 Gbits/sec    6          [  4]  26.00-27.00  sec   944 MBytes  7.92 Gbits/sec    2          [  4]  27.00-28.00  sec   929 MBytes  7.79 Gbits/sec    1          [  4]  28.00-29.00  sec  1.02 GBytes  8.74 Gbits/sec    0          [  4]  29.00-30.00  sec  1020 MBytes  8.56 Gbits/sec    0          [  4]  30.00-31.00  sec   926 MBytes  7.77 Gbits/sec    2          [  4]  31.00-32.00  sec  1.02 GBytes  8.80 Gbits/sec    0          [  4]  32.00-33.00  sec  1.01 GBytes  8.68 Gbits/sec    0          [  4]  33.00-33.86  sec   879 MBytes  8.59 Gbits/sec    0          - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval           Transfer     Bandwidth       Retransmits [  4]   0.00-33.86  sec  30.0 GBytes  7.61 Gbits/sec  135         sender [  4]   0.00-33.86  sec  30.0 GBytes  7.61 Gbits/sec              receiver  iperf Done. [root@dm01db01 modprobe.d]#