暂无图片
暂无图片
1
暂无图片
暂无图片
暂无图片

跑TPCC分析主机性能情况

原创 杨天成 2023-08-10
567

适用范围

操作系统版本:CentOS Linux release 7.6.1810 (Core)
主机环境:虚拟机(虚拟机配置:8cpu,8G,物理机上有30个虚拟机在使用)
数据库版本:MogDB 5.0.0 build 503a9ef7

运行tpcc

[root@mogdb245 run]# ./runBenchmark.sh props.mog 09:28:31,979 [main] INFO jTPCC : Term-00, 09:28:31,982 [main] INFO jTPCC : Term-00, +-------------------------------------------------------------+ 09:28:31,982 [main] INFO jTPCC : Term-00, BenchmarkSQL v5.0 09:28:31,982 [main] INFO jTPCC : Term-00, +-------------------------------------------------------------+ 09:28:31,982 [main] INFO jTPCC : Term-00, (c) 2003, Raul Barbosa 09:28:31,983 [main] INFO jTPCC : Term-00, (c) 2004-2016, Denis Lussier 09:28:31,984 [main] INFO jTPCC : Term-00, (c) 2016, Jan Wieck 09:28:31,984 [main] INFO jTPCC : Term-00, +-------------------------------------------------------------+ 09:28:31,984 [main] INFO jTPCC : Term-00, 09:28:31,985 [main] INFO jTPCC : Term-00, db=postgres 09:28:31,985 [main] INFO jTPCC : Term-00, driver=org.postgresql.Driver 09:28:31,985 [main] INFO jTPCC : Term-00, conn=jdbc:postgresql://192.168.64.246:28000/tpccdb?prepareThreshold=1&batchMode=on&fetchsize=10&loggerLevel=off 09:28:31,985 [main] INFO jTPCC : Term-00, user=tpcc_mogdb 09:28:31,985 [main] INFO jTPCC : Term-00, 09:28:31,985 [main] INFO jTPCC : Term-00, warehouses=50 09:28:31,985 [main] INFO jTPCC : Term-00, terminals=20 09:28:31,987 [main] INFO jTPCC : Term-00, runMins=12 09:28:31,987 [main] INFO jTPCC : Term-00, limitTxnsPerMin=0 09:28:31,987 [main] INFO jTPCC : Term-00, terminalWarehouseFixed=true 09:28:31,987 [main] INFO jTPCC : Term-00, 09:28:31,987 [main] INFO jTPCC : Term-00, newOrderWeight=45 09:28:31,987 [main] INFO jTPCC : Term-00, paymentWeight=43 09:28:31,987 [main] INFO jTPCC : Term-00, orderStatusWeight=4 09:28:31,987 [main] INFO jTPCC : Term-00, deliveryWeight=4 09:28:31,987 [main] INFO jTPCC : Term-00, stockLevelWeight=4 09:28:31,988 [main] INFO jTPCC : Term-00, 09:28:31,988 [main] INFO jTPCC : Term-00, resultDirectory=my_result_%tY-%tm-%td_%tH%tM%tS 09:28:31,988 [main] INFO jTPCC : Term-00, osCollectorScript=null 09:28:31,988 [main] INFO jTPCC : Term-00, 09:28:32,012 [main] INFO jTPCC : Term-00, copied props.mog to my_result_2023-08-10_092832/run.properties 09:28:32,012 [main] INFO jTPCC : Term-00, created my_result_2023-08-10_092832/data/runInfo.csv for runID 684 09:28:32,012 [main] INFO jTPCC : Term-00, writing per transaction results to my_result_2023-08-10_092832/data/result.csv 09:28:32,012 [main] INFO Term-00, Running Average tpmTOTAL: 27060.70 Current tpmTOTAL: 2144976 Memory Usage: 38MB / 126MB 09:40:50,129 [Thread-2] INFO jTPCC : Term-00, 09:40:50,130 [Thread-2] INFO jTPCC : Term-00, 09:40:50,131 [Thread-2] INFO jTPCC : Term-00, Measured tpmC (NewOrders) = 12164.56 09:40:50,131 [Thread-2] INFO jTPCC : Term-00, Measured tpmTOTAL = 27042.69 09:40:50,131 [Thread-2] INFO jTPCC : Term-00, Session Start = 2023-08-10 09:28:49 09:40:50,131 [Thread-2] INFO jTPCC : Term-00, Session End = 2023-08-10 09:40:50 09:40:50,131 [Thread-2] INFO jTPCC : Term-00, Transaction Count = 324743 09:40:50,131 [Thread-2] INFO jTPCC : executeTime[Payment]=3411029 09:40:50,132 [Thread-2] INFO jTPCC : executeTime[Delivery]=1926519 09:40:50,132 [Thread-2] INFO jTPCC : executeTime[Order-Status]=681644 09:40:50,132 [Thread-2] INFO jTPCC : executeTime[Stock-Level]=145261 09:40:50,132 [Thread-2] INFO jTPCC : executeTime[New-Order]=8235066
复制

观察主机整体性能情况

通过dstat命令进行查看:

----total-cpu-usage---- -dsk/total- -net/total- ---paging-- ---system-- ----system---- ------memory-usage-----
usr sys idl wai hiq siq| read  writ| recv  send|  in   out | int   csw |     time     | used  buff  cach  free
  4   3  92   1   0   0| 968k 1825k|   0     0 | 331B 2746B|  27k   53k|10-08 09:28:43| 786M  652k 6313M  722M
  2   3  95   0   0   0|   0   144k| 116k   93k|   0     0 |  26k   52k|10-08 09:28:46| 786M  652k 6313M  722M
  3   3  93   0   0   0|  48k   82k| 128k  107k|   0     0 |  29k   56k|10-08 09:28:49| 848M  652k 6313M  660M
 10   5  40  43   0   1|  51M 2390k| 612k 1553k|   0     0 |  40k   62k|10-08 09:28:52| 954M  652k 6166M  700M
 11   5  17  66   0   1|  56M   16M| 924k 2793k|   0     0 |  47k   69k|10-08 09:28:55| 965M  652k 6189M  666M
 12   5  22  60   0   1|  43M   16M|1061k 3365k|   0     0 |  50k   72k|10-08 09:28:58| 978M  652k 6174M  669M
 17   6  15  60   0   1|  54M   19M|1327k 4264k|   0     0 |  58k   74k|10-08 09:29:01| 984M  652k 6223M  613M
 14   5  18  61   0   1|  39M   18M|1226k 3813k|   0     0 |  52k   73k|10-08 09:29:04| 985M  652k 6199M  636M
 16   9  14  60   0   1|  40M   26M|1273k 4091k|   0     0 |  53k   74k|10-08 09:29:07| 988M  652k 6176M  656M
 17   6  20  57   0   1|  34M   20M|1472k 4632k|   0     0 |  55k   77k|10-08 09:29:10| 995M  652k 6287M  539M
 19   6  15  59   0   1|  39M   23M|1546k 5107k|   0     0 |  55k   76k|10-08 09:29:13|1002M  652k 6267M  551M
 21   6  13  59   0   1|  34M   30M|1741k 5664k|   0     0 |  58k   77k|10-08 09:29:16|1008M  648k 6233M  579M
 23   7  16  53   0   1|  33M   27M|1889k 6299k|   0     0 |  61k   79k|10-08 09:29:19|1018M  648k 6200M  602M
 25   7  17  49   0   1|  30M   42M|2064k 6573k|   0     0 |  65k   83k|10-08 09:29:22|1022M  648k 6157M  641M
 24   7  15  53   0   1|  31M   24M|2039k 6774k|   0     0 |  63k   81k|10-08 09:29:25|1028M  648k 6264M  528M
 21   6  28  43   0   1|  25M   39M|1745k 5738k|   0     0 |  60k   77k|10-08 09:29:28|1033M  648k 6205M  582M
 22   9  19  49   0   1|  25M   28M|1756k 5793k|   0     0 |  60k   76k|10-08 09:29:31|1039M  648k 6146M  635M
 21   6  14  58   0   1|  21M   37M|1662k 5434k|   0     0 |  58k   76k|10-08 09:29:34|1059M  648k 6222M  539M
 24   7  14  53   0   1|  27M   41M|2097k 6924k|   0     0 |  65k   82k|10-08 09:29:37|1067M  648k 6169M  584M
 28   7  15  48   0   2|  26M   36M|2250k 7397k|   0     0 |  66k   80k|10-08 09:29:40|1080M  648k 6119M  621M
 32   8  14  44   0   2|  36M   43M|2546k 8542k|   0     0 |  70k   83k|10-08 09:29:43|1101M  648k 6149M  570M
 23   7  19  50   0   1|  43M   31M|1832k 6082k|   0     0 |  61k   76k|10-08 09:29:46|1105M  648k 6165M  550M
 29   8  20  42   0   2|  38M   33M|2320k 7745k|   0     0 |  66k   81k|10-08 09:29:49|1115M  648k 6154M  552M
 22  10  20  47   0   1|  25M   45M|1717k 5613k|   0     0 |  60k   76k|10-08 09:29:52|1121M  648k 6101M  598M
 19   6  23  50   0   1|  28M   48M|1449k 4614k|   0     0 |  56k   73k|10-08 09:29:55|1129M  648k 6057M  635M
 20   6  26  47   0   1|  32M   41M|1570k 5142k|   0     0 |  57k   74k|10-08 09:29:58|1134M  648k 6113M  573M
 29   8  17  45   0   2|  49M   45M|2069k 6989k|   0     0 |  65k   78k|10-08 09:30:01|1169M  648k 6045M  606M
 19   6  19  55   0   1|  31M   41M|1362k 4456k|   0     0 |  53k   69k|10-08 09:30:04|1176M  648k 6009M  635M
  9   5  37  48   0   1|  12M   53M| 519k 1530k|   0     0 |  41k   64k|10-08 09:30:07|1176M  648k 6055M  590M
 22   6  28  42   0   1|  45M   27M|1589k 5297k|   0     0 |  58k   72k|10-08 09:30:10|1181M  648k 6063M  577M
 14   5  41  40   0   1|  29M   56M| 927k 2994k|   0     0 |  47k   66k|10-08 09:30:13|1183M  648k 6025M  612M
 23   7  19  50   0   1|  41M   48M|1656k 5530k|   0     0 |  57k   72k|10-08 09:30:16|1188M  648k 6019M  613M
 19   7  34  39   0   1|  24M   58M|1293k 4352k|   0     0 |  52k   68k|10-08 09:30:19|1197M  648k 5967M  656M
 17   5  32  45   0   1|  27M   50M|1093k 3539k|   0     0 |  49k   67k|10-08 09:30:22|1197M  648k 6060M  563M
 20   6  35  37   0   1|  34M   48M|1427k 4681k|   0     0 |  55k   71k|10-08 09:30:25|1201M  648k 6042M  578M
 23   6  33  36   0   1|  25M   64M|1476k 5006k|   0     0 |  54k   67k|10-08 09:30:28|1173M  648k 5995M  652M
 22   6  27  44   0   1|  21M   29M|1619k 5381k|   0     0 |  56k   71k|10-08 09:30:31|1175M  648k 6071M  574M
 21   6  34  38   0   1|  24M   62M|1511k 4952k|   0     0 |  56k   72k|10-08 09:30:34|1163M  648k 6117M  541M
 17   6  33  43   0   1|  16M   36M|1230k 3964k|   0     0 |  50k   67k|10-08 09:30:37|1168M  648k 6040M  612M^C

复制

可以分析cpu的wai很高,影响该指标的主要因素是io,网络和内存没有问题,cpu还有少量空闲。
通过iostat详细查看io情况

Device:         rrqm/s   wrqm/s     r/s     w/s    rMB/s    wMB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     0.00 1219.33 3428.67    22.17    49.02    31.37    48.01   10.51   22.18    6.36   0.22  99.97
dm-0              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-1              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-2              0.00     0.00 1208.67 3430.67    21.95    49.03    31.33    49.03   10.60   22.48    6.41   0.22 101.17

Device:         rrqm/s   wrqm/s     r/s     w/s    rMB/s    wMB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     0.00 1840.67 2262.00    33.89    40.21    36.99    56.33   13.57   23.16    5.76   0.24  99.93
dm-0              0.00     0.00    0.00    5.33     0.00     1.68   643.50     0.12   23.31    0.00   23.31   1.88   1.00
dm-1              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-2              0.00     0.00 1842.33 2254.33    33.91    38.51    36.21    57.33   13.65   23.27    5.79   0.24 100.00

Device:         rrqm/s   wrqm/s     r/s     w/s    rMB/s    wMB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     0.00 1623.33 2713.00    30.52    42.67    34.57    39.05    9.09   17.43    4.10   0.23  99.63
dm-0              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-1              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-2              0.00     0.00 1621.67 2713.00    30.53    42.67    34.59    39.75    9.16   17.54    4.15   0.23  99.67

Device:         rrqm/s   wrqm/s     r/s     w/s    rMB/s    wMB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     1.67 2596.33 2578.67    50.95    50.71    40.23    50.03    9.72   14.81    4.59   0.19  99.90
dm-0              0.00     0.00    0.00    7.67     0.00     0.06    16.22     0.04    5.39    0.00    5.39   1.13   0.87
dm-1              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-2              0.00     0.00 2601.67 2572.67    51.13    50.65    40.29    51.00    9.85   14.92    4.72   0.19 100.07

Device:         rrqm/s   wrqm/s     r/s     w/s    rMB/s    wMB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     3.00 1066.00 3825.00    18.62    53.34    30.13    41.10    8.40   24.19    3.99   0.20 100.00
dm-0              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-1              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-2              0.00     0.00 1060.33 3828.00    18.46    53.34    30.08    44.38    8.48   24.51    4.04   0.21 102.13

Device:         rrqm/s   wrqm/s     r/s     w/s    rMB/s    wMB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0.00     0.00 2108.00 2638.33    37.78    49.34    37.59    32.10    6.78   12.89    1.89   0.21 100.00
dm-0              0.00     0.00    0.00    3.00     0.00     1.50  1024.00     0.00    1.56    0.00    1.56   0.33   0.10
dm-1              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00    0.00    0.00   0.00   0.00
dm-2              0.00     0.00 2107.00 2677.33    37.71    48.19    36.77    32.31    6.73   12.91    1.87   0.21 100.13
复制

可以看到io一直都有排队(30+),平均每次设备 I/O 操作的等待时间在8ms左右,但是平均每次设备 I/O 操作的服务时间在0.2ms左右,两者之间的值相差很大,说明磁盘性能很差。会有人问,io到底是慢在什么地方呢?我们可以通过blktrace工具来分析磁盘上的一些瓶颈问题。

blktrace 统计分析

==================== Per Process ====================

          Q2Qdm           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------

          Q2Adm           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------

          Q2Cdm           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------


            Q2Q           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
AVCworker         0.000000020   0.002149645   0.642564533       27871
TrackStmtClean    0.000624243   0.043088303   0.116780239           3
WALwriter         0.000080125   0.001774371   0.611957820       33810
checkpointer      0.000068088   0.007573228   0.431564544         168
ckpt              0.000059414   0.137961659   3.005381837         417
cm_server         0.000096017   0.524410856   1.539114728         112
crond             0.000001828   0.002679836   0.030290045          14
kworker           0.000003618   0.022204116  10.011211786        2523
pagewriter        0.000000001   0.000501922   1.753065492      118755
sh                0.000003362   0.000881034   0.003511503           4
worker            0.000000005   0.001136068   0.669947241       52811
xfsaild           0.000002058   0.374493469  26.830049647          89

            Q2A           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------

            Q2G           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
AVCworker         0.000000369   0.000027679   0.059905954       27872
TrackStmtClean    0.000001616   0.000001768   0.000001957           4
WALwriter         0.000000467   0.000015017   0.049957888       33811
checkpointer      0.000000466   0.000000891   0.000004898         169
ckpt              0.000000469   0.000003026   0.000292638         418
cm_server         0.000000561   0.000316764   0.021004970         113
crond             0.000000471   0.000000751   0.000001577          15
kworker           0.000000337   0.000017679   0.011996936        2524
om_monitor        0.000001435   0.000001435   0.000001435           1
pagewriter        0.000000332   0.000027135   0.090302334      118756
sh                0.000000548   0.000000932   0.000001338           5
worker            0.000000372   0.000069910   0.099778508       52812
xfsaild           0.000000407   0.000000700   0.000002122          72

            S2G           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
AVCworker         0.000038280   0.005758791   0.059905263         130
WALwriter         0.000029292   0.003354881   0.049955965         139
ckpt              0.000224481   0.000266964   0.000291138           3
cm_server         0.001439129   0.008900543   0.021003296           4
kworker           0.000095120   0.000917243   0.011996528          47
pagewriter        0.000014661   0.001912357   0.090301781        1631
worker            0.000019910   0.006672698   0.099777164         544

            G2I           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
AVCworker         0.000000399   0.000038731   0.000323660       27872
TrackStmtClean    0.000001208   0.000001333   0.000001644           4
WALwriter         0.000000197   0.000000640   0.000073186       33811
checkpointer      0.000000260   0.000000661   0.000009049         169
ckpt              0.000000235   0.000000765   0.000010934         418
cm_server         0.000000332   0.000001323   0.000018964         113
crond             0.000001200   0.000009900   0.000022826          15
kworker           0.000000149   0.000000268   0.000018961        2524
om_monitor        0.000001107   0.000001107   0.000001107           1
pagewriter        0.000000137   0.000000801   0.000138493      118756
sh                0.000001011   0.000004012   0.000007238           5
worker            0.000000405   0.000023275   0.000344225       52812
xfsaild           0.000001118   0.000036979   0.000107033          72

            Q2M           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
xfsaild           0.000000260   0.000000375   0.000000820          18

            I2D           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
AVCworker         0.000000365   0.000012783   0.000129510       27872
TrackStmtClean    0.000000897   0.000001205   0.000001401           4
WALwriter         0.000000301   0.000000758   0.000050342       33811
checkpointer      0.000000418   0.000000666   0.000002158         169
ckpt              0.000000360   0.000000762   0.000013923         418
cm_server         0.000000473   0.000001370   0.000037003         113
crond             0.000001108   0.000007614   0.000018332          15
kworker           0.000000243   0.000000344   0.000034251        2524
om_monitor        0.000001064   0.000001064   0.000001064           1
pagewriter        0.000000241   0.000000366   0.000076494      118756
sh                0.000001277   0.000003230   0.000004923           5
worker            0.000000360   0.000008964   0.000254965       52812
xfsaild           0.000001218   0.000015317   0.000037678          72

            D2C           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
AVCworker         0.000052344   0.017821471   0.999923067       27865
TrackStmtClean    0.000535878   0.038228569   0.116290732           4
WALwriter         0.000037722   0.001241882   0.538851436       33811
checkpointer      0.000045763   0.006362985   0.431519833         169
ckpt              0.000039576   0.000963790   0.065962722         418
cm_server         0.000044924   0.014747078   0.538962738         113
crond             0.000299722   0.003211648   0.020317461          15
kworker           0.000059283   0.004299249   0.067233371        2524
om_monitor        0.010663646   0.010663646   0.010663646           1
pagewriter        0.000043722   0.002889675   0.418408558      118756
sh                0.000643239   0.002287152   0.003245116           5
worker            0.000051266   0.017814489   0.971295012       52802
xfsaild           0.000078852   0.008826295   0.067223456          90

            Q2C           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
AVCworker         0.000053997   0.017900665   0.999926486       27865
TrackStmtClean    0.000540148   0.038232874   0.116294598           4
WALwriter         0.000039271   0.001258297   0.538855206       33811
checkpointer      0.000048255   0.006365202   0.431521837         169
ckpt              0.000041597   0.000968343   0.065965728         418
cm_server         0.000048942   0.015066535   0.538965446         113
crond             0.000326488   0.003229913   0.020321305          15
kworker           0.000061433   0.004317541   0.067237949        2524
om_monitor        0.010667252   0.010667252   0.010667252           1
pagewriter        0.000046020   0.002917977   0.418436711      118756
sh                0.000651552   0.002295326   0.003252360           5
worker            0.000054912   0.017916651   0.971332242       52802
xfsaild           0.000082958   0.008880931   0.067231036          90

==================== Per Device ====================

          Q2Qdm           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------

          Q2Adm           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------

          Q2Cdm           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------


            Q2Q           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
(  8,  0)         0.000000001   0.000253601   0.538843857      236589

            Q2A           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------

            Q2G           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
(  8,  0)         0.000000332   0.000034982   0.099778508      236572

            S2G           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
(  8,  0)         0.000014661   0.003219971   0.099777164        2498

            G2I           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
(  8,  0)         0.000000137   0.000010270   0.000344225      236572

            Q2M           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
(  8,  0)         0.000000260   0.000000375   0.000000820          18

            I2D           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
(  8,  0)         0.000000241   0.000003810   0.000254965      236572

            D2C           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
(  8,  0)         0.000037722   0.007766757   0.999923067      236573

            Q2C           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------
(  8,  0)         0.000039271   0.007815820   0.999926486      236573

==================== All Devices ====================

            ALL           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------

Q2Q               0.000000001   0.000253601   0.538843857      236589
Q2G               0.000000332   0.000034982   0.099778508      236572
S2G               0.000014661   0.003219971   0.099777164        2498
G2I               0.000000137   0.000010270   0.000344225      236572
Q2M               0.000000260   0.000000375   0.000000820          18
I2D               0.000000241   0.000003810   0.000254965      236572
M2D               0.000017227   0.000060819   0.000098661          18
D2C               0.000037722   0.007766757   0.999923067      236573
Q2C               0.000039271   0.007815820   0.999926486      236573

==================== Device Overhead ====================

       DEV |       Q2G       G2I       Q2M       I2D       D2C
---------- | --------- --------- --------- --------- ---------
 (  8,  0) |   0.4476%   0.1314%   0.0000%   0.0488%  99.3723%
---------- | --------- --------- --------- --------- ---------
   Overall |   0.4476%   0.1314%   0.0000%   0.0488%  99.3723%

==================== Device Merge Information ====================

       DEV |       #Q       #D   Ratio |   BLKmin   BLKavg   BLKmax    Total
---------- | -------- -------- ------- | -------- -------- -------- --------
 (  8,  0) |   236590   236572     1.0 |        1       37     1024  8768662

==================== Device Q2Q Seek Information ====================

       DEV |          NSEEKS            MEAN          MEDIAN | MODE           
---------- | --------------- --------------- --------------- | ---------------
 (  8,  0) |          236590      12573926.8               0 | 16(35120)
---------- | --------------- --------------- --------------- | ---------------
   Overall |          NSEEKS            MEAN          MEDIAN | MODE           
   Average |          236590      12573926.8               0 | 16(35120)

==================== Device D2D Seek Information ====================

       DEV |          NSEEKS            MEAN          MEDIAN | MODE           
---------- | --------------- --------------- --------------- | ---------------
 (  8,  0) |          236572      11997879.4               0 | 16(36448)
---------- | --------------- --------------- --------------- | ---------------
   Overall |          NSEEKS            MEAN          MEDIAN | MODE           
   Average |          236572      11997879.4               0 | 16(36448)

==================== Plug Information ====================

       DEV |    # Plugs # Timer Us  | % Time Q Plugged
---------- | ---------- ----------  | ----------------
 (  8,  0) |      30357(         2) |   0.679599290%

       DEV |    IOs/Unp   IOs/Unp(to)
---------- | ----------   ----------
 (  8,  2) |        0.0          0.0
 (  8,  0) |        2.6          9.0
---------- | ----------   ----------
   Overall |    IOs/Unp   IOs/Unp(to)
   Average |        2.6          9.0

==================== Active Requests At Q Information ====================

       DEV |  Avg Reqs @ Q
---------- | -------------
 (  8,  0) |           1.8

==================== I/O Active Period Information ====================

       DEV |     # Live      Avg. Act     Avg. !Act % Live
---------- | ---------- ------------- ------------- ------
 (  8,  2) |          0   0.000000000   0.000000000   0.00
 (  8,  0) |        276   0.217193608   0.000196012  99.91
---------- | ---------- ------------- ------------- ------
 Total Sys |        276   0.217193608   0.000196012  99.91

==================== Q2D Histogram ====================

       DEV | <.005 <.010 <.025 <.050 <.075 <.100 <.250 <.500 < 1.0 >=1.0
 --------- | ===== ===== ===== ===== ===== ===== ===== ===== ===== ===== 
 (  8,  0) |  99.9   0.1   0.0   0.0   0.0   0.0   0.0   0.0   0.0   0.0 
========== | ===== ===== ===== ===== ===== ===== ===== ===== ===== ===== 
       AVG |  99.9   0.1   0.0   0.0   0.0   0.0   0.0   0.0   0.0   0.0 

复制

通过上面的统计数据,可以发现io主要卡在了D2C以及主要是那些进程耗费了io,能够看的很清楚,问题主要还是卡在硬件上面,耗时较大。
相关指标解释如下:
Q2G – 生成IO请求所消耗的时间,包括remap和split的时间;
G2I – IO请求进入IO Scheduler所消耗的时间,包括merge的时间;
I2D – IO请求在IO Scheduler中等待的时间;
D2C – IO请求在driver和硬件上所消耗的时间;
Q2C – 整个IO请求所消耗的时间(Q2I + I2D + D2C = Q2C),相当于iostat的await。

小结

通过操作系统命令和工具,可以一步一步分析出,主机上的性能瓶颈具体在什么地方,这个需要多熟悉操作系统相关命令及相关分析工具。

「喜欢这篇文章,您的关注和赞赏是给作者最好的鼓励」
关注作者
【版权声明】本文为墨天轮用户原创内容,转载时必须标注文章的来源(墨天轮),文章链接,文章作者等基本信息,否则作者和墨天轮有权追究责任。如果您发现墨天轮中有涉嫌抄袭或者侵权的内容,欢迎发送邮件至:contact@modb.pro进行举报,并提供相关证据,一经查实,墨天轮将立刻删除相关内容。

评论