The MS3270 tests provide a consistent test bed and can be used to establish a set of testing standards that don't vary. In real world applications, network stresses may vary depending on host speed and cluster/gateway speed. The MS3270 tests provide stresses and loads beyond those found in real cluster/gateway worlds, unlike other testing approaches.
+------+
¦Config¦
¦ File ¦
+------+
¦
+------+ +-----------+
¦ ¦ ¦ Automatic ¦
¦ ITF ¦ ------ ¦ Log ¦
¦ ¦ ¦ File ¦
+------+ +-----------+
¦
¦
¦
/
¦ Example Multi Session Test Environment
¦
¦ Test Features :
+---------+ Automatic Report File
¦ Gateway ¦ Flexible Parameter File
+---------+ Real-Time Response Times
¦ Up to 16 sessions
¦
+-----------------------------------------//-----+
¦ ¦ ¦ ¦ ¦ ¦ ¦
+-----+ +-----+ +-----+ +-----+ +-----+ +-----+ +-------+
¦ 1 ¦ ¦ 2 ¦ ¦ 3 ¦ ¦ 4 ¦ ¦ 5 ¦ ¦ 6 ¦ ¦ 16 ¦
+-----+ +-----+ +-----+ +-----+ +-----+ +-----+ +-------+
The MS3270 tests are able to saturate the serial SLIP or PPP link using PC to simulate a TN3270 server. These tests also take advantage of ITF's support for LANs and may be run with either Token Ring or Ethernet connections. The performance of these tests may be "tuned or de-tuned" using the timing parameters found on the ITF pull-down menus to achieve and control the level of performance desired. The use of pentium class PCs can yield results far beyond those of the Host/Front-end or other TN3270 server.
The tests are arranged in categories of Outbound only, Outbound/Inbound, and Inbound only. The inbound data is used to simulate operator input and is created by placing `modified data' in the outbound data stream and reading it back. The size of the output data varies. The differing output and input message sizes reflect the varying degrees of efficiency in the various components of the Implementation Under Test (IUT).
The MS3270 test results may be used to examine a number of performance indicators including:
A performance summary is compiled at the end of each test and is written in spreadsheet compatible Import Format (comma delimited) file to simplify displaying the results as a table or graph. Subsequent test summaries are appended to this file.
The MS3270 test numbers and their principle functions are:
001 Outbound with sequential response
002 Outbound with overlapped response
003 Outbound with no response
014 Large record outbound with sequential response
015 Large record outbound with overlapped response
016 Large Record outbound with no response
004 Outbound/Inbound(RM) with sequential response
005 Outbound/Inbound(RM) with overlapped response
006 Outbound/Inbound(RM) with no response
010 Sequential Read Modified inbound
011 Overlapped Read Modified inbound
007 Outbound/Inbound(RB) with sequential response
008 Outbound/Inbound(RB) with overlapped response
009 Outbound/Inbound(RB) with no response
012 Sequential Read Buffer inbound
013 Overlapped Read Buffer inbound
The performance data is output in a format that is easily importable by spreadsheet programs for further analysis and graphing. Example output is shown below:
"TN32Ex 4 Sessions" "TmStamp","TestID","UBPS","BPS","RPS","TPS","RspTm","ElapsedTm","MTxDly","ATxDly","#Delay","#RxTMO","#Block","#Session,#Active","TxTMO,RxTMO,FTxDly,AutoDly" "12:53:40 Monday May 6,1996","001",15860,17285,25.454,12.727,0.079,60.030,0,0,0,0,172815"4,4","10,10,0,ON"Report Data Output
"12:54:50 Monday May 6, 1996","002",25266,27536,40.532,20.266,0.049,60.200,0,0,0,0,621"4,4","10,10,0,ON"
"12:59:17 Monday May 6, 1996","003",23447,24514,19.049,18.983,0.053,60.580,30,15,361,0,3695"4,4","10,10,0,ON"
"13:00:34 Monday May 6, 1996","004",10957,12711,31.318,7.829,0.128,60.030,0,0,0,0,175006"4,4","10,10,0,ON"
The report data output by the MS3270 tests contains statistics and information useful for performance analysis and problem determination. An example report file is shown below:
>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=< MS3270 UTEP003 Started (17:52:36 Thursday May 2, 1996) 003 Outbound with no response Transmit Timeout : 10 Receive Timeout : 10 Fixed Transmit Delay : 0 Auto Transmit Delay : ON Number of Session : 4 Total Session Started : 4 Tx/Rx Buffer Size : 2048 Transmit Record Size : 256 or less Data Traffic Started : 17:52:37 Session ID (Addr/Port) : 200.200.200.203 #10376 Session Start Up Time : 17:50:09 Session Type : Enhanced TN3270 Device Type : IBM-3278-2-E Device Name : TN32Ey42 Supported Functions : BIND,DSC,RSP,SCS,SYSREQ 3270 Command Set : Local Session Status : Active Maximum Auto Tx Delay : 33 Average Auto Tx Delay : 16 Tx/Rx Blocking : 8647 Number of Tx Delay : 99 Number of Rx Timeout : 0 Completed Transactions : 162 Session ID (Addr/Port) : 200.200.200.203 #10377 Session Start Up Time : 17:50:11 Session Type : Enhanced TN3270 Device Type : IBM-3278-2-E Device Name : TN32Ey42.C Supported Functions : BIND,DSC,RSP,SCS,SYSREQ 3270 Command Set : Local Session Status : Active Maximum Auto Tx Delay : 30 Average Auto Tx Delay : 15 Tx/Rx Blocking : 4651 Number of Tx Delay : 58 Number of Rx Timeout : 0 Completed Transactions : 156 Session ID (Addr/Port) : 200.200.200.203 #10378 Session Start Up Time : 17:50:12 Session Type : Enhanced TN3270 Device Type : IBM-3278-2-E Device Name : TN32Ey42.D Supported Functions : BIND,DSC,RSP,SCS,SYSREQ 3270 Command Set : Local Session Status : Active Maximum Auto Tx Delay : 30 Average Auto Tx Delay : 15 Tx/Rx Blocking : 17555 Number of Tx Delay : 87 Number of Rx Timeout : 0 Completed Transactions : 168 Session ID (Addr/Port) : 200.200.200.203 #10379 Session Start Up Time : 17:50:13 Session Type : Enhanced TN3270 Device Type : IBM-3278-2-E Device Name : TN32Ey42.B Supported Functions : BIND,DSC,RSP,SCS,SYSREQ 3270 Command Set : Local Session Status : Active Maximum Auto Tx Delay : 30 Average Auto Tx Delay : 15 Tx/Rx Blocking : 18041 Number of Tx Delay : 58 Number of Rx Timeout : 0 Completed Transactions : 161 Termination Time : 17:53:39 Max UTEP Auto Tx Delay : 33 Total Auto Tx Delay : 4704 Average UTEP Tx Delay : 15 Total Tx/Rx Blocking : 48894 Total # of Tx Delay : 302 Total # of Rx Timeout : 0 Total Transactions : 647 Reason for Termination : 1 Minute Time Limit Expired *************************** Performance Indicators *************************** Elapsed Time = 62.308 Sec User Data Throughput = 12883 Bits/Sec Bits Per Second = 13464 Bits/Sec Throughput (TPS) = 10.384 Transactions/Sec Records Per Second = 10.384 Records/Sec Response Time = 0.096 Sec/Transaction MS3270 UTEP003 Ended (17:53:39 Thursday May 2, 1996) >=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<