ITF MS3270 - Multi-Session TN3270x Tests


The ITF MS3270 tests consist of a series of test cases for use in multi-session cluster and LAN gateway performance and load testing using 3270 (TN3270 and TN3270E) data streams. These tests support a maximum of 16 sessions. The testing environment is dynamically controlled using a flexible parameter file. All tests generate an automatic performance file containing test results and an optional report file containing additional statistics and problem determination information. The output of the MS3270 tests may be used to conduct sophisticated analysis of an individual products performance characteristics or to compare the performance of competing products

The MS3270 tests provide a consistent test bed and can be used to establish a set of testing standards that don't vary. In real world applications, network stresses may vary depending on host speed and cluster/gateway speed. The MS3270 tests provide stresses and loads beyond those found in real cluster/gateway worlds, unlike other testing approaches.

+------+
¦Config¦
¦ File ¦
+------+
    ¦
+------+         +-----------+
¦      ¦         ¦ Automatic ¦
¦ ITF  ¦  ------ ¦    Log    ¦
¦      ¦         ¦   File    ¦
+------+         +-----------+
   ¦
   ¦
   ¦
    /
     ¦                          Example Multi Session Test Environment
     ¦
     ¦                          Test Features :
+---------+                                    Automatic Report File
¦ Gateway ¦                                    Flexible Parameter File
+---------+                                    Real-Time Response Times
     ¦                                         Up to 16 sessions
     ¦
     +-----------------------------------------//-----+
     ¦       ¦       ¦       ¦       ¦       ¦        ¦
   +-----+ +-----+ +-----+ +-----+ +-----+ +-----+ +-------+
   ¦   1 ¦ ¦   2 ¦ ¦   3 ¦ ¦   4 ¦ ¦   5 ¦ ¦   6 ¦ ¦   16  ¦
   +-----+ +-----+ +-----+ +-----+ +-----+ +-----+ +-------+ 

Performance

The MS3270 tests are able to saturate the serial SLIP or PPP link using PC to simulate a TN3270 server. These tests also take advantage of ITF's support for LANs and may be run with either Token Ring or Ethernet connections. The performance of these tests may be "tuned or de-tuned" using the timing parameters found on the ITF pull-down menus to achieve and control the level of performance desired. The use of pentium class PCs can yield results far beyond those of the Host/Front-end or other TN3270 server.

Categories of Test

The tests are arranged in categories of Outbound only, Outbound/Inbound, and Inbound only. The inbound data is used to simulate operator input and is created by placing `modified data' in the outbound data stream and reading it back. The size of the output data varies. The differing output and input message sizes reflect the varying degrees of efficiency in the various components of the Implementation Under Test (IUT).

Results Measurement

The MS3270 test results may be used to examine a number of performance indicators including:

Individual response times are given in seconds and measure the amount of time it takes for an entire send to be completed for all active sessions. Throughput is measured by the number of transactions per second. The total number of frames sent and received over time creates the data packets per second (PPS) statistic. Finally, the BPS is calculated for all data flowing and userdata only (without Telnet overhead). Response time is measured by seconds per transaction and is the inverse of throughput. In addition to the default continuous mode, test duration can be specified by the minute to achieve a standard testing cycle.

A performance summary is compiled at the end of each test and is written in spreadsheet compatible Import Format (comma delimited) file to simplify displaying the results as a table or graph. Subsequent test summaries are appended to this file.

MS3270 Test Descriptions

The MS3270 test numbers and their principle functions are:

Outbound Only

001 Outbound with sequential response
002 Outbound with overlapped response
003 Outbound with no response
014 Large record outbound with sequential response
015 Large record outbound with overlapped response
016 Large Record outbound with no response

Outbound/Inbound Read Modified

004 Outbound/Inbound(RM) with sequential response
005 Outbound/Inbound(RM) with overlapped response
006 Outbound/Inbound(RM) with no response
010 Sequential Read Modified inbound
011 Overlapped Read Modified inbound

Outbound/Inbound Read Buffer

007 Outbound/Inbound(RB) with sequential response
008 Outbound/Inbound(RB) with overlapped response
009 Outbound/Inbound(RB) with no response
012 Sequential Read Buffer inbound
013 Overlapped Read Buffer inbound

Performance Data Output

The performance data is output in a format that is easily importable by spreadsheet programs for further analysis and graphing. Example output is shown below:

"TN32Ex 4 Sessions" "TmStamp","TestID","UBPS","BPS","RPS","TPS","RspTm","ElapsedTm","MTxDly","ATxDly","#Delay","#RxTMO","#Block","#Session,#Active","TxTMO,RxTMO,FTxDly,AutoDly"
"12:53:40 Monday May 6,1996","001",15860,17285,25.454,12.727,0.079,60.030,0,0,0,0,172815"4,4","10,10,0,ON" 
"12:54:50 Monday May 6, 1996","002",25266,27536,40.532,20.266,0.049,60.200,0,0,0,0,621"4,4","10,10,0,ON"
"12:59:17 Monday May 6, 1996","003",23447,24514,19.049,18.983,0.053,60.580,30,15,361,0,3695"4,4","10,10,0,ON"
"13:00:34 Monday May 6, 1996","004",10957,12711,31.318,7.829,0.128,60.030,0,0,0,0,175006"4,4","10,10,0,ON"
Report Data Output

The report data output by the MS3270 tests contains statistics and information useful for performance analysis and problem determination. An example report file is shown below:

>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<
MS3270 UTEP003 Started (17:52:36 Thursday May 2, 1996)
003 Outbound with no response
Transmit Timeout       : 10
Receive Timeout        : 10
Fixed Transmit Delay   : 0
Auto Transmit Delay    : ON
Number of Session      : 4
Total Session Started  : 4
Tx/Rx Buffer Size      : 2048
Transmit Record Size   : 256 or less
Data Traffic Started   : 17:52:37
Session ID (Addr/Port) : 200.200.200.203 #10376
Session Start Up Time  : 17:50:09
Session Type           : Enhanced TN3270
Device Type            : IBM-3278-2-E
Device Name            : TN32Ey42
Supported Functions    : BIND,DSC,RSP,SCS,SYSREQ
3270 Command Set       : Local
Session Status         : Active
Maximum Auto Tx Delay  : 33
Average Auto Tx Delay  : 16
Tx/Rx Blocking         : 8647
Number of Tx Delay     : 99
Number of Rx Timeout   : 0
Completed Transactions : 162
Session ID (Addr/Port) : 200.200.200.203 #10377
Session Start Up Time  : 17:50:11
Session Type           : Enhanced TN3270
Device Type            : IBM-3278-2-E
Device Name            : TN32Ey42.C
Supported Functions    : BIND,DSC,RSP,SCS,SYSREQ
3270 Command Set       : Local
Session Status         : Active
Maximum Auto Tx Delay  : 30
Average Auto Tx Delay  : 15
Tx/Rx Blocking         : 4651
Number of Tx Delay     : 58
Number of Rx Timeout   : 0
Completed Transactions : 156
Session ID (Addr/Port) : 200.200.200.203 #10378
Session Start Up Time  : 17:50:12
Session Type           : Enhanced TN3270
Device Type            : IBM-3278-2-E
Device Name            : TN32Ey42.D
Supported Functions    : BIND,DSC,RSP,SCS,SYSREQ
3270 Command Set       : Local
Session Status         : Active
Maximum Auto Tx Delay  : 30
Average Auto Tx Delay  : 15
Tx/Rx Blocking         : 17555
Number of Tx Delay     : 87
Number of Rx Timeout   : 0
Completed Transactions : 168
Session ID (Addr/Port) : 200.200.200.203 #10379
Session Start Up Time  : 17:50:13
Session Type           : Enhanced TN3270
Device Type            : IBM-3278-2-E
Device Name            : TN32Ey42.B
Supported Functions    : BIND,DSC,RSP,SCS,SYSREQ
3270 Command Set       : Local
Session Status         : Active
Maximum Auto Tx Delay  : 30
Average Auto Tx Delay  : 15
Tx/Rx Blocking         : 18041
Number of Tx Delay     : 58
Number of Rx Timeout   : 0
Completed Transactions : 161
Termination Time       : 17:53:39
Max UTEP Auto Tx Delay : 33
Total Auto Tx Delay    : 4704
Average UTEP Tx Delay  : 15
Total Tx/Rx Blocking   : 48894
Total # of Tx Delay    : 302
Total # of Rx Timeout  : 0
Total Transactions     : 647
Reason for Termination : 1 Minute Time Limit Expired
*************************** Performance Indicators ***************************
Elapsed Time           =   62.308  Sec
User Data Throughput   =    12883  Bits/Sec
Bits Per Second        =    13464  Bits/Sec
Throughput (TPS)       =   10.384  Transactions/Sec
Records Per Second     =   10.384  Records/Sec
Response Time          =    0.096  Sec/Transaction
MS3270 UTEP003 Ended (17:53:39 Thursday May 2, 1996)
>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<>=<

[ Home | About ACT | Services | Testing Information | Links | Download Demo | Jobs | FAQ | Products ]
Copyright © 1996,97 Applied Computer Technology, Le Claire, IA USA 972.240.6744
Last Updated: July 14, 1999 http://www.acomtech.com/act/itfms32.html