SPECweb2005 Release 1.20 is a point release which fixes some of 
the issues in SPECweb2005 Release 1.10 and also adds a few new 
features not present in previous releases. Also included in this 
release are a couple of changes to the Run Rules document, neither 
of which would affect the previously submitted results or the 
comparability of results in this benchmark.

Details on the fixes and features added in SPECweb2005 Release 1.20.

1. OVERTHINK_TIME Errors: SPECweb2005 Release 1.10 and earlier accounted 
for the OVERTHINK Time, starting from the Thread Ramp up period. This 
resulted in more than the necessary/required amount of OVERTHINK_TIME 
related errors. The current version fixes this, by beginning to account 
for the OVERTHINK_TIME from the start of the Run Time period.

2. Reporter changes: The reporter changes in this release are to prevent 
a user from creating a valid combined run file from invalid sub-metric 
run files.  The previous version would allow the creation of a valid 
submission file using one or more invalid workload result files.   There 
are no other changes to the reporter and any issues with this version should 
be reported to the support mail alias for SPECweb.

3. BESIM update: The BESIM v1.0 ISAPI implementation from the original kit 
resulted in two Ethernet packets per HTTP response sent from the BESIM 
to the SUT.  The BESIM FCGI implementation only resulted in a single 
Ethernet packet for each HTTP response sent to the SUT.  By adapting 
the BESIM implementation to use v2.0 ISAPI interface the Windows IIS 
implementation was able to achieve the same packet rate as that of FCGI. 
The net result of this change was to keep the BESIM implementations network 
characteristics equivalent across the various OS and Web Server combinations.

4. Timestamp in the data: The new version features a timestamp in the data 
returned when POLL_CLIENTS is set to 1.

5. GUI abort Issue: Release 1.20 features a fix to an intermittent error 
where the GUI will abort at the end of a run interval and (prematurely) 
stop the test.

6. The new release will abort any run with a negative response time for 
*any* request (dynamic page or image), usually caused when the client 
syncs with a time server periodically.

7. Premature termination: In Release V1.10 and earlier, a premature 
termination of the prime client (ctrl-C or otherwise) implied that the 
load generating clients never terminated. The new release fixes this 
issue, thus eliminating the need to restart the load generating clients 
when the prime client end prematurely.

8. The cookie fix: The harness would include an extra CRLF in a header 
if more than one cookie was sent by the web server in the "Set Cookie:" 
field of its response. This would result in malformed HTTP headers with 
double-CRLFs between the "Cookie:" fields in subsequent request headers.
 





Run Rule Document Changes:

The following two Run Rules were introduced.

Addendum to Sec 2.1.1:

All marketed standards that a software product states as being adhered to 
must have passed the relevant test suits used to ensure compliance with 
the standards. For example, In the case of Java Servlet Pages, one must 
pass the published test suites from Sun.

Section 3.2.2.2 added:
3.2.2.2 SUT Software Tuning Limitations
The following SUT software tunings are not acceptable:
- Percentage of requests directed towards various NIC interfaces cannot 
  be varied between workloads.
  Instructions for Installing the SPECweb2005 Release 1.20 Update Kit
 o Rerun the installer (setup.jar or the Win32 EXE file) on all testbed  
   components (prime client, clients, and SUT) and BeSim. You can choose to 
   install into a directory with a previous version, although in this case 
   you should back up your *.config files.
    o Be sure that no copies of the client are currently running.
    o Consider renaming your SPECweb2005 directories to SPECweb2005-1.20  
      after the installation.

Copyright (c) 2007 Standard Performance Evaluation Corporation