The Standard Performance Evaluation Corporation (SPEC®) is a non-profit consortium that establishes, maintains and endorses standardized benchmarks and tools to evaluate performance for the newest generation of computing systems. SPEC develops benchmark suites and also reviews and publishes submitted results from our member organizations and other benchmark licensees.
What's New:
12/05/2024: SPECwpc announced the availability of the SPECworkstation 4.0 benchmark, a major update to SPEC’s comprehensive tool designed to measure all key aspects of workstation performance. This significant upgrade from version 3.1 incorporates new workloads and modernizes existing workloads to keep pace with the latest workstation hardware and the evolving demands of professional applications, including the increasing reliance on data analytics, AI and machine learning.
November 26, 2024:: SPEC’s Embedded Group has published its inaugural newsletter, which offers insights into ongoing benchmark development and future initiatives.
June 20, 2024: The nomination period for the Kaivalya Dixit Distinguished Dissertation Award opens at the end of June. The award is open to dissertations defended between October 2022 and September 2024. The nomination deadline is September 30th, 2024 @23:59:59 AoE.
June 11, 2024: SPEC has released a new ISO-compliant version of the SERT suite. The SERT 2.0.8 Suite adds support for regulatory certification with NVIDIA Grace, AMD Instinct MI300A, and Microsoft Pioneer platforms. Additionally, SERT 2.0.8 contains the latest PTDaemon 1.11.0 interface and support for newer LTS java versions. Documentation was updated with clarification on closed loop liquid cooling support.
May 14, 2024: SPECapc announces the availability of the SPECapc® for Solidworks 2024 benchmark, an update to SPEC’s performance evaluation software for vendors and users of computing systems running Dassault Systèmes SolidWorks 2024 CAD/CAM software. The new version of the benchmark includes measurement for Hidden Line Removal (HLR), which has a dramatically improved algorithm.
May 2, 2024: The SPECjbb® 2015 benchmark has been updated to version 1.04. This update fixes crashes which were observed during the testing with the very large core count systems. Licensees of versions 1.00, 1.01, 1.02 and 1.03 are entitled to a complimentary V1.04 upgrade. SPEC will be retiring V1.03 in August 2024, after which time all result submissions must be made with V1.04.
March 6, 2024: Shreshth Tuli from the Imperial College London has been recognized as the winner of the 2023 Kaivalya Dixit Distinguished Dissertation Award for his work, "AI and Co-Simulation Driven Resource Management in Fog Computing Environments" The award will be presented at the 15th Annual ACM/SPEC International Conference on Performance Engineering (ICPE) conference.
March 4, 2024: ICPE 2024 - Call for Participation (Early Registration until March 15, 2024): Registration is open for the full conference (3-day conference, workshops, tutorials) or Workshops and Tutorials only. Registration deadlines are Early: March 15, 2024, Regular: April 12, 2024 and Late/Onsite: May 11, 2024. 15th ACM/SPEC International Conference on Performance Engineering Supported by ACM SIGMETRICS, SIGSOFT, and SPEC RG.
February 22, 2024: SPEC has released a new version of the PTDaemon® tool, the software that allows power measurement devices to be incorporated into performance evaluation software. PTDaemon greatly simplifies power and temperature benchmarking with SPEC benchmarks, eliminating the need to understand and adapt to different power analyzer interface protocols and behaviors.
February 20, 2024: Registration is now open for the Fifteenth ACM/SPEC International Conference on Performance Engineering (ICPE), taking place May 7-11, 2024, in London.
November 9, 2023: SPEC announced the availability of the SPECaccel® 2023 benchmark suite, a major update to the SPEC ACCEL® v1.4 benchmark, that measures the performance of key system components using computationally intensive parallel applications running under the OpenACC and OpenMP target offloading APIs.
October 30, 2023: SPEC announced that EEMBC®, the 25-year-old Embedded Microprocessor Benchmark Consortium, has become SPEC's new Embedded Group (SPEC EG). EEMBC is known for developing industry-standard benchmarks for measuring the performance and energy efficiency of embedded processor hardware and software used in autonomous driving, mobile imaging, the Internet of Things (IoT), mobile devices, and more. The addition of EEMBC broadens SPEC’s portfolio with more than 15 highly regarded benchmarks for embedded computers and enables both organizations to share workloads and infrastructure costs to allow for more investment in research and development.
July 25, 2023: SPECapc has released the SPECapc® for Creo 9 benchmark. The updated benchmark offers performance measurement for computing systems running PTC Creo 9. Creo is a popular 3D CAD solution that includes support for generative design, real-time simulation, advanced manufacturing, industrial IoT and augmented reality.
June 26 2023: This year's ACM/SPEC International Conference on Performance Engineering marked an exciting return to an in-person conference, and nearly 150 attendees enjoyed three keynote speeches, 28 research presentations, seven data challenge presentations, a range of workshops and more.
June 26, 2023: SPEC HPG Search program - SPEC is seeking to encourage those outside of SPEC to assist us in locating applications that could be used in the next SPEC high performance computing benchmark suite. For more details, go here.
[Older items can be found in the archive.]
