New Benchmark Released for Evaluating Performance of SIP Servers

A new benchmark, SPECsip_Infrastructure2011, has been released by the non-profit Standard Performance Evaluation Corp. (SPEC) to evaluate the performance of Session Initiation Protocol (SIP) servers. This benchmark is designed to evaluate the performance of SIP servers in a VoIP deployment for an enterprise, telco, or service provider. The SPEC SIP subcommittee, which includes IBM, Intel, Oracle, and Red Hat, developed this benchmark with supporting contributions from Shay Gal-On of the Embedded Microprocessor Benchmarking Consortium (EEMBC).

Key Takeaways:

  • SPECsip_Infrastructure2011 is a benchmark for evaluating the performance of SIP servers in a VoIP deployment.
  • The benchmark is based on a proxy server modeling a typical VoIP deployment for an enterprise, telco, or service provider.
  • The primary metric for SPECsip_Infrastructure measures the simultaneous number of supported subscribers while meeting several quality of service (QoS) requirements.
  • The benchmark is expected to be used by developers, testers, performance analysts, and purchasing decision-makers.
  • SIP software vendors will use the benchmark to evaluate and improve the performance of their server products.
  • Hardware vendors will use the benchmark to determine how well their servers can handle VoIP workloads.
  • Users can benefit from the benchmark by comparing the performance of competing SIP servers in a VoIP environment.
  • The benchmark is a great tool for optimizing server provisioning.

Statistics:

  • The SPEC SIP subcommittee includes 4 members: IBM, Intel, Oracle, and Red Hat.
  • The benchmark is based on user behavior patterns from studies by Communigate Systems and IBM.
  • The benchmark is available immediately on CD for $800, with discounts available for qualified non-profit and educational institutions.
  • The SPEC organization has a membership of over 70 leading computer hardware and software vendors, educational institutions, research organizations, and government agencies.

Sources:

  • SPEC (www.spec.org)
  • Embedded Microprocessor Benchmarking Consortium (EEMBC)
  • IBM
  • Intel
  • Oracle
  • Red Hat
  • Communigate Systems