Benchmarking big data

Benchmarking big data

The Transaction Processing Performance Council (TPC) launched TPCx-HS in 2014. The first—and to date, the only—vendor-neutral, industry standard big data benchmark, TPCx-HS measures the price, performance, and energy consumption of big data systems like Hadoop.

“Benchmarking provides an objective assessment of system performance and other variables,” says Raghunath Nambiar, distinguished engineer and chief architect of big data solutions for Cisco. “This is not only important for comparing and selecting technology options, but also for driving faster, less expensive, and more energy efficient systems.”

TPCx-HS is designed to measure both hardware and software, including:

  • Hadoop Runtime
  • Hadoop FileSystem API compatible systems
  • MapReduce layers

It can also be used to assess a broad range of system topologies and implementation methodologies, in a technically rigorous and directly comparable, vendor-neutral manner.

Establishing the big data benchmark
Cisco and MapR recently announced the first TPCx-HS results, setting the high performance benchmark for big data systems.

“We published not one but three results,” says Nambiar, “at 1TB, 3TB, and 10TB scale factors.”

The benchmark configuration includes the Intel® Xeon® processor-based Cisco Unified Computing System(Cisco UCS®) Integrated Infrastructure for Big Data, two redundant active-active Cisco UCS 6296 Fabric Interconnects running Cisco UCS Manager version 2.2, 16 Cisco UCS C240 M3 Servers running Red Hat Enterprise Linux Server 6.4, and MapR Distribution with Apache Hadoop.

“TPC benchmarks are highly regarded in the industry and we are pleased to establish these high-performance standards for Hadoop,” says Jon Posnik, vice president of business development at MapR. “These results validate the scale, performance, and availability of the MapR Distribution. We’re already seeing tremendous demand for the combined solution with Cisco to enable utility-grade Hadoop environments.”

Big data reference architectures and infrastructure bundles now available

Hadoop clusters, analytics software, and supplementary big data technologies all have one thing in common: A fundamental need for a rock-solid, tightly integrated infrastructure on which to operate.

“Big data is all about pulling a wide variety of data sources into a common environment,” says Raghunath Nambiar, distinguished engineer and chief architect of big data solutions for Cisco. “That requires alignment and orchestration spanning compute, storage, networking, and application environments.”

Cisco and its big data partners offer just that. Through the Intel Xeon processor-based Cisco UCS Integrated Infrastructure for Big Data, organizations have access to a set of reference architectures and solution bundles that are designed for big data deployments. Validated designs are available for leading Hadoop platforms and analytics software.

“The architectures can be used as is or customized to meet specific business requirements,” says Nambiar. “We also have a number of single SKU bundles that make it easy to order and deploy big data environments.”

The new Cisco UCS Director Express for Big Data enables end-to-end cluster management and monitoring, he adds. And Cisco Nexus® 7000 and 9000 switches in tandem with Cisco® Application Centric Infrastructure (Cisco ACITM) deliver best-in-class scalability.

“With these reference architectures, solution bundles, and [Cisco] UCS Director Express, organizations can focus squarely on innovation and business outcomes,” says Nambiar. “They don’t have to worry about piecing together the infrastructure or optimizing it for the Hadoop and analytics software they plan to use.”

Read Nambiar’s blog on Cisco UCS Integrated Infrastructure, and visit the Design Zone to learn more about the third generation of the Cisco UCS Common Platform Architecture for Big Data.

Related Articles

Business agility, beyond the hype

view article

MapR executive: Architecture matters

view article

Big data on-ramps

view article
Download PDF


Log In

Please enter your email address to log in:

Email not found, please try again or click Register below.

Register now for full site access.


Join today to gain full site access and stay up to date on IT trends and innovations.

Already a subscriber? Log in now for full site access.

All fields are required.