Operational Database Performance Improvements in CDP Private Cloud 7 vs CDH5

Cloudera Data Platform (CDP) Private Cloud is the most comprehensive on-premises platform for integrated analytics and data management. It combines the best of Cloudera Enterprise Data Hub and Hortonworks Data Platform Enterprise Plus, and brings the latest and greatest open source technologies for data management and analytics to the data center. 

With the latest version (7) of CDP Private Cloud, we’ve introduced a number of new features and enhancements. In this blog post, we would like to share the performance improvements available in Apache HBase (HBase1 vs HBase2). 

For those who are new to HBase or are evaluating it for a new project, HBase is a non-relational distributed database that is trusted by architects and developers who want to process large volumes of data in a timely and reliable manner. 

For this performance comparison, we measured HBase2 available in CDP Private Cloud 7 to Hbase1 available in CDH 5 using YCSB workloads. The comparison helps us understand the performance improvements and implications for customers doing in-place upgrades with no changes to underlying hardware. 

Note: Customers who are upgrading from CDH 5 to CDP 7 will get an HBase upgrade from HBase1 to HBase2 as well.

CDH5 vs CDP 7 Throughput

  • Custom YCSB Update Only workload
    • Our custom YCSB Update Only workload performs 
      • 100% UPDATE operations
    • An application example would be a metrics store
    • Workload performance: CDP 7 YCSB Update Only workload run throughput (operations per second) was 20% better than when run with CDH5

CDH 5 vs CDP 7 Throughput

  • YCSB WorkloadA 
    • YCSB Workload A performs 
      • 50% READ operations
      • 50% UPDATE operations
    • An application example would be a session store recording recent actions in a user session 
    • Workload performance: CDP Private Cloud 7.1 HBase2 YCSB workload A throughput (operations per second) was 15% better than CDH5 HBase1

CDH 5 vs CDP 7 Throughput

  • YCSB Workload C (Read Only) 
    • YCSB Workload C is a read only workload and performs 
      • 100% READ operations
    • An application example would be read user profile cache when profiles are constructed elsewhere (e.g Hadoop) or a banking system to access and view account statements 
    • Workload performance: CDP 7 YCSB workload C had similar throughput (operations per second) to CDH 5

Verdict – CDP 7 provides improved performance than CDH 5 in YCSB  

Custom UpdateOnly workload: CDP 7 YCSB Update only workload performed 20% better than C5. 

YCSB Workload A: CDP 7 YCSB workload A performed 15% better than CDH5. 

YCSB Workload C: CDP 7 YCSB read only workload C had similar operations/throughput to CDH 5 

During our testing, we noticed that upgrading from JDK8 to JDK 11 within CDP 7 can improve performance by another 10%. This is over and above the performance improvements gained by upgrading from CDH5 to CDP7. 

CDP 7 comes with JDK8 installed by default, and supports an upgrade to JDK11. In our test runs, CDP 7 was updated to use JDK 11 for YCSB workload runs shown above. We ran the same workloads with JDK8 as well, and the test results showed JDK11 performance is 5-10% better as compared to JDK8, as shown in the below chart

CDP 7 JDK8 vs JDK11 Throughput

 

To upgrade CDP 7 from JDK 8 to OpenJDK 11, please follow below steps:

Step 1: Install OpenJDK11 on all hosts using the below

RHEL 

sudo yum install java-11-openjdk

Ubuntu

sudo apt install openjdk-11-jdk

Step 2: On the Cloudera Manager Server host only (not required for other hosts):

  1. Open the file /etc/default/cloudera-scm-server in a text editor.
  2. Edit the line that begins with export JAVA_HOME (if this line does not exist, add it) and change the path to the path of the new JDK (the JDK is usually installed in /usr/lib/jvm)(or /usr/lib64/jvm on SLES 12), but the path may differ depending on how the JDK was installed).

For more info on upgrading JDK please follow Upgrading the JDK

Test Environment

Test Methodology

CDH 5.16.3/HBase1 was installed on the cluster and workload data with 1 billion rows (Dataset size 1TB) was generated and CDH 5.16.3 YCSB workloads were run. After loading, we waited for all compaction operations to finish before starting the workload test.

Once CDH 5.16.3 runs were completed, CDP Private Cloud 7.1 HBase2 was clean-installed and the data re-generated on the same cluster. The CDP Private Cloud 7.1 YCSB workloads were then run to get the test timings. Before every workload run, we initialized the HBase table used by YCSB. Snapshot of the usertable utable_snap were created and applied before every run. 

Each workload tested was run 3 times for 15min each to measure throughput*. The results shown are the averages taken from the 3 tests.

*Throughput (ops/sec) = No. of operations per second

CDP Private Cloud 7.1 includes HBase2 and CDH 5.16.3 includes HBase1. Both CDP Private Cloud 7.1 and CDH5 have JDK 8 installed. CDP Private Cloud 7.1 supports JDK11 and CDP Private Cloud 7.1 was updated to use JDK 11 for YCSB testing, CDH 5.13.3 runs were run with JDK 8 (1.8.0_141)

Test configurations

    • YCSB Version 0.17.0
    • YCSB Binding Version hbase2(CDP-CD 7.1) and hbase1(CDH 5) 
    • YCSB clients used 2
    • YCSB threads per client 20
    • YCSB table @1TB scale

 

  • Data size 

 

    • Total number of records (each record is 1KB) in the YCSB table 1,000,000,000 (1TB)
    • Number of Regions in the YCSB table 250, with 5+1 node cluster its approx 50 regions per region server
    • Average Region storage space used per server size 290G
  • HBase Region servers were configured with 32GB heap 
  • Only L1 cache with LruBlockCache was used with 12.3 GB cache size
  • L1 cache hit percent observed during runs on region servers was 85%
  • L2 off heap cache was not configured on the cluster

Cluster configs

  • Cluster used : 6 node cluster (1 master + 5 region servers)
  • Description: Dell PowerEdge R430, 20c/40t Xenon e5-2630 v4 @ 2.2Ghz, 128GB Ram, 4-2TB disks
  • Security: None configured (No Kerberos)

Cloudera versions compared

C7 Version: CDP Private Cloud 7.1.0

C5 Version: CDH5.16.3

JDKs used: JDK 8 (1.8.0_141) and JDK 11(11.0.6)

Based on our testing (results above), customers looking to upgrade from CDH 5 to CDP 7 should expect improved performance for similar workloads as compared to what they are getting today.

Learn more about Cloudera Operational DB here

The post Operational Database Performance Improvements in CDP Private Cloud 7 vs CDH5 appeared first on Cloudera Blog.

Leave a Reply

Your email address will not be published. Required fields are marked *