Dell EMC Isilon version OneFS 8.2.0 is now certified with HDP 3.1 and CDH 6.3.1 via the Cloudera QATS program!
Cloudera’s new streamlined Quality Assurance Test Suite (QATS) certification process is designed to validate HDP and CDH on a variety of Cloud, Storage & Compute Platforms. The validation and certification of Dell EMC’s Isilon storage solution is enabling us to grow our partnership.
Dell EMC Isilon scale-out Network Attached Storage (NAS) has the ability to natively run on HDFS and incorporates critical components of the HDFS software stack such as the name-node and data-node inside the OneFS software. Isilon’s architecture minimizes bottlenecks, rapidly serves petabyte scale data sets, and optimizes performance for Hadoop analytics.
What is the Cloudera QATS Program?
The QATS program is Cloudera’s highest certification level, with rigorous testing across the full breadth of HDP and CDH services. In this case, it focused on testing all the services running with HDP 3.1 and CDH 6.3.1 and it validated the features and functions of the HDP and CDH cluster.
QATS is a product integration certification program designed to rigorously test Software, File System, Next-Gen Hardware and Containers with Hortonworks Data Platform (HDP) and Cloudera’s Enterprise Data Hub(CDH). With dedicated Cloudera engineering resources to continuously and thoroughly test each release of HDP and CDH, QATS ensures that solutions are validated for a comprehensive suite of use cases and deliver high performance, under rigorous loads.
QATS functional testing was performed on the latest HDP 3.1 and CDH 6.3.1 version with Isilon OneFS v8.2.0. In addition, Stress, High Availability, Reliability, Performance, Operational Readiness, and Integration Testing were executed to ensure all components accommodate system demands.
This new certification enables Cloudera and Dell EMC to provide best-in-class support to our customers. The teams will continue to collaborate at various levels – across engineering R&D as well as Cloudera go-to-market plans – to ensure continuous product compatibility and high-quality customer service. And the team will continue to run QATS tests against future product versions.
QATS Test Coverage
The Hortonworks QATS certification covers an extensive range of tests including:
- Functional testing of all HDP components including Hive, Hive with LLAP, HBase, and Spark with Kerberos security
- Functional testing of all CDH components including Hive, Impala, HBase, and Spark with Kerberos security.
- Integration tests to ensure that all services are configured, integrated, and are working well with each other
- Stress testing of different components that are used frequently
- Performance testing and validation
- Concurrency and multi-tenancy testing of Hive, Spark, HBase, and other highly utilized services
- Operational readiness testing to ensure alerts, monitoring, auditing, and more
What does this mean for our joint customers?
Certification of Isilon via the Cloudera QATS program provides our existing customers with better support and reduced risk. Clusters that use CDH/HDP in conjunction with Cloudera Certified Technologies operate with lower risk and lower total cost of ownership due to reduced hardware costs (TCO). Cloudera Certified Technologies have been thoroughly tested and validated to use supported APIs and to comply with Cloudera’s development guidelines for integration with Hadoop. Validation includes:
- Overall architecture
- Observance of the Hadoop interface classification system
- Complete integration testing
- Compliance with Cloudera support policies and requirements
- Cluster capability using real-world workloads and micro-benchmarks
Dell EMC Isilon OneFS v8.2.0 has now been certified with HDP 3.1 and CDH 6.3.1. The joint solution will be jointly supported by Cloudera and Dell EMC. The joint support process involves triaging any issue that occurs with our solution, regardless of where it is discovered and directing issues to the appropriate teams, either in Cloudera or Dell EMC.
The objective of the certification work with Dell EMC was to get Isilon certified through QATS as the primary HDFS store for both CDH (version 6.3.1) and HDP (version 3.1), with an emphasis to develop joint reference architecture and solutions around Hadoop Tiered Storage. Doing so will enable enterprises to use Direct Attached Storage (DAS) for hot data and Isilon for cold data within the same logical Hadoop cluster to simultaneously deliver extreme performance and economic scaling.
There is also a plan to certify Dell ECS as the S3 object store using QATS for both CDH and HDP.
For more information regarding Cloudera’s partnership with Dell EMC, please reach out to your local Cloudera account executive.