This blog post was updated March 2020 to reflect current certifications.
Dell EMC Isilon version OneFS 8.2.0 is now certified with HDP 3.1 and CDH 6.3.1 and Dell EMC ECS v3.3.0 is now certified with HDP 3.1.4 and CDH 6.3.2 as a S3 object store via the Cloudera QATS program!
Cloudera’s new streamlined Quality Assurance Test Suite (QATS) certification process is designed to validate HDP and CDH on a variety of Cloud, Storage & Compute Platforms. The validation and certification of Dell EMC’s Isilon storage solution is enabling us to grow our partnership.
Dell EMC Isilon scale-out Network Attached Storage (NAS) has the ability to natively run on HDFS and incorporates critical components of the HDFS software stack such as the name-node and data-node inside the OneFS software. Isilon’s architecture minimizes bottlenecks, rapidly serves petabyte scale data sets, and optimizes performance for Hadoop analytics.
Read Blog
Dell EMC Isilon & ECS are getting QATS Certified, what does that mean for you?
Certification of Isilon via Cloudera QATS Program
The QATS program is Cloudera’s highest certification level, with rigorous testing across the full breadth of HDP and CDH services. In this case, it focused on testing all the services running with HDP 3.1 and CDH 6.3.1 and it validated the features and functions of the HDP and CDH cluster.
QATS is a product integration certification program designed to rigorously test Software, File System, Next-Gen Hardware and Containers with Hortonworks Data Platform (HDP) and Cloudera’s Enterprise Data Hub(CDH). With dedicated Cloudera engineering resources to continuously and thoroughly test each release of HDP and CDH, QATS ensures that solutions are validated for a comprehensive suite of use cases and deliver high performance, under rigorous loads.
QATS functional testing was performed on the latest HDP 3.1 and CDH 6.3.1 version with Isilon OneFS v8.2.0. In addition, Stress, High Availability, Reliability, Performance, Operational Readiness, and Integration Testing were executed to ensure all components accommodate system demands.
This new certification enables Cloudera and Dell EMC to provide best-in-class support to our customers. The teams will continue to collaborate at various levels – across engineering R&D as well as Cloudera go-to-market plans – to ensure continuous product compatibility and high-quality customer service. And the team will continue to run QATS tests against future product versions.
Certification of ECS via Cloudera QATS Program
Dell EMC ECS v3.3.0 has now been certified as a S3 object store with HDP 3.1.4 and CDH 6.3.2 via the Cloudera QATS program.
For the ECS v3.3 certification with HDP 3.1.4, more than 1500 functional tests were successfully carried out on the following components: Spark, MapReduce, Tez, Hive/Hive LLAP, Sqoop and Pig.
For the ECS v 3.3 certification with CDH 6.3.2, more than 2400 functional tests were successfully carried out on the following components: Spark, Hive, Spark-Hive, MapReduce, Impala, Sqoop and Sentry.
QATS Test Coverage
The Cloudera QATS certification covers an extensive range of tests including:
- Functional testing of all HDP components including Hive, Hive with LLAP, HBase, and Spark with Kerberos security
- Functional testing of all CDH components including Hive, Impala, HBase, and Spark with Kerberos security.
- Integration tests to ensure that all services are configured, integrated, and are working well with each other
- Stress testing of different components that are used frequently
- Performance testing and validation
- Concurrency and multi-tenancy testing of Hive, Spark, HBase, and other highly utilized services
- Operational readiness testing to ensure alerts, monitoring, auditing, and more
What does this mean for our joint customers?
Certification of Isilon via the Cloudera QATS program provides our existing customers with better support and reduced risk. Clusters that use CDH/HDP in conjunction with Cloudera Certified Technologies operate with lower risk and lower total cost of ownership due to reduced hardware costs (TCO). Cloudera Certified Technologies have been thoroughly tested and validated to use supported APIs and to comply with Cloudera’s development guidelines for integration with Hadoop. Validation includes:
- Overall architecture
- Observance of the Hadoop interface classification system
- Complete integration testing
- Compliance with Cloudera support policies and requirements
- Cluster capability using real-world workloads and micro-benchmarks
Dell EMC Isilon OneFS v8.2.0 has now been certified with HDP 3.1 and CDH 6.3.1. The joint solution will be jointly supported by Cloudera and Dell EMC. The joint support process involves triaging any issue that occurs with our solution, regardless of where it is discovered and directing issues to the appropriate teams, either in Cloudera or Dell EMC.
The objective of the certification work with Dell EMC was to get Isilon certified through QATS as the primary HDFS store for both CDH (version 6.3.1) and HDP (version 3.1), with an emphasis to develop joint reference architecture and solutions around Hadoop Tiered Storage. Doing so will enable enterprises to use Direct Attached Storage (DAS) for hot data and Isilon for cold data within the same logical Hadoop cluster to simultaneously deliver extreme performance and economic scaling. Object stores have also gained popularity as a storage layer option for Hadoop, and to align with those trends, customers now also have the choice to adopt Dell EMC ECS v3.3 with HDP (version 3.1.4) and CDH (version 6.3.2).
For more information regarding Cloudera’s partnership with Dell EMC, please reach out to your local Cloudera account executive.
Editor's Choice
