Tag Archives: beta

Apache ZooKeeper 3.5.3-beta Has Been Released

No Comments
Categories: ZooKeeper

The Apache ZooKeeper team has announced that Apache ZooKeeper release 3.5.3-beta is now available! This release is the first beta release of the 3.5 series, which cover 77 issues, thirteen of which were considered blockers. Here are some highlights:

New Feature

  • ZOOKEEPER-2719 Enable creation of TTL nodes, which are znode that’s not tied to a session and will get cleaned up automatically once expired.

Security Fixes

  • ZOOKEEPER-2014 Only admin roles should be allowed to reconfigure a cluster
  • ZOOKEEPER-2693 Prevent DOS attack on wchp/wchc four letter words (4lw)

Critical Bug Fixes

  • ZOOKEEPER-2383 Solve startup race in ZooKeeperServer
  • ZOOKEEPER-2172 Cluster crashes when reconfig a new node as a participant
  • ZOOKEEPER-2737 NettyServerCnxFactory leaks connection if exception happens while writing to a channel
  • ZOOKEEPER-2247 Zookeeper service becomes unavailable when leader fails to write transaction log
  • ZOOKEEPER-2080 Fix deadlock in dynamic reconfiguration
  • ZOOKEEPER-2687 Deadlock while shutting down the Leader server

Stability,

Read More

Apache Spark 2.0 Beta Now Available for CDH

14 Comments
Categories: Hadoop Spark

Today, Cloudera announced the availability of an Apache Spark 2.0 Beta release for users of the Cloudera platform.

Apache Spark 2.0 is tremendously exciting (read this post for more background) because (among other things):

  • The Dataset API further enhances Spark’s claim as the best tool for data engineering by providing compile-time type safety along with the benefits of a query-optimization engine.
  • The Structured Streaming API enables the modeling of streaming data as a continuous DataFrame and expresses operations on that data with a SQL-like API.

Read More

Announcing RecordService Beta 2: Brings Column-level Security to Apache Spark and MapReduce

2 Comments
Categories: General Platform Security & Cybersecurity Sentry Spark

With this new beta release, column-level privileges set via Apache Sentry (incubating) are now enforced on Spark/MapReduce jobs.

Cloudera is excited to announce the availability of the second beta release for RecordService. This release is based on CDH 5.5 and provides some new features, including:

  • Support for Sentry column-level security. Previously, column-level access control required the use of views; now,

Read More

Progress Report: Hive-on-Spark Nears Production Readiness

No Comments
Categories: Cloudera Labs Hive Spark

Contributors from Intel, Cloudera, and the rest of the community have been making strong progress on the Hive-on-Spark initiative. This post provides an update.

[Editor’s note (April 20, 2016): Hive-on-Spark is now GA/shipping starting in CDH 5.7.]

Since its inception about one year ago, the community initiative to make Apache Spark a data processing engine for Apache Hive (HIVE-7292) has attracted widespread interest from developers around the world and gone through phases of rapid development,

Read More

Docker is the New QuickStart Option for Apache Hadoop and Cloudera

20 Comments
Categories: CDH Ops and DevOps QuickStart VM Testing

Now there’s an even quicker “QuickStart” option for getting hands-on with the Apache Hadoop ecosystem and Cloudera’s platform: a new Docker image.

docker-logoYou might already be familiar with Cloudera’s popular QuickStart VM, a virtual image containing our distributed data processing platform. Originally intended as a demo environment, the QuickStart VM quickly evolved over time into quite a useful general-purpose environment for developers, customers, and partners. Today,

Read More