The Apache Hive team is hard at work putting the finishing touches on the 0.8.0 release. While the release hasn’t reached the GA milestone yet, I think now would be a good time to start highlighting some of the new features and improvements that users can expect to find in this important update:
The infrastructure required to support table indexes was originally added in the 0.7.0 release, but at the time no viable indexing plugin was provided. Project contributors have remedied this situation in the 0.8.0 release with the inclusion of support for bitmap indexes. This is a very important addition to Hive since it promises to significantly increase the performance of queries on indexed tables. More information about Hive Table Indexes can be found in the original design document, as well as in the comments that accompany the Bitmap Index JIRA ticket.
In response to frequent requests from users, Hive 0.8.0 will include support for the SQL TIMESTAMP datatype. We anticipate that this addition will make it much easier to integrate third-party ETL and BI tools with Hive. More information about the TIMESTAMP type can be found in the original JIRA ticket as well as in the Hive Language Manual.
Plugin Developer Kit
From the start, extensibility has been one of the key design goals of Hive; and the project has consistently delivered on this goal by providing a rich variety of extension points including User Defined Functions (UDFs), Serialization/Deserialization libraries (SerDes), StorageHandlers, and IndexHandlers. Up to this point one of the big inconveniences facing extension writers has been the requirement that they have access to a complete Hive source build. The new Hive Plugin Developer Kit seeks to relax this requirement by allowing developers to build and test extensions directly against a specific binary release of Hive. Currently the PDK is targeted only at UDFs, but there are plans to eventually extend this to support the other extension points including SerDes and StorageHandlers. More information about the Plugin Developer Kit can be found on the PDK page on the Hive Wiki.
JDBC Driver Improvements
The 0.8.0 release will also include several significant bug fixes and enhancements for the Hive JDBC driver. This module has received a lot of interest from the Hive user community due to the critical role it plays in enabling integrations between Hive and third-party ETL and BI tools.
I hope this quick overview has increased your interest in the next release of Hive. We expect the GA release of Hive 0.8.0 to drop sometime in the next couple of weeks, and look forward to getting feedback from the community about the new features described above.