After only three months of work, the developers of the Apache Hop community can announce the general availability of their data integration platform Apache Hop Orchestration Platform (Hop) in a new major release with version number 2.0. They report that the conversion of the entire project to Java 11 alone would justify such a major version, but they can also report a whole range of other innovations and extensions.
Full update to Java 11 and new plugins
According to the developers in their blog, Hop’s code ran on Java version 8 in the previous versions of the platform. With the new release, the Hop programmers have now completely switched to Java 11 and explicitly describe this step as “no small task “.
New Transform plugins available with this release include Apache Avro File Output, which can write Apache Avro messages to a file or field. The plug-in can convert writes to binary files or fields to Avro Binary or JSON formats.
The new Transform plugin Apache Avro File Output can write Apache Avro messages to a file or field.
(Bild: Apache Software Foundation)
The Apache Doris Bulk Loader, which is also new, is an analysis tool for MPP databases. Apache Doris can meet various data analysis needs. The developers cite historical data reporting, real-time data analysis, interactive data analysis, and exploratory data analysis as examples. The plug-in is intended to enable very fast queries and data analysis in real time. Thanks to its distributed architecture, data sets of up to 10 PB are supported and should also be easy to use. The Apache Doris Bulk Loader Transformation was made available by the Apache Doris community.
Work better with rules and formulas
Apache Hop’s Rules Accumulator collects incoming rows and executes them based on a set of rules. This enables developers, for example, to determine the answer to a question or to analyze a data set in other ways. The current implementation of the rules engine is Drools (840429). The newly added Drools Rules Executor now also allows fields of incoming rows to be executed based on a set of rules. This can be useful to get additional information or to pass rows to another transformation. Furthermore, the Formula Transform now also allows developers to apply Excel-like formulas and functions to fields in a pipeline.
Interested developers can read a detailed description of all other new features, including the translation of Apache Hop into simplified Chinese (zh_CN) and updates and improvements for Hop Translator, in the blog post by the Apache Hop team.
To home page
#Data #integration #Big #step #version #Apache #Hop