25 Jan 2019 Read in about 3 min
Stream Reactor, the largest open-source collection of Apache Kafka connectors, has released today many new features, bug fixes and new connectors for Apache Hive!
Version 1.2.1 for Kafka Connect 2.1.0
A big thank you goes to the community who contributed to this release, not only with raising issues, but also talking with the community and raising multiple pull requests (PRs). Lets have a closer look at some of the changes:
Stream Reactor is an
Apache License, Version 2.0 open source collection of components built on top of Kafka and
provides Kafka Connect compatible connectors to move data between Kafka and popular data stores. Stream Reactor
source connectors to publish data into Kafka and
sink connectors to bring data from Kafka into other
systems. The connectors support KCQL (Kafka Connect Query Language),
an open source component of Lenses SQL Engine
that provides an elegant and simple SQL like syntax for selecting fields and routing
from sources or topics to Kafka or the target system (topic to target entity mapping,
field selection, auto creation, auto evolution, error policies).
We hope you find Stream Reactor useful, and want to give it a try! Stream Reactor has over 25 connectors available, tested and documented, supporting Kafka 2.1.0, you can give it a go by downloading Lenses Development Environment or find the jars on GitHub, or even build the code locally and help us improve and add even more connectors.
The new Hive source and sink build further on our list of supported connectors allowing data pipelines so be constructed quickly and easily end to end with SQL. The Connectors support included:
These features are integrated into KCQL, our connector SQL, simplifying configuration and keep config bloat to a minimum.
HDFS is often used a persistent store, but somethings you need to reload to replay data. The Hive source now makes this possible.
Follow us on Twitter @LandoopLtd, chat with us on Gitter, or join our Slack to talk with the community. If you find problems or have ideas how we can improve Stream Reactor, please let us know or log an issue.
Did you like this article?