29 Aug 2017 Read in about 3 min
Our popular open source web tools and fast data integrations have helped our users to demystify their Kafka Cluster and simplify their streaming experience.
We collected our customers’ feedback for new features and brought together a unified platform to enable a whole new experience to Kafka. Lenses it is !
Over the past year, we have been actively working on building a number of Kafka Connectors that support our SQL library in order to improve expressibility and simplicity but also introducing new capabilities for the data injection process.
We worked with our customers to see what would solve their real problems and we modeled a wider Kafka SQL layer that supports a lot more exciting features such as live data browsing, analysis, and management of SQL streams.
The main benefit it provides is a logical and concise syntax to define transformations by creating SQL Streams via a simple web interface but also enable non-technical users to interact with their data streams in real time, export and analyze.
Here is a fraud detection example:
SELECT isFraud, lower(`type`) AS paymentType, newbalanceDest * 1.28 AS amountUSD, cast(substring(_key.nameOrig,4) AS long) AS id, _offset AS msgOffset FROM paysim_fraud_detection WHERE _vtype='AVRO' AND _ktype='AVRO' AND TYPE LIKE 'CASH%' AND amount > 10000 AND _partition IN (0, 1) AND _sample = 100
Lenses provides features and web tools that leverage our Landoop SQL for Data Browsing, Kafka Connectors, Register SQL Streams but also a supported web socket library to enable developers to build their apps by using streaming queries.
Here is an overview of Lenses features:
Data Browsing, Live streams, Managed schema changes, Publish, subscribe and configure topics.
Explore partitions by offset
Manage Consumer offsets, Monitor consumer lag in real time, collect and handle Consumer Group events.
Zero code Kafka integration with the most popular data sources via a simple web interface to setup and monitor connectors.
Manage ACLs, Quotas & Users, Project tags
Health checks, JMX Metrics monitoring and Alerting in app but also with Grafana/Prometheus integration.
Did you like this article?