About The Connector

License Apache 2.0

Kafka Connector that monitors files on an FTP server and feeds changes into Kafka. Provide the remote directories and on specified intervals, the list of files in the directories is refreshed. Files are downloaded when they were not known before, or when their timestamp or size are changed. Only files with a timestamp younger than the specified maximum age are considered. Hashes of the files are maintained and used to check for content changes. Changed files are then fed into Kafka, either as a whole (update) or only the appended part (tail), depending on the configuration. Optionally, file bodies can be transformed through a pluggable system prior to putting it into Kafka.

Download Try it Free with Lenses Box!

Resources

Blog
Getting data from FTP into Kafka

Implement custom file transformers, load files over FTP, convert them to meaningful events in Avro format.


Manage & Monitor Connectors

Lenses Web Interface

With 100+ Open Source Kafka connectors available - more than 30 enterprise grade connectors out of the box - integrate seamlessly with your data systems.

Lenses CLI

Enable CI/CD and automation, GitOps and promoting flows across environments with the open source CLI tool to deliver your apps to production quickly.

Ready to get started with Lenses?

Start your free trial today