About The Connector
License Apache 2.0
Kafka Connector that monitors files on an FTP server and feeds changes into Kafka. Provide the remote directories and on specified intervals, the list of files in the directories is refreshed. Files are downloaded when they were not known before, or when their timestamp or size are changed. Only files with a timestamp younger than the specified maximum age are considered. Hashes of the files are maintained and used to check for content changes. Changed files are then fed into Kafka, either as a whole (update) or only the appended part (tail), depending on the configuration. Optionally, file bodies can be transformed through a pluggable system prior to putting it into Kafka.
Implement custom file transformers, load files over FTP, convert them to meaningful events in Avro format.
Manage & Monitor Connectors
With 100+ Open Source Kafka connectors available - more than 30 enterprise grade connectors out of the box - integrate seamlessly with your data systems.
Enable CI/CD and automation, GitOps and promoting flows across environments with the open source CLI tool to deliver your apps to production quickly.