Time to comply with the European Union's General Data Protection Regulation (GDPR) is fast approaching. Starting on May 25, 2018, any organization failing to satisfy the new regulation faces fines as well as the potential suspension of any further data processing activities. Irrespective of whether you have a physical presence in the EU, if you are handling EU citizen data in any way, you are subject to the GDPR.
When it comes to security, Apache Kafka as every distributed system provides the mechanisms to transfer data securely across the components being involved. Depending on your set up this might involve different services such as Kerberos, relying on multiple TLS certificates and advanced ACL setup in brokers and Zookeeper. In many cases, with encryption features enabled, performance is also taking a penalty hit.
Even though, a secure network infrastructure ensures the data encryption in-transit, what happens when your data is at-rest and even after they leave the cluster?READ BLOG
Data lineage is represented visually to discover the data flow/movement from its source to destination via various changes and hops on its way in your enterprise data pipelines, how the data gets transformed along the way, how the representation and parameters change, and how the data splits or converges after each hop.