Assumptions: zeppelin 10.0, and Spark 3.1.1. I assume Spark runs in one thread on a single machine (local) and Zeppelin runs on the same machine. The Spark-Home variable has been […]
Given you have created flows with nfpcapd, you can now use nfdump (more info here https://manpages.ubuntu.com/manpages/jammy/en/man1/nfdump.1.html) to write flows in a custom format to a csv-file. fmt indicates how to
Renaming: If you are reading in from a topic to which you sent data formatted as Json you must serialize the data, optionally process it and finally you serialize it
List all topics Consume from a given topic from console
Assumption: Spark and Clickhouse are up and running. According to the official Clickhouse documentation we can use the ClicHouse-Native-JDBC driver. To use it with python we simply download the shaded
