C Pointer and Reference
https://gist.github.com/sallos-cyber/d2bc782f09688beefb4e66068af03174
C / C++, Programming
Big Data Tools, Spark
Pyspark streaming from and to csv-file in Zeppelin: basic code example
Assumptions: zeppelin 10.0, and Spark 3.1.1. I assume Spark runs in one thread on a single machine (local) and Zeppelin runs on the same machine. The Spark-Home variable has been
Network Analysis
How to print flow information with nfdump to csv
Given you have created flows with nfpcapd, you can now use nfdump (more info here https://manpages.ubuntu.com/manpages/jammy/en/man1/nfdump.1.html) to write flows in a custom format to a csv-file. fmt indicates how to
Kafka
Kafka Streaming Json using Gson: How to rename a json field? (Actually this is a Gson topic)
Renaming: If you are reading in from a topic to which you sent data formatted as Json you must serialize the data, optionally process it and finally you serialize it
Kafka
Some handy Kafka commands (that I keep forgetting)
List all topics Consume from a given topic from console
Spark
How to access your clickhouse database with Spark in Python
Assumption: Spark and Clickhouse are up and running. According to the official Clickhouse documentation we can use the ClicHouse-Native-JDBC driver. To use it with python we simply download the shaded