Pipeline Replay Dataset
The Netsage Pipeline processes network data. Though there are some components and patterns we can use to test the behavior using things like the Ruby unit tests in logstash, and the generator pligin, but the best test is to replay network data and inspect the output in the grafana dashboard.
Two sample data set are provided for the two types of collectors we have (Netflow and Sflow). The network data and ips have been anonymized and should have no identifying information.
You can download the files from here.
Please take note of which ports the collectors are listing on. Check your docker-compose.override.yml file. If you are using default ports, they should match this example.
Currently the default ports are:
- 9998/udp for sflow
- 9999/udp for netflow
Naturally the collectors have to be running in order for any of this to be usable. You can read more on how to get them running in the Docker Simple Deployment Guide
In order to replay the data, use the following commands for netflow and sflow respectively:
Netflow#
Sflow#
Coming soon. nfreplay will not work with sflow data type.