Graphs for dump1090 -- my version with install script

[wiedehopf]

As i don’t like all the clutter the adsb receiver-project introduces, i’ve written an install script for the collectd graphs for dump1090.

It is not widely tested yet and feedback regarding the layout of the graphs is very welcome. I’ve kept it rather close to the receiver-project.

Installation and configuration are described on the github page: GitHub - wiedehopf/graphs1090: Graphs for readsb / dump1090-fa / dump1090 (based on dump1090-tools by mutability)

If you already have graphs installed i would not recommend installing these. While in my mind it should work there might be unforeseen problems

At this point a thank you to mutability for originally creating those graphs (GitHub - mutability/dump1090-tools: Random scripts for doing stuff with dump1090) and thank you to the adsb receiver-project without which i would have probably never installed the graphs myself.

I’ve made some changes, including the following:

• Remote messages are counted towards the message rate, that means if you use another receiver to funnel messages into dump1090, you will now have a message rate graph.
• Added airspy CPU usage
• More time ranges for the graphs (48h, 14d, 90d, 180d, 730d)
• Increased graph sizes somewhat
• Slightly different webpage layout
• No php necessary to serve the page
• The secondary grid is drawn white, make it easier to read the graphs in my opinion (slight artifacts in the colored areas, can’t disable the secondary grid lines)

Anyway this wasn’t meant to be the invention of something new, just a way to install only collectd graphs comfortably.

Not yet fully populated graphs look like this:

[abcd567]

Great! Well done

SCREENSHOT 1 of 2

.
.

SCREENSHOT 2 of 2

(screenshot taken only 10 minutes after install, hence graph is only slightly filled)

[abcd567]

Tested on following installs:

Image	Integral Decoder	Installed Decoder	Dump1090 Graphs	System Graphs
Piaware SD card image	dump1090-fa		OK	OK
Raspbian Stretch Lite image		dump1090-fa	OK	OK
Raspbian Stretch Lite image		dump1090-mutability ver 1.15~dev	OK	OK
Raspbian Stretch x86 iso in VM		dump1090-mutability ver 1.15~dev	OK	OK
Pi24 SD card image	dump1090-mutability ver 1.14		Lot of Missing Graphs. See details below	OK

.

Missing Graphs on Flightradar24’s Pi24 SD Card Image

Seems dump1090-mutability ver 1.14 lacks a lot compared to ver 1.15~dev

@obj : Any comments / advise will be very helpful
.

SCREENSHOT 1 of 2

.

SCREENSHOT 2 of 2

[wiedehopf]

Could you post the total section of http://pi/dump1090/data/stats.json ?

[abcd567]

@wiedehopf

total section of http://pi/dump1090/data/stats.json

Pi24 image with dump1090-mutability ver 1.14

http://192.168.0.21/dump1090/data/stats.json

{
"latest":{"start":1551032577.6,"end":1551032577.6,"local":{"blocks_processed":0,"blocks_dropped":0,"modeac":0,"modes":0,"bad":0,"unknown_icao":0,"accepted":[0],"strong_signals":0},"cpr":{"surface":0,"airborne":0,"global_ok":0,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":0,"local_ok":0,"local_aircraft_relative":0,"local_receiver_relative":0,"local_skipped":0,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":0,"reader":0,"background":0},"tracks":{"all":0,"single_message":0},"messages":0},
"last1min":{"start":1551032517.6,"end":1551032577.6,"local":{"blocks_processed":916,"blocks_dropped":0,"modeac":0,"modes":96003,"bad":69069,"unknown_icao":20140,"accepted":[3130],"strong_signals":0},"cpr":{"surface":0,"airborne":349,"global_ok":306,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":4,"local_ok":36,"local_aircraft_relative":36,"local_receiver_relative":0,"local_skipped":7,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":10060,"reader":2106,"background":116},"tracks":{"all":2,"single_message":1},"messages":3130},
"last5min":{"start":1551032277.6,"end":1551032577.6,"local":{"blocks_processed":4578,"blocks_dropped":0,"modeac":0,"modes":481397,"bad":344980,"unknown_icao":100894,"accepted":[16895],"strong_signals":0},"cpr":{"surface":2,"airborne":1979,"global_ok":1725,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":10,"local_ok":223,"local_aircraft_relative":223,"local_receiver_relative":0,"local_skipped":33,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":58794,"reader":11259,"background":694},"tracks":{"all":16,"single_message":4},"messages":16895},
"last15min":{"start":1551031677.6,"end":1551032577.6,"local":{"blocks_processed":13732,"blocks_dropped":0,"modeac":0,"modes":1454387,"bad":1038709,"unknown_icao":305454,"accepted":[52937],"strong_signals":0},"cpr":{"surface":5,"airborne":6168,"global_ok":5370,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":15,"local_ok":664,"local_aircraft_relative":664,"local_receiver_relative":0,"local_skipped":139,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":186855,"reader":30811,"background":2204},"tracks":{"all":51,"single_message":10},"messages":52937},
"total":{"start":1551029577.5,"end":1551032577.6,"local":{"blocks_processed":45613,"blocks_dropped":0,"modeac":0,"modes":4912023,"bad":3470973,"unknown_icao":1036331,"accepted":[200771],"strong_signals":0},"cpr":{"surface":12,"airborne":22754,"global_ok":19873,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":33,"local_ok":2295,"local_aircraft_relative":2295,"local_receiver_relative":0,"local_skipped":598,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":626526,"reader":97491,"background":7587},"tracks":{"all":240,"single_message":40},"messages":200771}
}

[wiedehopf]

Yeah that’s a different format. As in the number of remote accepted messages is missing.
(And because i add local and network message rates up the message rate graphs don’t work)

Anyway who uses version 1.14?

[abcd567]

@wiedehopf

Anyway who uses version 1.14?

Majority of Flightradar24 feeders who use FR24’s SD Card image nick-name Pi24.
This image has integral dump1090-mutability ver 1.14.

[wiedehopf]

Yeah i’m well aware, that question was rhetorical.

They will have to upgrade to 1.15, i like combining the network and local receiver messages in the graphs.
Gives compatibility for combine1090 or airspy users.

Too bad rrdgraph does not just assume all unknown values if a .rrd file is missing.
Then it could draw at least the rest of the graph instead of spitting out an error and not producing the picture at all.

[AhrBee]

@wiedehopf very well done! Your process made it quite simple for me to have the ‘performance in a picture’ without having to worry about the effects on the existing piaware/dump1090-fa installation, something I have been wanting for a while, but never had the time/nerve/motivation to take apart and tailor. Thank you so very much for the investment of your skill and perseverence in doing this. If you are ever in the States in the Black Hills of South Dakota, PM me - I will be honored to buy you at least one beverage of your choosing. tschüss (if that’s still used today)

[wiedehopf]

@AhrBee

very well done!

Thank you

Actually i’ve just buffed out a minor kink, if you want to update to the most current version you can just run the install script again. (It will keep all the data you’ve collected so far)
One of the graphs was being generated too often resulting in this interesting CPU graph:

Instead of generating the 7 day graphs at minute 8 and 40, they were being generated every minute from minute 8 to 40 after the hour

[abcd567]

@AhrBee

Your process made it quite simple for me to have the ‘performance in a picture’ without having to worry about the effects on the existing piaware/dump1090-fa installation, something I have been wanting for a while,

That is what I also wanted for long time. No email, no database, no php, just simple graphs, but was lazy to do it.

Thanks to @wiedehopf who took the initiative and did it.

.

[wiedehopf]

What do you guys think, should the big graph be a little smaller than it currently is?
This would be a little closer to the size in the receiver-project.

Like this:

Or do you prefer it being the combined width of 2 small graphs?
Like this:

Overall i’ve tried to make the graphs and web page a little bigger, so they look good on bigger monitors.

Basically the webpage exactly fits the full width of my small laptop screen (1366x768) without scaling down the images.

For bigger monitors the webpage displays white borders left and right and keeps the panel at around 1362 pixels.

[thespeedycab]

from aesthetics I favor the second one with the wider graph.
there may be benefit to having them visually stand out from the receiver project so as to avoid confusion.
Either way, they look great.

[abcd567]

@wiedehopf

Or do you prefer it being the combined width of 2 small graphs?

Yes, this is what I prefer. Thanks for asking.

[biekerc]

The second option is better, from a design standpoint. Think of a newspaper front page that has one column width elements, two column elements, they all are aligned.

[wiedehopf]

I’ve beaten the html/css and users can now freely resize the images in an extra configuration file

Rejoice people with ridiculously large monitors!

I’ll tweak it a bit before pushing it out to github, so it’s not live yet.

[AhrBee]

Don’t know if this feature was on purpose or by accident, but I LIKE having the faint gridlines in the solid area of a graph (arrows point to them in the picture below). It gives me a better opportunity to know the detailed numbers behind the picture without having to go look a the source data. Time to dust off my ancient RRDtool books just to see how it is done - thank you!

[wiedehopf]

@AhrBee

Don’t know if this feature was on purpose or by accident, but I LIKE having the faint gridlines in the solid area

I made the secondary grid color white because you can’t disable it and i wanted to remove some clutter from the pictures.
(Too many grid lines in my opinion)

Have a look at /usr/share/graphs1090.sh, that is where the graphs are are generated.

grid="-c GRID#FFFFFF --grid-dash 2:1"

That is the relevant line.
It’s a bash variable that makes it into all graph commands.

[wiedehopf]

Configurable graph size and font size added: GitHub - wiedehopf/graphs1090: Graphs for readsb / dump1090-fa / dump1090 (based on dump1090-tools by mutability)

To upgrade to the new version, just run the install again.

[pdops1]

@wiedehopf very well done! It’s great to have the graphs without affecting the existing piaware/dump1090-fa page.

Everything works for me except for the ‘Bandwidth Usage’ graph. My RPi is on a wired connection, if that matters.