FlightAware Discussions

Graphs for dump1090 -- my version with install script

As i don’t like all the clutter the adsb receiver-project introduces, i’ve written an install script for the collectd graphs for dump1090.

It is not widely tested yet and feedback regarding the layout of the graphs is very welcome. I’ve kept it rather close to the receiver-project.

Installation and configuration are described on the github page: http://github.com/wiedehopf/graphs1090#graphs1090

If you already have graphs installed i would not recommend installing these. While in my mind it should work there might be unforeseen problems :slight_smile:

At this point a thank you to mutability for originally creating those graphs (https://github.com/mutability/dump1090-tools) and thank you to the adsb receiver-project without which i would have probably never installed the graphs myself.

I’ve made some changes, including the following:

  • Remote messages are counted towards the message rate, that means if you use another receiver to funnel messages into dump1090, you will now have a message rate graph.
  • Added airspy CPU usage
  • More time ranges for the graphs (48h, 14d, 90d, 180d, 730d)
  • Increased graph sizes somewhat
  • Slightly different webpage layout
  • No php necessary to serve the page
  • The secondary grid is drawn white, make it easier to read the graphs in my opinion (slight artifacts in the colored areas, can’t disable the secondary grid lines)

Anyway this wasn’t meant to be the invention of something new, just a way to install only collectd graphs comfortably.

Not yet fully populated graphs look like this:

13 Likes

Great! Well done

SCREENSHOT 1 of 2

.
.

SCREENSHOT 2 of 2

(screenshot taken only 10 minutes after install, hence graph is only slightly filled)

2 Likes

Tested on following installs:

Image Integral Decoder Installed Decoder Dump1090 Graphs System Graphs
Piaware SD card image dump1090-fa :heavy_minus_sign: :white_check_mark: OK :white_check_mark: OK
Raspbian Stretch Lite image :heavy_minus_sign: dump1090-fa :white_check_mark: OK :white_check_mark: OK
Raspbian Stretch Lite image :heavy_minus_sign: dump1090-mutability ver 1.15~dev :white_check_mark: OK :white_check_mark: OK
Raspbian Stretch x86 iso in VM :heavy_minus_sign: dump1090-mutability ver 1.15~dev :white_check_mark: OK :white_check_mark: OK
Pi24 SD card image dump1090-mutability ver 1.14 :heavy_minus_sign: :x: Lot of Missing Graphs. See details below :white_check_mark: OK

.

Missing Graphs on Flightradar24’s Pi24 SD Card Image

Seems dump1090-mutability ver 1.14 lacks a lot compared to ver 1.15~dev

@obj : Any comments / advise will be very helpful
.

SCREENSHOT 1 of 2
image

.

SCREENSHOT 2 of 2
image

Could you post the total section of http://pi/dump1090/data/stats.json ?

Pi24 image with dump1090-mutability ver 1.14

http://192.168.0.21/dump1090/data/stats.json

{
"latest":{"start":1551032577.6,"end":1551032577.6,"local":{"blocks_processed":0,"blocks_dropped":0,"modeac":0,"modes":0,"bad":0,"unknown_icao":0,"accepted":[0],"strong_signals":0},"cpr":{"surface":0,"airborne":0,"global_ok":0,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":0,"local_ok":0,"local_aircraft_relative":0,"local_receiver_relative":0,"local_skipped":0,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":0,"reader":0,"background":0},"tracks":{"all":0,"single_message":0},"messages":0},
"last1min":{"start":1551032517.6,"end":1551032577.6,"local":{"blocks_processed":916,"blocks_dropped":0,"modeac":0,"modes":96003,"bad":69069,"unknown_icao":20140,"accepted":[3130],"strong_signals":0},"cpr":{"surface":0,"airborne":349,"global_ok":306,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":4,"local_ok":36,"local_aircraft_relative":36,"local_receiver_relative":0,"local_skipped":7,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":10060,"reader":2106,"background":116},"tracks":{"all":2,"single_message":1},"messages":3130},
"last5min":{"start":1551032277.6,"end":1551032577.6,"local":{"blocks_processed":4578,"blocks_dropped":0,"modeac":0,"modes":481397,"bad":344980,"unknown_icao":100894,"accepted":[16895],"strong_signals":0},"cpr":{"surface":2,"airborne":1979,"global_ok":1725,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":10,"local_ok":223,"local_aircraft_relative":223,"local_receiver_relative":0,"local_skipped":33,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":58794,"reader":11259,"background":694},"tracks":{"all":16,"single_message":4},"messages":16895},
"last15min":{"start":1551031677.6,"end":1551032577.6,"local":{"blocks_processed":13732,"blocks_dropped":0,"modeac":0,"modes":1454387,"bad":1038709,"unknown_icao":305454,"accepted":[52937],"strong_signals":0},"cpr":{"surface":5,"airborne":6168,"global_ok":5370,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":15,"local_ok":664,"local_aircraft_relative":664,"local_receiver_relative":0,"local_skipped":139,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":186855,"reader":30811,"background":2204},"tracks":{"all":51,"single_message":10},"messages":52937},
"total":{"start":1551029577.5,"end":1551032577.6,"local":{"blocks_processed":45613,"blocks_dropped":0,"modeac":0,"modes":4912023,"bad":3470973,"unknown_icao":1036331,"accepted":[200771],"strong_signals":0},"cpr":{"surface":12,"airborne":22754,"global_ok":19873,"global_bad":0,"global_range":0,"global_speed":0,"global_skipped":33,"local_ok":2295,"local_aircraft_relative":2295,"local_receiver_relative":0,"local_skipped":598,"local_range":0,"local_speed":0,"filtered":0},"cpu":{"demod":626526,"reader":97491,"background":7587},"tracks":{"all":240,"single_message":40},"messages":200771}
}

Yeah that’s a different format. As in the number of remote accepted messages is missing.
(And because i add local and network message rates up the message rate graphs don’t work)

Anyway who uses version 1.14? :slight_smile:

Majority of Flightradar24 feeders who use FR24’s SD Card image nick-name Pi24.
This image has integral dump1090-mutability ver 1.14.

Yeah i’m well aware, that question was rhetorical.

They will have to upgrade to 1.15, i like combining the network and local receiver messages in the graphs.
Gives compatibility for combine1090 or airspy users.

Too bad rrdgraph does not just assume all unknown values if a .rrd file is missing.
Then it could draw at least the rest of the graph instead of spitting out an error and not producing the picture at all.

@wiedehopf very well done! Your process made it quite simple for me to have the ‘performance in a picture’ without having to worry about the effects on the existing piaware/dump1090-fa installation, something I have been wanting for a while, but never had the time/nerve/motivation to take apart and tailor. Thank you so very much for the investment of your skill and perseverence in doing this. If you are ever in the States in the Black Hills of South Dakota, PM me - I will be honored to buy you at least one beverage of your choosing. tschüss (if that’s still used today)

2 Likes

Thank you :slight_smile:

Actually i’ve just buffed out a minor kink, if you want to update to the most current version you can just run the install script again. (It will keep all the data you’ve collected so far)
One of the graphs was being generated too often resulting in this interesting CPU graph:

Instead of generating the 7 day graphs at minute 8 and 40, they were being generated every minute from minute 8 to 40 after the hour :slight_smile:

1 Like

That is what I also wanted for long time. No email, no database, no php, just simple graphs, but was lazy to do it.

Thanks to @wiedehopf who took the initiative and did it.

.

2 Likes

What do you guys think, should the big graph be a little smaller than it currently is?
This would be a little closer to the size in the receiver-project.

Like this:

Or do you prefer it being the combined width of 2 small graphs?
Like this:

Overall i’ve tried to make the graphs and web page a little bigger, so they look good on bigger monitors.

Basically the webpage exactly fits the full width of my small laptop screen (1366x768) without scaling down the images.

For bigger monitors the webpage displays white borders left and right and keeps the panel at around 1362 pixels.

1 Like

from aesthetics I favor the second one with the wider graph.
there may be benefit to having them visually stand out from the receiver project so as to avoid confusion.
Either way, they look great.

Yes, this is what I prefer. Thanks for asking.

The second option is better, from a design standpoint. Think of a newspaper front page that has one column width elements, two column elements, they all are aligned.

I’ve beaten the html/css and users can now freely resize the images in an extra configuration file :wink:

Rejoice people with ridiculously large monitors!

I’ll tweak it a bit before pushing it out to github, so it’s not live yet.

Don’t know if this feature was on purpose or by accident, but I LIKE having the faint gridlines in the solid area of a graph (arrows point to them in the picture below). It gives me a better opportunity to know the detailed numbers behind the picture without having to go look a the source data. Time to dust off my ancient RRDtool books just to see how it is done - thank you!

image

I made the secondary grid color white because you can’t disable it and i wanted to remove some clutter from the pictures.
(Too many grid lines in my opinion)

Have a look at /usr/share/graphs1090.sh, that is where the graphs are are generated.

grid="-c GRID#FFFFFF --grid-dash 2:1"

That is the relevant line.
It’s a bash variable that makes it into all graph commands.

Configurable graph size and font size added: https://github.com/wiedehopf/graphs1090#configuration-optional

To upgrade to the new version, just run the install again.

1 Like

@wiedehopf very well done! It’s great to have the graphs without affecting the existing piaware/dump1090-fa page.

Everything works for me except for the ‘Bandwidth Usage’ graph. My RPi is on a wired connection, if that matters.