All times are UTC - 6 hours [ DST ]




Post new topic Reply to topic  [ 102 posts ]  Go to page Previous  1, 2, 3, 4, 5  Next
Author Message
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Wed Jun 07, 2017 12:31 pm 
Offline
FlightAware Staff
ericcarlson - FlightAware user avatar

Joined: Sun Jan 01, 2006 5:00 pm
Posts: 150
@invergordon allowing for the approximate 1-hour interval lag for the polar chart to update, yes you should see an aircraft position for that sector. The table data is near teal-time. I've opened a bug with the dev team to see if there is an issue there. It will need some investigation.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Fri Jun 09, 2017 4:58 pm 
Offline
FlightAware Member
invergordon - FlightAware user avatar

Joined: Wed Jan 01, 2014 4:18 pm
Posts: 110
Excellent Eric, thank you so much.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sat Jun 10, 2017 11:47 am 
Offline
KevPease - FlightAware user avatar

Joined: Sat Jun 10, 2017 10:34 am
Posts: 4
I have a hole in my data from 1600 – 1700 8 May 17, I viewed the log that evening and it showed no interruption of service.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Jun 11, 2017 11:43 am 
Offline
franzke - FlightAware user avatar

Joined: Thu Jun 12, 2014 7:51 am
Posts: 45
ericcarlson wrote:
rosen85 wrote:
Can someone explain what has happened?
I am a Flight Aware feeder since 5 April 2016, and that number stayed on my profile just the way it was.
And today I found that somehow according to Flight Aware I had joined on the 3th of May 2016.
How did that happen?
Take a look at the two screenshots. The left one is with the correct date, and the right one is from today.
Image Image


{edited} The new stats site is showing your joined date as May 3 because the site is a FlightFeeder. The intent is to show the FlightFeeder as "joining" when you first installed it. However, this is an older FlightFeeder that predates an internal software change when we improved our tracking of FlightFeeder requests. This should be correct for newer FlightFeeders but represents an edge case for older FlightFeeders. I will see if we can make a one-off correction here.


That doesn't seem to be entirely true. See my stats:

Geregistreerd: 21 maart 2016

Longest Streak: 367 days (8-9-2015 - 8-9-2016)

I have already re-registered my feeder for a few times because of data corrupion on the sd card (with the same serial), maybe that's the reason that date is shown?

*edit: my explanation doesn't make sense because that day is in the mentioned streak


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Jun 25, 2017 3:50 pm 
Offline
HiVolt - FlightAware user avatar

Joined: Sun Mar 20, 2016 1:45 pm
Posts: 8
Are there any current issues with FA? Seems like nothing is being received for the past 2+ hours, yet the log shows it is. Not sure if it's something I should be investigating myself, or its FA's glitch. The 3 indicators on my FA profile are all green, PiAware, FlightAware & MLAT.

[2017-06-25 16:33 EDT] mlat-client(26399): Receiver status: connected
[2017-06-25 16:33 EDT] mlat-client(26399): Server status: synchronized with 88 nearby receivers
[2017-06-25 16:33 EDT] mlat-client(26399): Receiver: 511.9 msg/s received 184.8 msg/s processed (36%)
[2017-06-25 16:33 EDT] mlat-client(26399): Server: 0.5 kB/s from server 0.0kB/s TCP to server 2.3kB/s UDP to server
[2017-06-25 16:33 EDT] mlat-client(26399): Results: 233.0 positions/minute
[2017-06-25 16:33 EDT] mlat-client(26399): Aircraft: 41 of 84 Mode S, 27 of 41 ADS-B used
[2017-06-25 16:35 EDT] 18329081 msgs recv'd from dump1090-mutabi (1826 in last 5m); 18329081 msgs sent to FlightAware
[2017-06-25 16:40 EDT] 18330919 msgs recv'd from dump1090-mutabi (1838 in last 5m); 18330919 msgs sent to FlightAware

Image

Edit: nevermind, it looks like it caught up after a few hours...


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jun 26, 2017 12:57 pm 
Offline
lankosher - FlightAware user avatar

Joined: Sun Dec 14, 2014 8:53 am
Posts: 31
What happened with my 3 hours of feeding?

For sure it has been feeding as I saw in Skyview. It looks like it all disappeared for no reason :(

Feeder 18599

Image


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue Jun 27, 2017 8:07 am 
Offline
FlightAware Staff
ericcarlson - FlightAware user avatar

Joined: Sun Jan 01, 2006 5:00 pm
Posts: 150
@lankosher, We are working on resolving that issue in combination with the performance improvements to ensure stats is keeping up with hourly processing.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue Jun 27, 2017 9:11 am 
Offline
FlightAware Member
joelwiley - FlightAware user avatar

Joined: Mon Mar 12, 2012 7:46 pm
Posts: 870
Noticed yesterday afternoon that site 407 showed nothing received for over 13 hours. Laptop showed continued uploads to planeplotter. Rebooted system. When it came back up, the stats appeared for those hours. Not sure where they were and what might have triggered it. Was there an issue with Planeplotter forwarding that got tweaked? Curioser and curioser :?


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Jun 29, 2017 5:51 am 
Offline
lankosher - FlightAware user avatar

Joined: Sun Dec 14, 2014 8:53 am
Posts: 31
ericcarlson wrote:
@lankosher, We are working on resolving that issue in combination with the performance improvements to ensure stats is keeping up with hourly processing.

Thank you Eric, can't wait to see positive results of the actions


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 03, 2017 2:09 am 
Offline
FlightAware Member
SoNic67 - FlightAware user avatar

Joined: Fri Jun 16, 2017 7:44 pm
Posts: 74
Location: Newport News, Virginia, USA
I am looking at my stats page: http://flightaware.com/adsb/stats/user/SoNic67
Maybe I don't understand how the stats are working, but this looks weird to a newcomer like me.
On my "nearby sites" page I see an user with 2724 planes and 494339 positions. Says that he is near me, at KRIC (Richmond airport). When I click on his name I get this:
http://flightaware.com/adsb/stats/user/pboyum

Well, the nearby airport is listed KSTP (St Paul, MN), aircraft reported are around 1200-1300, positions reported are around 200,000.
On his "nearby sites" page, I am not shown (because I am not near KSTP).

Is this correct? Is he merging the sites, and shows up in both locations with the added data? Doesn't this messes up statistics? It's kind of annoying to me, I was trying to see if can improve anything in my setup, based on the positions and results of my nearby sites (and their radar maps).


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 03, 2017 6:45 am 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3672
Click on the dropdown arrow on the orange bar and select the right site. That user has two sites.

https://flightaware.com/adsb/stats/user ... stats-4171

This used to work directly (the nearby-sites link would refer directly to the right site) but it looks like that broke at some point and you get the generic user page, which isn't always the right site if the user has more than one site. I'll raise a bug report for it.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 03, 2017 12:28 pm 
Offline
FlightAware Member
SoNic67 - FlightAware user avatar

Joined: Fri Jun 16, 2017 7:44 pm
Posts: 74
Location: Newport News, Virginia, USA
Thanks, that makes more sense!


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 03, 2017 12:48 pm 
Offline
FlightAware Member
joelwiley - FlightAware user avatar

Joined: Mon Mar 12, 2012 7:46 pm
Posts: 870
obj wrote:
This used to work directly (the nearby-sites link would refer directly to the right site) but it looks like that broke at some point and you get the generic user page, which isn't always the right site if the user has more than one site. I'll raise a bug report for it.
It seems to default to the lowest # site, which may be the generic site.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Jul 16, 2017 11:22 pm 
Offline
FlightAware Member
biekerc - FlightAware user avatar

Joined: Sat Jul 16, 2016 2:17 am
Posts: 65
Mmh, my daily stats of a/c and messages for vesterday (16.07.17) are extremely low, and I am sure they already had been higher during the day? May something to do with the change from mac to feederid identification of the the site?


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Jul 16, 2017 11:43 pm 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3672
Yes, this is fallout from the feeder ID changes - the daily stats for the 16th and the 17th will be off. I expect data from the 18th onwards to be OK. Looking at ways to fix the data for the 16th/17th.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 17, 2017 9:42 am 
Offline
FlightAware Member
abcd567 - FlightAware user avatar

Joined: Sat Feb 15, 2014 3:08 am
Posts: 2140
Location: Toronto CYYZ
obj wrote:
Yes, this is fallout from the feeder ID changes - the daily stats for the 16th and the 17th will be off. I expect data from the 18th onwards to be OK. Looking at ways to fix the data for the 16th/17th.

Even if the data for 16th/17th could not be fixed, it is OK for me.
After few days it will become archive, and I will never look to it again.

Thanks for feeder ID changes. Makes life easy.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 17, 2017 5:08 pm 
Offline
FlightAware Member
tdrane - FlightAware user avatar

Joined: Thu Jan 08, 2015 7:28 am
Posts: 119
obj wrote:
Yes, this is fallout from the feeder ID changes - the daily stats for the 16th and the 17th will be off. I expect data from the 18th onwards to be OK. Looking at ways to fix the data for the 16th/17th.


Am I having a Groundhog Day moment?

Site 5089 was stuck at 512 total aircraft earlier today, moved up to 1700+ and has now returned to 512.

I'll also mention that my location was "user set" on July 14 at 4:28 P.M. however it was not set by me (the user.) Is this part of the MAC to ID conversion?


(And one last thing, if I put quotes around the above Groundhog Day, I am greeted with a Forbidden 403 error. Huh?)


Last edited by tdrane on Mon Jul 17, 2017 5:20 pm, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 17, 2017 5:20 pm 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3672
Groundhog day is exactly what's happening. The problem is that during the feeder ID transition, data for a single feeder ended up being processed by two separate partitions, and those two partitions are now competing to write out what they think is the current daily count for the feeder. But only one partition is actually receiving live data for the feeder. Unfortunately I didn't catch it in time on the 16th and so it's affecting the 17th too. It'll stop doing that at UTC midnight, and we're reprocessing data for the 16th/17th to clean that up retrospectively.

The user location change is an unrelated bug where feeder locations were being incorrectly reset for a couple of days. The feeder locations themselves were rolled back to last Monday's locations but the timestamp wasn't.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 17, 2017 5:27 pm 
Offline
FlightAware Member
tdrane - FlightAware user avatar

Joined: Thu Jan 08, 2015 7:28 am
Posts: 119
obj wrote:
Groundhog day is exactly what's happening. The problem is that during the feeder ID transition, data for a single feeder ended up being processed by two separate partitions, and those two partitions are now competing to write out what they think is the current daily count for the feeder. But only one partition is actually receiving live data for the feeder. Unfortunately I didn't catch it in time on the 16th and so it's affecting the 17th too. It'll stop doing that at UTC midnight, and we're reprocessing data for the 16th/17th to clean that up retrospectively.

The user location change is an unrelated bug where feeder locations were being incorrectly reset for a couple of days. The feeder locations themselves were rolled back to Monday's locations but the timestamp wasn't.




Thanks, Obj. Get some rest, buddy. I think you've had a long and busy weekend!

From my new favorite T-shirt:

99 little bugs in the code,
99 little bugs.
Take one down, patch it around,
117 little bugs in the code.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 17, 2017 5:53 pm 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3672
tdrane wrote:
117 little bugs in the code.

I think you mean 4294967197 ;-)


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Jul 17, 2017 8:00 pm 
Offline
FlightAware Member
SoNic67 - FlightAware user avatar

Joined: Fri Jun 16, 2017 7:44 pm
Posts: 74
Location: Newport News, Virginia, USA
Don't know if is related... I have rebooted the FF to get back the MLAT to show on Skyview, and all was good.
But after a few hours, the MLAT was red. Seemed that my site lost the antenna height information, so... I have input it again and MLAT turned green again.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue Jul 18, 2017 10:09 am 
Offline
lankosher - FlightAware user avatar

Joined: Sun Dec 14, 2014 8:53 am
Posts: 31
Hi Colleagues,

Can yesterday's error be corected to reflect true stats? Some system bug wasted my whole daily effort :(

Site ID 18599

Image


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue Jul 18, 2017 11:05 am 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3672
Regeneration of the 16th/17th is already in progress


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Wed Jul 19, 2017 7:50 am 
Offline
lankosher - FlightAware user avatar

Joined: Sun Dec 14, 2014 8:53 am
Posts: 31
obj wrote:
Regeneration of the 16th/17th is already in progress


Good to know, thank you for your effort.

How long it will take for the data to regenerate? So far it hasn't changed at all.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Wed Jul 19, 2017 8:26 am 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3672
About 36 hours per day. The 16th just completed.

(trivia: there were approx 1.34 billion messages processed on the 16th)


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 102 posts ]  Go to page Previous  1, 2, 3, 4, 5  Next

All times are UTC - 6 hours [ DST ]


Who is online

Users browsing this forum: 41south, Google [Bot], matth20man, RenatoRibeiro, turracaine and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to: