All times are UTC - 6 hours [ DST ]




Post new topic Reply to topic  [ 63 posts ]  Go to page 1, 2, 3  Next
Author Message
 Post subject: What's up with ADS-B Statistics?
PostPosted: Thu Apr 06, 2017 10:49 am 
Offline
FlightAware Staff
ericcarlson - FlightAware user avatar

Joined: Sun Jan 01, 2006 5:00 pm
Posts: 116
This thread is for updates on the ADS-B Statistics which are viewable at https://flightaware.com/adsb/stats or on your own "My ADS-B" page.

Statistics are calculated and updated on the web site on an hourly basis. During busy times statistics may get more than 1 hour "behind" real-time. Over time we address this with the addition of more hardware and further performance optimizations of the software.

3-Apr-2017 - Additional hardware deployed to support the continued rapid growth of the ADS-B network. We are adding over 100 new sites per week.
4-Apr-2017 - An issue has been identified where some sites' statistics are not updating properly after the maintenance performed yesterday.
6-Apr-2017 - All known issues with statistics calculation are resolved as of around 16:00Z. Statistics should start generating in the next hour for sites that were experiencing missing stats. We are looking into filling-in missing daily stats for sites that experienced issues this week.
10-Apr-2017 - Stats for the April 3 and 4 were restored over the weekend. Stats for April 5 and 6 are incomplete and not yet recalculated.
12-Apr-2017 - Stats for April 5 and 6 are being regenerated.
13-Apr-2017 - Stats for April 5 are restored.
18-Apr-2017 - Stats for April 6 are pending while we make some further optimizations and perform testing.
2-May-2017 - Some users are reporting isolated issues with hourly or daily stats not appearing on their My ADS-B page. We are investigating this issue.
11-May-2017 - The issue with isolated stats missing in one-off intervals has been identified and a solution is under development.
16-May-2017 - Isolated missing stats issue has been resolved on a go-forward basis. Please report any further issues on this thread.

We will update our progress on this thread.

Even though the stats may not be updating for your site, your data is still being received and captured by FlightAware for flight tracking (barring any other unrelated issue that your site may have at the time).


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 06, 2017 11:25 am 
Offline
FlightAware Member
abcd567 - FlightAware user avatar

Joined: Sat Feb 15, 2014 3:08 am
Posts: 1980
Location: Toronto CYYZ
Great! Thanks for the update.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 06, 2017 4:22 pm 
Offline
FlightAware Member
conligwx - FlightAware user avatar

Joined: Sat Mar 18, 2017 8:00 pm
Posts: 88
Location: EGAC/EGAD
Thanks for the explanation.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 06, 2017 4:31 pm 
Offline
FlightAware Member
tdrane - FlightAware user avatar

Joined: Thu Jan 08, 2015 7:28 am
Posts: 109
They love us, they really do love us! :P


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 06, 2017 4:35 pm 
Offline
FlightAware Member
idh - FlightAware user avatar

Joined: Tue Oct 01, 2013 12:08 pm
Posts: 113
Back filling? Looks more like back emptying here :roll: :

ads-b-flight-tracking-f21/lost-data-t38874.html


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 06, 2017 4:36 pm 
Offline
FlightAware Member
conligwx - FlightAware user avatar

Joined: Sat Mar 18, 2017 8:00 pm
Posts: 88
Location: EGAC/EGAD
just noticed, my stats for 04 are now gone completely, and the stats I did have for 03 were ok , but have been reduced significantly in the last 30 minutes. to next to nothing....


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 06, 2017 4:52 pm 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3463
Yes, that's the backfill in progress; we clear the existing stats and then regenerate them from scratch. You'll also see that you have a day-long hole in the hourly data, slowly filling in. Regenerating the stats is a slow process so it'll be like this for a while.

edit: the 3rd's daily totals have been restored. Data for the 4th is still processing; daily totals and hourly data are partially updated.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 06, 2017 8:05 pm 
Offline
MarkTe - FlightAware user avatar

Joined: Fri Oct 08, 2010 7:00 pm
Posts: 3
Thanks for the update and the investment in money and time.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sat Apr 08, 2017 4:11 am 
Offline
FlightAware Member
conligwx - FlightAware user avatar

Joined: Sat Mar 18, 2017 8:00 pm
Posts: 88
Location: EGAC/EGAD
Eric, is there still more to import on the 04/04?

I noticed now I have some stats but not all. 103,831 at present, there was at least 190,000 that day with 900 Aircraft. The hourly received reports dont tally up with the 4ths daily received/aircarft values.

Also 1am-2am on the 05th has no data either so looks like some data is still incomplete and you had not mentioned the 5th at all.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sat Apr 08, 2017 5:37 am 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3463
See what I said:
obj wrote:
edit: the 3rd's daily totals have been restored. Data for the 4th is still processing; daily totals and hourly data are partially updated.

There was a DB problem overnight that may have delayed the reprocessing further. Will look at it on Monday.
The regeneration is done day by day so we sort out the 4th before we look at the 5th.

To give you an idea of the processing required, to reprocess one day needs about 40-50 CPU-days of processing and 400GB of temporary storage, so regenerating several days is an involved process. It might take a week or more before everything is restored.

edit: also, you can't sum the hourly aircraft values to get the daily values. If you could do that, the regeneration would have been a whole lot easier! Unfortunately you actually need to run the whole day's data in order to get a correct count of unique aircraft.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sat Apr 08, 2017 6:27 am 
Offline
FlightAware Member
conligwx - FlightAware user avatar

Joined: Sat Mar 18, 2017 8:00 pm
Posts: 88
Location: EGAC/EGAD
obj wrote:
To give you an idea of the processing required, to reprocess one day needs about 40-50 CPU-days of processing and 400GB of temporary storage, so regenerating several days is an involved process. It might take a week or more before everything is restored.


Thank you for the detailed analysis of the situation.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sat Apr 08, 2017 10:10 am 
Offline
FlightAware Member
w7psk - FlightAware user avatar

Joined: Tue Jan 16, 2007 2:00 pm
Posts: 588
Location: KPAE
04/03 and 04/04 are back but now my data from 04/05 has gone missing, where it was fine before?


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sat Apr 08, 2017 11:43 am 
Offline
FlightAware Member
ExCalbr - FlightAware user avatar

Joined: Wed Nov 23, 2005 2:00 pm
Posts: 591
w7psk wrote:
04/03 and 04/04 are back but now my data from 04/05 has gone missing, where it was fine before?


I just noticed that as well. Maybe 04/05 was mostly OK but they're redoing it to catch what little was missing?


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sat Apr 08, 2017 11:51 am 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3463
ExCalbr wrote:
Maybe 04/05 was mostly OK but they're redoing it to catch what little was missing?

Yes, exactly. Same for the 6th. Only a few hours / a few sites were affected but the simplest way to make sure everything ends up consistent is to regenerate the whole day.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Apr 09, 2017 6:18 am 
Offline
FlightAware Member
biekerc - FlightAware user avatar

Joined: Sat Jul 16, 2016 2:17 am
Posts: 59
Just wondering if the regeneration f(this does start to sound like a Doctor Who board :D ) for the 5th is working correctly.

After one hour is completely regenerated, the hourly position/aircraft values for the hour before are changed, eg. I had 22137/421 from 4 to 5, now after the values from 5 to 6 have been completed, the values from 4 to 5 dropped to 1404/124

https://www.dropbox.com/s/c3896h73cgean69/IMG_7405.JPG?dl=0

https://www.dropbox.com/s/2bwm9tb59ikosj4/IMG_7406.JPG?dl=0


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Apr 09, 2017 7:26 am 
Offline
EGBWJon - FlightAware user avatar

Joined: Sun Jul 31, 2016 11:41 am
Posts: 13
Now I can't access the statistics page.....


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Apr 09, 2017 7:57 am 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3463
biekerc wrote:
Just wondering if the regeneration f(this does start to sound like a Doctor Who board :D ) for the 5th is working correctly.

After one hour is completely regenerated, the hourly position/aircraft values for the hour before are changed, eg. I had 22137/421 from 4 to 5, now after the values from 5 to 6 have been completed, the values from 4 to 5 dropped to 1404/124

I noticed the same thing and diagnosed the problem. It only affects the hourly data, not the daily data. I guess we'll rerun the 5th again with that fixed. (It doesn't affect the 4th)
EGBWJon wrote:
Now I can't access the statistics page.....

Unrelated database performance issues that are making the whole thing a lot more "interesting"..


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Apr 09, 2017 6:08 pm 
Offline
FlightAware Member
conligwx - FlightAware user avatar

Joined: Sat Mar 18, 2017 8:00 pm
Posts: 88
Location: EGAC/EGAD
obj wrote:
I noticed the same thing and diagnosed the problem. It only affects the hourly data, not the daily data. I guess we'll rerun the 5th again with that fixed. (It doesn't affect the 4th)


not only that but each time a day was removed it was not from 00:00-23:59 but from 02:00 to 02:220 the next day.

my 5th day is short of numbers, but this has also affected upto 02:00 on the 6th morning.


Last edited by conligwx on Mon Apr 10, 2017 2:41 am, edited 1 time in total.

Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Apr 09, 2017 6:11 pm 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3463
conligwx wrote:
not only that but each time a day was removed it was not from 00:00-23:59 but from 02:00 to 02:220 the next day.

That is because the hourly stats are in your local timezone (and I think there's an off by one display error in there somewhere too), but daily stats are in UTC.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Apr 09, 2017 7:29 pm 
Offline
FlightAware Member
ExCalbr - FlightAware user avatar

Joined: Wed Nov 23, 2005 2:00 pm
Posts: 591
obj wrote:
biekerc wrote:
Just wondering if the regeneration f(this does start to sound like a Doctor Who board :D ) for the 5th is working correctly.

After one hour is completely regenerated, the hourly position/aircraft values for the hour before are changed, eg. I had 22137/421 from 4 to 5, now after the values from 5 to 6 have been completed, the values from 4 to 5 dropped to 1404/124

I noticed the same thing and diagnosed the problem. It only affects the hourly data, not the daily data. I guess we'll rerun the 5th again with that fixed. (It doesn't affect the 4th)
EGBWJon wrote:
Now I can't access the statistics page.....

Unrelated database performance issues that are making the whole thing a lot more "interesting"..


I'm seeing new holes in hourly data for the 4th. Daily data seems good.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun Apr 09, 2017 11:11 pm 
Offline
FlightAware Member
w7psk - FlightAware user avatar

Joined: Tue Jan 16, 2007 2:00 pm
Posts: 588
Location: KPAE
w7psk wrote:
04/03 and 04/04 are back but now my data from 04/05 has gone missing, where it was fine before?


Well 4/05 is back and 4/06 has gone missing


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Apr 10, 2017 3:36 pm 
Offline
AlpineMeadows - FlightAware user avatar

Joined: Tue Mar 21, 2017 12:07 am
Posts: 25
I anyone else having an issue where your site is not in the 30 day rankings table?
I see 5 entries and none are mine.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Apr 10, 2017 4:16 pm 
Offline
FlightAware Member
jonhawkes2030 - FlightAware user avatar

Joined: Tue Jan 05, 2016 4:15 pm
Posts: 1063
Location: NYC
Refresh the page and they should come back.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Apr 10, 2017 5:57 pm 
Offline
AlpineMeadows - FlightAware user avatar

Joined: Tue Mar 21, 2017 12:07 am
Posts: 25
jonhawkes2030 wrote:
Refresh the page and they should come back.

Just refreshed many times, still I'm not listed.
Tried another browser - same thing.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Apr 10, 2017 6:12 pm 
Offline
FlightAware Member
w7psk - FlightAware user avatar

Joined: Tue Jan 16, 2007 2:00 pm
Posts: 588
Location: KPAE
Refreshed many times

04/06 still missing its data


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 63 posts ]  Go to page 1, 2, 3  Next

All times are UTC - 6 hours [ DST ]


Who is online

Users browsing this forum: k6rtm and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to: