All times are UTC - 6 hours [ DST ]




Post new topic Reply to topic  [ 54 posts ]  Go to page Previous  1, 2, 3  Next
Author Message
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Apr 10, 2017 6:15 pm 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3459
The "global" ranking table and the site page's idea of your ranking are up to an hour out of sync at the moment; this is most noticeable if your ranking is changing rapidly.
Try refreshing at about 15 mins after the hour until we've got them back into sync again (it is OK for your site at the time of writing - 14 mins after the hour)

regeneration of older stats is currently on hold.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Apr 10, 2017 7:22 pm 
Online
FlightAware Member
k6rtm - FlightAware user avatar

Joined: Tue Nov 18, 2014 10:18 pm
Posts: 416
Location: Silicon Valley
Thanks for working so hard to regenerate old data.

But in a very few days, that old data won't be a part of the 7-day weighted average.

Then it becomes more of an exercise in proving your recovery processes and procedures are effective.

(Which is another way of saying again, thanks for all the hard work dredging up that data, but I'm not heartbroken that it isn't there.)

cheers,

bob k6rtm


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon Apr 10, 2017 8:32 pm 
Offline
FlightAware Member
abcd567 - FlightAware user avatar

Joined: Sat Feb 15, 2014 3:08 am
Posts: 1980
Location: Toronto CYYZ
k6rtm wrote:
Thanks for working so hard to regenerate old data.

But in a very few days, that old data won't be a part of the 7-day weighted average.

Then it becomes more of an exercise in proving your recovery processes and procedures are effective.

(Which is another way of saying again, thanks for all the hard work dredging up that data, but I'm not heartbroken that it isn't there.)

cheers,

bob k6rtm

Fully agree!
.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue Apr 11, 2017 9:25 am 
Offline
davidbuhler - FlightAware user avatar

Joined: Wed May 04, 2016 6:58 pm
Posts: 1
There must still be ongoing issues. I am missing a couple days this week that was there, then disappeared over the couple days.

http://flightaware.com/adsb/stats/user/davidbuhler
David


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue Apr 11, 2017 8:28 pm 
Offline
kg5q - FlightAware user avatar

Joined: Mon Mar 20, 2017 8:37 pm
Posts: 2
Im still seeing backwards in time missing data - Flightaware might have to install faster FPGA based processing hardware vs processors - doing DSP on FPGA's is about the fastest way to number crunch around or maybe tied with Nvidia GPU's. Something is not keeping up
/Users/kevinparmenter/Desktop/Screen Shot 2017-04-11 at 6.17.51 PM.png
not sure if you can see my screen shot - no way to upload a file that I can see so have a look at my missing data
https://flightaware.com/adsb/stats/user/kg5q

maybe we should put United Airlines in charge of getting our data to do what its supposed to, they dont mess around!


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Wed Apr 12, 2017 5:03 pm 
Offline
djmd808 - FlightAware user avatar

Joined: Wed Jul 08, 2015 5:23 pm
Posts: 45
Dangit I climbed all the way to #5 and now I'm at a measly 18 because two days are missing. Haha, I really don't care that much :) I adjusted the gain yesterday and I think I'm seeing an improvement, already at 4000 AC with two hours to go, so I should climb back up if things stay steady from here on out.

I don't think we should put United in charge of anything! Haha...


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Wed Apr 12, 2017 8:51 pm 
Offline
Donw3 - FlightAware user avatar

Joined: Sun Oct 30, 2016 5:22 pm
Posts: 1
Where are now in the processing? My hourly positions have for the most part filled back in but in the lower summary something doesn't seem right. Sun 4/9 shows 4 positions reported but 0 aircraft seen. Normally it would be in thousands.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 13, 2017 9:49 am 
Offline
FlightAware Staff
ericcarlson - FlightAware user avatar

Joined: Sun Jan 01, 2006 5:00 pm
Posts: 116
Please see the first post in this thread for updates.

Donw3, we're investigating the issue you're reporting with 4/9.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Fri Apr 14, 2017 1:26 pm 
Offline
FlightAware Member
biekerc - FlightAware user avatar

Joined: Sat Jul 16, 2016 2:17 am
Posts: 59
Mmmh, is the the regeneration for the 6th completed?

I have values in the daily column again, but in the hourly data, 5 hours are still empty, and one has untypically low values.

Also, I think the 6th was my best day so far with 2724 a/c, right now I am at 2,479. I mean, I'll survive this, but only just :wink:


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 20, 2017 6:02 am 
Offline
FlightAware Member
tdrane - FlightAware user avatar

Joined: Thu Jan 08, 2015 7:28 am
Posts: 109
ericcarlson wrote:
The Latest
Stats are incomplete/unreliable for April 6. Stats for will be deleted and regenerated from scratch. There is no need to contact us individually as we are addressing this for all users to ensure consistent stats. April 6 stats are expected to be fully restored around the end of this week.

We will update our progress on this thread.



Today (4/20) is the last we'll see of the stats for 4/6. It appears that the regeneration "died on the vine" so to speak. Personally, I'm missing about 1000 planes for that day.

Hopefully, FA has solved the capacity issues which necessitated the regeneration and won't have to attempt the procedure again.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 20, 2017 8:02 am 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3459
Regeneration of the 6th is still on hold because it turned out that the regeneration process was actually interfering with live stats, causing spurious site reassignments for sites that changed users between the 6th and now; that needs to get fixed before restarting the rerun.

The alternative would be to take live stats offline for at least 3-4 days (about 24 hours to regenerate the data for the 6th, then however long it would take for live stats to catch up with the 24-hour backlog - probably at least a couple of days) which isn't something that we want to do.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu Apr 27, 2017 6:22 pm 
Offline
HiVolt - FlightAware user avatar

Joined: Sun Mar 20, 2016 1:45 pm
Posts: 6
Are there any lingering issues with stats collection? I noticed a whole block this morning was completely blank. I checked some users near my site and some have it filled, and some have other hours that are almost completely blank...

Image


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue May 02, 2017 12:07 pm 
Offline
wilco8888 - FlightAware user avatar

Joined: Mon Oct 17, 2016 10:00 pm
Posts: 1
FYI this reoccurred on the 29th and the 1st, one hour shows close to zero collections, and then the daily total shows only a handful of reports.

I opened a ticket (#127616 ), Flightaware say they are aware and tracking via this thread although this thread doesn't look to be particularly active other than when the issue first arose in early April.

Does Flightaware document their data collection system architecture, I'm curious what hardware/software/cloud services they rely on.. ?


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue May 02, 2017 12:16 pm 
Offline
FlightAware Member
ExCalbr - FlightAware user avatar

Joined: Wed Nov 23, 2005 2:00 pm
Posts: 589
HiVolt wrote:
Are there any lingering issues with stats collection? I noticed a whole block this morning was completely blank. I checked some users near my site and some have it filled, and some have other hours that are almost completely blank...

Image


I noticed the same thing but decided not to post about it, figuring someone else would.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue May 02, 2017 12:23 pm 
Offline
FlightAware Staff
obj - FlightAware user avatar

Joined: Tue Sep 30, 2014 7:14 pm
Posts: 3459
wilco8888 wrote:
Does Flightaware document their data collection system architecture, I'm curious what hardware/software/cloud services they rely on.. ?

Mostly tcl and Apache Kafka on bare metal.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue May 02, 2017 5:14 pm 
Offline
HiVolt - FlightAware user avatar

Joined: Sun Mar 20, 2016 1:45 pm
Posts: 6
ExCalbr wrote:
I noticed the same thing but decided not to post about it, figuring someone else would.


I had had another blank spot this morning...


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Fri May 05, 2017 3:14 pm 
Offline
jeffm5690 - FlightAware user avatar

Joined: Wed Apr 19, 2017 8:59 pm
Posts: 1
Now I completely "lost" my stats from yesterday
.....


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun May 07, 2017 6:30 pm 
Offline
FlightAware Member
rustytwig - FlightAware user avatar

Joined: Thu Sep 26, 2013 3:36 pm
Posts: 202
Location: Llandrindod Wells, Powys, Wales, UK
Hourly Received Reports are missing for Sunday 7th May for sites 141 and 33401. The graphs are showing as reports received.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon May 08, 2017 8:46 am 
Offline
FlightAware Staff
ericcarlson - FlightAware user avatar

Joined: Sun Jan 01, 2006 5:00 pm
Posts: 116
We are still investigating the cause of the (seemingly) randomly missing data points.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Mon May 08, 2017 6:55 pm 
Offline
FlightAware Member
rustytwig - FlightAware user avatar

Joined: Thu Sep 26, 2013 3:36 pm
Posts: 202
Location: Llandrindod Wells, Powys, Wales, UK
rustytwig wrote:
Hourly Received Reports are missing for Sunday 7th May for sites 141 and 33401. The graphs are showing as reports received.


Oh they're not missing it's the date that is wrong. It is showing Monday's data against Sun.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Thu May 11, 2017 10:30 am 
Offline
FlightAware Staff
ericcarlson - FlightAware user avatar

Joined: Sun Jan 01, 2006 5:00 pm
Posts: 116
The issue with isolated missing stats has been identified by the development team and a fix is being developed now.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Tue May 16, 2017 3:39 pm 
Offline
FlightAware Staff
ericcarlson - FlightAware user avatar

Joined: Sun Jan 01, 2006 5:00 pm
Posts: 116
The isolated missing stats issue that we identified has been corrected on a go-forward basis. If you see further instances of this issue please post on this thread. Thank you.


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun May 21, 2017 7:16 pm 
Offline
tonyscanga - FlightAware user avatar

Joined: Sun Aug 07, 2016 5:45 pm
Posts: 5
Over the last couple of hours, the hourly stats show no data. Viewing the live data seems to work, and everything looks like I'm connected to the fa network fine. I have a 2nd site connected through the same local network which is reporting properly. How do I go about diagnosing this issue?

Thanks in advance

http://flightaware.com/adsb/stats/user/tonyscanga#stats-28577


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun May 21, 2017 7:33 pm 
Offline
seabugs - FlightAware user avatar

Joined: Sat Apr 15, 2017 9:02 am
Posts: 6
Tony, I have same problem. The Piaware Skyview shows all sorts of planes but nothing shows up on my stats page.

http://flightaware.com/adsb/stats/user/seabugs


If you come up with an answer please let know!

THanks

Ross


Top
 Profile  
 
 Post subject: Re: What's up with ADS-B Statistics?
PostPosted: Sun May 21, 2017 7:50 pm 
Offline
FlightAware Member
ExCalbr - FlightAware user avatar

Joined: Wed Nov 23, 2005 2:00 pm
Posts: 589
It seems to be updating slowly. But it is updating. I think updates take a little longer around the time of the date change in UTC.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 54 posts ]  Go to page Previous  1, 2, 3  Next

All times are UTC - 6 hours [ DST ]


Who is online

Users browsing this forum: CommandPost2017, k6rtm and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to: