PIAware not connecting with FA anymore (outage 11-Nov-2014)


#1

hi,

Since I last week, I have been under the impression that my report rate is following a “falling trend” without knowing why.

When checking tonight, I find that piaware only reported 331 planes when it should have reported many more. A quick look at the output file shows the culprit:

Log is filled with the below lines since some time this morning:

11/11/2014 16:55:12 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 16:55:41 FlightAware server SSL certificate validated
11/11/2014 16:55:41 encrypted session established with FlightAware
11/11/2014 16:55:42 logged in to FlightAware as user subsy
11/11/2014 16:56:11 463889 msgs recv’d from dump1090 (262 in last 5m); 464918 msgs sent to FlightAware
11/11/2014 16:57:28 lost connection to FlightAware, reconnecting…
11/11/2014 16:57:28 connecting to FlightAware 70.42.6.203/1200
11/11/2014 16:57:50 FlightAware server SSL certificate validated
11/11/2014 16:57:50 encrypted session established with FlightAware
11/11/2014 16:57:54 logged in to FlightAware as user subsy
11/11/2014 16:59:40 lost connection to FlightAware, reconnecting…
11/11/2014 16:59:40 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 17:00:05 FlightAware server SSL certificate validated
11/11/2014 17:00:05 encrypted session established with FlightAware
11/11/2014 17:00:14 logged in to FlightAware as user subsy
11/11/2014 17:01:11 464187 msgs recv’d from dump1090 (298 in last 5m); 465161 msgs sent to FlightAware
11/11/2014 17:01:56 lost connection to FlightAware, reconnecting…

I am currently rebooting, to see if it helps in any way.

After rebooting, this is what I find :
11/11/2014 17:48:35 ****************************************************
11/11/2014 17:48:35 piaware version 1.16 is running, process ID 2060
11/11/2014 17:48:35 your system info is: Linux raspberrypi 3.12.28+ #709 PREEMPT Mon Sep 8 15:28:00 BST 2014 armv6l GNU/Linux
11/11/2014 17:48:35 ADS-B data program ‘dump1090’ is listening on port 30005, so far so good
11/11/2014 17:48:35 i see dump1090 serving on port 10001
11/11/2014 17:48:35 connecting to dump1090 on port 10001…
11/11/2014 17:48:35 piaware is connected to dump1090 on port 10001
11/11/2014 17:48:36 dump1090 is listening for connections on FA-style port 10001
11/11/2014 17:48:36 piaware received a message from the ADS-B source!
11/11/2014 17:48:48 connecting to FlightAware 70.42.6.203/1200
11/11/2014 17:48:48 got ‘couldn’t open socket: connection refused’ to adept server at 70.42.6.203/1200, will try again soon…
11/11/2014 17:49:06 56 msgs recv’d from dump1090; 0 msgs sent to FlightAware
11/11/2014 17:49:48 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 17:49:48 got ‘couldn’t open socket: connection refused’ to adept server at eyes.flightaware.com/1200, will try again soon…


Flight "AFR\1" on stats page
#2

After days of flawless operation my PiAware setup suddenly faces connection problems to FlightAware.
Tried rebooting, tried upgrading from 1.15 to 1.16 neither changed a thing. Can login to the Pi without issues, pings to eyes.flightaware.com keep running ok. Anything i can do?
This is the piaware.out log from the moment of trouble:


11/11/2014 14:38:51 1419271 msgs recv'd from dump1090 (2530 in last 5m); 1420006 msgs sent to FlightAware
11/11/2014 14:43:51 1421772 msgs recv'd from dump1090 (2501 in last 5m); 1422508 msgs sent to FlightAware
11/11/2014 14:48:51 1424082 msgs recv'd from dump1090 (2310 in last 5m); 1424819 msgs sent to FlightAware
11/11/2014 14:53:51 1426242 msgs recv'd from dump1090 (2160 in last 5m); 1426980 msgs sent to FlightAware
11/11/2014 14:55:24 timed out waiting for alive message from FlightAware, reconnecting...
11/11/2014 14:55:24 connecting to FlightAware 70.42.6.203/1200
11/11/2014 14:55:25 FlightAware server SSL certificate validated
11/11/2014 14:55:25 encrypted session established with FlightAware
11/11/2014 14:55:25 logged in to FlightAware as user paulmerkx
11/11/2014 14:56:15 lost connection to FlightAware, reconnecting...
11/11/2014 14:56:15 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 14:56:28 FlightAware server SSL certificate validated
11/11/2014 14:56:28 encrypted session established with FlightAware
11/11/2014 14:56:33 logged in to FlightAware as user paulmerkx
11/11/2014 14:57:08 lost connection to FlightAware, reconnecting...
11/11/2014 14:57:08 connecting to FlightAware 70.42.6.203/1200
11/11/2014 14:57:49 FlightAware server SSL certificate validated
11/11/2014 14:57:49 encrypted session established with FlightAware
11/11/2014 14:58:01 logged in to FlightAware as user paulmerkx
11/11/2014 14:58:51 1428428 msgs recv'd from dump1090 (2186 in last 5m); 1428651 msgs sent to FlightAware
11/11/2014 15:02:00 data isn't making it to FlightAware, reconnecting...
11/11/2014 15:02:00 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 15:02:55 FlightAware server SSL certificate validated
11/11/2014 15:02:55 encrypted session established with FlightAware
SSL channel "sock5": error: 1415718175
11/11/2014 15:02:58 logged in to FlightAware as user paulmerkx
11/11/2014 15:03:51 1430571 msgs recv'd from dump1090 (2143 in last 5m); 1430385 msgs sent to FlightAware
11/11/2014 15:04:43 lost connection to FlightAware, reconnecting...
11/11/2014 15:04:43 connecting to FlightAware 70.42.6.203/1200
11/11/2014 15:04:43 error during tls handshake: handshake failed: connection reset by peer, will try again soon...
11/11/2014 15:05:43 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 15:06:40 FlightAware server SSL certificate validated
11/11/2014 15:06:40 encrypted session established with FlightAware
11/11/2014 15:06:43 connecting to FlightAware 70.42.6.203/1200
11/11/2014 15:07:43 FlightAware server SSL certificate validated
11/11/2014 15:07:43 encrypted session established with FlightAware
11/11/2014 15:07:43 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 15:08:00 FlightAware server SSL certificate validated
11/11/2014 15:08:00 encrypted session established with FlightAware
11/11/2014 15:08:03 logged in to FlightAware as user paulmerkx
11/11/2014 15:08:51 1432861 msgs recv'd from dump1090 (2290 in last 5m); 1431143 msgs sent to FlightAware
11/11/2014 15:11:53 data isn't making it to FlightAware, reconnecting...
11/11/2014 15:11:53 connecting to FlightAware 70.42.6.203/1200
11/11/2014 15:11:54 FlightAware server SSL certificate validated
11/11/2014 15:11:54 encrypted session established with FlightAware
11/11/2014 15:11:54 logged in to FlightAware as user paulmerkx
SSL channel "sock5": error: 1415718814
11/11/2014 15:13:51 1435051 msgs recv'd from dump1090 (2190 in last 5m); 1433300 msgs sent to FlightAware
11/11/2014 15:15:53 data isn't making it to FlightAware, reconnecting...
11/11/2014 15:15:53 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 15:15:54 FlightAware server SSL certificate validated
11/11/2014 15:15:54 encrypted session established with FlightAware
11/11/2014 15:15:54 logged in to FlightAware as user paulmerkx
SSL channel "sock7": error: 1415718984
11/11/2014 15:18:48 lost connection to FlightAware, reconnecting...
11/11/2014 15:18:48 connecting to FlightAware 70.42.6.203/1200
11/11/2014 15:18:49 FlightAware server SSL certificate validated
11/11/2014 15:18:49 encrypted session established with FlightAware
11/11/2014 15:18:49 logged in to FlightAware as user paulmerkx
11/11/2014 15:18:51 1437245 msgs recv'd from dump1090 (2194 in last 5m); 1435409 msgs sent to FlightAware
11/11/2014 15:21:00 lost connection to FlightAware, reconnecting...
11/11/2014 15:21:00 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 15:21:00 FlightAware server SSL certificate validated
11/11/2014 15:21:00 encrypted session established with FlightAware
11/11/2014 15:21:01 logged in to FlightAware as user paulmerkx
11/11/2014 15:23:51 1439469 msgs recv'd from dump1090 (2224 in last 5m); 1437634 msgs sent to FlightAware
11/11/2014 15:24:08 lost connection to FlightAware, reconnecting...
11/11/2014 15:24:08 connecting to FlightAware 70.42.6.203/1200
11/11/2014 15:24:10 FlightAware server SSL certificate validated
11/11/2014 15:24:10 encrypted session established with FlightAware
11/11/2014 15:24:13 logged in to FlightAware as user paulmerkx
11/11/2014 15:26:50 lost connection to FlightAware, reconnecting...
11/11/2014 15:26:50 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 15:26:52 FlightAware server SSL certificate validated
11/11/2014 15:26:52 encrypted session established with FlightAware
11/11/2014 15:26:54 logged in to FlightAware as user paulmerkx
11/11/2014 15:28:37 lost connection to FlightAware, reconnecting...
11/11/2014 15:28:37 connecting to FlightAware 70.42.6.203/1200
11/11/2014 15:28:39 FlightAware server SSL certificate validated
11/11/2014 15:28:39 encrypted session established with FlightAware
11/11/2014 15:28:40 logged in to FlightAware as user paulmerkx
11/11/2014 15:28:51 1441698 msgs recv'd from dump1090 (2229 in last 5m); 1439766 msgs sent to FlightAware
11/11/2014 15:30:54 lost connection to FlightAware, reconnecting...
11/11/2014 15:30:54 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 15:30:56 FlightAware server SSL certificate validated
11/11/2014 15:30:56 encrypted session established with FlightAware
11/11/2014 15:30:56 logged in to FlightAware as user paulmerkx
11/11/2014 15:32:59 lost connection to FlightAware, reconnecting...
11/11/2014 15:32:59 connecting to FlightAware 70.42.6.203/1200
11/11/2014 15:33:03 FlightAware server SSL certificate validated
11/11/2014 15:33:03 encrypted session established with FlightAware
11/11/2014 15:33:04 logged in to FlightAware as user paulmerkx
11/11/2014 15:33:51 1443984 msgs recv'd from dump1090 (2286 in last 5m); 1442013 msgs sent to FlightAware
11/11/2014 15:34:47 lost connection to FlightAware, reconnecting...
11/11/2014 15:34:47 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 15:34:50 FlightAware server SSL certificate validated
11/11/2014 15:34:50 encrypted session established with FlightAware
11/11/2014 15:34:51 logged in to FlightAware as user paulmerkx
11/11/2014 15:36:39 lost connection to FlightAware, reconnecting...
11/11/2014 15:36:39 connecting to FlightAware 70.42.6.203/1200
11/11/2014 15:36:41 FlightAware server SSL certificate validated
11/11/2014 15:36:41 encrypted session established with FlightAware
11/11/2014 15:36:41 logged in to FlightAware as user paulmerkx
11/11/2014 15:38:20 lost connection to FlightAware, reconnecting...
11/11/2014 15:38:20 connecting to FlightAware eyes.flightaware.com/1200
11/11/2014 15:38:22 FlightAware server SSL certificate validated
11/11/2014 15:38:22 encrypted session established with FlightAware
11/11/2014 15:38:23 logged in to FlightAware as user paulmerkx
11/11/2014 15:38:53 1446441 msgs recv'd from dump1090 (2457 in last 5m); 1444427 msgs sent to FlightAware



#3

Server problems at the moment, please standby.


#4

Is the issue a regional problem? I see some users are reporting and other are not.

I happened to relocate my RPI and antenna in my house this morning. Once I brought it back online, I noticed the FA connection issue. I initially thought my FA connection was something I did in the relocation. I finally noticed this thread in the discussion forum. Was starting to run out of ideas to troubleshoot this. :slight_smile:

Marty


#5

Hi,

I have (as a consequence) reactivated PP from my home computer. Is this going to be a problem? Or it is not needed, since the FA aware are not processing any input, and will come back both for piaware and PP ?


#6

Stats are starting to come up on the PP, so I my next question is : will my stats be doubled if I run both PP and PiAware ?


#7

Any further insight on what the server problem is? Drive died? Power supply smoked? Router went stupid? Software crashed? Any progress getting it back online? ETA? (no pressure though…)

Sympathies offered, computers can be fickle beasts from time to time.

Hope that you don’t have to fix it yourself, dbaker, and I am sure the IT bubbas are swinging hammers and other construction tools at it!


#8

Capacity problems and a botched upgrade. Should be up shortly.


#9

It’s back up here since 7’ :slight_smile:


#10

PiAware service is back online – apologies for any confusion or wasted time.


#11

No problem! Thanks for getting it up again so fast! The fast growth surely brings its chalenges.
/paul


#12

For the record, I am still having problems. PiAware is running and connecting fine, but my stats are not updating. I tried restarting the service, but same result. Any thoughts?


#13

@Short Final:

The same here since 5 hours.


#14

Still not working here in New York either. I can see activity when I look at my local web page but stats are not updating for 5 hours now.


#15

I’m sure their stats process is separate from their receiving and processing data process. Give them a chance to fully recover from their outage.

If you want to know what you local PIAware status is, use the PIAware status command or view the log file in the tmp directory.

Marty


#16

OK, it’s working now.


#17

Me too, though looks like it zeroed my stats for today. Oh well.


#18

My Flightfeeder is still down. Rebooted, didn’t help.
feeder itself is working, can contact it on port 8080 and 30003


#19

We’re working on stats and still restoring a few things.


#20

FlightFeeders back up now.