I’m utilising AeroAPIs pagination to collect data on currently airborne planes. To do this, I’m passing the cursor string through a recursive loop that gives the cursor to the next loop until there is no cursor being returned. However, my GET requests return a lot of identical flights. My initial GET request takes the shape of https://aeroapi.flightaware.com/aeroapi/flights/search/advanced?query={aircraftType+{220+737+747+777+787+A19*+A20*+A21*+A31*+A32*+A33*+A35*+B37*+B38*+B39*+B73*+B74*+B77*+B78*+BCS*+CRJ9+E19*+E29*}}&max_pages=2 while my subsequent GET requests are similar to https://aeroapi.flightaware.com/aeroapi/flights/search/advanced?query={aircraftType%20{220%20737%20747%20777%20787%20A19*%20A20*%20A21*%20A31*%20A32*%20A33*%20A35*%20B37*%20B38*%20B39*%20B73*%20B74*%20B77*%20B78*%20BCS*%20CRJ9%20E19*%20E29*}}&max_pages=2&cursor=da46ebf33d0b05f with changing cursors of course. Any ideas why I’m geting the same flights multiple times?
Results are not always going to be unique or continuous across pages of separate calls due to the technical implementation and the underlying data is continuing to rapidly change. I recommend trying to narrow your search query (or increase the number of results returned per request) such that the entirety of the results you want are in the first response. Try adding a search term to also restrict aircraft by their current lat/lon position to just the area you are interested in.