Reviews have been at the very core of The Points Guy since Brian began writing back in 2010. We’ve certainly come a long way since then, and today, TPG himself and the rest of the team have reviewed hundreds of flights and hotels all over the world. We’ve aimed to review as many products as we can, from Emirates first class all the way down to the back of the bus on Spirit. Our team has a range of voices, each giving their unique perspective. And, at the first-ever TPG Awards at the end of 2018, we introduced a new scoring system in order to more definitively evaluate products.Oman Air first class (Photo by Zach Honig / The Points Guy)When we first set out to introduce a scoring system, we decided that we would judge each flight against itself. It is an experience, after all, and one that can change depending on a number of factors. However, we recognize that because the flight experiences can vary so widely — even on the exact same route, aircraft and cabin — it becomes difficult to objectively separate flights from one another, especially as the volume of flights and number of reviewers grows.Virgin Atlantic premium economy on the A350 (Photo by Emily McNutt/The Points Guy)So today we’re introducing the next iteration of our flight review scoring: an official review rubric that the TPG team will use to measure most aspects of the flight experience. After completing a flight, the reviewer will submit their notes to the reviews team — made up of a small group of TPG editors and expert flight reviewers — along with a proposed score. The reviews team will then meet to discuss the review before assigning a final score.Using this new checklist as a scoring guideline will help mitigate some of the inherent subjectivity in our flight review scores. The reviews team has spent countless hours and hundreds of thousands of miles in the air, so they’ll have much more context when assigning a score.Korean Air business class (Photo by Nick Ellis/The Points Guy)The new scoring checklist includes well over 200 questions for each cabin class — economy, premium economy, business and first class. We’re even going to start collecting some new statistics like the seat-to-bathroom ratio and a (flight attendant) call button response test, which will help us more objectively measure and evaluate the product and service.When meeting with our team of experts, we realized that different aspects of a flight matter more or less depending on what cabin you’re sitting in. As such, we are also changing the allocations for each flight review category. Currently, all categories are weighted equally across cabins: 10 points for Ground Experience, 25 points for Cabin and Seat, 15 points for Amenities and IFE, 25 points for Food and Beverage and 25 points for Service.Sign up for our daily newsletterEmail addressSign upI would like to subscribe to The Points Guy newsletters and special email promotions. The Points Guy will not share or sell your email. See privacy policy.Starting today, the new allocations will be as follows.CategoryEconomyPremium EconomyBusiness ClassFirst ClassGround Experience5102020Cabin and Seat30303020Amenities and IFE40301515Food and Beverage15202025Service10101520Lastly, our review scores continue to be valid relative to a given cabin. For instance, if a Singapore Airlines A380 economy review scores an 87 and a Thai Airways Boeing 747 first-class review scores a 75, it doesn’t mean that you should choose Singapore economy over Thai first class. It just means that Thai’s first-class product isn’t all that great compared to its first-class peers.Aeroflot economy (Photo by Javier Rodriguez / The Points Guy)We hope that this new scoring system will help you when you’re deciding which airline and product to fly. We’re incredibly excited by the next chapter in our flight reviews, and look forward to having you on board with us.
