Skip to content

Last updated

On this page
  1. The stars on a review
  2. An agency's rating
  3. How agencies are put in order
  4. What does not change the order

Every rating on this site comes from pilgrims' own reviews, checked by a moderator before they count. Here is exactly how the stars add up, and how agencies are put in order.

The stars on a review

  • Every review gives 1 to 5 stars for the experience as a whole. Four or five stars is a good experience, one or two a problem, three goes either way.
  • Pilgrims can also rate parts of the trip: hotel and accommodation, transport, food, guidance and staff, and value for money. Each is optional, so a part the trip did not include is left out rather than guessed.
  • Tags such as "visa delay" or "great service" say what the review is about. They are shown with the review but do not change the stars.

An agency's rating

An agency's page shows the plain average of its stars, how many reviews gave each number of stars, and the average for each part of the trip. Only published reviews count: a review waiting for a moderator, or one taken down, does not. Reviews written before the site had stars have none, and are not counted in the average.

How agencies are put in order

City pages, search results and the top agencies list use a fair average, not the plain one. Three five-star reviews should not put a new agency above one with two hundred reviews averaging 4.8.

  • An agency is ranked once it has 5 reviews with stars. Agencies with fewer come after the ranked ones, those with the most reviews first.
  • The fair average counts five extra "average" ratings, at the average of every star on the site. With few reviews, an agency's fair average stays close to the site's average; as its reviews add up, it moves to its own.

For example, if the site's average is 4.0: an agency with 5 reviews of five stars has a fair average of 4.5, while one with 100 reviews averaging 4.8 has 4.76 and is listed first.

What does not change the order

  • Money. Nobody can pay to move up, to move a rival down, or to have a review removed. See how we make money.
  • Verification. A verified agency is shown with a badge. It says the agency's paperwork checks out, not that its service is good, so it does not change the rating or the order.
  • Replies and reports. An agency's reply sits under the review it answers. A report from an agency never hides a review; only a moderator decides.

How every review is checked before it counts is on how moderation works.