Scribd
Upload
55 views3 pages

Relevance Rating Scale Explained

The document outlines a relevance rating scale for evaluating search results based on how well they meet user queries. It categorizes results into five levels: Navigational, Excellent, Good, Acceptable, and Bad, each defined by how closely they match the user's intent. Additionally, it emphasizes the importance of checking data accuracy regarding name, address, and location after determining relevance.

Uploaded by

nishchaygo88
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
55 views3 pages

Relevance Rating Scale Explained

The document outlines a relevance rating scale for evaluating search results based on how well they meet user queries. It categorizes results into five levels: Navigational, Excellent, Good, Acceptable, and Bad, each defined by how closely they match the user's intent. Additionally, it emphasizes the importance of checking data accuracy regarding name, address, and location after determining relevance.

Uploaded by

nishchaygo88
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

RELEVANCE RATING SCALE - "How helpful is this result?

"
Think of this as answering: "Is this what the user was actually looking for?"

🎯 Navigational - "THE One and Only"

 Meaning: There's only ONE correct answer in the entire world


 Example:

o Query: "Eiffel Tower"


o Perfect Result: The actual Eiffel Tower in Paris
o Why: There's only one Eiffel Tower

⭐ Excellent - "Exactly Right"

 Meaning: This is exactly what the user wanted


 Example:

o Query: "Starbucks near me"


o Perfect Result: A Starbucks close to your location
o Why: It's exactly what was asked for

👍 Good - "Close Enough"

 Meaning: Kind of what they wanted, but not perfect


 Example:

o Query: "Starbucks"
o Result: A Starbucks that's pretty far away
o Why: It's the right business, but too distant

⭐ Acceptable - "Technically Right"

 Meaning: Barely matches what they asked for


 Example:

o Query: "Starbucks coffee"


o Result: A different coffee shop that sells Starbucks beans
o Why: Related to Starbucks, but not an actual Starbucks store
⭐ Bad - "Completely Wrong"

 Meaning: Has nothing to do with what they asked for


 Example:

o Query: "Starbucks"
o Result: A car repair shop
o Why: No connection at all

DATA ACCURACY COMPONENTS - "Is the information correct?"

1. NAME & CATEGORY ACCURACY - "Is the name right?"

2. ADDRESS ACCURACY - "Is the location information right?"


SIMPLE WAY TO REMEMBER:

For RELEVANCE:

 Navigational: Only one exists (Eiffel Tower)


 Excellent: Exactly what you asked for
 Good: Close but not perfect
 Acceptable: Barely related
 Bad: Completely wrong

For DATA ACCURACY:

 Name: Is the name spelled right?


 Address: Is the address correct?
 Pin: Is the map marker in the right place?

Key Point: Rate relevance FIRST (assuming everything is correct), THEN check if the
data is actually accurate!

You might also like