Relevance

What is Relevance?

Relevance is the a ribute that determines whether a result sa sfies the user's query.

What is a query?

The query is what the user is looking for, the research they type in a map applica on.

What is a result?

The results are the sugges ons that would sa sfy the user's request that raters have to evaluate.

QUERY SECTION

Balance

Query Locale

end US

Query

gym near me

Viewport Age

Stale

Is there a naviga onal result for this query?

Yes

No

RESULT SECTION

1. Legacy Gym

Address

1091 Yellowstone Rd. Rock Springs WY 82901

Classifica on

Sports
Distance to User

17,2 km

Distance to

42km

Viewport

4164178

Lat, Ling

-106.25388

Result name tle in unexpected Sequence or script

Relevance

How do we determine if a result is RELEVANT?

Relevant result sa sfies the user's request

What you should take into considera on:

USER INTENT

Does the result sa sfy the inten on of the user? Is the result what the rater would expect to find
with their research?

DISTANCE

Does the result match the loca on intent?

Loca on intent is where the user expects the results to be.

Relevance

How do we determine loca on intent?

Loca on intent = where the results need to be in order to be relevant

This could be indicated in the query itself. Is there a loca on modifier in the query?

A loca on modifier can be a locality, an area, a specific street or full address that tells us where the
result is expected.

If YES: Results are expected in the specific locality, area, street or full address indicated.
Be aware that phrases like "near me", "closest..." in the query are considered loca on modifiers and
imply that the user wants the results to be near and closest to the user loca on. Loca on intent is
the user's loca on.

If NO: You should check user viewport age (fresh or stale) and user loca on to determine loca on
intent. Relevance

What is the viewport?

The user viewport represents the map area the user was looking at when making the query.
Viewport age can be fresh or stale and this influences loca on intent.

According to viewport age and user loca on, loca on intent changes too!

FRESH viewport

User inside: When the user is within a fresh viewport, take the user loca on as loca on intent.

User outside: When the user is outside a fresh viewport, results are expected in or near the viewport
area.

STALE viewport

User inside/outside: When a viewport is stale, the user's loca on is considered the loca on intent for
the results whether the user is inside or outside the viewport
Relevance

What we have discussed so far:

1. Relevance is the a ribute that determines whether a result sa sfies the user's query.

2. A result is considered relevant based on distance from the loca on intent (check if there is a
loca on modifier in the query, if not check viewport age and user loca on to iden fy where the
results are expected to be)

3. Relevance of a result is also decided based on user intent, is the result what the user is looking
for? Does it match the request? > Understanding the query.

Understanding the query

What is the user looking for? Is the result connected to the query? To know that, we need to
understand the user's request.

Queries can be of different types, the most common you will find are:

POI queries (Chain businesses, unique POIs)

Category queries (a specific type of business, a specific item e.g. Italian restaurant, cheesecake)

Address queries (Full and par al addresses, locali es)Relevance

How to rate chain business queries

Chain business queries start at Excellent if no specific loca on is requested.

> When ra ng chain business results, relevance should be based on the distribu on of returned/real-
world results

If there are many branches of the chain business, you should be strict with demo on, taking into
account whether there are real-world results not reported in Try ra ng that would be er sa sfy the
user's intent.

if the result to rate is the closest to the loca on intent, it should receive a ra ng of Excellent. If there
is at least one closer branch but the result to rate is the second closer, we do not want to be too
harsh when demo ng and a-1 for distance should be applied [Good)

If there are several branches closer to the user and the result to rate is farther but s ll in the fresh
viewport, a -2 [Acceptable for distance should be applied. Relevance

How to rate unique POI queries

Some businesses have only one loca on, so treat and rate them as queries that can have only one
sa sfying result.

The correct result should be rated Naviga onal (as it is unique) and any other results should receive a
Bad (for User Intent).

Even if the result is related to the naviga onal intent of the query, but it's not the right result, it
should be rated as Bad.

EXAMPLE 1:

Query: "Unique School name"

Result 1: "That School district office

> Bad

Result 2: "School matching the query

Naviga onal

EXAMPLE 2:

Query "Unique restaurant name

Result 1: "Address result where the unique restaurant is located > Bad

Result 2: "Restaurant matching the query"> Naviga onal

hp

Relevance

Category queries

The user can be looking for a category which can be expressed as a:

Specific type of business (e.g. "Italian restaurant", "pharmacy", "mall near me", "liquor store", "car
rent")

Specific item (e.g. "Mexican food", "sportswear", "flowers", "ice cream", "vegan desserts") Relevance

How to rate category queries

Category queries start at 'Excellent' if no specific loca on is requested. Category queries with a
loca on modifier are the only category queries eligible for a Naviga onal ra ng.

A result is considered relevant when it belongs to the category queried, otherwise it is automa cally
considered Bad for User Intent issue.

When ra ng category results, relevance should be based on the distribu on of returned/real world
results and match with the category queried.

Since category queries can be very broad and there are many businesses that can sa sfy user's intent
in the loca on intent, you should be strict with demo on.

More than one result can have the same ra ng. Result Name

How do we determine if the result name is correct?

When it is used on the POI's official website or on other official resources. Even if the official website
doe

not use the name, if it is used in other official sources, the name is correct.

Where to check?

Need to check it in

Chain business locator Official Website

About us sec on on an Official Website

Signs and/or storefronts seen in Streetview

Claimed social media accounts

No resources available?

Check on recent street/online imagery/crowdsourced reviews to check the storefront/sign

publica ons and official menus

If it cannot be confirmed because there

No results inside the fresh Viewport should be demoted to Bad for distance alone. Relevance

Address queries

Address queries include:

Full Addresses: all address components are present (Street number, street name, Locality, Postal
code)

Par al addresses: the address is missing some components so it is ambiguous and could point to
different places.

Locali es: when the user is looking for ci es and neighbourhoods, they should be considered as
address Queries. how to rate par al address queries

When the query is for a non-specific or unfinished address, the nearest possible sa sfying results
that match the query are expected.

If there are no real-world existent op ons any closer than the given result returned and that result
falls closest and matcher query intent, relevance for the result is EXCELLENT.

If the result matches the query but there is a closer address op on, the resul ng address should be
demoted-1 [Good] with Distance/Prominence box Checked relevance

How to rate locali es queries

When the query is for a specific address, such as a locality, and the result is that exact Locality,
Relevance should be rated as Naviga onal, as the user is looking for that specific locality.

The only results that should be given secondary intent are interna onally prominent Pols and Transit
Pols:

If the given result, for example, is an airport or a transit sta on, it is considered a transit Pot and
should be given secondary intent relevance based on its associa on with the requested locality
[Good].
If the given result is, for example, a Zoo, it is not interna onally prominent nor is it considered a
Transit POL. Relevance for the result is BAD.

Be aware that some mes transit sta ons have the same name of the locality they are in, so look at
the classifica on and where the pin is located in

the map to check if the result is the actual locality or a transit poi within the same.

hp

Relevance

Conclusions

1. Relevance is the a ribute that determines whether a result sa sfies the user's query.

2. A result is considered relevant based on distance from the loca on intent (check if there is a
loca on modifier in the query, if not check viewport age and user loca on to iden fy where the
results are expected to be)

3. Relevance of a result is also decided based on user intent, is the result what the user is looking
for? Does it match the request? You need to understand the query = what the user is looking for.

4. There can be different types of queries (POI queries, Category queries, Address queries and more)

5. How to rate a result change based on type of query and type of result. Index

Name and Category Accuracy

Result Name

Category Name

Transit Name

Name and Category Accuracy

You need to evaluate the Business/POI Name and Category data accuracy, taking into considera on
both of them in case of demo ng

It can be rated as N/A

Correct

Par ally Correct

Incorrect

Can't Verify

If you mark it as Par ally Correct or Incorrect, you may be presented with two checkboxes you'll
need to select depending on the query (THIS IS NOT FOUND IN THE SIMULATOR, JUSTIN TRYRATING)

Name Issue

Category issue

Result Name

How do we determine if the result name is correct?

When it is used on the POI's official website or on other official resources. Even if the official website
doe

not use the name, if it is used in other official sources, the name is correct.

Where to check?

Need to check it in

Chain business locator Official Website

About us sec on on an Official Website

Signs and/or storefronts seen in Street view

Claimed social media accounts

No resources available?

Check on recent street/online imagery/crowdsourced reviews to check the storefront/sign

publica ons and official menus

If it cannot be confirmed because there are no sources available, rate as Can’t Verify and Result
Name

How do we determine if the result is par ally correct?

It differs from the official versions but can s ll be recognized by the user.

Mistakes accepted as Par ally correct

Minor and moderate misspellings,

Service level mismatches.

Missing or unnecessary name parts.

Including holding names/corporate structures

"The"

If "the" is missing when a company uses it, both with and without "the" would be Correct

However, if it is added when it is not used, it would be Par ally Correct and Result Name

Other things to take into considera on:

Loca on Modifiers

If the modifier is not crucial for understanding the result, mark as Correct

If it is not spelled correctly or if it is essen al for the understanding the result, mark as Par ally
Correct.

Corporate name

If a company has different names depending on the region the interna onal one (English) would just
be valid if the test locale is English

If not, mark unexpected language/script checkbox. Result Name

How do we determine if the result is incorrect?

It can't be recognized because of severe misspelling or ambiguous or unnecessary/missing parts in

the name

Mark as Incorrect if:

-Severe misspellings that prevent the user from iden fying the business because of change in
meaning. create an en rely different word or are gibberish

-Holding names completely different than the recognized name

Unnecessary or missing parts in the name that prevent the user from recognizing the business

Slang and inappropriate language

Keep in mind:

If a result category is Incorrect, the final Name and Category Accuracy ra ng will always be Incorrect,
even if the name is Correct, or Par ally Correct. Result Name
I

Actual Name

Name Accuracy

The misspelling changes the meaning, which makes the name ambiguous: It could be a "Taco Bell"
chain store or a different business named "Taco Bull

Taco Bull

Taco Bell

Incorrect

Result Category

How do we determine if the result category is correct?

The category accurately reflects the business, service, or func on of the en ty. This includes broad or
alternate categoriza ons that are not the preferred choice but are not misleading

Correct

Some categories may seem sightly too specific or too general If the categoriza on is not misleading,
consider it correct.

Categories can vary for similar POIs and vary per market Localiza on of categories should be
considered when deciding on correctness

Incorrect

Consider the category incorrect when it is

Wrong

Misleading

Misspelled

Incomplete (missing parts or tas uncommon odd

abbrevia ons)

In an unexpected language/[Link] Category

Other things to take into considera on:

Not every result will include a category, but when one appears, you will find it below the address
details If the category is missing or listed as N/A, make your ra ng based on the name alone.

Name not applicable (n/a)

For all address type of results. Since they do not have a name or category, it is not expected to
evaluate those Select n/a. Transit names

Transit results (sta ons, airports, ports, etc.), are o en named a er the locality or street where they
are located and can include a transit indica on (e.g. "Sta on" or "Subway)

The transit indica on in the result name tle is considered op onal and can be missing and s ll be
considered correct

The category of the result will help you correctly interpret the result because categories for transit
Pols should be a reference to transit

Keep in mind that some transit Pois located on street intersec ons may have a result tle that is the
name of the street intersec on. This is also considered Correct

If there are mul ple transit systems opera ng out of the same sta on, any of the systems can be
included in the name to be Correct. Name/Title Correctness

Correct

Correct

Par ally Correct

Par ally Correct

Incorrect

Incorrect

Category Accuracy

Correct or N/A

Incorrect

Correct or N/A

Incorrect

Correct or N/A
Incorrect

Final Name and Category Accuracy Ra ng

Correct

Incorrect

Par ally Correct

Incorrect

Incorrect. Index

Components

Issues

Result Expecta ons

Address Components and Issues

Components

Street Number

Unit/Apt

Street Name

Sub-Locality.

Region/State

Postal Code

Country

Address does not exist

Language/Script issue

Country specific issue

Other Issue
Incorrect. Address Components and Issues

You'll need to select each checkbox depending on the components missing or incorrect and the
issues found in the address.

Remember that if the mistake is not ed to a component but to an issue pa ern, you'll need to select
only the issue.

Never select issues and components to report the same problem. For example, do not rate Incorrect-
Language/Script issue for the en re address and also Incorrect-Street Name because street name is
in an incorrect language.

However, if it addresses two different mistakes, you can mark both an issue and a component. For
example, if the language/script issue and the street number are wrong, you need to mark the street
number checkbox and the one for language/script.

13002

Address Components

Elements used to form the address details for the result: street number, unit/apt, street name,
locality, region/state, postal code and country.

These are defined by a global approach so some address components might be missing. For each
market you'll need to check the Country Specific GLs to see which requirements are compulsory for
each result.

Each country has its own understanding of what is expected (correct) or unusual (incorrect) for the
components. See your Country Specific guidelines for more informa on. However, the US ones are
the one expected during the cer fica ons. Street number

How do we determine if any component is correct?

It is the one assigned in official website or on other official resources.

INCORRECT

If the number is missing or wrong, mark it as Incorrect-Street Number.

If your market needs a number extension and it is wrong/missing, mark it as Incorrect-Street

Number.

ADDRESS RANGES

Used to assign numbers to a stretch of road. As a result, not all numbers will have a building assigned
to them.

If we have an address range in the query or in a result, consider it Correct when

The result street number is within the queried range

The result address range exists and contains the queried street number

The range or number matches the odd even numbering system for le /right side of street required
by the country. Unit/Apt

A street number can be divided into unit, apartment, or building numbers.

Commonly seen forms include the use of le ers: A, B, C, the character # in front of a number or even
%. A unit number should be correct and present when the official address of a business/POI contains
a unit number.

If it is missing or if it is added when the official address does not have it, Rate Incorrect-Unit/Apt

Result address

Vuori 333 Santana Row Suite #1110 San Jose, CA 95128

Vuori 333 Santana Row San Jose, CA 95128

Official Address

333 Santana Row Suite #1110 San Jose, CA 95128

Ra ng

Correct: This is the correct address listed on the official website of the business.

Incorrect: This result address is missing the unit number listed on the official website Unit number
checkbox should be selected.

Street name

INCORRECT

If the result address has an incorrect or missing street name rate Address Accuracy as Incorrect-
Street Name.

Misspells including missing diacri cs (e instead of é, I instead of I) may be rated Incorrect-Street

Name.

If street direc ons (e.g. North (N)) or street types (St for Street) are incorrect or missing, the street
name is wrong and rated Incorrect-Street Name.

ALTERNATIVE NAMES
A street name can have an alterna ve name or route number, or even have different names in
different languages in bilingual areas. If both are s ll used, marked as Correct.

If the street name has changed and the older name is no longer in use, consider the old name to be
Incorrect-Street Name if returned. Sub-Locality and other administra ve subdivisions

Some countries or areas require an addi onal subdivision, like sub-locality, for correct address
informa on. See your Country Specific guidelines for specific guidance. The general guidance is to
rate a wrong sub-locality

as Incorrect-Sub-Locality. Do the same if the sub-locality is required but missing.

Locality

INCORRECT

Misspellings within the locality name, including missing diacri cs (e instead of é, I instead of 1) may
be rated Incorrect - Locality. See your Country-Specific Guidelines for more informa on.

If the locality is wrong, also mark it as Incorrect.

ALTERNATIVE NAMES

In cases of local government reforms or other changes in naming, the result has to reflect the official
name. Excep ons are made when alternate names are accepted. Address Components and Issues

You'll need to select each checkbox depending on the components missing or incorrect and the
issues found in the address.

Remember that if the mistake is not ed to a component but to an issue pa ern, you'll need to select
only the issue.

Never select issues and components to report the same problem. For example, do not rate Incorrect-
Language/Script issue for the en re address and also Incorrect-Street Name because street name is
in an incorrect language.

However, if it addresses two different mistakes, you can mark both an issue and a component. For
example, if the language/script issue and the street number are wrong, you need to mark the street
number checkbox and the one for language/[Link] Components

Elements used to form the address details for the result: street number, unit/apt, street name,
locality, region/state, postal code and country.

These are defined by a global approach so some address components might be missing. For each
market you'll need to check the Country Specific GLs to see which requirements are compulsory for
each result.
Each country has its own understanding of what is expected (correct) or unusual (incorrect) for the
components. See your Country Specific guidelines for more informa on. However, the US ones are
the one expected during the cer fica ons. Sub-Locality and other administra ve subdivisions

Some countries or areas require an addi onal subdivision, like sub-locality, for correct address
informa on. See your Country Specific guidelines for specific guidance. The general guidance is to
rate a wrong sub-locality

as Incorrect-Sub-Locality. Do the same if the sub-locality is required but missing.

Locality

INCORRECT

Misspellings within the locality name, including missing diacri cs (e instead of é, I instead of 1) may
be rated Incorrect - Locality. See your Country-Specific Guidelines for more informa on.

If the locality is wrong, also mark it as Incorrect.

ALTERNATIVE NAMES

In cases of local government reforms or other changes in naming, the result has to reflect the official
name. Excep ons are made when alternate names are accepted. Region or State

INCORRECT

Again, each country has its own understanding of what is expected (correct) or unusual (incorrect)
for region or state components.

However, the state is a mandatory component in the USA. Incorrect - Region/State checkbox will be
selected for missing state.

Example

Result address

1384 Navarro Dr 1354 Navarro Dr. Sunnyvale, 94087, USA

Official Address

1384 Navarro D Sunnyvale, CA 94087 USA

Ra ng

Incorrect-Region/State:

This address is missing the state, which is a mandatory component in USA

Postal Code

Keep in mind

The postal code accompanies the locality name and provides further detail about where a feature is
located, if a postal code is not mandatory but is present in the result address, rate Correct as long as
the postal code applies to at least part of the feature (street, locality, large POI without an expected
address, etc.).

Other things

For many locali es, more than one postal code may apply. As long as the returned postal code is
correct for at least a part of the feature rate Correct. Columbus, OH, for example, contains 45 postal
codes.

Again, consider any country specific conven ons when it comes to the use and correctness of
shortened postal codes. The US postal code does not need the four-digit extension that follows the
five-digit main code. Ignore it if it appears. Country

INCORRECT

The country is not mandatory for in-locale addresses, but if it appears it must be well spelled and
without mistakes.

If the result is out of the locale, it needs to be present. If missing, rate Incorrect and select the
Country checkbox.

Locale

Result address

En US

Museum Lein 6. 1071 DJ Amsterdam

Example

Official Address

Museum Lein

1071 DJ Amsterdam, Netherlands

Raing

Incorrect-Country:
The country is mandatory in this example because the address is in the Netherlands, which is outside
the user's US test locale. Address does not exist

They can be associated with the address components or the address itself. An address-type result
should be associated with a building or a plot of land that has been officially designated this address

INCORRECT

If you find strong evidence that there is no building at the address or that no plot of land has been
officially assigned the address, rate Incorrect -Address does not exist.

Remember to include a detailed comment including links explaining your finds.

If your market uses street number extensions and the result offers an address without it and it does
not exist rate the address as Incorrect-Address does not exist

INCORRECT

Some mes, the street address can be found in a different locality instead of the one that appears.
Always mark such cases as Incorrect-Address does not exist and not as Incorrect-Locality.

Use the Incorrect-Address does not exist checkbox for any address result that doesn't exist, like a
street or sub-locality result. This ra ng should not be applied to POI addresses.

If there are not enough resources available to make an informed decision, rate Can't Verify

Language/Script Issue in Adress

Address details must be in the language specified for the test locale

INCORRECT

Use the Address Accuracy Incorrect -Language/Script Issue checkbox if you find issues of this nature
in any of the address components of the address details of any result.

Rate mixed languages and scripts found in any address details as Address Accuracy Incorrect -
Language/Script Issue when they use a different language or script than the one used in the query,
test, or result loca on. Other Issues

Used for:

Issues not men oned in these guidelines are reported using the Incorrect - Other Issue checkbox.
Remember to leave a comment as well as links to the resources you used to iden fy the issue.

This checkbox is also used for:

Duplicate address components

Name of POI reappears in the address details

Natural features that contain street address elements.

P.O. Box addresses

Keep in mind

You may also use this checkbox if you no ce forma ng issues along with any Incorrect components
you've already selected since once you mark a component Incorrect, you can no longer choose
Correct with Forma ng issue.

160/3000

2004 нас

Correct with Forma ng Issue

Mark it when the informa on is correct and available in the address, but not in the format expected
(it not equals MISSING, rate incorrect if any informa on is missing).

Components are in unexpected order

Non-required but correct address components

Extra spacing

Double comma [..]

Valid but redundant or unnecessary components (See your Country Specific guidelines for more
informa on).Can't Verify

Mark it when it cannot be confirmed as Correct or Incorrect. This mostly happens when there is a
lack of resources or an unexpected address format is given on the official website.

Lack of resources:

No official webpage found

No official address listed

General lack of official resources

Lack of street imagery

Unexpected addresses

Unexpected address formats used by official resources can include:

Intersec on address (Main St and 2nd St)

Exit address (Exit 5, Hay 101)

Descrip ve address (Main St between 6th and 7th Streets)

Ask yourself: Is the loca on given by the result address at least not wrong given all the informa on I
have found?

Can't Verify

EXAMPLE

The following example shows address details for a business called "Utopia".

No informa on online confirms the address and only a few street numbers can be confirmed with
official resources.

The street number needs to fall between the range of exis ng addresses and 165 falls within the
possible street numbers ranging from 103 to 175. Those are the houses closest to the result address
that could have been confirmed.

Rate the address as Can't Verify. Result Expecta ons

You can encounter 3 kinds of results:

Business/POI results

Adress type results Features without an expected address

Different address details are expected for each result type. For example, the Amazon River has no
street address but its name is accompanied by the country, while the fast food restaurant
Wienerschnitzel shows a complete address. You will need to iden fy the right expecta ons in order
to rate addresses accuracy.

Wienerschnitzel

75 Saratoga Ave Santa Clara, CA 95050 United States 1 Church St 1 Church St Burlington, VT 06401
United States

Amazon Brazil

Business

Residen al Address

Natural Tam
Eiffel Tower

5 Avenue Anatole France 75007 Paris France

Landmark

Grand Central Terminal

Manha an New York, NY United States

Transit Sta on

Yellowstone Na onal Park Yellowstone Na onal Pas WY AZ100

Na onal Park

2004 A

Business/Poi results

The address details of a business or POI generally consist of: street number, street name, locality,
region, postal code, and country.

Correct

When it points to the same physical loca on specified on the official website or other official
resources AND

All mandatory components needed for your market are present.

Use official resources to confirm the address in case that a business/POI official website does not
show the full address or if there is a conflict with the result address.

If a business or POI has more than one official address for the same loca on, accept any of them as
Correct. Business/Poi results

Resources you can check

Social media sites claimed by the business/POΙ and updated within the last 6 months

Street imagery (any recent online imagery showing streets and buildings)

Postal authori es (for postal codes and locality names)

Government property registries

If no official resources can be found, rate according to other mul ple reliable sources such as:
Ar cles in primary publica ons (newspapers or similar publica ons that do their own repor ng)

Crowdsourced user review sites

When no official resources are available and address components are missing or clearly incorrect,
please check if those components are required in the locale or region of the result and then select
the appropriate checkboxes under Incorrect in case it is needed

Query Locale

Gary

Correct: For verifying

Address Accuracy, you

should use the official

3. Wellhausen Weather Technologies

p.//[Link]/The address reported hers actually matches the official website, so

Address Accuracy is Correct. Business/Poi results

Alterna ve official addresses

Valid alternate street and locality names: When valid alternate names for streets or locali es are
used interchangeably, consider all versions Correct.

Valid alternate street addresses: When valid alternate addresses are returned, consider all versions
found on the official website or confirmed by official sources as Correct.

If there is any obvious error in an official source, like a misspelled country or city name, and the same
error appears in the result, rate the erroneous component Incorrect.

Department Addresses

When the official webpage does not give a complete address with street number and name for a
large en ty (mall, university, etc.)

Rate the result address Correct when it matches the address of any department or en ty at the same
loca on complex or campus

If the locality is missing, rate Incorrect. If the en ty has an official address and the result address
belongs to another en ty in the same complex or on the same campus, also rate Incorrect

If the exact locality is unclear because the entry borders mul ple loca ons, rate Can't Verify
Address results

An address usually includes a street number, street name, locality, postal code and state/region. It
can be the same as the mailing address or other addresses provided by the official resources.

Correct

They need to include mandatory components in order to be Correct.

It might be impossible to confirm an address on official resources when another format is used. Rate
Can't Verify if the address points to the same loca on using an alternate format and there are no
missing or incorrect components.

Keep in mind

Streets/Roads: Local roads that stay within a certain locality or county must include the appropriate
locality and state name. However,

Interstates or longer roads can vary. US locali es usually include the State.

If the user makes the query from a country outside the state or region result, that result must be
accompanied by the country name

The country is the highest administra ve level and has no other address component. Incorrect:

Address result is not the one shown in the result name and not the one the user is searching for.
Correct: Result

a street, if only requires street name, locality and region. Since is in the locale, t does not require the
country. Address results

Features without expected street address

Natural features (rivers, mountains, jungles, and other geological features. Typically, do not have a
street address, so natural feature results should be returned without any street address components.
Countries, locali es, states and postal codes can be correct depending on the feature.

POIs without street address: includes

Monuments, Na onal Landmarks, bridges, square, parking lots, Transit Pols, park-like heritage sites,
and others. The locality must be returned whenever a POI fits en rely within it.

Keep in mind

Some of these features have an official street address listed on their website or found on other
official sources.
Since a full address is not expected, the result does not need to contain a full address even if there is
one found in official sources. If the result and official addresses are iden cal, mark it as Correct

When there is no official address the returned street address cannot be confirmed and therefore
cannot be considered correct, mark Incorrect or Verify depending on the result. Pin Accuracy

What is Pin Accuracy?

Pin Accuracy is the a ribute that determines whether the pin loca on indicated on the map matches
the actual loca on of the result in the real-world.

What is a pin?

The pin is the symbol on the map that tells us where the result we are ra ng is located. The head of
the pin is only an indicator; the p marks the actual loca on.

What is the actual loca on of the result?

Where the result is in the real world. The pin on the pla orm map should be a reflec on of the result
in the real-world. Pin Accuracy

How do we determine if the Pin is Accurate?

A Pin is accurate when its posi on on the pla orm map reflects the loca on of the result in the real
world.

THE GOAL

VERIFY DATA ACCURACY

1st step of research

FIND RELIABLE SOURCES

2nd step of research

FIND RESULT ON A MAP APPLICATION

ACTION ITEM

COMPARING THE PLATFORM DATA WITH REAL-WORLD DATA. Pin Accuracy

Ra ng op ons for Pin Accuracy:

Perfect: the pin falls on the roo op area of the result.

Approximate: the pin falls out of the roo op but within the boundaries of the result.
Next door: the pin falls out of the boundaries of the result, but specifically on the roo op of the
neighbourhood property.

Wrong: the pin falls out of both the roo op area and boundaries of the result.

Can't verify: real-world loca on of the result cannot be verified; hence no comparison can be made
between pla orm data and real-world data. Pin Accuracy

Ra ng op ons for Pin Accuracy:

Perfect: the pin falls on the roo op area of the result.

Approximate: the pin falls out of the roo op but within the boundaries of the result.

Next door: the pin falls out of the boundaries of the result, but specifically on the roo op of the
neighbourhood property.

Wrong: the pin falls out of both the roo op area and boundaries of the result.

Can't verify: real-world loca on of the result cannot be verified; hence no comparison can be made
between pla orm data and real-world data.

Pin Accuracy

How to establish roo op and boundaries areas:

To rate a pin for a feature, you must first understand where the feature begins and ends
(boundaries). Some features have roo ops (houses, businesses, malls, and so on) and sit on a parcel
of land that belongs to or is associated with them.

The boundaries of a feature always include half of the road when a road is present as limit of the
property. According to the Half 'n' half rule: divide the space between the street or next building in
half to create a boundary when

not present.

Pin Accuracy

Example of roo op and boundaries areas:

Green area: Roo op of the result Yellow Area: Boundaries of the result established

according to the Half 'n' half rule. Pin Accuracy

Features with no roo op:

Other features that do not have roo ops (mountains, parks, waterfalls), s ll have a place where they
begin and where they end, they are defined by defining features and associated features.

If the natural feature has a defining feature (water for a river/ocean, cliffs/peak of a mountain, the
sand for a beach), pin should fall on that feature or if the natural feature is defined by an arbitrary
boundary (parks, na onal forests), pin should fall in their polygon or where it would be if we had that
informa on.

Green area: defining feature of the result. In the case of a lake, it would be water.

Yellow area: associated feature of the result.

In the case of a lake, it would be

the shore of the lake.

Pin Accuracy

Boundaries in Shared Spaces:

When a feature shares a parcel or parking lot with other en es and the same space is used to
access many en es, it can be difficult to determine a feature's boundaries.

If the shared parcel contains any through roads, apply the Half 'n Half rule to them.

Example of a store in a mall:

Malls are en es that contain different stores in the same building

under the same roo op.

If, for example, the result to rate is a restaurant inside a mall with shared parking that has no public
or internal access roads passing through it, the en re shared parcel would be considered as
boundaries area (yellow area) and only the sec on of the roo op over the restaurant would be
considered the roo op area (green area) for that result. This is because the exact loca on of the
business

can be confirmed with street imagery or other strong evidence. Pin Accuracy

Example of Perfect pin:

Result to rate:

1. Sheetz

Address

1406 A Hun ngton, WY

Classifica on

25701

Distance to User

Distance to

Commence Thore

2014

Viewport

Lat Ling

38-418-42-44316

8th St

Pin in the pla orm

Pin in the map applica on

Pin Accuracy

Street imagery evidence. Pin Accuracy

Condi ons for a Pin to be Approximate:

1. The pin falls within the boundaries of the result, but outside the roo op area for results with
roo op and gut side the defining feature area for results without roo op.

2. It doesn't ma er where the pin is located in the boundaries area/associated feature area, as long
as it is within that designated area, it is considered Approximate. For edge cases: apply the Tennis
rule - if the pin drops on the perimeter of the area designated as Approximate, it should s ll be
considered Approximate and not Wrong.

3. Boundaries in Shared Spaces: if you can iden fy the specific area of the shared roo op
corresponding to the result you are evalua ng, only that specific area will be eligible for the ra ng of
Perfect. If the pin drops outside of those areas but within the rest of the boundaries of the shared
space, pin is eligible for the ra ng of Approximate.

Pin Accuracy

Example of Approximate Pin:

Result to rate:

2. American Eagle Ou i ers

Address

32005 Alport Road W Traverse

Classifica on

Chy, Mi 45664

Distance to Uver

Clothing

Distance to

1569 km

Viewport

15.69 k

Lat Ling

Pin in the pla orm

Pin in the map applica on. Pin Accuracy

Zooming in:

PP

19

Pin in the pla orm

Pin in the map applica on

MAT

Pin Accuracy

Condi ons for a Pin to be Wrong:

1. The pin falls outside the roo op area/defining feature area and outside of the
boundaries/associated feature area of the result.
2. A pin is also considered Wrong with Coordinate and "My Loca on" Queries when it falls outside
the 50m radius of the loca on intent.

3. Boundaries in Shared Spaces: if you can iden fy the specific area of the shared roo op
corresponding to the result you are evalua ng, only that specific area will be eligible for the ra ng of
Perfect. If the pin drops outside of that area and also outside of the rest of the boundaries of the
shared space, pin should be rated Wrong. Pin Accuracy

Example of Wrong Pin:

Result to rate:

3. Culver's

Address

4401 Co age Grove Rd. Madison, WI 53716

Classifica on

Restaurant

Distance to User

12.5 km

Distance to

332 km

Viewport

Lat. Ling

43.00369-69.3037

Pin in the pla orm

Pin in the map applica on. Pin Accuracy

Condi ons for a Pin to be Next Door:

1. The pin falls outside the roo op area/defining feature area and outside of the
boundaries/associated feature area of 2 the result, BUT on the roo op of a neighbouring property.
What is a neighbouring property? It is the immediate property next to the intended one.

Features of a neighbouring property:

The Next Door property must be on the same street as the intended property,

-The Next Door property must share the same street name as the intended property,

-The Next Door property must be on the same side of the street as the intended property The Next
Door property must be the first property to any side of the intended property;

The Next Door property must be on the same block as the intended property

4. When the pin lands on a neighbouring structure that falls on a different block than the intended
loca on, the pin is considered incorrect, and Pin Accuracy should be rated as: Wrong, not Next Door.

5. Boundaries in Shared Spaces: The ra ng of Next Door does not apply to this case scenario

Pin Accuracy

Example of Next Door Pin:

Result to rate:

1. Legacy Gym

Address

1891 Yellowstone Rd. Rock Springs

WY 82901

Classifica on

Sports

Distance to User

17.2 k

Distance to Viewport

4.2 km

Lat. Ling
4164178

109.25389

Legace Cym

Pin in the pla orm

Pin in the map applica on. Pin Accuracy

Example of Next Door Pin:

Does "Morcom Specialty classify as Next Door property?

On the same street as the intended proper: YES

The Next Door property must share the same street name as the intended pre y YES

The first property to any side of the intended property: YES

On the same block as the tant property: YES

Pin Accuracy

Conclusions

1. Pin Accuracy is the a ribute that determines whether the pin loca on indicated on the map
matches the actual loca on of the result in the real-world.

2. To determine if a Pin is accurate, you should compare the Pin in the pla orm with the actual
loca on of the result in the real world, and to do that you should look for the result on a map
applica on.

3. You have to iden fy the boundaries of the result which comprehend the roo op area of the
building and rest of the parcel lot on which the result is located at for results with roo ops
(businesses, POIs) and defining feature area/associated feature area for results without roo ops
(natural features like lakes, mountains, parks).

4. Ra ngs vary according to the fact that the Pin falls on the roo op area (Perfect), not on the
roo op area but with but on the of the boundaries (Approximate), out of the boundaries of the
result (Wrong), out of the boundaries of the result but on the roo op of the neighbouring property
(Next Door).