Josep- Usability Test Google Lens

Me: How often do you use image recognition tools like Google Lens?
Joseph: I rarely use

Me: What do you typically use your mobile device for?

Joseph: Social media, make calls. Listen to music watch videos, browse the Internet. And a lot of other
things.

Me: Have you ever used Google Lens before?

Joseph: Yes, I have used it a couple of times.

Me: What did you use it for?

Joseph: I use them to search for products. If I see something I want to buy online physically, I use Google
Lens to search for it. I use Google Lens for translation also. I pointed at something and then it translates
it. If I want to search for something and I don't know the name. I just use Google Lens to take the photo.
And then it searches for the name, for me, I think I like it. These cases have used them on.

Me: Beautiful, thank you. So now please open the Google Lens app and share your screen.
Joseph: Can you see my screen?

Me: Yes, I can see your screen

Joseph: This is Google Lens

Me: Before doing anything, please take a moment to look at the first screen. What do you see? What do
you think you can do with this app?
Joseph: I can use it to do homework, I can use it to search for stuff online. I can also use it to translate.
These are the three use cases.

Me: Alright. So, what stands out to you?

Joseph: I think I like the fact that I can just take photo without taking normal photo and uploading, I can
just take a photo directly. What stands out is the option to translate as well, it’s very very important.
Another option is that I can upload a photo. I can also see my history for things I have searched for in the
past.

Me: This is the scenario. You are a frequent traveler, and today, you find yourself in a large and
vibrant market. The market is filled with colorful stalls, people, and plenty of attractive objects
and food—some locally made, others from around the world.
You want to buy interesting souvenirs for your loved ones, but since you cannot speak the local
language, you only rely on your smartphone for assistance. As you explore, you find five things
that intrigue you. Before purchasing them, you have taken pictures of them and want to learn
more about their history, origin, and significance. To do this, you will use Google Lens to upload
the photos and gather relevant information. So the first task, I’m going to send you a picture and
you have to save it in your phone library then you use Google Lens to upload it and tell me.
Ehm, so what do you expect to see in the results. Okay, let me send you the image first. Okay so
I’ve sent one to you. Have you successfully downloaded?
Joseph: Yeah

Me: Alright, so what do you expect to see in the results when you use Google Lens? Let me
know your expectations. Can you hear me?
Joseph: If I’m in the market,

Me: Yeah!
Joseph: I can hear you.

Me: Please go ahead

Joeph: So the scenario says I'm in the market, I don't know what to buy. Is it? Because I don't
understand the language of what is written on it or is this because I don't know what the item is.
And secondly, I'm a bit confused because I can see that it's a bag. and I was thinking, If I’m in a
foreign market I don't know what to buy, maybe the item would have a description of that local
language so I can click on it and translates because right now, I’m seeing items online. I don't
know if I should look at the description online which might be different from what’s in the
market. Or if you buy from the vendors that they are showing me online. So what do you want
me to do?

Me: So you want to know more about the history, origin and significance of these items you are
about to analyze.
Joseph: Okay, so I have uploaded the item, I could ask. So I can use Google to search and ask.
Then this looks promising. Okay, so I think I have gotten what I need.

Me: Okay
Joseph: I can search with the image and then Google also allows me to add text based on what I
want to see in that image. It gives me the results.

Me: Okay. So do you see anything about the history or the origin of this bag?
Joseph: Yeah, I have, from the website

Me: How confident are you in the accuracy of the results?

Joseph: I would say 60-70% because most of the sites here are asking me to buy and I do not
know if they just copied it online as well.

Me: Okay. If it is the wrong object, what would you do next?

Joseph: I don’t understand. How would it be the wrong object? I thought I’m searching with a
picture?
Me: It is possible that it comes up with an object that is not related to the picture.
Joseph: Oh, the Google Lens comes up with an image that is not related to the picture?

Me: Yes.
Joseph: Okay, if it’s a different object not related to the picture, I will exit because that’s not
what i’m looking for so there is no point moving forward.

Me: Okay. So, I'm going to send you the second picture right away. Please download it. So, this
picture is called a kalimba box. So, you're going to upload it and review the provided
information. In this case, you don't know what it is. You want to know, what's the box is? So
upload it and let's see what Google Lens about it.
Joseph: Okay

Me: Please share your screen

Joseph: I’m sharing my screen. Can you see my screen?

Me: So, what information did it provide you with?

Joseph: It brought me to where I can buy the item and then it has a little description of what the
item is, wher eit originated from, and what it can be used for. And then of course, there is a link
for me to buy the item.

Me: Is that information relevant and helpful?

Joseph: Yeah, it is, because it has given me more information about the item and then it has
gotten me curious.

Me: Okay. Is there any important data that you think is missing?
Joseph: Ah….Not really! All of the characteristics and everything is here. So I dont think there is
anything….maybe how to use the item because I only saw what it is but not how to use the item.

Me: Okay, so I;m going to send you the next image. So that’s a bitter leaf plant.
Joseph: Okay

Me: Upload the object and review the research sources. I cannot see your screen
Joseph: I don’t knowm what is wrong but my video is up. Let exit and return.

Me: Okay, I can see your screen.

Joseph: What do you want me to do?

Me: Upload the object and review the listed sources. Do the sources appear credible? Wikipedia,
e-commerce sites, blogs. Do they appear credible? That is supposed to be a bitterleaf plant.
Joseph: so, first of all, I don't think the search is giving me specifics. What the plant is, I'm
getting a lot of different items. different plants, I think like three or four different plants from the
top searches. And then there is blogs, people are asking what this leaf is and all that. So I would
say I'm 100% sure that the information here is directly related to the plant because of course the
leaf is green and there are a thousand and one plants that look like this. So, I'll say I trust the
sources to tell me that this is exactly what I'm looking for. Then might be giving me something
that is totally different from what the image is.

Me: Okay. Alright. Thank you. So would you rely on Google Lens to make a purchase decision
based on this information?
Joseph: No

Me: So, I’m going to send you the fourth picture. Have you seen it?
Joseph: Let me check. Yeah, I’ve seen it.

Me: Please share your screen. Upload this picture and compare it with similar objects found in
the results.
Joseph: I think they are the same.

Me: Okay. If you were shopping for this item, would this suggestion be helpful?
Joseph: Yeah, it will

Me: How could this comparison feature be improved?

Joseph: I dont know…Maybe give me an option to just view more about the item. Because all of
the things I’m seeing are basically shops for me to buy. Maybe just information about the item.
At the top tab, I can see items you can switch from; that is helpful as well. Then make it clear
and divide it into tabs, a tab to know the kind of product or just get knowledge about what you’re
looking for without ending up going to e-commerce stores because these stores don’t have expert
information. They just want to sell. I also want to see research, papers and writings and other
facts without having to look at shops and stores.

Me: I have sent you the last picture. Use Google Lens to identify the writing and explore its
history. This is a grocery list written in Efik language.
Joseph: I asked Google Lens to identify the text and I asked it to translate. It gave me different
translations. I cannot rely on Google Lens to translate the language. Google Lens is giving me
similar write-ups for me to identify. It’s giving me other handwritten or paper texts.

Me: Okay. Thank you. So now that you have have completed the assessment, I want to ask some
questions about your experience. What aspects of Google Lens did you find most helpful?
Joseph: the option that enables me to search and translate is helpful, It is easy for someone to buy
the wrong item because of translation. Help translate will help when making purchases or
decisions that are not written in your language.

Me: Okay. What if anything did you find confusing or frustrating?

Joseph: The option to switch between products and viewing other items was confusing at first.
It’s not ver elaborate so I think those ones can be improved on.
Me: Which task was the easiest and why?
Joseph: The first and second tasks were easy. That of the coin was also easy.

Me: Which task was the most difficult and why?

Joseph: The plant and the grocery list was difficult because there are a lot of plants that look
similar to what was uploaded and the list was supposed to be translated but it gave me wrong
translation and gave me other lists that look like that. So it’s not what I was looking for. I had
something else in mind but the results were different.

Me: Did you trust the information provided by Google Lens?

Joseph: Not 100%. If it’s a yes and No, then borderline but not 100%

Me: Would you use this tool for object identification? Why or why not?
Joseph: Yes, I will. There are limitations to what it can do but there are also advantages as it
helps in identifying objects.

Me: If you could change one thing about Google Lens, what would it be?
Joseph: I don’t think I would change anything.

Me: This was very helpful. Thank you for your time and insights. I’m really grateful.
Joseph: You’re welcome.

Time Taken for Each Task and Why

Task Time Why It Took That Long
Taken

Mochila Bag 3:48 The task was unclear to Joseph initially; he needed clarification and
minutes explored different paths.

Kalimba Box 1:45 Smooth experience; the item was unfamiliar but interesting and the
 minutes results were helpful.

Plant 1:45 Multiple conflicting results led to doubt and extra effort verifying
Identification minutes credibility.

Coin 2:22 The task was straightforward but the comparison of details added
Comparison minutes time.

Efik Grocery 1:20 Quick execution, but the results were frustratingly inaccurate;
List minutes Joseph lost interest.

Reasons for Delays

 Cognitive Load: Joseph had to interpret unclear or inconsistent search results.
 Interface Limitations: Difficulty navigating tabs or switching between knowledge-based and
commercial content.
 Ambiguous or Noisy Data: Visual similarity in plants; handwritten text misinterpreted.
 Frustration Accumulation: By the grocery list task, he was mentally fatigued and less patient.

Was It Worth Investing the Time?

 Yes, for object identification (e.g., Kalimba, coin) — it offered new knowledge and some sense
of discovery.
 No, for tasks requiring specific translations or identifying visually ambiguous items — results
were inaccurate or untrustworthy.