100% found this document useful (1 vote)
1K views4 pages

ATLAS Knowledge Quiz Labeling Guide

The document provides guidelines for labeling actions in a knowledge quiz, emphasizing the importance of accuracy and clarity in annotations. It covers various scenarios, including how to label multiple actions, the use of timestamps, and the acceptable terminology for actions. The correct answers for each question highlight the need for precise descriptions that reflect observable actions and interactions.

Uploaded by

bonfacemutie39
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
100% found this document useful (1 vote)
1K views4 pages

ATLAS Knowledge Quiz Labeling Guide

The document provides guidelines for labeling actions in a knowledge quiz, emphasizing the importance of accuracy and clarity in annotations. It covers various scenarios, including how to label multiple actions, the use of timestamps, and the acceptable terminology for actions. The correct answers for each question highlight the need for precise descriptions that reflect observable actions and interactions.

Uploaded by

bonfacemutie39
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

ATLAS KNOWLEDGE QUIZ ANSWERS Formatted: Centered

1. How should labels be written? • "Pick up mat and place on table" or


"Move mat to table" – must capture
• As passive observations (e.g., "the
both actions
cup was picked up")
• Any of the above are acceptable
• As direct instructions (e.g., "pick up
the cup") Correct answer: Capture both actions

• As timestamps only

• As questions (e.g., "is the cup being 4. What is required for timestamps to be
picked up?") correct?

Correct answer: As direct instructions • They can be off by a few seconds

• Begin when hands reach; end when


hands disengage; must be accurate
2. The subject washes their hands, checks
their watch, and adjusts their head-
mounted camera. How should this be • Only the start timestamp needs to
labeled? be accurate
• "wash hands, check watch, adjust • Timestamps are optional
camera"
Correct answer: Accurate start and end
• "wash hands" – the most visible based on hand movement
action

• "no action"
5. Is it acceptable to use sequence words
• "prepare for task" like "another" and "next"?

Correct answer: "no action" • No – each action must be


independent

• Yes – if each action and timestamp is


3. The ego picks up a mat from the floor
accurate
and places it on the table. Which label is
acceptable? • Only for actions repeated more than
3 times
• "Place mat on table" – the goal is
captured • Only at the beginning of a video
• "Pick up mat" – the first action is Correct answer: Yes, if accurate
captured
ATLAS KNOWLEDGE QUIZ ANSWERS Formatted: Centered

6. When multiple events happen at once,


what must the labels capture?
9. Can you combine "No Action" with other
• Only the first action actions in one label?

• Only the most important action • Yes – "No Action, pick up cup"

• All actions with meaningful object • No – never combine No Action with


interactions real actions

• A one-word summary • Only if No Action comes first

Correct answer: All meaningful object • Only for long segments


interactions
Correct answer: Never combine

7. The subject picks up a red mug from the


10. The ego picks up items while closing a
sink while a blue mug sits on the counter.
drawer with their hip. What should be
Which label is correct?
labeled?
• "pick up mug"
• "Close drawer, pick up items"
• "pick up mug from sink" or "pick up
• "Pick up items" only
red mug"
• "No Action"
• "grab item from sink"
• "Close drawer" only
• "pick up blue mug"
Correct answer: Hand-based actions only
Correct answer: Clearly identify the correct
object

11. The subject adjusts the corners of a t-


shirt to see the design. Which label is
8. What is the maximum word count for a
appropriate?
single dense label segment?
• "inspect t-shirt"
• 10 words
• "adjust t-shirt" or "straighten t-shirt"
• 15 words

• 20 words (about 4 atomic actions)


• "look at t-shirt"

• "examine t-shirt design"


• No limit
Correct answer: Physical manipulation
Correct answer: 20 words
ATLAS KNOWLEDGE QUIZ ANSWERS Formatted: Centered

15. Is "pick up book" acceptable without


specifying the hand?
12. Are "lift", "pick up", and "grab"
interchangeable? • No – must specify hand

• No – use consistent terminology • No – must describe book

• Yes – flexibility is encouraged • Yes – valid annotation

• Only if ambiguous • Only for short videos

• Only for specific objects Correct answer: Yes

Correct answer: No

16. Can relative positions like "left" and


"right" be used?
13. When should a label be "idle" or "no
action"? • No – never

• When ego is walking or hands are • Yes – if accurate from ego’s POV
not interacting with objects
• Only for stationary objects
• When ego speaks
• Only with duplicates
• When ego looks away
Correct answer: Yes, if accurate
• Always at start/end

Correct answer: No hand–object interaction


17. The ego appears about to put down a
phone but doesn’t. Can you label it as "put
down phone"?
14. What is the primary focus of
annotations? • Yes – intent is clear

• Ego movement • No – only label observable actions

• Main actions and hand dexterity


relevant to the task • Yes – if phone is visible

• Every action • Only if within 2 seconds

• Only electronics Correct answer: Only label what happens

Correct answer: Task-relevant hand actions


ATLAS KNOWLEDGE QUIZ ANSWERS Formatted: Centered

18. The ego lifts a shirt and shakes it out.


Which labels are acceptable?

• Only exact wording

• Multiple accurate descriptions are


acceptable

• "Lift shirt" only

• Must include hand positions

Correct answer: Multiple accurate


descriptions

19. A label says "pick up weight and frame"


but only the weight was picked up. What
should happen?

• Accept

• Edit to "pick up weight"

• Add "attempted frame"

• Accept if timestamps match

Correct answer: Edit to match reality

20. If one annotator says "orange box" and


another says "yellow box", is this a
problem?

• Yes – must be correct color

• No – inconsistency is fine

• Yes – same terminology required

• Depends on video quality

Correct answer: Yes, orange and yellow are


different

You might also like