Evaluation Process – Cognitive Walkthrough

The Cognitive Walkthrough (CW) we conducted was a pivotal element in our project's design
phase, specifically aimed at refining the user experience related to privacy settings in our digital
application. This evaluation was methodically planned and executed to uncover any usability
issues that could potentially hinder user interaction with our app, focusing on intuitiveness and
ease of navigation.

The CW, a methodological approach grounded in user-centered design principles, was selected
for its robust framework in assessing the intuitiveness of user interfaces. The objective was to
simulate typical user interactions within our application, specifically targeting our newly
introduced privacy management features. This evaluation aimed to uncover any usability issues
from a user's perspective, ensuring that the application's design was both intuitive and efficient.

Our CW was carried out by a diverse group of evaluators, comprising team members across
multiple project teams. This diversity ensured a comprehensive evaluation from various
perspectives, closely mirroring a wide user demographic. The evaluators were briefed on
embodying the role of a typical user, focusing on the persona "Abby," to provide consistent and
focused feedback on the user experience.

The tasks selected for the CW centered around critical interactions a user would have with our
application, specifically:

Adjusting privacy settings with granularity.

Navigating optional pop-ups detailing app data usage during installation.
Utilizing features to track and visualize personal data leakage.

These tasks were chosen based on their relevance to our application's core value proposition:
offering users unparalleled control and transparency over their privacy settings. Scenarios were
meticulously crafted to guide evaluators through each task, simulating real-world usage
scenarios that "Abby" might encounter.

The CW unfolded in a structured manner, with evaluators independently navigating through the
predefined tasks in the application. At each step of a task, evaluators were prompted to answer
three key questions:

Would a typical user know what to do next?

Could a typical user see how to perform the action?
Would a typical user understand if the action was performed correctly?

These questions were designed to dissect the usability of each task critically, focusing on the
ease of understanding and executing actions within the app.
The primary tool used in our CW was a detailed prototype of our application created in Figma.
This tool allowed evaluators to interact with the app's interface as if it were fully functional,
providing a realistic experience of navigating through the application. Additionally, cognitive
walkthrough sheets were employed to document evaluators' responses, ensuring a structured
and consistent evaluation process.

Results and Discussion

Following our comprehensive Cognitive Walkthrough (CW), we meticulously analyzed the

results, aligning them with the insights derived from our cost-importance table. This dual-
faceted approach not only highlighted usability issues but also offered a structured method for
prioritizing these issues based on their impact on the user experience and the feasibility of
implementing solutions.

The CW illuminated several critical areas within our application that posed potential usability
challenges. Foremost among these was the navigation through privacy settings. Users, as
represented by our evaluators, expressed difficulty in locating and adjusting the settings app,
indicating a need for a more intuitive interface especially for the home screen. The optional
popup detailing data usage during app installation, while conceptually appreciated for its
commitment to transparency, was also found to be potentially confusing, suggesting a need for
more clear and user-friendly information presentation.

The cost-importance table served as a pivotal tool in translating these insights into actionable
design improvements. High-priority issues identified included the complexity of navigating
privacy settings and the information density of the data usage pop-up. Each problem was
assigned an importance value, reflecting its impact on the user experience, and a cost rating,
indicating the effort required for resolution.

Based on the CW findings and the cost-importance table analysis, several general suggestions
for improving the existing LFP emerged:

Navigation Clarity For Settings:

Issue: Users found the process of accessing and adjusting privacy settings and selecting the
setting app from home screen unintuitive, often struggling to find the relevant options.
Improvement Suggestion: Redesign the home-screen interface to enhance visibility and
accessibility. Incorporating clear, descriptive labels and visually distinct navigation cues could
significantly reduce user confusion and improve the ease of use.
Cost-Importance Analysis: Given its high impact on user satisfaction and relatively low
implementation cost, this improvement was prioritized.

Simplification of Data Usage Pop-Up:

Issue: The data usage pop-up, intended to inform users about how their data is utilized by the
app, was critiqued for presenting too less information too quickly.
Improvement Suggestion: Streamline the presentation of data usage information to balance
comprehensiveness with clarity. Implementing a tiered information disclosure, where users can
opt to view more details if desired, could address users' varied preferences for information
depth.
Cost-Importance Analysis: This issue was deemed a high priority due to its substantial influence
on user comprehension and the relatively moderate effort required for its redesign.

Enhancing the User Interface for Personal Data Leakage Visualization:

Issue: The feature allowing users to visualize personal data leakage was found to be not very
clear, making it challenging for users to interpret the presented information effectively.
Improvement Suggestion: Simplify the visualization interface to make it more user-friendly.
This could involve clearer graphical representations and concise, actionable insights into how
users might protect their privacy.
Cost-Importance Analysis: While the redesign of this feature may require a significant
investment of resources, its critical role in user empowerment and privacy management
justifies its prioritization.

The CW was instrumental in highlighting not just specific usability issues but also broader
design principles that our application should adhere to, such as simplicity, clarity, and user
empowerment. The process underscored the importance of designing with the user's
perspective at the forefront, ensuring that features are not only functional but also accessible
and understandable.

Armed with the insights gained from the CW and the structured prioritization provided by the
cost-importance table, we are poised to refine our application's design. The identified
improvements will guide our next iteration, focusing on enhancing the user experience through
intuitive design, clear information presentation, and meaningful privacy controls. Our
commitment to these principles is unwavering, as we aim to create an application that not only
meets but exceeds our users' expectations in managing their digital privacy.