Module 4 Reading Material
Module 4 Reading Material
Reading Material # 4
Module 4: Prompt Engineering and AI–Human
Collaboration
YEEAP · FUSE-AI-101
Foundations of Artificial Intelligence
Module 4 Overview: Talking to the Machine — The Art and
Science of Prompt Engineering
Introduction: The Most Practical Module in the Course
Of all six modules in FUSE-AI-101, Module 4 is the one that will most immediately change what
you can do tomorrow. While Modules 1 through 3 built the conceptual and historical foundations
you need to understand AI intelligently, Module 4 puts AI directly in your hands. It teaches you
how to communicate with large language models effectively — how to write inputs that produce
outputs you can actually use, how to design workflows that combine your judgment with AI
capability, and how to evaluate AI outputs with the critical eye of a professional who knows both
the technology's power and its limits.
The skill at the center of this module has a name: prompt engineering. The term sounds technical,
but the concept is straightforward. A prompt is the input you give to an AI model — the text you
type into ChatGPT, Claude, Gemini, or any other large language model. Prompt engineering is the
practice of designing those inputs systematically and skillfully to produce the outputs you need.
It is, in essence, the art of communicating with AI — and like any communication skill, it can be
learned, practiced, and dramatically improved.
This matters enormously for two reasons. First, the quality of what you get from an AI model is
directly, powerfully determined by the quality of what you put in. Two people using the same AI
model for the same task can get radically different results depending on how well they have
designed their prompt. The professional who understands prompt engineering consistently gets
better, more reliable, more useful outputs than the professional who approaches AI as a black box
and hopes for the best. Second, as AI tools become central to professional work across every sector
— healthcare, finance, agriculture, education, government, creative industries — the ability to use
them effectively and critically is becoming a core professional competency, as fundamental as
knowing how to use a spreadsheet or conduct a web search.
2
A large language model (LLM) is a neural network trained on vast quantities of text — the contents
of much of the accessible internet, books, scientific papers, code repositories, and other text
sources — with a single training objective: predict the next token in a sequence. A token is
approximately a word or word fragment; the model processes text as a sequence of tokens rather
than characters. Given a sequence of tokens as input, the model produces a probability
distribution over all possible next tokens, samples from this distribution, appends the selected
token to the input, and repeats the process until it generates a complete response.
This process sounds mechanical — and in a technical sense, it is. But the remarkable discovery of
the past decade is that training a very large neural network to predict the next token in text, on a
sufficiently large and diverse corpus, produces a system that has implicitly learned a vast range of
capabilities: factual knowledge, logical reasoning, mathematical problem-solving, code
generation, language translation, summarization, creative writing, and conversation. These
capabilities emerge from the training objective rather than being explicitly programmed — they
are a consequence of what it takes to predict text accurately across the full diversity of human
written expression.
Several technical parameters shape the behavior of LLMs in ways that prompt engineers need to
understand. The context window is the amount of text the model can attend to simultaneously —
its effective working memory for a conversation. Temperature is a parameter that controls the
randomness of the model's sampling: lower temperature produces more deterministic, consistent
outputs; higher temperature produces more varied, creative outputs. The attention mechanism —
the self-attention architecture described in Module 3 — determines how the model relates
different parts of the input to each other when generating each output token. Understanding these
mechanics explains why the same prompt can produce different responses on different runs, why
very long conversations can degrade model performance, and why the model sometimes drifts
from the specific task specified in the prompt.
3
Part Two: Core Prompt Engineering Techniques
Prompt engineering encompasses a spectrum of techniques ranging from simple to sophisticated.
At the core are several fundamental approaches that every professional using AI tools should
master. These are the subject of Sub-Module 4.2.
Zero-shot prompting involves giving the model a task with no examples — relying on the model's
pre-trained capabilities to complete the task from your description alone. Most simple AI
interactions are zero-shot: you describe what you want, and the model attempts to produce it.
Zero-shot prompting works well for tasks the model has seen many times in its training data —
writing emails, summarizing text, answering factual questions — but may produce lower quality
results for unusual, specialized, or highly specific tasks.
Few-shot prompting provides the model with one or more examples of the desired input-output
mapping before presenting the actual task. By showing the model what good outputs look like,
few-shot prompting significantly improves performance on tasks where the model needs to
understand a specific style, format, or reasoning pattern. One-shot prompting provides a single
example; few-shot prompting typically provides two to five. The examples serve as implicit
instructions, communicating the task requirements through demonstration rather than
description.
Chain-of-thought prompting instructs the model to reason step by step before producing its final
answer. Rather than asking the model to jump directly to a conclusion, chain-of-thought
prompting asks it to show its reasoning — which both improves accuracy on complex reasoning
tasks and makes the model's logic visible for human review. Simply adding the phrase 'Let's think
step by step' to a prompt can substantially improve performance on multi-step reasoning
problems.
Role and persona assignment instructs the model to adopt a specific identity or professional role
before responding. 'You are an experienced Ethiopian tax attorney...' or 'You are an agricultural
extension worker explaining crop rotation to a smallholder farmer in Amhara...' constrains the
model's response style, vocabulary, knowledge emphasis, and perspective in ways that can
significantly improve relevance for specific use cases. Format control instructions specify the
desired output structure — 'Respond in a numbered list of five items,' 'Format your response as a
table with three columns,' 'Provide your answer in JSON format' — enabling the integration of AI
outputs into downstream systems or workflows.
4
Part Three: Advanced Prompting — System Prompts, RAG, and Agents
Beyond the core techniques, a set of more sophisticated approaches enables AI capabilities that
go significantly beyond what simple conversational prompting can achieve. These are the subject
of Sub-Module 4.3.
System prompts are persistent instructions provided at the beginning of a conversation that
establish the context, role, constraints, and behavior of the AI model for the entire interaction.
Unlike user prompts (which are part of the conversational turn), system prompts are typically
invisible to the end user and are used by developers to configure AI applications for specific use
cases. A customer service chatbot for an Ethiopian telecom company would be configured with a
system prompt that specifies the company's name, the scope of questions the bot should answer,
the tone and language it should use, and the behaviors it should avoid. Understanding system
prompts is essential for building AI-powered applications, not just using AI tools.
AI agents represent the frontier of prompt engineering — systems where an AI model is given not
just a single task to complete, but a set of tools it can use and a high-level objective it must plan
and execute steps to achieve. An AI agent might be given access to a web search tool, a code
execution environment, a document database, and a calendar system, and asked to research a
topic, synthesize findings, draft a report, and schedule a meeting to present it. Rather than
completing this as a single prompt-response turn, the agent plans a sequence of steps, executes
each one using the available tools, observes the results, and adapts its plan based on what it finds.
Agentic AI is rapidly advancing from research concept to practical deployment, with significant
implications for professional workflows.
5
Part Four: Designing Human-AI Workflows
Prompt engineering is not only about individual interactions with AI — it is about designing the
workflows and processes that determine how AI is integrated into ongoing professional and
organizational activities. This is the subject of Sub-Module 4.4.
Task decomposition is a foundational workflow design principle: breaking complex tasks into
smaller, well-defined subtasks that can be effectively handled by AI, and identifying the points in
the workflow where human judgment, creativity, or accountability is essential and AI should serve
as support rather than decision-maker. A complex report might be decomposed into: AI drafting
individual sections from structured notes, human review and correction of each section, AI
formatting and copyediting, human final review and sign-off.
The question of when to use AI versus when to apply human judgment is one of the most
important professional decisions in the AI era. AI is most valuable when the task is well-defined,
the quality criteria are clear, the volume is large, and the cost of individual errors is manageable.
Human judgment is most important when the task requires contextual understanding that AI
lacks, when the stakes are high enough that errors are unacceptable, when ethical reasoning or
value trade-offs are involved, or when the task requires authentic human relationship and
empathy. Developing a clear personal framework for this judgment — and applying it consistently
— is one of the most important professional skills of the AI era.
Prompt libraries and templates systematize effective prompts for recurring tasks, ensuring that
the best-known prompt formulations are shared across teams and that AI interactions are
consistent, reproducible, and improvable over time. Building and maintaining a personal or
organizational prompt library is an investment in AI productivity that compounds over time —
each new effective prompt formulation becomes a reusable asset.
6
training data, where precise factual accuracy is required (specific dates, statistics, citations, legal
provisions, medical dosages), and where the model is interpolating between things it does know
in ways that sound plausible but are wrong. The professional who treats AI output as reliable
without verification is exposed to serious risk — in any context where accuracy matters.
Professional Standard: The professional who uses AI well is not the one who uses it
most, or the one who trusts it most. It is the one who has the clearest understanding of
what AI can and cannot do reliably, who applies the right tool to the right task, and
who verifies AI outputs with the same critical rigor they would apply to any other
information source. Effective AI use is an exercise in professional judgment, not a
substitute for it.
At the same time, the ability to prompt effectively in English gives African professionals access to
some of the most powerful AI tools currently available, and the skills developed in this module
translate directly to productive use of those tools for professional tasks — including producing
English-language documents, research, and content at a quality and speed that would otherwise
require far more time and resources. For young professionals entering Ethiopia's growing digital
economy, this capability is a genuine competitive advantage.
7
The workflow design skills in Sub-Module 4.4 are particularly valuable for African organizational
contexts where AI tools are being introduced into workflows that were not designed with AI in
mind. Understanding how to decompose tasks, identify the appropriate role for AI versus human
judgment, and build sustainable AI-augmented work processes is a skill that will be in high
demand across Ethiopian institutions as AI adoption accelerates.
The sub-modules that follow provide the detailed knowledge and practical frameworks you need
to build these skills: the mechanics of LLMs (Sub-Module 4.1), core prompting techniques (Sub-
Module 4.2), advanced prompting including RAG and agents (Sub-Module 4.3), human-AI
workflow design (Sub-Module 4.4), and output evaluation and verification (Sub-Module 4.5).
Engage with each sub-module actively — not just as reading material, but as a framework you test
and apply in your own interactions with AI tools.
8
YEEAP · FUSE-AI-101
Foundations of Artificial Intelligence
Reading Essay
Tokens, context windows, attention, temperature, and why the same prompt produces
different results
9
Sub-Module 4.1: Understanding Large Language Models
— Foundations and Mechanics
Reading Essay · Estimated Reading Time: 20–24 Minutes
Understanding tokens matters for prompt engineering for several reasons. First, most AI APIs
charge for usage based on the number of tokens in the input and output — understanding token
counts helps manage costs. Second, long inputs that approach or exceed the model's context
window will be truncated or handled in ways that can degrade performance. Third, the model's
attention mechanism processes tokens in relation to each other — understanding this helps you
structure prompts so that the most relevant information is positioned advantageously.
10
Context Windows: The Model's Working Memory
Every large language model has a context window — the maximum number of tokens it can
process in a single interaction, encompassing both the input (your prompt) and the output (the
model's response). Early language models had context windows of a few thousand tokens. Current
leading models have context windows ranging from 128,000 tokens (roughly 100,000 words) to
one million tokens or more. This represents a remarkable expansion of what can be included in a
single interaction — an entire book, a large codebase, or a long conversation history can fit within
a modern model's context window.
The context window is effectively the model's working memory for the interaction. Everything the
model knows during the interaction — the conversation history, any documents you have
provided, the instructions you have given — must fit within this window. When the context
window is exceeded, earlier content is typically dropped, which can cause the model to 'forget'
earlier instructions or context.
Practical implications for prompt engineering: front-load your most important instructions.
Research suggests that information at the very beginning and very end of a prompt receives more
attention from the model than information buried in the middle — a phenomenon sometimes
called the 'lost in the middle' problem. For long prompts with complex instructions, repeating the
most critical constraints at the end of the prompt can significantly improve compliance.
Practical Analogy: Think of the context window as a whiteboard on which the entire
conversation is written. The model reads the whole whiteboard before generating each
response. If the whiteboard gets too full and content is erased to make room, the model
loses that context. If important instructions are buried under lots of text in the middle,
they may receive less attention. Keep your most critical instructions prominent — at the
start and end of your prompt.
11
This process has several important implications. First, the model is not looking up answers in a
database — it is generating text probabilistically, token by token. This means there is inherent
variability in outputs, even for identical inputs. Second, because each new token is generated
based on all preceding tokens (including the tokens already generated in the current response),
early choices in the output constrain later ones — the model cannot easily 'go back and revise'
once it has committed to a direction. Third, the model has no access to external information
during generation — everything it knows comes from its training data and from what you have
included in the prompt.
This token-by-token generation process also explains why LLMs sometimes get worse as a
response gets longer. Errors or suboptimal choices early in the generation cascade forward — a
slightly wrong premise in the first paragraph can compound into increasingly wrong conclusions
by the end of a long response. Techniques like chain-of-thought prompting (discussed in Sub-
Module 4.2) address this by structuring the generation process more carefully.
Temperature scales the probability distribution before sampling. A temperature of 1.0 means
sampling from the original distribution. Lower temperatures (0.1 to 0.5) make the distribution
more peaked — high-probability tokens become much more likely, producing more deterministic,
consistent outputs. Higher temperatures (1.5 to 2.0) flatten the distribution — lower-probability
tokens become more likely, producing more varied, sometimes more creative but also more
unpredictable outputs.
Top-p (also called nucleus sampling) is an alternative or complementary method for controlling
output variation. Rather than scaling the entire distribution, top-p sampling restricts sampling to
the smallest set of tokens whose cumulative probability exceeds a threshold p. A top-p of 0.9
means sampling only from the tokens that collectively account for 90 percent of the probability
mass, excluding very low-probability tokens regardless of temperature.
Low Temperature (0.1–0.5): Use When... High Temperature (0.8–1.5): Use When...
• You need consistent, reproducible outputs • You want creative variation in outputs
12
• The task has a single correct or best answer • You are brainstorming multiple options or
• You are generating factual summaries or reports approaches
• Reliability matters more than creativity • You are generating creative writing or marketing
copy
• You are processing many similar inputs and
need comparable outputs • You want the model to explore less obvious
possibilities
• You are generating several candidates to select
the best from
The primary source of variation is the stochastic sampling described above. Unless temperature
is set to near-zero, the model will sample differently from the probability distribution each time
it generates a response, producing different token sequences even from identical inputs. This is a
feature, not a bug — it enables the creative variation that makes LLMs useful for brainstorming
and generation tasks. But it means that for tasks where consistency and reproducibility are
important (formal reports, standardized analyses, automated workflows), you should use lower
temperature settings or build verification steps that can identify and filter out unacceptable
outputs.
Additional sources of variation include differences in the model's context (if conversation history
differs between runs), model updates (AI providers regularly update their models, which can
change output behavior), and the non-deterministic nature of the underlying hardware (floating-
point arithmetic on GPUs can produce slightly different results on different runs due to
parallelism and rounding). For mission-critical applications, always test prompts across multiple
runs to understand the distribution of outputs you can expect, not just the result of a single run.
13
is for predicting the current one. This means that every token in your prompt can, in principle,
influence every other token in the model's processing — but in practice, not all tokens receive
equal attention.
Research has documented that LLMs give more weight to information at the very beginning and
very end of long contexts — the 'primacy' and 'recency' effects. Information in the middle of long
contexts receives less attention. This has direct implications for prompt structure: place your most
important instructions at the start of your prompt. If you have long context and need to ensure a
specific instruction is followed, repeat it at the end. Keep critical constraints close to the task
statement, not buried in extensive background material.
The attention mechanism also explains why providing relevant context improves LLM
performance. When you include information in the prompt that is directly relevant to the task —
the specific domain, the intended audience, examples of desired outputs, constraints on format
or content — the model can attend to this information as it generates its response, producing
outputs that are more aligned with your specific needs than a context-free prompt would produce.
14
YEEAP · FUSE-AI-101
Foundations of Artificial Intelligence
Reading Essay
Zero-shot, few-shot, chain-of-thought, role assignment, and format control — the essential
toolkit
15
Sub-Module 4.2: Core Prompt Engineering Techniques
Reading Essay · Estimated Reading Time: 22–26 Minutes
The techniques presented here form a progression from simple to more structured. Every
professional using AI tools should master all of them. Together, they constitute the core
prompting toolkit — the set of methods that distinguishes a skilled AI user from someone who
types questions and hopes for the best.
Zero-shot prompting is most effective when the task is clearly defined, when the model has seen
many examples of similar tasks in its training data, and when you have provided all the context
the model needs to complete the task. Weak zero-shot prompts omit critical context ('Write a
report'), specify the task vaguely ('Make this better'), or leave the output format undefined ('Tell
me about AI'). Strong zero-shot prompts are specific about the task, the audience, the format, the
length, and any constraints.
Specificity Rule: The single most effective improvement to any zero-shot prompt is
adding specificity. Compare 'Write an email' with 'Write a formal 150-word email to a
bank manager in Addis Ababa requesting a meeting to discuss loan options for a small
16
retail business, using a respectful tone appropriate for Ethiopian professional
correspondence.' The second prompt will produce a dramatically better result.
The quality of your examples matters as much as their presence. Use examples that are
representative of the full range of inputs the model will encounter, ensure that the examples are
consistent with each other (if they contradict each other, they will confuse the model), and choose
examples that highlight distinctions the model might find difficult to make without guidance. The
number of examples is a trade-off — more examples improve performance but consume more of
the context window and increase cost. For most tasks, two to five examples strike an effective
balance.
The mechanism behind CoT's effectiveness is not fully understood, but the most plausible
explanation is that by externalizing the reasoning process — writing out intermediate steps rather
than jumping to a conclusion — the model is forced to generate each reasoning step as an explicit
token sequence. This makes each step a conditioning context for the next, reducing the probability
17
of reasoning errors that can occur when large inferential gaps must be crossed in a single
generation step.
Chain-of-thought prompting is particularly valuable for professional tasks that require visible
reasoning: financial analysis, diagnostic reasoning, legal argument construction, policy analysis,
and any task where the reasoning process is as important as the conclusion and where errors in
reasoning can have significant consequences. The visible reasoning chain also makes it easier to
identify where the model went wrong if its conclusion is incorrect — enabling targeted correction
rather than requiring a complete regeneration.
18
highlands. Respond to farmer questions as you would in an in-person
consultation."
The more specific and contextually grounded the role assignment, the more effectively it
constrains the model's behavior. A vague role ('You are an expert') provides minimal constraint.
A rich role that specifies the professional context, geographic context, audience, and
communication style provides strong, effective constraint. Role assignment is particularly
powerful for tasks where the same question might receive very different responses depending on
the professional perspective — medical advice, legal guidance, agricultural recommendations, and
policy analysis all benefit from well-constructed role assignments.
Format control is particularly important when AI outputs will be integrated into downstream
systems or workflows — when the output will be parsed by software, incorporated into a document
template, or used as input to another AI prompt. JSON format control, for example, enables AI
outputs to be directly parsed by applications. Structured output formats
(summary/findings/recommendation) enable AI outputs to be incorporated into standardized
report templates. Consistent formatting also makes AI outputs easier to review, compare, and
quality-control.
19
Combining Techniques: The CRRF Framework
The most effective prompts typically combine multiple techniques. A useful framework for
structuring complex prompts is the CRRF framework: Context, Role, Request, Format. Context
provides the background information and situational constraints the model needs. Role assigns
the professional identity and perspective. Request specifies the task clearly and precisely. Format
specifies the desired output structure.
The CRRF framework is not a rigid prescription — not every prompt needs all four components.
But using it as a checklist when you are dissatisfied with AI output quality can help you diagnose
what is missing. Vague outputs often reflect insufficient context or an underspecified request.
Inappropriate tone or perspective reflects a missing or weak role assignment. Difficult-to-use
outputs reflect missing format instructions.
20
YEEAP · FUSE-AI-101
Foundations of Artificial Intelligence
Reading Essay
Configuring AI behavior, grounding responses in real data, and building AI systems that plan
and act
21
Sub-Module 4.3: Advanced Prompting — System
Prompts, RAG, and Agents
Reading Essay · Estimated Reading Time: 20–24 Minutes
A system prompt is a special message — typically invisible to end users — that establishes the AI's
identity, scope, constraints, and behavior for the entire interaction. System prompts are used by
application developers to configure general-purpose AI models (like GPT-4 or Claude) for specific
use cases. They specify what the AI's role is, what topics it should address and which it should
decline, what tone and language it should use, what format it should produce its outputs in, and
what safety and compliance constraints it must observe.
22
LANGUAGE: Respond in the same language the user writes in (Amharic,
Oromiffa, or English). Use simple, accessible language appropriate for
adults with primary school education. TONE: Warm, reassuring, and
respectful. Use culturally appropriate terms.
Understanding system prompts matters for AI practitioners for several reasons. First, if you are
building AI-powered applications, designing effective system prompts is one of the most
important skills you need — a well-designed system prompt can transform a general-purpose LLM
into a highly specialized, reliable, and safe application for a specific context. Second,
understanding that AI assistants are shaped by system prompts helps you interpret their behavior
— an AI that refuses certain requests or consistently responds in a particular way is likely
following system prompt instructions, not expressing an inherent limitation of the underlying
model. Third, system prompts themselves can have vulnerabilities — prompt injection attacks,
where malicious users attempt to override system prompt instructions through their inputs, are a
real security concern for AI applications.
23
NBE directives and regulations, retrieves the most relevant passages from
the current mobile lending directive. STEP 2 — AUGMENTED PROMPT TO LLM:
"Based ONLY on the following official NBE directive text: [retrieved
passages], answer the user's question about current interest rate
guidelines. If the answer is not contained in the provided text, say so."
STEP 3 — GROUNDED RESPONSE: LLM generates a response citing specific
provisions from the actual current directive, rather than potentially
outdated or hallucinated general knowledge.
RAG systems have significant practical applications across African professional contexts. An AI
legal research assistant for Ethiopian lawyers, grounded in a database of Ethiopian legislation and
court decisions, can provide more accurate and current legal guidance than a generic LLM. An
agricultural advisory system for Ethiopian extension workers, grounded in a database of locally
validated agronomic research and seasonal weather data, can provide better-calibrated
recommendations than a system relying on global training data alone. A medical decision support
system grounded in the Ethiopian standard treatment guidelines can ensure that AI-generated
clinical guidance reflects the Ethiopian therapeutic context rather than potentially inappropriate
international protocols.
Building a RAG system requires several components beyond the LLM itself: a knowledge base (a
structured collection of documents, regularly updated), a document embedding model (which
converts documents and queries into numerical vectors for semantic search), a vector database
(which stores the embeddings and enables fast similarity search), and an orchestration layer
(which coordinates the retrieval and generation steps). Open-source tools including LangChain,
LlamaIndex, and various vector databases (Pinecone, Weaviate, Chroma) have made building
RAG systems significantly more accessible in recent years.
The conceptual core of an AI agent is the ReAct loop — a cycle of Reasoning, Acting, and
Observing. Given an objective, the agent reasons about what steps are needed to achieve it, selects
an action from its available tools (which might include web search, code execution, database
24
query, file operations, API calls, or interactions with other AI models), executes the action,
observes the result, and then reasons about what to do next based on what it has observed. This
loop continues until the agent determines that the objective has been achieved or that it cannot
proceed.
AI agents are beginning to appear in production applications across multiple domains. GitHub
Copilot Workspace can plan and implement multi-file code changes from a high-level task
description. AI research assistants can autonomously search the web, read papers, and synthesize
findings into reports. AI customer service agents can query customer databases, look up account
information, and take actions on behalf of customers without human intervention.
The governance challenges raised by AI agents are significant. When an AI agent takes
autonomous actions — sending emails, executing code, modifying files, making API calls — the
consequences can be difficult to reverse and can occur before humans have an opportunity to
review them. Careful design of agent permissions (what tools the agent can access), action scope
(what actions it is permitted to take), and human-in-the-loop checkpoints (what decisions require
human approval before the agent can proceed) is essential for safe agentic AI deployment.
25
Memory management in multi-turn conversations involves ensuring that the model retains
relevant context from earlier in the conversation without consuming the entire context window
on conversation history. Common approaches include: summarization (periodically summarizing
earlier conversation into a compact form that preserves key information while reducing token
count), explicit re-statement (restating the key context and constraints at relevant points in the
conversation rather than relying on the model to retain them from early exchanges), and
structured context management (maintaining a structured summary of key facts, decisions, and
constraints established in the conversation, which is prepended to each turn).
For professional AI workflows involving long, complex tasks — drafting a detailed proposal,
conducting a multi-stage analysis, developing a curriculum or training program — multi-turn
conversation design is what separates a productive AI-assisted workflow from a frustrating series
of disconnected interactions. Invest time in thinking about how to structure the conversation:
what to establish upfront, what to introduce progressively, and how to manage context as the
conversation extends.
26
YEEAP · FUSE-AI-101
Foundations of Artificial Intelligence
Reading Essay
Task decomposition, knowing when to use AI vs. human judgment, prompt libraries, and
collaboration design
27
Sub-Module 4.4: Designing Human-AI Workflows
Reading Essay · Estimated Reading Time: 20–24 Minutes
This shift from individual interaction to workflow design represents a maturation in how AI is
used — from experimenting with AI to building AI-augmented professional capability.
Organizations that invest in workflow design alongside individual AI skill development
consistently get dramatically better returns on their AI investments than those that focus only on
tool access.
Effective task decomposition for AI-augmented workflows involves: identifying the discrete
subtasks within a complex task, assessing the role of AI in each subtask (AI-primary, AI-assisted,
or human-primary), identifying the information and context each subtask requires and where that
information comes from, and sequencing the subtasks in an order that manages dependencies
and information flow effectively.
28
assisted] Research leadership development best practices and benchmark
programs 3. [AI-primary] Generate draft curriculum structure with module
titles and time allocations 4. [Human review] Review and refine curriculum
structure — add organizational context, adjust priorities 5. [AI-primary]
Draft detailed content outlines for each module 6. [Human-primary] Review
for accuracy, relevance, and alignment with organizational culture 7. [AI-
assisted] Draft facilitator guides and participant handouts from approved
outlines 8. [Human review] Final review, approval, and sign-off before
delivery KEY INSIGHT: AI handles research, drafting, and structuring.
Humans own objectives, context, quality assurance, and accountability.
The discipline of task decomposition also surfaces an important insight: many complex
professional tasks have a natural structure of alternating AI and human contributions. AI excels
at the high-volume, structurally defined work of drafting, organizing, researching, and formatting.
Humans excel at the judgment-intensive work of defining objectives, providing organizational
context, evaluating quality and relevance, and making decisions with accountability. Designing
workflows that explicitly alternate between these two modes — rather than trying to do everything
in a single AI interaction — produces dramatically better results.
• The task involves searching, structuring, or • Ethical trade-oFs and value judgments are
drafting from a large information space involved
• Speed matters more than perfect quality • Authentic personal or professional relationship
and empathy matter
29
• The task is tedious and low-stakes for individual • Legal, medical, or professional accountability is
errors at stake
• The output will be reviewed and refined by a • Creative originality and genuine novelty are
human before use required
• The domain is underrepresented in AI training
data (e.g. local contexts)
For Ethiopian professional contexts, a particularly important criterion is local knowledge depth.
AI models have limited, often inaccurate knowledge of Ethiopian-specific institutional contexts,
regulatory frameworks, cultural norms, and community dynamics. Tasks that require deep
knowledge of how a specific Ethiopian institution works, how a specific regulation is interpreted
in practice, or how a specific community would respond to a proposed intervention require human
judgment — AI can provide structural scaffolding and draft language, but the locally-grounded
content must come from human expertise.
Professional Heuristic: A useful heuristic for the AI era: use AI for the work you would
delegate to a competent, knowledgeable intern who lacks deep organizational context
and whose work you will always review before using. Retain direct human judgment
for the work that requires deep organizational context, accountability, ethical
reasoning, or authentic relationship. The distinction is not about AI capability in
general — it is about what AI can reliably do in your specific context with your specific
data.
A well-organized prompt library for a professional context typically includes: prompt templates
(with placeholders for task-specific content), notes on the intended use case and quality criteria
for each template, examples of inputs and outputs from successful uses, version history (tracking
improvements made over time), and tags or categories for easy retrieval. Prompt libraries should
be treated as living documents — updated as new techniques are discovered, as model behavior
changes with model updates, and as the team learns what works best for specific tasks.
30
For organizational prompt libraries, governance is important: who is responsible for maintaining
and updating the library, how are new prompts vetted before being added, and how are outdated
prompts retired when model updates change their performance? These are the same questions
that apply to any organizational knowledge asset, and the same answers apply: clear ownership,
defined review processes, and regular maintenance cycles.
31
Research and Synthesis Workflows
AI research workflows typically follow a two-phase structure: a discovery phase (using AI to
identify relevant information, summarize sources, and map the information landscape) and a
synthesis phase (using AI to help organize findings into a coherent narrative, while humans apply
judgment about which sources are most credible and relevant). The critical human contribution
in research workflows is source verification — AI-identified sources and AI-generated summaries
must always be checked against the original sources before being cited or relied upon.
32
YEEAP · FUSE-AI-101
Foundations of Artificial Intelligence
Reading Essay
Hallucinations, fact-checking, bias recognition, and building professional verification habits
33
Sub-Module 4.5: Evaluating and Verifying AI Outputs
Reading Essay · Estimated Reading Time: 20–24 Minutes
This sub-module fills that gap. It examines the phenomenon of hallucination — the most
consequential failure mode of current AI systems — in detail, provides concrete strategies for fact-
checking and source verification, addresses the problem of bias in AI outputs, and presents a
practical framework for building personal verification habits that can be applied consistently
across professional contexts.
Hallucinations are not random errors. They have characteristic patterns that, once understood,
become more predictable and manageable. The following are the most common hallucination-
prone contexts:
34
• Specific legal and regulatory provisions — the exact text of laws, regulations, court
decisions, or contractual clauses. The model may accurately convey the general
intent of a legal provision while fabricating specific section numbers, thresholds, or
conditions.
• Recent events and developments — anything that occurred after the model's training
cutoH date. The model has no information about post-cutoH events and may
generate plausible-sounding but entirely fabricated claims about recent
developments.
• Domain-specific technical details — precise medical dosages, engineering
specifications, financial calculations, agricultural yield figures specific to a particular
region or crop variety. The more specific the technical detail, the higher the
hallucination risk.
• Information about specific people, organizations, and local contexts — particularly
for individuals, organizations, and places that were underrepresented in the training
data.
Why This Is Dangerous: The insidious quality of hallucinations is that they are
generated with the same confident, fluent prose as correct information. There is
typically no linguistic signal that distinguishes a hallucinated fact from a correct one in
the model's output. This is why external verification is not optional — it is a
professional obligation whenever AI-generated content will be used for any
consequential purpose.
The model's training objective — predicting the next token accurately across a vast corpus of text
— incentivizes fluency and plausibility, not factual precision. A model that frequently said 'I don't
know the exact figure' would score worse on next-token prediction tasks than one that confidently
generated plausible-sounding specific figures. This is a fundamental limitation of the current
35
generation of LLMs that cannot be fully resolved through prompting — only through external
verification and appropriate system design.
Techniques that can reduce (though not eliminate) hallucination frequency include: asking the
model to explicitly state its uncertainty and the basis for its claims, instructing the model to say 'I
don't know' when it lacks specific information, using RAG to ground the model's responses in a
verified knowledge base (as described in Sub-Module 4.3), and using chain-of-thought prompting
to surface the model's reasoning, which makes it easier to identify potentially hallucinated claims.
Multi-Source Cross-Reference
For important factual claims, find at least two independent sources that corroborate the
claim. If multiple credible sources agree, confidence is higher. If sources disagree, the
2 discrepancy itself is important information.
Example: AI describes a regulatory requirement → Check both the
regulation itself and a compliance guide from a law firm
Recency Check
For any claim about current conditions, current laws, current prices, or recent events, verify
4 that the source is current. AI training data has a cutoff date; information that was accurate
at training time may be outdated.
36
Example: AI describes current mobile lending regulations → Check the
NBE website for the most recent directive date
Self-Consistency Check
Ask the AI to explain the basis for specific claims and to identify what it is uncertain about.
While this does not guarantee accuracy, it can surface claims where the model is generating
5 from sparse training data rather than from frequently-confirmed facts.
Example: Follow-up prompt: 'What is the source for the statistic you
cited? How confident are you in that figure?'
Several types of bias commonly appear in LLM outputs. Representation bias occurs when the
model's training data underrepresents certain groups, perspectives, or contexts — producing
outputs that systematically reflect the perspectives of over-represented groups. An LLM asked to
describe 'a typical professional' may default to describing someone who does not reflect the
diversity of Ethiopian or African professional contexts. An LLM asked for examples may default
to examples from North American or European contexts when African examples are equally or
more relevant.
Cultural bias occurs when the model's outputs reflect cultural assumptions, values, and norms
that are specific to the cultural contexts dominant in its training data — particularly Western,
English-speaking contexts. This can manifest in advice that assumes cultural contexts (legal
systems, family structures, business practices, communication norms) that do not apply in
Ethiopian or African settings. Language bias occurs when the model's performance is significantly
better in English than in other languages, producing outputs of inconsistent quality when
prompting in local languages.
Practical strategies for managing bias in AI outputs include: explicitly specifying the cultural,
geographic, and institutional context in your prompts (giving the model the contextual
information it needs to produce locally appropriate outputs), critically reviewing AI outputs for
assumptions that may not apply in your context (particularly legal, economic, or cultural
assumptions), using local experts to review AI-generated content for cultural appropriateness,
37
and maintaining awareness that AI tools are more reliable for some contexts and purposes than
others.
Before using any AI-generated content for a consequential purpose, ask: Is there a specific factual
claim here that could be wrong? Is there a citation or reference that I have not verified? Is there a
legal or regulatory provision that needs to be checked against the official source? Is there a
calculation or numerical result that I should verify independently? Is there an assumption about
context, culture, or institutional practice that may not apply to my specific situation? Is this
content recent enough, or could it reflect outdated information?
For high-stakes outputs — formal reports, proposals submitted to funders or clients, regulatory
submissions, medical or legal guidance, policy recommendations — build a structured review step
into your workflow where these questions are addressed systematically before the content is used.
Treat AI-generated content as a first draft that requires professional review, not as a final product
that can be used directly.
Building verification habits is easier when it is systematized into workflows rather than relying on
memory and discipline alone. Create checklists, build review steps into document templates, use
commenting tools to flag AI-generated sections that need verification, and cultivate the habit of
being explicit in documents about which content is AI-assisted and which has been independently
verified. These practices protect you professionally, produce more reliable work, and help build
organizational capability in responsible AI use.
38
References
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of
stochastic parrots: Can language models be too big? Proceedings of the 2021 ACM Conference on
Fairness, Accountability, and Transparency, 610–623.
[Link]
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Chen, S., Chen, Y.,
Chi, E. H., Chowdhery, A., Demszky, D., Farhadi, A., Fei-Fei, L., Ganguli, D., Grossman, S.,
Guestrin, C., Gururangan, S., Ho, D., Icard, T., … Liang, P. (2021). On the opportunities and risks
of foundation models. arXiv. [Link]
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam,
P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R.,
Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., … Amodei, D. (2020). Language models are few-
shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., &
Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing
Systems, 30.
39