Optimizing Health Data Collection Systems
Optimizing Health Data Collection Systems
information
system
1
THE INFORMATION CYCLE
• As shown in the figure below the information cycle starts with data
collection.
• The collected data are then processed, analyzed, presented and interpreted
to become information.
• Then finally this information will be used for action.
Use COLLECT
Interpret PROCESS
Present Analyze
Data Collection Tools
Why is Data Collection Important?
To track changes/stability of health over time
What is influencing changes
To evaluate the impact of prevention/health promotion, and
health care interventions
To monitor resource allocation
3
Standardized, Integrated, and Simplified Data Collection and Reporting
An integrated data collection and reporting system provides the
foundation for harmonizing the requirements of internal
information consumers like the MOH and external consumers
such as other ministries, development partners, and civil
society.
An integrated data collection and reporting system requires :
1. Cascaded Indicators for performance monitoring
2. Standardized data collection tools for service delivery and
administrative records
3. Standardized reporting instruments
4. An integrated reporting channel that supplies all
information to consumers.
All HMIS information generators and consumers will use these
tools, so their introduction requires consensus from all.
4
Standardized Data Collection Tools
These tools capture medical, demographic, and
financial transaction information on clients and
patients.
They may be:
Registers,
Cards,
Files retained at the facility, or
Cards retained by the client.
Must include the data required for the HMIS
indicators
5
Important Consideration In Designing Data Collection Tools
These tools must respond to patterns of
service delivery in a facility.
It is essential that the HMIS be flexible
enough to adapt to new service delivery
norms.
A register should help to trace care and
responds to the need for financial
accountability.
6
Important Consideration In Designing Data Collection
Tools…
In the case of simple services, such as immunization, A
REGISTER can be used because the service information
required can be predicted in advance;
In the case of complex services, such as curative care,
AN OPEN-ENDED CARD is needed because the service
information requirements cannot be predicted.
For services that become more complex if a
complication is detected, recording can begin on a
register, with SUPPLEMENTATION by a card in the
infrequent cases when it is needed .
7
Essentials For Data Instruments
Clear instructions for entering the information.
A continuous supply of these instruments must
be assured so that data will be consistently
recorded and
Should and must be easily reported over time
and across locations.
Care providers must be thoroughly trained,
using both pre-service and in-service modalities.
8
Standardized Reporting Instruments
Standardized reporting formats,
including tally sheets, must be
designed to collect the HMIS data
from the client / patient records.
Assurance of stationary supply and
training are crucial for improving and
maintaining data quality, and
thereby meeting HMIS performance
standards. 9
What Is Standardization?
Standardization refers to the process of employing
best practice, principles and guidelines for the
collection and storage of healthcare data in a uniform
manner across various facilities, levels, and programs.
Standardization applies for the data collecting
instruments and practices for collection of data, its
analysis and transmission.
Standards serve as guidelines, principles or gateways
for communication among health workers and health
hierarchies such as woredas, regions and a nation.
10
Why is Standardization Important?
To define all the data elements according to
international standard
To make sure that data are comparable
across countries/regions/woredas/zones.
• For this purpose user’s guide or manual
defining the data elements should be
developed to ensure the data collected in one
facility means the same in the others.
11
Standardizing the Data Elements
There is a need to define all the data elements and cases
according to a standard.
For example: one may diagnose malaria purely on clinical
symptoms while others may strictly depend on laboratory
exams.
In such cases it will be difficult to compare cases across
different health facilities and across different healthcare
providers.
Hence, defining cases is of paramount importance in
order to make sure that we are saying the same thing.
12
Standardizing the Data Collection Tools
All the data collection tools such as registers,
tally sheets and formats should be developed
according to a standard.
Doing so helps in maintaining the data quality
as well as in making reports comparable across
all the health sector hierarchical levels, i.e. :
‘consistency of the data items’ requires the
need to standardize the data collecting
instruments well.
13
Standardizing the Data Collection Tools...
In standardizing data collecting tools, it is important
to make the data collection tools:
S- Simple- easy to use (layout)
O- Overlap less- no duplication of data elements
U- Useful for calculating indicators
R- Relevant for making decisions and plans
C- Clear- easily understandable (terms used)
E- Effective in making decisions
14
Standardizing the Data Collection Procedures
Again there is a need to standardize the way in which data
are collected.
For example: in some of the hospitals in Addis recording
and reporting of the inpatients’ data is made on discharge
while on the others it is made on admission.
The diagnosis that is made on admission may change after
investigating the patient thoroughly and hence the true
diagnosis of the patient is the one that is recorded on
discharge.
However, if the diagnosis that is made on admission is taken
on the routine health data then the information might be
wrong.
Hence, there is also a need of standardizing the data
collection procedures taking the best practice.
15
Standardizing Data Set by Developing Essential Data Set
At the health Sector of most developing countries, there is a
tendency of collecting all possible data.
Most healthcare providers are supposed to fill in data in
endless forms that are not relevant to the task they perform
and without understanding the meaning and importance of
the data.
Overburdens health professionals who have to collect health
data in addition to their primary task, which is giving health
service for their community.
Collecting excess data affects the quality of data inhibiting the
utilization of relevant information. It should be noted that
the ultimate objective of health information is not only to
‘gain information’ but to ‘improve action’.
The collection and use of information should not impose
burden on the health system.
It should be collected as a routine by-product of the
health system
16
The Information Pyramid
The information pyramid: - is a schematic way of looking
at the number of data items to be collected at each level of
the health system, allowing each level to gather data of
importance and relevance to their daily work while avoiding
reporting of excessive data where no action is taken.
Only the information that leads to action must be reported to
the health facility and all the activities taking place in the
health facility can be recorded for local action but for the
woreda only relevant information is to be provided.
It is only the information that is needed for decision making
process at this level should be reported.
17
We can classify health data according to their usefulness as:
1. Must know: E.G. Percentage of children under one year fully
immunized
2. Useful to know: E.G. Drop out rate Penta1-Penta 3
Penta 1
3. Nice to know: other vaccines given
4. Dangerous to know: all the doses of vaccines like Penta 2,
polio2, TT3….
Dangerous to know is so called because it distracts health
workers from the essential work of seeing patients and
diverts attention to data that is of no use in making
decisions.
18
The common problem in most developing countries is that data
elements to be collected are mostly decided by international and
national requirements as well as by donors and funding agencies
rather than by local needs.
This leads to a situation where most of the data collected at the
local level are not relevant to local management needs, and is
therefore not used effectively.
In such conditions, health professionals will collect information only
for the sake of reporting to the higher officials and not to use it for
their own action.
This may also contribute to a reporting of data of a poor quality as
the possibility of correcting gross errors while using the information
is lost in such cases.
One should note that systems that are not found to be useful locally
tend to be less useful at higher levels.
19
Integrating Health Information Systems
Another factor which leads to the collection of excess data is the
persistence of vertical programs.
Such vertically oriented health program managers tend to
prioritize their programs insisting on the inclusion of many data
elements related to their service.
For the development of a single integrated reporting system,
careful selection of essential data elements by each program is
needed.
Health managers of the different programs should have an open
mind and should be ready to accept change in such processes.
In addition, facilitating the sharing of data across vertical program
managers helps in integrating the information system and in
reducing the data elements to be collected.
Defining HMIS unit at all levels of the health sector where all
collected data will be available for each program manager may
help in realizing the integration process
20
Factors that affect Data Collection Methods
1. Resource (human and financial)
2. Ethical issues
3. Sensitivity of the information gathered
4. Geographic accessibility
5. Time
6. Language
7. Study design
8. Type of study participants (eg. Educational status)
21
Control for Reliability
• Use redundancy
– Ensures reliability
– Duplication of data collection item
Parallel
• Repetition of a question with slight modification
Series
• Repeating the whole/ part of the instrument at
different times
– Eg. selected sub-samples of the clients
22
Control for Validity
• Insure Validity
– The right Response should be filled in the right
respondent column.
– Ambiguous responses should be re-checked at the
field level
23
Quality Control at Facilities
Ensure appropriate administration of the data collection
instrument
Monitoring and supervision of facilities is the key to
ensure quality
Questionnaires should be manually edited before entering
data into computer software
Correction of errors
Coding and recoding of questions (if needed)
Checking completeness
Proper design of the data entry template
The template should reflect the actual report
24
The Role Of Data Entry Clerk
The data entry clerk must simply type
what is written on the questionnaire
The clerk must not do
Coding and recoding
Calculation
Interpretation
Assumption
25
Quality Check During Data Entry
26
Domains of Health Data
1. Health Determinants
27
Figure 2 Typology of measurement domains
Health
determinants
Risk factors
Behaviours Health
Genetics status
Environment
Health
Mortality
Socio-economic & system
demographic outcomes Morbidity /
disability
Health Health Well-being
system system Service
inputs outputs utilization
Policy Information
Financing Service
Human availability and
resources quality
Organization
28
Types of Data Commonly Collected Under Each Domain
29
Data Collected on Health Care Resource & health Care Utilization
30
Frequency of Data Collection
ROUTINE or continuous data collection
– Health facility-based (patient information and service statistics)
– Community-based (service-statistics)
– Program-based (administrative)
– Vital registration
– Sentinel reporting/demographic surveillance
NON-ROUTINE or periodic data collection
– Household or facility-based surveys
– Population census
– Rapid assessment procedures (RAP)
– Special studies/research
31
Data Quality and Accuracy
Since data are the basis for information
adequate attention should be given to maintain
its quality in order for it to be useful.
Data quality/Accuracy can be defined as the
distance between the actual and the
measured.
The shorter the distance, the more accurate
the data will be.
The level of accuracy required depends on the
importance of the decision to be made.
If a decision has important consequences,
accuracy should be higher.
Data Quality and Accuracy…
However, it should be noted that higher
accuracy usually means higher cost. In
other words, when one tries to get data of a
high quality, there is a risk of compromising
the primary task, the health service delivery.
Therefore, the level of accuracy required
depends also on the cost of getting the stated
accuracy level.
there is a need of focusing only on
essential (minimum) data elements.
Data Quality Measures
The health information system should ensure that the
data meet standards of reliability, transparency and
completeness.
It is important to assess the strength of the source data
and the statistical techniques and estimation methods
used to generate indicators.
The following criteria are used to assess the quality of
health related data and indicators:
Timeliness:-The gap between when data are collected
and when they become avail- able to a higher level or are
published.
Periodicity:-The frequency with which an indicator is
measured.
Data Quality Measures…
Consistency and transparency of revisions:
Internal consistency of data within a data- set as well
as consistency between datasets and over time;
extent to which revisions follow a regular, well-
established and transparent schedule and process.
Representativeness: The extent to which data
adequately represent the population and relevant
subpopulations.
Disaggregation: The availability of statistics
stratified by sex, age, socioeconomic status, major
geographical or administrative region and ethnicity,
as appropriate.
Confidentiality and data security guidelines
There should be guidelines for data protection
and other established standards for:
Storage,
Backup,
Transport of information and
Retrieval.
Aspects of High Quality Data
Complete
All Oranges belonging in the data are in the data
Consistent
Oranges aren’t confused with mangos
Correct
All items defined as oranges are indeed oranges
Timely
All oranges listed as fresh are still fresh
Accessible
People needing information on oranges can get it
Relevant (Useful)
People do in fact need data collected on oranges
Factors Affecting Data Quality
Correctness
•Training/skill
Layout of forms
Standardized instruction
Local use of information
Perceived relevance of the information gathered
Incentive/feedback
Validation technique
Time in relation to data set and work load
Consistency of the data items
Timeliness Completeness
Incentive/feedback
Perceived relevance of the
•Infrastructure
information gathered
Incentive/feedback Data Training/skill
•Time in relation to Quality Standardized instruction
data set and work load Local use of information
Time in relation to data set and
work load
Factors Affecting Data Quality…
1. Training/skill: - In order to obtain data of a high accuracy,
data collectors must receive training on how to collect data and
on how to calculate indicators.
2. Local use of information: - Use of data at the site where it is
collected can lead to detection of errors and inconsistencies, so
that correction is made easily.
It is mainly at this level that information use can have the
greatest impact on the efficiency and effectiveness of h-
services.
When information is used by people who collect it then it
tends to be more accurate.
The improved quality following extensive use of data leads to
further confidence to use the data at all levels forming a
positive spiral.
Factors Affecting Data Quality…
3. Perceived relevance of the information:- Health care
providers will be inspired to collect and maintain the data
quality if they consider the selected data set to be relevant for
the task they perform.
If in contrary excessive quantities of data that are not
relevant to the h professionals responsible for data recording,
then the quality of data often suffers and data use at collection
level becomes minimal.
Involving all potential users in the selection of the data
elements to be included in the essential data set has proved
fruitful in increasing ownership and perceived relevance of the
information system.
Factors Affecting Data Quality…
4. Providing incentives: - Incentives are acknowledged to
be one of the important factors in maintaining data quality
and improving data use.
Offering incentives and feedback for performance helps in
keeping the quality of data and data use.
However, incentives offered for high performance as
revealed by information generated by health care providers
may also lead to ‘cooked figures’ and regular supervision
and validation techniques by managers is imperative.
For example, if incentives are provided for the h facility
with the highest vaccination coverage, some people may be
tempted to report higher coverage. Hence, one should be
cautious enough to verify the reported data are representing
reality.
Factors Affecting Data Quality…
5. Validation technique: - Cross checking mechanisms for
the health data helps in identifying errors and hence in taking
corrective measures.
For example, cross checking number of deliveries to the
number of BCGs delivered may also be used as a
validation technique as the number of BCGs delivered in
an institution can not be more than the attended
deliveries in the institution.
6. Time in relation to data set: - As the routine h data are
collected at the expense of h workers’ time whose primary
task is to deliver h care for their community, as much as
possible the data elements in the essential data set should
be limited.
Only the data which lead to useful information should be
collected routinely.
Data that are needed for research purposes can be
collected on ad hoc basis as a survey and used to
supplement the routine data.
Factors Affecting Data Quality…
Zonal Hospital
Zonal Health Department (MOH, NGO, private, etc)
Woreda Council
Woreda Health Office Woreda Hospital
(MOH, NGO, private, etc)
Health Center /
Clinic
285 285
•The Underweight Rate is 9.1%
Indicators Analysis...