|
Guidelines
for assessing cost-effectiveness of hygiene
promotion
This
Briefing Note presents a summary guide to
Cost-Effectiveness Analysis methods for use at
project and programme level. For ore comprehensive
information, including detail on methodological
issues, please see the full report by Bolt and
Merrett (2006), reference below.
Compiled
by: Julie Fisher of WEDC
Based
on a full report by Eveline Bolt and Stephen Merrett
(2006)
Headline
facts
-
It
is suggested that hygiene promotion
interventions are more cost-effective than other
water and sanitation interventions, although
this has rarely been assessed.
-
CEA
compares planned effects, with and without an intervention,
taking into account the local situation, the
intervention process and the institutional
setting.
-
It
is relatively straightforward to assign capital
and recurrent costs to hygiene interventions in
a water, sanitation and hygiene programme.
-
Financial
benefits of behaviour change (such as reduced
working days lost due to sickness) are hard to
include in CEAs, as there may be other factors
contributing to these changes. They are
therefore not dealt with here.
-
Effects
and therefore cost-effectiveness are costed by
aggregating baseline and post-intervention data
and comparing these. However, effectiveness
cannot be numerically quantified.
Using
Hygiene Promotion CEAs
Analysing
cost-effectiveness allows programme managers,
governments, donors and researchers to compare
programme costs against programme effects. However,
a comparison of the cost-effectiveness of programmes
using different hygiene promotion approaches is only
possible if other variables and external factors are
the same.
CEA compares the
planned effects relating to a situation, both with
and without the intervention. For this, it is
important to have access to baseline data and clear
programme objectives. Where baseline data is
unavailable, planned effects may be assessed through
longitudinal studies. Alternatively, behaviour
differences can be compared between the programme
community and control communities where the
programme has not been active.
To have a better
understanding of what to describe and measure
when assessing cost-effectiveness, Christoffers et
al (2004) include a framework, which combines
various elements related to measuring the
cost-effectiveness of hygiene promotion. In this,
hygiene promotion inputs are turned into processes,
processes lead to outputs and effectiveness, and
effectiveness leads to impacts. Costs are set
against effectiveness to determine
cost-effectiveness.
This model is
simplified here and for analysing cost effectiveness
we deal with inputs - in terms of the local
situation, the intervention process and the
institutional setting; financial costs; and outputs
and effectiveness.
The
Inputs
Insight into
inputs is crucial for assessing cost-effectiveness.
For example, where health norms are similar, a
hygiene promotion programme in an area of abundant
water will result in more hand-washing against less
effort (and hence less costs), than a programme in a
water-scarce area.
The
local situation
This
is an assessment of factors that determine
objectives and direct the programme: socio-economic
issues, the physical environment, available water
and sanitation facilities, sanitation and
hygiene-related knowledge, health status, and the
level of previous developmental interventions.
-
When drawing
up data collection tools, make sure that:
-
definitions
are consistent e.g. of hygiene behaviour or a
latrine;
-
variables
refer only to what has been promoted by the
intervention; and
-
baseline
data are related to the changes the intervention
intends to bring about.
The
intervention process
The
hygiene promotion approach and its intended effects
determine the activities and inputs of the
intervention process, for example, participatory
approaches may target social as well as hygiene
change.
| What
to include |
Assessment
methods |
| Intervention
approach |
Programme
documentation
Staff/community
consultation |
| Objectives/intended
outputs |
| Duration and
staff input |
| Communication
channels and success |
| Baseline
data availability and use |
Programme
documentation
Staff
interviews |
| Staff
expertise and roles |
|
Intervention
activities eg:
-
household visits
-
mass campaign
-
training |
Programme
documentation
Staff/community
consultation
Community
focus groups |
The
institutional setting
The
institutional setting has an impact on the
effectiveness of the intervention, for example,
water supply, sanitation and hygiene promotion
activities can only be integrated if the
institutional setting allows it.
Information on
the following elements can be obtained through
consultation of programme documents and interviews
with staff and community leaders:
| Elements
of the institutional setting to include |
| Type of
organization responsible for the intervention |
| Programme
design and by whom |
| Specific
targets and policies |
| Staff
labour conditions impacting on commitment |
| Existence
of monitoring framework |
| Possibility
of pilot testing revised interventions |
| Partnerships
with other public or private parties |
| Intervention
is stand-alone or part of integrated
programme? |
Hygiene
Promotion Costs
The
costing tool
Table
1 is an example of a costing tool. Capital costs are
expenditures on assets with a year or more of life,
sometimes raised through loans or grants. Recurrent
costs are those regular costs required to keep the
programme running. By calculating depreciation, we
identify an annual cost for a piece of equipment
that may last ten years and that was paid for as a
one-off purchase. By adding depreciation to
recurrent costs in a given year, we have the cost
component of the cost-effectiveness measure. Costs
are recorded for the implementing agency and for the
families involved.
The
subsidy question
Hygiene
promotion interventions often receive a level of
subsidy from local or regional government. Records
should detail the year of subsidy; the source; the
cost category using Table 1 (1-19); and the sum
allocated. A cost analysis should be followed by a
subsidy analysis.
Methods
of collecting cost data
Once
cost estimates are arrived at, the proportion
attributed to the intervention can be determined, in
discussion with the accounting section of the
organizations involved. An additional cross check is
to discuss actual events with programme personnel
e.g. how many times were vehicles used, length of
travel and fuel prices. Costs incurred by families
can be assessed through household interviews.

Describing
outputs and effects
Outputs are
the direct results of an intervention e.g. the
number of people trained, the number of hygiene
promotion sessions and the materials produced.
Effects refer
to changes in hygiene behaviour, at both household
and community level, such as latrine use and
hand-washing after defecation and before preparing
food. Effects can also be on social behaviour e.g.
in the roles of the sexes or the status of trained
health volunteers.
Intended effects
(e.g. to increase the level of hand-washing) should
be distinguished from unintended effects
(which are not planned). These can be negative as
well as positive, such as the burden of extra
latrine cleaning falling onto women.
Impacts
of Behaviour Change
Behaviour change
impacts on health improvement, people’s welfare,
societal social norms and values and state
expenditure on health. Hand-washing with soap can
reduce the risk of diarrhoea by more than 40%,
bringing with it further ‘resource savings’ for
families not having to pay for medicine or health
clinic visits and not losing income from sick family
members.
However, such
impact of behavioural change is not taken into
account in the CEA method described here, due to the
many confounding factors that exist. For example,
the risk of diarrhoea is affected by nutrition
levels, and market opportunities also affect earning
power.
Cost-effectiveness
of Community Health Clubs
(CHCs)
CHCs
are used as a vehicle for rural health promotion
in Makoni District, Zimbabwe, supported by the
A.H.E.A.D. (Applied Health Education and
Development) NGO. After two years of
implementation, a household survey was undertaken
of observable indicators of good practice that
acted as proxy indicators of improved family
health, comparing CHC and non-CHC areas.
The
project cost for 2000 was US$120,000, with 20%
spent on health promotion. In 2001, costs per
beneficiary dropped from 0.91c to 0.35c with costs
per trainer of US$3,144 for two years.
Results
showed that indicators of good hygiene were more
evident in the health club group than in the
control group. It is concluded that, based on
measurable impact, health clubs are highly
effective and at an estimated 35c per beneficiary,
the A.H.E.A.D. method of health promotion is
therefore also deemed to be cost-effective.
Source:
Waterkeyn (2003).
Costs
and Effects - Cost-Effectiveness
Effectiveness
matrices can be used to assess effects against
costs. These aggregate both the baseline behavioural
data and the post-intervention data for the intended
effects of the programme and can be recorded in
Table 2. This example is for a programme covering
hand-washing, latrine use and safe drinking water
use.

Having
calculated the intervention costs, it is possible to
cost the effects and therefore get some idea of
cost-effectiveness. Hygiene promotion programmes
have multiple effects, so figures for
cost-effectiveness of single effects cannot be
calculated. Input costs can be known per household
for a single behaviour, but dividing costs by the
number of additional persons performing a certain
behaviour is not possible.
Conclusions
The costs
associated with any programme are relatively easy to
estimate and can be recorded as a single figure
expressed in the local currency, with a breakdown of
this shown on a spreadsheet.
Effectiveness,
however, cannot be sensibly aggregated into a single
number, because the effects in question are due to
various changes in both individual hygiene behaviour
and social patterns. The effectiveness matrix shows
the programme outcomes but cannot translate into a
single figure.
Cost-effectiveness
is assessed by relating programme costs to the
matrix of behaviour change brought about by the
intervention, also taking into account inputs and
outputs. Comparisons can be made between
interventions in terms of costs but there is no
numerical value or cost-effectiveness ratio to judge
the value of different programmes. CEAs provide an
approach to setting out costs and outcomes. This is
useful in the design, financing, implementation and
evaluation of such programmes.
Key
References
-
Waterkeyn,
J. (2003) Cost-effective Health Promotion:
Community Health Clubs, Loughborough: 29th
WEDC Conference.
-
Christoffers,
T., van Wijk, C. & Njuguna, V. (2004) The
Value of Hygiene Promotion: Cost-Effective
Analysis of Hygiene Promotion Interventions,
London/Delft: WELL/IRC International Water and
Sanitation Centre.
-
Bolt, E.
& Cairncross, S. (2004) Sustainability of
Hygiene Behaviour and the Effectiveness of
Change Interventions: Lessons Learned on
Research Methodologies and Research
Implementation from a Multicountry Research
Study, IRC Booklet 1, Delft: IRC
International Water and Sanitation Centre.
-
Shordt, K.
& Cairncross, S. (2004) Sustainability of
Hygiene Behaviour and the Effectiveness of
Change Interventions: Findings of a
Multi-Country Research Study and Implications
for Water and Sanitation Programmes, IRC
Booklet 2, Delft: IRC International Water and
Sanitation Centre.
For
further information contact:
WELL Water,
Engineering and Development Centre (WEDC) Loughborough
University Leicestershire
LE11 3TU UK Email:
well@lboro.ac.uk Phone:
+44 (0)1509 228304 Fax:
+44 (0)1509 223970
BACK TO TOP
Home > Resources > Fact sheets > Child survival
|