Lessons Lessons learned from OVC programs have revealed the need to improve service quality and to strengthen harmonization across partners around the questions: How can our programs make a measurable difference in children’s well-being? What are the essential actions that we all agree need to be part of a service to best to mitigate the impact of HIV/AIDS on children and families, in the pursuit of efficiency, effectiveness, equity, reach, and scale and sustainability? In response to the observed need to improve the quality of services provided to orphans and vulnerable children, in 2007, PEPFAR, through the United States Agency for International Development (USAID), sought to create a regional initiative to support countries and implementing partners in improving the quality of OVC programming. With support from the USAID Health Care Improvement Project (HCI), a regional OVC quality improvement initiative was organized. The initiative, which has come to be known as Care that Counts, has engaged national stakeholders, program implementers, and donor agencies throughout sub-Saharan Africa in improving the quality of OVC programming.
This short report describes the efforts of the Care that Counts Initiative to support to implementers at the country level to:
1) Build constituencies and commitment for quality in OVC programming,
2) Develop OVC service standards through consensus processes involving key stakeholders, including children and their families,
3) Undertake quality improvement activities at the point of service delivery with community-based volunteers and organizations, and
4) Gather evidence that standards and other quality improvement approaches have a measurable impact.
This paper summarizes 10 years of evidence of the effectiveness of collaborative improvement in improving health outcomes and compliance with health care standards. The collaborative improvement approach was designed by the Institute for Healthcare Improvement (IHI) in the United States to produce rapid, significant improvements in a targeted area of health care. The paper was commissioned by USAID and analyzes the results achieved by over 1,300 teams of health care providers who participated in 27 improvement collaboratives supported by USAID during 1998-2008. Data analyzed consisted of 135 time-series charts representing pooled data from groups of teams from 12 countries. All together, the data covered 81 distinct measures of compliance with standards and outcomes for maternal, newborn and child health, HIV/AIDS care, family planning, and malaria and tuberculosis diagnosis and treatment.
The study found that improvement collaboratives were able to achieve large increases in compliance with health care standards and in some cases, in health outcomes, across all care areas addressed, regardless of the baseline level of quality. Of the 135 analyzed time-series charts, 88% attained performance levels of at least 80%, and 76% reached at least 90%, even though more than half had baseline levels at 50% or below. The data provide compelling evidence that collaborative improvement can achieve large increases in performance, regardless of baseline level, and that results can be achieved relatively rapidly. Across collaboratives, time series charts showed average increases of 52%. Teams reached performance levels of 80% in about 13 months on average when baselines levels were below 50% and in about 6 months when baselines were above 50%.
The analysis also suggests that moving beyond 80% performance requires different efforts (system redesign) to make high quality the routine and that deliberate spread reduces time required to raise performance of new sites.
Cette collection d’études de cas en bref décrit examples des experiences de 30 instances de l’améloration de la qualité par l’identification et la résolution des problems en équipe. Ce travail été exécuté en Rwanda de 1998 à 2002. En effect, le personnel médical, d’hygiène, et d’administration, impliqué directement dans la production des soins de santé y compris parfois les représentants de la population béneiciaire, forme des équipes multidisciplinaires qui identifient les différents écarts entre les manières de travailler et ce que les normes tant implicites qu’éxplicites préconisent. Ces équipes utilisent des outils et techniques pour combler ces écarts. Les cinq recueil de cas concerne l’améloriation de la qualité de la prise en charge des polytraumatisés choqués, l’augmentation de la couverture vaccinate effective de la rougeole qui se fait au huitième mois, l’améloration du taux d’acceptation de la planification familiale, l’augmentation de la fréquentation des services de consultation curative et des recettes financires en abaissant les tarifs, et l’augmentation de taux de femmes enceintes consultant au premier trimestre.
In response to concerns that stigma and discrimination pose barriers to access to healthcare services for patients with HIV or AIDS, the Quality Assurance Project surveyed 110 healthcare providers in six health facilities in Kenya in late 2003–early 2004. Structured interviews assessed provider beliefs, attitudes, practices, and fears toward providing care to these patients. Findings indicate that all providers expressed negative attitudes and fear, and most reported being aware of discriminatory practices by providers and facilities toward these patients. The report concludes that as long as providers feel unsafe in providing services to these patients, discrimination will persist. The report discusses the implication of these fidings for stigma reduction strategies to ensure high quality health services for people with HIV/AIDS. Appendices provide informed consent text and the four instruments used for the interviews.
Adherence to antiretroviral therapy (ART) will result in better health outcomes. However, studies investigating such adherence usually examine only part of adherence requirements: They study the number of pills taken, but not whether they were taken in accordance with other requirements, such as taking pills on a schedule and with food requirements. This study, conducted in 2004–2005 in four Rwandan health facilities, found indications that pill combination type was a more important indicator of adherence than the burden of having to take numerous pills. In addition, while 92–98% of study participants reported meeting pill-count requirements, only 69–73% met schedule and food requirements. The report details adherence by treatment type, and the analysis explains associations with such factors as social support and urban versus rural settings.
Trained clinical observers used a structured checklist at referral and district/regional hospitals in four developing countries to monitor care provided to 245 women during labor, delivery, and postpartum and their newborns during postpartum. The countries were Benin, Ecuador, Jamaica, and Rwanda. Observation periods were either continuous and lasted 72 hours or noncontinuous and lasted 12 hours over 4--6 days; all such periods included a weekend day and night. Observers marked the checklist to record the times when healthcare providers performed certain tasks and whether each had been done according to standard. Certain circumstances--such as a woman giving birth before arrival--required rigorous data cleaning. The quality of care for the different tasks is reported here by country, by hospital type, and overall. The frequency of labor monitoring was well below the rates recommended in all four countries, regardless of hospital type. Fetal heart rate (FHR) was monitored the most frequently at 1.3 times per hour, although its recommended rate in all countries is twice an hour. Other labor indicators recommended at twice per hour were checked less often: maternal pulse was taken 0.43 times per hour, contraction intervals 0.38 times per hour, and contraction duration 0.37 times per hour. The two indicators recommended at the rate of once every four hours (0.25 times per hour) were performed more frequently: maternal blood pressure at 0.63 times per hour and vaginal exam at 1.1 times per hour. On average, in 26% of the cases, no labor indicator was monitored at all. In the three study countries where partograph use is recommended, incorrect use was observed in more than half the case observations, varying substantially by country. Correct partograph use was associated with more frequent labor monitoring. (author's)
This report presents findings from Phase 3 of an assessment of the human resources implications of HIV/AIDS services scale-up in Rwanda. The Government of Rwanda is committed to rapidly expanding the delivery of HIV/AIDS care and support services, including antiretroviral treatment. By the end of September 2004, over 6,000 clients had started antiretroviral therapy (ART), 101 health facilities offered voluntary counseling and testing (VCT) services, 101 facilities provided prevention of mother-to-child transmission (PMTCT) services, and 23 sites provided care and treatment to HIV-positive clients. The number of health sites offering VCT, PMTCT, and HIV/AIDS care and treatment is expected to grow to 147 VCT sites and 152 PMTCT sites by the end of 2005. In order to reach a target of 100,000 clients receiving ART, the Ministry of Health also plans to expand HIV/AIDS care and support services delivery to three referral hospitals, 39 district hospitals, and 117 health centers by 2007. Scale-up strategies for national HIV/AIDS services include the rapid training of health staff and decentralization of HIV/AIDS services. This report focuses on the staffing implications and associated costs of HIV/AIDS services scale-up. By documenting current staffing levels and the level of effort necessary to provide HIV/AIDS services, Phase 3 of the study analyzes how many full-time equivalent (FTE) staff will be needed, and at what costs, if the Government of Rwanda is to meet its HIV/AIDS service delivery objectives. The human resources projections are based on data gathered during Phases 1 and 2 of the study. (excerpt)
This report presents findings from Phase 2 of the Rwanda Human Resources Assessment for HIV/AIDS Services Scale-up. The study aimed to review the existing staffing situation in the country, document practices and levels of effort in providing HIV/AIDS services, and calculate staffing needs for planned expansion of antiretroviral treatment. Phase 2 of this study describes current systems of HIV/AIDS services in Rwanda by documenting categories of staff and the specific HIV/AIDS services they perform, comparing performance to national standards, and analyzing the time required to provide these different services. The study also looks at the adequacy of current management and supervision of personnel providing HIV/AIDS services and the country's HIV/AIDS training capacity. Information on which the Phase 2 analysis was based was derived from 283 observations of providers with HIV/AIDS clients, record reviews, and interviews with District Health Management Teams, site managers, training coordinators, and 93 service providers at 20 sample sites. The sample sites examined in Phase 2 included both public facilities managed by the Ministry of Health and agree sites (those managed by religious institutions but that are considered to be part of the public health system). Fifteen of the sites yielded information on voluntary counseling and testing (VCT) services, 12 sites on prevention of mother-to-child transmission (PMTCT) services, and eight sites on antiretroviral therapy. (excerpt)
As the international community rallies funds to support the expansion of HIV/AIDS services in the developing world, the health human resources crisis presents a significant challenge to achieving HIV/AIDS service delivery goals. This is especially true of countries in sub-Saharan Africa where, in the last 30 years, the health workforce has declined relative to population growth, and the HIV/AIDS epidemic has intensified health service needs. This report addresses health human resources issues related to HIV/AIDS services scale-up in Rwanda, but must be understood in the context of broader health human resources constraints. Any attempt to address HIV/AIDS service delivery needs will impact all health services. The staffing shortages identified in this report represent system-wide shortages, not only HIV/AIDS service delivery shortages. The Government of Rwanda is committed to providing its population with required HIV/AIDS health services. At the time this study was conducted, HIV prevalence in Rwanda was estimated at 8.9% of adults. To meet the urgent needs of Rwandans for HIV/AIDS prevention, care and treatment, the Ministry of Health aims to scale-up HIV/AIDS service provision to treat 100,000 clients with ART by 2007. More than 15 donor agencies have contributed over $100 million to assist the Government of Rwanda in financing and coordinating the rapid scale-up of HIV/AIDS services. (excerpt)
This report presents findings from Phase 1 of an assessment of the human resources implications of HIV/AIDS services scale-up in Rwanda. Phase 1 of the study sought to document the number and type of staff currently employed at public and private sites in Rwanda, estimate those currently providing HIV/AIDS services, and identify employment practices that could facilitate or hinder human resources scale-up for HIV/AIDS service delivery. To estimate the number of health workers providing health services and the employment mechanisms through which they are contracted, the research team gleaned data from Ministry of Health reports. The study found that out of Rwanda's 4,889 active health service providers, 4.2% are doctors, 52.2% are nurses, and 23.5% are nurse aides or other auxiliary staff. Hospitals absorb 44% of the health workforce, and half of the country's doctors are posted at the three national referral hospitals. The Ministry of Health employs 43% of the health workforce through the civil service. The largest share (55%) of the workforce is employed through contracts with a health facility (38%) or through NGOs, donor organizations, or district contracts (17%). Salaries for staff contracted by health facilities are usually paid from funds accumulated from user fees and occasionally from contracts the facilities have with a supporting institution. Reliance on user fees constrains the ability of health centers, especially those in rural areas, to meet their staffing needs. (excerpt)
Quality improvement via the identification of problems and team-based problem solving is one of the main pillars of quality assurance. Through this method, medical, technical, and administrative personnel directly involved in the provision of health services and sometimes representatives of the population being served--those who best understand the interests of that population--form multidisciplinary teams that identify gaps between actual service and what implicit or explicit norms advocate. These teams use the tools and methods of quality assurance (QA) to close those gaps. The case studies in this collection present the results of five teams that 1) increased curative consultations and revenues while lowering fees, 2) improved family planning rates, 3) increased the percentage of pregnant women who attended first trimester consultations, 4) increased vaccination coverage, and 5) improved the quality of care for shock victims during their first 48 hours at the hospital. These results confirm that quality is not always linked to additional resources but instead often lies in simple, low-cost measures, well adapted to the development level of each country. This publication is therefore intended for everyone, for healthcare consumers who need to understand how quality healthcare is provided, for policy makers and planners who must institutionalize the QA approach, but above all for frontline (or first-line) healthcare providers, from whom results are demanded on a daily basis, and consequently, must achieve similar concrete results. (excerpt)
Each year, more than 500,000 women worldwide die from complications related to childbirth. With good quality obstetric care, approximately 90% of these deaths could be averted. The assistance of a skilled birth attendant during labor, delivery, and the immediate postpartum period is one important component of quality obstetric care. An enabling environment for skilled attendance at delivery and prompt attention for women arriving at a medical facility with an obstetric complication are also key factors. However, little is known about the competence of skilled birth attendants (SBAs), the elements that contribute to an enabling environment, and the causes of what is commonly known as the "third delay": the delay in receiving medical attention after a woman arrives at a healthcare facility. Through its Safe Motherhood Research Program, the Quality Assurance Project carried out three studies to explore these issues in countries with high maternal mortality ratios. The first study examined the competency of SBAs. The second measured SBA performance and the relative contribution to performance of different enabling factors in the work environment. The last examined causes of in-hospital delays in receiving obstetric care. All three studies occurred between September 2001 and July 2002 in Benin, Rwanda, Ecuador, and Jamaica. This report presents the results from Rwanda, where three hospitals participated: a tertiary care referral hospital with an active maternity department and two regional hospitals. The competency study measured knowledge with a 58-question test covering six subject areas. We also tested skills in several key areas, including ability to use a partograph, neonatal resuscitation, manual removal of placenta, bimanual uterine compression, and insertion of an intravenous needle. Finally, we asked participants to assess their own ability to carry out common obstetric procedures. Results show low competency levels with a mean score of 47% correct. Active management of third stage labor merits specific mention, as the mean score was only 7%. The overall test scores for doctors, professional nurses, and midwives were quite similar, while scores for technical nurses were significantly lower. There were too few doctors and midwives to compare skills scores in a statistically reliable way; however, professional nurses scored significantly higher than technical nurses overall, for mouth-to-mouth and nose resuscitation, and asepsia. There was no correlation between providers' self-assessment and their competency as measured by the knowledge and skills tests. The enabling environment study addressed the contribution of enabling factors and essential elements to health worker performance. We used an observation checklist to evaluate performance during labor, delivery, and the immediate postpartum period. We reviewed medical records to evaluate performance in managing obstetric complications. We also surveyed providers in each facility about supervision, training, and motivation. Finally, we inventoried the availability of essential drugs, equipment, and supplies in each study hospital. Labor monitoring, including checking fetal heart rate and the mother's blood pressure, was inadequate in most observed cases. Providers used a partograph only about a third of the time. Few washed their hands before assisting at delivery, and only about half cleaned the perineum before birth; most administered oxytocin to the mother after delivery. The third delay study used direct observation to analyze patient flow in all three study hospitals. In addition, three physicians reviewed medical records to reveal any delays at different points in patient care: Most of the delays they found occurred during diagnosis, especially for obstructed labor. Waiting times after arrival at the hospital or the OB department were short, averaging 13 minutes, with one regional hospital averaging only 3 minutes. The mean time from decision to operate and start of a cesarean section at the tertiary hospital was about two hours. Antibiotics were administered only 44 minutes on average after an order at the tertiary hospital. (author's)
The Case Study Series presents real applications of Quality Assurance (QA) methodologies in developing countries at various health system levels, from national to community. The series focuses on QA applications in maternal and reproductive health, child survival, and infectious diseases. Each case study focuses on a major QA activity area, such as quality design, quality improvement, communication and development of standards, and quality assessment. In some cases, more than one QA activity is presented. Quality assessment is the measurement of the quality of healthcare services. A quality assessment measures the difference between expected and actual performance to identify opportunities for improvement. Performance standards can be established for most dimensions of quality, such as technical competence, effectiveness, efficiency, safety, and coverage. Where standards are established, a quality assessment measures the level of compliance with standards. For dimensions of quality where standards are more difficult to identify, such as continuity of care or accessibility, a quality assessment describes the current level of performance with the objective of improving it. A quality assessment frequently combines various data collection methods to overcome the intrinsic biases of each method alone. These method include direct observation of patient-provider encounters, staff interview, patient focus group, record review, and facility inspection, among others. The assessment is often the initial step in a larger process, which may include providing feedback to health workers on performance, training and motivating staff to undertake quality improvements, and designing solutions to bridge the quality gap. These case study describes how Rwandan staff from the central, regional and district levels designed and implemented an assessment of the quality of healthcare services at two districts. Ministry of Health staff defined indicators, created and tested assessment tools, assessed 19 health centers, and presented findings. (excerpt)
The Joint Commission for Hospital Accreditation developed a framework in 1993 for improving healthcare provider performance, defining nine aspects of performance. One aspect was timeliness, defined as, "the degree to which care is provided to the patient at the most beneficial or necessary time." Since then, timeliness has emerged as a key component of monitoring the quality of healthcare. The Institute of Medicine in 2001 brought it into sharper focus by discussing the consequences of a lack of timeliness, ranging from long waiting times that patients may interpret as lack of respect from providers to delay in the diagnosis or treatment of an illness. The National Health Care Quality report card included a conceptual framework for quality of healthcare with four dimensions: safety, effectiveness, patient centeredness, and timeliness. The report defines timeliness as "obtaining needed care and minimizing unnecessary delays in getting that care." It also defines three sub-categories of timeliness (1) access to the system of care, (2) timeliness in getting to care for a particular problem, and (3) timeliness within and across episodes of care. In developing countries, timeliness relating to safe motherhood was brought to the fore by the three-delay model, which specifies three types of delays that contribute to the likelihood of maternal death in the event of a complication: (1) delay in deciding to seek care, (2) delay in reaching a treatment facility, and (3) delay in receiving adequate treatment at the facility. (excerpt)