In 2008, the USAID Health Care Improvement Project (HCI) took on the challenge of improving the learning system for health care improvement. This learning system includes the processes of harvesting, analyzing, and synthesizing knowledge about what teams do to improve health care and the process of sharing what they learn with other QI teams. Using experience to date and some innovations, HCI developed a set of four tools—collectively known as the “Standard Evaluation System” (SES) tools—for teams and their coaches to use to facilitate these knowledge management processes. The SES tools include a QI team-level Journal, a QI team-level Synthesis Form, and two databases for results indicator data—one for QI teams and the other for the collaborative level. These tools were created to help support the collaborative learning system by which teams examine which of their changes were most effective and sharing this learning with other teams in the collaborative. This report summarizes the results of testing these SES tools to strengthen documentation, analysis, and sharing of QI team efforts to improve care through testing of changes.
This paper summarizes 10 years of evidence of the effectiveness of collaborative improvement in improving health outcomes and compliance with health care standards. The collaborative improvement approach was designed by the Institute for Healthcare Improvement (IHI) in the United States to produce rapid, significant improvements in a targeted area of health care. The paper was commissioned by USAID and analyzes the results achieved by over 1,300 teams of health care providers who participated in 27 improvement collaboratives supported by USAID during 1998-2008. Data analyzed consisted of 135 time-series charts representing pooled data from groups of teams from 12 countries. All together, the data covered 81 distinct measures of compliance with standards and outcomes for maternal, newborn and child health, HIV/AIDS care, family planning, and malaria and tuberculosis diagnosis and treatment.
The study found that improvement collaboratives were able to achieve large increases in compliance with health care standards and in some cases, in health outcomes, across all care areas addressed, regardless of the baseline level of quality. Of the 135 analyzed time-series charts, 88% attained performance levels of at least 80%, and 76% reached at least 90%, even though more than half had baseline levels at 50% or below. The data provide compelling evidence that collaborative improvement can achieve large increases in performance, regardless of baseline level, and that results can be achieved relatively rapidly. Across collaboratives, time series charts showed average increases of 52%. Teams reached performance levels of 80% in about 13 months on average when baselines levels were below 50% and in about 6 months when baselines were above 50%. The analysis also suggests that moving beyond 80% performance requires different efforts (system redesign) to make high quality the routine and that deliberate spread reduces time required to raise performance of new sites.
The impact of counseling and the quality of services provided by both skilled and unskilled health care workers within government facilities in Zou/Collines, Benin was assessed both prior to and following the intervention trial. At both points, baseline/endline data was collected on the quality of counseling, health workers' knowledge of maternal care, in addition to facility-based newborn care practices. At this time, a pictorial set of counseling cards was also introduced, which were to be used to improve upon current service delivery. Fourteen public health maternities were included in the study, of which seven were randomly assigned to interventions and the other seven to control groups. Methods of evaluation consisted of direct observation and exit interviews with pregnant women and new mothers, in addition to extensive surveying of both skilled and unskilled workers.
Results indicated that the baseline quality of skilled provider counseling was inadequate; however, it improved substantially, as a result of training, increased supervision, and the implementation of job aids. This was directly correlated with improved maternal care knowledge in areas such as birth preparedness, maternal and newborn danger signs, newborn care, and healthy home practices. The study confirmed that lay providers were also capable of achieving comparably high performance levels using job aids. In conclusion, task delegation and job aids both significantly improve the quality of counseling provided by health care workers, in addition to increasing patient understanding of maternal and newborn care.
Trained clinical observers used a structured checklist at referral and district/regional hospitals in four developing countries to monitor care provided to 245 women during labor, delivery, and postpartum and their newborns during postpartum. The countries were Benin, Ecuador, Jamaica, and Rwanda. Observation periods were either continuous and lasted 72 hours or noncontinuous and lasted 12 hours over 4--6 days; all such periods included a weekend day and night. Observers marked the checklist to record the times when healthcare providers performed certain tasks and whether each had been done according to standard. Certain circumstances--such as a woman giving birth before arrival--required rigorous data cleaning. The quality of care for the different tasks is reported here by country, by hospital type, and overall. The frequency of labor monitoring was well below the rates recommended in all four countries, regardless of hospital type. Fetal heart rate (FHR) was monitored the most frequently at 1.3 times per hour, although its recommended rate in all countries is twice an hour. Other labor indicators recommended at twice per hour were checked less often: maternal pulse was taken 0.43 times per hour, contraction intervals 0.38 times per hour, and contraction duration 0.37 times per hour. The two indicators recommended at the rate of once every four hours (0.25 times per hour) were performed more frequently: maternal blood pressure at 0.63 times per hour and vaginal exam at 1.1 times per hour. On average, in 26% of the cases, no labor indicator was monitored at all. In the three study countries where partograph use is recommended, incorrect use was observed in more than half the case observations, varying substantially by country. Correct partograph use was associated with more frequent labor monitoring. (author's)
The Quality Assurance Project (QAP) compared two data collection methods used to determine the number and type of providers who attended 245 obstetric cases in hospitals in Benin, Ecuador, Jamaica, and Rwanda. Each case was viewed as having four phases (labor, intrapartum, postpartum-mother, and postpartum-newborn) resulting in 980 possible phases, referred to as "phase-cases." In all, 801 phase-cases were observed and assessed using both data collection methods. In the first method, an observer recorded the names or identification number of all providers attending the case in a table on the first page of a pre-printed data collection form (the "Page 1 method"). In the second method, the same observer recorded the identity of the provider next to each required task on the form as the provider performed the task (the "Task-by-task method"). The form is appended to Burkhalter et al. (2006). This report discusses the number of providers recorded by each method and addresses the problem generated by the fact that the two methods resulted in identical lists of providers in only 46% of the 245 obstetric cases. To address this problem, we present an analysis that generates a best ("Combined") method from the two original methods (Page 1 and Task-by-task). The average number of providers recorded was 3.65 by the Task-by-task method, 3.44 recorded by the Page 1 method, and 4.02 when the data from both methods were combined. An estimated 2% of providers were not recorded by either method. Over all countries, the Task-by-task method missed fewer providers than the Page 1 method in the intrapartum (12% compared to 51%), postpartum-mother (27% compared to 38%), and postpartum-newborn phases (14% compared to 40%), but missed more providers in the labor phase (36%) than the Page 1 method (22%). Based on the Combined data, the labor phase had the highest average number of attending providers at 2.8; intrapartum had 1.8 attending providers, postpartum mother had 1.7, and postpartum-newborn had 1.6. The labor phase was also most likely to be attended by at least one skilled provider (doctor, nurse, or midwife): 96% of the time. This rate for intrapartum was 90%, for postpartum-mother 84%, and postpartum-newborn 79%. Among all attending teams and phases, 88% included at least one skilled provider. Skilled provider attendance varied by country, ranging from 73% to 99%. (author's)
Each year, more than 500,000 women worldwide die from complications related to childbirth. With good quality obstetric care, approximately 90 percent of these deaths could be averted. The assistance of a skilled birth attendant during labor, delivery and the immediate postpartum period is one important component of quality obstetric care. An enabling environment for skilled attendance at delivery and prompt attention for women arriving at a medical facility with an obstetric complication are also key factors. However, little is known about the competence of skilled birth attendants, the elements that contribute to an enabling environment and the causes of what is commonly known as the "third delay:" the delay in receiving medical attention after a woman arrives at a healthcare facility. Through its Safe Motherhood Research Program, the Quality Assurance Project carried out three studies to explore these issues in countries with high maternal mortality ratios. The first study examined the competency of skilled birth attendants (SBAs). The second measured SBA performance and the relative contribution to performance of different enabling factors in the work environment. The last study examined causes of in-facility delays in receiving obstetric care. All three studies were carried out between September 2001 and July 2002 in Benin, Ecuador, Jamaica, and Rwanda. This report presents the results from Benin. The Benin studies included five hospitals: a tertiary care referral hospital with an active maternity department, two secondary care hospitals, and two smaller district hospitals. The competency study measured knowledge with a 72-question test covering six subject areas. We also tested skills in several key areas including ability to use a partograph, neonatal resuscitation, manual removal of placenta, bimanual uterine compression and IV insertion. Finally, we asked participants to assess their own ability to carry out common obstetric procedures. Results show that current competency levels are low. Two key skills, bimanual uterine compression and active management of third stage labor, are rarely taught and rarely practiced. We found little difference in competency by professional level. Physicians do somewhat better with complex procedures, but professional level appears inversely related to the interpersonal quality of care. There was no correlation between providers' self-assessment and their competency as measured by the knowledge and skills tests. The enabling environment study addressed the contribution of enabling factors and essential elements to health worker performance. We used an observation checklist to evaluate performance during labor, delivery and the immediate postpartum period. We reviewed medical records to evaluate performance at managing obstetric complications. We also surveyed providers in each facility about supervision, training and motivation. Finally, we inventoried the availability of essential drugs, equipment and supplies in each study hospital. Although most staff had extensive professional training, less than half said they had received any training in the last two years. Labor monitoring, including checking fetal heart rate and mother's blood pressure, was inadequate in most observed cases. Providers used a partograph only about two-thirds of the time. Few washed their hands before assisting at delivery and none suctioned the newborn after birth, but most administered oxytocin to the mother after delivery. The third delay study used direct observation to analyze patient flow in three of the five study hospitals. In addition, two physicians reviewed medical records to determine if there were delays at different points in the care of the patient. Most of the delays found in the record review occurred during diagnosis, especially for obstructed labor and severe pre-eclampsia/eclampsia. Waiting times after arrival at the hospital or the OB department varied by hospital but were unusually long at the regional referral hospital (RRH), one of the two secondary level facilities included in the study. We recommend a quality improvement initiative to improve medical records at all hospitals. For RRHs, we also recommend developing a systematic triage system to reduce waiting times for incoming patients. The Quality Assurance Project's safe motherhood research is supported with Maternal Health funds from the U.S. Agency for International Development (USAID). (author's)
The Joint Commission for Hospital Accreditation developed a framework in 1993 for improving healthcare provider performance, defining nine aspects of performance. One aspect was timeliness, defined as, "the degree to which care is provided to the patient at the most beneficial or necessary time." Since then, timeliness has emerged as a key component of monitoring the quality of healthcare. The Institute of Medicine in 2001 brought it into sharper focus by discussing the consequences of a lack of timeliness, ranging from long waiting times that patients may interpret as lack of respect from providers to delay in the diagnosis or treatment of an illness. The National Health Care Quality report card included a conceptual framework for quality of healthcare with four dimensions: safety, effectiveness, patient centeredness, and timeliness. The report defines timeliness as "obtaining needed care and minimizing unnecessary delays in getting that care." It also defines three sub-categories of timeliness (1) access to the system of care, (2) timeliness in getting to care for a particular problem, and (3) timeliness within and across episodes of care. In developing countries, timeliness relating to safe motherhood was brought to the fore by the three-delay model, which specifies three types of delays that contribute to the likelihood of maternal death in the event of a complication: (1) delay in deciding to seek care, (2) delay in reaching a treatment facility, and (3) delay in receiving adequate treatment at the facility. (excerpt)
Each year, more than 500,000 women worldwide die from complications related to childbirth. With good quality obstetric care, approximately 90 percent of these deaths could be averted. The assistance of a skilled birth attendant during labor, delivery and the immediate postpartum period is one important component of quality obstetric care. An enabling environment for skilled attendance at delivery and prompt attention for women arriving at a medical facility with an obstetric complication are also key factors. However, little is known about the competence of skilled birth attendants, the elements that contribute to an enabling environment and the causes of what is commonly known as the “third delay:” the delay in receiving medical attention after a woman arrives at a healthcare facility. Through its Safe Motherhood Research Program, the Quality Assurance Project carried out three studies to explore these issues in countries with high maternal mortality ratios. The first study examined the competency of skilled birth attendants (SBAs). The second measured SBA performance and the relative contribution to performance of different enabling factors in the work environment. The last study examined causes of in-facility delays in receiving obstetric care. All three studies were carried out between September 2001 and July 2002 in Benin, Ecuador, Jamaica, and Rwanda. This report presents the results from Benin. The Benin studies included five hospitals: a tertiary care referral hospital with an active maternity department, two secondary care hospitals, and two smaller district hospitals. The competency study measured knowledge with a 72-question test covering six subject areas. We also tested skills in several key areas including ability to use a partograph, neonatal resuscitation, manual removal of placenta, bimanual uterine compression and IV insertion. Finally, we asked participants to assess their own ability to carry out common obstetric procedures. Results show that current competency levels are low. Two key skills, bimanual uterine compression and active management of third stage labor, are rarely taught and rarely practiced. We found little difference in competency by professional level. Physicians do somewhat better with complex procedures, but professional level appears inversely related to the interpersonal quality of care. There was no correlation between providers’ self-assessment and their competency as measured by the knowledge and skills tests. The enabling environment study addressed the contribution of enabling factors and essential elements to health worker performance. We used an observation checklist to evaluate performance during labor, delivery and the immediate postpartum period. We reviewed medical records to evaluate performance at managing obstetric complications. We also surveyed providers in each facility about supervision, training and motivation. Finally, we inventoried the availability of essential drugs, equipment and supplies in each study hospital. Although most staff had extensive professional training, less than half said they had received any training in the last two years. Labor monitoring, including checking fetal heart rate and mother’s blood pressure, was inadequate in most observed cases. Providers used a partograph only about two-thirds of the time. Few washed their hands before assisting at delivery and none suctioned the newborn after birth, but most administered oxytocin to the mother after delivery. The third delay study used direct observation to analyze patient flow in three of the five study hospitals. In addition, two physicians reviewed medical records to determine if there were delays at different points in the care of the patient. Most of the delays found in the record review occurred during diagnosis, especially for obstructed labor and severe pre-eclampsia/eclampsia. Waiting times after arrival at the hospital or the OB department varied by hospital but were unusually long at the regional referral hospital (RRH), one of the two secondary level facilities included in the study. We recommend a quality improvement initiative to improve medical records at all hospitals. For RRHs, we also recommend developing a systematic triage system to reduce waiting times for incoming patients. The Quality Assurance Project’s safe motherhood research is supported with Maternal Health funds from the U.S. Agency for International Development (USAID). (author's)