Our membership with our benchmarking service is based on surgical volume. For us, it's a little less than $2,000 per year. I have no problem justifying this cost since it gives me access to one-stop shopping for several performance improvement tools and regulatory mandates. Membership also includes consultations with experts who can explain benchmarking, employee satisfaction surveys, cost surveys, infection rate surveys and access to a network of peers. When outcomes aren't as good as you want them to be, you can call other members identified as having "best practices" in a certain area.
Now that benchmarking services have gone online, collecting needed data is easier than ever before. Online benchmarking services let you import data directly to a server, rather than going through a stack of patient charts and filling out forms that need to be mailed. At our facility, it takes 15 to 20 minutes per week to enter the required online data.
Afterward, we receive monthly or quarterly e-mails, notifying us that our reports are ready to be viewed and downloaded from the vendor's secured site. These reports contain quality indicators that tell us how we're doing on such measures as infection rates, procedure times, recovery times, incidence of PACU nausea, urinary retention and post-op pain at home. The data come from the charts and post-op phone interviews of patient groups that we want to study.
Learn things you never knew you never knew
I've found that benchmarking can really pay off by helping you discover issues that you don't even know need improving. For example, 2 years ago we launched a project aimed at improving our patient satisfaction scores following fairly extensive shoulder surgery, a procedure that isn't usually done on an outpatient basis in our community.
Specifically, we wondered how well our patients tolerated post-op pain with just a 24- to 48-hour peripheral nerve block and oral pain medication, as opposed to the IV narcotics they'd receive in the community hospital. What we discovered surprised us.
Choosing the Right Benchmarking Service |
There are several sources of benchmarking data, including private services, associations, accreditation agencies, group purchasing organizations and professional societies. Get these questions answered to make sure you work with the service that's right for your facility. 1. What sort of technical support do you offer? You should be able to get support easily in order to fix problems and help you get to know the system better. This is important because if you can't fully use the system, you're not getting your money's worth. 2. What types of facilities participate? You need to compare "apples to apples" when you look at benchmarking data. Make sure that the members of the benchmarking group are similar to your facility in specialty mix and size. If you run a multi-specialty facility, for example, find out how many facilities in the data set host a similar number of cases in the same specialties. 3. How can I use the data? A report full of data is useless unless you know how to apply it to your processes. A benchmarking service should offer suggestions for creating practical change based on what you learn in your reports. — Claude Baconcini, CRNA |
Using data gathered during our follow-up telephone interviews, we assumed that a lower perceived pain score at home would correlate to a higher perceived overall satisfaction score. After collecting shoulder surgery data for a year, a strange paradox emerged. There was no relation between low pain scores and high patient satisfaction. Many patients who said they experienced a lot of pain were in fact very satisfied with their experience, while other patients who experienced relatively little pain were less satisfied.
Armed with that information and with the help of our benchmarking service, we decided to examine all the variables related to perceived pain scores. We hypothesized that patients' pre-op education regarding regional anesthesia blocks, anticipated post-op pain and use of pain medication would affect how they perceived their post-op experience.
At our facility, patients first meet with an anesthesia provider on the day of surgery. The provider explains the blocks that will be used and what to expect before, during and after surgery. In addition, some surgeons provide patients with information about the surgery during pre-op consults in their offices, but we didn't know exactly what they were telling patients with respect to how much and what kind of pain they would experience after surgery.
Since patients could have been getting mixed signals, we wanted to make sure they received the same information regarding our use of peripheral nerve blocks. We wanted them to know what to expect when they arrived for surgery, to understand expected pain levels after surgery and grasp how they'd feel at home after discharge. We also stressed the importance of taking pain medication before the block wore off.
To make sure every patient received the same information, our department created an educational brochure that orthopedic surgeons give to their patients when scheduling shoulder procedures. We've found that the earlier a patient is educated about what they can expect following surgery, the more likely the information will be retained.
| |||
Here's a look at what surgeons like about working in ASCs — and a few things that ASCs might improve — based on results of Surgical Outcomes Information Exchange's annual physician satisfaction benchmarking survey. SOIX asked surgeons the same questions from 2007 to 2009. Between 150 and 300 physicians from 20 to 35 ASCs submitted surveys each year, says SOIX. Patient satisfaction rates were the highest recorded scores across all 3 years, an indication that physicians felt their patients were satisfied with their ASC experience, the staff that cared for them and the follow-up care they received. Physicians were very satisfied with efficiency, personnel and anesthesia teams in ASCs, according to the survey. Physicians don't always get to schedule their cases when they'd like to, don't think very highly of lounge spaces and would prefer a better parking space, says the survey. |
|||
2007 |
2008 |
2009 |
|
SCHEDULING | 4.2 | 4.4 | 4.4 |
Convenient scheduling times | 4.4 | 4.7 | 4.6 |
Courteous treatment | 4.8 | 4.7 | 4.9 |
Participates with major third party plans | 4.1 | 4.4 | 4.5 |
Lack of participation in plans prevents use of facility | 3.5 | 3.8 | 3.8 |
EFFICIENCY | 4.6 | 4.5 | 4.7 |
Rapid turnover | 4.6 | 4.4 | 4.7 |
Cases start on time | 4.6 | 4.4 | 4.7 |
Staff prepared | 4.6 | 4.5 | 4.7 |
Good equipment | 4.6 | 4.5 | 4.8 |
Supplies available | 4.6 | 4.5 | 4.8 |
Supply brands acceptable | 4.6 | 4.6 | 4.8 |
PATIENT SATISFACTION | 4.8 | 4.7 | 4.9 |
Patients satisfied with experience | 4.8 | 4.7 | 4.9 |
Patients like staff | 4.8 | 4.7 | 4.9 |
Follow-up needs met | 4.7 | 4.6 | 4.8 |
ANESTHESIA SERVICES | 4.6 | 4.5 | 4.7 |
Prompt | 4.6 | 4.5 | 4.7 |
Patient satisfied with services | 4.7 | 4.6 | 4.7 |
Surgeon satisfied with services | 4.6 | 4.5 | 4.7 |
PERSONNEL | 4.7 | 4.5 | 4.7 |
Competent staff | 4.7 | 4.5 | 4.7 |
Effective troubleshooting for equipment | 4.6 | 4.5 | 4.6 |
Staff responsiveness | 4.7 | 4.6 | 4.8 |
Confidence in staff ability | 4.7 | 4.6 | 4.8 |
Knowledgeable management | 4.6 | 4.5 | 4.7 |
FACILITY RATING | 3.4 | 3.5 | 3.7 |
Procedure rooms | 3.8 | 3.7 | 3.9 |
Scheduling & billing systems | 3.3 | 3.6 | 3.8 |
Physician lounge/office space | 2.9 | 3.1 | 3.4 |
Parking | 3.6 | 3.4 | 3.8 |
OVERALL RATING | 3.8 | 3.7 | 3.9 |
SOURCE: SOIX Physician Satisfaction Benchmarking Survey, 2007 to 2009 (1=strongly disagree, 5=strongly agree) |
Not long after the surgeons started handing out the brochure, our benchmarking data revealed that perceived satisfaction scores were improving regardless of how much post-op pain patients experienced. We discovered that when patients know what to expect, and feel that what they are experiencing is "normal," they accept post-op pain as part of the process. In turn, they're more likely to be satisfied with their overall surgical experience.
Digging deeper
We're now planning to use benchmarking data to take a deeper look at our shoulder surgery post-op pain and patient satisfaction scores to figure out which of our anesthesia providers are associated with the highest patient satisfaction scores. Then we'll be able to look at what those particular providers are doing well and standardize our practices. Having the benchmarking evidence on file will help when it comes time to provide our best practices data to the anesthesia team. If we weren't using an online benchmarking service, this study would be much more difficult to perform.
Benchmarking is required in many states and by all accreditation agencies. Online services let you easily gather the information you need to meet those requirements. They also let you improve your clinical and business performances, and perhaps help identify and improve areas you didn't know were struggling. In the end, having access to performance data from your facility and from your peers lets you know how you're really doing, not how you think you're doing.