Background
Evaluation of new surgical procedures is a complex process challenged by evolution of technique, operator learning curves, the possibility of variable procedural quality, and strong ...treatment preferences among patients and clinicians. Preliminary studies that address these issues are needed to prepare for a successful randomized trial. The IDEAL (Idea, Development, Exploration, Assessment and Long‐term follow‐up) Framework and Recommendations provide an integrated step‐by‐step evaluation pathway that can help investigators achieve this.
Methods
A practical guide was developed for investigators evaluating new surgical interventions in the earlier phases before a randomized trial (corresponding to stages 1, 2a and 2b of the IDEAL Framework). The examples and practical tips included were chosen and agreed upon by consensus among authors with experience either in designing and conducting IDEAL format studies, or in helping others to design such studies. They address the most common challenges encountered by authors attempting to follow the IDEAL Recommendations.
Results
A decision aid has been created to help identify the IDEAL stage of an innovation from literature reports, with advice on how to design and report the IDEAL study formats discussed, along with the ethical and scientific rationale for specific recommendations.
Conclusion
The guide helps readers and researchers to understand and implement the IDEAL Framework and Recommendations to improve the quality of evidence supporting surgical innovation.
How to use IDEAL
Summary
Background
The preferred initial investigation with either magnetic resonance (MRCP) or endoscopic retrograde cholangiopancreatography (ERCP) in patients with suspected biliary obstruction ...remains controversial in many clinical settings.
Aim
To assess the effectiveness of an initial MRCP vs. ERCP in the work‐up of patients at moderate likelihood of a suspected biliary obstruction.
Methods
Patients with an unconfirmed benign biliary obstruction, based on laboratory and ultrasound findings, were randomised to an ERCP‐first or MRCP‐first strategy, stratified by level of obstruction. The primary outcome was the occurrence of a disease or procedure‐related bilio‐pancreatic adverse events within the next 12 months. Secondary outcomes were the number of subsequent bilio‐pancreatic procedures, duration of hospitalisation, days away from activities of daily living (ADL), quality of life (SF‐36) and mortality.
Results
We randomised 126 patients to ERCP‐first and 131 to MRCP‐first (age 54 ± 18 years, 62% female, 39% post‐cholecystectomy). In follow‐up, 18/126 (14.3%) ERCP‐first and 25/131 (19.1%) MRCP‐first patients experienced a procedure‐ or disease‐related complication (P = 0.30) (disease‐related in 13 and 18 patients, and procedure‐related in 5 and 7 patients respectively). A cause of biliary obstruction was found in 39.7% vs. 49.6% of patients (P = 0.11). Sixty‐six (50%) patients in the MRCP‐first group ended up avoiding an ERCP in follow‐up. ERCP‐first and MRCP‐first patients were away from usual activities for 3.4 ± 7.7 days and 2.0 ± 4.8 days respectively (P < 0.001).
Conclusion
A strategy of MRCP‐first decreased the need for subsequent MRCPs, but not complications. Further study is required to define factors influencing the eventual use of MRCP vs. ERCP in appropriately selected patients (ClinicalTrial.gov: NCT01424657).
Background: Interest in the training and evaluation of laparoscopic skills is extending beyond the realm of the operating room to the use of laparoscopic simulators. The purpose of this study was to ...develop a series of structured tasks to objectively measure laparoscopic skills. This model was then used to test for the effects of level of training and practice on performance.
Methods: Forty-two subjects (6 each of surgical residents PGY1 to PGY5, 6 surgeons who practice laparoscopy and 6 who do not) were evaluated. Each subject viewed a 20-minute introductory video, then was tested performing 7 laparoscopic tasks (peg transfers, pattern cutting, clip and divide, endolooping, mesh placement and fixation, suturing with intracorporeal or extracorporeal knots). Performance was measured using a scoring system rewarding precision and speed. Each candidate repeated all 7 tasks and was rescored. Data were analyzed by linear regression to assess the relationship of performance with level of residency training for each task, and by ANOVA with repeated measures to test for effects of level of training, of repetition, and of the interaction between level of training and repetition on overall performance. Student’s
t test was used to evaluate differences between laparoscopic and nonlaparoscopic surgeons and between each of these groups and the PGY 5 level of surgical residents.
Results: Significant predictors of overall performance were (a) level of training (
P = 0.002), (b) repetition (
P < 0.0001), and (c) interaction between level of training and practice (
P = 0.001). There was also a significant interaction between level of training and the specific task on performance scores (
P = 0.006). When each task was evaluated individually for the 30 residents, 4 of the 7 tasks (tasks 1, 2, 6, 7) showed significant correlation between PGY level and score. A significant difference in performance scores between laparoscopic and nonlaparoscopic surgeons was seen for tasks 1, 2, and 6.
Conclusions: A model was developed to evaluate laparoscopic skills. Construct validity was demonstrated by measuring significant improvement in performance with increasing residency training, and with practice. Further validation will require correlation of performance in the model with skill in vivo.
The IDEAL framework describes the stages of evaluation for surgical innovations. This paper considers the role of observational studies in the exploration and assessment stages. At the exploration ...stage, the surgical intervention is usually more widely used, and observational studies should collect prospective data from multiple surgeons, deal with factors such as case mix and learning, and prepare for a definitive evaluation at the next stage of assessment. Although a randomised controlled trial is preferable, a high quality observational study would be acceptable if a randomised trial is not feasible or, on rare occasions, deemed unnecessary.
Based on the excellent correlation between cyclosporine A 2-hr postdose blood levels (C2) and the area under the concentration versus time curve, we evaluated the clinical benefit of Neoral dose ...monitoring with C2 compared trough levels (C0) in stable heart transplant patients.
We studied 114 stable adult patients followed at the heart transplant clinic, who were >1 year after surgery. In May 1996 (period 1, follow-up 10+/-4 months), Neoral dose monitoring was based on C2 (300-600 ng/ml); while in May 1997 (period 2, follow-up 10+/-2 months), it was based on C0 (100-200 ng/ml). Cyclosporine A levels were measured by an enzyme multiplied immunologic technique. Clinical benefit was defined by the absence of acute rejection, no mortality, no fall in left ventricular ejection fraction >10%, and no increase in serum creatinine >10% (compared with baseline).
During period 1, Neoral dose, cyclosporine A, C0 and C2, and serum creatinine, decreased by 26, 56, 45, and 2.3%, respectively. At the end of period 2, the same variables increased by 24, 56, 38, and 10%, respectively (P<0.0001). The incidence of acute rejection was similar (period 1: 0.87%, period 2: 0.96%). The left ventricular ejection fraction (initial/final) remained stable (period 1: 57+/-91%/58+/-13%, period 2: 59+/-11d/58+/-10%). Mortality did not differ (period 1: 7.9%, period 2: 9.6%). A clinical benefit was observed in 69.3% of the patients during period 1 vs. 43.3% of the patients during period 2 (P<0.00001).
In stable heart transplant patients, a greater clinical benefit was observed when Neoral dose monitoring was performed according to C2, compared with C0.
Laparoscopic cholecystectomy (LC) has gained wide acceptance for treatment of cholelithiasis in preference to open cholecystectomy, though it has not been formally compared with mini cholecystectomy ...(MC). We have compared these two techniques in a randomised trial. 70 patients with ultrasound-proven cholelithiasis were randomly allocated LC (38) or MC (32); 37 and 25, respectively, underwent the assigned procedure. The mean hospital stay (including 1 preoperative day) was significantly shorter in the LC than the MC group (median 3 interquartile range 2-3 vs 4 3-5, p=0·001) as was duration of convalescence (mean 11·9 SD 9·1 vs 20·2 16·5 days, p=0·04). The rate of return to normal activities was 1·77 times greater in the LC group than in the MC group (95% confidence interval 1·01-3·11, p=0·03). In regression analysis, the type of cholecystectomy done was the only variable significantly associated with the duration of convalescence. Although there was significant postoperative improvement in all of three quality of life scores in both groups, LC patients improved more quickly than did MC patients. This randomised trial shows the superior effectiveness of LC over MC in treating cholelithiasis.
Determinants of complications after endoscopic retrograde cholangiopancreatography (ERCP) have not yet been completely characterized.
Data were collected from an endoscopic database. Univariate ...analysis and multivariate logistic regression analysis were used to generate the best model of independent predictors of post-ERCP pancreatitis.
The database included 1239 ERCP examinations carried out to investigate suspected choledocholithiasis over a five-year period. From these, 45 patients who developed post-ERCP complications were compared to a random sample of 486 patients who had undergone an uncomplicated ERCP for suspected choledocholithiasis. Univariate analysis demonstrated significant differences between the two patient groups for the following factors: age, using a cut-off point of 59 years (27% vs. 51%, P = 0.002), pancreatic channel opacification (73% vs. 58%, P = 0.05), and absence of common bile duct stones (41% vs. 24%, P = 0.03). Using multivariate logistic regression, the best model for predicting post-ERCP pancreatitis in patients undergoing sphincterotomy included age under 59 years (P = 0.04), and absence of a common bile duct stone (P = 0.004). The model yielded probabilities of developing post-sphincterotomy pancreatitis that ranged from 2.8% if no predictor was present, to 27% when both predictors were present. Among patients in whom a sphincterotomy was not performed, the only significant independent predictor found was pancreatic channel opacification (P = 0.05).
Age under 59 years, pancreatic channel opacification, and an absence of common bile duct stones at ERCP are all independent predictors of post-ERCP pancreatitis.
Background: The management of bile leaks has evolved in the laparoscopic era. This study characterizes risk factors for their development and their clinical course and management. Methods: Data on a ...cohort of patients who developed bile leaks after cholecystectomy in the laparoscopic era were gathered prospectively and retrospectively from an ongoing surgical database and following a review of hospital charts. Results: Sixty-four patients (mean age 56 ± 17.1 years, 72% women) were included over a 5-year study period. The incidence of leaks was 1.1% among patients entered in a laparoscopic cholecystectomy database. Intraoperative complications were encountered in 36%. Rates of intraoperative complication and conversion to open surgery were greater among patients who developed leaks (5.2% vs 0.6% and 33% vs 6.3%, respectively, p < 0.00001). Patients presented 5.3 ± 4.2 days following surgery with abdominal pain (89%), fever (74%), and tenderness (81%). Ultrasound diagnosed a suspected leak in 73%, which ERCP showed as originating from the cystic duct stump in 77%. Biliary obstruction was noted in 20 (31%) patients (14 with stones). Treatments included percutaneous (13%), endoscopic (28%), primary or secondary operative procedures (14%), or a combination thereof (45%). Conclusion: A complication at laparoscopic cholecystectomy increases the likelihood of a subsequent bile leak. Most patients present early with a patent cystic duct stump in the absence of biliary obstruction. Endoscopic therapy is successful in the majority of cases, but otherwise percutaneous or operative procedures may be needed. (Gastrointest Endosc 1997;45:277-82.)
To assess the safety profile of Neoral dose adjustment using cyclosporine (CsA) trough levels (C0) compared with levels obtained 2 h after the morning dose (C2), 30 stable adult heart transplant ...patients 1 yr or more after surgery were converted from Sandimmune to Neoral. After a baseline visit (before conversion), initial follow-up included two visits (2 and 4-6 wk after conversion). After the first visit, patients were randomized to Group I (C0: 100-200 ng/ml) or Group II (C2: 200-400 ng/ml). Abbreviated pharmacokinetics were obtained for the estimation of the AUC0-4 h. Renal function was assessed by serum creatinine and the cimetidine-modified creatinine clearance. C2 correlated better than C0 with the AUC0-4 h (r = 0.91 vs. 0.63). Initial Neoral dose (mg/kg/d) was similar in both groups (2.8 +/- 0.5 and 2.8 +/- 0.8), and was lower in Group II at the second visit (2.0 +/- 0.7 vs. 3.0 +/- 0.6, p = 0.0001). C2 levels decreased in Group II from 912 +/- 438 to 555 +/- 271 ng/ml (p = 0.01), without evidence of acute rejection on endomyocardial biopsies. After the second visit,-both groups were monitored with C2, and the range was increased to 300-600 ng/ml. At the last visit (additional follow-up of 5 +/- 1 months), Neoral dose (mg/kg/d) was reduced to 2.0 +/- 0.3 in Group I (p < 0.001) and 1.8 +/- 0.4 in Group II. Serum creatinine was lower in Group II at the second visit (138 +/- 59 vs. 168 +/- 37 mumol/L, p = 0.01) and was similar in both groups at the last visit. Neoral dose reduction based on C2 levels was not associated with acute rejection. The better correlation with the AUC0-4 h suggests that C2 may be more reliable than C0 for Neoral dose adjustment.