TY - JOUR
T1 - Assessment of Competence in EVAR Procedures
T2 - A Novel Rating Scale Developed by the Delphi Technique
AU - “EVARATE Delphi Panel”
AU - Strøm, M.
AU - Lönn, L.
AU - Bech, B.
AU - Schroeder, T. V.
AU - Konge, L.
AU - Aho, P.
AU - Back, M.
AU - Bicknell, C.
AU - Björses, K.
AU - Brunkwall, J.
AU - Dake, M.
AU - Dias, N.
AU - Dorenberg, E.
AU - Duvnjak, S.
AU - Falkenberg, M.
AU - Formgren, J.
AU - Holst, J.
AU - Kristmundsson, T.
AU - Langfeldt, S.
AU - Lindgren, H.
AU - Mafi, H.
AU - Malina, M.
AU - Mani, K.
AU - Modarai, B.
AU - Morgan, R.
AU - Nyman, N.
AU - Pärsson, H.
AU - Rasmussen, J.
AU - Resch, T.
AU - Shames, M.
AU - Van Den Berg, J.
AU - Van Herzeele, I.
AU - Verhagen, H.
AU - Verhoeven, E.
AU - Venermo, M.
AU - Vermassen, F.
AU - Wanhainen, A.
PY - 2017/7/1
Y1 - 2017/7/1
N2 - Objective/Background To develop a procedure specific global rating scale for assessment of operator competence in endovascular aortic repair (EVAR). Methods A Delphi approach was used to achieve expert consensus. A panel of 32 international experts (median 300 EVAR procedures, range 200–3000) from vascular surgery (n = 21) and radiology (n = 11) was established. The first Delphi round was based on a review of endovascular skills assessment papers, stent graft instructions for use, and structured interviews. It led to a primary pool of 83 items that were formulated as global rating scale items with tentative anchors. Iterative Delphi rounds were executed. The panellists rated the importance of each item on a 5 point Likert scale. Consensus was defined as 80% of the panel rating an item 4 or 5 in the primary round and 90% in subsequent rounds. Consensus on the final assessment tool was defined as Cronbach's alpha > .8 after a minimum of three rounds. Results Thirty-two of 35 invited experts participated. Three rounds of surveys were completed with a completion rate of 100% in the first two rounds and 91% in round three. The 83 primary assessment items were supplemented with five items suggested by the panel and reduced to seven pivotal assessment items that reached consensus, Cronbach's alpha = 0.82. The seven item rating scale covers key elements of competence in EVAR stent placement and deployment. Each item has well defined grades with explicit anchors at unacceptable, acceptable, and superior performance on a 5 point Likert scale. Conclusion The Delphi methodology allowed for international consensus on a new procedure specific global rating scale for assessment of competence in EVAR. The resulting scale, EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE), represents key elements in the procedure. EVARATE constitutes an assessment tool for providing structured feedback to endovascular operators in training.
AB - Objective/Background To develop a procedure specific global rating scale for assessment of operator competence in endovascular aortic repair (EVAR). Methods A Delphi approach was used to achieve expert consensus. A panel of 32 international experts (median 300 EVAR procedures, range 200–3000) from vascular surgery (n = 21) and radiology (n = 11) was established. The first Delphi round was based on a review of endovascular skills assessment papers, stent graft instructions for use, and structured interviews. It led to a primary pool of 83 items that were formulated as global rating scale items with tentative anchors. Iterative Delphi rounds were executed. The panellists rated the importance of each item on a 5 point Likert scale. Consensus was defined as 80% of the panel rating an item 4 or 5 in the primary round and 90% in subsequent rounds. Consensus on the final assessment tool was defined as Cronbach's alpha > .8 after a minimum of three rounds. Results Thirty-two of 35 invited experts participated. Three rounds of surveys were completed with a completion rate of 100% in the first two rounds and 91% in round three. The 83 primary assessment items were supplemented with five items suggested by the panel and reduced to seven pivotal assessment items that reached consensus, Cronbach's alpha = 0.82. The seven item rating scale covers key elements of competence in EVAR stent placement and deployment. Each item has well defined grades with explicit anchors at unacceptable, acceptable, and superior performance on a 5 point Likert scale. Conclusion The Delphi methodology allowed for international consensus on a new procedure specific global rating scale for assessment of competence in EVAR. The resulting scale, EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE), represents key elements in the procedure. EVARATE constitutes an assessment tool for providing structured feedback to endovascular operators in training.
KW - Abdominal aortic aneurysm
KW - Clinical competence
KW - Delphi technique
KW - EVAR
KW - Educational assessment
KW - Endovascular procedures
UR - http://www.scopus.com/inward/record.url?scp=85019578820&partnerID=8YFLogxK
U2 - https://doi.org/10.1016/j.ejvs.2017.04.001
DO - https://doi.org/10.1016/j.ejvs.2017.04.001
M3 - Article
C2 - 28549712
SN - 1078-5884
VL - 54
SP - 34
EP - 41
JO - European Journal of Vascular and Endovascular Surgery
JF - European Journal of Vascular and Endovascular Surgery
IS - 1
ER -