The reliability and usability of the Anesthesiologists’ Non-Technical Skills (ANTS) system in simulation research

Advances in Simulation

Table 2 Interrater reliability measures for the categories and elements of the ANTS system

Categories	ICC agreement	Elements	% absolute agreement	ICC agreement	Mean absolute difference
Task Management	0.713	Planning and Preparing	57	0.488	0.47
		Prioritizing	52	0.621	0.55
		Providing and Maintaining Standards	63	0.670	0.37
		Identifying and Utilizing Resources	62	0.449	0.45
Team Working	0.520	Coordinating Activities with Team	73	0.661	0.27
		Exchanging Information	57	0.398	0.52
		Using Authority and Assertiveness	46	0.519	0.55
		Assessing Capabilities	42	0.371	0.63
		Supporting Others	40	0.520	0.67
Situation Awareness	0.568	Gathering Information	55	0.409	0.45
		Recognizing and Understanding	50	0.535	0.53
		Anticipating	63	0.568	0.40
Decision Making	0.427	Identifying Options	32	0.459	0.85
		Balancing Risks and Selecting Options	33	0.426	0.80
		Re-evaluating	53	0.506	0.52

ISSN: 2059-0628