Certifying navigational skills: A video-based study on assessments in simulated environments

• Autorzy: Sellberg C. , Lindmark O. , Lundin M.

Identyfikatory

DOI

10.12716/1001.13.04.23

• Języki publikacji: EN

Abstrakty

EN

In Maritime Education and Training (MET) where students are trained for professions with high standards of safety, the use of simulators is taken to provide opportunities for safe and cost-effective training. Although the use of simulators for training and certifying technical proficiency and so-called non-technical skills is well established and regulated by international standards, previous research suggests that simulator-based assessment has been poorly implemented in the MET system. Now the challenge is to contribute with knowledge about how to conduct consistent, unbiased, and transparent assessments of navigational skills and competencies. However, in current research it is not evident how training of non-technical skills in simulated environments should be assessed. The aim of this study is to explore the pedagogical challenges instructors face when assessing students’ navigational skills and competencies in a simulated environment. The study is based on video-recorded data from the certification part in a navigation course for second year master mariner students. A situated approach to cognition and learning is employed to analyze the co-construction of assessment in the simulated exercises by means of instructors’ questions and students’ answers. Results reveal an assessment practice where the students are still developing their navigational skills with instructional support from examiners whilst being certified on using Radar equipment in accordance to COLREG.

Słowa kluczowe

EN

Maritime Education and Training (MET); certifying navigational skills; video-based study; assessments in simulated environments; colregs; STCW Convention; MET system in Sweden; simulator based assessments

• Wydawca: Faculty of Navigation, Gdynia Maritime University
• Czasopismo: TransNav : International Journal on Marine Navigation and Safety of Sea Transportation
• Rocznik: 2019
• Tom: Vol. 13. no. 4
• Strony: 881--886
• Opis fizyczny: Bibliogr. 19 poz., tab.

Twórcy

autor

Sellberg C.

• Chalmers University of Technology, Gothenburg, Sweden
• University of Gothenburg, Gothenburg, Sweden

autor

Lindmark O.

• Chalmers University of Technology, Gothenburg, Sweden
• University of Gothenburg, Gothenburg, Sweden

autor

Lundin M.

• Chalmers University of Technology, Gothenburg, Sweden
• University of Gothenburg, Gothenburg, Sweden

Bibliografia

• 1. Conceição, V. P., Basso, J. C., Lopes, C. F., & Dahlman, J.  (2017). Development of a behavioural marker system for  rating  cadet’s  non‐technical  skills.  TransNav:  International Journal on Marine Navigation and Safety of Sea  Transportation. Doi:10.12716/1001.11.02.07 
• 2. Emad,  G.,  &  Roth,  W.  M.  (2008).  Contradictions  in  the  practices of training for and assessment of competency:  A  case  study  from  the  maritime  domain.  Education+  Training. Doi: https://doi.org/10.1108/00400910810874026 
• 3. Flin, R., O’Connor, P., & Crichton, M. (2008). Safety at the  sharp  end:  a  guide  to  non‐technical  skills.  Aldershot  England: Ashgate.
• 4. Flin,  R.,  Martin,  L.,  Goeters,  K‐M.,  Hörmann,  H‐J.,  Amalberti,  R.,  Valot,  C.  &  Nijhuis.,  H.  (2003).  Development  of  the  NOTECHS  (non‐tecnical  skills)  system for assessing pilots’ CRM skills. Human Factors  and Aerospace Safety, 3(2), 97‐119
• 5. Gekara, V. O., Bloor, M. & Sampson, H. (2011). Computerbased assessment in safety‐critical industries: The case  of shipping. Journal of Vocational Education & Training.  Doi: https://doi.org/10.1080/13636820.2010.536850
• 6. Ghosh, S, Bowles, M, Ranmuthugala, D. & Brooks, B. (2014).  Reviewing  seafarer  assessment  methods  to  determine  the need for authentic assessment. Australian Journal of  Maritime  &  Ocean  Affairs.  Doi:  10.1080/18366503.2014.888133
• 7. Heath, C., Hindmarsh, J. & Luff, P. (2010). Video in qualitative  research: Analysing social interaction in everyday life. SAGE  Publications Ltd, London. 
• 8. Hontvedt,  M.  (2015).  Professional  vision  in  simulated  environments—Examining professional maritime pilotsʹ  performance  of  work  tasks  in  a  full‐mission  ship  simulator.  Learning,  Culture  and  Social  Interaction.  Doi:  https://doi.org/10.1016/j.lcsi.2015.07.003 
• 9.Mavin, T., & Roth, W‐M. (2014). A holistic view of cockpit  performance: An analysis of the assessment discourse of  flight  examiners.  International  Journal  of  Aviation  Psychology.  Doi:  https://doi.org/10.1080/10508414.2014.918434 
• 10. Roth,  W‐M.  (2015).  Flight  Examiners’  Methods  of  Ascertaining Pilot Proficiency. The International Journal of  Aviation Psychology. Doi: 10.1080/10508414.2015.1162642 
• 11. Roth,  W‐M.  &  Mavin,  T.  (2015).  Peer  Assessment  of  Aviation Performance: Inconsistent for Good Reasons.  Cognitive Science. Doi: 10.1111/cogs.12152
• 12. Sampson, H., Gekara, V. & Bloor, M. (2011). Water‐tight or  sinking?  A  consideration  of  the  standards  of  the  contemporary  assessment  practices  underpinning  seafarer licence examinations and their implications for  employers. Maritime Policy Management. Doi: https://doiorg.ezproxy.ub.gu.se/10.1080/03088839.2010.533713 
• 13. Sellberg, C. (2017). Simulators in bridge operation training  and  assessment:  A  systematic  review  and  qualitative  synthesis.  WMU  Journal  of  Maritime  Affairs.  Doi:  https://doi.org/10.1007/s13437‐016‐0114‐8 
• 14. Sellberg, C. & Lundin, M. (2017). Sellberg, C., & Lundin, M.  (2017). Demonstrating professional intersubjectivity: The  instructorʹs  work  in  simulator‐based  learning  environments. Learning, culture and social interaction. Doi:  https://doi.org/10.1016/j.lcsi.2017.02.003
• 15. Sellberg, C., & Lundin, M. (2018). Tasks and instructions on  the  simulated  bridge:  Discourses  of  temporality  in maritime  training.  Discourse  Studies.  Doi:  https://doi.org/10.1177/1461445617734956 
• 16. Stahl  G  (2005)  Group  cognition  in  computer‐assisted  collaborative  learning.  Journal  of  Computer  Assisted  Learning,  Doi:  https://doi.org/10.1111/j.13652729.2005.00115.
• 17. Taylor,  D.  H.  (1998).  Rules  and  regulations  in  maritime  collision  avoidance:  New  directions  for  bridge  team  training. Journal of Navigation, 51(1), 67–72.
• 18. Weber,  D.,  Roth,  W‐M.,  Mavin,  T.  &  S.  Dekker.  (2013).  Should we pursue interrater reliability or diversity? An  empirical  study  of  pilot  performance  assessment.  Aviation in Focus, 4(2), 34‐58
• 19. Øvergård, K. I., Nazir, S., & Solberg, A. S. (2017). Towards  automated  performance  assessment  for    maritime  navigation.  TransNav,  International  Journal  on  Marine  Navigation  and  Safety  of  Sea  Transportation.  Doi:10.12716/1001.11.02.03