Brief history of OSCE technology
When first considering the use of OSCE exams as a method for skills assessment we observed other practitioner exams being conducted. This exercise clearly demonstrated the necessity to devise a technology-based solution for gathering results data, as a paper-based system was prohibitive. The technological solution identified as the most efficient was in the form of Pocket PCs.
Pocket PCs were small hand-held user-friendly devices. The results were captured on these devices in text files, imported into a Microsoft Access database and then Microsoft Excel was used to generate results reports. This system, although it might sound complicated, allowed maximum flexibility for an exam system which was undergoing many changes in the early days.
Minor issues, which came to light through practical use of the device were addressed in version two of the system – the Tablet PC. This device delivered a larger data-entry screen which allowed all the data entered to be displayed on one screen without compromising text size. The results system was also revised at this time in conjunction with formulising examination procedures. This initiative resulted in increased efficiency in the administration of exam results and reporting. The Tablet PC served it’s purpose well over the years and was developed further to enable the availability of a realtime snap-shot of results and issues which
improved administrative efficiencies as well as the implementation of quality standards. Through researching further technological advancements it became apparent that newer devices could bring further efficiencies in administration and quality standards and a redevelopment of the exam system enabled us to exploit this technology.
iPad development
The iPad/iPhone Operating System (OS) is famously known for its simplistic design and user interface. The OS offers users a simple and intuitive interaction with the system, without the need for an additional pointing device such as a mouse or a stylus, all the user needs are their hands and through a few simple swipes and “point and click” movements the OS can be simply navigated. The iPad also offers the additional flexibility of fail-safe battery power, dispensing with the necessity to charge and re-charge devices. (Continued in next column)
|
|
Prior to the go-live date (October 2010) we engaged in many weeks of screen and user-interface development. This developmental period ensured the smooth operation of the device which was evidenced during the first official test of the system carried out during the Examiner Training Course in September. Feedback gathered from the more experienced examiners during this training programme was invaluable in finalising the product which is now in use The new device is proving hugely successful and is now in use at all OSCE examinations. Examiner training in using the device is on-going as we expand our Examiner Panel and we continue to welcome feedback which will inform future development of the system.
Summary
Through constant review of existing systems and research into new technological advancements we have developed a system which provides many administrative and user advantages. The new system has greatly reduced the pre-exam setup times; it has simplified the pre-exam setup. The weight of equipment required to be brought from exam to exam has been greatly reduced, the capture
of results has been simplified and its speed has been improved. From the users perspective, the new system offers the many benefits of the Tablet PC version such as the large screen and mobility but the user interface has been improved and simplified. Although the iPad system is the best OSCE system that we have currently produced, the available technologies and procedures used during exams is under regular review to identify developments which may be taken to improve the overall system. We don’t know what technological development will happen in the future but if they can improve our system they will be incorporated into any future development work carried out.
|