KTRM project D.12: Pilot tests guidelines and feedback forms

The present deliverable illustrates the preparatory work for pilot testing to be conducted in KTRM Work Package 7 ("Pilot Tests, Evaluation and Refinement of Content"). Aim of this work package is to thoroughly test the KTRM online e-learning platform and supporting resources. Working with national testing panels, partners will address the effectiveness of the system and its ease of use. The pilot tests are an important element of KTRM to ensure that the platform and content are valuable for future users. As a first step, a set of guidelines and feedback forms for the pilot tests have been realized and circulated to all the partners. The guidelines will provide partners with details on the pilot test process and on information to be obtained to help ASCAMM with any additional developments/amendments to improve the platform. They will also give a consistent approach to the testing phase across all countries. On agreement of the documents each partner will start the pilot tests. Pilot tests will be carried out in two stages: 1) The first version of the KTRM platform and contents will be "internally" tested by all the partners. Employees that have not been participating in the project will be asked to test the materials and provide feedback. Feedback will be passed to ASCAMM who will update and make any necessary changes or amendments. To get representative feedback, employees of various status and background education will be recruited for tests performing (technical education, basic and higher education level, different age and gender). In such a way, it will be possible to analyse if the e-learning platform is understandable and it is a fruitful source of professional information for the target group and users. A second test on the platform will be carried out by the consortium prior to its release for external pilot testing. This is to ensure that any "bugs" or technical problems are removed as early as possible. Similarly, it will ensure that the platform is user friendly and the instructions are easy to follow. This process will continue until all the partners involved in the work package are in agreement that the training resources are at an adequate stage for external pilot testing. 2) Each partner will select a minimum of 10 companies and trade unions to form a National Testing Panel. An initial five users will be asked to test the modules following the instructions available. They will be asked to complete the feedback forms detailing their opinion on it and any problems they had with the platform. Testing will include a list of questions and answers in order to assess if e-learning materials feed their background and improve skills. The results will be used to amend and/or change aspects of the platform for final optimization. The present deliverable contains preparatory work to testing, since it defines the detailed method for pilot testing and supplies the questionnaires and feedback forms that will be used for testing by all KTRM partners. In this way, the testing approach will be harmonized in all countries and at Consortium level.