Evaluation of eCat metadata interface designs

Please enter your participant code here:

Questionnaire purpose


This research project (Streamline) is examining how to improve on the processes of producing and searching for Learning Objects. As part of this research we have been examining the use of eCat’s process for adding metadata to Learning Objects. Further details can be found on the Streamline blog.

This questionnaire is completely anonymous and all data gathered will be used for research purposes only. By completing and sending this questionnaire you are giving us your consent to use this data in this way. Thank you for your time and participation.


A. Demographic questions


Q1. Gender? Male Female


Q2. Age?



Q3. Country?


Q4. What is your highest attained education level?


Q5. To which faculty/department do you belong to?


Q6. What are your areas of expertise?


Q7. How long have you been teaching for?



B. Previous Experience

[TOP]


Q8. Have you ever created any Learning Objects?


Yes: go to Q9 No: go to Q12


Q9. Please list the applications you have used to create Learning Objects?



Q10. Give a brief description of how you went about creating the Learning Objects



Q11. How would you rate the process of creating Learning Objects with these applications? (where 1=easy and 5=hard).



Easy


Average


Hard



1 2 3 4 5



Q12. In your opinion how important are Learning Objects in developing eLearning? (where 1=low and 5=high).



Not Important


Average


Important



1 2 3 4 5



Q13. In your opinion how important is metadata within a Learning Object? (where 1=low and 5=high).



Not Important


Average


Important



1 2 3 4 5



C. eCat_Original_Interface.dnm

[TOP]

The following section evaluates the original eCat metadata interface as shown using the DENIM application


Q14. How true are the following statements about the ORIGINAL eCat DENIM design, from your perspective
(where 1=not true and 5=true)

Not True Uncertain True
a. I did not understand what was being represented. 1 2 3 4 5
b. I liked the way the required metadata was grouped (tab sections). 1 2 3 4 5
c. I think the layout is too complicated. 1 2 3 4 5
d. I think some of the data asked for is irrelevant to Learning Objects. 1 2 3 4 5
e. I prefer to enter my own data, rather than choose from a list. 1 2 3 4 5


Q15. How would you rate the ORIGINAL eCat interface (where 1=poor and 5=good).



Poor


Average


Good



1 2 3 4 5



Q16. Was there any particular thing that you felt was missing from the ORIGINAL eCat interface?


Yes: go to Q17 No: go to Q18


Q17. Please give a brief description of what you felt was missing



D. eCat_new_design_1.dnm

[TOP]

The following section evaluates the 1st new design metadata interface as shown using the DENIM application


Q18. How true are the following statements about the NEW_DESIGN_1 eCat DENIM design, from your perspective
(where 1=not true and 5=true)

Not True Uncertain True
a. I did not understand what was being represented. 1 2 3 4 5
b. I liked the way the required metadata was grouped (tab sections). 1 2 3 4 5
c. I think the layout is too complicated. 1 2 3 4 5
d. I like the idea of keywords being suggested. 1 2 3 4 5
e. I liked the idea of visualising the keywords as a relationship map. 1 2 3 4 5
f. I think it is important to be able to preview the metadata in one place. 1 2 3 4 5


Q19. How would you rate the NEW_DESIGN_1 eCat interface (where 1=poor and 5=good).



Poor


Average


Good



1 2 3 4 5



Q20. Was there any particular thing that you felt was missing from the NEW_DESIGN_1 eCat interface?


Yes: go to Q21 No: go to Q22


Q21. Please give a brief description of what you felt was missing



E. eCat_new_design_2.dnm

[TOP]

The following section evaluates the 2nd new design metadata interface as shown using the DENIM application


Q22. How true are the following statements about the NEW_DESIGN_2 eCat DENIM design, from your perspective
(where 1=not true and 5=true)

Not True Uncertain True
a. I did not understand what was being represented. 1 2 3 4 5
b. I liked the way the required metadata was grouped (tab sections). 1 2 3 4 5
c. I think the layout is too complicated. 1 2 3 4 5
d. I like the idea of being able to select from preset copyright. 1 2 3 4 5
e. I liked the idea of selecting keywords using faculty documents and structure. 1 2 3 4 5
f. I prefer to be able to edit the auto-generated keywords 1 2 3 4 5


Q23. How would you rate the NEW_DESIGN_2 eCat interface (where 1=poor and 5=good).



Poor


Average


Good



1 2 3 4 5



Q24. Was there any particular thing that you felt was missing from the NEW_DESIGN_2 eCat interface?


Yes: go to Q25 No: go to Q26


Q25. Please give a brief description of what you felt was missing



Other Comments

[TOP]


Q26. If you have any other comments you would like to add, please state them here:



Thank you for participating in this research.

The Streamline project is focused on producing a series of user centred tools to improve the process of developing, searching and storing Learning Objects. If you would like to be contacted with regards to other evaluations please enter your email address here.

E-mail address:

This information will only be used in the context of this research and will be kept independent of the questionnaire data and confidential at all times.

If you have any questions concerning this questionnaire or this research project please email d.a.wood@leedsmet.ac.uk


Please enter your participant code here: