1 ITECH3001 Assignment 2: Evaluating a System (25%) Due date: Monday, Week 11 Word limit: 3,000 – 5,000 words Assignment objectives • Investigate the techniques for evaluating systems as described in the literature • Design and conduct usability evaluation for a chosen system • Analyse and interpret the data and results from the evaluation • Report on the results and recommend for improvement of the evaluated system Details of written components Assignment You will select one of the websites provided (the list is available on Moodle). You must notify your tutor which website you have selected as each website can be evaluated by only one person. The assignment involves conducting a usability test on that website, interpreting the results and writing recommendations in the form of a report on any changes needed. A copy of your report will be ready to be submitted to the charity. Each of the charities listed have requested a usability evaluation of their website. The written component of the assignment must be based on your ACTUAL usability test on REAL users and should contain the following: • A discussion, based on the literature, of the different approaches for assessing or testing usability with more detail on the use of usability testing for evaluating systems or websites. • A brief description of the website selected for the usability evaluation. This should include the purpose of the website, the audience and the objectives of the organisation with respect to their website as determined by the charity. • For the usability test you must: o Describe how the usability testing was conducted, and rationale for the approach. You may use the usability instrument provided on Moodle or a modified version (but improved version). The description should include a justification of the number of 2 users, selection of users, the instrument you used for your test (that is the questions), the task you set the users, the scenario etc. • A critical discussion of the method (good or useful aspects, difficult or poor aspects). • A page summarizing your recommendations for changes to the website with supporting evidence. Think about what you think key personnel in the charity will want to know about how well their website is performing. It should be noted that this is not an exclusive list but suggestions of how you might approach the assignment. Your presentation must be brief and no more than 10 A4 pages with 12pt font. Use dot or numbered lists, tables and numbered headings to organize your ideas and info as demonstrated in this document. To support your arguments, use screenshots, graphs and actual data from your test and cite references across your document. Presentation to the charity • You are required to do a presentation for the charity. This is an assessable component of your assignment. • Your presentation will be a summary version of the full assignment and should contain recommendations regarding changes to the website. • The presentation will not contain all the information you have in your written assignment. Consider carefully what you think the charity will want to know that will be useful to them. • It would be helpful if you imagine you are reporting your evaluation results to your boss who has only about 10 minutes for you, and your career or promotion depends on your success on this reporting. • Start with key points (must haves), followed by blurbs (additional info) and then with elaborations on each of the key points (nice to have). Please use the attached marking guide as a guide to the work and content required for this assignment.3 Marking guide for the assignment written component The written component of your assignment will be marked out of 50, is worth 20% of your final mark. Use the following guide to structure the written component of the assignment. The criteria used to mark your work will be as follows: Criteria Comments Understanding the purpose of the website (as described by the /4 charity) • Described the organisation’s purpose adequately • Described the purpose (objectives) the organisation has for their web site adequately • Identified the audience the charity is trying to reach Background literature on evaluating and testing for usability /10 • Overview of approaches to usability testing and evaluation was included • Discussion was provided on the different approaches and use of usability • testing • Critical assessment of the use of usability testing was included Implementation of the usability testing /16 • Details were provided on the choice of users with justification • Detailed description was provided of how the usability test was implemented (including the, instrument used with justification, test environment, scenario and tasks performed). • Critical discussion provided reflecting on your use of and experience with usability testing • Summary of findings provided and include evidence from the testing to support the findings Recommendations /12 • Recommendations were sufficiently detailed. • Recommendations were appropriate • Recommendations were well justified based on the outcomes of the • evaluation • Recommendations were presented appropriately Literature /4 • The literature used was appropriate • Sufficient literature was used Submission /4 • Written presentation was professional • References cited correctly using Harvard style or similar correctly presented in • text and in reference section and all details provided • Assignment Submitted on time • No evidence of plagiarism Total Marks /50 Mark out of /204 Assignment Presentation Marking Guide You are required to present the results in a short presentation of no longer than 10 minutes. The presentation should be based on the report to be provided to the charity, it should focus on the key findings from your testing and the recommendations. Your presentation should consist of no more than 10 slides. Please use the attached marking guide as a guide to the content for your presentation. Presentation Content Rating • Relevancy of the content for the organisation /4 • Appropriateness as a report for an organisation • Recommendations with justification provided • Ability to address issues/questions raised /3 • All relevant issues addressed and all information the organisation would need was provided • Appropriate breadth vs depth /5 • Contained interesting, informative and useful information • Sufficient reflective thinking • Analysis of results described appropriately /3 Presentation Style /5 • Ability to incite interest, interaction and/or discussion • Clear, concise, and professional delivery, flow of information and presentation • Quality of powerpoint slides • Ability to adhere to time constraints and number of slides • marks will be deducted for over time and/or more than 6 slides Total Marks /20 Mark out of /5