The final help files and videos are now in place.
The Synote Researcher transcript (.doc file) can be downloaded.
Help file (Word .doc download) This is also seen on the home page of Synote Researcher
Here are the details about the project budget. Some information has been blurred out due to the public nature of this blog.
|Directly Incurred Staff||August 10– July 11||August 11– July 12||TOTAL £|
|(b) blanked out||3219||5611||8830|
|(c) blanked out||3377||6427||9804|
|(d) blanked out||1688||2856||4544|
|Total Directly Incurred Staff (A)||8284||14894||23178|
|Travel and expenses||430||1771||2201|
|Total Directly Incurred Non-Staff
|Directly Incurred Total (C) = A+B||8714||17665||26379|
|Directly Allocated Total (D)||16027||27732||43759|
|Indirect Costs (E)||13540||23312||36852|
|Total Project Cost (C+D+E)||38281||68709||106990|
|Amount Requested from JISC||14312||25688||40000|
|% Contributions over project life||JISC= 37.4%||Partners=62.6%||Total=100%|
|No. FTEs used to calculate indirectand estates charges, and staff included||No FTEs
All staff Listed in Section 3.10
The following shows the main risks identified for this project, as well as contingency actions for each risk.
|Title||Liklihood x Impact = Priority||Action to Prevent/Manage Risk|
|Loss of personnel||2 x 4 = 8||ECS has many experienced staff and members of the team have the knowledge, experience and ability to support staff and to take over each other’s roles at critical moments if required.|
|Interest of users||2 x 8 = 16||User interest has been confirmed among a number of schools who will be involved in the co-design and evaluation and will be maintained as the project will support users in existing research and provide a more learnable and adaptable tool that is currently available to them.|
|Keeping to planned timetable||2 x 8 = 16||An initial study has been conducted to demonstrate the feasibility of the proposed ALUIAR system. The team are very experienced at successfully completing funded projects to time and have the required technical and managerial expertise and support of the institution and will meet regularly to ensure the project runs to plan.|
|Addressing boy Usability and Accessibility Issues||2 x 8 = 16||Synote was designed with both accessibility and usability in mind (and was closely linked with the development of UDIM though the users and innovations programme) and the ALUIAR project team includes experts on addressing both accessibility and usability issues and if required also has easy access to other HCI experts within ECS and beyond.|
Likelihood scored as Very Low = 1, Low = 2, Medium = 3, High = 4, Very High = 5
Impact scored as: Very Low = 1, Low = 2, Medium = 4, High = 8, Very High = 16
The project will be led by Dr Mike Wald of Southampton’s School of Electronics and Computer Science (ECS) and his team will use an agile interactive approach involving end users in regular co-design, and review meetings. There will also be regular management meetings and discussions with the Stakeholder Group involving researchers from a wide range of schools/faculties (including Psychology, Health sciences, Nursing, Sociology and Social Policy, Management, Education).
The project will begin with an initial project face-to-face meeting. Team meetings will occur at monthly intervals to monitor progress against objectives. Minutes of these meetings will be published on this project blog and will be available to the public. Financial reports will be supplied by ECS financial management and a Final Report will be produced at the end of the Project as specified. There will be a final project closure meeting. Each of the work packages will require formal review and sign-off meetings. There will be weekly technical meetings of the core project staff.
Workpackage 1: Co-design: Team meeting and requirements and specification agreement with our panel of stakeholders from different schools identified in sections 2.1 & 3.1 who will be involved in the co-design and evaluation processes. These users have already identified the following developments required to make the tool more adaptable and learnable and any further issues will also be identified:
Output: Requirements/functional specifications will be expressed using use cases, personas and scenarios (developed further from the three scenarios outlined in section 2) and will be revisited in WP3 to ensure an agile approach. The different ALUIAR demonstrators themselves will also be used to support the ALUIAR co-design design and evaluation process through the analysis of recorded project evaluation interviews and observations in a fashion similar to that described in scenario 3 in section 2, thus demonstrating our confidence in our own software (an approach colloquially referred to as ‘eating your own dog food’).
Workpackage 2: Dissemination and working with and reporting to JISC
Output: Project website, Blog syndicated, Project plan, reports to and liaison with JISC, attendance at JISC programme level activities (e.g. programme meetings and relevant special interest groups) for at least 10 days per year, extensive involvement with JISC community, OSS Watch, workshops, relevant special interest groups, conferences presentations, mailing lists, published papers and articles.
Workpackage 3: Software Development & Evaluation
The software development and evaluation will be agile and iterative to ensure responsiveness to changes with three phases/iterations and demonstrators and a final version at the end of the project. Analysis and design and development of demonstrators at the different phases will involve usability studies including iterative evaluation of interaction design with users to finalise improved adaptability and learnability for deployment. Improvements in usability of the demonstrators will be measured and evaluated using quantitative and qualitative evaluations, tasks, tests and observations based on deployment by users on the stakeholder panel in their research studies. A wide range of approaches will be used at appropriate stages of pre-development, development, and deployment, including, low and hi fidelity prototypes, cognitive Walkthrough, Heuristic Evaluations, interviews, Adaptable and Learnable User Interface for Analysing Recordings (ALUIAR) Page 4, Adaptable and Learnable User Interface for Analysing Recordings (ALUIAR) Page 5, Focus Groups, and Empirical testing. The different ALUIAR demonstrators themselves will also be used to support the software design and evaluation process through the analysis of recorded ALUIAR project evaluation interviews and observations. Beta testing reports include testing against requirements and acceptance, compatibility, integration, unit and load testing and identifying problems to be addressed, including integration or interoperability issues. Demonstrators will be also made available to the JISC research community for evaluation and feedback including through stakeholders’ subject networks and contacts.
Phase 1 output will be a prototype demonstrator 1 based on requirements identified in 3.1
Phase 2 outputs will be an evaluation of demonstrator 1 and development of demonstrator 2 which will have improvements based on the phase 2 evaluation
Phase 3 outputs will be:
Workpackage 4: Project Evaluation
Output: Evaluation report of project by independent evaluator using project documentation created throughout the project and with the success of the project measured by the acceptance and take up by users.
Workpackage 5: Sustainability We will consult with OSS watch on sustainability and access to the code and documentation through a best fit ‘OSI approved licence’ and a suitable governance model. ALUIAR will also liaise with the Software Sustainability Institute. Best practice in source code development and management will be followed and Quality factors built in to the workpackages will ensure successful Open Source life through achievement of a good OSMM rating, community engagement, and community stated need. All reports, tools, and code from the project will remain on the project server for a minimum period of 2 years and will be archived in the institutional repository (E-Prints) and appropriate JISC repository, for instance Jorum.
Output: Acceptance by users and a sustainability strategy for the application.
E.A. Draffan, the ALUIAR project manager is Research Fellow at the University of Southampton’s School of Electronics and Computer Science and has extensive experience in usability, accessibility testing and evaluation. She has project managed many JISC funded projects, e.g. LexDis (participatory investigation of elearning tools and strategies), Web2access (evaluation of web application usability and accessibility) , REALISE (open source participatory design), as well as many other government and charity funded projects. She also has extensive experience of using commercial and open source tools to analyse recordings within many previous projects.
Yunjia Li is ALUIAR’s lead developer and researcher, and has been Synote’s lead developer since the JISC MACFOB project in 2008. He has a 1st Class Computer Science Degree and a distinction in MSc Web Technologies, as well as extensive experience of web based user interface design.
Seb Skuse is an ALUIAR developer/researcher, has a 1st Class Information Technology in Organisations Degree and has been lead developer on many JISC agile open source projects since 2009. He has extensive experience of web based user interface design and has also developed ATbar, the accessibility toolbar for websites.
Mike Wald is ALUIAR’s Principal Investigator and a Senior Lecturer at the School of Electronics and Computer Science at the University of Southampton. He has taught on undergraduate and postgraduate HCI/usability courses and led the award winning JISC projects MACFOB (developing Synote), LEXDIS (involving extensive use of NViVO software for interview on ‘Adaptable and Learnable User Interface for Analysing Recordings’ (ALUIAR), Page 7 analysis), has advised HEFCE, BECTA, and JISC on technology and usability issues and was involved in the development of the JISC Users and Innovation Development Model.
Dr Wald will lead the project aided by the following co-investigators:
Gary Wills is a Technical Leader and a Senior Lecturer in Computer Science at the University of Southampton who has also taught on undergraduate and postgraduate HCI/usability courses. He has led a number of JISC funded projects involving participatory usability co-design, including projects from the Virtual Research Programmes rounds I & III (CORE, VRIC, IBBRE projects). In addition to the JISC funded work Gary has projects funded by the TSB/DTI, ESRC, MRC and NIHR, and therefore has extensive experience developing usable tools for analysing research in the Engineering, Social Science and Medical domains.
Lester Gilbert is lead on project evaluation, a Senior Lecturer at the School of Electronics and Computer Science and was Principal Investigator on REAQ and EFSCE, technical manager of the VRE CORE, co-investigator on FREMA and R2Q2 and has extensive experience of participatory co-design on JISC projects. He has worked for many years leading commercial teams developing computer based software.
Lisa Roberts is an experienced researcher and clinical physiotherapist, with experience of leading trials in communication and back pain. In August 2007 she commenced a 5-year post (ARC Senior Lecturer in Physiotherapy), funded by the Arthritis Research Campaign leading a mixed methods research programme. She is currently secretary for the Society for Back Pain Research and a member of the Research Committee of BackCare.
Mary Gobbi is a Senior Lecturer and Award Leader for the Postgraduate Diploma in Nursing with Registration in the School of Nursing and Midwifery and will lead on their involvement in the project. She is responsible for research and evaluation of the HEA and ESRC funded Virtual Interactive Practice (VIP) initiative and has been involved with a range of funded research projects including evaluation of nursing education and training provision. It was Mary who first identified the value of Synote for research and was responsible for its demonstration and dissemination at the “Developing video analysis as a pedagogic and research tool for health care simulation: workshop” in February 2009.
Lisa Harris is Senior Lecturer in Marketing in the School of Management and Programme Director for the Marketing Analytics MSc. She runs workshops on how to use web 2.0 technologies and is exploring ways of using the technology to enhance research, particularly for international students.
This project aims to improve the usability and learnability of the user interface of Synote, the open source web based video and audio annotation tool. There is the need support those researchers, non-specialist and novice users who wish to transcribe audio and video recordings with synchronised text.
The key objective is to present users with an interface that is not only easy to use but is designed to suit the needs of researchers when uploading materials rather than the original users of Synote who tend to search and listen to lectures.
None of the main functionality of thee tool will be changed, but the way in which it will be used will be enhanced, so that it is more intuitive and logical to use. Existing users have already commented on some of the issues that need to be re-examined, such as navigation flexibility, interface learnability and the organisation of recordings and search features etc.
An ethnographic approach will be taken to benchmark Synote’s current performance. A small group of users will be interviewed and ‘walked through’ the tool whilst having their opinions, concerns and behaviour (whilst using the tool) monitored. These results will then be ranked and implemented to help identify the changes that should be made to Synote. These changes will be discussed again with the stakeholders and implemented using an agile interactive approach involving end users in regular co-design, and review meetings.
The success of interventions will be measured by the participants completing a questionnaire based on John Brookes System Usability Scale (SUS) and by quantifying the qualitative results gathered in interviews from the participants. It is felt that due to time constraints the number of interviews that take place before storyboarding interface designs will be minimal. Nielsen (2000) states that “the best results come from testing no more than 5 users and running as many small tests as you can afford.” The stated methods will provide quantitative and qualitative results that will inform the need to improve the adaptability, usability and learnability of Synote. Two other methods were considered but discarded due to the size of the project and time of year with many users going on holiday during July and August: