Categories
Digital technologies to enhance learning and teaching and assessment. Enabling student development and achievement Online learning review Student engagement in learning Technology and digital literacies

The flipped classroom!

Blog Authors: Tracey Howe, John McVeigh, Jan Robertson, Walter Patterson, Cathy Glover, Anna Close, Fiona Nixon

Image: DuEnLiJu / CC0Attribution

In the last few weeks, due to the coronavirus (COVID-19) pandemic, the world of education has had to react to a fundamental change due to closures of schools, colleges and universities on a world wide scale. Our College like many other institutions has had to shift from more traditional lecture-based approaches to teaching on-line.

This week we discussed this recent systematic review of flipped classroom empirical evidence from different fields addressing the gaps and future trends. Flipped classrooms are where students attempt to learn and comprehend the instructional contents before attending class through video-recorded lectures.

Here’s what they did

The authors searched electronic databases, namely ScienceDirect, EBSCOhost Web, Emerald Insight, Wiley Online Library and Springer Link for studies using keywords flipped classroom, flipped learning, flipping the class, inverted classroom and inverted learning in different fields and published in 2017 and 2018.

The authors reviewed and analysed 48 studies that met their criteria using content analysis. They explored positive impacts and challenges of implementing flipped classrooms.

Here’s what they found

Four major themes emerged;

  • students’ academic achievement,
  • learning motivation and/or engagement,
  • self-directed learning skills
  • social interaction.

The flipped classroom yielded positive impacts on students’ learning activities such as academic performance, learning motivation and/or engagement, social interaction and self-directed learning skills.

The most significant challenges encountered by the instructors is a lack of students’ motivation to watch the pre-recorded video lectures or to study the contents outside of the class time.

The author/s concluded

The findings suggest  that the flipped classroom concept might be effective in pursuing the 21st century learning such as greater collaboration, more interaction, greater confidence in communicating  ideas, and interestingly delivering a more democratic and equal learning space.

Our Journal Club’s views

Who are the authors of the paper and where do they work? The authors are affiliated to the Faculties of Education at the University of Hong Kong and the Ocean University of China.

What do we know about the journal? An international journal, On the Horizon, now in volume 28, explores the issues that are emerging as technology changes the nature of education and learning within and among institutions, other organizations, and across geo-political boundaries, as learning increasingly takes place outside of the traditional institutional environment. 

What about the methodology used? This was stated to be a systematic review using content analysis (see here for a hands-on guide to content analysis). The authors would have benefited from using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) an evidence-based minimum set of items for reporting in systematic reviews and meta-analyses. For more information see here.

The inclusion and exclusion criteria were not explicit, studies were only eligible if they were indexed by the the Social Sciences Citation Index (SSCI). The SSCI is a multidisciplinary index and indexes over 3,000 social sciences journals – 1988 to present. It would have been helpful to have a PRISMA flow diagram and tables of included and excluded studies.

It is not clear what language restrictions, if any, were applied and whether studies were independently reviewed by authors, what the level of agreement there was or how any disagreements were resolved.

The 5 summary tables of findings, 4 of positive impacts based on the four themes identified and one of challenges were helpful to the reader.

The final section on gamification did not appear to be based on the included studies and appeared more personal opinions of the authors and based on the work of ‘a professor’ at the same university of most of the authors which may have been one of the authors of this paper.

Our conclusions are – that this evidence has a high risk of bias.

Implications for our practice

Covid-19 may become a catalyst for educational institutions worldwide to search for innovative solutions to the closure of campuses in a relatively short period of time.

It appears that those students who benefit from flipped classroom approaches are those with high self efficacy and motivation. Rather than offering a blanket change in practice could we do more to evaluate students self efficacy, motivation, learning styles, digital literacy and access to technology and connectivity. This would help targeting interventions to those who need support.

It is our anecdotal experience that gamification often appeals more to a younger cohort of students, this may be due to the format and content. Furthermore, cultural and language context should be taken into consideration.

It may be a cultural issue that many students are expecting to be talked at rather than taking responsibility for their own learning. This is reflected in evening class students who in general appear more motivated to undertake activity outside of the classroom.

There is a widespread assumption that all students are able to access and engage with online material. This is not the case. Many students do not have access to wifi, have poor broadband width and general connectivity issues, lack of suitable mobile technology, skills required to use them and some have language barriers.

Next steps

  • Convene a virtual group, MS Teams, of staff who have experience or wish to gain experience of using flipped classrooms. This will allow us to pool expertise and resources. This will also identify any staff development needs and develop a strategy to fulfil any needs.
  • Look at adding material as part of new staff integration process.
  • Finding new ways to develop students’ self-efficacy and motivation
  • Consider introducing a ‘learning log’ for all staff to capture innovative practice, challenges and issues during this period of College closure.

View from

What do you think?

References

Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, et al. (2009) The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration.PLoS Medicine (OPEN ACCESS)  PLoS Med 6(7): e1000100. doi:10.1371/journal.pmed.1000100

Zamzami Zainuddin, Hussein Haruna, Xiuhan Li, Yin Zhang, Samuel Kai Wah Chu, (2019) “A systematic review of flipped classroom empirical evidence from different fields: what are the gaps and future trends?“, On the Horizon , https://doi.org/10.1108/OTH-09-2018-0027

Keywords:

Our Blog Posts are written by staff at City of Glasgow College to inform and inspire our practice. We meet together at the Journal Club to consider the latest evidence to provide insights on hot topics related to learning and teaching, quality assurance and subject needs. It forms part of our activity for General Teaching Council Scotland registration and Professional Standards for lecturers in Scotland’s Colleges demonstrating that we are a self-critical staff community.

Categories
Digital technologies to enhance learning and teaching and assessment. review Student engagement in learning Student experience

What the Kahoot!

Blog Authors: Tracey Howe

Our College is considering running a webinar on how to use Kahoot! a game-based student response system (GSRS) where the classroom is temporarily transformed into a game show where the teacher is the game show host, and the students are the contenders. We were pleased to find this paper published in 2020 ‘The effect of using Kahoot! for learning – A literature review’ the objective of which was to investigate studies on the effects of using Kahoot! for learning. Specifically,
how Kahoot! affects learning performance, classroom dynamics, student anxiety, and the perceptions of students and teachers.

Here’s what they did

The purpose was of this study was to investigate the effect of using Kahoot! in learning from the point of view of a researcher in the context of students and teachers in education. They used the Goal, Question, Metrics (GQM) approach. They searched 5 electronic databases using the search string was “Kahoot”. 

They included 93 studies. Appraisal of studies for inclusion was carried out independently by 2 authors and was on relevance (only articles classified as an experiment, survey case study or similar with focus on Kahoot!), rigor (appropriate research approach described including research context, number of subjects, scope, design, methods, and execution), and credibility (conclusions based on sound analysis and reasoning). Studies were classified according to their type and by nine attributes and a narrative review was reported.

Here’s what they found

  • Effect on learning positive compared to traditional learning and other learning tools and approaches and for various contexts and domains
  • Classroom dynamics – improved teacher-student interaction and student-student interaction, more favourable to actively participate in class, improved classroom atmosphere, and easier to answer questions in class.
  • Student anxiety was reduced related to asking questions, reduce stress and tension, encourages participation without being judged, add humour to class, and enables shy students to get involved.
  • Students have a very positive perception including a positive effect on motivation, engagement, concentration, perceived learning, attention, enjoyment, satisfaction, and confidence. Main challenges – technical challenges, hard to read questions and answers on a projected screen, time pressure, afraid of losing, and hard to catch up if an incorrect answer had been given.
  • Teachers were positive about using Kahoot! for teaching. Positive – higher motivation of teachers, ease of use, a motivating tool, support teachers’ instructive work in class, can assess students’ knowledge in real-time, increases student motivation, stimulate students to speak their point of view in class, can wake up students, increase class participation, and reduce teacher’s workload. Main challenges – technical issues and challenges, get the questions and answers right and scoring based on timing.

The author/s concluded

Kahoot! has a positive effect on learning, but there are challenges and room for improvement.

Our Journal Club’s views

Who are the authors of the paper and where do they work? Both authors were based in the Dept. of Computer Science, Norwegian University of Science and Technology. It appears that one of the authors was funded by Fulbright Scholarship to visit Institute for Software Research (ISR) at University of California, Irvine where the work took place.  

What do we know about the journal? Computers & Education is an international peer reviewed journal that aims to increase knowledge and understanding of ways in which digital technology can enhance education, through the publication of high-quality research, which extends theory and practice. Impact Factor: 5.627

What about the methodology used?

They authors only considered papers in English and those available through their institutional subscription. Appraisal of studies did not include quality assessment, the synthesis was narrative, and the analysis was thematic. The authors stated that they biased selection of articles in that only positive studies were accepted! 97% present mainly positive results related to Kahoot! and 8% include challenges and problems. The results from all the accepted studies were summarized according to the five research questions and the kind of results reported.

Our conclusions are – that this evidence has a high risk of bias.

Implications for our practice

Many of our staff use Kahoot! Workshops to introducing using it within VLE. Way to replace expensive clicker system. Introduced in interactive way in classroom but now we find ourselves in distance learning. Kahoot is just one of many tools that staff can use to bring interactivity into their teaching. There are a range of tools that staff can deploy.

These tools feature in teachmeets and should feature in future learning and teaching conference.

Next steps

  • Introductory workshops and how to guides [REF]
  • This paper will be used as background material
  • Experiment with STEM girls lightening zoom meets. Enable development of Kahoot by group

View from

What do you think?

Kahoot is excellent but like many innovations need to be adopted in a planned way. Students will experience Kahoot fatigue if it appears in every learning episode.

References

Keywords: Kahoot!, teaching, learning, classroom dynamics, student anxiety, review

Our Blog Posts are written by staff at City of Glasgow College to inform and inspire our practice. We meet together at the Journal Club to consider the latest evidence to provide insights on hot topics related to learning and teaching, quality assurance and subject needs. It forms part of our activity for General Teaching Council Scotland registration and Professional Standards for lecturers in Scotland’s Colleges demonstrating that we are a self-critical staff community.

Categories
Assessment and feedback Delivery and assessment of the curriculum Digital technologies to enhance learning and teaching and assessment. review Student engagement in learning Technology and digital literacies

Student-generated video creation for assessment?

Blog Authors: Fiona Balloch, Jan Robertson, John McVeigh, Robertson, Lisa Shields, Joe Wilson, Tracey Howe

Image: Photo by Hermes Rivera on Unsplash

Student-generated video creation assessments are an innovative and emerging form of assessment in higher education. Academic staff may be reluctant to transform assessment practices without robust evidence of the benefits and rationale for doing so and some guidance regarding how to do so successfully. JISC have recently published Future of assessment: five principles, five targets for 2025 which states ‘In a move away from the traditional essay or exam, assessments are building in authenticity by asking students to develop websites, set up online profiles, shoot and edit videos, and use social media.’

We explored the idea, with reference to the article Student-generated video creation for assessment: can it transform assessment within Higher Education? published in the International Journal of Transformative Research, 2018.

Here’s what they did

They searched literature and conducted a thematic analysis related to the use of student-generated video for assessment.

Here’s what they found

For successful use of video creation for assessment:

  • Align video creation task set to both learning outcomes and skills development required for graduate capabilities for relevant industry
  • Ensure technological support, resources and infrastructure are all in place
  • Have an intentional change management process to support both staff and students in the transition to a new assessment format.
  • Involve students in the generation of clear guidance for the assessment and development of an assessment rubric.

The author/s concluded

Video assessment is beneficial for students’ digital communication skills and an effective and enjoyable method of assessment.

Our Journal Club’s views

Who are the authors of the paper and where do they work? At the time of publication the authors are Ruth Hawley and Cate Allen, who work at University of Derby.  Our view is that the authors may be biased in favour of video assessment, in order to provide evidence to support an initiative taking place within their own institution.

What do we know about the journal? The fully refereed Journal of International Journal of Transformative Research does not seem to be live yet and will be issued for the first time in Fall 2020. Our view is that the journal does not meet its stated aims, as it says that articles should explore transformative impact but this is not the case in this article.

What about the methodology used? Research could not be easily replicated based on the level of detail provided in the paper. In addition, the findings lack critical analysis. that this evidence is inconclusive and biased. It lacks a rationale for the use of video assessment or guidance on how it can be used effectively.

Our conclusions are – that this evidence has a high risk of bias.

Implications for our practice

  • How can Nautical courses extend their use of asynchronous video assessment with international students?
  • How could the COGC Health suite integrate video assessment into assessments?
  • How could issues such as trolling, and confidence with one’s own image on video be addressed through digital communication skills training?
  • How could YouTube and Flipgrid be used for assessment?
  • How issues such as trolling, and confidence with one’s own image on video could be addressed through digital communication skills training. It is easier for assessors to view videos asynchronously at the time of the assessor’s choosing, than assessing a large run of live events, one after the other.
  • Training and support is available through the College Learning and Teaching Academy

Next steps

Create a working group to pursue this topic in the College with a view to group-creation of a paper on this area.

View from

What do you think?

References

Keywords: assessment, video, student-generated, Higher Education, digital, technology

Our Blog Posts are written by staff at City of Glasgow College to inform and inspire our practice. We meet together at the Journal Club to consider the latest evidence to provide insights on hot topics related to learning and teaching, quality assurance and subject needs. It forms part of our activity for General Teaching Council Scotland registration and Professional Standards for lecturers in Scotland’s Colleges demonstrating that we are a self-critical staff community.

Categories
Quality assurance review

What is quality assurance and why do we need it?

Blog Authors: Tony Adams, Fiona Balloch, Lynn Brown, Tom Duff, Tracey Howe, John McVeigh, Joe Mulholland, Penny Robertson, Lisa Shields, Derek Timpany, Joe Wilson.

There have been a number of recent conversations across our College about Quality Assurance (QA). What is it? Why do we need it? To help us consider these questions and aid our conversations going forward we took a look at the literature.  

In 2015 Tricia Ryan from the Laureate International Universities network published a review of the literature of quality assurance in higher education in Higher Learning Research Communications an open access journal. 

Here’s what they did. The author reviewed a series of papers relating to quality assurance in global higher education. It provides an overview of accreditation as a mechanism to ensure quality in higher education, examines models of Quality Assurance, and explores the concept of quality (including definitions of quality and quality assurance).  In addition, this paper provides a review of research on the effectiveness of quality assurance practices, with a particular focus on student involvement with quality assurance. 

Here’s what they found

  • there is no agreement as to a QA definition or a QA model. 
  • accreditation structures are decentralized and complex at both the regional and international level. 
  • concerns of faculty members and other stakeholders, such as students, about the QA process 

The author/s concluded

  • There is a need for a common framework for a quality assurance model; however, there is no agreement as to a QA definition or a QA model.  
  • Given that students are at the centre of higher education, and invest time and money in the system, involving them could improve QA processes 

Our Journal Club’s views

Who are the authors of the paper and where do they work? At the time of publication Tricia Ryan worked, Director, Quality and Performance Improvement, Academic Quality and Accreditation, The Laureate International Universities network. This network comprises over 25 higher education institutions and more than 875,000 students, primarily focused in Latin America. Our view is that this author has validity. 

What do we know about the journal? The Journal Higher Learning Research Communications is a peer reviewed journal founded in 2011 by four Laureate International Universities® network institutions: Istanbul Bilgi University (Turkey), Universidad Andrés Bello (Chile), Universidad Europea de Madrid (Spain), and Walden University (USA). It is an open access journalOur view is that this is a reputable journal. 

What about the methodology used? This is a narrative literature review. The aim of the review is stated as “to examine the literature surrounding quality assurance in global higher education. However, the author does not state any specific question/s. There are no details on why or how the included papers were selected. Nor are there any details on whether any quality appraisal of each paper was undertaken. There is only one author and so only one opinion. Although the aim was to consider global higher education the majority of papers focus on the US. All included papers included appeared to be in English Language. The included papers are however relatively recent compared to the publication date. 

Our conclusions are – that this evidence has a potential high risk of bias.

Implications for our practice

Do we have a shared vision for quality and if so, what is it?  Quality is quite a nebulous concept, one that almost defies analysis and definition. One instinctively knows or feels if one has experienced a quality product or service but putting the finger on what exactly made that an experience of quality can be difficult to evaluate….do we need to? 

Within education there are different stakeholders who wish to see that quality is attained. From a macro level, one could view this from society itself, as within educational institutions the student is exposed to the values, mores and norms of that particular nation state, so this would by default be a component of the quality of the education.  The providers of that education wish to deliver a service of quality, both in terms of the process and of course the outcome, in terms of results. This is likely to be determined and influenced by an external body and financial sanctions, with the expectation and demand of ever-increasing numbers of students successfully achieving, and at higher levels. This expectation in turn could negatively impact of the overall quality of the service provided, the value of the qualification obtained and the reputation of the awarding institution. At the ‘coal face’, teachers or lecturers teach for many reasons, but one would suggest that they all wish to be ‘good’ teachers, inspirational and motivating, not only from their own perspective but most certainly in their students’ eyes, so will strive to provide ’quality’ teaching…. but how is this defined? 

Ultimately, it could be suggested that is in the student, the person being taught who can determine the quality of the teaching and the educational experience as a whole. We can all think of exceptional teachers in our lives and can recognise quality teaching…so it may be, that this group is the one who trumps the others in terms of determining quality…and perhaps this is where we should go in order to try to establish a working definition of the concept.  It may be that what is uncovered by such an approach will differ or reflect the concept of quality education from the other relevant stakeholders. Perhaps asking the students might help to establish a baseline to define what is high quality teaching and education…. if we feel the need to capture its essence. 

What internal mechanisms do we have in place for Quality Assurance? This includes but is not limited to;  

  • In course questionnaires such as student satisfaction, learning and teaching questionnaire 
  • Students representation – Board of Management, faculty boards, CIAMS, academic board and student academic experience committee, student services committee, learning and teaching committee 
  • Guidance sessions  
  • Myvoice.  

We think in terms of the paper City of Glasgow College are probably ahead of HE globally, however, the paper was potential for high bias and was published in 2015. 

What external mechanisms do we have in place for Quality Assurance?  We have SQA External Verification, Education Scotland, University partners, Professional bodies who; 

  • Talk to staff and students 
  • Verify assessments 
  • Award qualifications 

In terms of the material discussed in the paper we are perhaps ahead of international model.   

Our challenge is the feedback loop – do we take action on what learners say and what we are analysing the projects. We have different models in College dependent on the mode of student. 

Other topics We them moved into wider ranging conversation about what constitutes quality of learner experience and how we add value and attract learners in an increasingly competitive market place.  How should we react to Amazon Colleges etc and new competition?  What gives us a good reputation? is it quality, how do we define this?  How do we add value? 

  • Education is a social experience, how can we engage learners in fundraising, social responsibility, social learning, broader experiences  
  • Education is not just about getting a certificate  
  • Why did you choose us … we need to do more …where is blended learning and flexible offers.  

How do we quality assure online and blended learning? This was thought to be important and something we will consider at our next meeting. 

Next steps

We agreed that as a group we would draft a paper on College quality systems

View from

City of Glasgow College’s Quality Management Systems   

Information relating to quality can be found on Connected on the Quality Management Systems section. Other information includes; 

References

Keywords: Quality, assurance, verification, education 

What do you think?

Our Blog Posts are written by staff at City of Glasgow College to inform and inspire our practice. We meet together at the Journal Club to consider the latest evidence to provide insights on hot topics related to learning and teaching, quality assurance and subject needs. It forms part of our activity for General Teaching Council Scotland registration and Professional Standards for lecturers in Scotland’s Colleges demonstrating that we are a self-critical staff community.

css.php