Let's assess a MOOC!

Make a MOOC is an innovated process that can be very exciting and fun. But we need to make it in a way that it becomes gratifying, motivating and rewarding.


Previous thoughts: What are we evaluating and why?
There are currently a multitude of initiatives in response to the revolution that MOOC suppose. Networks, collaborative projects, all kinds of initiatives, global platforms, regional, national debate ... and much more debate about the impact of MOOC will be done in the future of education.

The course # 23keysmooc just tried give some clues of how professors or teaching teams can build a MOOC, without going into its institutional fit. Each university has its own e-learning policy of MOOCs, platforms, recognition of the work that must be expended there, issues that can be offered by budget ... Obviously the overall assessment of a given MOOC will consider this different contexts.


Another thing that is being discussed now is the accreditation of the MOOC. There is no established rule, and if you get to establish a system of academic recognition, a comission to account for a global certificate authority to allow an institution accepting credits for MOOCs offered by another. This can be use to build degrees / masters / joint studies between universities, etc.


Beyond the accreditation what it is important is the assurance of quality. Which will be the role of the quality agencies such as the Catalan Agency? If a university has no positive evaluations for its teaching, do it can offer a MOOCs? And what happens with respect to blended learning?

Even more: does it represents the end of the monopoly of the certification by the universities? Are MOOC specific form of the Bologna Process? And what do we do with informal education, the education throughout life and the acquisition of transversal competences?


Student assessment
Beyond assessing the own course, we need to evaluate the participants. Some MOOC takes into account presencial exams (UNED, for example). How can we verify that a student has actually achieved the skills? Really it could only being certificate the achievement of profitable course if you pay? (the model that seems to be implemented now)


Let's assess our course!

To evaluate we must first know what we want to assess. So ...

  • A starting survey can be performed, to make an analysis different items as origin, studies, etc...
  • Let's take a poll at the end of the course about satisfaction, difficulties, etc.The objective is to know the strengths and weaknesses from the point of view of participation, and ask for suggestions to improve.

The main objective is to analyze the progression of students: How many students have completed each module? How many have watched every video? How many have completed each task? What there has been a withdrawing and when? P2P tasks have been the cause of abandonment? has been assessment test a catalyst of progress a difficulty?

Before the course,we must have schedule and introduced some indicators: number of participants, percentage retention, etc.


On the other hand, one must assess whether the effort expended was really what we predicted by both students and teachers as well as staff support.-

- Has been the number of hours of student by top or below that indicated on the course offered ?
- Has the dedication of professsor / coordinator / support team for peak or below what was proposed?
- How was the dynamic of the course? Has many participants participate in the forum?
- How many technical difficulties there have been?
- How many conceptual difficulties have appeared that it was necessary to clarify?
- Was it possible to perform network activities (google hangouts, streaming debates, doubts sessions etc.)?

And finally and very important for this course:

If you set up a MOOC course and wanted to enjoy it and that it was exciting ...


- Have you enjoyed the course?
- Have you learned from it?
- Have you created network of contacts with students and other people who have wanted to get involved?
- Was it useful for improving your teaching with Moodle and / or your teaching more classic classroom?
- Have you improved your skills in recording and video editing?
- Have you taken more than an educational experience, for example expanding your network of collaborations in research?
- Have you increase your professional reputation, even as a positive impact in the face of accreditations, evaluations, promotions, etc.?
- Has it help to improve your personal communication skills, ICT 2.0, linguistic, etc.?
- Note that you are part of an unstoppable movement of the education system, which is now called MOOCs but one day it may be something else?

Many other questions can be asked, but iit will depen on the fact of how you design your MOOC. As an own initiative, plan on DIY (Do it Yourself) or have been surrounded by a team of technical and pedagogical support. Each case is certainly different.

We could make many more questions, but a summary:

With the delivery of MOOC, we felt gratified, motivated and had fun in a very broad sense?