What can/should/could PBL look like in our programme?

What can/should/could PBL look like in our programme?

by Anouk Janssens-Bevernage -
Number of replies: 10

Hi everyone,

As agreed, I'm starting a new thread on PBL.

Since January I have assisted a number of  KTC (Kiribati Teachers College) lecturers with incorporating more PBL elements in their courses. During the online learning design workshop which I ran with 30 lecturers in May, there was one task in which lectures needed to turn one of their learning activities into a PBL activity.

What does PBL look like in this context?

First I need to clarify that we don't use a strict definition of PBL and certainly don't make it as complex as university PBL. At university level PBL tends to be narrowly defined (e.g. the Maastricht Seven Step Procedure of (1) clarifying terms (2) defining the problem (3) brainstorming (4) structuring and hypothesis (5) learning objectives (6) searching for information (7) synthesis).

Instead, I use a much more pragmatic approach that I have been using in professional development in general (so not only teachers, but also nurses,  agricultural extension staff, child protection officers, and many more across the training programmes I support).

The focus is on keeping the problem and the problem-solving steps as close to real life as possible. If possible and appropriate (and in PBL for schools especially) we also include a 'compulsory' internet-based (small) research component to support digital literacy development (a little similar to a 'WebQuest')

By using a simplified PBL (as in 'simpler' than the complex academic PBL) we support the need for short/crisp 'real life' activities rather than rote learning.

This is really an initial explanation 'in a nutshell' - happy to elaborate over the next few days when I have the time.

Anouk

In reply to Anouk Janssens-Bevernage

Re: What can/should/could PBL look like in our programme?

by Prof. Robert McCormick -

That's very helpful Anouk.

So your focus is on the process of problem-solving? Would you expect to be able to recognise this approach in a classroom? For the baseline the challenge is when you walk into a classroom, how do you know it is taking place? Though we may be able to use training college staff to do the observation, we have to ensure that we can specify clearly enough what they should look for to reliably identify activity as PLB (among other things).

We can also carry out qualitative studies, but they wouldn't really fit with the baseline format and reporting requirements.

It would therefore be helpful if you could think of a few classroom practices (including student behaviour) you might expect to see if PBL is taking place.

Best wishes

Bob

In reply to Prof. Robert McCormick

Re: What can/should/could PBL look like in our programme?

by Prof. Muhammad Junaid -

Hello Prof,

I think one way an observer can determine if PBL is taking place in a lesson is when the learning activity engages pupils/students in a reflection on how what they are learning in class can be applied to solve real life situations, such as when a teacher relates lesson content to other subject areas, personal experiences and contexts; or uses a variety of questioning technique to encourage students' development of critical thinking, problem solving, or communication skills; or when students work collaboratively to share knowledge, complete project, or critique their work.

I think also that qualitative approaches can be used to triangulate the quantitative data obtained through lesson observation, if only to avoid the "Hawthorne effect" that might play out in teachers' classroom behaviours while under observation which may not be reflective of their typical performance. In this regard focus group discussions with small samples of student teachers and JSS students will help to ascertain the genuineness of the observation data and vice-versa.

In reply to Prof. Muhammad Junaid

Re: What can/should/could PBL look like in our programme?

by Anouk Janssens-Bevernage -

Hi Bob and team,

What is important in a practical/short PBL approach is to get down to simulated 'doing' (i.e. solving a problem) instead of 'talking about' as fast as possible. So instead of providing students with readings/resources upfront, they are presented with a real-life problem in which the learning outcomes are practiced/simulated.

The 'talking about' (i.e. reflecting) isn't eliminated, it's just being moved to a little later in the process (reflecting on how we solved that problem, why we choose to do it this way, and what that means in wider contexts or for other similar problems). This can be done collaboratively or individually (there are some great ways to set this up in order to avoid having to assess groups, which is always tricky - but that's for another post).

The resources/readings aren't eliminated either - they are provided (or selected by learners depending on context/time etc.) just-in-time when they are solving a problem.

Let me give an example out of one of the courses in the Kiribati programme, in which student teachers need to learn the Teachers’ Code of Ethics.

Initially the approach was to make students read the Code of Ethics and answer (quiz) questions. Instead the lecturers are now working on a series of mini PBL modules that include the most pertinent ethics challenges that teachers might encounter in class.

What does this look like?

Each problem is a story of a teacher (and other characters if needed – all given a local name to make it sound real) who is/are in the middle of an ethical dilemma. Some of the stories ask for student teachers to ‘step into the shoes’ of the fictional teacher, others mention that the teacher asks for advice to the principal and student teachers are asked to prepare the principal’s advice (an email for example), others involve some higher body (another piece of writing very similar to how this would be done in real life), as appropriate, etc.

While they are solving these ethical problems, they use the Code of Ethics. However, it’s a ‘pull’ model’ rather than a ‘push’ model, though – the resource is pulled into the learning process by the learner (because they feel/know they really need it), rather than pushed by the lecturer upfront (which is often the case in more passive teaching approaches).

In this particular course, this is all done collaboratively, because it’s important that students are aware that often ethical problems don’t present themselves clearly and other people’s perspectives are important to consider. One of the learning outcomes talks about the ‘spirit’ of the Code and that needs to be reflected in the learning process too i.e. in the problems.

So unlike the academic PBL, this approach is much less time consuming and much less focused on research and a fixed process. The focus is on continually bringing real life into the classroom, not just by ‘talking about’ stuff that happens out there (including the sometimes endless reflections and ‘sharing thoughts’), but ask students to make decisions (stepping into the shoes of a fictional professional who applies these skills).

As I said earlier, it is important to include digital literacy components in PBL – often as simple as ‘Can you find out how this is done in another country?’. No lengthy research requirements, just a basic ‘have a peek online’. This is about creating the habit of doing quick Google searches when we’re stuck.

Another powerful addition is inviting a professional from the community into PBL components. PBL is a much better framework to do this than guests just giving a ‘talk’.

I’ll stop here – this is just a quick overview and example of what PBL looks like in the Kiribati programme. Bob, I’ll attempt to answer your questions in a separate post.

Hope this helps,

Anouk

In reply to Anouk Janssens-Bevernage

Re: What can/should/could PBL look like in our programme?

by Anouk Janssens-Bevernage -

Hi again Bob and team,

This is a first attempt to suggest how we might recognize the use of PBL when we walk into a classroom – as per Bob’s post.

It might be easier to start by defining what is NOT PBL (or not sufficiently problem ‘focused’ to be considered PBL):

After a skill is learned or knowledge shared, the teacher engages students in a discussion/reflection activity where they talk about how this could be applied in real life or how this affects personal experiences.

This is not PBL. The mere mention/discussion of real life (even if the conversation is about problems) isn’t enough for a learning activity to be considered PBL.

Instead, the problem needs to be the back-bone of the learning activity; the problem is presented upfront; the problem carries whatever happens next (supported by different teaching/learning strategies).

It took a while for the lecturers in Kiribati to understand what is and what isn’t PBL. The most confusing are the activities that mention a problem, but the task isn’t quite there yet – often the decision-making parts, or the ‘stepping into the shoes of a real person’ parts are missing. Luckily it often takes just a (little) tweak to turn the activity into a PBL task.

It takes practice to recognize PBL and be able to turn a task around so that it can qualify as PBL. In the online workshop with the Kiribati group, all 30 lecturers needed to design at least one PBL task and share with their colleagues. I (and some of the lecturers who felt they ‘got’ it – which was very empowering) provided continuous detailed feedback along the lines of “The story is great, but it’s not quite PBL because […].  I suggest you add […] to the [task/story/instructions/deliverable] and then it would be PBL.”

Through this exposure to heaps of examples (over a period of one week), the lecturers shared lots of ‘AHA’ moments. This was very productive – way more productive than if I would have shared readings about PBL or ‘talked about’ PBL. In the spirit of PBL, we got there by ‘doing’ :)

The Kiribati programme is working towards a fully online programme, so we’re working at two levels – classroom and online teaching.

Although our PBL focus has been on the online components of the pre- and in-service programme, many lecturers are saying that they are taking these tasks to class as well. In one of the Zoom meetings we had during the workshop, someone mentioned that PBL – in whatever shape or form (online or classroom) – becomes a mindset once you get it and they believe that teaching teachers in this way will definitively trickle down to the schools. This is our intention, so it was great to hear it from the ‘converted’ :). It’s good to see that an increasing number of tasks in the KTC programme require student teachers to submit lesson plans with PBL learning activities.

Recognizing PBL online is easy, but trickier (or rather more time consuming) in class. This is what I look for:

  • The problem or series of mini problems is/are presented at the start of the lesson/session/module.
  • The problem(s) is/are the backbone of the lesson/session/module.
  • The problem is a simulation of real-life – fictional or not.
  • The problem story includes real sounding characters.
  • The students are required to step into the shoes of one of the characters and make decisions.
  • The deliverable (what students need to do/submit/present) is a simulation of real life (e.g. a budget, an email, a piece of advice, a plan, etc.).
  • Resources are provided (or guidance is provided on where/how to look for them) to help with the problem-solving process. They are not the focus.
  • The teacher plays an active ‘guide on the side’ role.

So this – in a nutshell – would be the things I would look out for in a classroom when deciding whether it’s PBL or not.

Now, when it comes to ‘is it done well?’, I would also look at

  • how the PBL task is being assessed (e.g. I’m not fond of group assessment in collaborative PBL tasks and there are plenty ways to avoid this),
  • the appropriateness (is PBL really the right approach to learn this?),
  • good use of time (PBL is more time consuming so it has to be worth it)
  • how does the teacher play the ‘guide on the side’ role (certainly not hands-off)

Not sure if this is helpful for the baseline at this stage and if so, how best to turn this into a practical checklist for the purpose of this programme. I would also love to hear from others how this compares to their approaches to PBL!

Anouk

In reply to Anouk Janssens-Bevernage

Re: What can/should/could PBL look like in our programme?

by Prof. Robert McCormick -

Hi Anouk

That moves us on quite a bit. I can see that some of your first list could find their way into an observation schedule, along with a short teacher interview. As a general framework, it will fit well with some qualitative studies. A lot will depend on whether these PBL activities can be done in a single lesson or over several lessons (and even outside the classroom). Also qualitative work will be needed to capture subject differences.

If there has been any trial of this kind of ideas in the classroom, some informal observations will help to see if something works (if there is time before the actual piloting of instruments). You may have a clear idea of how all this pans out in the classroom so when I draw up some kind of specification/draft instruments, you would be able to see how much it captures such lessons.

Best wishes

Bob

In reply to Prof. Robert McCormick

Re: What can/should/could PBL look like in our programme?

by Prof. Robert McCormick -

Dear all

I am still in the middle of formulating the framework for the RM&E for TFP and in particular the work to be done in the coming months in Kiribati and Sierra Leone. At the moment I’m thinking about classroom observation to understand teacher classroom practice. I have been reflecting on what Anouk said about PBL on the forum, what is in the SBTD toolkit, and in the Learner Centred Approaches (one of the Sierra Leone modules). I am trying to represent this in a data collection method that will use it in part to pick up some of the difficult elements in a systematic timed instantaneous sampled observation. That last sentence might be a bit foreign to some, but I have a short description of types of observations schedules for those who might want it (apologies to anyone who knows all this stuff) in the attached. Not all of the behaviours discussed in the three 'documents', are represented in the attached (the file 'Classroom observation for the Forum'), which highlights PBL (but is not exclusively about that). Your thoughts on this would be most welcome.

I will put up more (in another strand) when I see what kind of response the attached stimulates. If you want to suggest changes, feel free to mention in the forum the changes you see necessary and, either upload a tracked version of change on my attached file, or email it to me (robert.mccormick@open.ac.uk)

Have a good weekend

Best wishes

Bob

In reply to Prof. Robert McCormick

Re: What can/should/could PBL look like in our programme?

by Anouk Janssens-Bevernage -

Thanks Bob!

I have made a few comments/suggestions - see doc attached.

Kind regards,

Anouk

In reply to Anouk Janssens-Bevernage

Re: What can/should/could PBL look like in our programme?

by Prof. Robert McCormick -

Dear Anouk

Very helpful comments all of which I am in agreement with, and they help to sharpen the wording.

You raise a point about the fact that an observer may not see a PBL lesson. That is simply a sampling issue of lessons. For any teacher only one lesson will be observed, and it might be good, bad, or an unusual one. Whether the lesson is all reading or individual work, group activity or pair work, none of these are typical and may or may not be observed. The assumption is that over all the schools and teachers (which could be about 60 teachers and hence lessons), a range of teaching will be observed, and if PBL has been used, it will appear. The baseline will tell us if any is being done now, and we will hope to see more of it later at midline (then there is the question of quality you raised earlier; that's role for qualitative evaluation).

I look forward to other people's comments too.

By the way, in Kiribati, I have assumed 10 schools, but can't tell how many teachers and students will be involved as the proposal contains a list of all secondary schools (20) and teacher and student number s to match, but then in other places various numbers are given for teachers (who complete etc.). If you could give me some definitive school, teacher and student numbers, that would help me with sampling (of which the above is one element).

Best wishes

Bob

In reply to Prof. Robert McCormick

Re: What can/should/could PBL look like in our programme?

by Prof. Robert McCormick -

Dear all

As I said in my last note on Anouk's suggestions for changes, I was very happy with them and have made changes. However, in now making the changes she suggested I began to wonder about the changes of the one on problem solving. Below aremy changes in response:

  1. Linking problem solving to real life to help learning
    1. Are you aware of the role of solving real-life problems in helping students learn?
            (Scored as: 2 Very aware; 1 Somewhat aware; 0 Not aware)
    2. Do you feel able to transform some of your lesson materials into real-life problems?
            (Scored as: 2 Very able; 1 Somewhat able; 0 Not able)
    3. Can you give examples of learning activities which you turned into real-life problems for your       students to solve?
            (Scored as: 2 Yes practical account; 1 Somewhat - vague account; 0 No)

Although I can see that the 'b' and 'c' are more focused on what the teacher has to do (transforming/turning into), it does in fact change the flow of the questions and then the first option on awareness (a) is actually asking a different question. I cannot tell what difference this might make on teachers' interpretations. If we change the 'a' option to be about changing activities to PBL it will become in my view a narrower question.

I am also looking at some of the questions on a separate questionnaire to all or a large sample of all teachers in the TFP, and so have some further thoughts on this. But first it would be good to have all your thoughts on the above before I bombard you with this new set.

In addition Anouk suggested adding a question such as: 'The use of PBL is an appropriate teaching/learning approach for the learning outcomes/curriculum topic.' to the 'event' sampling section. However, my problem with this is that it requires a judgement on the appropriateness of the PBL approach, which is a quality issue, and one that I don't think is appropriately answered in this kind of systematic observation schedule (it requires a qualitative approach to classroom observation). Hence I didn't take that suggestion up. :-)

I attach my revisions so far from Anouk's helpful suggestions, and I also include the timed observation part of the schedule, which was omitted last time.

Best wishes

Bob

In reply to Prof. Robert McCormick

Re: What can/should/could PBL look like in our programme?

by Anouk Janssens-Bevernage -

Thanks Bob!

I totally understand the point about not adding my suggestion to the event sampling section.

About the PBL a/b/c questions...

I agree with your suggestion to narrow down the 'a'-question as well. Not sure if your comment means that you saw this is perhaps problematic?

I appreciate that this means that the PBL section would then in fact be more specific than the others, but I think it will provide us with more valuable data if we go that route. I find that there is a lot of confusion around PBL, much more than around other teaching methods. At the start of our workshop, a maths teacher in the Kiribati group said that her course was full of PBL and when I looked, I realised she referred to questions along the lines of 'Martha has two sweets; John has five..." (I'm simplifying here.) Well, she said, it's real life and it's a problem... (!) Then there is all the typical confusion between PBL and the discussion method/project work/ reflection etc. that might have a 'real life' reference with a 'problem' flavour. So it will help to ask specific questions to ensure we're looking at the right teaching/learning action. Otherwise our data won't be very meaningful.

What do others think?

Best wishes,

Anouk