Jun 25, 2009




School: St Francis de Sales School

Year Level: Middle Syndicate


Teachers: Jacinta, Nik, Marilyn, Lisa






Focus area: Managaing Self in Literacy (Writing)

Research Questions:

Question 1. Implementation: Are students' learning outcomes in writing enhanced through using a rubric?

Question 2. Engagement: Do students use the rubric to assist their learning?


Question 3. Competency: Did the students use the rubrics effectively to increase their learning outcomes?

Success Criteria for Competency

Expert:

8. Proficient: Be aware of their own strengths and weaknesses when using a rubric, self reflect on this knowledge and use it to improve their own learning outcomes by setting their own goals andexpressing to others how this was determined and transferring skills to help others.

7. Beginning: Be aware of their own strengths and weaknesses when using a rubric, self reflect on this knowledge and use it to improve their own learning outcomes by setting their own goals.

Practitioner:

6. Proficient: Demonstrate the knowledge and the ability to use a rubric as a self assessment tool and to identify their next learning step.

5. Beginning: Is able to tell others of their positioning on the rubric identifying features to self assess against.

Apprentice:

4. Proficient: Has the knowledge and the ability to use the rubric as a self assessment tool and can identify their next step.

3. Beginning: Able to use rubric and can identify their next learning step.

Novice:

2. Proficient: Knows the rubric represents their level of skill and knowledge in writing and is used to set their next step in learning goals.

1. Beginning: Knows what the rubric is and attempts to use it to reflect on their goals.

Learning Story:

We got together and decided that the area of focus which we wanted to explore was the effect of using rubrics in literacy (writing).

We had previously written the asTTle assessment criteria (for descriptive writing) into rubrics to link with our self-regulated/self-management goal. Our intention was to use the rubrics with the students so that together we could identify where they were meeting literacy functions in writing and what area they needed to focus on. We conferenced with the students to identify their next learning step and shared this in three-way conferences. Through these conferences, we recognised that the rubric (information transferred from asTTle rubrics) were in 'teacher language' and therefore, the students had no control (lanugague barriers).

For our action research, we decided that it was necessary to further develop the rubrics based on these learning steps to make them more child-friendly.




Steps to Implementation:

1. Mid Syndicate Teachers refined existing rubric into ‘child-friendly’ language. This was a very difficult and lengthy process as teachers working at Level 2 needed to juggle between NZ Curriculum Writing Exemplars at Level 1iii and align to asTTle Level 2. There was also the difficulty of simplifying technical terms into 'child speak'.

2. Students' writing samples were gathered using a test topic created on asTTle with the focus being on 'description', (gathered wk 9 Term 2 so that we had data to became conferences straight back into the term).

3. Wk 1, Term 3 - Shared rubric with students using the suggested strategies we developed together:

□ Model by deconstructing exemplar against the rubric
□ Buddy read, deconstruct rubric together, come back with questions
□ Question students as to how they could use this rubric, where and when could it help with their learning etc.

3. Process of Implementation:

a. Using term 1 writing sample - revisit goal from Term 1

b. Students were given back writing sample – asked to self-assess against rubric

c. Teachers conferenced with individual children to analyse writing sample identifying positioning on rubric. This lead to co-construction of new goal by assessing writing sample together.

d. Every child has a copy of their own goal to readily access and implement.







In Reflection: Positives, Minuses, and Suggestions after Implementation:

Working with the Rubric:

Positives:

1. Students can see areas of ability/strengths/weaknesses

2. Tool for motivation

3. Most can identify next step easily

Negatives:

1. Some langauge barriers still/ambiguous areas

2. Time factor involved (3 weeks of guided writing instructional time dedicated to conferencing)

3. Steps between levels were unclear in some areas

4. Doesn't allow instructional writing to be taught - unable to feed-forward, feed-back

Suggestions:

1. Revisit some areas

2. Concentrate/focus on one writing function

3. Feedback on specific goal only


Conferencing with student:

Positivies:

1. Valuable 1:1 time

2. Able to identify child's abilities, informed to find next step

3. Creates class discussion = all students are involved

Minus:

1. Time factor involved

Suggestions:

1. Working together in groups with students who have the same goal and asking them to self/peer assess

Reporting: (writing up feedback)

Positives:
1. Many falling in same area - ability to transpose comments

2. Written feedback valuable to students and parents informed

Minus:
1. Time consuming
2. Editing - who??

Suggestions:

1. offer opportunity for parents to comment

2. Rubric to be sent home also, then child could share learning pathways with parents (all informed of criteria)

3. Release time should be given for added work-load

4. Standard formatting form should be developed to be used school wide (standardised)


INDIVIDUAL CLASS FEEDBACK:


Room 2:

In our Year 5/6 class, the students overall comments were positive.

Positives: (high rating overall)

'I learn faster and I like it" Yr 5 student

'Helps me to have a writing goal and shows me where I'm on the scale' Yr 6 student

'To make us better and to understand where we have to learn and achieve" Yr 6 student

"It helps us to see where you need to achieve and what we are good at" Yr 5 student

Minus: (4 comments in total)

'It goes too fast and is complicating sometimes" Yr 5 student

"So much information about what we need to work on" Yr 5 student

Suggestions:

"We could do it with someone with the same score"

"Could compare it with people and get some tips or learn how or what you can do"





















Rm 3: Overall, there was a general feeling that students understood the purpose of using the rubric and still needed more guidance as to how to use it for managing their learning pathway.

Comments

"I found it cool. I never knew what I had to learn but now I have something that can direct me."

"I know now that I have different areas to work on."

"I can still see that I have areas to improve."

"I can see what I have to work on."

"I think it good. I can see what I need to include in my writing."

Room 1:
At first the students were nervous about using the rubrics to identify the strengths and weaknesses within their writing. Once it was explained to them most were able to use the rubric successfully, but some needed support to understand the format and the language used. It was used to identify the student's next learning step for their writing.

Comments.

"It allowed me to see what I could do (success criteria)."

"I showed me what to do next."

"I needed help to understand what it was."


Room 4

Some students said that they enjoyed highlighting where they were up to on the writing Rubric and others found this challenging. The students could clearly see their next learning steps in writing but commented that there were so many. Some were overcome with the amount of language that they had to process in order to complete the Rubric task. All students managed to self-assess using the Rubric either independently or with support. The students need to have easy access to these Rubrics and interaction with these regularly to become more familar with the process.

Outcome 1. Room 2 Engagement only: Do students use the rubric? (see above comments)

Room 2: SCALE: 1 = never, 2 = not very often, 3 = about half the time, 4 = often, 5 = always

Mean level of engagement of students ... Offered ideas - [3.0]
Asked questions - [3.2]
Listened to and thought about other's ideas and responded respectfully - [4.3]
Used positive body language related to task - [4.2]
Persevered in order to enact related task - [4.1]
Showed evidence of being active learners outside school time - [3.5]
Showed interest in directing their own learning - [3.0]
Had behavioural issues that impacted on their learning - [1.3]
Showed evidence of using what they have learnt - [3.8]

Overall mean level of engagement of students = [3.8]

Outcome 2. Knowledge:
Number of students who were ..
8. Proficient experts - at start [#]; at end [#]
7. Beginning experts - at start [#]; at end [#]
6. Proficient practitioners - at start [#]; at end [#]
5. Beginning practitioners - at start [#]; at end [#]
4. Proficient apprentices - at start [#]; at end [#]
3. Beginning apprentices - at start [#]; at end [#]
2. Proficient novices - at start [#]; at end [#]
1. Beginning novices - at start [#]; at end [

Knowledge effect size =

Standard error =

Outcome 3. Competency: Did the students use the rubric effectively to increase their learning outcomes?
Number of students who were:
8. Proficient experts - at start [0]; at end [0]
7. Beginning experts - at start [0]; at end [0]
6. Proficient practitioners - at start [0]; at end [0]
5. Beginning practitioners - at start [0]; at end [2]
4. Proficient apprentices - at start [0]; at end [3]
3. Beginning apprentices - at start [0]; at end [16]
2. Proficient novices - at start [0]; at end [9]
1. Beginning novices - at start [31]; at end [0]



Competency effect size = 1.24

Standard error = 0.09

Conclusions:
Much of our conclusions can be drawn from the reflective comments above. We have come to the conclusion that the rubric is an essential tool which we will embed into our teaching and learning practice.

Without the rubric, students do not have personal access to their learning path. There are far more advantages to learning than disadvantages (as evident in data gathered).

Next Steps: we will implement our writing rubric into every text form explored - which means writing each asTTle text form rubric into child speak to provide our students with an essential tool for identifying their next steps leading to managing self in learning.







[outline conclusions to be drawn from the research here]

Jun 3, 2009

School:St Francis de Sales
Year Level: 7/8
Teacher: Louise & Denise
Focus area: Managing Self
Research Questions
Question 1. Implementation: How do you implement a senior webquest?
(A webquest is a research tool which has relevant links to safe sites to assist children in their search for information.)
Question 2. Engagement: Does a webquest provide all students with motivation to focus on their inquiry.
Question 3. Knowledge: To develop an understanding of the impact NZ natural disasters have had on people, communities and landscapes.
Success Criteria for Knowledge
Expert: Can independently use their knowledge to plan, create and generate a new learning experience .

Practitioner: Is aware of a range of NZ Disasters and
uses this knowledge in another context .


Apprentice: Can explain to others the effect a disaster has had on people, communities or landscapes.
Novice: Retrieves and reports information orally
Question 4. Competency: To be able to navigate a webquest effectively in order to interpret and present research results
Success Criteria for Competency
Expert:
Can independently create and explain their own webquest
Practitioner:
Uses knowledge of webquest navigating in another context
Apprentice: With support can complete a webquest task
Novice: Select relevant links for research

Learning Story:










Implementation:
We were interested in exploring options that would promote further learning for our senior students when using class sets of laptops, ICT and on line search engines.We decided to design a web quest that which would challenge the way our students usually researched i.e. not to rely on one site such as 'Wikipedia' or on one search engine such as 'Google.’ We were hoping that it would not only provide them with the most informative and direct links to a site but would give them the opportunity to contribute and understand what a web quest was.











Web quest Design:
Our web quest was designed using previous experience. We also sourced materials from the National Library, Christchurch City Libraries and Civil Defence New Zealand. It was important to us that our students had ownership of this web quest so we designed it in such a way that our students could participate and contribute to its effectiveness by adding their own success criteria and choosing their next learning step.

Teaching and Learning:
Children assessed themselves against a knowledge and competency rubric before beginning the web quest. They were then exposed to a variety of texts, video clips and speakers about NZ disasters to provide them with some base knowledge of NZ disasters. This gave them the ability to understand the impact that disasters have on communities and environments.








We then introduced the actual web quest learning and research tool which had been designed using power point. Teachers modelled to students how to navigate their way through the web quest by demonstrating some of the direct links. Other links were left unexplored which gave the students the opportunity to discover what they held without teacher modelling.









The students contributed their own thoughts on what they felt successful measures would be as a final result of their research, investigation and presentation and developed their own success criteria. This success criteria was integrated into the actual web quest design and students were made aware of how important it was to refer back to this during their research. Next, students were given the opportunity to explore and discuss the web quest before beginning their actual disaster inquiry.











Children developed their disaster reports using the links provided in the web quest and any additional resources they located themselves. These were presented to parents and the school community at the conclusion of the investigation.














Students then assessed themselves against the success criteria they had developed in the web quest. This assessment included self, peer, group and teacher feedback. Everyone was required to give specific feedback according to this success criteria and then students reflected on the feedback they had received.

We took this a step further and encouraged students to discuss with a buddy an area that they wanted to improve in their competency when working with a web quest and an area they would like to focus on when writing a report. Together they recorded how they thought they might achieve this.








Finally, students were given time to reflect on their feedback and re assess themselves against their own rubric.









Student Reflection:
We gave all students the opportunity to reflect on the pros and cons of their experiences when using a web quest. We were pleased with the feedback from our students and felt they had enjoyed this learning experience.
· “All the information is ready for you to stop you from using irrelevant info. Good visuals! Didn’t have to spend days researching.”
· “Some of the websites had all of NZ’s disasters and it was faster and easier to source information.”
· “It helped me to see what I had to do for my project.”
· “It helped because it had sites that I could use that gave really good information quicker, faster and had success criteria that we could follow.”

Student engagement:
We found the use of a web quest beneficial and highly motivational for all students. This was reflected not only in the student comments (see above), but in the positive body language that was evident throughout the investigative activity.

We felt there were very high levels of enthusiasm, interest and engagement. It is also clear that knowledge and competency increased considerably as a direct of the students’ engagement with the web quest.


Data Analyses:


Results:
Outcome 1. Engagement:
SCALE: 1 = never, 2 = not very often, 3 = about half the time, 4 = often, 5 = always
Mean level of engagement of students ...
Class One
Offered ideas - 3.4
Asked questions - 2.6
Listened to and thought about other's ideas and responded respectfully - 4.0
Used positive body language related to task - 4.8
Persevered in order to enact related task - 4.1
Showed evidence of being active learners outside school time -
Showed interest in directing their own learning - 3.3
Had behavioural issues that impacted on their learning - 1.4
Showed evidence of using what they have learnt - 4.

Overall mean level of engagement of students = 3.8


Class two

Offered ideas - 3.3
Asked questions - 3.3
Listened to and thought about other's ideas and responded respectfully - 3.1
Used positive body language related to task - 3.1
Persevered in order to enact related task - 4.0
Showed evidence of being active learners outside school time - 3.6
Showed interest in directing their own learning - 3.9
Had behavioural issues that impacted on their learning - 1.8
Showed evidence of using what they have learnt - 3.1

Overall mean level of engagement of students = 3.5

Outcome 2. Knowledge: N/A
Outcome 3. Competency:

Number of students who were ...
Class One:
8. Proficient experts - at start 0; at end 0
7. Beginning experts - at start 0; at end 0
6. Proficient practitioners - at start 0; at end 2
5. Beginning practitioners - at start 0; at end 21
4. Proficient apprentices - at start 0
; at end 4
3. Beginning apprentices - at start 0; at end 1
2. Proficient novices - at start 1; at end 0
1. Beginning novices - at start 27; at end 0


Competency effect size = 1.85
Standard error = 0.09

Class Two:

8. Proficient experts - at start 0; at end 0
7. Beginning experts - at start 0; at end 1
6. Proficient practitioners - at start 0; at end 9
5. Beginning practitioners - at start 0; at end 17
4. Proficient apprentices - at start 0; at end 2
3. Beginning apprentices - at start 3; at end 1
2. Proficient novices - at start 27; at end 0
1. Beginning novices - at start 0; at end 0

Competency effect size = 1.57
Standard error = 0.07
Conclusions:
Our webquest proved to be a very effective learning tool for year 7 & 8 students. It is clear through the data that the competency of the students increased and engagement was high throughout the webquest. As a different way of challenging and motivating senior students we would definitely recommend giving this a go!


[outline conclusions to be drawn from the research here]