Just to let everyone know, I have kept a reflective journal on just about everything that has happened from my perspective at North Side this year. This has been the most difficult, challenging, and, yet, most rewarding year of my teaching career. ECA scores are just now coming back. All of them are showing significant improvement. We are crossing our fingers and hoping that all of our efforts wlil get us the needed data to make AYP for the first time in 6 years. I know the teachers have really worked hard. I know the administration was really worked hard. Most importantly, I believe we squeezed as much effort as we possibly could out of the kids and did the best with what we had.
That is one huge step I believe as a foundation of success: you have to get those to succeed that you know ought to succeed and often times in the process you get miracles to happen here and there. From my perspective, I had seen data from the previous years’ in Honors English 10 and had observed that only 56% of THOSE classes, those HONORS clsases had passed the ECA. This year, 97% of them passed the ECA and those who had not, I knew they weren’t going to do so but I also knew that they had made significant gains and are knocking on the door.
But more importantly, I had a 6th and 7th period World Literature-History class with Mr. Khaliq that, at the beginning of the year, was frightening to me. The Acuity scores showed that at best 40% of those kids were in Tiers 3 and 4 (the two highest Tiers) and of those, only 3 out of 4 were in good shape to pass the ECA or were on a path to do so. In other words, only about 30% were where they should have been in reading and writing. But as the year wore on and the seriousness factor came in, as procedures were put into place, as data came in, as changes were made (to class rosters, teaching methods, partnerships, and projects), things changed. The kids changed. They woke up for the most part and matured before our very eyes. People who had no shot at the beginning of the year had significant shot going into the ECA. People had a shot, solidified there place. Those who were out of the race are not back into it.
Preliminary results show a 66% pass rate in those classes. Wow. I am so proud of those kids. It was difficult. Very difficult. And we may have come to a point where we can make AYP. Who knows?
But we did the best with what we had in all content areas. We stole out of Brockton’s playbook on so many levels and it worked and it will continue to work. I will post more as I have more time.
I am at the National Model Schools Conference in Tennessee right now and I am about to go into a session and learn some more.
Check out this blog:
http://greekhistlit2010-11.tumblr.com/
This is my blog that links to the works that the students did after they read Oedipus Rex, the Illiad, Sappho’s poetry, and sections out of the Glencoe World History book specific to Ancient Greece.
During the last week, I have been working exhausting hours doing a couple of things that I enjoy doing, at least most of the time: professional development and coaching football. I would like to reflect here on a couple of those things because they have really given me some guidance and insight into what I need to do to help more kids become more successful.
Reflections on FWCS LEAD TRAINING Days 1 through 4
Mullinax Training
Wyatt Mullinax, an expert in the field of psychology and behavior, did a training session for our group and really, I walked away feeling vindicated on many levels and also improved in my understanding of some areas in behavior which filled in some gaps and explained some other things which I had observed in students and others but had no foundational understanding of why these behaviors were taking place.
I would like to start reflecting on a process which I came to understand from the training session that I believe all educators ought to take to heart: beliefs control emotions; emotions impact thoughts; thoughts govern actions; then the process recurs. With this in mind, then, the way to impact people’s actions come from using the relational piece to change their beliefs. If a student believes they will fail a course, it surely will happen. If a teacher believes they cannot teach certain kids or will not be successful, it is certain to happen that way. Conversely, if the opposites are true about beliefs, so the outcomes will be as well. This leads to an interesting conclusion about the best teachers, coaches, and administrators out there: they do so because they can get people to believe in success which ultimately guides their actions towards success and outcomes that truly are successful.
Another key point from the presentation that I will take to heart is the idea that human beings need four basic things: resources, love, physiological needs, and the need to be somebody. From rich to poor, low to high I.Q., people strive and live to attain these things. Given this, people who are pro-social gain these things legitimately through hard work and do so while not impeding or hurting the rights and feelings of others. In contrast, those who can be labeled as anti-social tend to strive for the same things but they do so while taking “illegitimate shortcuts” to gain those things without regard to the rights and feelings of others. This is where school has a moral imperative to be promotive to socialize and teach kids how to attain those four things above without taking the illegitimate shortcuts to do so (Jamers Comers and Joyce Epstein are experts on how schools can promote this in house and through positive relationships with all stakeholders in the school community). Bottom line, we all want those four thing; how we get them generally dictates our success or failure in society.
The presentation obviously had a lot more as well but I want to close my reflections on his presentation with the following ethical statement: “he who produces needs no excuses.” This was a closing remark in the context of the ethos of people who become successful. They believe and conduct themselves with this type of mantra in their work and it is something that can be internalized in the self and taught to others. As I listened to that, and it still resonates with me now, I kept thinking, “students need to know this but how many of my colleagues could use this kind of thinking themselves?” And this is an important idea in the context of being in a LEAD school. The pathological arguments about how bad things are or were, how bad the LEAD process was that so many people are still complaining about, or other sources of negativity have to go and we need to conduct ourselves with that ethos of “he who produces needs no excuses.” Or as Shakespeare states in Julius Caesar, “The fault, dear Brutus, lies not in our stars but in ourselves that we are underlings.” I will not be an underling.
Dr. Slocumbe and Understanding Poverty
Along similar lines to the previous post, the premise of this presentation was about understanding what people want to live for and then how they attain it based on beliefs yet the focus here was on people in poverty. This is an important conversation to have seeing that the poverty rate in the LEAD schools is exceptionally high and that truly our moral purpose is to educate these people to better things than living in poverty. This presentation added to my insight of students in poverty and also added some credence to practices in which I already engaged.
More specifically, we learned about the overall background information on the nature of poverty and specifically to the underlying cultural norms and tacit rules that govern the modus operandi of people in poverty. I knew some of these concepts and yet this presentation really refined and focused that understanding moreso than before. I think the key point I learned was that people in poverty value relationships and that many of the conflicts, problems, successes, or failures are usually defined by a person in poverty in terms of the relationships that they have. A teacher gives a student a failing grade: “that teacher doesn’t like me.” It is expressed in terms of the personal relationship regardless if it was or was not true.
Another key concept was that to move from one social class to another, one has to have two things: a mentor to acclimatize that person to the new class and an understanding of the hidden rules that govern membership of that class, usually learned from the mentor. Specifically with regard to moving people in poverty into the middle class successfully, this can only be done through a relationship and education. The logical conclusion here is that if a teacher wants for a student in poverty to succeed academically in their class, they must invest in the relationship piece first and the content of the class second.
Another logical conclusion comes from the understanding that schools and the staff members therein tend to have middle class values and norms, and that both explicit and implicit rules govern this culture. Yet, if students from poverty view the world from the perspective of poverty and the norms and rules governing that culture and they come to school which has a completely different culture, the net result is that conflict occurs. The data bears this out too: who are the students most likely to have behavioral referrals, in-school suspensions, out of school suspensions, and expulsions? Those in poverty. That’s what makes the role of school that much more important too because if the staff members can relate positively with students, they can educate them. But if they cannot, it will be a matter of time before that conflict between cultures manifests itself in problems for both the school and the students.
To bring this back to the context of being a LEAD school, those problems are not just for the student anymore. If we fail to teach these kids, we will lose our jobs and livelihoods. Hence, this training is really important to helping the kids succeed and if you understand how the students relate, you can teach them.
To add, we got copies of Ruby Payne’s book A Framework for Understanding Poverty the most recent edition and I have been reading it and have trouble putting it down. It tells a story that I have seen played out over and over again, both positive and negative, yet the truth.
I will add more to this post later…
The High School Master Mapping Teams
Here are the guilty parties.
Thomas J. Bailey
Kinetic Energy
The most effective professional development opportunities are those that require action orientation, a mission, and collaborative culture among people who are passionate about their work. Specific to education, this passion has to be about helping kids learn at high levels the skills that will make those kids successful in life. In the case of curriculum mapping for the State of Indiana, the elements of effective professional development and that very passion for helping kids synthesized into kinetic energy toward reaching specific and reasonable standards that would ensure student learning and ultimately student success.
In engaging in this process this week, teacher-leaders from across the state, from various districts, urban, suburban, and rural, from various grade levels, K through 12, came together to discuss, refine, and clarify the skills that students would need to learn across grade levels, in content areas, and throughout the learning progression. The discussions within groups, across grade levels, and throughout allowed for serious reevaluation and reflection on what we were doing as teachers, why we were doing it, and how can we best serve students great education. Therefore through our dialogue, we had to reach consensus on what learning looks like, i.e. learning targets. Moreover, we had to reevaluate state indicators to determine which ones were most relevant or could be simplified in language and broadened to be applicable across genres, grade levels, and content areas.
Truly, this process led to robust discussion and clarity on expectations for learning which is the purpose of a curriculum map: to determine the outcomes which students ought to be able to do. To add, the teachers shared a common understanding that in choosing learning targets according to understanding learning progressions and vertical alignment, the language of the curriculum maps should allow for instructional flexibility on the part of individual teachers. In other words, we created simple and measureable expectations without prescribing how teachers get students there. To add, this process is really the transition from the past—where individual states and teachers worked in isolation to determine standards and like, i.e. rushed responses to No Child Left Behind—toward the future in which the skills are rigorous and relevant, shared across teachers, content areas, districts, and states, i.e. consensus toward core standards. Moreover, this curriculum map will inform the process of data analysis and assessment to arm teachers with best practices and differentiation on a student-by-student basis to ensure continuous learning. Indeed, if we know what skills we want and we understand what our kids can actually do when they come to us, we can focus our time, resources, and skills toward helping those kids effectively. The kinetic energy among these professionals is making this reality.
Core Standards and Curriculum Maps
One of the goals and benefits of this process is the ability to take the curriculum maps which were created during this process and see that they are directly correlated with the core standards. The mission of the core standards, according to their website is (Common core state standards initiative, 2010):
The Common Core State Standards provide a consistent, clear understanding of what students are expected to learn, so teachers and parents know what they need to do to help them. The standards are designed to be robust and relevant to the real world, reflecting the knowledge and skills that our young people need for success in college and careers. With American students fully prepared for the future, our communities will be best positioned to compete successfully in the global economy.
In the state of Indiana and beyond, this type of mission really simplifies the ideas and learning standards to rigorous and relevant goals and actually allows teachers to integrate research-based and learner-based teaching strategies including problem-based learning and Quadrant D lessons (Rigor, relevance, and relationships, 2010). To add, this allows teachers the flexibility to differentiate instruction to reach these precise skills or “learning targets.”
Furthermore, as the Chief Council of State School Officers and the National Governor’s Association move forward with the Core Standards, the goal of consistency in learning outcomes (i.e. through curriculum mapping) and assessments will allow for students across state lines to reach agreed upon standards. Moreover, this will enhance the capacity of teachers, teacher preparation programs, and school districts to effectively collaborate on helping all students learn at high levels.
Learning Targets/Big Ideas/Essential Questions
In the context of Core Standards and these curriculum maps, teachers came together to reach consensus on expectations from grade level to grade level and within each quarter of a grade level. Teachers developed standards-based “learning targets,” i.e. verbs or observable actions which reflect learning in the content areas and can be assessed, which also reflect appropriate developmental progression of students and the cognitive process of “learning progressions” (Heritage, 2008, pp. 2-3).
This leads into the discussion of Big Ideas which are overarching concepts that link many of the learning targets and have open-ended, real-world relevance to many situations in life, especially toward life-long learning, college, and workforce readiness. Hence, the essential questions are specific to the instruction of those concepts. Ideally, if any given teacher at any given grade level is using those essential questions to guide their instruction and students are engaged in learning, students will learn skills that will have rigor and relevance to college and workforce readiness.
Teacher Leadership: Bring it on Home
Therefore, in creating these curriculum maps and clarifying and refining educational goals, teacher leaders, whose work in the classroom and in this process are highly effective, must continue to act as leaders in this profession to enhance the capacity of other teachers, departments, schools, and districts towards high learning for all that is reasonable, observable, measureable, and relevant to citizenship and life in a global society. As a profession, educators and legislators should never underestimate the power of effective instruction nor the power of effective leadership. Within this, clarity and precision are key at every level, ergo these curriculum maps. Thus, by formulating clear and precise learning outcomes in this curriculum mapping process, the necessary resources, energy, and collaboration can be allocated toward effective instruction and leadership across this state and beyond. Our role as educational leaders, then, is to bring this back home to our respective districts and classrooms, lead the way, and enhance every educator’s capacity to teach all kids to high levels of learning.
References:
Common core state standards initiative. (2010). Retrieved from http://www.corestandards.org
Rigor, relevance, and relationships. (2010). International Center for Leadership in Education. Retrieved from http://www.leadered.com/rrr.html
Heritage, M. (2008). Learning progressions: Supporting instruction and formative assessment. National Center for Research on Evaluation, Standards, and Student Testing. Washington DC: Council of Chief State School Officers.
These are blogs created by my AP Language and Composition students in 2009-10. They were done in conjunction with their argumentative research papers.
http://tga-political-sex-scandals.tumblr.com/ http://community.livejournal.com/exasperati0n/ http://amberjanell.tumblr.com/ http://masterwarrior10.tumblr.com/ http://chelliebean.tumblr.com/ http://t9zmbdj.weebly.com/nanotechnology.html
The following blogs were created by my AP Literature and Composition class in 2009-10. They were required to do analysis writing, a video project of some sort, a musical piece, and a graphic representation: http://aplitbonanza.tumblr.com/ http://bookprojectbpjslj.tumblr.com/
Shabaz Khaliq and I co-taught a World Literature and World History class in which our students did a project for India.
Here are some of the fruits of their labor:
http://indiansensation.tumblr.com/ http://indiathenation.tumblr.com/
A Data-Driven English Classroom in Action: A Reflective Analysis
Thomas J. Bailey
Introduction
In a previous essay called “Toward a Data-Driven English Classroom,” I reflected on how I collect data, what types of data, and how I use it to drive instruction. I outlined 5 essential questions that drive a data-driven classroom as well as specific data sets that could be used to get a fairly accurate profile of a student’s abilities in the English content area. The following essay is a reflection on those data sets and results from a cohort of students in the Fall of 2009 in block English 12 classes at Elmhurst High School
Specifically speaking, the prior article reviewed relevant data, essential questions guiding data usage, and strategies to drive instruction based on the data. As a review of relevant data, most of the data mentioned in the previous article was focused on reading and writing scores. This data included Lexile data, Acuity Test data, language conventions test data, and ETS Criterion data. The first two assessments listed, for the most part are dedicated to assessing reading, and the second two assessments measure writing and grammar. The essential questions on data usage are as follows:
1. What do I want my students to be able to do as a result of experiencing and learning from my class?
2. How will I measure that?
3. How does that align with state and local standards and prepares them for observable outcomes on exams?
4. Where are the students now?
5. How will I get them to the answers of questions 1 through 3 above?
Along the lines of those questions and leading onto instruction, I outlined that teaching and resources need to be dedicated to the explicit learning goals of the content area and that improvement needs to be the focus on a student by student basis.
For the sake of brevity, the premise of this study, then, is to review student data for two English classes that I taught in the Fall of 2009 and reflect on learning results based on the student data gathered therein. In this case, it must be mentioned that Acuity testing was not administered to these students because the 12th grade English courses do not have acuity tests designed to assess progress for this particular class because Acuity is reserved, at this time, to English 9 and English 10 classes, those classes which either prepare for or are subject to the ISTEP 10 End of Course Assessment.
Therefore, the assessment data sets were from the following assessments: the Language Conventions Test (my personal, local assessment), the ETS Criterion Essay assessment data, and SRI Testing (Lexile) data. This study will reflect on the results of the pretest and post test data in these assessments and what the results yield. In closing with each area of data, there will be a discussion on the learning experiences within the classroom and how they are related to the data at hand. The research here supports that measureable learning outcomes are predictable based on having relevant student data, clear desired outcomes, effective teaching practice, and reflection on results.
Language Conventions Test
As an overview, the language conventions test used to assess students’ understanding of language conventions and sentence structures has a format similar to that of the Test for Standard Written English. There are 25 multiple choice questions set up as complete sentences with four parts of the sentence underlined and matched with answers A, B, C, and D along with a E option which is no errors. The objective for the student is to read the sentence, evaluate its structure and punctuation, detect if an error has occurred, and identify the part of the sentence which has the error. This is a very difficult assessment for most high school students because grammar is rarely taught in the primary and secondary grades and it is rarely taught in the context of creating and correcting sentences. Rather, most grammar instruction in this district in my observations has centered along identifying parts of speech and phrases rather than on creation, constructing, and evaluating sentences. In this case, the pretest and the post test were only slightly different in that the pretest had a typographical error in one sentence and one question had two possible error answers. The post test was corrected accordingly. The test is available at the end of this article (No it is not…). The pretest was administered on September 9th 2009 and the post test was administered on January 13th 2010.
Results
According to the pretest data, students in both English classes generally scored very low. For the pretests, the lowest score was 3 correct of 25 and the highest was 21 of 25 correct answers. For full student by student pretest and post test raw scores in both classes, see Figures 1 and 2. After comparing the pretest and post test data, most students significantly increased their scores. For student by student increases or decreases, see Figures 3 and 4. Between the two classes, a total of 5 students’ scores decreased or remained the same. The rest all showed increases in correct answers. In English 12 period 2, students’ raw scores increased, on average, by 5.412 answers and their percentage increased on average by 21.67%. In English 12 period 3, students’ raw scores increased on average by 4.67 answers and their percentages increased on average by 18.42% (See Figure 5). As reflected in Figures 3 and 4, there is a great deal of variance in the increases among students as many of the increases were dramatic in nature while some were modest. Overall, the increases in scores reflect the overall increase in student understanding of the concepts and rules the guide sentence structures and punctuation.
Reflections
In all honesty, the increases in these statistical categories is the result of the following factors: lack of experience with this level of grammar coming into the class, practice in the rules in writing and evaluating sentence structures, and application of those rules in direct lessons on grammar, short writings such as quickwrites and responses to reading, and formal writing assignments (full fledged essays on various topics).
First and foremost, it is difficult for a student to succeed on a test especially if they have not faced a test of that style nor have they been equipped with the skills necessary to succeed in answering the questions correctly. Therefore, their scores were disproportionately low compared to anecdotal writing data, i.e. what they could actually write at the time they took this test and compared to their normal achievement data, i.e. what types of grades they would normally get on assessments and as class grades. Yet, the abysmal scores were a great place to start in being a source of motivation and teachable moment.
Secondly and most importantly, the skills needed to evaluate the sentences on this test were taught in a progressive, reflexive, and comprehensive manner through practice and reflection sessions. Early on in the semester, the material was taught starting with comma usage and focusing first on one basic skill with commas and then moving onto another skill. But when moving onto the second skill, practice and reflection was also done on the first skills. This progression took place until a total of 14 skills had been mastered in a progressive way. For example, the semester started with commas separating items in a list of particulars of three or more. The second skill was putting a comma after a transitional phrase but on that day, the students also practiced putting the comma in a list of particulars of three or more. This progression took place throughout the entire 18 weeks at a high frequency early on and then gradually easing off the frequency for long-term recall. The skills taught could be summarized as follows:
During the practice sessions too, the concepts were presented with a combination of abstract “recipes,” as I called them coupled with concrete examples. The sessions always included the creation of sentences based on the concepts as well as the correction of incorrect sentences based on the concepts. To add during the lesson, when students corrected sentences, they had to name the rule that was being applied. Feedback, because this was done using an LCD projector and students’ own papers and writing, was immediate and informative.
Lastly, the increases should also be attributed to the explicit requirements in short and long assigned writings throughout the course of specific and measureable usages of the rules in their writing. For example, when students wrote the compare/contrast essay between the Anglo-Saxons and the Medieval literature and heroes, they were explicitly instructed to use a certain number of semicolons, complex sentences, lists, and transitional phrases. Sometimes the writings were done in class as quick writes and journal entries. But there was usually a set of specific language conventions-based requirements even in those. For example, students wrote a quick paragraph on the King Arthur stories but had to include 4 transitional phrases in that paragraph.
All in all, the results here reflect that learning takes place through repetition, dispersed periodicity in the repetition, and comparisons between abstract and concrete examples. To add, the results also reflect that by requiring the same skill sets across a variety of outlets, i.e. practice sessions, formal writings, projects, and other assignments, the skill is reinforced and learned in the long term.
ETS Criterion Writing Data
In Fort Wayne Community Schools, English teachers have access to an invaluable writing resource in ETS Criterion which is a web-based online writing assessment tool. ETS Criterion has writing prompts for all grade levels all of the way up to the “College Second Year” level. For an overview of how Criterion assesses student writing the following webpage is available for information: http://www.ets.org/criteriontour.html . For the sake of brevity, the administration and data of the tests will be discussed next.
In August, students were assigned in Criterion to write for a prompt called “Multi-Media Teaching” and the grading rubric was set to the “College Second Year” level. This was done for two reasons. First, results from this test, generally speaking, had been reliable throughout the years reflect an accurate snapshot of students’ ability to write and formulate essays. Usually, what was reflected in the written responses for the prompts showed up in students’ daily and formal writing. These issues varied greatly but included the following issues and beyond: ability to start an essay at all, organization issues, answering the prompt directly, language conventions errors, homophone errors, speed of writing, etc. So the data in this type of report informs about students on an individual basis thus giving room for differentiation. The data also informs and is fairly accurate in giving holistic scores as well in the 6 point-rubric option. The second reason for setting the rubric to the “College Second Year” level resides in how my objectives are that even the most advanced students receive scores that force them to improve. If a student gets a 6 on the initial writing test, they may have the false sense of superiority or mastery of the content which could lead them to not focusing on the instruction leading to improvement. Therefore, I do so to force advanced students to advance.
There are some issues with the data sets which are about to be presented. First, the data is incomplete: some students did not post-test and therefore a second data report was generated using a combination of post-test data or most recent assignment data (which was a Shakespeare Essay prompt set to College Second Year). To add, a handful of students moved into alternative education programs or transferred to other schools and thus their data is reflected in the initial data sets but not the final (these were not the score 1 and 2 students in the pretest though). Lastly, Criterion sometimes does not assign a score to an essay because its algorithms are not equipped to compare their database of essays toward the essay at hand. Anecdotally and through evaluating the non-scored essays, I would propose that to include that data would actually skew the improvement of the scores upward compared to the hard data currently at hand. In these cases, this explains why the second sets of data do not have the same totals of essay scores compared to the initial pretest. Therefore, the data is compelling overall even with these issues but not conclusive although informative toward student improvement.
Data Sets and ETS Criterion
For both English 12 classes, the Criterion essay “Multi-Media Teaching” was administered on September 1st 2009 and the final exam prompt on “Emailing and Texting” was administered on January 13th 2010. Both tests had a three day window to allow extra time for students with individual education plans that required extra time. To add, both prompts were set for “College Second Year” as the default evaluation level.
That being said, three sets of data are presented here to give a more comprehensive picture rather than just the pretest and post test data. This is the case because due to absences and other academic circumstances, some individuals were not able to complete the final exam but were able to complete the recent assignment before the exam which was an essay about a Shakespearean play for which the rubric was also set to “College Second Year.” Therefore, the data sets presented are meant to show a trend rather than a specific, student by student correlation although the overall data is fairly conclusive.
In Figures 6, 7, and 8 the English 12 Period 2 pretest, post test, and most recent assignment data are presented. The graphs show the frequency of scores at the 6 levels that Criterion assesses. Obviously, levels 1 through 3 represent shades of the standard below the acceptable grade level. Levels 4, 5, and 6 represent the different levels of passable essays ranging from at the standard to excellent. As is shown in Figure 6, the frequencies of levels 1 and 2 essays are at 2 each while levels 3 and 4 occurred 18 times, and level 5 occurred 10 times in the English 12 Period 2 class. A similar distribution of scores is reflected in Table 4 for the English 12 Period 3 class as well. These tables (Figures 6 and 9) represent the initial writing scores for both periods.
In comparison, the post-test Final Exam scores are reflected in Figures 7 and 8 respectively. The issue with the data, though, is that the number of students who completed this assignment is significantly less than those who pretested because many students were making up other parts of the exam or were absent on the day of assignment. Nonetheless, the frequencies of scores of 4 and 5 are significantly higher on a per student basis when compared to the initial pretest. This begs the question, then, if this data reflects students’ work achieved significantly higher because they were able to accomplish the task while those who may have been behind would have scored lower though their data is not present. In this case though, there was a balance in the number of students who did not take this prompt who normally achieve at high levels and those who normally achieve at appropriate or below grade levels. In fact, some students wrote for this prompt instead of the major project and these students would be considered low achievers. Thus the conventional wisdom would be that their scores would have been lower. While the data comparing Figures 6 and 7 as well as Figures 9 versus 10 suggests a slide upward in student writing abilities, the data is still inconclusive.
To get a more accurate reflection on improvement, comparing the data between Figures 6 versus 8 and Figures 9 versus 11 would be more appropriate. This data in Figures 9 and 11 represent the score reports of the assignments for the Final Exam or the Shakespeare Essay assignment. In both cases, the grading prompt was set at “College Second Year.” If students completed the Final Exam, then that data was included. If they did not complete the Final Exam, then Shakespeare Essay was used as the determining data set for that student.
Comparing the Pretest Data for both class periods (Figures 6 and 9) versus the Composite Data for both class periods (Figures 8 and 11) reveals the general distribution upward in scores. While this comparison probably would not statistically pass the test for significance and specific accuracy, coupled with the trend upward in language conventions test data as well as anecdotal in student projects and in-class writing assignments, this data does point to improved writing for these students.
Reflections
In fairness, in future attempts to track and record this data, more accuracy has to be a focus. Nonetheless, the composite work of the students in this class, their test data, and the work in their projects and writing throughout the course certainly reflect significant improvement in student skills in their writing despite the holes in the data. Yet as a professional, I am still disappointed with the lack of scores of 6.
In retrospect, the use of the Criterion data was effective in driving individual instruction and served as an accurate representation of student abilities. This serves as a positive and effective teaching practice for evaluating and driving instruction towards improving students’ writing.
From an anecdotal perspective, the essays from the Pretest, regardless of the scores and across the board, were significantly inferior compared to the essays after the instruction was administered regardless of which assignment was reflected in the report. For example, students’ essays were significantly longer in the last essays when compared to the first. Paragraphs were longer and had more sentences, complex and simple. Sentences were of greater variety and structure with use of transitions, appositive phrases, semicolons, colons, lists of particulars, and the integration of research and citations (this was a requisite for the Final Exam prompt as well).
As it stands, the improvement in writing skills can be directly attributed to the quality instruction and engagement by students. The exercises used to improve the language conventions test results were also directly tied to focusing on creating and writing varied and complex sentences. The added dimension of paragraphing and the instruction dedicated to organizing a paragraph and an essay accordingly led to improved writing skills. For example, body and singular paragraphs were taught in the terms that “paragraphs are sandwiches to be served with bread, meat, cheese, and bread” a mnemonic that effectively and logically was learned by the students. Additionally, formulas for introductions (attention-getting device, relating step, preview step, thesis) and conclusions (restate thesis, recapitulation of main points, and closing statement) also positively affected student learning because of the practice and repetition. While some may question the narrow focus of these formulas, two pedagogical considerations are made: you have know the rules to break the rules; it is better to master a few things perfectly than to do many things poorly.
Lexile Data Results
Fort Wayne Community Schools requires all language arts teachers to administer the SRI (Student Reading Inventory) test to all students enrolled in an English class at the beginning of every new year and new semester. The SRI Test is a computer-based test in which students read passages and then answer questions based on the reading passage in which they must choose answers based on their understanding of the reading vocabulary. The test yields a score from 0 to 1700+ that reflects the vocabulary reading level of the student. While the scores generally represent a range score and they are loosely tied to ranges in grade levels, the scores do a fair job of reflecting a student’s current reading vocabulary level. There have been exceptions when students have scored significantly too high and too low based on a bad test date (several reasons could be the source of this) but the scores are certainly important in driving instruction and determining developmentally appropriate texts and to identify those students who will need reading support and strategies when faced with various reading materials.
Fort Wayne Community Schools does not, on the other hand, require a second administration of the test toward the end of a course but in my English classes, I re-administer the test to track student growth or maintenance. Therefore, my students tested in August 2009 and January 2010 at the respective beginning and end of the semester. Obviously, due to transfers and absences, four students did not test a second time between the two class periods and therefore, their data is omitted. Also in the interest of privacy, students’ names are not listed with the data sets.
Before the discussion of data here, some points need to be made about Lexile data and how this data has been disaggregated. For the sake of this study, an increase or decrease above 50 points is considered significant. Increases or decreases within that 50 point range represent no significant change. Finally, students that pretest at a level of 1200 or higher are considered pretesting at a high level. Consequently, students who already test at high levels may show disproportionate drops in growth due to the high initial test, especially if another early test sample is not taken.
The results are as follows. In English 12 Period 2 the number of students who increased significantly was 13. The number of students who stayed within their range was 11. The number of students who decreased significantly was 4. Of those 4, 3 are considered to be high level pre-testers (See Figure 12). In English 12 Period 3, the number of students who increased significantly was 9. The number of students who stayed within their range was 16 (See Figure 13). There was only one student whose score decreased significantly and this student was a high pre-tester.
The increases in Lexile scores in both classes are significant. To add, the high percentages of those who stayed within range as well as those who pretested at a high score reflect that both classes had significant groups of students who were already reading at a high level in the class. The greater improvement in Lexile scores in English 12 Period 2 versus English 12 Period 3 also reflects that Period 3 came in with stronger Lexile scores and therefore had less room for improvement. This was replicated in the Language Conventions test data (See Figures 1 through 5).
Conclusion
The underlying argument is that student achievement and learning improves because of effective, data-driven instruction. If teachers can get an accurate profile of students’ abilities and they know what the final reflection of students’ learning should look like, they can effectively create the roadmap to reach improvement for those students. The data on student writing, understanding of language conventions, and reading data presented here reflect this direct correlation.
Lastly, I want to mention here some very important revelations in having experienced this type of success. First, this type of success is rare and I humbly credit the students for having the willingness to buy into what I was trying to teach them and maintaining a positive attitude and rapport with me. I am thankful that they listened to me and learned from me. Secondly, at Fort Wayne Community Schools, we have some resources that other schools simply do not have, and these resources, in this case, were allocated and completely focused toward specific learning goals. To add, this experience is also the reflection of 3 years of working, reflecting, gathering resources, figuring out how to best use those resources, narrowing and maximizing the classroom focus and experience, and putting together a cohesive plan of action to serve these kids a great English 12 classroom learning experience. Finally, I would like to thank the administration at Elmhurst High School for giving me the resources and the pedagogical freedom to teach with courage and to work creatively and think outside of the box.
On a final note, I do regret that my discussions on actual teaching practice were as brief as they were. Teaching to help these kids succeed to these levels was much more effort and complication than one should guess from the scant writing on the classroom experiences. This was about knowing every single one of my students from a relational standpoint as well as a professional one. To add, I regret too that I did not discuss the role of Quadrant D lessons in making this come about as they played a role in leading to these achievement results. Between the Quadrant D lessons and the daily norms and routines of practice and perfecting, there is enough material to serve as its own written reflection. This analysis was specific to addressing the before and after effects and data of an effective classroom, not on the roadmap to make it there. To add, if the essay “Toward a Data Driven Classroom” was an overview of what I was doing or what I was going to do, this outcomes in this essay reflect the results of doing those things.
Figures 1, 2, and 3
Figures 4 and 5
Figure 6: English 12 Period 2 Pretest Data Criterion Writing
Figure 7: English 12 Period 2 Final Exam Criterion Writing Scores
Figure 8: English Period 2 Composite Scores
Figure 9 English 12 Period 3 Pretest Data