‘The Positive Impact of Innovative Testing Methodologies’ by D.Christina Sagaya Mary

Abstract

This paper of mine discusses the manner in which the use of newsletters as a mode of alternative assessment enhances the acquisition of the LSRW skills of the English language.  This form of innovative assessment was experimented with a class of heterogeneous learners at the tertiary level. The views of scholars towards ‘paper pencil tests’ and ‘alternative assessment’ have been quoted.  I have also mentioned the response of the L2 learners and facilitators towards this method of testing.

My personal perception of innovative testing methodologies is that it enhances the acquisition of ‘listening,’ ‘speaking,’ ‘reading’ and ‘writing’ of the L2 learners at the tertiary level.  Innovative testing approaches as opposed to the conventional paper-pencil test invigorate the ‘motivational quotient’ of the L2 learners.  It creates an aura of ‘self-evaluation’,’ peer-review’ and ‘group-learning’ strategies.  The focal idea of my paper could be expressed as innovative testing approaches invigorate the motivational quotient of the L2 learner, which enhances the acquisition of the four skills of language.  In fact the L2 acquisition and the retention of the acquired skills obliterate any form of duress and monotony associated with ‘paper-pencil tests.’  This ‘alternative assessment’ ensures that the learners ‘performance’ is not restricted merely to a three hour written examination, but is synonymous with the ‘criterion ‘situation.

Innovative testing methodologies cull out and furnish the latent skills in the L2 learner.  The traditional approaches have been castigated for its intransigent approach towards the learners.  It incarcerates the L2 learner in a claustrophobic ‘test situation’, which relegates the creative, analytical and reasoning abilities of the L2 learner.  The stipulated time constraint of the traditional testing process equally fails to assess the linguistic expressional abilities of the L2 learner.  Tim Mc Namara in Language Testing is of the view that alternative assessment borders on the very act of communication.  In the words of Tim Mc Namara:

“Paper-Pencil tests take the form of the familiar examination question paper. They are typically used for the assessment either of separate components of language knowledge (grammar, vocabulary etc) or of receptive understanding (listening and reading comprehension).” (5)

“In performance based tests, language skills are assessed in act of communication.” (6)

In this context I wish to quote Dr. John Love Joy in his path breaking dissertation Testing To Learn: The Portfolio Assessment Way To Empower At Risk Learners where he expresses the need for an Authentic assessment’:

“Traditional testing practices have been vigorously (see Brandt 1989 and Shepard 1989) since, according to Bachor (1990) apart from being rigid, they are also more concerned with labeling and placement issues; and are less helpful in revealing the information necessary for the development of intervention goals, objectives and strategies.  They attempt to segment language into discrete measurable parts (see Damico 1993) has added fuel to the fire, thus trivializing language into a predictable structural entity.”(55)

Randall Penfield in the article Test -Based Retention: Does it Stand up to Professional Standards for Fair and Appropriate Test Use   are of the view that detaining the learners based on their test performance deprives them of their intrinsic motivation towards language acquisition.

“Grade retention is an educational placement, and thus tests used in determining

grade retention can be evaluated on the basis of whether the resulting placement is educationally beneficial. On the surface, retention as a form of remediation has intuitive appeal; a student

who did not adequately master the material should have a second attempt at mastering it before moving on to the next grade, where the material becomes more difficult. This rationale, however,

ignores important mediating issues. Retention places students in the same learning environments where they were unsuccessful on first attempt, and these students typically are not given adequate educational interventions to help them overcome the obstacles encountered on the first (unsuccessful) attempt. Furthermore, from the student perspective, being retained is viewed as a punitive measure that brings with it a high level of stigma and embarrassment (Byrnes, 1989). The end result of these negative attributes of retention is that students not only may receive no

educational benefit from the placement but may actually be worse off in terms of academic and cognitive growth than if they had not been retained.”(113)

Chappius and Stiggins (2002) are of the view that certain L2 learners are intimidated by the retention practice of paper-pencil tests and are equally de motivated. This also leads to fossilization of their learning process.     Chappius and Stiggins are of the view that the learners would rather be encouraged by virtue of reward rather than punishment.  In the words of Chappius and Stiggins:

“Educators open the door to using assessment in more productive ways when they acknowledge that students respond differently to the use of the test scores as threats of punishment or promises of reward.  Those who succeed keep striving; those who fail may give up.  By contrast, most students respond positively to classroom assessment environments that promote success rather than simply measure it.” (43)

Glenn Fulcher is of the view that Performance test assesses the learner in the ‘criterion’ situation rather than the ‘test’ situation.  The test material incorporates the communicative impositions of real life.  In the words of Glenn Fulcher:

“The assumption underlying the performance tests advocated and developed in the 1980s was that the observation of behavior that mirrored ‘real-world communication’ would lead to scores that would indicate whether the learner could perform in the real world.”  (485)

“This `real world’ involves interaction, unpredictability, and integration of skills. The test and the criterion (real-world communication) are seen to be essentially the same, which led to the pre-eminent position of sampling and content analysis as the primary approach to test validation in English for Academic Pur-poses (EAP) testing.” (489) 

“In other words, the relationship between the learner and the task, how the learner deals with the task, and what we can learn about the learner as a result of doing the task, is what makes a task communicative.”(113)

Alternative assessment has an edge over paper-pencil tests due its ‘learner-centric’ and ‘student-friendly’ approach.  Traditional testing approach is monotonous.  It is ‘syllabus centric’, ‘curriculum oriented’ and marginalizes the L2 learners from the process of testing and learning.  On the other hand ‘performance tests’ creates relevant experiences for the learners.  It obliterates the hiatus between the ‘test situation’ and ‘criterion situation.’  The learners are actively and meaningfully involved on the testing process and feel accountable towards it. 

Alternative assessment serves as a comprehensive testing of the four skills of the language of the L2 learner; it tests the L2 learner in the ‘criterion’ situation propagates ‘group-discussion’ and ‘peer-learning’ among the L2 learners.  While creating a stress- free language acquisition atmosphere, it equally renders a positive ‘wash-back ‘effect on teaching.     I would prefer to discuss in detail that the innovative testing method that I had adopted in my general English class-room.

My class room comprises of sixty four learners hailing from diverse sociolinguistic backgrounds.  The class is a confluence of first generation learners with basic ‘Communicative Fluency’ in the language and learners with superlative fluency from the crème of the e society.  The course material is termed as ‘Value Added General English’.  It comprises of texts focusing on societal and global issues namely science and technology, politics, ecology, trade and commerce, concerns of youth, literature and art.  This innovative testing material accelerates the spontaneity and learners involvement in the testing process. It serves as a catalyst for the testing method.

This class of sixty four learners was divided into groups of ten comprising about six members each.  The task allotted for them was to design a’ news letter’ that focuses on titular social issues.  The learners were expected to submit the assignment on a specific date after the lapse of one month.  I was relentlessly and closely observing the learners while they were involved in the assignment.  I was simply overwhelmed by their zeal and excitement during the process. They exhibited a great degree of personal involvement and emotional commitment towards this testing method, which is quite opposed to the petrified and lackluster attitude of the l2 learners towards the paper-pencil tests.  My learners had worked on a plethora of topics namely global warming, Robotics, Politics, Democracy in India, youth empowerment, Agriculture and Drug Abuse.  Each topic showcases a myriad of articles like news story, poems, interview, cartoon scape, jokes, anecdotes, celebrity’s speech etc.  The L2 learners had contributed articles either individually or in pairs.  The end result, which is quite enriching and gratifying is evidenced in the scintillating layout of the news letter.  It substantiates the exuberance and conformity of the L2 learners towards this method of testing. 

While being associated with the learners during the preparation of the news letter, I discovered that this mode of assessment offered room for ‘peer-learning’ strategies.  The brain-storming of ideas and techniques in the initial stages served as a nexus for language acquisition.  It churns the acquisition of ’listening’, ‘speaking’ ‘reading’ and ‘writing’ skills.   My role as a facilitator was also transformed into a ‘language counselor’ and ‘co-learner’ in the assessment process.    This innovative testing process demands a great degree of interaction, pre-planning, writing and revising the written script.

In the initial stages of the assignment the learners indulged in extensive planning about the news letter.  This planning process which lasted for about two days involved a great degree of ‘speaking’ skills.  The learners discussed in detail the layout, content, title and logo of the news letter. The process ameliorates their ‘listening’ and ‘speaking’ skills on an eventual basis.  The L2 learners splurged in extensive reading in order to acquire primary source.  They also employed  different reading strategies namely ’skimming’, ’scanning’ and ‘close reading’  while drafting and revising the script.  The fine-tuning of ‘writing’ skills is conspicuous since each learner is expected to contribute an article.  These L2 learners relentlessly rewrite their first draft to attain flawlessness in the final draft.  The L2 learners were extremely professional in their outlook, because within each team they had formed an internal group of Chief Editor, editor, proof-reader and reporters.  The systematic and organized approach of the L2 learners towards this testing method rendered intellectual caliber and artistic finesse to the news letter.  

The L2 learners had elicited their experiences in formulating the news letter.  Their collective experience could be enumerated as edifying and entertaining.  In the words of the L2 learners”

“Your technique of making us understands the subject was indeed a success.”

“Giving rise to our imagination and talent was one of your objectives which came as our success.”

“Indeed it was a sublime opportunity for us to come together and work as a group giving shape to our ideas and perceptions.”

“This newsletter has paved a way to freedom of expression of our ideas broadening our horizons and perceptions.”

“This experience enabled me to look at things differently and analyze them critically and more over give shape to this few thoughts.”

The aforementioned responses reveal the L2 learners zeal and commitment towards alternative testing process.  It also dawns on us that there is a gradual transition from ’fluency’ to ‘accuracy’ in the process of language acquisition The transition from ‘meaning ‘to ‘form ‘is also evidenced.

The use of newsletters as an alternative testing methodology was also reviewed by associate professors and a vice-principal of the college.”

“In one word the project was professional.”

“I appreciate t he interest of the e student who had tried to create awareness among the youth and their responsible action towards it.”

The evaluation of the newsletters prepared by the L2 learners would be done by experience ‘raters’ from the department and myself.  The ’test rubric’ would be notified to the L2 learners before the initiation of the actual process.

While eliciting the salient features of this innovative testing approach, I would like to place on record some practical impediments of this method.  The use of newsletters as a mode of testing is time consuming, which cannot be accomplished within the standard three hours of an examination.  Neither can it be completed during the classroom hours.   It demands ‘peer-learning’ strategies outside the class-room replicating ‘real-life’ situation.  It equally requires the time and energy of the facilitator, who is transformed into a ‘Co-learner’ and ‘Counselor’ during the process of testing.  The constant monitoring of the L2 facilitator is mandatory to maintain ‘group cohesiveness’ and negotiate ego clashes and differences of opinion.  The process is equally expensive; the L2 learners need to possess the   adequate materials like Camera, and access to suitable location.  They need to acquire permission from authorities for video graphing in specific locations, like college campus.  The facilitator should also ensure the safety of the L2 learners during the shooting especially while placing the cameras at perilous angles.  In certain cases if the l2 learners adopt a survey method, they may encounter difficulty in eliciting the appropriate response due to the reluctance of the sample population.   In the initial stages, there are chances for facilitate to be confronted with disinterest and disinclination from the L2 learners who may be daunted by the magnitude of the task.  The group-size is equally a matter of concern; it should be restricted to a maximum of five to seven members to facilitate effective functioning. 

However these hitches can always be meted out with pre-planning, allocation of funds, motivational quotient of the learners and diligence of the facilitator.  The penchant of this methodology will have a positive reverberation in the minds of the L2 learners.  This innovative testing process is definitely here to stay.   The preference of innovative testing methodology over paper-pencil tests is reminiscent of Robert Frost in his poem “The Road Not Taken.”  In the words of Frost:

“Two woods diverged in a yellow wood,

I took the one less traveled by,

And that has made all the difference.” (16-20)

Works Cited

1)      Chappius,S. and Stiggins,R.J, Classroom Assessment for Learning. Educational leadership, September: 40-43,   http://cusd.capousd.org/edusupport/Articles/Classroom%20Assessment.pdf

2)      Frost, Robert, The Road Not Taken. www.poemhunter.com › Poems › Robert Frost

3)      Fulcher, Glenn. The Communicative Legacy in Language Testing. Volume 28.No.4.Dec1 2000:483-497.www.ignentaconnect.com/content/els/034625/X/2000/…/art 00033.print. 10 April 2013.

4)      Love Joy, John.J. The Portfolio assessment Way to Empower At Risk Learners, 2005. print.

5)      Mc namara ,Tim, Testing. United Kingdom: Oxford University Press, 2000. print.

Penfield, Randall D. “Test-Based Grade Retention: Does It Stand Up to Professional Standards for fair and Appropriate Test Use? Vol.39. No.2 March 2010: 110-119. 69.8.231.237/uploadedFiles/publications/…/110-119_03EDR10.pdf .print 10 April 2013.

About the author

D.Christina Sagaya Mary, is an Assistant Professor of English, at Loyola College, Chennai. Her area of interest in ELT includes ‘Language Acquisition through Reading Skills’ and ‘Testing and Evaluation.’  She is currently pursuing her research in innovative testing methodologies at the tertiary level.