What are the best practices for assessing writing proficiency in a second language?

1 Define the purpose and construct

Before you create or choose a writing task, you need to define the purpose and construct of your assessment. The purpose is the reason why you are assessing writing, such as placement, diagnosis, feedback, or certification. The construct is the underlying ability or trait that you want to measure, such as grammatical accuracy, lexical range, rhetorical organization, or genre awareness. You should align your purpose and construct with the learning outcomes and standards of your curriculum or program.

2 Choose the task type and format

Next, you need to choose the task type and format that best suit your purpose and construct. The task type is the genre or mode of writing that you ask your test takers to produce, such as an email, a summary, an essay, or a report. The format is the way you present the task, such as a prompt, a question, a scenario, or a source text. You should consider the authenticity, relevance, and difficulty of your task type and format, as well as the time and resources available for administration and scoring.

3 Develop the scoring criteria and rubric

Then, you need to develop the scoring criteria and rubric that will guide your evaluation of the writing samples. The scoring criteria are the aspects or dimensions of writing that you will focus on, such as content, organization, language, or mechanics. The rubric is the scale or framework that you will use to assign scores or levels to the criteria, such as holistic, analytic, or primary trait. You should ensure that your scoring criteria and rubric are clear, consistent, and aligned with your purpose and construct.

4 Train and monitor the raters

After you have your task and rubric ready, you need to train and monitor the raters who will score the writing samples. The raters are the people who will apply the rubric and assign scores or levels to the test takers' writing. They can be teachers, peers, experts, or automated systems. You should provide them with adequate training, guidance, and feedback to ensure that they understand and apply the rubric accurately and reliably. You should also monitor their performance and address any issues or discrepancies that may arise.

5 Analyze and report the results

Finally, you need to analyze and report the results of your assessment. The results are the scores or levels that you obtain from the raters' evaluation of the writing samples. They can be numerical, descriptive, or qualitative. You should analyze them using appropriate statistical or qualitative methods to check their validity and reliability, as well as their usefulness and fairness. You should also report them in a clear and meaningful way to your intended audience, such as test takers, teachers, administrators, or stakeholders.