TOEFL Testing on the Computer

The benefits of TOEFL on computer:

The move to testing on computer will allow for several important enhancements, including:

assessment that is tailored to each test taker's ability level
context-setting visuals and topic orientation during the Listening Comprehension section
more examinee control over the pace of the Listening Comprehension section questions
individual headphones and examinee-controlled volume
Reading Comprehension tasks that require the examinee to interact more closely with the text
essay with every test administration
more individualized test environment
faster score reporting
platform for future innovations in test design

Where can students take TOEFL on computer?

The test is administered at computerized test centers at designated universities, at ETS field offices, and at Sylvan Technology Centers^Ž around the world. There is greater flexibility in scheduling because candidates will be able to arrange convenient testing times with the closest test centers.

Will students have a choice between computerized TOEFL and the paper test?

Why is TOEFL changing?

TOEFL on computer is an important improvement that enables the TOEFL program to take advantage of new forms of assessment made possible by the computer platform. This platform provides the springboard from which TOEFL 2000 will be launched. TOEFL 2000 reflects ETS's commitment to create an improved English-language proficiency test that will:

How is the test changing?

Computerized TOEFL is not just the paper test reformatted for the computer. It has the following four sections:

While some questions are similar to those on the current test, others are quite different. For example, the Listening and Reading sections will include new question types designed specifically for the computer. In addition, the test will also include an essay that can be handwritten or typed on the computer. The essay will measure an examinee's ability to generate and organize ideas and support those ideas using the conventions of standard written English.

Some parts of the computer-based TOEFL test are linear; other parts are computer-adaptive. A linear computerized test is a full-length test (scored the same way as the paper TOEFL) in which the computer selects different questions for each test taker. A computer-adaptive test (CAT) is one in which the computer selects a unique set of questions matched to the examinee's ability level. Because of this item selection process, CATs contain fewer questions than paper tests.

How does a computer-adaptive test work?

In computer-adaptive testing, the computer selects a unique set of test questions based on the test design and the test taker's ability level. Questions are chosen from a very large pool categorized by item content and difficulty. The test design ensures fairness because all examinees receive the same:

The CAT begins with a question of medium difficulty. The next question is one that best fits the examinee's performance and the design of the test. The computer is programmed to make continuous adjustments in order to present questions of appropriate difficulty to test takers of all ability levels.

Only one question is presented at a time. This means that examinees cannot skip questions or change answers to previously answered questions. On the other hand, the test contains fewer questions than a paper test, and test takers do not spend time answering questions that are too easy or too difficult for them.

Is computer selection of test questions fair?

Occasionally examinees will give an incorrect answer because of a careless error or will answer correctly with a lucky guess. However, the adaptive nature of the CAT allows the test to correct itself. Answers to subsequent questions will lead examinees back to questions that are at the appropriate level of difficulty.

How are the scores calculated?

The linear parts of the exam will be scored the same way the current paper TOEFL sections are scored. The computer-adaptive parts will take the difficulty of the questions into account in the score process. Therefore, if two examinees have the same number of correct responses on a computer-adaptive section, the test taker who correctly answers the more difficult set of questions will receive a higher score than the one who correctly answers an easier set of questions.

TOEFL on computer will report separate scaled scores for the three test sections. The Listening section will be scored on the basis of responses to computer-adaptive questions. The Structure and Written Expression section will be scored on the basis of computer-adaptive questions and the essay, which will be evaluated by two readers in the same way the current Test of Written English (TWE^Ž) is scored. The Reading section will be scored on the basis of linear multiple-choice questions. Finally, scores on all three sections of the TOEFL on computer will be factored into a scaled total score, as is the case with the current test.

Has the score scale change? If so, how would a new scale relate to the current TOEFL scores?

New question types will make new scales necessary. Concordance tables were developed to assist score users in setting new score standards that relate the computer TOEFL scores to paper TOEFL scores.

Is score reporting any different?

Score reporting is faster for computerized TOEFL than for paper TOEFL. Score reports will be mailed to examinees who type their essays approximately two weeks after the test is taken. Reports will be mailed about five weeks after if the examinee handwrites. Scores may also be available to institutions through electronic methods being developed for all ETS computer-based testing programs. Until full transition to computerized testing, institutions will receive both paper and computerized TOEFL scores.

What if an examinee has never used a computer?

The TOEFL program has taken steps to assure that an individual's test performance is not influenced by a lack of computer experience. A tutorial, designed especially for nonnative speakers of English, has been developed to teach the skills needed to take TOEFL on computer. An international computer familiarity study has been conducted to examine test takers' performance on the tutorial and test items. Results of the study suggest that, after controlling for English proficiency as measured by the paper TOEFL, no differences exist in performance on computerized TOEFL between test takers familiar with the computer and computer novices, both of whom took the tutorial.

What is covered in the computerized tutorial?

The computerized tutorial, administered at the beginning of a test session, provides instruction and practice in three areas:

In the tutorial, examinees can practice answering the types of questions for each section of the test.

How can students prepare for TOEFL on computer?

Instructional materials teaching the computer skills needed to take the test and practice questions for each test section can be downloaded (US$8). The tutorials and practice questions are also available on CD-ROM (US$15). Study materials, such as the Test Preparation Kit (containing the free CD-ROM), are suitable for test takers who want more practice.

Where can I get more information about TOEFL on computer?

NOTE: This article was prepared by TOEFL staff for publication in various educational periodicals. Permission is hereby granted to reproduce it in its entirety under conditions set forth in Articles Available for Reprint. The following statements MUST appear at the end of the reproduced version.

Copyright Š 1999 by Educational Testing Service. All rights reserved.
Reproduced by permission.
EDUCATIONAL TESTING SERVICE, ETS, and TOEFL
are registered trademarks of Educational Testing Service.
SYLVAN TECHNOLOGY CENTERS
is a registered trademark of Sylvan Learning Systems, Inc.

TOEFL Testing on Computer . . .