https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ Strategies Proposed for Listening Comprehension in PBT TOEFL: Tricks that Do Not Work 1Faisal Mustafa and 2Tomi Mandala Putra 1faisal.mustafa@unsyiah.ac.id, 2tomiputra@outlook.com 1English Education Department, Faculty of Teacher Training and Education, Universitas Syah Kuala, Darussalam, Aceh, Indonesia 2School of Language and Culture, Faculty of Humanities and Social Sciences, University of Queensland, Brisbane, Australia Abstract: The Longman Preparation Course for the TOEFL, written by Phillips in 2003, is the most widely used coursebook for TOEFL test preparation. This book provides 17 strategies for Listening Comprehension Part A. Therefore, the current study examines whether the strategies provided in the book are applicable in a real test. The data were obtained from Part A of the TOEFL listening section in nine tests designed by Educational Testing Service (ETS). Each item in the test was tested against the proposed strategies. The results reveal that many items did not successfully match the strategies. Only two proposed strategies had matches of higher than 80%, while others were less than 10%. There are four strategies that did not have a match at all. All in all, very few strategies can be applied to answer the questions correctly without adequate comprehension. With comprehension, test takers can answer the questions without needing to rely on any of the proposed strategies. Therefore, the study concludes that most of the strategies proposed by Phillips (2003) are not successful in real test. Key words: strategies, PBT TOEFL, listening comprehension Abstrak: The Longman Preparation Course for the TOEFL yang ditulis oleh Phillips in 2003 paling banyak digunakan untuk pelatihan persiapan TOEFL. Buku tersebut berisi 17 strategi untuk menjawab 218 Celt: A Journal of Culture, English Language Teaching & Literature, Volume 20, Number 2, December 2020, pp. 217 – 234 https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ soal TOEFP pada Part A. Oleh karena itu, penelitian ini menelaah apakah strategi dalam buku tersebut dapat digunakan untuk mengerjakan tes TOEFL yang sebenarnya. Data untuk penelitian ini diperoleh dari tes TOEFL bagian listening Part A yang diperoleh dari Educational Testing Service (ETS). Setiap soal pada tes tersebut dicocokkan dengan strategi yang terdapat dalam buku Phillips (2003). Hasil penelitian menunjukkan bahwa banyak soal tidak dapat dijawab dengan menggunakan strategi yang dianjurkan. Hanya ada dua strategi yang memiliki kecocokan lebih dari 80%, sedangkan yang lain kurang dari 10%. Ada dua strategi yang tidak cocok dengan satu soal manapun. Secara keseluruhan, sangat sedikit strategi yang dapat digunakan untuk menjawab soal TOEFL listening Part A tanpa pemahaman yang cukup. Dengan pemahaman, peserta tes bisa menjawab soal tanpa harus menggunakan strategi-strategi tersebut. Oleh karena itu, penelitian ini menyimpulkan bahwa kebanyakan strategi yang dikemukakan oleh Phillips (2003) tidak dapat digunakan untuk menjawab soal TOEFL asli. Kata kunci: strategi, PBT TOEFL, listening comprehension. INTRODUCTION Listening received little attention in second and foreign language instruction before the 1950s. However, it is now considered a very significant part of language learning because experts have discovered that it facilitates language acquisition (Munoz, 2013, p. 3). Listening is perhaps the most important language skill to develop (Selamat & Sidhu, 2013, p. 422). Therefore, researchers have shifted their focus strategies that improve listening skills (Dong, 2016, p. 150). In order to measure learners’ listening skills, the Educational Testing Service (ETS) provides a standardized language test known as the Test of English as a Foreign Language (TOEFL). The test is regarded highly by academicians since it is one of the admission requirements for most universities in the world (Golubovich, Tolentino & Papageorgiou, 2018, p. 8). Paper-based TOEFL (PBT TOEFL) tests listening, structure, reading, and writing. Among those language skills, listening is the most difficult skill to teach (Walker, 2014). This skill requires much practice and adequate exposure to the language (Megawati, Mustafa & Bahri Ys, 2016, pp. 352-353). For general listening, many suggest accessing videos such as movies to develop the skill (Muthalib, Bahri Ys, Mustafa, 2019; Safranj, 2015, p. 172). According to Bisson et al. (2012, p. 415), this process takes a long time to improve listening comprehension. To teach listening for TOEFL, the TOEFL Mustafa, M & Putra, T.M., Strategies Proposed for Listening Comprehension 219 in PBT TOEFL: Tricks that Do Not Work https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ preparation coursebook provides test-taking strategies. The most popular TOEFL preparation coursebook is Longman Preparation Course for the TOEFL Test: The Paper Test written by Deborah Phillips. It provides 17 strategies meant to be learned and practiced by TOEFL test candidates to help them answer the listening comprehension questions in the TOEFL test. However, to what extent these strategies are helpful is a question which needs to be answered through research. Therefore, the current study analyzed whether the proposed strategies are applicable in a real PBT TOEFL. The results of this research are significant for both TOEFL test candidates in planning their test preparation and instructors in designing syllabi for TOEFL training. LITERATURE REVIEW A. Test of English as a Foreign Language (TOEFL) English language ability can be measured in many ways. One way is through the Test of English as a Foreign Language, which was published for the first time in 1960 (ETS, 2011, p. 2). The test itself is provided by a non- government organization named ETS (Educational Testing Service) (Elfiondri et al., 2020, pp. 54-55). The test is used all over the world. With more than 4,000 test centers in more than 165 countries, the TOEFL is used as the primary English standardized test (ETS, 2020, p. 4). There are four versions of the TOEFL: computer-based, internet-based, paper-based, and institutional. The Computer-Based TOEFL (CBT TOEFL), introduced in 1998, consists of four sections, listening, structure, reading, and writing, with possible scores between 0 and 300 (ETS, 2020, p. 6). With the discontinuation of the CBT TOEFL in 2005, the Internet-based TOEFL was introduced (ETS, 2011, p. 3). The Paper-based TOEFL (PBT TOEFL), also a product of ETS, has only three sections with possible scores between 310 and 677. The first section in the PBT TOEFL is the listening comprehension section, which consists of three parts - short conversations, long conversations, and short talks and lectures (Mustafa & Sofyan, 2018, p. 275). The second section deals with 40 grammatical questions divided into two parts - incomplete sentences and error analysis (Mustafa, 2015, pp. 347-348). The third section is reading comprehension consisting of 5 passages, with about ten questions per passage (Elfiondri et al., 2020, p. 55). The PBT TOEFL, unless it is the Institutional PBT TOEFL, has a writing section called TWE - 220 Celt: A Journal of Culture, English Language Teaching & Literature, Volume 20, Number 2, December 2020, pp. 217 – 234 https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ Test of Written English (Salma, 2018), which is given to the test-takers before the other sections. B. Listening Comprehension Section in PBT TOEFL Listening comprehension in the paper-based test consists of 50 multiple- choice questions that are divided into three sections (Kasim, Muslem & Mustafa, 2019, p. 482). Phillips (2003, p. 22) stated that the first section has 30 questions based on a short conversation between two people. The second section is based on two 60-90-second conversations between two speakers in which 4-5 questions come after each of the conversations. The last section is three 60-90-second talks with 3-4 follow-up questions after each talk. Nemati, Qareqani, & Fumani (2016) proposed specific factors which predict item difficulties in listening comprehension of the PBT TOEFL. They recognize two major factors including infrequent vocabulary and the role of speakers. For the first factor, when unfamiliar vocabulary was used, the number of participants who could correctly answer the question was low compared to when only familiar vocabulary was used. Finally, the role of the speaker determines the difficulty of a question in the TOEFL PBT. When the speaker’s role is not familiar to the participants, the question is significantly more difficult. However, considering the three parts of the listening comprehension test, the first part was predicted to be the least difficult part because one of the problems in listening proposed by Nushi & Orouji (2020, p. 10), i.e. the problem of difficulty in focusing, is very minimum in this part. It is because the conversation is short, and thus does not require intense concentration. In addition, when the conversations are longer, as in the second and third parts of the test, students feel discouraged and bored (Hamouda, 2013, p. 125). C. Listening Strategies Proposed in Literature There is some debate about whether listening strategies need to be taught (Chen, 2010; Fathi, Derakhshan & Torabi, 2020; López, 2017; Sharaf, Mobaraki & Nia, 2018). Nation and Newton (2009, p. 66) claimed that listening strategies are not applicable for a test taker. However, Fathi & Hamidizadeh (2019) were convinced that mastering strategies for listening can improve student’s listening skills. Some language teachers also favor the idea that listening strategies are helpful for students (Golubovich, Tolentino & Papageorgiou, 2018, p. 5). See Table 1 for the listening strategies that was proposed by Nation and Newton (2009.) Mustafa, M & Putra, T.M., Strategies Proposed for Listening Comprehension 221 in PBT TOEFL: Tricks that Do Not Work https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ Table 1: Listening Strategies Proposed by Nation and Newton (2009) No. Strategies Examples 1 Communication strategies Strategies to assist comprehension 1. Making prediction before listening 2. Listening selectively 3. Knowing how to interrupt politely Learning strategies Strategies for noticing language forms in the input in their independent listening 1. Negotiating 2. Listening for pattern 3. Focused listening The listening strategies proposed in Table 1 mostly apply to non-test situations. Oxford (1990, p. 49) provided a listening strategy which is applicable in testing situations, i.e. guessing intelligently. Oxford (1990, p. 91) listed linguistic clues and other clues as methods of intelligent guessing. Linguistic clues include suffixes, prefixes, and word order. Other clues which can help learners in making an intelligent guess are provided in the following table. Table 2: Other Clues for Guessing Proposed by Oxford (1990, pp. 92-94) No. Clues Example 1 Form of address Relationship between speakers: my dear friend Distance or respect: formal vous or lhr (you) Status: Herr Doctor Professor (Mr. Dr. Professor) 2 Non-verbal items: tone of voice, emphasis 1. Tone of voice 2. Emphasis 3 What was already said Policeman using the word grilling in questioning a suspect does not refer to any act of cooking. 4 Perceptual clues Background noise 222 Celt: A Journal of Culture, English Language Teaching & Literature, Volume 20, Number 2, December 2020, pp. 217 – 234 https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ 5 Text structure Transition: First ….. Second … . Third … Numbers: The two main points are ... Structural clues: We will now turn to …… 6 Description of people Sinister person Unknown words used to describe the person relate to sinisterness or cruelty 7 General background knowledge 1. Knowledge of the target culture 2. Knowledge of the topic under discussion 3. General world knowledge of current affairs, art, politics, and literature Previous research has studied the application of listening strategies in language tests. Among others, Dong (2016) found that listening strategies did not correlate with listening performance among highly motivated learners. However, Moradi (2013) found that undergraduate freshmen given listening strategy instruction outperformed those who were not given any instruction in a TOEFL listening test. Furthermore, a research study also discovered that, in terms of listening proficiency, there were no evident differences between those who were given strategy training and those who were not (Chen, 2010). Gholaminejad (2014) showed that strategy instruction benefits low-proficiency learners less than others. D. Listening Strategies Proposed in Phillips (2003) Preparation Course for the TOEFL Test written by Deborah Phillips provides strategies for each of the 3 parts of the listening comprehension section of the TOEFL test as follows: 1. Part A. Short Conversation Phillips (2003) proposed 17 strategies termed “Skill,” that are categorized into six groups. Each strategy is provided with a definition and steps, as in the following example. Strategy #1: Focus on the second line a. The second line of the conversation probably contains the answer to the question. Mustafa, M & Putra, T.M., Strategies Proposed for Listening Comprehension 223 in PBT TOEFL: Tricks that Do Not Work https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ b. Listen to the first line of the conversation. If you understand it, that’s good. If you don’t understand it, don’t worry because it probably does not contain the answer. c. Be ready to focus on the second line of the conversation because it probably contains the answer. Repeat the second line in your mind as you read through the answer in the text. The complete list of strategies proposed by Phillips (2003) for Part A is presented in the following table. Table 3: Strategies for Answering the Listening Comprehension Test in Part A No. Groups Strategies 1-3 Strategies Focus on the second line Choose answers with synonyms Avoid similar sounds 4-6 Who, What, and Where Draw conclusion about who, what, where Listen for who and what in passive Listen for who and what with multiple nouns 7-10 Negatives Listen for negative expression Listen for double negative expressions Listen for “almost negative” expressions Listen for negative with comparatives 11-13 Functions Listen for expression of agreement Listen for expression of uncertainty and suggestion Listen for emphatic expression of surprise 14-15 Contrary Meaning Listen for wishes Listen for untrue conditions 16-17 Idiomatic language Listen for two- and three-part verbs Listen for idioms 2. Part B and Part C. Long Conversation and Long Talk Strategies for Part B proposed by Phillips (2003) are similar to those of Part C. The strategies are divided into two phases, i.e. before listening and while listening. Table 4 presents these strategies. 224 Celt: A Journal of Culture, English Language Teaching & Literature, Volume 20, Number 2, December 2020, pp. 217 – 234 https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ Table 4: Strategies for the Listening Comprehension Test in Part B and Part C No Phases Strategies 1-2 Before listening Anticipate the topics Anticipate the questions 3-5 While listening Determine the topic Draw conclusions about who, what, when, and where Listen for answers in order METHOD To collect the data for this research, nine samples of the test published by the Educational Testing Service (ETS) were used. The tests were once used for official tests and, therefore, authentic and suitable for the purposes of the study. The tests come in three different publications, as presented in Table 5. Table 5: List of Published TOEFL Test Materials for Data Collection No. Name of Publication Year of Publication Number of Tests 1 TOEFL Test Preparation Kit Volume 1 1998 4 tests 2 TOEFL Test Preparation Kit Volume 2 2000 3 tests 3 TOEFL Practice Test Volume 1 2003 2 tests This research comprised two stages of analysis. In stage one, each number in each test from all publications in Table 5 was matched to the strategies proposed in Preparation Course for the TOEFL Test written by Deborah Phillips. This book was popular because it is very easy to use, and the topics presented in the books are systematic. Both practice tests in each topic and the complete practice tests provided in the book are relevant to the topics discussed in the book. The earlier version of this book, published in 1989, provided practice tests which are very close to the real TOEFL designed Mustafa, M & Putra, T.M., Strategies Proposed for Listening Comprehension 225 in PBT TOEFL: Tricks that Do Not Work https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ by ETS from the early to mid-1990s, though only for the Structure and Reading Comprehension sections. In the second stage, the items that have matches in the strategies were analyzed to find out whether the strategies can actually be applied to answer the questions. In the analysis, the writer answered the following questions: 1. Will the strategy narrow down the number of potentially-correct options? 2. How many distractors can the strategies eliminate? The questions above were constructed with the consideration that if the strategies are effective, they need to give a high chance of obtaining good scores when the strategies are applied in taking the test. To answer the questions, the authors read the recording script, either the second speaker or both speakers as suggested by the strategies, and the options in the test material. Using the strategy, the authors decided which distractors can be eliminated. The strategies were considered to work perfectly when all three distractors could be eliminated. The listening comprehension section in the PBT TOEFL comprises three parts, i.e. Part A, Part B, and Part C. Phillips (2003) did not propose specific strategies for Parts B and Part C. Therefore, the analysis in this study was restricted to the 17 strategies of Part A. The results of both stages of analysis are presented via percentages in the following sections. The percentage for applicable strategies was obtained by dividing the number of questions for which the strategies were applicable by the total number of questions, i.e. 270 (30 questions in nine tests). The percentage for distractor elimination was calculated by dividing the number of strategies which can eliminate a certain number of distractors by the number of questions for which the strategies are applicable. RESULTS Based on the data collected from test materials published by ETS, not all strategies proposed by Phillips are potentially applicable in completing the real TOEFL. The results are presented in two tables. The first table reveals how many strategies can be potentially implemented during the test. The latter explains how many distractors that the strategies can eliminate. 226 Celt: A Journal of Culture, English Language Teaching & Literature, Volume 20, Number 2, December 2020, pp. 217 – 234 https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ Table 6: Strategies Applicable for TOEFL Designed by ETS No. Strategies Potentially applicable Percentage 1 Focus on the second line 237 87.78% 2 Choose answers with synonyms 76 28.15% 3 Avoid similar sounds 235 87.04% 4 Draw conclusion about who, what, where 22 8.15% 5 Listen for who and what in passive 0 0.00% 6 Listen for who and what with multiple nouns 0 0.00% 7 Listen for negative expression 2 0.74% 8 Listen for double negative expressions 1 0.37% 9 Listen for “almost negative” expressions 0 0.00% 10 Listen for negative with comparatives 0 0.00% 11 Listen for expression of agreement 2 0.74% 12 Listen for expression of uncertainty and suggestion 21 7.78% 13 Listen for emphatic expression of surprise 4 1.48% 14 Listen for wishes 3 1.11% 15 Listen for untrue conditions 3 1.11% 16 Listen for two- and three-part verbs 4 1.48% 17 Listen for idioms 7 2.59% Table 6 shows that the majority of questions can potentially be answered using the strategy of focusing on the second speaker (88%) and the strategy of avoiding similar sounds (87%). Two of the strategies can sometimes be applied in the real TOEFL, i.e. drawing conclusion (8%) and expression of suggestion and uncertainty (8%). However, the other strategies proposed by Phillips (2003) can rarely be applied (<3%). Regardless of their potential applicability, few strategies can actually be applied to correctly answer the questions in the TOEFL. These results are presented in Table 7. Mustafa, M & Putra, T.M., Strategies Proposed for Listening Comprehension 227 in PBT TOEFL: Tricks that Do Not Work https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ Table 7: Number of distractors eliminated by proposed strategies No. Strategies Distractor elimination 0 1 2 3 1 Focus on the second line 0% 4% 26% 70% 2 Choose answers with synonyms 3% 1% 9% 87% 3 Avoid similar sounds 0% 29% 48% 23% 4 Draw conclusion about who, what, where 9% 5% 5% 82% 5 Listen for who and what in passive 0% 0% 0% 100% 6 Listen for who and what with multiple nouns 100% 0% 0% 0% 7 Listen for negative expression 0% 0% 0% 100% 8 Listen for double negative expressions 50% 0% 0% 50% 9 Listen for “almost negative” expressions 67% 0% 0% 33% 10 Listen for negative with comparatives 25% 0% 25% 50% 11 Listen for expression of agreement 67% 0% 0% 33% 12 Listen for expression of uncertainty & suggestion 75% 0% 0% 25% 13 Listen for emphatic expression of surprise 50% 0% 0% 50% 14 Listen for wishes 100% 0% 0% 0% Table 7 shows that when strategies are applicable, the strategies can eliminate all distractors except for negative expression and idioms, none of which can be eliminated. In Table 7, some strategies can only eliminate one distractor, which narrows down the chance of selecting the correct answer. Other strategies can eliminate two distractors, and the others can eliminate all distractors, leaving only the correct answer. However, regardless of their potential application, many strategies cannot be used to eliminate any distractors. DISCUSSION The objective of this research was to find out whether the strategies for answering listening comprehension questions in the PBT TOEFL as proposed 228 Celt: A Journal of Culture, English Language Teaching & Literature, Volume 20, Number 2, December 2020, pp. 217 – 234 https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ by Phillips (2003) are applicable in taking the real TOEFL. The data were collected by finding matches between strategies proposed and nine historic listening tests designed by ETS. The results show that most strategies are not applicable. Some strategies are potentially applicable but they cannot eliminate distractors and thus cannot lead to correct answers. The most potentially-applicable strategy was “focus on the second speaker.” The study found that 88 percent of the questions can be answered only by listening to the second speaker in the conversation of Part A. However, this strategy can only be applied when a test taker can comprehend what the speaker says. In the case that the test taker does not completely understand what the second speaker says, the book suggests that he or she select an answer which has the synonym of keywords that they recognized from the conversation. This strategy can be applied to 28% of the questions and all distractors from 87% of those questions can be eliminated. When the test taker does not understand any of the conversations, the book recommends that the test taker avoid choosing the options which sound similar to what the test taker hears in the conversation. This strategy is potentially applicable to 87% of the questions, but all distractors can be eliminated in only 23% of them, two distractors in 48%, and one distractor in 29% (See Table 7). The book provides a strategy to answer questions about who, what and where. The test taker is suggested to pay attention to keywords in the conversation in order to draw conclusions about who the speakers are, what they are speaking about, and where the conversation takes place. Based on the analysis, this strategy has matches in 8.15% of the questions in the real test. This strategy is very effective because it can eliminate all distractors in 87% of those questions. However, test-takers need to have a wide range of vocabulary to make such conclusions. In fact, Wang and Treffers-Daller (2017, p. 148) found that vocabulary is one of the strongest predictors of listening comprehension. For the strategy of listen for uncertainty and suggestion, the book only provides the way to identify the skill tested. For expressions of uncertainty, the speaker usually uses ... isn’t it (tag), as far as I know, or as far as I can tell. In the real test, however, only two out of 270 questions can be identified by using this strategy. For expressions of suggestion, the book suggests to listen to the expressions Why not and Let’s because those expressions signal suggestion. However, among 20 questions (7.4%), only 6 of them (30%) use Why not and Let’s. In short, this strategy is not very useful for a Mustafa, M & Putra, T.M., Strategies Proposed for Listening Comprehension 229 in PBT TOEFL: Tricks that Do Not Work https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ test taker. In addition, the strategy does not state how identifying the expressions helps the test taker to determine the answer to the questions. Idioms are found in the listening section of every TOEFL. There were seven questions found in the nine tests analyzed in this research. Phillips (2003) provided a list of 48 idioms. However, none listed in her book appears in the actual tests. According to Rafatbakhsh & Ahmadi (2020, p. 212), there are more than 5,000 idioms in English. Therefore, the chance that the idioms in Phillips’ list appear in the TOEFL is less than 1%. However, the meaning of idioms can be determined if the test taker understands the context (Rafatbakhsh & Ahmadi, 2019, p. 17). Therefore, high-achieving listeners will most likely be able to answer the questions about idioms although they are not familiar with the tested idioms. Oakhill, Cain, & Nesi (2016, p. 133) also found that the understanding of idioms is not related to the understanding of the expression, suggesting that learning the meaning of idioms in isolation is not necessary. In short, the list provided by Phillips (2003) is not very useful. Other strategies proposed by Phillips (2003), as presented in Table 7, have no better applicability in answering the questions than the above strategies because they have limited matches in the real tests. In addition, most of the strategies that have matches cannot eliminate distractors. For a strategy to work in the test, it should be able to eliminate all the distractors in the tests, leaving only the correct answer. CONCLUSION The research results have found that only two strategies (i.e. focus on the second speaker and avoid similar sounds) have matches in more than 80% of the questions in the real TOEFL. Three strategies (i.e. choosing answers with synonyms, draw conclusion about who, what, and where, and listen for expression of uncertainty and suggestion) have matches between 8% and 28%. The other strategies rarely have matches (<3%). The most successful strategy, which had the most frequent matches in the real test, can only be applied if the test-takers understand the conversation. The second most successful strategy is only applicable if the test takers have sufficient vocabulary. The next three strategies, which have matches between 8% and 28%, can rarely eliminate all distractors. To conclude, strategies proposed by Phillips (2003) cannot successfully be applied to answer the questions in Part A of the Listening Comprehension section in the real TOEFL. However, the decision regarding whether the strategies matched the test items was based solely on the 230 Celt: A Journal of Culture, English Language Teaching & Literature, Volume 20, Number 2, December 2020, pp. 217 – 234 https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ researchers’ judgment. No real test takers were involved in confirming the findings. To overcome this limitation, further study should experiment by teaching students the strategies proposed by Phillips (2003) and compare their scores before and after they are taught the strategies. As a pedagogical implication, the listening sections in standardized tests such as the TOEFL and IELTS are intended to measure the students’ listening comprehension level. Therefore, in preparation courses, students should be taught to improve the level of their listening ability. It is suggested that teachers help improve their students’ listening comprehension by using movies, involving pre-viewing and post-viewing (Amalia, Kusrini, Ramadhani, 2019). Movies are also recommended for independent learning (Safranj, 2015). Another useful technique of improving students’ listening comprehension is through transcribing tasks (Shafiee & Rahimi, 2012). Students are provided with a podcast or other audio and are asked to transcribe it. According to Dinmore and Gao (2016, p. 198), not only is it useful in forming an awareness and for feedbacks, transcribing authentic texts also improves listening skills through word recognition enhancement. ACKNOWLEDGMENT The authors are indebted to anonymous reviewers for their comments on earlier versions of this article which had initially been scheduled for presentation at Syiah Kuala University Annual International Conference for Social Sciences. This research received no specific grant from any funding agency. REFERENCES Amalia, E. R., Kusrini, N. R., & Ramadhani, P. (2019). Using films to teach listening comprehension. IJEE (Indonesian Journal of English Education), 6(2), 119-132. https://doi.org/10.15408/ijee.v6i2.14531 Bisson, M.-J., Heuven, V., W. J. B., Conklin, K., & Tunney, R. J. (2012). Processing of native and foreign language subtitles in films: An eye tracking study. Applied Psycholinguistics, 35, 1–20. Chen, A. H. (2010). Effects of listening strategy training for EFL adult listeners. Journal of Asia TEFL, 7(1), 135–169. Mustafa, M & Putra, T.M., Strategies Proposed for Listening Comprehension 231 in PBT TOEFL: Tricks that Do Not Work https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ Dinmore, S., & Gao, J. (2016). Voice-to-text transcription of lecture recording. In S. Barker, S. Dawson, A. Pardo, & C. Colvin (Eds.), Show Me The Learning. Proceedings ASCILITE (pp. 197-202). Adelaide. Dong, J. (2016). A dynamic systems theory approach to development of listening strategy use and listening performance. System, 63, 149-165. Elfiondri, Kasim, U., Mustafa, F., & Putra, T. M. (2020). Reading comprehension in the TOEFL PBT: Which sub-skill deserves more intensive training? TESOL International Journal, 15(1), 53–64. ETS. (2011). TOEFL iBT research insight Vol 6. TOEFL Program History (Vol. 6). New Jersey: Educational Testing Service. ETS. (2020). Information for TOEFL iBT® score users, teachers, and learners (3rd ed., Vol. 5). Educational Testing Service. Fathi, J., Derakhshan, A., & Torabi, S. (2020). The effect of listening strategy instruction on second language listening anxiety and self-efficacy of Iranian EFL learners. SAGE Open, 10(2), 1–13. https://doi.org/10.1177/2158244020933878 Fathi, J., & Hamidizadeh, R. (2019). The contribution of listening strategy instruction to improving second language listening comprehension: A case of Iranian EFL learners. International Journal of Instruction, 12(2), 17– 32. https://doi.org/10.29333/iji.2019.1222a Gholaminejad, R. (2014). Feasibility of strategy instruction in teaching listening comprehension for high-proficiency and low-proficiency Iranian EFL learners. Higher Educational of Social Science, 7(2), 1–4. https://doi.org/10.3968/5332 Golubovich, J., Tolentino, F., & Papageorgiou, S. (2018). Examining the applications and opinions of the TOEFL ITP® assessment series test scores in three countries. ETS Research Report Series, 2018(1), 1–30. https://doi.org/10.1002/ets2.12231 Hamouda, A. (2013). An investigation of listening comprehension problems encountered by Saudi students in the EL listening classroom. International Journal of Academic Research in Progressive Education and 232 Celt: A Journal of Culture, English Language Teaching & Literature, Volume 20, Number 2, December 2020, pp. 217 – 234 https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ López, M. N. (2017). Listening strategies instruction: effects on Hong Kong students’ general strategic behaviour. Asian-Pacific Journal of Second and Foreign Language Education, 2(1), 1–15. https://doi.org/10.1186/s40862- 017-0029-8 Kasim, U., Muslem, A., & Mustafa, F. (2019). Differences in English proficiency test scores between students of social and natural sciences. International Journal of Instruction, 12(1), 479–492. https://doi.org/10.29333/iji.2019.12131a Megawati, M., Mustafa, F., & Bahri Ys, S. (2016). Listening to real English: How much do EFL students in Indonesia understand a native speaker’s spoken language? Paper presented at the Proceedings of English Education International Conference, Banda Aceh. Moradi, K. (2013). The Impact of Listening Strategy Instruction on Academic Lecture Comprehension: A Case of Iranian EFL Learners. Procedia - Social and Behavioral Sciences, 70, 406–416. Munoz, C. (2013). Explicit learning in second language acquisition. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics. Oxford: Wiley- Blackwell. Mustafa, F. (2015). Using corpora to design a reliable test instrument for English proficiency assessment. In TEFLIN International Conference (pp. 344–352). Denpasar. Mustafa, F., & Sofyan, H. (2018). Comparing the scores in paper and internet- delivered TOEFL: Can an unsupervised online English language test be used for placement? Asian EFL Journal, 20(12), 269–291. Muthalib, K. A., Bahri Ys, S., & Mustafa, F. (2019). Why are you different? Investigating reasons of success by high achieving EFL students. Asian EFL Journal, 21(2), 166–182. Nation, I. S. P., & Newton, J. (2009). Teaching ESL / EFL listening and speaking. New York: Routledge. Nemati, A., Qareqani, K., & Fumani, M. R. F. Q. (2016). The investigation of listening comprehension problems of American accents for Iranian B.A. students of translation studies. Online Journal of Humanities, 1(1), 1–8. Mustafa, M & Putra, T.M., Strategies Proposed for Listening Comprehension 233 in PBT TOEFL: Tricks that Do Not Work https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ Nushi, M., & Orouji, F. (2020). Investigating EFL teachers’ views on listening difficulties among their learners: The case of Iranian context. SAGE Open, 10(2), 1–16. https://doi.org/10.1177/2158244020917393 Oakhill, J., Cain, K., & Nesi, B. (2016). Understanding of idiomatic expressions in context in skilled and less skilled comprehenders: Online processing and interpretation. Scientific Studies of Reading, 20(2), 124-139. Oxford, R. L. (1990). Language learning strategies: What every teacher should know. Massachusetts: Heinle & Heinle Publishers. Phillips, D. (2003). Longman preparation course for the TOEFL test. New York: Pearson Education. Rafatbakhsh, E., & Ahmadi, A. (2019). A thematic corpus-based study of idioms in the Corpus of Contemporary American English. Asian-Pacific Journal of Second and Foreign Language Education, 4(11), 1–21. https://doi.org/10.1186/s40862-019-0076-4 Rafatbakhsh, E., & Ahmadi, A. (2020). The most frequent idioms used in contemporary American English: A corpus-based study. Applied Research on English Language, 9(2), 205–228. https://doi.org/10.22108/are.2019.114449.1389 Safranj, J. (2015). Advancing listening comprehension through movies. Procedia - Social and Behavioral Sciences, 191, 169-173. https://doi.org/10.1016/j.sbspro.2015.04.513 Salma, N. F. (2018). Almost everything about TOEFL PBT. University of Lancang Kuning: unpublished essay. https://doi.org/10.31219/osf.io/rnkmh Selamat, S., & Sidhu, G. K. (2013). Enhancing listening comprehension: The role of Metacognitive Strategy Instruction (MetSI). Procedia - Social and Behavioral Sciences, 90, 421 – 430. Shafiee, D., & Rahimi, A. (2012). An investigation of the effect of transcribing listening on Iranian EFL learners’ listening skill. International Journal of Applied Linguistics and English Literature, 1(6), 99-105. 234 Celt: A Journal of Culture, English Language Teaching & Literature, Volume 20, Number 2, December 2020, pp. 217 – 234 https://doi.org/10.24167/celt.v20i2; ISSN: 1412-3320 (print); ISSN: 2502-4914 (online); Accredited; DOAJ Sharaf, F. G., Mobaraki, M., & Nia, M. R. (2018). The effect of listening strategy instruction on Iranian pre-intermediate EFL learners’ listening ability. International Journal of Applied Linguistics and English Literature, 7(3), 188–192. https://doi.org/10.7575/aiac.ijalel.v.7n.3p.188 Walker, N. (2014). Listening: The most difficult skill to teach. Encuentro, 23, 167–175. Wang, Y., & Treffers-Daller, J. (2017). Explaining listening comprehension among L2 learners of English: The contribution of general language proficiency, vocabulary knowledge and metacognitive awareness. System, 65, 139-150.