id sid tid token lemma pos dad-10733 1 1 dialogue dialogue PROPN dad-10733 1 2 & & CCONJ dad-10733 1 3 discourse discourse PROPN dad-10733 1 4 9(1 9(1 NUM dad-10733 1 5 ) ) PUNCT dad-10733 1 6 ( ( PUNCT dad-10733 1 7 2018 2018 NUM dad-10733 1 8 ) ) PUNCT dad-10733 1 9 1–49 1–49 PROPN dad-10733 1 10 doi doi NOUN dad-10733 1 11 : : PUNCT dad-10733 1 12 10.5087 10.5087 NUM dad-10733 1 13 / / SYM dad-10733 1 14 dad.2018.101 dad.2018.101 NOUN dad-10733 1 15 a a DET dad-10733 1 16 survey survey NOUN dad-10733 1 17 of of ADP dad-10733 1 18 available available ADJ dad-10733 1 19 corpora corpora PROPN dad-10733 1 20 for for ADP dad-10733 1 21 building build VERB dad-10733 1 22 data data NOUN dad-10733 1 23 - - PUNCT dad-10733 1 24 driven drive VERB dad-10733 1 25 dialogue dialogue NOUN dad-10733 1 26 systems system NOUN dad-10733 1 27 : : PUNCT dad-10733 1 28 the the DET dad-10733 1 29 journal journal PROPN dad-10733 1 30 version version PROPN dad-10733 1 31 iulian iulian PROPN dad-10733 1 32 vlad vlad PROPN dad-10733 1 33 serban serban PROPN dad-10733 1 34 { { PUNCT dad-10733 1 35 iulian.vlad.serban iulian.vlad.serban PROPN dad-10733 1 36 } } PUNCT dad-10733 1 37 at at ADP dad-10733 1 38 umontreal umontreal ADJ dad-10733 1 39 dot dot NOUN dad-10733 1 40 ca can AUX dad-10733 1 41 mila mila X dad-10733 1 42 , , PUNCT dad-10733 1 43 diro diro NOUN dad-10733 1 44 , , PUNCT dad-10733 1 45 université université ADJ dad-10733 1 46 de de ADP dad-10733 1 47 montréal montréal PROPN dad-10733 1 48 2920 2920 NUM dad-10733 1 49 chemin chemin X dad-10733 1 50 de de X dad-10733 1 51 la la PROPN dad-10733 1 52 tour tour NOUN dad-10733 1 53 , , PUNCT dad-10733 1 54 montréal montréal PROPN dad-10733 1 55 , , PUNCT dad-10733 1 56 qc qc PROPN dad-10733 1 57 h3c h3c PROPN dad-10733 1 58 3j7 3j7 PROPN dad-10733 1 59 , , PUNCT dad-10733 1 60 canada canada PROPN dad-10733 1 61 ryan ryan PROPN dad-10733 1 62 lowe lowe PROPN dad-10733 1 63 { { PUNCT dad-10733 1 64 ryan.lowe ryan.lowe X dad-10733 1 65 } } PUNCT dad-10733 1 66 at at ADP dad-10733 1 67 mail mail NOUN dad-10733 1 68 dot dot NOUN dad-10733 1 69 mcgill mcgill NOUN dad-10733 1 70 dot dot NOUN dad-10733 1 71 ca can AUX dad-10733 1 72 school school NOUN dad-10733 1 73 of of ADP dad-10733 1 74 computer computer NOUN dad-10733 1 75 science science NOUN dad-10733 1 76 , , PUNCT dad-10733 1 77 mcgill mcgill PROPN dad-10733 1 78 university university PROPN dad-10733 1 79 3480 3480 NUM dad-10733 1 80 university university PROPN dad-10733 1 81 st st PROPN dad-10733 1 82 , , PUNCT dad-10733 1 83 montréal montréal PROPN dad-10733 1 84 , , PUNCT dad-10733 1 85 qc qc PROPN dad-10733 1 86 h3a h3a NOUN dad-10733 1 87 0e9 0e9 NOUN dad-10733 1 88 , , PUNCT dad-10733 1 89 canada canada PROPN dad-10733 1 90 peter peter PROPN dad-10733 1 91 henderson henderson PROPN dad-10733 1 92 { { PUNCT dad-10733 1 93 peter.henderson peter.henderson PROPN dad-10733 1 94 } } PUNCT dad-10733 1 95 at at ADP dad-10733 1 96 mail mail NOUN dad-10733 1 97 dot dot NOUN dad-10733 1 98 mcgill mcgill NOUN dad-10733 1 99 dot dot NOUN dad-10733 1 100 ca can AUX dad-10733 1 101 school school NOUN dad-10733 1 102 of of ADP dad-10733 1 103 computer computer NOUN dad-10733 1 104 science science NOUN dad-10733 1 105 , , PUNCT dad-10733 1 106 mcgill mcgill PROPN dad-10733 1 107 university university PROPN dad-10733 1 108 3480 3480 NUM dad-10733 1 109 university university PROPN dad-10733 1 110 st st PROPN dad-10733 1 111 , , PUNCT dad-10733 1 112 montréal montréal PROPN dad-10733 1 113 , , PUNCT dad-10733 1 114 qc qc PROPN dad-10733 1 115 h3a h3a NOUN dad-10733 1 116 0e9 0e9 NOUN dad-10733 1 117 , , PUNCT dad-10733 1 118 canada canada PROPN dad-10733 1 119 laurent laurent PROPN dad-10733 1 120 charlin∗ charlin∗ VERB dad-10733 1 121 { { PUNCT dad-10733 1 122 laurent.charlin laurent.charlin NOUN dad-10733 1 123 } } PUNCT dad-10733 1 124 at at ADP dad-10733 1 125 hec hec PROPN dad-10733 1 126 dot dot NOUN dad-10733 1 127 ca ca NOUN dad-10733 1 128 department department NOUN dad-10733 1 129 of of ADP dad-10733 1 130 decision decision NOUN dad-10733 1 131 sciences science NOUN dad-10733 1 132 , , PUNCT dad-10733 1 133 hec hec PROPN dad-10733 1 134 montréal montréal PROPN dad-10733 1 135 3000 3000 NUM dad-10733 1 136 , , PUNCT dad-10733 1 137 chemin chemin X dad-10733 1 138 de de X dad-10733 1 139 la la X dad-10733 1 140 côte côte PROPN dad-10733 1 141 - - PUNCT dad-10733 1 142 sainte sainte NOUN dad-10733 1 143 - - PUNCT dad-10733 1 144 catherine catherine PROPN dad-10733 1 145 , , PUNCT dad-10733 1 146 montréal montréal PROPN dad-10733 1 147 , , PUNCT dad-10733 1 148 qc qc PROPN dad-10733 1 149 h3 h3 PROPN dad-10733 1 150 t t PROPN dad-10733 1 151 2a7 2a7 NUM dad-10733 1 152 , , PUNCT dad-10733 1 153 canada canada PROPN dad-10733 1 154 joelle joelle PROPN dad-10733 1 155 pineau pineau PROPN dad-10733 1 156 { { PUNCT dad-10733 1 157 jpineau jpineau PROPN dad-10733 1 158 } } PUNCT dad-10733 1 159 at at ADP dad-10733 1 160 cs cs ADJ dad-10733 1 161 dot dot NOUN dad-10733 1 162 mcgill mcgill NOUN dad-10733 1 163 dot dot NOUN dad-10733 1 164 ca can AUX dad-10733 1 165 school school NOUN dad-10733 1 166 of of ADP dad-10733 1 167 computer computer NOUN dad-10733 1 168 science science NOUN dad-10733 1 169 , , PUNCT dad-10733 1 170 mcgill mcgill PROPN dad-10733 1 171 university university PROPN dad-10733 1 172 3480 3480 NUM dad-10733 1 173 university university PROPN dad-10733 1 174 st st PROPN dad-10733 1 175 , , PUNCT dad-10733 1 176 montréal montréal PROPN dad-10733 1 177 , , PUNCT dad-10733 1 178 qc qc PROPN dad-10733 1 179 h3a h3a NOUN dad-10733 1 180 0e9 0e9 NOUN dad-10733 1 181 , , PUNCT dad-10733 1 182 canada canada PROPN dad-10733 1 183 editor editor NOUN dad-10733 1 184 : : PUNCT dad-10733 1 185 david david PROPN dad-10733 1 186 traum traum PROPN dad-10733 1 187 submitted submit VERB dad-10733 1 188 12/2015 12/2015 NUM dad-10733 1 189 ; ; PUNCT dad-10733 1 190 accepted accept VERB dad-10733 1 191 03/2018 03/2018 NUM dad-10733 1 192 ; ; PUNCT dad-10733 1 193 published publish VERB dad-10733 1 194 online online PROPN dad-10733 1 195 05/2018 05/2018 NOUN dad-10733 1 196 abstract abstract ADV dad-10733 1 197 during during ADP dad-10733 1 198 the the DET dad-10733 1 199 past past ADJ dad-10733 1 200 decade decade NOUN dad-10733 1 201 , , PUNCT dad-10733 1 202 several several ADJ dad-10733 1 203 areas area NOUN dad-10733 1 204 of of ADP dad-10733 1 205 speech speech NOUN dad-10733 1 206 and and CCONJ dad-10733 1 207 language language NOUN dad-10733 1 208 understanding understanding NOUN dad-10733 1 209 have have AUX dad-10733 1 210 witnessed witness VERB dad-10733 1 211 substantial substantial ADJ dad-10733 1 212 breakthroughs breakthrough NOUN dad-10733 1 213 from from ADP dad-10733 1 214 the the DET dad-10733 1 215 use use NOUN dad-10733 1 216 of of ADP dad-10733 1 217 data data NOUN dad-10733 1 218 - - PUNCT dad-10733 1 219 driven drive VERB dad-10733 1 220 models model NOUN dad-10733 1 221 . . PUNCT dad-10733 2 1 in in ADP dad-10733 2 2 the the DET dad-10733 2 3 area area NOUN dad-10733 2 4 of of ADP dad-10733 2 5 dialogue dialogue NOUN dad-10733 2 6 systems system NOUN dad-10733 2 7 , , PUNCT dad-10733 2 8 the the DET dad-10733 2 9 trend trend NOUN dad-10733 2 10 is be AUX dad-10733 2 11 less less ADV dad-10733 2 12 obvious obvious ADJ dad-10733 2 13 , , PUNCT dad-10733 2 14 and and CCONJ dad-10733 2 15 most most ADV dad-10733 2 16 practical practical ADJ dad-10733 2 17 systems system NOUN dad-10733 2 18 are be AUX dad-10733 2 19 still still ADV dad-10733 2 20 built build VERB dad-10733 2 21 through through ADP dad-10733 2 22 significant significant ADJ dad-10733 2 23 engineering engineering NOUN dad-10733 2 24 and and CCONJ dad-10733 2 25 expert expert NOUN dad-10733 2 26 knowledge knowledge NOUN dad-10733 2 27 . . PUNCT dad-10733 3 1 nevertheless nevertheless ADV dad-10733 3 2 , , PUNCT dad-10733 3 3 several several ADJ dad-10733 3 4 recent recent ADJ dad-10733 3 5 results result NOUN dad-10733 3 6 suggest suggest VERB dad-10733 3 7 that that SCONJ dad-10733 3 8 data data NOUN dad-10733 3 9 - - PUNCT dad-10733 3 10 driven drive VERB dad-10733 3 11 approaches approach NOUN dad-10733 3 12 are be AUX dad-10733 3 13 feasible feasible ADJ dad-10733 3 14 and and CCONJ dad-10733 3 15 quite quite ADV dad-10733 3 16 promising promising ADJ dad-10733 3 17 . . PUNCT dad-10733 4 1 to to PART dad-10733 4 2 facilitate facilitate VERB dad-10733 4 3 research research NOUN dad-10733 4 4 in in ADP dad-10733 4 5 this this DET dad-10733 4 6 area area NOUN dad-10733 4 7 , , PUNCT dad-10733 4 8 we we PRON dad-10733 4 9 have have AUX dad-10733 4 10 carried carry VERB dad-10733 4 11 out out ADP dad-10733 4 12 a a DET dad-10733 4 13 wide wide ADJ dad-10733 4 14 survey survey NOUN dad-10733 4 15 of of ADP dad-10733 4 16 publicly publicly ADV dad-10733 4 17 available available ADJ dad-10733 4 18 datasets dataset NOUN dad-10733 4 19 suitable suitable ADJ dad-10733 4 20 for for ADP dad-10733 4 21 data data NOUN dad-10733 4 22 - - PUNCT dad-10733 4 23 driven drive VERB dad-10733 4 24 learning learning NOUN dad-10733 4 25 of of ADP dad-10733 4 26 dialogue dialogue NOUN dad-10733 4 27 systems system NOUN dad-10733 4 28 . . PUNCT dad-10733 5 1 we we PRON dad-10733 5 2 discuss discuss VERB dad-10733 5 3 important important ADJ dad-10733 5 4 characteristics characteristic NOUN dad-10733 5 5 of of ADP dad-10733 5 6 these these DET dad-10733 5 7 datasets dataset NOUN dad-10733 5 8 , , PUNCT dad-10733 5 9 how how SCONJ dad-10733 5 10 they they PRON dad-10733 5 11 can can AUX dad-10733 5 12 be be AUX dad-10733 5 13 used use VERB dad-10733 5 14 to to PART dad-10733 5 15 learn learn VERB dad-10733 5 16 various various ADJ dad-10733 5 17 components component NOUN dad-10733 5 18 of of ADP dad-10733 5 19 a a DET dad-10733 5 20 dialogue dialogue NOUN dad-10733 5 21 system system NOUN dad-10733 5 22 , , PUNCT dad-10733 5 23 and and CCONJ dad-10733 5 24 their their PRON dad-10733 5 25 other other ADJ dad-10733 5 26 potential potential ADJ dad-10733 5 27 uses use NOUN dad-10733 5 28 . . PUNCT dad-10733 6 1 we we PRON dad-10733 6 2 also also ADV dad-10733 6 3 examine examine VERB dad-10733 6 4 methods method NOUN dad-10733 6 5 for for ADP dad-10733 6 6 transfer transfer NOUN dad-10733 6 7 learning learning NOUN dad-10733 6 8 between between ADP dad-10733 6 9 datasets dataset NOUN dad-10733 6 10 and and CCONJ dad-10733 6 11 the the DET dad-10733 6 12 use use NOUN dad-10733 6 13 of of ADP dad-10733 6 14 external external ADJ dad-10733 6 15 knowledge knowledge NOUN dad-10733 6 16 . . PUNCT dad-10733 7 1 finally finally ADV dad-10733 7 2 , , PUNCT dad-10733 7 3 we we PRON dad-10733 7 4 discuss discuss VERB dad-10733 7 5 appropriate appropriate ADJ dad-10733 7 6 choices choice NOUN dad-10733 7 7 of of ADP dad-10733 7 8 evaluation evaluation NOUN dad-10733 7 9 metrics metric NOUN dad-10733 7 10 for for ADP dad-10733 7 11 the the DET dad-10733 7 12 learning learning NOUN dad-10733 7 13 objective objective NOUN dad-10733 7 14 . . PUNCT dad-10733 8 1 ∗. ∗. PROPN dad-10733 8 2 work work NOUN dad-10733 8 3 done do VERB dad-10733 8 4 primarily primarily ADV dad-10733 8 5 while while SCONJ dad-10733 8 6 author author NOUN dad-10733 8 7 was be AUX dad-10733 8 8 at at ADP dad-10733 8 9 mcgill mcgill PROPN dad-10733 8 10 university university PROPN dad-10733 8 11 c c PROPN dad-10733 8 12 © © PROPN dad-10733 8 13 2018 2018 NUM dad-10733 8 14 iulian iulian ADJ dad-10733 8 15 vlad vlad PROPN dad-10733 8 16 serban serban PROPN dad-10733 8 17 , , PUNCT dad-10733 8 18 ryan ryan PROPN dad-10733 8 19 lowe lowe PROPN dad-10733 8 20 , , PUNCT dad-10733 8 21 peter peter PROPN dad-10733 8 22 henderson henderson PROPN dad-10733 8 23 , , PUNCT dad-10733 8 24 laurent laurent PROPN dad-10733 8 25 charlin charlin PROPN dad-10733 8 26 , , PUNCT dad-10733 8 27 joelle joelle PROPN dad-10733 8 28 pineau pineau PROPN dad-10733 8 29 this this PRON dad-10733 8 30 is be AUX dad-10733 8 31 an an DET dad-10733 8 32 open open ADJ dad-10733 8 33 - - PUNCT dad-10733 8 34 access access NOUN dad-10733 8 35 article article NOUN dad-10733 8 36 distributed distribute VERB dad-10733 8 37 under under ADP dad-10733 8 38 the the DET dad-10733 8 39 terms term NOUN dad-10733 8 40 of of ADP dad-10733 8 41 a a DET dad-10733 8 42 creative creative ADJ dad-10733 8 43 commons common NOUN dad-10733 8 44 attribution attribution NOUN dad-10733 8 45 license license NOUN dad-10733 8 46 ( ( PUNCT dad-10733 8 47 http http NOUN dad-10733 8 48 : : PUNCT dad-10733 8 49 //creativecommons.org //creativecommons.org SYM dad-10733 8 50 / / SYM dad-10733 8 51 licenses license NOUN dad-10733 8 52 / / SYM dad-10733 8 53 by/3.0/ by/3.0/ NOUN dad-10733 8 54 ) ) PUNCT dad-10733 8 55 . . PUNCT dad-10733 9 1 serban serban PROPN dad-10733 9 2 , , PUNCT dad-10733 9 3 lowe lowe PROPN dad-10733 9 4 , , PUNCT dad-10733 9 5 henderson henderson PROPN dad-10733 9 6 , , PUNCT dad-10733 9 7 charlin charlin PROPN dad-10733 9 8 and and CCONJ dad-10733 9 9 pineau pineau PROPN dad-10733 9 10 1 1 NUM dad-10733 9 11 . . PUNCT dad-10733 9 12 introduction introduction NOUN dad-10733 9 13 dialogue dialogue NOUN dad-10733 9 14 systems system NOUN dad-10733 9 15 , , PUNCT dad-10733 9 16 also also ADV dad-10733 9 17 known know VERB dad-10733 9 18 as as ADP dad-10733 9 19 interactive interactive ADJ dad-10733 9 20 conversational conversational ADJ dad-10733 9 21 agents agent NOUN dad-10733 9 22 , , PUNCT dad-10733 9 23 virtual virtual ADJ dad-10733 9 24 agents agent NOUN dad-10733 9 25 or or CCONJ dad-10733 9 26 sometimes sometimes ADV dad-10733 9 27 chatterbots chatterbot NOUN dad-10733 9 28 , , PUNCT dad-10733 9 29 are be AUX dad-10733 9 30 useful useful ADJ dad-10733 9 31 in in ADP dad-10733 9 32 a a DET dad-10733 9 33 wide wide ADJ dad-10733 9 34 range range NOUN dad-10733 9 35 of of ADP dad-10733 9 36 applications application NOUN dad-10733 9 37 ranging range VERB dad-10733 9 38 from from ADP dad-10733 9 39 technical technical ADJ dad-10733 9 40 support support NOUN dad-10733 9 41 services service NOUN dad-10733 9 42 to to ADP dad-10733 9 43 language language NOUN dad-10733 9 44 learning learning NOUN dad-10733 9 45 tools tool NOUN dad-10733 9 46 and and CCONJ dad-10733 9 47 entertainment entertainment NOUN dad-10733 9 48 ( ( PUNCT dad-10733 9 49 young young ADJ dad-10733 9 50 et et PROPN dad-10733 9 51 al al PROPN dad-10733 9 52 . . PROPN dad-10733 9 53 , , PUNCT dad-10733 9 54 2013 2013 NUM dad-10733 9 55 ; ; PUNCT dad-10733 9 56 shawar shawar NOUN dad-10733 9 57 and and CCONJ dad-10733 9 58 atwell atwell PROPN dad-10733 9 59 , , PUNCT dad-10733 9 60 2007b 2007b NUM dad-10733 9 61 ) ) PUNCT dad-10733 9 62 . . PUNCT dad-10733 10 1 largescale largescale PROPN dad-10733 10 2 data data NOUN dad-10733 10 3 - - PUNCT dad-10733 10 4 driven drive VERB dad-10733 10 5 methods method NOUN dad-10733 10 6 , , PUNCT dad-10733 10 7 which which PRON dad-10733 10 8 use use VERB dad-10733 10 9 recorded record VERB dad-10733 10 10 data datum NOUN dad-10733 10 11 to to PART dad-10733 10 12 automatically automatically ADV dad-10733 10 13 infer infer VERB dad-10733 10 14 knowledge knowledge NOUN dad-10733 10 15 and and CCONJ dad-10733 10 16 strategies strategy NOUN dad-10733 10 17 , , PUNCT dad-10733 10 18 are be AUX dad-10733 10 19 becoming become VERB dad-10733 10 20 increasingly increasingly ADV dad-10733 10 21 important important ADJ dad-10733 10 22 in in ADP dad-10733 10 23 speech speech NOUN dad-10733 10 24 and and CCONJ dad-10733 10 25 language language NOUN dad-10733 10 26 understanding understanding NOUN dad-10733 10 27 and and CCONJ dad-10733 10 28 generation generation NOUN dad-10733 10 29 . . PUNCT dad-10733 11 1 speech speech NOUN dad-10733 11 2 recognition recognition NOUN dad-10733 11 3 performance performance NOUN dad-10733 11 4 has have AUX dad-10733 11 5 increased increase VERB dad-10733 11 6 tremendously tremendously ADV dad-10733 11 7 over over ADP dad-10733 11 8 the the DET dad-10733 11 9 last last ADJ dad-10733 11 10 decade decade NOUN dad-10733 11 11 due due ADP dad-10733 11 12 to to ADP dad-10733 11 13 innovations innovation NOUN dad-10733 11 14 in in ADP dad-10733 11 15 deep deep ADJ dad-10733 11 16 learning learning NOUN dad-10733 11 17 architectures architecture NOUN dad-10733 11 18 ( ( PUNCT dad-10733 11 19 hinton hinton PROPN dad-10733 11 20 et et PROPN dad-10733 11 21 al al PROPN dad-10733 11 22 . . PROPN dad-10733 11 23 , , PUNCT dad-10733 11 24 2012 2012 NUM dad-10733 11 25 ; ; PUNCT dad-10733 11 26 goodfellow goodfellow PROPN dad-10733 11 27 et et PROPN dad-10733 11 28 al al PROPN dad-10733 11 29 . . PROPN dad-10733 11 30 , , PUNCT dad-10733 11 31 2015 2015 NUM dad-10733 11 32 ) ) PUNCT dad-10733 11 33 . . PUNCT dad-10733 12 1 similarly similarly ADV dad-10733 12 2 , , PUNCT dad-10733 12 3 a a DET dad-10733 12 4 wide wide ADJ dad-10733 12 5 range range NOUN dad-10733 12 6 of of ADP dad-10733 12 7 datadriven datadriven ADJ dad-10733 12 8 machine machine NOUN dad-10733 12 9 learning learning NOUN dad-10733 12 10 methods method NOUN dad-10733 12 11 have have AUX dad-10733 12 12 been be AUX dad-10733 12 13 shown show VERB dad-10733 12 14 to to PART dad-10733 12 15 be be AUX dad-10733 12 16 effective effective ADJ dad-10733 12 17 for for ADP dad-10733 12 18 natural natural ADJ dad-10733 12 19 language language NOUN dad-10733 12 20 processing processing NOUN dad-10733 12 21 , , PUNCT dad-10733 12 22 including include VERB dad-10733 12 23 tasks task NOUN dad-10733 12 24 relevant relevant ADJ dad-10733 12 25 to to ADP dad-10733 12 26 dialogue dialogue NOUN dad-10733 12 27 , , PUNCT dad-10733 12 28 such such ADJ dad-10733 12 29 as as ADP dad-10733 12 30 dialogue dialogue NOUN dad-10733 12 31 act act NOUN dad-10733 12 32 classification classification NOUN dad-10733 12 33 ( ( PUNCT dad-10733 12 34 reithinger reithinger NOUN dad-10733 12 35 and and CCONJ dad-10733 12 36 klesen klesen PROPN dad-10733 12 37 , , PUNCT dad-10733 12 38 1997 1997 NUM dad-10733 12 39 ; ; PUNCT dad-10733 12 40 stolcke stolcke NOUN dad-10733 12 41 et et PROPN dad-10733 12 42 al al PROPN dad-10733 12 43 . . PROPN dad-10733 12 44 , , PUNCT dad-10733 12 45 2000 2000 NUM dad-10733 12 46 ) ) PUNCT dad-10733 12 47 , , PUNCT dad-10733 12 48 dialogue dialogue NOUN dad-10733 12 49 state state NOUN dad-10733 12 50 tracking tracking NOUN dad-10733 12 51 ( ( PUNCT dad-10733 12 52 thomson thomson NOUN dad-10733 12 53 and and CCONJ dad-10733 12 54 young young ADJ dad-10733 12 55 , , PUNCT dad-10733 12 56 2010 2010 NUM dad-10733 12 57 ; ; PUNCT dad-10733 12 58 wang wang PROPN dad-10733 12 59 and and CCONJ dad-10733 12 60 lemon lemon PROPN dad-10733 12 61 , , PUNCT dad-10733 12 62 2013 2013 NUM dad-10733 12 63 ; ; PUNCT dad-10733 12 64 ren ren PROPN dad-10733 12 65 et et PROPN dad-10733 12 66 al al PROPN dad-10733 12 67 . . PROPN dad-10733 12 68 , , PUNCT dad-10733 12 69 2013 2013 NUM dad-10733 12 70 ; ; PUNCT dad-10733 12 71 henderson henderson PROPN dad-10733 12 72 et et PROPN dad-10733 12 73 al al PROPN dad-10733 12 74 . . PROPN dad-10733 12 75 , , PUNCT dad-10733 12 76 2013 2013 NUM dad-10733 12 77 ; ; PUNCT dad-10733 12 78 williams williams PROPN dad-10733 12 79 et et PROPN dad-10733 12 80 al al PROPN dad-10733 12 81 . . PROPN dad-10733 12 82 , , PUNCT dad-10733 12 83 2013 2013 NUM dad-10733 12 84 ; ; PUNCT dad-10733 12 85 henderson henderson PROPN dad-10733 12 86 et et PROPN dad-10733 12 87 al al PROPN dad-10733 12 88 . . PROPN dad-10733 12 89 , , PUNCT dad-10733 12 90 2014c 2014c NUM dad-10733 12 91 ; ; PUNCT dad-10733 12 92 kim kim PROPN dad-10733 12 93 et et PROPN dad-10733 12 94 al al PROPN dad-10733 12 95 . . PROPN dad-10733 12 96 , , PUNCT dad-10733 12 97 2015 2015 NUM dad-10733 12 98 ) ) PUNCT dad-10733 12 99 , , PUNCT dad-10733 12 100 natural natural ADJ dad-10733 12 101 language language NOUN dad-10733 12 102 generation generation NOUN dad-10733 12 103 ( ( PUNCT dad-10733 12 104 langkilde langkilde NOUN dad-10733 12 105 and and CCONJ dad-10733 12 106 knight knight NOUN dad-10733 12 107 , , PUNCT dad-10733 12 108 1998 1998 NUM dad-10733 12 109 ; ; PUNCT dad-10733 12 110 oh oh INTJ dad-10733 12 111 and and CCONJ dad-10733 12 112 rudnicky rudnicky NOUN dad-10733 12 113 , , PUNCT dad-10733 12 114 2000 2000 NUM dad-10733 12 115 ; ; PUNCT dad-10733 12 116 walker walker PROPN dad-10733 12 117 et et PROPN dad-10733 12 118 al al PROPN dad-10733 12 119 . . PROPN dad-10733 12 120 , , PUNCT dad-10733 12 121 2002 2002 NUM dad-10733 12 122 ; ; PUNCT dad-10733 12 123 ratnaparkhi ratnaparkhi NOUN dad-10733 12 124 , , PUNCT dad-10733 12 125 2002 2002 NUM dad-10733 12 126 ; ; PUNCT dad-10733 12 127 stent stent NOUN dad-10733 12 128 et et PROPN dad-10733 12 129 al al PROPN dad-10733 12 130 . . PROPN dad-10733 12 131 , , PUNCT dad-10733 12 132 2004 2004 NUM dad-10733 12 133 ; ; PUNCT dad-10733 12 134 rieser rieser NOUN dad-10733 12 135 and and CCONJ dad-10733 12 136 lemon lemon NOUN dad-10733 12 137 , , PUNCT dad-10733 12 138 2010 2010 NUM dad-10733 12 139 ; ; PUNCT dad-10733 12 140 mairesse mairesse NOUN dad-10733 12 141 et et PROPN dad-10733 12 142 al al PROPN dad-10733 12 143 . . PROPN dad-10733 12 144 , , PUNCT dad-10733 12 145 2010 2010 NUM dad-10733 12 146 ; ; PUNCT dad-10733 12 147 mairesse mairesse NOUN dad-10733 12 148 and and CCONJ dad-10733 12 149 young young ADJ dad-10733 12 150 , , PUNCT dad-10733 12 151 2014 2014 NUM dad-10733 12 152 ; ; PUNCT dad-10733 12 153 wen wen PROPN dad-10733 12 154 et et PROPN dad-10733 12 155 al al PROPN dad-10733 12 156 . . PROPN dad-10733 12 157 , , PUNCT dad-10733 12 158 2015a 2015a NUM dad-10733 12 159 ; ; PUNCT dad-10733 12 160 sharma sharma PROPN dad-10733 12 161 et et PROPN dad-10733 12 162 al al PROPN dad-10733 12 163 . . PROPN dad-10733 12 164 , , PUNCT dad-10733 12 165 2016 2016 NUM dad-10733 12 166 ) ) PUNCT dad-10733 12 167 , , PUNCT dad-10733 12 168 and and CCONJ dad-10733 12 169 dialogue dialogue NOUN dad-10733 12 170 policy policy NOUN dad-10733 12 171 learning learning NOUN dad-10733 12 172 ( ( PUNCT dad-10733 12 173 young young ADJ dad-10733 12 174 et et PROPN dad-10733 12 175 al al PROPN dad-10733 12 176 . . PROPN dad-10733 12 177 , , PUNCT dad-10733 12 178 2013 2013 NUM dad-10733 12 179 ) ) PUNCT dad-10733 12 180 . . PUNCT dad-10733 13 1 recent recent ADJ dad-10733 13 2 advances advance NOUN dad-10733 13 3 in in ADP dad-10733 13 4 computing compute VERB dad-10733 13 5 power power NOUN dad-10733 13 6 , , PUNCT dad-10733 13 7 the the DET dad-10733 13 8 availability availability NOUN dad-10733 13 9 of of ADP dad-10733 13 10 large large ADJ dad-10733 13 11 public public ADJ dad-10733 13 12 datasets dataset NOUN dad-10733 13 13 , , PUNCT dad-10733 13 14 and and CCONJ dad-10733 13 15 the the DET dad-10733 13 16 development development NOUN dad-10733 13 17 of of ADP dad-10733 13 18 efficient efficient ADJ dad-10733 13 19 and and CCONJ dad-10733 13 20 effective effective ADJ dad-10733 13 21 machine machine NOUN dad-10733 13 22 learning learning NOUN dad-10733 13 23 models model NOUN dad-10733 13 24 has have AUX dad-10733 13 25 led lead VERB dad-10733 13 26 to to PART dad-10733 13 27 increases increase VERB dad-10733 13 28 attention attention NOUN dad-10733 13 29 and and CCONJ dad-10733 13 30 success success NOUN dad-10733 13 31 in in ADP dad-10733 13 32 data data NOUN dad-10733 13 33 - - PUNCT dad-10733 13 34 driven drive VERB dad-10733 13 35 dialogue dialogue NOUN dad-10733 13 36 systems system NOUN dad-10733 13 37 . . PUNCT dad-10733 14 1 importantly importantly ADV dad-10733 14 2 , , PUNCT dad-10733 14 3 the the DET dad-10733 14 4 use use NOUN dad-10733 14 5 of of ADP dad-10733 14 6 machine machine NOUN dad-10733 14 7 learning learning NOUN dad-10733 14 8 methods method NOUN dad-10733 14 9 — — PUNCT dad-10733 14 10 such such ADJ dad-10733 14 11 as as ADP dad-10733 14 12 neural neural ADJ dad-10733 14 13 networks network NOUN dad-10733 14 14 — — PUNCT dad-10733 14 15 require require VERB dad-10733 14 16 an an DET dad-10733 14 17 understanding understanding NOUN dad-10733 14 18 of of ADP dad-10733 14 19 the the DET dad-10733 14 20 availability availability NOUN dad-10733 14 21 , , PUNCT dad-10733 14 22 requirements requirement NOUN dad-10733 14 23 , , PUNCT dad-10733 14 24 and and CCONJ dad-10733 14 25 uses use VERB dad-10733 14 26 of of ADP dad-10733 14 27 available available ADJ dad-10733 14 28 dialogue dialogue NOUN dad-10733 14 29 corpora corpora PROPN dad-10733 14 30 . . PUNCT dad-10733 15 1 to to ADP dad-10733 15 2 this this DET dad-10733 15 3 end end NOUN dad-10733 15 4 , , PUNCT dad-10733 15 5 this this DET dad-10733 15 6 paper paper NOUN dad-10733 15 7 presents present VERB dad-10733 15 8 a a DET dad-10733 15 9 broad broad ADJ dad-10733 15 10 survey survey NOUN dad-10733 15 11 of of ADP dad-10733 15 12 available available ADJ dad-10733 15 13 dialogue dialogue NOUN dad-10733 15 14 corpora corpora PROPN dad-10733 15 15 . . PUNCT dad-10733 16 1 corpus corpus NOUN dad-10733 16 2 - - PUNCT dad-10733 16 3 based base VERB dad-10733 16 4 learning learning NOUN dad-10733 16 5 is be AUX dad-10733 16 6 not not PART dad-10733 16 7 the the DET dad-10733 16 8 only only ADJ dad-10733 16 9 approach approach NOUN dad-10733 16 10 to to ADP dad-10733 16 11 training training NOUN dad-10733 16 12 dialogue dialogue NOUN dad-10733 16 13 systems system NOUN dad-10733 16 14 . . PUNCT dad-10733 17 1 researchers researcher NOUN dad-10733 17 2 have have AUX dad-10733 17 3 also also ADV dad-10733 17 4 proposed propose VERB dad-10733 17 5 training training NOUN dad-10733 17 6 dialogue dialogue NOUN dad-10733 17 7 systems system NOUN dad-10733 17 8 online online ADV dad-10733 17 9 through through ADP dad-10733 17 10 live live ADJ dad-10733 17 11 interaction interaction NOUN dad-10733 17 12 with with ADP dad-10733 17 13 humans human NOUN dad-10733 17 14 , , PUNCT dad-10733 17 15 and and CCONJ dad-10733 17 16 offline offline ADJ dad-10733 17 17 using use VERB dad-10733 17 18 user user NOUN dad-10733 17 19 simulator simulator NOUN dad-10733 17 20 models model NOUN dad-10733 17 21 and and CCONJ dad-10733 17 22 reinforcement reinforcement NOUN dad-10733 17 23 learning learning NOUN dad-10733 17 24 methods method NOUN dad-10733 17 25 ( ( PUNCT dad-10733 17 26 levin levin PROPN dad-10733 17 27 et et PROPN dad-10733 17 28 al al PROPN dad-10733 17 29 . . PROPN dad-10733 17 30 , , PUNCT dad-10733 17 31 1997 1997 NUM dad-10733 17 32 ; ; PUNCT dad-10733 17 33 georgila georgila NOUN dad-10733 17 34 et et PROPN dad-10733 17 35 al al PROPN dad-10733 17 36 . . PROPN dad-10733 17 37 , , PUNCT dad-10733 17 38 2006 2006 NUM dad-10733 17 39 ; ; PUNCT dad-10733 17 40 paek paek NOUN dad-10733 17 41 , , PUNCT dad-10733 17 42 2006 2006 NUM dad-10733 17 43 ; ; PUNCT dad-10733 17 44 schatzmann schatzmann PROPN dad-10733 17 45 et et PROPN dad-10733 17 46 al al PROPN dad-10733 17 47 . . PROPN dad-10733 17 48 , , PUNCT dad-10733 17 49 2007 2007 NUM dad-10733 17 50 ; ; PUNCT dad-10733 17 51 jung jung PROPN dad-10733 17 52 et et PROPN dad-10733 17 53 al al PROPN dad-10733 17 54 . . PROPN dad-10733 17 55 , , PUNCT dad-10733 17 56 2009 2009 NUM dad-10733 17 57 ; ; PUNCT dad-10733 17 58 schatzmann schatzmann NOUN dad-10733 17 59 and and CCONJ dad-10733 17 60 young young ADJ dad-10733 17 61 , , PUNCT dad-10733 17 62 2009 2009 NUM dad-10733 17 63 ; ; PUNCT dad-10733 17 64 gašić gašić ADV dad-10733 17 65 et et PROPN dad-10733 17 66 al al PROPN dad-10733 17 67 . . PROPN dad-10733 17 68 , , PUNCT dad-10733 17 69 2010 2010 NUM dad-10733 17 70 , , PUNCT dad-10733 17 71 2011 2011 NUM dad-10733 17 72 ; ; PUNCT dad-10733 17 73 daubigney daubigney NOUN dad-10733 17 74 et et PROPN dad-10733 17 75 al al PROPN dad-10733 17 76 . . PROPN dad-10733 17 77 , , PUNCT dad-10733 17 78 2012 2012 NUM dad-10733 17 79 ; ; PUNCT dad-10733 17 80 gašić gašić ADV dad-10733 17 81 et et PROPN dad-10733 17 82 al al PROPN dad-10733 17 83 . . PROPN dad-10733 17 84 , , PUNCT dad-10733 17 85 2012 2012 NUM dad-10733 17 86 ; ; PUNCT dad-10733 17 87 su su PROPN dad-10733 17 88 et et PROPN dad-10733 17 89 al al PROPN dad-10733 17 90 . . PROPN dad-10733 17 91 , , PUNCT dad-10733 17 92 2013 2013 NUM dad-10733 17 93 ; ; PUNCT dad-10733 17 94 gasic gasic NOUN dad-10733 17 95 et et PROPN dad-10733 17 96 al al PROPN dad-10733 17 97 . . PROPN dad-10733 17 98 , , PUNCT dad-10733 17 99 2013 2013 NUM dad-10733 17 100 ; ; PUNCT dad-10733 17 101 pietquin pietquin NOUN dad-10733 17 102 and and CCONJ dad-10733 17 103 hastie hastie PROPN dad-10733 17 104 , , PUNCT dad-10733 17 105 2013 2013 NUM dad-10733 17 106 ; ; PUNCT dad-10733 17 107 young young PROPN dad-10733 17 108 et et PROPN dad-10733 17 109 al al PROPN dad-10733 17 110 . . PROPN dad-10733 17 111 , , PUNCT dad-10733 17 112 2013 2013 NUM dad-10733 17 113 ; ; PUNCT dad-10733 17 114 mohan mohan PROPN dad-10733 17 115 and and CCONJ dad-10733 17 116 laird laird PROPN dad-10733 17 117 , , PUNCT dad-10733 17 118 2014 2014 NUM dad-10733 17 119 ; ; PUNCT dad-10733 17 120 su su PROPN dad-10733 17 121 et et PROPN dad-10733 17 122 al al PROPN dad-10733 17 123 . . PROPN dad-10733 17 124 , , PUNCT dad-10733 17 125 2015 2015 NUM dad-10733 17 126 ; ; PUNCT dad-10733 17 127 piot piot PROPN dad-10733 17 128 et et PROPN dad-10733 17 129 al al PROPN dad-10733 17 130 . . PROPN dad-10733 17 131 , , PUNCT dad-10733 17 132 2015 2015 NUM dad-10733 17 133 ; ; PUNCT dad-10733 17 134 cuayáhuitl cuayáhuitl PROPN dad-10733 17 135 et et PROPN dad-10733 17 136 al al PROPN dad-10733 17 137 . . PROPN dad-10733 17 138 , , PUNCT dad-10733 17 139 2015 2015 NUM dad-10733 17 140 ; ; PUNCT dad-10733 17 141 hiraoka hiraoka NOUN dad-10733 17 142 et et PROPN dad-10733 17 143 al al PROPN dad-10733 17 144 . . PROPN dad-10733 17 145 , , PUNCT dad-10733 17 146 2016 2016 NUM dad-10733 17 147 ; ; PUNCT dad-10733 17 148 fatemi fatemi PROPN dad-10733 17 149 et et PROPN dad-10733 17 150 al al PROPN dad-10733 17 151 . . PROPN dad-10733 17 152 , , PUNCT dad-10733 17 153 2016 2016 NUM dad-10733 17 154 ; ; PUNCT dad-10733 17 155 asri asri PROPN dad-10733 17 156 et et PROPN dad-10733 17 157 al al PROPN dad-10733 17 158 . . PROPN dad-10733 17 159 , , PUNCT dad-10733 17 160 2016 2016 NUM dad-10733 17 161 ; ; PUNCT dad-10733 17 162 williams williams PROPN dad-10733 17 163 and and CCONJ dad-10733 17 164 zweig zweig NOUN dad-10733 17 165 , , PUNCT dad-10733 17 166 2016 2016 NUM dad-10733 17 167 ; ; PUNCT dad-10733 17 168 su su PROPN dad-10733 17 169 et et PROPN dad-10733 17 170 al al PROPN dad-10733 17 171 . . PROPN dad-10733 17 172 , , PUNCT dad-10733 17 173 2016 2016 NUM dad-10733 17 174 ) ) PUNCT dad-10733 17 175 . . PUNCT dad-10733 18 1 however however ADV dad-10733 18 2 , , PUNCT dad-10733 18 3 these these DET dad-10733 18 4 approaches approach NOUN dad-10733 18 5 are be AUX dad-10733 18 6 beyond beyond ADP dad-10733 18 7 the the DET dad-10733 18 8 scope scope NOUN dad-10733 18 9 of of ADP dad-10733 18 10 this this DET dad-10733 18 11 survey survey NOUN dad-10733 18 12 unless unless SCONJ dad-10733 18 13 the the DET dad-10733 18 14 simulators simulator NOUN dad-10733 18 15 are be AUX dad-10733 18 16 built build VERB dad-10733 18 17 from from ADP dad-10733 18 18 dialogue dialogue NOUN dad-10733 18 19 corpora corpora PROPN dad-10733 18 20 . . PUNCT dad-10733 19 1 this this DET dad-10733 19 2 survey survey NOUN dad-10733 19 3 is be AUX dad-10733 19 4 structured structure VERB dad-10733 19 5 as as SCONJ dad-10733 19 6 follows follow VERB dad-10733 19 7 . . PUNCT dad-10733 20 1 in in ADP dad-10733 20 2 the the DET dad-10733 20 3 next next ADJ dad-10733 20 4 section section NOUN dad-10733 20 5 , , PUNCT dad-10733 20 6 we we PRON dad-10733 20 7 give give VERB dad-10733 20 8 a a DET dad-10733 20 9 high high ADJ dad-10733 20 10 - - PUNCT dad-10733 20 11 level level NOUN dad-10733 20 12 overview overview NOUN dad-10733 20 13 of of ADP dad-10733 20 14 dialogue dialogue NOUN dad-10733 20 15 systems system NOUN dad-10733 20 16 . . PUNCT dad-10733 21 1 we we PRON dad-10733 21 2 briefly briefly ADV dad-10733 21 3 discuss discuss VERB dad-10733 21 4 the the DET dad-10733 21 5 purpose purpose NOUN dad-10733 21 6 and and CCONJ dad-10733 21 7 goal goal NOUN dad-10733 21 8 of of ADP dad-10733 21 9 dialogue dialogue NOUN dad-10733 21 10 systems system NOUN dad-10733 21 11 . . PUNCT dad-10733 22 1 then then ADV dad-10733 22 2 we we PRON dad-10733 22 3 describe describe VERB dad-10733 22 4 the the DET dad-10733 22 5 individual individual ADJ dad-10733 22 6 system system NOUN dad-10733 22 7 components component NOUN dad-10733 22 8 that that PRON dad-10733 22 9 are be AUX dad-10733 22 10 relevant relevant ADJ dad-10733 22 11 for for ADP dad-10733 22 12 data data NOUN dad-10733 22 13 - - PUNCT dad-10733 22 14 driven drive VERB dad-10733 22 15 approaches approach NOUN dad-10733 22 16 as as ADV dad-10733 22 17 well well ADV dad-10733 22 18 as as ADP dad-10733 22 19 holistic holistic ADJ dad-10733 22 20 end end NOUN dad-10733 22 21 - - PUNCT dad-10733 22 22 to to ADP dad-10733 22 23 - - PUNCT dad-10733 22 24 end end NOUN dad-10733 22 25 dialogue dialogue NOUN dad-10733 22 26 systems system NOUN dad-10733 22 27 . . PUNCT dad-10733 23 1 in in ADP dad-10733 23 2 section section NOUN dad-10733 23 3 3 3 NUM dad-10733 23 4 , , PUNCT dad-10733 23 5 we we PRON dad-10733 23 6 discuss discuss VERB dad-10733 23 7 types type NOUN dad-10733 23 8 of of ADP dad-10733 23 9 dialogue dialogue NOUN dad-10733 23 10 interactions interaction NOUN dad-10733 23 11 and and CCONJ dad-10733 23 12 aspects aspect NOUN dad-10733 23 13 relevant relevant ADJ dad-10733 23 14 to to ADP dad-10733 23 15 building build VERB dad-10733 23 16 data data NOUN dad-10733 23 17 - - PUNCT dad-10733 23 18 driven drive VERB dad-10733 23 19 dialogue dialogue NOUN dad-10733 23 20 systems system NOUN dad-10733 23 21 , , PUNCT dad-10733 23 22 from from ADP dad-10733 23 23 a a DET dad-10733 23 24 corpus corpus NOUN dad-10733 23 25 perspective perspective NOUN dad-10733 23 26 , , PUNCT dad-10733 23 27 as as ADV dad-10733 23 28 well well ADV dad-10733 23 29 as as ADP dad-10733 23 30 the the DET dad-10733 23 31 modalities modality NOUN dad-10733 23 32 recorded record VERB dad-10733 23 33 in in ADP dad-10733 23 34 each each DET dad-10733 23 35 corpus corpus NOUN dad-10733 23 36 ( ( PUNCT dad-10733 23 37 e.g. e.g. ADV dad-10733 23 38 text text NOUN dad-10733 23 39 , , PUNCT dad-10733 23 40 speech speech NOUN dad-10733 23 41 and and CCONJ dad-10733 23 42 video video NOUN dad-10733 23 43 ) ) PUNCT dad-10733 23 44 . . PUNCT dad-10733 24 1 we we PRON dad-10733 24 2 further far ADV dad-10733 24 3 discuss discuss VERB dad-10733 24 4 corpora corpora PROPN dad-10733 24 5 constructed construct VERB dad-10733 24 6 from from ADP dad-10733 24 7 both both DET dad-10733 24 8 human human ADJ dad-10733 24 9 - - PUNCT dad-10733 24 10 human human ADJ dad-10733 24 11 and and CCONJ dad-10733 24 12 human human ADJ dad-10733 24 13 - - PUNCT dad-10733 24 14 machine machine NOUN dad-10733 24 15 interactions interaction NOUN dad-10733 24 16 , , PUNCT dad-10733 24 17 corpora corpora PROPN dad-10733 24 18 constructed construct VERB dad-10733 24 19 using use VERB dad-10733 24 20 natural natural ADJ dad-10733 24 21 versus versus ADP dad-10733 24 22 unnatural unnatural ADJ dad-10733 24 23 or or CCONJ dad-10733 24 24 constrained constrained ADJ dad-10733 24 25 settings setting NOUN dad-10733 24 26 , , PUNCT dad-10733 24 27 and and CCONJ dad-10733 24 28 corpora corpora PROPN dad-10733 24 29 constructed constructed ADJ dad-10733 24 30 using use VERB dad-10733 24 31 works work NOUN dad-10733 24 32 of of ADP dad-10733 24 33 fiction fiction NOUN dad-10733 24 34 . . PUNCT dad-10733 25 1 in in ADP dad-10733 25 2 section section NOUN dad-10733 25 3 4 4 NUM dad-10733 25 4 , , PUNCT dad-10733 25 5 we we PRON dad-10733 25 6 present present VERB dad-10733 25 7 our our PRON dad-10733 25 8 survey survey NOUN dad-10733 25 9 over over ADP dad-10733 25 10 dialogue dialogue NOUN dad-10733 25 11 corpora corpora PROPN dad-10733 25 12 using use VERB dad-10733 25 13 the the DET dad-10733 25 14 categories category NOUN dad-10733 25 15 from from ADP dad-10733 25 16 sections section NOUN dad-10733 25 17 2 2 NUM dad-10733 25 18 & & CCONJ dad-10733 25 19 3 3 NUM dad-10733 25 20 . . PUNCT dad-10733 26 1 in in ADP dad-10733 26 2 particular particular ADJ dad-10733 26 3 , , PUNCT dad-10733 26 4 we we PRON dad-10733 26 5 categorize categorize VERB dad-10733 26 6 the the DET dad-10733 26 7 corpora corpora NOUN dad-10733 26 8 based base VERB dad-10733 26 9 on on ADP dad-10733 26 10 whether whether SCONJ dad-10733 26 11 dialogues dialogue NOUN dad-10733 26 12 are be AUX dad-10733 26 13 : : PUNCT dad-10733 26 14 between between ADP dad-10733 26 15 humans human NOUN dad-10733 26 16 or or CCONJ dad-10733 26 17 between between ADP dad-10733 26 18 a a DET dad-10733 26 19 human human NOUN dad-10733 26 20 and and CCONJ dad-10733 26 21 a a DET dad-10733 26 22 machine machine NOUN dad-10733 26 23 ; ; PUNCT dad-10733 26 24 whether whether SCONJ dad-10733 26 25 the the DET dad-10733 26 26 dialogues dialogue NOUN dad-10733 26 27 are be AUX dad-10733 26 28 in in ADP dad-10733 26 29 written write VERB dad-10733 26 30 or or CCONJ dad-10733 26 31 spoken spoken ADJ dad-10733 26 32 language language NOUN dad-10733 26 33 ; ; PUNCT dad-10733 26 34 whether whether SCONJ dad-10733 26 35 they they PRON dad-10733 26 36 are be AUX dad-10733 26 37 constrained constrain VERB dad-10733 26 38 or or CCONJ dad-10733 26 39 spontaneous spontaneous ADJ dad-10733 26 40 ; ; PUNCT dad-10733 26 41 and and CCONJ dad-10733 26 42 whether whether SCONJ dad-10733 26 43 they they PRON dad-10733 26 44 are be AUX dad-10733 26 45 scripted script VERB dad-10733 26 46 fictional fictional ADJ dad-10733 26 47 works work NOUN dad-10733 26 48 . . PUNCT dad-10733 27 1 we we PRON dad-10733 27 2 discuss discuss VERB dad-10733 27 3 each each DET dad-10733 27 4 corpus corpus NOUN dad-10733 27 5 in in ADP dad-10733 27 6 turn turn NOUN dad-10733 27 7 while while SCONJ dad-10733 27 8 emphasizing emphasize VERB dad-10733 27 9 how how SCONJ dad-10733 27 10 the the DET dad-10733 27 11 dialogues dialogue NOUN dad-10733 27 12 were be AUX dad-10733 27 13 generated generate VERB dad-10733 27 14 and and CCONJ dad-10733 27 15 collected collect VERB dad-10733 27 16 , , PUNCT dad-10733 27 17 the the DET dad-10733 27 18 topic topic NOUN dad-10733 27 19 of of ADP dad-10733 27 20 the the DET dad-10733 27 21 dialogues dialogue NOUN dad-10733 27 22 , , PUNCT dad-10733 27 23 and and CCONJ dad-10733 27 24 the the DET dad-10733 27 25 size size NOUN dad-10733 27 26 of of ADP dad-10733 27 27 the the DET dad-10733 27 28 entire entire ADJ dad-10733 27 29 corpus corpus NOUN dad-10733 27 30 . . PUNCT dad-10733 28 1 in in ADP dad-10733 28 2 section section NOUN dad-10733 28 3 5 5 NUM dad-10733 28 4 , , PUNCT dad-10733 28 5 we we PRON dad-10733 28 6 discuss discuss VERB dad-10733 28 7 issues issue NOUN dad-10733 28 8 related relate VERB dad-10733 28 9 to to ADP dad-10733 28 10 : : PUNCT dad-10733 28 11 corpus corpus NOUN dad-10733 28 12 size size NOUN dad-10733 28 13 , , PUNCT dad-10733 28 14 transfer transfer NOUN dad-10733 28 15 learning learn VERB dad-10733 28 16 2 2 NUM dad-10733 28 17 a a DET dad-10733 28 18 survey survey NOUN dad-10733 28 19 of of ADP dad-10733 28 20 available available ADJ dad-10733 28 21 corpora corpora PROPN dad-10733 28 22 for for ADP dad-10733 28 23 building build VERB dad-10733 28 24 data data NOUN dad-10733 28 25 - - PUNCT dad-10733 28 26 driven drive VERB dad-10733 28 27 dialogue dialogue NOUN dad-10733 28 28 systems system NOUN dad-10733 28 29 between between ADP dad-10733 28 30 corpora corpus NOUN dad-10733 28 31 , , PUNCT dad-10733 28 32 incorporation incorporation NOUN dad-10733 28 33 of of ADP dad-10733 28 34 external external ADJ dad-10733 28 35 knowledge knowledge NOUN dad-10733 28 36 into into ADP dad-10733 28 37 the the DET dad-10733 28 38 dialogue dialogue NOUN dad-10733 28 39 system system NOUN dad-10733 28 40 , , PUNCT dad-10733 28 41 data data NOUN dad-10733 28 42 - - PUNCT dad-10733 28 43 driven drive VERB dad-10733 28 44 learning learning NOUN dad-10733 28 45 for for ADP dad-10733 28 46 contextualization contextualization NOUN dad-10733 28 47 and and CCONJ dad-10733 28 48 personalization personalization NOUN dad-10733 28 49 , , PUNCT dad-10733 28 50 and and CCONJ dad-10733 28 51 automatic automatic ADJ dad-10733 28 52 evaluation evaluation NOUN dad-10733 28 53 metrics metric NOUN dad-10733 28 54 . . PUNCT dad-10733 29 1 we we PRON dad-10733 29 2 conclude conclude VERB dad-10733 29 3 the the DET dad-10733 29 4 survey survey NOUN dad-10733 29 5 in in ADP dad-10733 29 6 section section NOUN dad-10733 29 7 6 6 NUM dad-10733 29 8 . . NOUN dad-10733 29 9 2 2 NUM dad-10733 29 10 . . X dad-10733 29 11 characteristics characteristic NOUN dad-10733 29 12 of of ADP dad-10733 29 13 data data NOUN dad-10733 29 14 - - PUNCT dad-10733 29 15 driven drive VERB dad-10733 29 16 dialogue dialogue NOUN dad-10733 29 17 systems system NOUN dad-10733 29 18 this this DET dad-10733 29 19 section section NOUN dad-10733 29 20 offers offer VERB dad-10733 29 21 a a DET dad-10733 29 22 broad broad ADJ dad-10733 29 23 characterization characterization NOUN dad-10733 29 24 of of ADP dad-10733 29 25 data data NOUN dad-10733 29 26 - - PUNCT dad-10733 29 27 driven drive VERB dad-10733 29 28 dialogue dialogue NOUN dad-10733 29 29 systems system NOUN dad-10733 29 30 , , PUNCT dad-10733 29 31 which which PRON dad-10733 29 32 structures structure VERB dad-10733 29 33 our our PRON dad-10733 29 34 presentation presentation NOUN dad-10733 29 35 of of ADP dad-10733 29 36 the the DET dad-10733 29 37 datasets dataset NOUN dad-10733 29 38 . . PUNCT dad-10733 30 1 2.1 2.1 NUM dad-10733 30 2 an an DET dad-10733 30 3 overview overview NOUN dad-10733 30 4 of of ADP dad-10733 30 5 dialogue dialogue NOUN dad-10733 30 6 systems system NOUN dad-10733 30 7 the the DET dad-10733 30 8 standard standard ADJ dad-10733 30 9 architecture architecture NOUN dad-10733 30 10 for for ADP dad-10733 30 11 dialogue dialogue NOUN dad-10733 30 12 systems system NOUN dad-10733 30 13 , , PUNCT dad-10733 30 14 shown show VERB dad-10733 30 15 in in ADP dad-10733 30 16 figure figure NOUN dad-10733 30 17 1 1 NUM dad-10733 30 18 , , PUNCT dad-10733 30 19 incorporates incorporate VERB dad-10733 30 20 automatic automatic ADJ dad-10733 30 21 speech speech NOUN dad-10733 30 22 recognition recognition NOUN dad-10733 30 23 , , PUNCT dad-10733 30 24 natural natural ADJ dad-10733 30 25 language language NOUN dad-10733 30 26 understanding understanding NOUN dad-10733 30 27 , , PUNCT dad-10733 30 28 dialogue dialogue NOUN dad-10733 30 29 state state NOUN dad-10733 30 30 tracking tracking NOUN dad-10733 30 31 , , PUNCT dad-10733 30 32 dialogue dialogue NOUN dad-10733 30 33 response response NOUN dad-10733 30 34 action action NOUN dad-10733 30 35 selection selection NOUN dad-10733 30 36 , , PUNCT dad-10733 30 37 natural natural ADJ dad-10733 30 38 language language NOUN dad-10733 30 39 generation generation NOUN dad-10733 30 40 , , PUNCT dad-10733 30 41 and and CCONJ dad-10733 30 42 speech speech NOUN dad-10733 30 43 synthesis synthesis NOUN dad-10733 30 44 . . PUNCT dad-10733 31 1 in in ADP dad-10733 31 2 the the DET dad-10733 31 3 case case NOUN dad-10733 31 4 of of ADP dad-10733 31 5 text text NOUN dad-10733 31 6 - - PUNCT dad-10733 31 7 based base VERB dad-10733 31 8 ( ( PUNCT dad-10733 31 9 written write VERB dad-10733 31 10 ) ) PUNCT dad-10733 31 11 dialogues dialogue NOUN dad-10733 31 12 , , PUNCT dad-10733 31 13 automatic automatic ADJ dad-10733 31 14 speech speech NOUN dad-10733 31 15 recognition recognition NOUN dad-10733 31 16 and and CCONJ dad-10733 31 17 speech speech NOUN dad-10733 31 18 synthesis synthesis NOUN dad-10733 31 19 can can AUX dad-10733 31 20 be be AUX dad-10733 31 21 left leave VERB dad-10733 31 22 out out ADP dad-10733 31 23 and and CCONJ dad-10733 31 24 throughout throughout ADP dad-10733 31 25 this this DET dad-10733 31 26 work work NOUN dad-10733 31 27 we we PRON dad-10733 31 28 generally generally ADV dad-10733 31 29 do do AUX dad-10733 31 30 not not PART dad-10733 31 31 discuss discuss VERB dad-10733 31 32 them they PRON dad-10733 31 33 and and CCONJ dad-10733 31 34 focus focus VERB dad-10733 31 35 on on ADP dad-10733 31 36 the the DET dad-10733 31 37 core core NOUN dad-10733 31 38 components component NOUN dad-10733 31 39 . . PUNCT dad-10733 32 1 we we PRON dad-10733 32 2 can can AUX dad-10733 32 3 refer refer VERB dad-10733 32 4 to to ADP dad-10733 32 5 systems system NOUN dad-10733 32 6 including include VERB dad-10733 32 7 speech speech NOUN dad-10733 32 8 synthesis synthesis NOUN dad-10733 32 9 and and CCONJ dad-10733 32 10 automatic automatic ADJ dad-10733 32 11 speech speech NOUN dad-10733 32 12 recognition recognition NOUN dad-10733 32 13 as as ADP dad-10733 32 14 spoken spoken ADJ dad-10733 32 15 dialogue dialogue NOUN dad-10733 32 16 systems system NOUN dad-10733 32 17 . . PUNCT dad-10733 33 1 in in ADP dad-10733 33 2 some some DET dad-10733 33 3 dialogue dialogue NOUN dad-10733 33 4 systems system NOUN dad-10733 33 5 literature literature NOUN dad-10733 33 6 , , PUNCT dad-10733 33 7 the the DET dad-10733 33 8 dialogue dialogue NOUN dad-10733 33 9 state state NOUN dad-10733 33 10 tracking tracking NOUN dad-10733 33 11 and and CCONJ dad-10733 33 12 dialogue dialogue NOUN dad-10733 33 13 response response NOUN dad-10733 33 14 action action NOUN dad-10733 33 15 selection selection NOUN dad-10733 33 16 components component NOUN dad-10733 33 17 comprise comprise VERB dad-10733 33 18 the the DET dad-10733 33 19 dialogue dialogue NOUN dad-10733 33 20 manager manager NOUN dad-10733 33 21 ( ( PUNCT dad-10733 33 22 young young ADJ dad-10733 33 23 , , PUNCT dad-10733 33 24 2000 2000 NUM dad-10733 33 25 ) ) PUNCT dad-10733 33 26 . . PUNCT dad-10733 34 1 here here ADV dad-10733 34 2 , , PUNCT dad-10733 34 3 we we PRON dad-10733 34 4 discuss discuss VERB dad-10733 34 5 each each DET dad-10733 34 6 component component NOUN dad-10733 34 7 separately separately ADV dad-10733 34 8 and and CCONJ dad-10733 34 9 briefly briefly ADV dad-10733 34 10 discuss discuss VERB dad-10733 34 11 related related ADJ dad-10733 34 12 work work NOUN dad-10733 34 13 to to ADP dad-10733 34 14 each each PRON dad-10733 34 15 . . PUNCT dad-10733 35 1 we we PRON dad-10733 35 2 also also ADV dad-10733 35 3 discuss discuss VERB dad-10733 35 4 end end NOUN dad-10733 35 5 - - PUNCT dad-10733 35 6 to to ADP dad-10733 35 7 - - PUNCT dad-10733 35 8 end end NOUN dad-10733 35 9 dialogue dialogue NOUN dad-10733 35 10 systems system NOUN dad-10733 35 11 , , PUNCT dad-10733 35 12 a a DET dad-10733 35 13 relatively relatively ADV dad-10733 35 14 new new ADJ dad-10733 35 15 paradigm paradigm NOUN dad-10733 35 16 which which PRON dad-10733 35 17 ignores ignore VERB dad-10733 35 18 the the DET dad-10733 35 19 division division NOUN dad-10733 35 20 into into ADP dad-10733 35 21 components component NOUN dad-10733 35 22 and and CCONJ dad-10733 35 23 treats treat NOUN dad-10733 35 24 all all DET dad-10733 35 25 four four NUM dad-10733 35 26 non non ADJ dad-10733 35 27 - - ADJ dad-10733 35 28 spoken spoken ADJ dad-10733 35 29 dialogue dialogue NOUN dad-10733 35 30 system system NOUN dad-10733 35 31 components component NOUN dad-10733 35 32 as as ADP dad-10733 35 33 a a DET dad-10733 35 34 single single ADJ dad-10733 35 35 learned learn VERB dad-10733 35 36 system system NOUN dad-10733 35 37 ( ( PUNCT dad-10733 35 38 ritter ritter PROPN dad-10733 35 39 et et PROPN dad-10733 35 40 al al PROPN dad-10733 35 41 . . PROPN dad-10733 35 42 , , PUNCT dad-10733 35 43 2011 2011 NUM dad-10733 35 44 ; ; PUNCT dad-10733 35 45 vinyals vinyal NOUN dad-10733 35 46 and and CCONJ dad-10733 35 47 le le NOUN dad-10733 35 48 , , PUNCT dad-10733 35 49 2015 2015 NUM dad-10733 35 50 ; ; PUNCT dad-10733 35 51 lowe lowe PROPN dad-10733 35 52 et et PROPN dad-10733 35 53 al al PROPN dad-10733 35 54 . . PROPN dad-10733 35 55 , , PUNCT dad-10733 35 56 2015a 2015a NUM dad-10733 35 57 ; ; PUNCT dad-10733 35 58 sordoni sordoni PROPN dad-10733 35 59 et et PROPN dad-10733 35 60 al al PROPN dad-10733 35 61 . . PROPN dad-10733 35 62 , , PUNCT dad-10733 35 63 2015 2015 NUM dad-10733 35 64 ; ; PUNCT dad-10733 35 65 shang shang PROPN dad-10733 35 66 et et PROPN dad-10733 35 67 al al PROPN dad-10733 35 68 . . PROPN dad-10733 35 69 , , PUNCT dad-10733 35 70 2015 2015 NUM dad-10733 35 71 ; ; PUNCT dad-10733 35 72 li li PROPN dad-10733 35 73 et et PROPN dad-10733 35 74 al al PROPN dad-10733 35 75 . . PROPN dad-10733 35 76 , , PUNCT dad-10733 35 77 2015 2015 NUM dad-10733 35 78 ; ; PUNCT dad-10733 35 79 serban serban PROPN dad-10733 35 80 et et PROPN dad-10733 35 81 al al PROPN dad-10733 35 82 . . PROPN dad-10733 35 83 , , PUNCT dad-10733 35 84 2016 2016 NUM dad-10733 35 85 ; ; PUNCT dad-10733 35 86 serban serban PROPN dad-10733 35 87 et et PROPN dad-10733 35 88 al al PROPN dad-10733 35 89 . . PROPN dad-10733 35 90 , , PUNCT dad-10733 35 91 2017d 2017d NUM dad-10733 35 92 , , PUNCT dad-10733 35 93 a a PRON dad-10733 35 94 ; ; PUNCT dad-10733 35 95 dodge dodge VERB dad-10733 35 96 et et PROPN dad-10733 35 97 al al PROPN dad-10733 35 98 . . PROPN dad-10733 35 99 , , PUNCT dad-10733 35 100 2015 2015 NUM dad-10733 35 101 ; ; PUNCT dad-10733 35 102 williams williams PROPN dad-10733 35 103 and and CCONJ dad-10733 35 104 zweig zweig NOUN dad-10733 35 105 , , PUNCT dad-10733 35 106 2016 2016 NUM dad-10733 35 107 ; ; PUNCT dad-10733 35 108 weston weston PROPN dad-10733 35 109 , , PUNCT dad-10733 35 110 2016 2016 NUM dad-10733 35 111 ) ) PUNCT dad-10733 35 112 . . PUNCT dad-10733 36 1 in in ADP dad-10733 36 2 this this DET dad-10733 36 3 work work NOUN dad-10733 36 4 , , PUNCT dad-10733 36 5 we we PRON dad-10733 36 6 focus focus VERB dad-10733 36 7 on on ADP dad-10733 36 8 corpus corpus NOUN dad-10733 36 9 - - PUNCT dad-10733 36 10 based base VERB dad-10733 36 11 data data NOUN dad-10733 36 12 - - PUNCT dad-10733 36 13 driven drive VERB dad-10733 36 14 dialogue dialogue NOUN dad-10733 36 15 systems system NOUN dad-10733 36 16 . . PUNCT dad-10733 37 1 that that PRON dad-10733 37 2 is be AUX dad-10733 37 3 , , PUNCT dad-10733 37 4 systems system NOUN dad-10733 37 5 that that PRON dad-10733 37 6 use use VERB dad-10733 37 7 machine machine NOUN dad-10733 37 8 learning learn VERB dad-10733 37 9 algorithms algorithm NOUN dad-10733 37 10 to to PART dad-10733 37 11 learn learn VERB dad-10733 37 12 the the DET dad-10733 37 13 functionality functionality NOUN dad-10733 37 14 of of ADP dad-10733 37 15 the the DET dad-10733 37 16 previously previously ADV dad-10733 37 17 described describe VERB dad-10733 37 18 components component NOUN dad-10733 37 19 from from ADP dad-10733 37 20 dialogue dialogue NOUN dad-10733 37 21 corpora corpora PROPN dad-10733 37 22 constructed construct VERB dad-10733 37 23 from from ADP dad-10733 37 24 human human ADJ dad-10733 37 25 conversational conversational ADJ dad-10733 37 26 data datum NOUN dad-10733 37 27 . . PUNCT dad-10733 38 1 we we PRON dad-10733 38 2 define define VERB dad-10733 38 3 human human ADJ dad-10733 38 4 conversational conversational ADJ dad-10733 38 5 data datum NOUN dad-10733 38 6 as as ADP dad-10733 38 7 dialogue dialogue NOUN dad-10733 38 8 corpora corpora PROPN dad-10733 38 9 collected collect VERB dad-10733 38 10 through through ADP dad-10733 38 11 human human ADJ dad-10733 38 12 - - PUNCT dad-10733 38 13 human human ADJ dad-10733 38 14 or or CCONJ dad-10733 38 15 human human ADJ dad-10733 38 16 - - PUNCT dad-10733 38 17 machine machine NOUN dad-10733 38 18 interaction interaction NOUN dad-10733 38 19 . . PUNCT dad-10733 39 1 these these DET dad-10733 39 2 system system NOUN dad-10733 39 3 components component NOUN dad-10733 39 4 have have VERB dad-10733 39 5 variables variable NOUN dad-10733 39 6 or or CCONJ dad-10733 39 7 parameters parameter NOUN dad-10733 39 8 that that PRON dad-10733 39 9 are be AUX dad-10733 39 10 optimized optimize VERB dad-10733 39 11 based base VERB dad-10733 39 12 on on ADP dad-10733 39 13 statistics statistic NOUN dad-10733 39 14 observed observe VERB dad-10733 39 15 in in ADP dad-10733 39 16 dialogue dialogue NOUN dad-10733 39 17 corpora corpora PROPN dad-10733 39 18 . . PUNCT dad-10733 40 1 in in ADP dad-10733 40 2 particular particular ADJ dad-10733 40 3 , , PUNCT dad-10733 40 4 we we PRON dad-10733 40 5 focus focus VERB dad-10733 40 6 on on ADP dad-10733 40 7 systems system NOUN dad-10733 40 8 where where SCONJ dad-10733 40 9 the the DET dad-10733 40 10 majority majority NOUN dad-10733 40 11 of of ADP dad-10733 40 12 variables variable NOUN dad-10733 40 13 and and CCONJ dad-10733 40 14 parameters parameter NOUN dad-10733 40 15 are be AUX dad-10733 40 16 optimized optimize VERB dad-10733 40 17 . . PUNCT dad-10733 41 1 such such ADJ dad-10733 41 2 corpus corpus NOUN dad-10733 41 3 - - PUNCT dad-10733 41 4 based base VERB dad-10733 41 5 data data NOUN dad-10733 41 6 - - PUNCT dad-10733 41 7 driven drive VERB dad-10733 41 8 systems system NOUN dad-10733 41 9 should should AUX dad-10733 41 10 be be AUX dad-10733 41 11 contrasted contrast VERB dad-10733 41 12 to to ADP dad-10733 41 13 systems system NOUN dad-10733 41 14 where where SCONJ dad-10733 41 15 each each DET dad-10733 41 16 component component NOUN dad-10733 41 17 is be AUX dad-10733 41 18 hand hand NOUN dad-10733 41 19 - - PUNCT dad-10733 41 20 crafted craft VERB dad-10733 41 21 by by ADP dad-10733 41 22 engineers engineer NOUN dad-10733 41 23 — — PUNCT dad-10733 41 24 for for ADP dad-10733 41 25 example example NOUN dad-10733 41 26 , , PUNCT dad-10733 41 27 components component NOUN dad-10733 41 28 defined define VERB dad-10733 41 29 by by ADP dad-10733 41 30 an an DET dad-10733 41 31 a a DET dad-10733 41 32 priori priori ADV dad-10733 41 33 fixed fix VERB dad-10733 41 34 set set NOUN dad-10733 41 35 of of ADP dad-10733 41 36 deterministic deterministic ADJ dad-10733 41 37 rules rule NOUN dad-10733 41 38 ( ( PUNCT dad-10733 41 39 e.g. e.g. ADV dad-10733 41 40 weizenbaum weizenbaum X dad-10733 41 41 ( ( PUNCT dad-10733 41 42 1966 1966 NUM dad-10733 41 43 ) ) PUNCT dad-10733 41 44 ; ; PUNCT dad-10733 41 45 mcglashan mcglashan PROPN dad-10733 41 46 et et PROPN dad-10733 41 47 al al PROPN dad-10733 41 48 . . PROPN dad-10733 42 1 ( ( PUNCT dad-10733 42 2 1992 1992 NUM dad-10733 42 3 ) ) PUNCT dad-10733 42 4 ) ) PUNCT dad-10733 42 5 . . PUNCT dad-10733 43 1 these these DET dad-10733 43 2 systems system NOUN dad-10733 43 3 should should AUX dad-10733 43 4 also also ADV dad-10733 43 5 be be AUX dad-10733 43 6 contrasted contrast VERB dad-10733 43 7 with with ADP dad-10733 43 8 systems system NOUN dad-10733 43 9 learning learn VERB dad-10733 43 10 online online ADV dad-10733 43 11 , , PUNCT dad-10733 43 12 such such ADJ dad-10733 43 13 as as ADP dad-10733 43 14 when when SCONJ dad-10733 43 15 the the DET dad-10733 43 16 free free ADJ dad-10733 43 17 variables variable NOUN dad-10733 43 18 and and CCONJ dad-10733 43 19 parameters parameter NOUN dad-10733 43 20 are be AUX dad-10733 43 21 optimized optimize VERB dad-10733 43 22 directly directly ADV dad-10733 43 23 based base VERB dad-10733 43 24 on on ADP dad-10733 43 25 interactions interaction NOUN dad-10733 43 26 with with ADP dad-10733 43 27 humans human NOUN dad-10733 43 28 ( ( PUNCT dad-10733 43 29 e.g. e.g. ADV dad-10733 43 30 gašić gašić ADV dad-10733 43 31 et et PROPN dad-10733 43 32 al al PROPN dad-10733 43 33 . . PUNCT dad-10733 44 1 ( ( PUNCT dad-10733 44 2 2011 2011 NUM dad-10733 44 3 ) ) PUNCT dad-10733 44 4 ) ) PUNCT dad-10733 44 5 . . PUNCT dad-10733 45 1 still still ADV dad-10733 45 2 , , PUNCT dad-10733 45 3 it it PRON dad-10733 45 4 is be AUX dad-10733 45 5 worth worth ADJ dad-10733 45 6 noting note VERB dad-10733 45 7 that that SCONJ dad-10733 45 8 it it PRON dad-10733 45 9 is be AUX dad-10733 45 10 possible possible ADJ dad-10733 45 11 to to PART dad-10733 45 12 combine combine VERB dad-10733 45 13 different different ADJ dad-10733 45 14 types type NOUN dad-10733 45 15 of of ADP dad-10733 45 16 learning learn VERB dad-10733 45 17 within within ADP dad-10733 45 18 one one NUM dad-10733 45 19 system system NOUN dad-10733 45 20 . . PUNCT dad-10733 46 1 for for ADP dad-10733 46 2 example example NOUN dad-10733 46 3 , , PUNCT dad-10733 46 4 some some DET dad-10733 46 5 parameters parameter NOUN dad-10733 46 6 may may AUX dad-10733 46 7 be be AUX dad-10733 46 8 learned learn VERB dad-10733 46 9 using use VERB dad-10733 46 10 statistics statistic NOUN dad-10733 46 11 observed observe VERB dad-10733 46 12 in in ADP dad-10733 46 13 a a DET dad-10733 46 14 corpus corpus NOUN dad-10733 46 15 , , PUNCT dad-10733 46 16 while while SCONJ dad-10733 46 17 other other ADJ dad-10733 46 18 parameters parameter NOUN dad-10733 46 19 may may AUX dad-10733 46 20 be be AUX dad-10733 46 21 learned learn VERB dad-10733 46 22 through through ADP dad-10733 46 23 interactions interaction NOUN dad-10733 46 24 with with ADP dad-10733 46 25 humans human NOUN dad-10733 46 26 . . PUNCT dad-10733 47 1 while while SCONJ dad-10733 47 2 there there PRON dad-10733 47 3 are be VERB dad-10733 47 4 substantial substantial ADJ dad-10733 47 5 opportunities opportunity NOUN dad-10733 47 6 to to PART dad-10733 47 7 improve improve VERB dad-10733 47 8 each each PRON dad-10733 47 9 of of ADP dad-10733 47 10 the the DET dad-10733 47 11 components component NOUN dad-10733 47 12 in in ADP dad-10733 47 13 figure figure NOUN dad-10733 47 14 1 1 NUM dad-10733 47 15 through through ADP dad-10733 47 16 ( ( PUNCT dad-10733 47 17 corpus corpus NOUN dad-10733 47 18 - - PUNCT dad-10733 47 19 based base VERB dad-10733 47 20 ) ) PUNCT dad-10733 47 21 data data NOUN dad-10733 47 22 - - PUNCT dad-10733 47 23 driven drive VERB dad-10733 47 24 approaches approach NOUN dad-10733 47 25 , , PUNCT dad-10733 47 26 within within ADP dad-10733 47 27 this this DET dad-10733 47 28 survey survey NOUN dad-10733 47 29 we we PRON dad-10733 47 30 focus focus VERB dad-10733 47 31 primarily primarily ADV dad-10733 47 32 on on ADP dad-10733 47 33 datasets dataset NOUN dad-10733 47 34 suitable suitable ADJ dad-10733 47 35 to to PART dad-10733 47 36 jointly jointly ADV dad-10733 47 37 enhance enhance VERB dad-10733 47 38 the the DET dad-10733 47 39 components component NOUN dad-10733 47 40 inside inside ADP dad-10733 47 41 the the DET dad-10733 47 42 dialogue dialogue NOUN dad-10733 47 43 system system NOUN dad-10733 47 44 box box PROPN dad-10733 47 45 . . PUNCT dad-10733 48 1 it it PRON dad-10733 48 2 is be AUX dad-10733 48 3 worth worth ADJ dad-10733 48 4 noting note VERB dad-10733 48 5 that that SCONJ dad-10733 48 6 natural natural ADJ dad-10733 48 7 language language NOUN dad-10733 48 8 understanding understanding NOUN dad-10733 48 9 and and CCONJ dad-10733 48 10 natural natural ADJ dad-10733 48 11 language language NOUN dad-10733 48 12 generation generation NOUN dad-10733 48 13 are be AUX dad-10733 48 14 core core NOUN dad-10733 48 15 problems problem NOUN dad-10733 48 16 in in ADP dad-10733 48 17 natural natural ADJ dad-10733 48 18 language language NOUN dad-10733 48 19 processing processing NOUN dad-10733 48 20 with with ADP dad-10733 48 21 applications application NOUN dad-10733 48 22 well well ADV dad-10733 48 23 beyond beyond ADP dad-10733 48 24 dialogue dialogue NOUN dad-10733 48 25 systems system NOUN dad-10733 48 26 . . PUNCT dad-10733 49 1 3 3 NUM dad-10733 49 2 serban serban PROPN dad-10733 49 3 , , PUNCT dad-10733 49 4 lowe lowe PROPN dad-10733 49 5 , , PUNCT dad-10733 49 6 henderson henderson PROPN dad-10733 49 7 , , PUNCT dad-10733 49 8 charlin charlin PROPN dad-10733 49 9 and and CCONJ dad-10733 49 10 pineau pineau PROPN dad-10733 49 11 figure figure NOUN dad-10733 49 12 1 1 NUM dad-10733 49 13 : : PUNCT dad-10733 49 14 spoken spoken ADJ dad-10733 49 15 dialogue dialogue NOUN dad-10733 49 16 system system NOUN dad-10733 49 17 diagram diagram PROPN dad-10733 49 18 . . PUNCT dad-10733 50 1 rectangular rectangular ADJ dad-10733 50 2 boxes box NOUN dad-10733 50 3 represent represent VERB dad-10733 50 4 the the DET dad-10733 50 5 different different ADJ dad-10733 50 6 components component NOUN dad-10733 50 7 of of ADP dad-10733 50 8 the the DET dad-10733 50 9 system system NOUN dad-10733 50 10 while while SCONJ dad-10733 50 11 arrows arrow NOUN dad-10733 50 12 represent represent VERB dad-10733 50 13 how how SCONJ dad-10733 50 14 the the DET dad-10733 50 15 information information NOUN dad-10733 50 16 flows flow VERB dad-10733 50 17 between between ADP dad-10733 50 18 the the DET dad-10733 50 19 components component NOUN dad-10733 50 20 from from ADP dad-10733 50 21 automatic automatic ADJ dad-10733 50 22 speech speech NOUN dad-10733 50 23 recognition recognition NOUN dad-10733 50 24 all all DET dad-10733 50 25 the the DET dad-10733 50 26 way way NOUN dad-10733 50 27 to to ADP dad-10733 50 28 speech speech NOUN dad-10733 50 29 synthesis synthesis NOUN dad-10733 50 30 . . PUNCT dad-10733 51 1 throughout throughout ADP dad-10733 51 2 this this DET dad-10733 51 3 survey survey NOUN dad-10733 51 4 we we PRON dad-10733 51 5 mostly mostly ADV dad-10733 51 6 discuss discuss VERB dad-10733 51 7 text text NOUN dad-10733 51 8 - - PUNCT dad-10733 51 9 based base VERB dad-10733 51 10 dialogue dialogue NOUN dad-10733 51 11 systems system NOUN dad-10733 51 12 ( ( PUNCT dad-10733 51 13 denoted denote VERB dad-10733 51 14 in in ADP dad-10733 51 15 the the DET dad-10733 51 16 figure figure NOUN dad-10733 51 17 as as ADP dad-10733 51 18 dialogue dialogue NOUN dad-10733 51 19 systems system NOUN dad-10733 51 20 ) ) PUNCT dad-10733 51 21 which which PRON dad-10733 51 22 omit omit VERB dad-10733 51 23 the the DET dad-10733 51 24 automatic automatic ADJ dad-10733 51 25 speech speech NOUN dad-10733 51 26 recognition recognition NOUN dad-10733 51 27 and and CCONJ dad-10733 51 28 speech speech NOUN dad-10733 51 29 synthesis synthesis NOUN dad-10733 51 30 . . PUNCT dad-10733 52 1 2.2 2.2 NUM dad-10733 52 2 tasks task NOUN dad-10733 52 3 and and CCONJ dad-10733 52 4 objectives objective NOUN dad-10733 52 5 dialogue dialogue NOUN dad-10733 52 6 systems system NOUN dad-10733 52 7 have have AUX dad-10733 52 8 been be AUX dad-10733 52 9 built build VERB dad-10733 52 10 for for ADP dad-10733 52 11 a a DET dad-10733 52 12 wide wide ADJ dad-10733 52 13 range range NOUN dad-10733 52 14 of of ADP dad-10733 52 15 purposes purpose NOUN dad-10733 52 16 . . PUNCT dad-10733 53 1 a a DET dad-10733 53 2 useful useful ADJ dad-10733 53 3 distinction distinction NOUN dad-10733 53 4 can can AUX dad-10733 53 5 be be AUX dad-10733 53 6 made make VERB dad-10733 53 7 between between ADP dad-10733 53 8 goal goal NOUN dad-10733 53 9 - - PUNCT dad-10733 53 10 driven drive VERB dad-10733 53 11 dialogue dialogue NOUN dad-10733 53 12 systems system NOUN dad-10733 53 13 , , PUNCT dad-10733 53 14 such such ADJ dad-10733 53 15 as as ADP dad-10733 53 16 technical technical ADJ dad-10733 53 17 support support NOUN dad-10733 53 18 services service NOUN dad-10733 53 19 , , PUNCT dad-10733 53 20 and and CCONJ dad-10733 53 21 non non ADJ dad-10733 53 22 - - ADJ dad-10733 53 23 goal goal ADJ dad-10733 53 24 - - PUNCT dad-10733 53 25 driven drive VERB dad-10733 53 26 dialogue dialogue NOUN dad-10733 53 27 systems system NOUN dad-10733 53 28 , , PUNCT dad-10733 53 29 such such ADJ dad-10733 53 30 as as ADP dad-10733 53 31 bots bot NOUN dad-10733 53 32 aimed aim VERB dad-10733 53 33 for for ADP dad-10733 53 34 general general ADJ dad-10733 53 35 chatting chatting NOUN dad-10733 53 36 ( ( PUNCT dad-10733 53 37 wallace wallace NOUN dad-10733 53 38 , , PUNCT dad-10733 53 39 2009 2009 NUM dad-10733 53 40 ; ; PUNCT dad-10733 53 41 serban serban PROPN dad-10733 53 42 et et PROPN dad-10733 53 43 al al PROPN dad-10733 53 44 . . PROPN dad-10733 53 45 , , PUNCT dad-10733 53 46 2017b 2017b NUM dad-10733 53 47 ; ; PUNCT dad-10733 53 48 a. a. NOUN dad-10733 53 49 ram ram NOUN dad-10733 53 50 , , PUNCT dad-10733 53 51 2017 2017 NUM dad-10733 53 52 ; ; PUNCT dad-10733 53 53 i. i. PROPN dad-10733 53 54 papaioannou papaioannou PROPN dad-10733 53 55 , , PUNCT dad-10733 53 56 2017 2017 NUM dad-10733 53 57 ; ; PUNCT dad-10733 53 58 serban serban PROPN dad-10733 53 59 et et PROPN dad-10733 53 60 al al PROPN dad-10733 53 61 . . PROPN dad-10733 53 62 , , PUNCT dad-10733 53 63 2017c 2017c NUM dad-10733 53 64 ) ) PUNCT dad-10733 53 65 . . PUNCT dad-10733 54 1 although although SCONJ dad-10733 54 2 both both DET dad-10733 54 3 types type NOUN dad-10733 54 4 of of ADP dad-10733 54 5 systems system NOUN dad-10733 54 6 do do AUX dad-10733 54 7 in in ADP dad-10733 54 8 fact fact NOUN dad-10733 54 9 have have VERB dad-10733 54 10 objectives objective NOUN dad-10733 54 11 , , PUNCT dad-10733 54 12 typically typically ADV dad-10733 54 13 the the DET dad-10733 54 14 goal goal NOUN dad-10733 54 15 - - PUNCT dad-10733 54 16 driven drive VERB dad-10733 54 17 dialogue dialogue NOUN dad-10733 54 18 systems system NOUN dad-10733 54 19 have have VERB dad-10733 54 20 a a DET dad-10733 54 21 well well ADV dad-10733 54 22 - - PUNCT dad-10733 54 23 defined define VERB dad-10733 54 24 measure measure NOUN dad-10733 54 25 of of ADP dad-10733 54 26 performance performance NOUN dad-10733 54 27 that that PRON dad-10733 54 28 is be AUX dad-10733 54 29 explicitly explicitly ADV dad-10733 54 30 related relate VERB dad-10733 54 31 to to ADP dad-10733 54 32 task task NOUN dad-10733 54 33 completion completion NOUN dad-10733 54 34 . . PUNCT dad-10733 55 1 while while SCONJ dad-10733 55 2 both both DET dad-10733 55 3 goal goal NOUN dad-10733 55 4 - - PUNCT dad-10733 55 5 driven drive VERB dad-10733 55 6 and and CCONJ dad-10733 55 7 non non ADJ dad-10733 55 8 - - ADJ dad-10733 55 9 goal goal ADJ dad-10733 55 10 - - PUNCT dad-10733 55 11 driven drive VERB dad-10733 55 12 components component NOUN dad-10733 55 13 may may AUX dad-10733 55 14 have have VERB dad-10733 55 15 different different ADJ dad-10733 55 16 levels level NOUN dad-10733 55 17 of of ADP dad-10733 55 18 abstraction abstraction NOUN dad-10733 55 19 , , PUNCT dad-10733 55 20 throughout throughout ADP dad-10733 55 21 this this DET dad-10733 55 22 text text NOUN dad-10733 55 23 , , PUNCT dad-10733 55 24 we we PRON dad-10733 55 25 generally generally ADV dad-10733 55 26 refer refer VERB dad-10733 55 27 to to ADP dad-10733 55 28 the the DET dad-10733 55 29 surface surface NOUN dad-10733 55 30 - - PUNCT dad-10733 55 31 form form NOUN dad-10733 55 32 output output NOUN dad-10733 55 33 of of ADP dad-10733 55 34 a a DET dad-10733 55 35 dialogue dialogue NOUN dad-10733 55 36 system system NOUN dad-10733 55 37 as as ADP dad-10733 55 38 the the DET dad-10733 55 39 dialogue dialogue NOUN dad-10733 55 40 system system NOUN dad-10733 55 41 or or CCONJ dad-10733 55 42 natural natural ADJ dad-10733 55 43 language language NOUN dad-10733 55 44 response response NOUN dad-10733 55 45 ( ( PUNCT dad-10733 55 46 i.e. i.e. X dad-10733 55 47 the the DET dad-10733 55 48 natural natural ADJ dad-10733 55 49 language language NOUN dad-10733 55 50 generation generation NOUN dad-10733 55 51 output output NOUN dad-10733 55 52 ) ) PUNCT dad-10733 55 53 and and CCONJ dad-10733 55 54 a a DET dad-10733 55 55 concept concept NOUN dad-10733 55 56 - - PUNCT dad-10733 55 57 level level NOUN dad-10733 55 58 response response NOUN dad-10733 55 59 ( ( PUNCT dad-10733 55 60 e.g. e.g. ADV dad-10733 55 61 the the DET dad-10733 55 62 output output NOUN dad-10733 55 63 of of ADP dad-10733 55 64 a a DET dad-10733 55 65 dialogue dialogue NOUN dad-10733 55 66 manager manager NOUN dad-10733 55 67 or or CCONJ dad-10733 55 68 response response NOUN dad-10733 55 69 action action NOUN dad-10733 55 70 selection selection NOUN dad-10733 55 71 mechanism mechanism NOUN dad-10733 55 72 ) ) PUNCT dad-10733 55 73 as as ADP dad-10733 55 74 a a DET dad-10733 55 75 response response NOUN dad-10733 55 76 action action NOUN dad-10733 55 77 . . PUNCT dad-10733 56 1 non non ADJ dad-10733 56 2 - - ADJ dad-10733 56 3 goal goal ADJ dad-10733 56 4 - - PUNCT dad-10733 56 5 driven drive VERB dad-10733 56 6 dialogue dialogue NOUN dad-10733 56 7 systems system NOUN dad-10733 56 8 . . PUNCT dad-10733 57 1 research research NOUN dad-10733 57 2 on on ADP dad-10733 57 3 non non ADJ dad-10733 57 4 - - ADJ dad-10733 57 5 goal goal ADJ dad-10733 57 6 - - PUNCT dad-10733 57 7 driven drive VERB dad-10733 57 8 dialogue dialogue NOUN dad-10733 57 9 systems system NOUN dad-10733 57 10 goes go VERB dad-10733 57 11 back back ADV dad-10733 57 12 to to ADP dad-10733 57 13 the the DET dad-10733 57 14 mid-60s mid-60 NOUN dad-10733 57 15 . . PUNCT dad-10733 58 1 it it PRON dad-10733 58 2 began begin VERB dad-10733 58 3 , , PUNCT dad-10733 58 4 perhaps perhaps ADV dad-10733 58 5 , , PUNCT dad-10733 58 6 with with ADP dad-10733 58 7 weizenbaum weizenbaum PROPN dad-10733 58 8 ’s ’s PART dad-10733 58 9 famous famous ADJ dad-10733 58 10 program program NOUN dad-10733 58 11 eliza eliza NOUN dad-10733 58 12 , , PUNCT dad-10733 58 13 a a DET dad-10733 58 14 system system NOUN dad-10733 58 15 based base VERB dad-10733 58 16 only only ADV dad-10733 58 17 on on ADP dad-10733 58 18 simple simple ADJ dad-10733 58 19 text text NOUN dad-10733 58 20 parsing parsing NOUN dad-10733 58 21 rules rule NOUN dad-10733 58 22 that that PRON dad-10733 58 23 managed manage VERB dad-10733 58 24 to to PART dad-10733 58 25 convincingly convincingly ADV dad-10733 58 26 mimic mimic VERB dad-10733 58 27 a a DET dad-10733 58 28 rogerian rogerian ADJ dad-10733 58 29 psychotherapist psychotherapist NOUN dad-10733 58 30 by by ADP dad-10733 58 31 persistently persistently ADV dad-10733 58 32 rephrasing rephrase VERB dad-10733 58 33 statements statement NOUN dad-10733 58 34 or or CCONJ dad-10733 58 35 asking ask VERB dad-10733 58 36 questions question NOUN dad-10733 58 37 ( ( PUNCT dad-10733 58 38 weizenbaum weizenbaum NOUN dad-10733 58 39 , , PUNCT dad-10733 58 40 1966 1966 NUM dad-10733 58 41 ) ) PUNCT dad-10733 58 42 . . PUNCT dad-10733 59 1 this this DET dad-10733 59 2 line line NOUN dad-10733 59 3 of of ADP dad-10733 59 4 research research NOUN dad-10733 59 5 was be AUX dad-10733 59 6 continued continue VERB dad-10733 59 7 by by ADP dad-10733 59 8 colby colby NOUN dad-10733 59 9 ( ( PUNCT dad-10733 59 10 1981 1981 NUM dad-10733 59 11 ) ) PUNCT dad-10733 59 12 , , PUNCT dad-10733 59 13 who who PRON dad-10733 59 14 used use VERB dad-10733 59 15 simple simple ADJ dad-10733 59 16 text text NOUN dad-10733 59 17 parsing parsing NOUN dad-10733 59 18 rules rule NOUN dad-10733 59 19 to to PART dad-10733 59 20 construct construct VERB dad-10733 59 21 the the DET dad-10733 59 22 dialogue dialogue NOUN dad-10733 59 23 system system NOUN dad-10733 59 24 parry parry PROPN dad-10733 59 25 , , PUNCT dad-10733 59 26 which which PRON dad-10733 59 27 managed manage VERB dad-10733 59 28 to to PART dad-10733 59 29 mimic mimic VERB dad-10733 59 30 the the DET dad-10733 59 31 pathological pathological ADJ dad-10733 59 32 behaviour behaviour NOUN dad-10733 59 33 of of ADP dad-10733 59 34 a a DET dad-10733 59 35 paranoid paranoid ADJ dad-10733 59 36 patient patient NOUN dad-10733 59 37 to to ADP dad-10733 59 38 the the DET dad-10733 59 39 extent extent NOUN dad-10733 59 40 that that SCONJ dad-10733 59 41 clinicians clinician NOUN dad-10733 59 42 could could AUX dad-10733 59 43 not not PART dad-10733 59 44 distinguish distinguish VERB dad-10733 59 45 it it PRON dad-10733 59 46 from from ADP dad-10733 59 47 real real ADJ dad-10733 59 48 patients patient NOUN dad-10733 59 49 . . PUNCT dad-10733 60 1 however however ADV dad-10733 60 2 , , PUNCT dad-10733 60 3 neither neither PRON dad-10733 60 4 of of ADP dad-10733 60 5 these these DET dad-10733 60 6 two two NUM dad-10733 60 7 systems system NOUN dad-10733 60 8 used use VERB dad-10733 60 9 data data NOUN dad-10733 60 10 - - PUNCT dad-10733 60 11 driven drive VERB dad-10733 60 12 learning learning NOUN dad-10733 60 13 approaches approach NOUN dad-10733 60 14 . . PUNCT dad-10733 61 1 later later ADV dad-10733 61 2 work work NOUN dad-10733 61 3 , , PUNCT dad-10733 61 4 such such ADJ dad-10733 61 5 as as ADP dad-10733 61 6 the the DET dad-10733 61 7 megahal megahal NOUN dad-10733 61 8 system system NOUN dad-10733 61 9 by by ADP dad-10733 61 10 hutchens hutchen NOUN dad-10733 61 11 and and CCONJ dad-10733 61 12 alder alder NOUN dad-10733 61 13 ( ( PUNCT dad-10733 61 14 1998 1998 NUM dad-10733 61 15 ) ) PUNCT dad-10733 61 16 , , PUNCT dad-10733 61 17 started start VERB dad-10733 61 18 to to PART dad-10733 61 19 apply apply VERB dad-10733 61 20 data data NOUN dad-10733 61 21 - - PUNCT dad-10733 61 22 driven drive VERB dad-10733 61 23 methods method NOUN dad-10733 61 24 ( ( PUNCT dad-10733 61 25 shawar shawar NOUN dad-10733 61 26 and and CCONJ dad-10733 61 27 atwell atwell PROPN dad-10733 61 28 , , PUNCT dad-10733 61 29 2007b 2007b NUM dad-10733 61 30 ) ) PUNCT dad-10733 61 31 . . PUNCT dad-10733 62 1 hutchens hutchens PROPN dad-10733 62 2 and and CCONJ dad-10733 62 3 alder alder NOUN dad-10733 62 4 ( ( PUNCT dad-10733 62 5 1998 1998 NUM dad-10733 62 6 ) ) PUNCT dad-10733 62 7 proposed propose VERB dad-10733 62 8 modeling modeling NOUN dad-10733 62 9 dialogue dialogue NOUN dad-10733 62 10 as as ADP dad-10733 62 11 a a DET dad-10733 62 12 stochastic stochastic ADJ dad-10733 62 13 sequence sequence NOUN dad-10733 62 14 of of ADP dad-10733 62 15 discrete discrete ADJ dad-10733 62 16 symbols symbol NOUN dad-10733 62 17 ( ( PUNCT dad-10733 62 18 words word NOUN dad-10733 62 19 ) ) PUNCT dad-10733 62 20 using use VERB dad-10733 62 21 4thorder 4thorder ADJ dad-10733 62 22 markov markov NOUN dad-10733 62 23 chains chain NOUN dad-10733 62 24 . . PUNCT dad-10733 63 1 given give VERB dad-10733 63 2 a a DET dad-10733 63 3 user user NOUN dad-10733 63 4 utterance utterance NOUN dad-10733 63 5 , , PUNCT dad-10733 63 6 their their PRON dad-10733 63 7 system system NOUN dad-10733 63 8 generated generate VERB dad-10733 63 9 a a DET dad-10733 63 10 response response NOUN dad-10733 63 11 by by ADP dad-10733 63 12 following follow VERB dad-10733 63 13 a a DET dad-10733 63 14 two two NUM dad-10733 63 15 - - PUNCT dad-10733 63 16 step step NOUN dad-10733 63 17 procedure procedure NOUN dad-10733 63 18 : : PUNCT dad-10733 63 19 first first ADV dad-10733 63 20 , , PUNCT dad-10733 63 21 a a DET dad-10733 63 22 sequence sequence NOUN dad-10733 63 23 of of ADP dad-10733 63 24 topic topic NOUN dad-10733 63 25 keywords keyword NOUN dad-10733 63 26 , , PUNCT dad-10733 63 27 used use VERB dad-10733 63 28 to to PART dad-10733 63 29 create create VERB dad-10733 63 30 a a DET dad-10733 63 31 seed seed NOUN dad-10733 63 32 reply reply NOUN dad-10733 63 33 , , PUNCT dad-10733 63 34 was be AUX dad-10733 63 35 extracted extract VERB dad-10733 63 36 from from ADP dad-10733 63 37 the the DET dad-10733 63 38 user user NOUN dad-10733 63 39 ’s ’s PART dad-10733 63 40 utterance utterance NOUN dad-10733 63 41 ; ; PUNCT dad-10733 63 42 second second ADJ dad-10733 63 43 , , PUNCT dad-10733 63 44 starting start VERB dad-10733 63 45 from from ADP dad-10733 63 46 the the DET dad-10733 63 47 seed seed NOUN dad-10733 63 48 reply reply NOUN dad-10733 63 49 , , PUNCT dad-10733 63 50 two two NUM dad-10733 63 51 separate separate ADJ dad-10733 63 52 markov markov NOUN dad-10733 63 53 chains chain NOUN dad-10733 63 54 generated generate VERB dad-10733 63 55 the the DET dad-10733 63 56 words word NOUN dad-10733 63 57 preceding precede VERB dad-10733 63 58 and and CCONJ dad-10733 63 59 proceeding proceed VERB dad-10733 63 60 the the DET dad-10733 63 61 seed seed NOUN dad-10733 63 62 keywords keyword NOUN dad-10733 63 63 . . PUNCT dad-10733 64 1 this this DET dad-10733 64 2 procedure procedure NOUN dad-10733 64 3 produced produce VERB dad-10733 64 4 many many ADJ dad-10733 64 5 candidate candidate NOUN dad-10733 64 6 responses response NOUN dad-10733 64 7 , , PUNCT dad-10733 64 8 from from ADP dad-10733 64 9 which which PRON dad-10733 64 10 the the DET dad-10733 64 11 highest high ADJ dad-10733 64 12 entropy entropy NOUN dad-10733 64 13 response response NOUN dad-10733 64 14 was be AUX dad-10733 64 15 returned return VERB dad-10733 64 16 to to ADP dad-10733 64 17 the the DET dad-10733 64 18 user user NOUN dad-10733 64 19 . . PUNCT dad-10733 65 1 under under ADP dad-10733 65 2 the the DET dad-10733 65 3 4 4 NUM dad-10733 65 4 a a DET dad-10733 65 5 survey survey NOUN dad-10733 65 6 of of ADP dad-10733 65 7 available available ADJ dad-10733 65 8 corpora corpora PROPN dad-10733 65 9 for for ADP dad-10733 65 10 building build VERB dad-10733 65 11 data data NOUN dad-10733 65 12 - - PUNCT dad-10733 65 13 driven drive VERB dad-10733 65 14 dialogue dialogue NOUN dad-10733 65 15 systems system NOUN dad-10733 65 16 assumption assumption NOUN dad-10733 65 17 that that SCONJ dad-10733 65 18 the the DET dad-10733 65 19 coverage coverage NOUN dad-10733 65 20 of of ADP dad-10733 65 21 different different ADJ dad-10733 65 22 topics topic NOUN dad-10733 65 23 and and CCONJ dad-10733 65 24 general general ADJ dad-10733 65 25 fluency fluency NOUN dad-10733 65 26 is be AUX dad-10733 65 27 of of ADP dad-10733 65 28 primary primary ADJ dad-10733 65 29 importance importance NOUN dad-10733 65 30 , , PUNCT dad-10733 65 31 the the DET dad-10733 65 32 4th 4th ADJ dad-10733 65 33 order order NOUN dad-10733 65 34 markov markov NOUN dad-10733 65 35 chains chain NOUN dad-10733 65 36 were be AUX dad-10733 65 37 trained train VERB dad-10733 65 38 on on ADP dad-10733 65 39 a a DET dad-10733 65 40 mixture mixture NOUN dad-10733 65 41 of of ADP dad-10733 65 42 data datum NOUN dad-10733 65 43 sources source NOUN dad-10733 65 44 ranging range VERB dad-10733 65 45 from from ADP dad-10733 65 46 real real ADJ dad-10733 65 47 and and CCONJ dad-10733 65 48 fictive fictive ADJ dad-10733 65 49 dialogues dialogue NOUN dad-10733 65 50 to to ADP dad-10733 65 51 arbitrary arbitrary ADJ dad-10733 65 52 texts text NOUN dad-10733 65 53 . . PUNCT dad-10733 66 1 until until SCONJ dad-10733 66 2 very very ADV dad-10733 66 3 recently recently ADV dad-10733 66 4 , , PUNCT dad-10733 66 5 such such ADJ dad-10733 66 6 data data NOUN dad-10733 66 7 - - PUNCT dad-10733 66 8 driven drive VERB dad-10733 66 9 dialogue dialogue NOUN dad-10733 66 10 systems system NOUN dad-10733 66 11 were be AUX dad-10733 66 12 not not PART dad-10733 66 13 applied apply VERB dad-10733 66 14 widely widely ADV dad-10733 66 15 in in ADP dad-10733 66 16 real real ADJ dad-10733 66 17 - - PUNCT dad-10733 66 18 world world NOUN dad-10733 66 19 applications application NOUN dad-10733 66 20 ( ( PUNCT dad-10733 66 21 perez perez NOUN dad-10733 66 22 - - PUNCT dad-10733 66 23 marin marin NOUN dad-10733 66 24 and and CCONJ dad-10733 66 25 pascual pascual PROPN dad-10733 66 26 - - PUNCT dad-10733 66 27 nieto nieto PROPN dad-10733 66 28 , , PUNCT dad-10733 66 29 2011 2011 NUM dad-10733 66 30 ; ; PUNCT dad-10733 66 31 shawar shawar NOUN dad-10733 66 32 and and CCONJ dad-10733 66 33 atwell atwell PROPN dad-10733 66 34 , , PUNCT dad-10733 66 35 2007b 2007b NUM dad-10733 66 36 ) ) PUNCT dad-10733 66 37 . . PUNCT dad-10733 67 1 more more ADV dad-10733 67 2 recently recently ADV dad-10733 67 3 , , PUNCT dad-10733 67 4 in in ADP dad-10733 67 5 a a DET dad-10733 67 6 similar similar ADJ dad-10733 67 7 spirit spirit NOUN dad-10733 67 8 , , PUNCT dad-10733 67 9 several several ADJ dad-10733 67 10 neural neural ADJ dad-10733 67 11 network network NOUN dad-10733 67 12 architectures architecture NOUN dad-10733 67 13 trained train VERB dad-10733 67 14 on on ADP dad-10733 67 15 large large ADJ dad-10733 67 16 - - PUNCT dad-10733 67 17 scale scale NOUN dad-10733 67 18 corpora corpora NOUN dad-10733 67 19 have have AUX dad-10733 67 20 been be AUX dad-10733 67 21 developed develop VERB dad-10733 67 22 . . PUNCT dad-10733 68 1 these these DET dad-10733 68 2 models model NOUN dad-10733 68 3 show show VERB dad-10733 68 4 promising promising ADJ dad-10733 68 5 results result NOUN dad-10733 68 6 for for ADP dad-10733 68 7 several several ADJ dad-10733 68 8 non non ADJ dad-10733 68 9 - - ADJ dad-10733 68 10 goal goal ADJ dad-10733 68 11 - - PUNCT dad-10733 68 12 driven drive VERB dad-10733 68 13 dialogue dialogue NOUN dad-10733 68 14 tasks task NOUN dad-10733 68 15 ( ( PUNCT dad-10733 68 16 ritter ritter PROPN dad-10733 68 17 et et PROPN dad-10733 68 18 al al PROPN dad-10733 68 19 . . PROPN dad-10733 68 20 , , PUNCT dad-10733 68 21 2011 2011 NUM dad-10733 68 22 ; ; PUNCT dad-10733 68 23 vinyals vinyal NOUN dad-10733 68 24 and and CCONJ dad-10733 68 25 le le NOUN dad-10733 68 26 , , PUNCT dad-10733 68 27 2015 2015 NUM dad-10733 68 28 ; ; PUNCT dad-10733 68 29 lowe lowe PROPN dad-10733 68 30 et et PROPN dad-10733 68 31 al al PROPN dad-10733 68 32 . . PROPN dad-10733 68 33 , , PUNCT dad-10733 68 34 2015a 2015a NUM dad-10733 68 35 ; ; PUNCT dad-10733 68 36 sordoni sordoni PROPN dad-10733 68 37 et et PROPN dad-10733 68 38 al al PROPN dad-10733 68 39 . . PROPN dad-10733 68 40 , , PUNCT dad-10733 68 41 2015 2015 NUM dad-10733 68 42 ; ; PUNCT dad-10733 68 43 shang shang PROPN dad-10733 68 44 et et PROPN dad-10733 68 45 al al PROPN dad-10733 68 46 . . PROPN dad-10733 68 47 , , PUNCT dad-10733 68 48 2015 2015 NUM dad-10733 68 49 ; ; PUNCT dad-10733 68 50 li li PROPN dad-10733 68 51 et et PROPN dad-10733 68 52 al al PROPN dad-10733 68 53 . . PROPN dad-10733 68 54 , , PUNCT dad-10733 68 55 2015 2015 NUM dad-10733 68 56 ; ; PUNCT dad-10733 68 57 serban serban PROPN dad-10733 68 58 et et PROPN dad-10733 68 59 al al PROPN dad-10733 68 60 . . PROPN dad-10733 68 61 , , PUNCT dad-10733 68 62 2016 2016 NUM dad-10733 68 63 ; ; PUNCT dad-10733 68 64 serban serban PROPN dad-10733 68 65 et et PROPN dad-10733 68 66 al al PROPN dad-10733 68 67 . . PROPN dad-10733 68 68 , , PUNCT dad-10733 68 69 2017d 2017d NUM dad-10733 68 70 , , PUNCT dad-10733 68 71 a a PRON dad-10733 68 72 ; ; PUNCT dad-10733 68 73 dodge dodge VERB dad-10733 68 74 et et PROPN dad-10733 68 75 al al PROPN dad-10733 68 76 . . PROPN dad-10733 68 77 , , PUNCT dad-10733 68 78 2015 2015 NUM dad-10733 68 79 ; ; PUNCT dad-10733 68 80 williams williams PROPN dad-10733 68 81 and and CCONJ dad-10733 68 82 zweig zweig NOUN dad-10733 68 83 , , PUNCT dad-10733 68 84 2016 2016 NUM dad-10733 68 85 ; ; PUNCT dad-10733 68 86 weston weston PROPN dad-10733 68 87 , , PUNCT dad-10733 68 88 2016 2016 NUM dad-10733 68 89 ) ) PUNCT dad-10733 68 90 . . PUNCT dad-10733 69 1 however however ADV dad-10733 69 2 , , PUNCT dad-10733 69 3 they they PRON dad-10733 69 4 require require VERB dad-10733 69 5 having have VERB dad-10733 69 6 sufficiently sufficiently ADV dad-10733 69 7 large large ADJ dad-10733 69 8 corpora corpora NOUN dad-10733 69 9 — — PUNCT dad-10733 69 10 in in ADP dad-10733 69 11 the the DET dad-10733 69 12 hundreds hundred NOUN dad-10733 69 13 of of ADP dad-10733 69 14 millions million NOUN dad-10733 69 15 or or CCONJ dad-10733 69 16 even even ADV dad-10733 69 17 billions billion NOUN dad-10733 69 18 of of ADP dad-10733 69 19 words word NOUN dad-10733 69 20 — — PUNCT dad-10733 69 21 in in ADP dad-10733 69 22 order order NOUN dad-10733 69 23 to to PART dad-10733 69 24 achieve achieve VERB dad-10733 69 25 these these DET dad-10733 69 26 results result NOUN dad-10733 69 27 . . PUNCT dad-10733 70 1 goal goal NOUN dad-10733 70 2 - - PUNCT dad-10733 70 3 driven drive VERB dad-10733 70 4 dialogue dialogue NOUN dad-10733 70 5 systems system NOUN dad-10733 70 6 . . PUNCT dad-10733 71 1 initial initial ADJ dad-10733 71 2 work work NOUN dad-10733 71 3 on on ADP dad-10733 71 4 goal goal NOUN dad-10733 71 5 - - PUNCT dad-10733 71 6 driven drive VERB dad-10733 71 7 dialogue dialogue NOUN dad-10733 71 8 systems system NOUN dad-10733 71 9 was be AUX dad-10733 71 10 primarily primarily ADV dad-10733 71 11 based base VERB dad-10733 71 12 on on ADP dad-10733 71 13 deterministic deterministic ADJ dad-10733 71 14 hand hand NOUN dad-10733 71 15 - - PUNCT dad-10733 71 16 crafted craft VERB dad-10733 71 17 rules rule NOUN dad-10733 71 18 coupled couple VERB dad-10733 71 19 with with ADP dad-10733 71 20 learned learn VERB dad-10733 71 21 speech speech NOUN dad-10733 71 22 recognition recognition NOUN dad-10733 71 23 models model NOUN dad-10733 71 24 . . PUNCT dad-10733 72 1 one one NUM dad-10733 72 2 example example NOUN dad-10733 72 3 is be AUX dad-10733 72 4 the the DET dad-10733 72 5 sundial sundial ADJ dad-10733 72 6 project project NOUN dad-10733 72 7 , , PUNCT dad-10733 72 8 which which PRON dad-10733 72 9 was be AUX dad-10733 72 10 capable capable ADJ dad-10733 72 11 of of ADP dad-10733 72 12 providing provide VERB dad-10733 72 13 timetable timetable NOUN dad-10733 72 14 information information NOUN dad-10733 72 15 about about ADP dad-10733 72 16 trains train NOUN dad-10733 72 17 and and CCONJ dad-10733 72 18 airplanes airplane NOUN dad-10733 72 19 , , PUNCT dad-10733 72 20 as as ADV dad-10733 72 21 well well ADV dad-10733 72 22 as as ADP dad-10733 72 23 taking take VERB dad-10733 72 24 airplane airplane NOUN dad-10733 72 25 reservations reservation NOUN dad-10733 72 26 ( ( PUNCT dad-10733 72 27 aust aust PROPN dad-10733 72 28 et et PROPN dad-10733 72 29 al al PROPN dad-10733 72 30 . . PROPN dad-10733 72 31 , , PUNCT dad-10733 72 32 1995 1995 NUM dad-10733 72 33 ; ; PUNCT dad-10733 72 34 mcglashan mcglashan PROPN dad-10733 72 35 et et PROPN dad-10733 72 36 al al PROPN dad-10733 72 37 . . PROPN dad-10733 72 38 , , PUNCT dad-10733 72 39 1992 1992 NUM dad-10733 72 40 ; ; PUNCT dad-10733 72 41 simpson simpson PROPN dad-10733 72 42 and and CCONJ dad-10733 72 43 eraser eraser NOUN dad-10733 72 44 , , PUNCT dad-10733 72 45 1993 1993 NUM dad-10733 72 46 ) ) PUNCT dad-10733 72 47 . . PUNCT dad-10733 73 1 later later ADV dad-10733 73 2 , , PUNCT dad-10733 73 3 machine machine NOUN dad-10733 73 4 learning learn VERB dad-10733 73 5 techniques technique NOUN dad-10733 73 6 were be AUX dad-10733 73 7 used use VERB dad-10733 73 8 to to PART dad-10733 73 9 classify classify VERB dad-10733 73 10 the the DET dad-10733 73 11 intention intention NOUN dad-10733 73 12 ( ( PUNCT dad-10733 73 13 or or CCONJ dad-10733 73 14 need need VERB dad-10733 73 15 ) ) PUNCT dad-10733 73 16 of of ADP dad-10733 73 17 the the DET dad-10733 73 18 user user NOUN dad-10733 73 19 , , PUNCT dad-10733 73 20 as as ADV dad-10733 73 21 well well ADV dad-10733 73 22 as as ADP dad-10733 73 23 to to PART dad-10733 73 24 bridge bridge VERB dad-10733 73 25 the the DET dad-10733 73 26 gap gap NOUN dad-10733 73 27 between between ADP dad-10733 73 28 text text NOUN dad-10733 73 29 and and CCONJ dad-10733 73 30 speech speech NOUN dad-10733 73 31 ( ( PUNCT dad-10733 73 32 e.g. e.g. ADV dad-10733 73 33 by by ADP dad-10733 73 34 taking take VERB dad-10733 73 35 into into ADP dad-10733 73 36 account account NOUN dad-10733 73 37 uncertainty uncertainty NOUN dad-10733 73 38 related relate VERB dad-10733 73 39 to to ADP dad-10733 73 40 the the DET dad-10733 73 41 outputs output NOUN dad-10733 73 42 of of ADP dad-10733 73 43 the the DET dad-10733 73 44 speech speech NOUN dad-10733 73 45 recognition recognition NOUN dad-10733 73 46 model model NOUN dad-10733 73 47 ) ) PUNCT dad-10733 73 48 ( ( PUNCT dad-10733 73 49 gorin gorin NOUN dad-10733 73 50 et et PROPN dad-10733 73 51 al al PROPN dad-10733 73 52 . . PROPN dad-10733 73 53 , , PUNCT dad-10733 73 54 1997 1997 NUM dad-10733 73 55 ) ) PUNCT dad-10733 73 56 . . PUNCT dad-10733 74 1 research research NOUN dad-10733 74 2 in in ADP dad-10733 74 3 this this DET dad-10733 74 4 area area NOUN dad-10733 74 5 started start VERB dad-10733 74 6 to to PART dad-10733 74 7 take take VERB dad-10733 74 8 off off ADP dad-10733 74 9 during during ADP dad-10733 74 10 the the DET dad-10733 74 11 mid mid ADJ dad-10733 74 12 1990s 1990 NOUN dad-10733 74 13 , , PUNCT dad-10733 74 14 when when SCONJ dad-10733 74 15 researchers researcher NOUN dad-10733 74 16 began begin VERB dad-10733 74 17 to to PART dad-10733 74 18 formulate formulate VERB dad-10733 74 19 dialogue dialogue NOUN dad-10733 74 20 as as ADP dad-10733 74 21 a a DET dad-10733 74 22 sequential sequential ADJ dad-10733 74 23 decision decision NOUN dad-10733 74 24 making make VERB dad-10733 74 25 problem problem NOUN dad-10733 74 26 based base VERB dad-10733 74 27 on on ADP dad-10733 74 28 markov markov NOUN dad-10733 74 29 decision decision NOUN dad-10733 74 30 processes process NOUN dad-10733 74 31 ( ( PUNCT dad-10733 74 32 singh singh PROPN dad-10733 74 33 et et PROPN dad-10733 74 34 al al PROPN dad-10733 74 35 . . PROPN dad-10733 74 36 , , PUNCT dad-10733 74 37 1999 1999 NUM dad-10733 74 38 ; ; PUNCT dad-10733 74 39 young young PROPN dad-10733 74 40 et et PROPN dad-10733 74 41 al al PROPN dad-10733 74 42 . . PROPN dad-10733 74 43 , , PUNCT dad-10733 74 44 2013 2013 NUM dad-10733 74 45 ; ; PUNCT dad-10733 74 46 paek paek PROPN dad-10733 74 47 , , PUNCT dad-10733 74 48 2006 2006 NUM dad-10733 74 49 ; ; PUNCT dad-10733 74 50 pieraccini pieraccini NOUN dad-10733 74 51 et et PROPN dad-10733 74 52 al al PROPN dad-10733 74 53 . . PROPN dad-10733 74 54 , , PUNCT dad-10733 74 55 2009 2009 NUM dad-10733 74 56 ) ) PUNCT dad-10733 74 57 . . PUNCT dad-10733 75 1 unlike unlike ADP dad-10733 75 2 for for ADP dad-10733 75 3 non non ADJ dad-10733 75 4 - - ADJ dad-10733 75 5 goal goal ADJ dad-10733 75 6 - - PUNCT dad-10733 75 7 driven drive VERB dad-10733 75 8 systems system NOUN dad-10733 75 9 , , PUNCT dad-10733 75 10 industry industry NOUN dad-10733 75 11 played play VERB dad-10733 75 12 a a DET dad-10733 75 13 major major ADJ dad-10733 75 14 role role NOUN dad-10733 75 15 and and CCONJ dad-10733 75 16 enabled enable VERB dad-10733 75 17 researchers researcher NOUN dad-10733 75 18 to to PART dad-10733 75 19 have have VERB dad-10733 75 20 access access NOUN dad-10733 75 21 to to ADP dad-10733 75 22 ( ( PUNCT dad-10733 75 23 at at ADP dad-10733 75 24 the the DET dad-10733 75 25 time time NOUN dad-10733 75 26 ) ) PUNCT dad-10733 75 27 relatively relatively ADV dad-10733 75 28 large large ADJ dad-10733 75 29 dialogue dialogue NOUN dad-10733 75 30 corpora corpora NOUN dad-10733 75 31 for for ADP dad-10733 75 32 certain certain ADJ dad-10733 75 33 tasks task NOUN dad-10733 75 34 , , PUNCT dad-10733 75 35 such such ADJ dad-10733 75 36 as as ADP dad-10733 75 37 recordings recording NOUN dad-10733 75 38 from from ADP dad-10733 75 39 technical technical ADJ dad-10733 75 40 support support NOUN dad-10733 75 41 call call NOUN dad-10733 75 42 centers center NOUN dad-10733 75 43 . . PUNCT dad-10733 76 1 although although SCONJ dad-10733 76 2 research research NOUN dad-10733 76 3 in in ADP dad-10733 76 4 the the DET dad-10733 76 5 past past ADJ dad-10733 76 6 decade decade NOUN dad-10733 76 7 has have AUX dad-10733 76 8 continued continue VERB dad-10733 76 9 to to PART dad-10733 76 10 push push VERB dad-10733 76 11 the the DET dad-10733 76 12 field field NOUN dad-10733 76 13 towards towards ADP dad-10733 76 14 data data NOUN dad-10733 76 15 - - PUNCT dad-10733 76 16 driven drive VERB dad-10733 76 17 approaches approach NOUN dad-10733 76 18 , , PUNCT dad-10733 76 19 commercial commercial ADJ dad-10733 76 20 systems system NOUN dad-10733 76 21 are be AUX dad-10733 76 22 highly highly ADV dad-10733 76 23 domain domain NOUN dad-10733 76 24 - - PUNCT dad-10733 76 25 specific specific ADJ dad-10733 76 26 and and CCONJ dad-10733 76 27 heavily heavily ADV dad-10733 76 28 based base VERB dad-10733 76 29 on on ADP dad-10733 76 30 hand hand NOUN dad-10733 76 31 - - PUNCT dad-10733 76 32 crafted craft VERB dad-10733 76 33 rules rule NOUN dad-10733 76 34 and and CCONJ dad-10733 76 35 features feature NOUN dad-10733 76 36 ( ( PUNCT dad-10733 76 37 young young ADJ dad-10733 76 38 et et PROPN dad-10733 76 39 al al PROPN dad-10733 76 40 . . PROPN dad-10733 76 41 , , PUNCT dad-10733 76 42 2013 2013 NUM dad-10733 76 43 ) ) PUNCT dad-10733 76 44 . . PUNCT dad-10733 77 1 in in ADP dad-10733 77 2 particular particular ADJ dad-10733 77 3 , , PUNCT dad-10733 77 4 many many ADJ dad-10733 77 5 of of ADP dad-10733 77 6 the the DET dad-10733 77 7 tasks task NOUN dad-10733 77 8 and and CCONJ dad-10733 77 9 datasets dataset NOUN dad-10733 77 10 available available ADJ dad-10733 77 11 are be AUX dad-10733 77 12 constrained constrain VERB dad-10733 77 13 to to ADP dad-10733 77 14 narrow narrow ADJ dad-10733 77 15 domains domain NOUN dad-10733 77 16 . . PUNCT dad-10733 78 1 2.3 2.3 NUM dad-10733 78 2 learning learn VERB dad-10733 78 3 dialogue dialogue NOUN dad-10733 78 4 system system NOUN dad-10733 78 5 components component NOUN dad-10733 78 6 most most ADJ dad-10733 78 7 of of ADP dad-10733 78 8 the the DET dad-10733 78 9 dialogue dialogue NOUN dad-10733 78 10 system system NOUN dad-10733 78 11 components component NOUN dad-10733 78 12 shown show VERB dad-10733 78 13 in in ADP dad-10733 78 14 figure figure NOUN dad-10733 78 15 1 1 NUM dad-10733 78 16 can can AUX dad-10733 78 17 be be AUX dad-10733 78 18 learned learn VERB dad-10733 78 19 through through ADP dad-10733 78 20 so so ADV dad-10733 78 21 - - PUNCT dad-10733 78 22 called call VERB dad-10733 78 23 discriminative discriminative NOUN dad-10733 78 24 models model NOUN dad-10733 78 25 , , PUNCT dad-10733 78 26 which which PRON dad-10733 78 27 aim aim VERB dad-10733 78 28 to to PART dad-10733 78 29 predict predict VERB dad-10733 78 30 labels label NOUN dad-10733 78 31 or or CCONJ dad-10733 78 32 annotations annotation NOUN dad-10733 78 33 relevant relevant ADJ dad-10733 78 34 to to ADP dad-10733 78 35 other other ADJ dad-10733 78 36 parts part NOUN dad-10733 78 37 of of ADP dad-10733 78 38 the the DET dad-10733 78 39 dialogue dialogue NOUN dad-10733 78 40 system system NOUN dad-10733 78 41 . . PUNCT dad-10733 79 1 many many ADJ dad-10733 79 2 discriminative discriminative NOUN dad-10733 79 3 models model NOUN dad-10733 79 4 , , PUNCT dad-10733 79 5 such such ADJ dad-10733 79 6 as as ADP dad-10733 79 7 the the DET dad-10733 79 8 ones one NOUN dad-10733 79 9 we we PRON dad-10733 79 10 focus focus VERB dad-10733 79 11 on on ADP dad-10733 79 12 in in ADP dad-10733 79 13 this this DET dad-10733 79 14 section section NOUN dad-10733 79 15 , , PUNCT dad-10733 79 16 fall fall VERB dad-10733 79 17 into into ADP dad-10733 79 18 the the DET dad-10733 79 19 machine machine NOUN dad-10733 79 20 learning learning NOUN dad-10733 79 21 paradigm paradigm NOUN dad-10733 79 22 of of ADP dad-10733 79 23 supervised supervised ADJ dad-10733 79 24 learning learning NOUN dad-10733 79 25 . . PUNCT dad-10733 80 1 when when SCONJ dad-10733 80 2 the the DET dad-10733 80 3 labels label NOUN dad-10733 80 4 of of ADP dad-10733 80 5 interest interest NOUN dad-10733 80 6 are be AUX dad-10733 80 7 discrete discrete ADJ dad-10733 80 8 ( ( PUNCT dad-10733 80 9 most most ADV dad-10733 80 10 commonly commonly ADV dad-10733 80 11 ) ) PUNCT dad-10733 80 12 the the DET dad-10733 80 13 models model NOUN dad-10733 80 14 are be AUX dad-10733 80 15 called call VERB dad-10733 80 16 classification classification NOUN dad-10733 80 17 models model NOUN dad-10733 80 18 . . PUNCT dad-10733 81 1 when when SCONJ dad-10733 81 2 the the DET dad-10733 81 3 labels label NOUN dad-10733 81 4 of of ADP dad-10733 81 5 interest interest NOUN dad-10733 81 6 are be AUX dad-10733 81 7 continuous continuous ADJ dad-10733 81 8 , , PUNCT dad-10733 81 9 the the DET dad-10733 81 10 models model NOUN dad-10733 81 11 are be AUX dad-10733 81 12 called call VERB dad-10733 81 13 regression regression NOUN dad-10733 81 14 models model NOUN dad-10733 81 15 . . PUNCT dad-10733 82 1 one one NUM dad-10733 82 2 popular popular ADJ dad-10733 82 3 approach approach NOUN dad-10733 82 4 for for ADP dad-10733 82 5 tackling tackle VERB dad-10733 82 6 the the DET dad-10733 82 7 discriminative discriminative NOUN dad-10733 82 8 task task NOUN dad-10733 82 9 is be AUX dad-10733 82 10 to to PART dad-10733 82 11 learn learn VERB dad-10733 82 12 a a DET dad-10733 82 13 probabilistic probabilistic ADJ dad-10733 82 14 model model NOUN dad-10733 82 15 of of ADP dad-10733 82 16 the the DET dad-10733 82 17 labels label NOUN dad-10733 82 18 conditioned condition VERB dad-10733 82 19 on on ADP dad-10733 82 20 the the DET dad-10733 82 21 available available ADJ dad-10733 82 22 information information NOUN dad-10733 82 23 , , PUNCT dad-10733 82 24 p p X dad-10733 82 25 ( ( PUNCT dad-10733 82 26 y y PROPN dad-10733 82 27 |x |x PROPN dad-10733 82 28 ) ) PUNCT dad-10733 82 29 , , PUNCT dad-10733 82 30 where where SCONJ dad-10733 82 31 y y PROPN dad-10733 82 32 is be AUX dad-10733 82 33 the the DET dad-10733 82 34 label label NOUN dad-10733 82 35 of of ADP dad-10733 82 36 interest interest NOUN dad-10733 82 37 ( ( PUNCT dad-10733 82 38 e.g. e.g. ADV dad-10733 82 39 a a DET dad-10733 82 40 discrete discrete ADJ dad-10733 82 41 variable variable NOUN dad-10733 82 42 representing represent VERB dad-10733 82 43 the the DET dad-10733 82 44 user user NOUN dad-10733 82 45 intent intent NOUN dad-10733 82 46 ) ) PUNCT dad-10733 82 47 , , PUNCT dad-10733 82 48 and and CCONJ dad-10733 82 49 x x X dad-10733 82 50 is be AUX dad-10733 82 51 the the DET dad-10733 82 52 available available ADJ dad-10733 82 53 information information NOUN dad-10733 82 54 ( ( PUNCT dad-10733 82 55 e.g. e.g. ADV dad-10733 82 56 utterances utterance NOUN dad-10733 82 57 in in ADP dad-10733 82 58 the the DET dad-10733 82 59 conversation conversation NOUN dad-10733 82 60 ) ) PUNCT dad-10733 82 61 . . PUNCT dad-10733 83 1 another another DET dad-10733 83 2 popular popular ADJ dad-10733 83 3 approach approach NOUN dad-10733 83 4 is be AUX dad-10733 83 5 to to PART dad-10733 83 6 use use VERB dad-10733 83 7 maximum maximum ADJ dad-10733 83 8 margin margin NOUN dad-10733 83 9 classifiers classifier NOUN dad-10733 83 10 such such ADJ dad-10733 83 11 as as ADP dad-10733 83 12 support support NOUN dad-10733 83 13 vector vector NOUN dad-10733 83 14 machines machine NOUN dad-10733 83 15 ( ( PUNCT dad-10733 83 16 cristianini cristianini PROPN dad-10733 83 17 and and CCONJ dad-10733 83 18 shawe shawe NOUN dad-10733 83 19 - - PUNCT dad-10733 83 20 taylor taylor PROPN dad-10733 83 21 , , PUNCT dad-10733 83 22 2000 2000 NUM dad-10733 83 23 ) ) PUNCT dad-10733 83 24 as as SCONJ dad-10733 83 25 opposed oppose VERB dad-10733 83 26 to to ADP dad-10733 83 27 probabilistic probabilistic ADJ dad-10733 83 28 models model NOUN dad-10733 83 29 . . PUNCT dad-10733 84 1 discriminative discriminative NOUN dad-10733 84 2 models model NOUN dad-10733 84 3 have have AUX dad-10733 84 4 allowed allow VERB dad-10733 84 5 goal goal NOUN dad-10733 84 6 - - PUNCT dad-10733 84 7 driven drive VERB dad-10733 84 8 dialogue dialogue NOUN dad-10733 84 9 systems system NOUN dad-10733 84 10 to to PART dad-10733 84 11 make make VERB dad-10733 84 12 significant significant ADJ dad-10733 84 13 progress progress NOUN dad-10733 84 14 ( ( PUNCT dad-10733 84 15 williams williams PROPN dad-10733 84 16 et et PROPN dad-10733 84 17 al al PROPN dad-10733 84 18 . . PROPN dad-10733 84 19 , , PUNCT dad-10733 84 20 2013 2013 NUM dad-10733 84 21 ) ) PUNCT dad-10733 84 22 . . PUNCT dad-10733 85 1 with with ADP dad-10733 85 2 proper proper ADJ dad-10733 85 3 annotations annotation NOUN dad-10733 85 4 , , PUNCT dad-10733 85 5 discriminative discriminative NOUN dad-10733 85 6 models model NOUN dad-10733 85 7 can can AUX dad-10733 85 8 be be AUX dad-10733 85 9 evaluated evaluate VERB dad-10733 85 10 automatically automatically ADV dad-10733 85 11 and and CCONJ dad-10733 85 12 accurately accurately ADV dad-10733 85 13 . . PUNCT dad-10733 86 1 furthermore furthermore ADV dad-10733 86 2 , , PUNCT dad-10733 86 3 once once ADV dad-10733 86 4 trained train VERB dad-10733 86 5 on on ADP dad-10733 86 6 a a DET dad-10733 86 7 given give VERB dad-10733 86 8 dataset dataset NOUN dad-10733 86 9 , , PUNCT dad-10733 86 10 these these DET dad-10733 86 11 models model NOUN dad-10733 86 12 may may AUX dad-10733 86 13 be be AUX dad-10733 86 14 plugged plug VERB dad-10733 86 15 into into ADP dad-10733 86 16 a a DET dad-10733 86 17 fully fully ADV dad-10733 86 18 - - PUNCT dad-10733 86 19 deployed deploy VERB dad-10733 86 20 dialogue dialogue NOUN dad-10733 86 21 system system NOUN dad-10733 86 22 ( ( PUNCT dad-10733 86 23 e.g. e.g. ADV dad-10733 86 24 a a DET dad-10733 86 25 classification classification NOUN dad-10733 86 26 model model NOUN dad-10733 86 27 for for ADP dad-10733 86 28 user user NOUN dad-10733 86 29 intents intent NOUN dad-10733 86 30 may may AUX dad-10733 86 31 be be AUX dad-10733 86 32 used use VERB dad-10733 86 33 as as ADP dad-10733 86 34 input input NOUN dad-10733 86 35 to to ADP dad-10733 86 36 dialogue dialogue NOUN dad-10733 86 37 state state NOUN dad-10733 86 38 tracking tracking NOUN dad-10733 86 39 ) ) PUNCT dad-10733 86 40 . . PUNCT dad-10733 87 1 although although SCONJ dad-10733 87 2 it it PRON dad-10733 87 3 is be AUX dad-10733 87 4 beyond beyond ADP dad-10733 87 5 the the DET dad-10733 87 6 scope scope NOUN dad-10733 87 7 of of ADP dad-10733 87 8 this this DET dad-10733 87 9 paper paper NOUN dad-10733 87 10 to to PART dad-10733 87 11 provide provide VERB dad-10733 87 12 a a DET dad-10733 87 13 survey survey NOUN dad-10733 87 14 5 5 NUM dad-10733 87 15 serban serban PROPN dad-10733 87 16 , , PUNCT dad-10733 87 17 lowe lowe PROPN dad-10733 87 18 , , PUNCT dad-10733 87 19 henderson henderson PROPN dad-10733 87 20 , , PUNCT dad-10733 87 21 charlin charlin PROPN dad-10733 87 22 and and CCONJ dad-10733 87 23 pineau pineau PROPN dad-10733 87 24 over over ADP dad-10733 87 25 such such ADJ dad-10733 87 26 system system NOUN dad-10733 87 27 components component NOUN dad-10733 87 28 , , PUNCT dad-10733 87 29 we we PRON dad-10733 87 30 now now ADV dad-10733 87 31 give give VERB dad-10733 87 32 a a DET dad-10733 87 33 brief brief ADJ dad-10733 87 34 example example NOUN dad-10733 87 35 of of ADP dad-10733 87 36 each each DET dad-10733 87 37 component component NOUN dad-10733 87 38 . . PUNCT dad-10733 88 1 this this PRON dad-10733 88 2 will will AUX dad-10733 88 3 motivate motivate VERB dad-10733 88 4 and and CCONJ dad-10733 88 5 facilitate facilitate VERB dad-10733 88 6 the the DET dad-10733 88 7 dataset dataset ADJ dad-10733 88 8 analysis analysis NOUN dad-10733 88 9 in in ADP dad-10733 88 10 section section NOUN dad-10733 88 11 4 4 NUM dad-10733 88 12 . . X dad-10733 88 13 2.3.1 2.3.1 NUM dad-10733 88 14 natural natural ADJ dad-10733 88 15 language language NOUN dad-10733 88 16 understanding understand VERB dad-10733 88 17 a a DET dad-10733 88 18 natural natural ADJ dad-10733 88 19 language language NOUN dad-10733 88 20 understanding understanding NOUN dad-10733 88 21 model model NOUN dad-10733 88 22 , , PUNCT dad-10733 88 23 placed place VERB dad-10733 88 24 in in ADP dad-10733 88 25 the the DET dad-10733 88 26 context context NOUN dad-10733 88 27 of of ADP dad-10733 88 28 a a DET dad-10733 88 29 dialogue dialogue NOUN dad-10733 88 30 system system NOUN dad-10733 88 31 , , PUNCT dad-10733 88 32 is be AUX dad-10733 88 33 typically typically ADV dad-10733 88 34 designed design VERB dad-10733 88 35 to to PART dad-10733 88 36 interpret interpret VERB dad-10733 88 37 and and CCONJ dad-10733 88 38 classify classify VERB dad-10733 88 39 the the DET dad-10733 88 40 semantic semantic ADJ dad-10733 88 41 meaning meaning NOUN dad-10733 88 42 or or CCONJ dad-10733 88 43 intent intent NOUN dad-10733 88 44 of of ADP dad-10733 88 45 the the DET dad-10733 88 46 interlocutor interlocutor NOUN dad-10733 88 47 . . PUNCT dad-10733 89 1 several several ADJ dad-10733 89 2 works work NOUN dad-10733 89 3 investigate investigate VERB dad-10733 89 4 different different ADJ dad-10733 89 5 statistical statistical ADJ dad-10733 89 6 approaches approach NOUN dad-10733 89 7 for for ADP dad-10733 89 8 learning learn VERB dad-10733 89 9 natural natural ADJ dad-10733 89 10 language language NOUN dad-10733 89 11 understanding understanding NOUN dad-10733 89 12 models model NOUN dad-10733 89 13 . . PUNCT dad-10733 90 1 these these PRON dad-10733 90 2 involve involve VERB dad-10733 90 3 semantic semantic ADJ dad-10733 90 4 frame frame NOUN dad-10733 90 5 parsing parse VERB dad-10733 90 6 wang wang PROPN dad-10733 90 7 et et PROPN dad-10733 90 8 al al PROPN dad-10733 90 9 . . PROPN dad-10733 91 1 ( ( PUNCT dad-10733 91 2 2005 2005 NUM dad-10733 91 3 ) ) PUNCT dad-10733 92 1 , , PUNCT dad-10733 92 2 intent intent ADJ dad-10733 92 3 classification classification NOUN dad-10733 92 4 ( ( PUNCT dad-10733 92 5 tur tur X dad-10733 92 6 and and CCONJ dad-10733 92 7 deng deng PROPN dad-10733 92 8 , , PUNCT dad-10733 92 9 2011 2011 NUM dad-10733 92 10 ) ) PUNCT dad-10733 92 11 , , PUNCT dad-10733 92 12 slot slot NOUN dad-10733 92 13 - - PUNCT dad-10733 92 14 filling fill VERB dad-10733 92 15 ( ( PUNCT dad-10733 92 16 mesnil mesnil NOUN dad-10733 92 17 et et PROPN dad-10733 92 18 al al PROPN dad-10733 92 19 . . PROPN dad-10733 92 20 , , PUNCT dad-10733 92 21 2013 2013 NUM dad-10733 92 22 ; ; PUNCT dad-10733 92 23 liu liu PROPN dad-10733 92 24 and and CCONJ dad-10733 92 25 lane lane NOUN dad-10733 92 26 , , PUNCT dad-10733 92 27 2017 2017 NUM dad-10733 92 28 ) ) PUNCT dad-10733 92 29 , , PUNCT dad-10733 92 30 and and CCONJ dad-10733 92 31 semantic semantic ADJ dad-10733 92 32 interpretation interpretation NOUN dad-10733 92 33 ( ( PUNCT dad-10733 92 34 miller miller PROPN dad-10733 92 35 et et PROPN dad-10733 92 36 al al PROPN dad-10733 92 37 . . PROPN dad-10733 92 38 , , PUNCT dad-10733 92 39 1996 1996 NUM dad-10733 92 40 ) ) PUNCT dad-10733 92 41 . . PUNCT dad-10733 93 1 discriminative discriminative NOUN dad-10733 93 2 models model NOUN dad-10733 93 3 , , PUNCT dad-10733 93 4 as as SCONJ dad-10733 93 5 aforementioned aforementione VERB dad-10733 93 6 , , PUNCT dad-10733 93 7 are be AUX dad-10733 93 8 often often ADV dad-10733 93 9 used use VERB dad-10733 93 10 in in ADP dad-10733 93 11 natural natural ADJ dad-10733 93 12 language language NOUN dad-10733 93 13 understanding understanding NOUN dad-10733 93 14 for for ADP dad-10733 93 15 user user NOUN dad-10733 93 16 intent intent ADJ dad-10733 93 17 classification classification NOUN dad-10733 93 18 . . PUNCT dad-10733 94 1 this this DET dad-10733 94 2 model model NOUN dad-10733 94 3 is be AUX dad-10733 94 4 trained train VERB dad-10733 94 5 to to PART dad-10733 94 6 predict predict VERB dad-10733 94 7 the the DET dad-10733 94 8 intent intent NOUN dad-10733 94 9 of of ADP dad-10733 94 10 a a DET dad-10733 94 11 user user NOUN dad-10733 94 12 conditioned condition VERB dad-10733 94 13 on on ADP dad-10733 94 14 the the DET dad-10733 94 15 utterances utterance NOUN dad-10733 94 16 of of ADP dad-10733 94 17 that that DET dad-10733 94 18 user user NOUN dad-10733 94 19 . . PUNCT dad-10733 95 1 in in ADP dad-10733 95 2 this this DET dad-10733 95 3 case case NOUN dad-10733 95 4 , , PUNCT dad-10733 95 5 the the DET dad-10733 95 6 intent intent NOUN dad-10733 95 7 is be AUX dad-10733 95 8 called call VERB dad-10733 95 9 the the DET dad-10733 95 10 label label NOUN dad-10733 95 11 ( ( PUNCT dad-10733 95 12 or or CCONJ dad-10733 95 13 target target VERB dad-10733 95 14 or or CCONJ dad-10733 95 15 output output NOUN dad-10733 95 16 ) ) PUNCT dad-10733 95 17 , , PUNCT dad-10733 95 18 and and CCONJ dad-10733 95 19 the the DET dad-10733 95 20 conditioned condition VERB dad-10733 95 21 utterances utterance NOUN dad-10733 95 22 are be AUX dad-10733 95 23 called call VERB dad-10733 95 24 the the DET dad-10733 95 25 conditioning conditioning NOUN dad-10733 95 26 variables variable NOUN dad-10733 95 27 ( ( PUNCT dad-10733 95 28 or or CCONJ dad-10733 95 29 inputs input NOUN dad-10733 95 30 ) ) PUNCT dad-10733 95 31 . . PUNCT dad-10733 96 1 training train VERB dad-10733 96 2 this this DET dad-10733 96 3 model model NOUN dad-10733 96 4 requires require VERB dad-10733 96 5 examples example NOUN dad-10733 96 6 of of ADP dad-10733 96 7 pairs pair NOUN dad-10733 96 8 of of ADP dad-10733 96 9 user user NOUN dad-10733 96 10 utterances utterance NOUN dad-10733 96 11 and and CCONJ dad-10733 96 12 intentions intention NOUN dad-10733 96 13 . . PUNCT dad-10733 97 1 one one NUM dad-10733 97 2 way way NOUN dad-10733 97 3 to to PART dad-10733 97 4 obtain obtain VERB dad-10733 97 5 these these DET dad-10733 97 6 example example NOUN dad-10733 97 7 pairs pair NOUN dad-10733 97 8 would would AUX dad-10733 97 9 be be AUX dad-10733 97 10 to to ADP dad-10733 97 11 first first ADJ dad-10733 97 12 record record NOUN dad-10733 97 13 written write VERB dad-10733 97 14 dialogues dialogue NOUN dad-10733 97 15 between between ADP dad-10733 97 16 humans human NOUN dad-10733 97 17 carrying carry VERB dad-10733 97 18 out out ADP dad-10733 97 19 a a DET dad-10733 97 20 task task NOUN dad-10733 97 21 , , PUNCT dad-10733 97 22 and and CCONJ dad-10733 97 23 then then ADV dad-10733 97 24 to to PART dad-10733 97 25 have have VERB dad-10733 97 26 humans human NOUN dad-10733 97 27 annotate annotate VERB dad-10733 97 28 each each DET dad-10733 97 29 utterance utterance NOUN dad-10733 97 30 with with ADP dad-10733 97 31 its its PRON dad-10733 97 32 intention intention NOUN dad-10733 97 33 label label NOUN dad-10733 97 34 . . PUNCT dad-10733 98 1 depending depend VERB dad-10733 98 2 on on ADP dad-10733 98 3 the the DET dad-10733 98 4 complexity complexity NOUN dad-10733 98 5 of of ADP dad-10733 98 6 the the DET dad-10733 98 7 domain domain NOUN dad-10733 98 8 , , PUNCT dad-10733 98 9 this this PRON dad-10733 98 10 may may AUX dad-10733 98 11 require require VERB dad-10733 98 12 training train VERB dad-10733 98 13 the the DET dad-10733 98 14 human human ADJ dad-10733 98 15 annotators annotator NOUN dad-10733 98 16 to to PART dad-10733 98 17 reach reach VERB dad-10733 98 18 a a DET dad-10733 98 19 certain certain ADJ dad-10733 98 20 level level NOUN dad-10733 98 21 of of ADP dad-10733 98 22 agreement agreement NOUN dad-10733 98 23 between between ADP dad-10733 98 24 annotators annotator NOUN dad-10733 98 25 . . PUNCT dad-10733 99 1 often often ADV dad-10733 99 2 , , PUNCT dad-10733 99 3 natural natural ADJ dad-10733 99 4 language language NOUN dad-10733 99 5 understanding understanding NOUN dad-10733 99 6 systems system NOUN dad-10733 99 7 are be AUX dad-10733 99 8 more more ADV dad-10733 99 9 expansive expansive ADJ dad-10733 99 10 than than ADP dad-10733 99 11 this this PRON dad-10733 99 12 . . PUNCT dad-10733 100 1 along along ADP dad-10733 100 2 with with ADP dad-10733 100 3 an an DET dad-10733 100 4 intent intent NOUN dad-10733 100 5 , , PUNCT dad-10733 100 6 these these DET dad-10733 100 7 systems system NOUN dad-10733 100 8 can can AUX dad-10733 100 9 also also ADV dad-10733 100 10 provide provide VERB dad-10733 100 11 so so ADV dad-10733 100 12 - - PUNCT dad-10733 100 13 called call VERB dad-10733 100 14 slot slot NOUN dad-10733 100 15 information information NOUN dad-10733 100 16 ( ( PUNCT dad-10733 100 17 mesnil mesnil NOUN dad-10733 100 18 et et PROPN dad-10733 100 19 al al PROPN dad-10733 100 20 . . PROPN dad-10733 100 21 , , PUNCT dad-10733 100 22 2013 2013 NUM dad-10733 100 23 ; ; PUNCT dad-10733 100 24 liu liu PROPN dad-10733 100 25 and and CCONJ dad-10733 100 26 lane lane NOUN dad-10733 100 27 , , PUNCT dad-10733 100 28 2017 2017 NUM dad-10733 100 29 ) ) PUNCT dad-10733 100 30 . . PUNCT dad-10733 101 1 this this PRON dad-10733 101 2 is be AUX dad-10733 101 3 added add VERB dad-10733 101 4 information information NOUN dad-10733 101 5 which which PRON dad-10733 101 6 narrows narrow VERB dad-10733 101 7 the the DET dad-10733 101 8 scope scope NOUN dad-10733 101 9 of of ADP dad-10733 101 10 the the DET dad-10733 101 11 intent intent NOUN dad-10733 101 12 . . PUNCT dad-10733 102 1 for for ADP dad-10733 102 2 example example NOUN dad-10733 102 3 , , PUNCT dad-10733 102 4 the the DET dad-10733 102 5 system system NOUN dad-10733 102 6 may may AUX dad-10733 102 7 classify classify VERB dad-10733 102 8 a a DET dad-10733 102 9 “ " PUNCT dad-10733 102 10 request request NOUN dad-10733 102 11 arrival arrival NOUN dad-10733 102 12 times time NOUN dad-10733 102 13 intent intent NOUN dad-10733 102 14 ” " PUNCT dad-10733 102 15 with with ADP dad-10733 102 16 a a DET dad-10733 102 17 slot slot NOUN dad-10733 102 18 of of ADP dad-10733 102 19 “ " PUNCT dad-10733 102 20 flight flight NOUN dad-10733 102 21 number number NOUN dad-10733 102 22 = = SYM dad-10733 102 23 az1234 az1234 ADJ dad-10733 102 24 ” " PUNCT dad-10733 102 25 . . PUNCT dad-10733 103 1 2.3.2 2.3.2 NUM dad-10733 103 2 dialogue dialogue NOUN dad-10733 103 3 management management NOUN dad-10733 103 4 as as SCONJ dad-10733 103 5 previously previously ADV dad-10733 103 6 mentioned mention VERB dad-10733 103 7 , , PUNCT dad-10733 103 8 dialogue dialogue NOUN dad-10733 103 9 management management NOUN dad-10733 103 10 encompasses encompass VERB dad-10733 103 11 both both DET dad-10733 103 12 dialogue dialogue NOUN dad-10733 103 13 state state NOUN dad-10733 103 14 tracking tracking NOUN dad-10733 103 15 and and CCONJ dad-10733 103 16 dialogue dialogue NOUN dad-10733 103 17 response response NOUN dad-10733 103 18 generation generation NOUN dad-10733 103 19 . . PUNCT dad-10733 104 1 often often ADV dad-10733 104 2 , , PUNCT dad-10733 104 3 the the DET dad-10733 104 4 role role NOUN dad-10733 104 5 of of ADP dad-10733 104 6 a a DET dad-10733 104 7 dialogue dialogue NOUN dad-10733 104 8 manager manager NOUN dad-10733 104 9 component component NOUN dad-10733 104 10 is be AUX dad-10733 104 11 to to PART dad-10733 104 12 take take VERB dad-10733 104 13 the the DET dad-10733 104 14 current current ADJ dad-10733 104 15 dialogue dialogue NOUN dad-10733 104 16 state state NOUN dad-10733 104 17 ( ( PUNCT dad-10733 104 18 e.g. e.g. ADV dad-10733 104 19 output output NOUN dad-10733 104 20 from from ADP dad-10733 104 21 natural natural ADJ dad-10733 104 22 language language NOUN dad-10733 104 23 understanding understanding NOUN dad-10733 104 24 components component NOUN dad-10733 104 25 ) ) PUNCT dad-10733 104 26 and and CCONJ dad-10733 104 27 take take VERB dad-10733 104 28 an an DET dad-10733 104 29 action action NOUN dad-10733 104 30 – – PUNCT dad-10733 104 31 typically typically ADV dad-10733 104 32 at at ADP dad-10733 104 33 the the DET dad-10733 104 34 concept concept NOUN dad-10733 104 35 level level NOUN dad-10733 104 36 – – PUNCT dad-10733 104 37 which which PRON dad-10733 104 38 can can AUX dad-10733 104 39 be be AUX dad-10733 104 40 transformed transform VERB dad-10733 104 41 into into ADP dad-10733 104 42 a a DET dad-10733 104 43 natural natural ADJ dad-10733 104 44 language language NOUN dad-10733 104 45 response response NOUN dad-10733 104 46 . . PUNCT dad-10733 105 1 see see VERB dad-10733 105 2 churcher churcher PROPN dad-10733 105 3 et et PROPN dad-10733 105 4 al al PROPN dad-10733 105 5 . . PROPN dad-10733 106 1 ( ( PUNCT dad-10733 106 2 1997 1997 NUM dad-10733 106 3 ) ) PUNCT dad-10733 107 1 ; ; PUNCT dad-10733 107 2 young young ADJ dad-10733 107 3 ( ( PUNCT dad-10733 107 4 2000 2000 NUM dad-10733 107 5 ) ) PUNCT dad-10733 107 6 ; ; PUNCT dad-10733 107 7 lee lee PROPN dad-10733 107 8 et et PROPN dad-10733 107 9 al al PROPN dad-10733 107 10 . . PROPN dad-10733 107 11 ( ( PUNCT dad-10733 107 12 2010 2010 NUM dad-10733 107 13 ) ) PUNCT dad-10733 107 14 for for ADP dad-10733 107 15 overviews overview NOUN dad-10733 107 16 of of ADP dad-10733 107 17 data data NOUN dad-10733 107 18 - - PUNCT dad-10733 107 19 driven drive VERB dad-10733 107 20 dialogue dialogue NOUN dad-10733 107 21 management management NOUN dad-10733 107 22 components component NOUN dad-10733 107 23 using use VERB dad-10733 107 24 various various ADJ dad-10733 107 25 methods method NOUN dad-10733 107 26 . . PUNCT dad-10733 108 1 recent recent ADJ dad-10733 108 2 advances advance NOUN dad-10733 108 3 in in ADP dad-10733 108 4 dialogue dialogue NOUN dad-10733 108 5 management management NOUN dad-10733 108 6 have have AUX dad-10733 108 7 involved involve VERB dad-10733 108 8 using use VERB dad-10733 108 9 reinforcement reinforcement NOUN dad-10733 108 10 learning learning NOUN dad-10733 108 11 methods method NOUN dad-10733 108 12 to to PART dad-10733 108 13 learn learn VERB dad-10733 108 14 a a DET dad-10733 108 15 dialogue dialogue NOUN dad-10733 108 16 management management NOUN dad-10733 108 17 policy policy NOUN dad-10733 108 18 ( ( PUNCT dad-10733 108 19 singh singh PROPN dad-10733 108 20 et et PROPN dad-10733 108 21 al al PROPN dad-10733 108 22 . . PROPN dad-10733 108 23 , , PUNCT dad-10733 108 24 2002 2002 NUM dad-10733 108 25 ; ; PUNCT dad-10733 108 26 scheffler scheffler NOUN dad-10733 108 27 and and CCONJ dad-10733 108 28 young young ADJ dad-10733 108 29 , , PUNCT dad-10733 108 30 2002 2002 NUM dad-10733 108 31 ; ; PUNCT dad-10733 108 32 pietquin pietquin PROPN dad-10733 108 33 et et PROPN dad-10733 108 34 al al PROPN dad-10733 108 35 . . PROPN dad-10733 108 36 , , PUNCT dad-10733 108 37 2011 2011 NUM dad-10733 108 38 ; ; PUNCT dad-10733 108 39 rieser rieser NOUN dad-10733 108 40 and and CCONJ dad-10733 108 41 lemon lemon NOUN dad-10733 108 42 , , PUNCT dad-10733 108 43 2011 2011 NUM dad-10733 108 44 ; ; PUNCT dad-10733 108 45 peng peng PROPN dad-10733 108 46 et et PROPN dad-10733 108 47 al al PROPN dad-10733 108 48 . . PROPN dad-10733 108 49 , , PUNCT dad-10733 108 50 2017 2017 NUM dad-10733 108 51 ; ; PUNCT dad-10733 108 52 fazel fazel NOUN dad-10733 108 53 - - PUNCT dad-10733 108 54 zarandi zarandi PROPN dad-10733 108 55 et et PROPN dad-10733 108 56 al al PROPN dad-10733 108 57 . . PROPN dad-10733 108 58 , , PUNCT dad-10733 108 59 2017 2017 NUM dad-10733 108 60 ) ) PUNCT dad-10733 108 61 . . PUNCT dad-10733 109 1 an an DET dad-10733 109 2 example example NOUN dad-10733 109 3 of of ADP dad-10733 109 4 such such DET dad-10733 109 5 a a DET dad-10733 109 6 learned learn VERB dad-10733 109 7 dialogue dialogue NOUN dad-10733 109 8 management management NOUN dad-10733 109 9 policy policy NOUN dad-10733 109 10 , , PUNCT dad-10733 109 11 as as SCONJ dad-10733 109 12 seen see VERB dad-10733 109 13 in in ADP dad-10733 109 14 fazel fazel NOUN dad-10733 109 15 - - PUNCT dad-10733 109 16 zarandi zarandi NOUN dad-10733 109 17 et et PROPN dad-10733 109 18 al al PROPN dad-10733 109 19 . . PROPN dad-10733 110 1 ( ( PUNCT dad-10733 110 2 2017 2017 NUM dad-10733 110 3 ) ) PUNCT dad-10733 110 4 , , PUNCT dad-10733 110 5 takes take VERB dad-10733 110 6 the the DET dad-10733 110 7 intent intent NOUN dad-10733 110 8 and and CCONJ dad-10733 110 9 slot slot NOUN dad-10733 110 10 information information NOUN dad-10733 110 11 outputted output VERB dad-10733 110 12 by by ADP dad-10733 110 13 a a DET dad-10733 110 14 natural natural ADJ dad-10733 110 15 language language NOUN dad-10733 110 16 understanding understanding NOUN dad-10733 110 17 system system NOUN dad-10733 110 18 , , PUNCT dad-10733 110 19 along along ADP dad-10733 110 20 with with ADP dad-10733 110 21 the the DET dad-10733 110 22 history history NOUN dad-10733 110 23 of of ADP dad-10733 110 24 this this DET dad-10733 110 25 information information NOUN dad-10733 110 26 and and CCONJ dad-10733 110 27 confidence confidence NOUN dad-10733 110 28 score score NOUN dad-10733 110 29 , , PUNCT dad-10733 110 30 and and CCONJ dad-10733 110 31 outputs output VERB dad-10733 110 32 one one NUM dad-10733 110 33 of of ADP dad-10733 110 34 several several ADJ dad-10733 110 35 actions action NOUN dad-10733 110 36 : : PUNCT dad-10733 110 37 confirming confirm VERB dad-10733 110 38 what what PRON dad-10733 110 39 the the DET dad-10733 110 40 interlocutor interlocutor NOUN dad-10733 110 41 said say VERB dad-10733 110 42 , , PUNCT dad-10733 110 43 eliciting elicit VERB dad-10733 110 44 more more ADJ dad-10733 110 45 information information NOUN dad-10733 110 46 from from ADP dad-10733 110 47 the the DET dad-10733 110 48 interlocutor interlocutor NOUN dad-10733 110 49 , , PUNCT dad-10733 110 50 or or CCONJ dad-10733 110 51 selecting select VERB dad-10733 110 52 a a DET dad-10733 110 53 response response NOUN dad-10733 110 54 according accord VERB dad-10733 110 55 to to ADP dad-10733 110 56 a a DET dad-10733 110 57 pre pre ADJ dad-10733 110 58 - - ADJ dad-10733 110 59 defined define VERB dad-10733 110 60 response response NOUN dad-10733 110 61 generation generation NOUN dad-10733 110 62 policy policy NOUN dad-10733 110 63 . . PUNCT dad-10733 111 1 this this DET dad-10733 111 2 concept concept NOUN dad-10733 111 3 - - PUNCT dad-10733 111 4 level level NOUN dad-10733 111 5 action action NOUN dad-10733 111 6 is be AUX dad-10733 111 7 then then ADV dad-10733 111 8 converted convert VERB dad-10733 111 9 to to ADP dad-10733 111 10 an an DET dad-10733 111 11 utterance utterance NOUN dad-10733 111 12 by by ADP dad-10733 111 13 the the DET dad-10733 111 14 natural natural ADJ dad-10733 111 15 language language NOUN dad-10733 111 16 generation generation NOUN dad-10733 111 17 component component NOUN dad-10733 111 18 . . PUNCT dad-10733 112 1 dialogue dialogue NOUN dad-10733 112 2 state state NOUN dad-10733 112 3 tracking tracking NOUN dad-10733 112 4 . . PUNCT dad-10733 113 1 the the DET dad-10733 113 2 dialogue dialogue PROPN dad-10733 113 3 state state NOUN dad-10733 113 4 tracking tracking NOUN dad-10733 113 5 component component NOUN dad-10733 113 6 of of ADP dad-10733 113 7 a a DET dad-10733 113 8 dialogue dialogue NOUN dad-10733 113 9 system system NOUN dad-10733 113 10 might might AUX dad-10733 113 11 similarly similarly ADV dad-10733 113 12 be be AUX dad-10733 113 13 implemented implement VERB dad-10733 113 14 as as ADP dad-10733 113 15 a a DET dad-10733 113 16 classification classification NOUN dad-10733 113 17 model model NOUN dad-10733 113 18 ( ( PUNCT dad-10733 113 19 williams williams PROPN dad-10733 113 20 et et PROPN dad-10733 113 21 al al PROPN dad-10733 113 22 . . PROPN dad-10733 113 23 , , PUNCT dad-10733 113 24 2013 2013 NUM dad-10733 113 25 ) ) PUNCT dad-10733 113 26 . . PUNCT dad-10733 114 1 at at ADP dad-10733 114 2 any any DET dad-10733 114 3 given give VERB dad-10733 114 4 point point NOUN dad-10733 114 5 in in ADP dad-10733 114 6 the the DET dad-10733 114 7 dialogue dialogue NOUN dad-10733 114 8 , , PUNCT dad-10733 114 9 such such DET dad-10733 114 10 a a DET dad-10733 114 11 model model NOUN dad-10733 114 12 will will AUX dad-10733 114 13 take take VERB dad-10733 114 14 as as ADP dad-10733 114 15 input input NOUN dad-10733 114 16 all all DET dad-10733 114 17 the the DET dad-10733 114 18 user user NOUN dad-10733 114 19 utterances utterance NOUN dad-10733 114 20 and and CCONJ dad-10733 114 21 user user NOUN dad-10733 114 22 intention intention NOUN dad-10733 114 23 labels label NOUN dad-10733 114 24 estimated estimate VERB dad-10733 114 25 by by ADP dad-10733 114 26 a a DET dad-10733 114 27 natural natural ADJ dad-10733 114 28 language language NOUN dad-10733 114 29 understanding understanding NOUN dad-10733 114 30 model model NOUN dad-10733 114 31 so so ADV dad-10733 114 32 far far ADV dad-10733 114 33 , , PUNCT dad-10733 114 34 and and CCONJ dad-10733 114 35 outputs output VERB dad-10733 114 36 a a DET dad-10733 114 37 distribution distribution NOUN dad-10733 114 38 over over ADP dad-10733 114 39 possible possible ADJ dad-10733 114 40 dialogue dialogue NOUN dad-10733 114 41 states state NOUN dad-10733 114 42 . . PUNCT dad-10733 115 1 one one NUM dad-10733 115 2 common common ADJ dad-10733 115 3 way way NOUN dad-10733 115 4 to to PART dad-10733 115 5 represent represent VERB dad-10733 115 6 dialogue dialogue NOUN dad-10733 115 7 states state NOUN dad-10733 115 8 are be AUX dad-10733 115 9 through through ADP dad-10733 115 10 slot slot NOUN dad-10733 115 11 - - PUNCT dad-10733 115 12 value value NOUN dad-10733 115 13 pairs pair NOUN dad-10733 115 14 . . PUNCT dad-10733 116 1 for for ADP dad-10733 116 2 6 6 NUM dad-10733 116 3 a a DET dad-10733 116 4 survey survey NOUN dad-10733 116 5 of of ADP dad-10733 116 6 available available ADJ dad-10733 116 7 corpora corpora PROPN dad-10733 116 8 for for ADP dad-10733 116 9 building build VERB dad-10733 116 10 data data NOUN dad-10733 116 11 - - PUNCT dad-10733 116 12 driven drive VERB dad-10733 116 13 dialogue dialogue NOUN dad-10733 116 14 systems system NOUN dad-10733 116 15 example example NOUN dad-10733 116 16 , , PUNCT dad-10733 116 17 a a DET dad-10733 116 18 dialogue dialogue NOUN dad-10733 116 19 system system NOUN dad-10733 116 20 providing provide VERB dad-10733 116 21 timetable timetable NOUN dad-10733 116 22 information information NOUN dad-10733 116 23 for for ADP dad-10733 116 24 trains train NOUN dad-10733 116 25 might might AUX dad-10733 116 26 have have VERB dad-10733 116 27 three three NUM dad-10733 116 28 different different ADJ dad-10733 116 29 slots slot NOUN dad-10733 116 30 : : PUNCT dad-10733 116 31 departure departure NOUN dad-10733 116 32 city city NOUN dad-10733 116 33 , , PUNCT dad-10733 116 34 arrival arrival NOUN dad-10733 116 35 city city NOUN dad-10733 116 36 , , PUNCT dad-10733 116 37 and and CCONJ dad-10733 116 38 departure departure NOUN dad-10733 116 39 time time NOUN dad-10733 116 40 . . PUNCT dad-10733 117 1 each each DET dad-10733 117 2 slot slot NOUN dad-10733 117 3 may may AUX dad-10733 117 4 take take VERB dad-10733 117 5 one one NUM dad-10733 117 6 of of ADP dad-10733 117 7 several several ADJ dad-10733 117 8 discrete discrete ADJ dad-10733 117 9 values value NOUN dad-10733 117 10 ( ( PUNCT dad-10733 117 11 e.g. e.g. ADV dad-10733 117 12 departure departure NOUN dad-10733 117 13 city city NOUN dad-10733 117 14 could could AUX dad-10733 117 15 take take VERB dad-10733 117 16 values value NOUN dad-10733 117 17 from from ADP dad-10733 117 18 a a DET dad-10733 117 19 list list NOUN dad-10733 117 20 of of ADP dad-10733 117 21 city city NOUN dad-10733 117 22 names name NOUN dad-10733 117 23 ) ) PUNCT dad-10733 117 24 . . PUNCT dad-10733 118 1 the the DET dad-10733 118 2 task task NOUN dad-10733 118 3 of of ADP dad-10733 118 4 dialogue dialogue NOUN dad-10733 118 5 state state NOUN dad-10733 118 6 tracking tracking NOUN dad-10733 118 7 is be AUX dad-10733 118 8 then then ADV dad-10733 118 9 to to PART dad-10733 118 10 output output VERB dad-10733 118 11 a a DET dad-10733 118 12 distribution distribution NOUN dad-10733 118 13 over over ADP dad-10733 118 14 every every DET dad-10733 118 15 possible possible ADJ dad-10733 118 16 combination combination NOUN dad-10733 118 17 of of ADP dad-10733 118 18 slot slot NOUN dad-10733 118 19 - - PUNCT dad-10733 118 20 value value NOUN dad-10733 118 21 pairs pair NOUN dad-10733 118 22 . . PUNCT dad-10733 119 1 this this DET dad-10733 119 2 distribution distribution NOUN dad-10733 119 3 — — PUNCT dad-10733 119 4 or or CCONJ dad-10733 119 5 alternatively alternatively ADV dad-10733 119 6 , , PUNCT dad-10733 119 7 the the DET dad-10733 119 8 k k PROPN dad-10733 119 9 dialogue dialogue PROPN dad-10733 119 10 states state NOUN dad-10733 119 11 with with ADP dad-10733 119 12 the the DET dad-10733 119 13 highest high ADJ dad-10733 119 14 probability probability NOUN dad-10733 119 15 — — PUNCT dad-10733 119 16 may may AUX dad-10733 119 17 then then ADV dad-10733 119 18 be be AUX dad-10733 119 19 used use VERB dad-10733 119 20 by by ADP dad-10733 119 21 other other ADJ dad-10733 119 22 parts part NOUN dad-10733 119 23 of of ADP dad-10733 119 24 the the DET dad-10733 119 25 dialogue dialogue NOUN dad-10733 119 26 system system NOUN dad-10733 119 27 . . PUNCT dad-10733 120 1 the the DET dad-10733 120 2 dialogue dialogue NOUN dad-10733 120 3 state state NOUN dad-10733 120 4 tracking tracking NOUN dad-10733 120 5 model model NOUN dad-10733 120 6 can can AUX dad-10733 120 7 be be AUX dad-10733 120 8 trained train VERB dad-10733 120 9 on on ADP dad-10733 120 10 examples example NOUN dad-10733 120 11 of of ADP dad-10733 120 12 dialogue dialogue NOUN dad-10733 120 13 utterances utterance NOUN dad-10733 120 14 and and CCONJ dad-10733 120 15 dialogue dialogue NOUN dad-10733 120 16 states state NOUN dad-10733 120 17 labeled label VERB dad-10733 120 18 by by ADP dad-10733 120 19 humans human NOUN dad-10733 120 20 . . PUNCT dad-10733 121 1 dialogue dialogue NOUN dad-10733 121 2 response response NOUN dad-10733 121 3 action action NOUN dad-10733 121 4 selection selection NOUN dad-10733 121 5 . . PUNCT dad-10733 122 1 given give VERB dad-10733 122 2 the the DET dad-10733 122 3 dialogue dialogue NOUN dad-10733 122 4 state state NOUN dad-10733 122 5 distribution distribution NOUN dad-10733 122 6 provided provide VERB dad-10733 122 7 by by ADP dad-10733 122 8 the the DET dad-10733 122 9 dialogue dialogue NOUN dad-10733 122 10 state state NOUN dad-10733 122 11 tracking tracking NOUN dad-10733 122 12 system system NOUN dad-10733 122 13 , , PUNCT dad-10733 122 14 the the DET dad-10733 122 15 dialogue dialogue NOUN dad-10733 122 16 response response NOUN dad-10733 122 17 action action NOUN dad-10733 122 18 selection selection NOUN dad-10733 122 19 component component NOUN dad-10733 122 20 must must AUX dad-10733 122 21 select select VERB dad-10733 122 22 an an DET dad-10733 122 23 appropriate appropriate ADJ dad-10733 122 24 system system NOUN dad-10733 122 25 response response NOUN dad-10733 122 26 action action NOUN dad-10733 122 27 ( ( PUNCT dad-10733 122 28 sometimes sometimes ADV dad-10733 122 29 referred refer VERB dad-10733 122 30 to to ADP dad-10733 122 31 as as ADP dad-10733 122 32 a a DET dad-10733 122 33 dialogue dialogue NOUN dad-10733 122 34 act act PROPN dad-10733 122 35 ) ) PUNCT dad-10733 122 36 . . PUNCT dad-10733 123 1 this this DET dad-10733 123 2 component component NOUN dad-10733 123 3 may may AUX dad-10733 123 4 also also ADV dad-10733 123 5 be be AUX dad-10733 123 6 implemented implement VERB dad-10733 123 7 as as ADP dad-10733 123 8 a a DET dad-10733 123 9 classification classification NOUN dad-10733 123 10 model model NOUN dad-10733 123 11 that that PRON dad-10733 123 12 maps map VERB dad-10733 123 13 dialogue dialogue NOUN dad-10733 123 14 states state NOUN dad-10733 123 15 to to ADP dad-10733 123 16 a a DET dad-10733 123 17 probability probability NOUN dad-10733 123 18 over over ADP dad-10733 123 19 a a DET dad-10733 123 20 discrete discrete ADJ dad-10733 123 21 set set NOUN dad-10733 123 22 of of ADP dad-10733 123 23 response response NOUN dad-10733 123 24 actions action NOUN dad-10733 123 25 . . PUNCT dad-10733 124 1 for for ADP dad-10733 124 2 example example NOUN dad-10733 124 3 , , PUNCT dad-10733 124 4 in in ADP dad-10733 124 5 a a DET dad-10733 124 6 dialogue dialogue NOUN dad-10733 124 7 system system NOUN dad-10733 124 8 providing provide VERB dad-10733 124 9 timetable timetable NOUN dad-10733 124 10 information information NOUN dad-10733 124 11 for for ADP dad-10733 124 12 trains train NOUN dad-10733 124 13 , , PUNCT dad-10733 124 14 the the DET dad-10733 124 15 set set NOUN dad-10733 124 16 of of ADP dad-10733 124 17 response response NOUN dad-10733 124 18 actions action NOUN dad-10733 124 19 might might AUX dad-10733 124 20 include include VERB dad-10733 124 21 providing provide VERB dad-10733 124 22 information information NOUN dad-10733 124 23 ( ( PUNCT dad-10733 124 24 e.g. e.g. ADV dad-10733 124 25 providing provide VERB dad-10733 124 26 the the DET dad-10733 124 27 departure departure NOUN dad-10733 124 28 time time NOUN dad-10733 124 29 of of ADP dad-10733 124 30 the the DET dad-10733 124 31 next next ADJ dad-10733 124 32 train train NOUN dad-10733 124 33 with with ADP dad-10733 124 34 a a DET dad-10733 124 35 specific specific ADJ dad-10733 124 36 departure departure NOUN dad-10733 124 37 and and CCONJ dad-10733 124 38 arrival arrival NOUN dad-10733 124 39 city city NOUN dad-10733 124 40 ) ) PUNCT dad-10733 124 41 and and CCONJ dad-10733 124 42 clarification clarification NOUN dad-10733 124 43 questions question NOUN dad-10733 124 44 ( ( PUNCT dad-10733 124 45 e.g. e.g. ADV dad-10733 124 46 asking ask VERB dad-10733 124 47 the the DET dad-10733 124 48 user user NOUN dad-10733 124 49 to to PART dad-10733 124 50 re re VERB dad-10733 124 51 - - VERB dad-10733 124 52 state state VERB dad-10733 124 53 their their PRON dad-10733 124 54 departure departure NOUN dad-10733 124 55 city city NOUN dad-10733 124 56 ) ) PUNCT dad-10733 124 57 . . PUNCT dad-10733 125 1 the the DET dad-10733 125 2 model model NOUN dad-10733 125 3 may may AUX dad-10733 125 4 be be AUX dad-10733 125 5 trained train VERB dad-10733 125 6 on on ADP dad-10733 125 7 example example NOUN dad-10733 125 8 pairs pair NOUN dad-10733 125 9 of of ADP dad-10733 125 10 dialogue dialogue NOUN dad-10733 125 11 states state NOUN dad-10733 125 12 and and CCONJ dad-10733 125 13 response response NOUN dad-10733 125 14 actions action NOUN dad-10733 125 15 . . PUNCT dad-10733 126 1 2.3.3 2.3.3 NUM dad-10733 126 2 natural natural ADJ dad-10733 126 3 language language NOUN dad-10733 126 4 generator generator NOUN dad-10733 126 5 given give VERB dad-10733 126 6 a a DET dad-10733 126 7 dialogue dialogue NOUN dad-10733 126 8 system system NOUN dad-10733 126 9 selected select VERB dad-10733 126 10 response response NOUN dad-10733 126 11 action action NOUN dad-10733 126 12 ( ( PUNCT dad-10733 126 13 e.g. e.g. ADV dad-10733 126 14 a a DET dad-10733 126 15 response response NOUN dad-10733 126 16 action action NOUN dad-10733 126 17 providing provide VERB dad-10733 126 18 the the DET dad-10733 126 19 departure departure NOUN dad-10733 126 20 time time NOUN dad-10733 126 21 of of ADP dad-10733 126 22 a a DET dad-10733 126 23 train train NOUN dad-10733 126 24 ) ) PUNCT dad-10733 126 25 , , PUNCT dad-10733 126 26 the the DET dad-10733 126 27 natural natural ADJ dad-10733 126 28 language language NOUN dad-10733 126 29 generator generator NOUN dad-10733 126 30 must must AUX dad-10733 126 31 output output VERB dad-10733 126 32 the the DET dad-10733 126 33 natural natural ADJ dad-10733 126 34 language language NOUN dad-10733 126 35 utterance utterance NOUN dad-10733 126 36 of of ADP dad-10733 126 37 the the DET dad-10733 126 38 system system NOUN dad-10733 126 39 . . PUNCT dad-10733 127 1 in in ADP dad-10733 127 2 the the DET dad-10733 127 3 case case NOUN dad-10733 127 4 of of ADP dad-10733 127 5 commercial commercial ADJ dad-10733 127 6 goal goal NOUN dad-10733 127 7 - - PUNCT dad-10733 127 8 driven drive VERB dad-10733 127 9 dialogue dialogue NOUN dad-10733 127 10 systems system NOUN dad-10733 127 11 , , PUNCT dad-10733 127 12 this this PRON dad-10733 127 13 is be AUX dad-10733 127 14 often often ADV dad-10733 127 15 implemented implement VERB dad-10733 127 16 using use VERB dad-10733 127 17 hand hand NOUN dad-10733 127 18 - - PUNCT dad-10733 127 19 crafted craft VERB dad-10733 127 20 rules rule NOUN dad-10733 127 21 . . PUNCT dad-10733 128 1 another another DET dad-10733 128 2 option option NOUN dad-10733 128 3 is be AUX dad-10733 128 4 to to PART dad-10733 128 5 learn learn VERB dad-10733 128 6 a a DET dad-10733 128 7 discriminative discriminative NOUN dad-10733 128 8 model model NOUN dad-10733 128 9 to to PART dad-10733 128 10 select select VERB dad-10733 128 11 a a DET dad-10733 128 12 natural natural ADJ dad-10733 128 13 language language NOUN dad-10733 128 14 response response NOUN dad-10733 128 15 . . PUNCT dad-10733 129 1 in in ADP dad-10733 129 2 this this DET dad-10733 129 3 case case NOUN dad-10733 129 4 , , PUNCT dad-10733 129 5 the the DET dad-10733 129 6 output output NOUN dad-10733 129 7 space space NOUN dad-10733 129 8 may may AUX dad-10733 129 9 be be AUX dad-10733 129 10 defined define VERB dad-10733 129 11 as as ADP dad-10733 129 12 a a DET dad-10733 129 13 set set NOUN dad-10733 129 14 of of ADP dad-10733 129 15 so so ADV dad-10733 129 16 - - PUNCT dad-10733 129 17 called call VERB dad-10733 129 18 surface surface NOUN dad-10733 129 19 form form NOUN dad-10733 129 20 sentences sentence NOUN dad-10733 129 21 ( ( PUNCT dad-10733 129 22 e.g. e.g. ADV dad-10733 129 23 “ " PUNCT dad-10733 129 24 the the DET dad-10733 129 25 requested request VERB dad-10733 129 26 train train NOUN dad-10733 129 27 leaves leave VERB dad-10733 129 28 city city NOUN dad-10733 129 29 x x NOUN dad-10733 129 30 at at ADP dad-10733 129 31 time time NOUN dad-10733 129 32 y y PROPN dad-10733 129 33 ” " PUNCT dad-10733 129 34 , , PUNCT dad-10733 129 35 where where SCONJ dad-10733 129 36 x x PUNCT dad-10733 129 37 and and CCONJ dad-10733 129 38 y y PROPN dad-10733 129 39 are be AUX dad-10733 129 40 placeholder placeholder NOUN dad-10733 129 41 values value NOUN dad-10733 129 42 ) ) PUNCT dad-10733 129 43 . . PUNCT dad-10733 130 1 given give VERB dad-10733 130 2 the the DET dad-10733 130 3 system system NOUN dad-10733 130 4 response response NOUN dad-10733 130 5 action action NOUN dad-10733 130 6 , , PUNCT dad-10733 130 7 the the DET dad-10733 130 8 classification classification NOUN dad-10733 130 9 model model NOUN dad-10733 130 10 must must AUX dad-10733 130 11 choose choose VERB dad-10733 130 12 an an DET dad-10733 130 13 appropriate appropriate ADJ dad-10733 130 14 surface surface NOUN dad-10733 130 15 form form NOUN dad-10733 130 16 . . PUNCT dad-10733 131 1 afterwards afterwards ADV dad-10733 131 2 , , PUNCT dad-10733 131 3 the the DET dad-10733 131 4 chosen choose VERB dad-10733 131 5 surface surface NOUN dad-10733 131 6 form form NOUN dad-10733 131 7 will will AUX dad-10733 131 8 have have VERB dad-10733 131 9 the the DET dad-10733 131 10 placeholder placeholder NOUN dad-10733 131 11 values value NOUN dad-10733 131 12 substituted substitute VERB dad-10733 131 13 with with ADP dad-10733 131 14 appropriate appropriate ADJ dad-10733 131 15 items item NOUN dad-10733 131 16 ( ( PUNCT dad-10733 131 17 e.g. e.g. ADV dad-10733 131 18 x x PRON dad-10733 131 19 will will AUX dad-10733 131 20 be be AUX dad-10733 131 21 replaced replace VERB dad-10733 131 22 by by ADP dad-10733 131 23 the the DET dad-10733 131 24 appropriate appropriate ADJ dad-10733 131 25 city city NOUN dad-10733 131 26 name name NOUN dad-10733 131 27 through through ADP dad-10733 131 28 a a DET dad-10733 131 29 database database NOUN dad-10733 131 30 look look VERB dad-10733 131 31 up up ADP dad-10733 131 32 ) ) PUNCT dad-10733 131 33 . . PUNCT dad-10733 132 1 several several ADJ dad-10733 132 2 works work NOUN dad-10733 132 3 examine examine VERB dad-10733 132 4 such such ADJ dad-10733 132 5 data data NOUN dad-10733 132 6 - - PUNCT dad-10733 132 7 driven drive VERB dad-10733 132 8 approaches approach NOUN dad-10733 132 9 . . PUNCT dad-10733 133 1 the the DET dad-10733 133 2 authors author NOUN dad-10733 133 3 of of ADP dad-10733 133 4 ( ( PUNCT dad-10733 133 5 oh oh INTJ dad-10733 133 6 and and CCONJ dad-10733 133 7 rudnicky rudnicky NOUN dad-10733 133 8 , , PUNCT dad-10733 133 9 2000 2000 NUM dad-10733 133 10 ) ) PUNCT dad-10733 133 11 use use VERB dad-10733 133 12 statistical statistical ADJ dad-10733 133 13 probabilities probability NOUN dad-10733 133 14 gathered gather VERB dad-10733 133 15 from from ADP dad-10733 133 16 corpora corpora PROPN dad-10733 133 17 to to PART dad-10733 133 18 generate generate VERB dad-10733 133 19 a a DET dad-10733 133 20 conditional conditional ADJ dad-10733 133 21 language language NOUN dad-10733 133 22 generation generation NOUN dad-10733 133 23 process process NOUN dad-10733 133 24 . . PUNCT dad-10733 134 1 similarly similarly ADV dad-10733 134 2 lemon lemon NOUN dad-10733 134 3 ( ( PUNCT dad-10733 134 4 2008 2008 NUM dad-10733 134 5 ) ) PUNCT dad-10733 134 6 , , PUNCT dad-10733 134 7 reformulates reformulate VERB dad-10733 134 8 this this DET dad-10733 134 9 mapping mapping NOUN dad-10733 134 10 as as ADP dad-10733 134 11 a a DET dad-10733 134 12 reinforcement reinforcement NOUN dad-10733 134 13 learning learning NOUN dad-10733 134 14 problem problem NOUN dad-10733 134 15 and and CCONJ dad-10733 134 16 trains train VERB dad-10733 134 17 linear linear VERB dad-10733 134 18 policies policy NOUN dad-10733 134 19 to to PART dad-10733 134 20 generate generate VERB dad-10733 134 21 natural natural ADJ dad-10733 134 22 language language NOUN dad-10733 134 23 based base VERB dad-10733 134 24 on on ADP dad-10733 134 25 semantic semantic ADJ dad-10733 134 26 frames frame NOUN dad-10733 134 27 . . PUNCT dad-10733 135 1 wen wen PROPN dad-10733 135 2 et et PROPN dad-10733 135 3 al al PROPN dad-10733 135 4 . . PROPN dad-10733 135 5 ( ( PUNCT dad-10733 135 6 2015b 2015b NUM dad-10733 135 7 ) ) PUNCT dad-10733 135 8 use use VERB dad-10733 135 9 recurrent recurrent ADJ dad-10733 135 10 neural neural ADJ dad-10733 135 11 networks network NOUN dad-10733 135 12 to to PART dad-10733 135 13 learn learn VERB dad-10733 135 14 a a DET dad-10733 135 15 mapping mapping NOUN dad-10733 135 16 from from ADP dad-10733 135 17 a a DET dad-10733 135 18 dialogue dialogue NOUN dad-10733 135 19 act act NOUN dad-10733 135 20 and and CCONJ dad-10733 135 21 semantic semantic ADJ dad-10733 135 22 frame frame NOUN dad-10733 135 23 to to ADP dad-10733 135 24 a a DET dad-10733 135 25 natural natural ADJ dad-10733 135 26 language language NOUN dad-10733 135 27 response response NOUN dad-10733 135 28 . . PUNCT dad-10733 136 1 many many ADJ dad-10733 136 2 other other ADJ dad-10733 136 3 works work NOUN dad-10733 136 4 , , PUNCT dad-10733 136 5 similarly similarly ADV dad-10733 136 6 propose propose VERB dad-10733 136 7 various various ADJ dad-10733 136 8 methods method NOUN dad-10733 136 9 for for ADP dad-10733 136 10 conditional conditional ADJ dad-10733 136 11 natural natural ADJ dad-10733 136 12 language language NOUN dad-10733 136 13 generation generation NOUN dad-10733 136 14 based base VERB dad-10733 136 15 on on ADP dad-10733 136 16 response response NOUN dad-10733 136 17 actions action NOUN dad-10733 136 18 , , PUNCT dad-10733 136 19 dialogue dialogue NOUN dad-10733 136 20 acts act VERB dad-10733 136 21 , , PUNCT dad-10733 136 22 and and CCONJ dad-10733 136 23 semantic semantic ADJ dad-10733 136 24 frames frame NOUN dad-10733 136 25 . . PUNCT dad-10733 137 1 as as ADP dad-10733 137 2 with with ADP dad-10733 137 3 other other ADJ dad-10733 137 4 classification classification NOUN dad-10733 137 5 models model NOUN dad-10733 137 6 , , PUNCT dad-10733 137 7 such such ADJ dad-10733 137 8 models model NOUN dad-10733 137 9 may may AUX dad-10733 137 10 be be AUX dad-10733 137 11 trained train VERB dad-10733 137 12 on on ADP dad-10733 137 13 example example NOUN dad-10733 137 14 pairs pair NOUN dad-10733 137 15 of of ADP dad-10733 137 16 system system NOUN dad-10733 137 17 response response NOUN dad-10733 137 18 actions action NOUN dad-10733 137 19 and and CCONJ dad-10733 137 20 surface surface NOUN dad-10733 137 21 forms form NOUN dad-10733 137 22 . . PUNCT dad-10733 138 1 2.3.4 2.3.4 NUM dad-10733 138 2 end end NOUN dad-10733 138 3 - - PUNCT dad-10733 138 4 to to ADP dad-10733 138 5 - - PUNCT dad-10733 138 6 end end NOUN dad-10733 138 7 dialogue dialogue NOUN dad-10733 138 8 systems system NOUN dad-10733 138 9 not not PART dad-10733 138 10 all all DET dad-10733 138 11 dialogue dialogue NOUN dad-10733 138 12 systems system NOUN dad-10733 138 13 conform conform VERB dad-10733 138 14 to to ADP dad-10733 138 15 the the DET dad-10733 138 16 architecture architecture NOUN dad-10733 138 17 shown show VERB dad-10733 138 18 in in ADP dad-10733 138 19 figure figure NOUN dad-10733 138 20 1 1 NUM dad-10733 138 21 . . PUNCT dad-10733 139 1 various various ADJ dad-10733 139 2 works work NOUN dad-10733 139 3 have have AUX dad-10733 139 4 examined examine VERB dad-10733 139 5 learning learn VERB dad-10733 139 6 “ " PUNCT dad-10733 139 7 end end VERB dad-10733 139 8 - - PUNCT dad-10733 139 9 to to ADP dad-10733 139 10 - - PUNCT dad-10733 139 11 end end VERB dad-10733 139 12 ” " PUNCT dad-10733 139 13 systems system NOUN dad-10733 139 14 which which PRON dad-10733 139 15 combine combine VERB dad-10733 139 16 various various ADJ dad-10733 139 17 sub sub NOUN dad-10733 139 18 - - NOUN dad-10733 139 19 components component NOUN dad-10733 139 20 together together ADV dad-10733 139 21 . . PUNCT dad-10733 140 1 while while SCONJ dad-10733 140 2 some some DET dad-10733 140 3 works work NOUN dad-10733 140 4 investigate investigate VERB dad-10733 140 5 combining combine VERB dad-10733 140 6 various various ADJ dad-10733 140 7 combinations combination NOUN dad-10733 140 8 of of ADP dad-10733 140 9 sub sub NOUN dad-10733 140 10 - - NOUN dad-10733 140 11 components component NOUN dad-10733 140 12 together together ADV dad-10733 140 13 — — PUNCT dad-10733 140 14 such such ADJ dad-10733 140 15 as as ADP dad-10733 140 16 natural natural ADJ dad-10733 140 17 language language NOUN dad-10733 140 18 understanding understanding NOUN dad-10733 140 19 and and CCONJ dad-10733 140 20 dialogue dialogue NOUN dad-10733 140 21 management management NOUN dad-10733 140 22 ( ( PUNCT dad-10733 140 23 yang yang PROPN dad-10733 140 24 et et PROPN dad-10733 140 25 al al PROPN dad-10733 140 26 . . PROPN dad-10733 140 27 , , PUNCT dad-10733 140 28 2017 2017 NUM dad-10733 140 29 ) ) PUNCT dad-10733 140 30 — — PUNCT dad-10733 140 31 we we PRON dad-10733 140 32 take take VERB dad-10733 140 33 a a DET dad-10733 140 34 broader broad ADJ dad-10733 140 35 view view NOUN dad-10733 140 36 where where SCONJ dad-10733 140 37 we we PRON dad-10733 140 38 define define VERB dad-10733 140 39 end end NOUN dad-10733 140 40 - - PUNCT dad-10733 140 41 to to ADP dad-10733 140 42 - - PUNCT dad-10733 140 43 end end NOUN dad-10733 140 44 systems system NOUN dad-10733 140 45 as as ADP dad-10733 140 46 encompassing encompass VERB dad-10733 140 47 all all PRON dad-10733 140 48 of of ADP dad-10733 140 49 the the DET dad-10733 140 50 non non ADJ dad-10733 140 51 - - ADJ dad-10733 140 52 spoken spoken ADJ dad-10733 140 53 dialogue dialogue NOUN dad-10733 141 1 compo7 compo7 PROPN dad-10733 141 2 serban serban PROPN dad-10733 141 3 , , PUNCT dad-10733 141 4 lowe lowe PROPN dad-10733 141 5 , , PUNCT dad-10733 141 6 henderson henderson PROPN dad-10733 141 7 , , PUNCT dad-10733 141 8 charlin charlin PROPN dad-10733 141 9 and and CCONJ dad-10733 141 10 pineau pineau PROPN dad-10733 141 11 nents nent NOUN dad-10733 141 12 ( ( PUNCT dad-10733 141 13 i.e. i.e. X dad-10733 141 14 , , PUNCT dad-10733 141 15 natural natural ADJ dad-10733 141 16 language language NOUN dad-10733 141 17 understanding understanding NOUN dad-10733 141 18 , , PUNCT dad-10733 141 19 dialogue dialogue NOUN dad-10733 141 20 state state NOUN dad-10733 141 21 tracking tracking NOUN dad-10733 141 22 , , PUNCT dad-10733 141 23 dialogue dialogue NOUN dad-10733 141 24 response response NOUN dad-10733 141 25 action action NOUN dad-10733 141 26 selection selection NOUN dad-10733 141 27 , , PUNCT dad-10733 141 28 and and CCONJ dad-10733 141 29 natural natural ADJ dad-10733 141 30 language language NOUN dad-10733 141 31 generation generation NOUN dad-10733 141 32 ) ) PUNCT dad-10733 141 33 . . PUNCT dad-10733 142 1 in in ADP dad-10733 142 2 particular particular ADJ dad-10733 142 3 , , PUNCT dad-10733 142 4 so so ADV dad-10733 142 5 - - PUNCT dad-10733 142 6 called call VERB dad-10733 142 7 end end NOUN dad-10733 142 8 - - PUNCT dad-10733 142 9 to to ADP dad-10733 142 10 - - PUNCT dad-10733 142 11 end end NOUN dad-10733 142 12 dialogue dialogue NOUN dad-10733 142 13 system system NOUN dad-10733 142 14 architectures architecture NOUN dad-10733 142 15 based base VERB dad-10733 142 16 on on ADP dad-10733 142 17 neural neural ADJ dad-10733 142 18 networks network NOUN dad-10733 142 19 have have AUX dad-10733 142 20 shown show VERB dad-10733 142 21 promising promising ADJ dad-10733 142 22 results result NOUN dad-10733 142 23 on on ADP dad-10733 142 24 several several ADJ dad-10733 142 25 dialogue dialogue NOUN dad-10733 142 26 tasks task NOUN dad-10733 142 27 ( ( PUNCT dad-10733 142 28 ritter ritter PROPN dad-10733 142 29 et et PROPN dad-10733 142 30 al al PROPN dad-10733 142 31 . . PROPN dad-10733 142 32 , , PUNCT dad-10733 142 33 2011 2011 NUM dad-10733 142 34 ; ; PUNCT dad-10733 142 35 vinyals vinyal NOUN dad-10733 142 36 and and CCONJ dad-10733 142 37 le le NOUN dad-10733 142 38 , , PUNCT dad-10733 142 39 2015 2015 NUM dad-10733 142 40 ; ; PUNCT dad-10733 142 41 lowe lowe PROPN dad-10733 142 42 et et PROPN dad-10733 142 43 al al PROPN dad-10733 142 44 . . PROPN dad-10733 142 45 , , PUNCT dad-10733 142 46 2015a 2015a NUM dad-10733 142 47 ; ; PUNCT dad-10733 142 48 sordoni sordoni PROPN dad-10733 142 49 et et PROPN dad-10733 142 50 al al PROPN dad-10733 142 51 . . PROPN dad-10733 142 52 , , PUNCT dad-10733 142 53 2015 2015 NUM dad-10733 142 54 ; ; PUNCT dad-10733 142 55 shang shang PROPN dad-10733 142 56 et et PROPN dad-10733 142 57 al al PROPN dad-10733 142 58 . . PROPN dad-10733 142 59 , , PUNCT dad-10733 142 60 2015 2015 NUM dad-10733 142 61 ; ; PUNCT dad-10733 142 62 li li PROPN dad-10733 142 63 et et PROPN dad-10733 142 64 al al PROPN dad-10733 142 65 . . PROPN dad-10733 142 66 , , PUNCT dad-10733 142 67 2015 2015 NUM dad-10733 142 68 ; ; PUNCT dad-10733 142 69 serban serban PROPN dad-10733 142 70 et et PROPN dad-10733 142 71 al al PROPN dad-10733 142 72 . . PROPN dad-10733 142 73 , , PUNCT dad-10733 142 74 2016 2016 NUM dad-10733 142 75 ; ; PUNCT dad-10733 142 76 serban serban PROPN dad-10733 142 77 et et PROPN dad-10733 142 78 al al PROPN dad-10733 142 79 . . PROPN dad-10733 142 80 , , PUNCT dad-10733 142 81 2017d 2017d NUM dad-10733 142 82 , , PUNCT dad-10733 142 83 a a PRON dad-10733 142 84 ; ; PUNCT dad-10733 142 85 dodge dodge VERB dad-10733 142 86 et et PROPN dad-10733 142 87 al al PROPN dad-10733 142 88 . . PROPN dad-10733 142 89 , , PUNCT dad-10733 142 90 2015 2015 NUM dad-10733 142 91 ) ) PUNCT dad-10733 142 92 . . PUNCT dad-10733 143 1 in in ADP dad-10733 143 2 their their PRON dad-10733 143 3 purest pure ADJ dad-10733 143 4 form form NOUN dad-10733 143 5 , , PUNCT dad-10733 143 6 these these DET dad-10733 143 7 models model NOUN dad-10733 143 8 take take VERB dad-10733 143 9 as as ADP dad-10733 143 10 input input NOUN dad-10733 143 11 a a DET dad-10733 143 12 dialogue dialogue NOUN dad-10733 143 13 in in ADP dad-10733 143 14 text text NOUN dad-10733 143 15 form form NOUN dad-10733 143 16 and and CCONJ dad-10733 143 17 output output VERB dad-10733 143 18 a a DET dad-10733 143 19 natural natural ADJ dad-10733 143 20 language language NOUN dad-10733 143 21 response response NOUN dad-10733 143 22 ( ( PUNCT dad-10733 143 23 or or CCONJ dad-10733 143 24 a a DET dad-10733 143 25 distribution distribution NOUN dad-10733 143 26 over over ADP dad-10733 143 27 responses response NOUN dad-10733 143 28 ) ) PUNCT dad-10733 143 29 . . PUNCT dad-10733 144 1 we we PRON dad-10733 144 2 call call VERB dad-10733 144 3 these these DET dad-10733 144 4 systems system NOUN dad-10733 144 5 end end NOUN dad-10733 144 6 - - PUNCT dad-10733 144 7 to to ADP dad-10733 144 8 - - PUNCT dad-10733 144 9 end end NOUN dad-10733 144 10 dialogue dialogue NOUN dad-10733 144 11 systems system NOUN dad-10733 144 12 because because SCONJ dad-10733 144 13 they they PRON dad-10733 144 14 possess possess VERB dad-10733 144 15 two two NUM dad-10733 144 16 important important ADJ dad-10733 144 17 properties property NOUN dad-10733 144 18 . . PUNCT dad-10733 145 1 first first ADV dad-10733 145 2 , , PUNCT dad-10733 145 3 they they PRON dad-10733 145 4 do do AUX dad-10733 145 5 not not PART dad-10733 145 6 contain contain VERB dad-10733 145 7 or or CCONJ dad-10733 145 8 require require VERB dad-10733 145 9 learning learn VERB dad-10733 145 10 any any DET dad-10733 145 11 sub sub NOUN dad-10733 145 12 - - NOUN dad-10733 145 13 components component NOUN dad-10733 145 14 ( ( PUNCT dad-10733 145 15 such such ADJ dad-10733 145 16 as as ADP dad-10733 145 17 natural natural ADJ dad-10733 145 18 language language NOUN dad-10733 145 19 understanding understanding NOUN dad-10733 145 20 or or CCONJ dad-10733 145 21 dialogue dialogue NOUN dad-10733 145 22 state state NOUN dad-10733 145 23 tracking tracking NOUN dad-10733 145 24 ) ) PUNCT dad-10733 145 25 . . PUNCT dad-10733 146 1 consequently consequently ADV dad-10733 146 2 , , PUNCT dad-10733 146 3 there there PRON dad-10733 146 4 is be VERB dad-10733 146 5 no no DET dad-10733 146 6 need need NOUN dad-10733 146 7 to to PART dad-10733 146 8 collect collect VERB dad-10733 146 9 intermediate intermediate ADJ dad-10733 146 10 labels label NOUN dad-10733 146 11 ( ( PUNCT dad-10733 146 12 e.g. e.g. ADV dad-10733 146 13 user user NOUN dad-10733 146 14 intention intention NOUN dad-10733 146 15 or or CCONJ dad-10733 146 16 dialogue dialogue NOUN dad-10733 146 17 state state NOUN dad-10733 146 18 labels label NOUN dad-10733 146 19 ) ) PUNCT dad-10733 146 20 . . PUNCT dad-10733 147 1 second second ADJ dad-10733 147 2 , , PUNCT dad-10733 147 3 all all DET dad-10733 147 4 model model NOUN dad-10733 147 5 parameters parameter NOUN dad-10733 147 6 are be AUX dad-10733 147 7 optimized optimize VERB dad-10733 147 8 w.r.t w.r.t NOUN dad-10733 147 9 . . PUNCT dad-10733 148 1 a a DET dad-10733 148 2 single single ADJ dad-10733 148 3 objective objective ADJ dad-10733 148 4 function function NOUN dad-10733 148 5 . . PUNCT dad-10733 149 1 often often ADV dad-10733 149 2 the the DET dad-10733 149 3 objective objective ADJ dad-10733 149 4 function function NOUN dad-10733 149 5 chosen choose VERB dad-10733 149 6 is be AUX dad-10733 149 7 maximum maximum ADJ dad-10733 149 8 log log NOUN dad-10733 149 9 - - PUNCT dad-10733 149 10 likelihood likelihood NOUN dad-10733 149 11 ( ( PUNCT dad-10733 149 12 e.g. e.g. ADV dad-10733 149 13 crossentropy crossentropy NOUN dad-10733 149 14 ) ) PUNCT dad-10733 149 15 on on ADP dad-10733 149 16 a a DET dad-10733 149 17 fixed fix VERB dad-10733 149 18 corpus corpus NOUN dad-10733 149 19 of of ADP dad-10733 149 20 dialogues dialogue NOUN dad-10733 149 21 . . PUNCT dad-10733 150 1 although although SCONJ dad-10733 150 2 in in ADP dad-10733 150 3 earlier early ADJ dad-10733 150 4 work work NOUN dad-10733 150 5 these these DET dad-10733 150 6 models model NOUN dad-10733 150 7 depended depend VERB dad-10733 150 8 only only ADV dad-10733 150 9 on on ADP dad-10733 150 10 the the DET dad-10733 150 11 dialogue dialogue NOUN dad-10733 150 12 context context NOUN dad-10733 150 13 , , PUNCT dad-10733 150 14 they they PRON dad-10733 150 15 may may AUX dad-10733 150 16 be be AUX dad-10733 150 17 extended extend VERB dad-10733 150 18 to to PART dad-10733 150 19 also also ADV dad-10733 150 20 depend depend VERB dad-10733 150 21 on on ADP dad-10733 150 22 outputs output NOUN dad-10733 150 23 from from ADP dad-10733 150 24 other other ADJ dad-10733 150 25 components component NOUN dad-10733 150 26 ( ( PUNCT dad-10733 150 27 e.g. e.g. ADV dad-10733 150 28 outputs output NOUN dad-10733 150 29 from from ADP dad-10733 150 30 the the DET dad-10733 150 31 speech speech NOUN dad-10733 150 32 recognition recognition NOUN dad-10733 150 33 component component NOUN dad-10733 150 34 ) ) PUNCT dad-10733 150 35 , , PUNCT dad-10733 150 36 and and CCONJ dad-10733 150 37 on on ADP dad-10733 150 38 external external ADJ dad-10733 150 39 knowledge knowledge NOUN dad-10733 150 40 ( ( PUNCT dad-10733 150 41 e.g. e.g. ADV dad-10733 150 42 external external ADJ dad-10733 150 43 databases database NOUN dad-10733 150 44 that that PRON dad-10733 150 45 can can AUX dad-10733 150 46 be be AUX dad-10733 150 47 queried query VERB dad-10733 150 48 by by ADP dad-10733 150 49 the the DET dad-10733 150 50 system system NOUN dad-10733 150 51 ) ) PUNCT dad-10733 150 52 . . PUNCT dad-10733 151 1 end end NOUN dad-10733 151 2 - - PUNCT dad-10733 151 3 to to ADP dad-10733 151 4 - - PUNCT dad-10733 151 5 end end NOUN dad-10733 151 6 dialogue dialogue NOUN dad-10733 151 7 systems system NOUN dad-10733 151 8 can can AUX dad-10733 151 9 be be AUX dad-10733 151 10 divided divide VERB dad-10733 151 11 into into ADP dad-10733 151 12 two two NUM dad-10733 151 13 categories category NOUN dad-10733 151 14 : : PUNCT dad-10733 151 15 those those PRON dad-10733 151 16 that that PRON dad-10733 151 17 select select VERB dad-10733 151 18 deterministically deterministically ADV dad-10733 151 19 from from ADP dad-10733 151 20 a a DET dad-10733 151 21 fixed fix VERB dad-10733 151 22 set set NOUN dad-10733 151 23 of of ADP dad-10733 151 24 possible possible ADJ dad-10733 151 25 responses response NOUN dad-10733 151 26 , , PUNCT dad-10733 151 27 and and CCONJ dad-10733 151 28 those those PRON dad-10733 151 29 that that PRON dad-10733 151 30 attempt attempt VERB dad-10733 151 31 to to PART dad-10733 151 32 stochastically stochastically ADV dad-10733 151 33 generate generate VERB dad-10733 151 34 responses response NOUN dad-10733 151 35 by by ADP dad-10733 151 36 keeping keep VERB dad-10733 151 37 a a DET dad-10733 151 38 posterior posterior ADJ dad-10733 151 39 distribution distribution NOUN dad-10733 151 40 over over ADP dad-10733 151 41 possible possible ADJ dad-10733 151 42 utterances utterance NOUN dad-10733 151 43 . . PUNCT dad-10733 152 1 systems system NOUN dad-10733 152 2 in in ADP dad-10733 152 3 the the DET dad-10733 152 4 first first ADJ dad-10733 152 5 category category NOUN dad-10733 152 6 map map VERB dad-10733 152 7 the the DET dad-10733 152 8 dialogue dialogue NOUN dad-10733 152 9 history history NOUN dad-10733 152 10 , , PUNCT dad-10733 152 11 state state NOUN dad-10733 152 12 tracking tracking NOUN dad-10733 152 13 outputs output NOUN dad-10733 152 14 and and CCONJ dad-10733 152 15 external external ADJ dad-10733 152 16 knowledge knowledge NOUN dad-10733 152 17 to to ADP dad-10733 152 18 a a DET dad-10733 152 19 response response NOUN dad-10733 152 20 action action NOUN dad-10733 152 21 : : PUNCT dad-10733 152 22 fθ fθ ADJ dad-10733 152 23 : : PUNCT dad-10733 152 24 { { PUNCT dad-10733 152 25 dialogue dialogue NOUN dad-10733 152 26 history history NOUN dad-10733 152 27 , , PUNCT dad-10733 152 28 state state NOUN dad-10733 152 29 tracking tracking NOUN dad-10733 152 30 outputs output NOUN dad-10733 152 31 , , PUNCT dad-10733 152 32 external external ADJ dad-10733 152 33 knowledge knowledge NOUN dad-10733 152 34 , , PUNCT dad-10733 152 35 t t PROPN dad-10733 152 36 } } PUNCT dad-10733 152 37 → → SYM dad-10733 152 38 action action NOUN dad-10733 152 39 at at ADP dad-10733 152 40 , , PUNCT dad-10733 152 41 ( ( PUNCT dad-10733 152 42 1 1 X dad-10733 152 43 ) ) PUNCT dad-10733 152 44 where where SCONJ dad-10733 152 45 at at ADP dad-10733 152 46 is be AUX dad-10733 152 47 the the DET dad-10733 152 48 dialogue dialogue NOUN dad-10733 152 49 system system NOUN dad-10733 152 50 response response NOUN dad-10733 152 51 action action NOUN dad-10733 152 52 at at ADP dad-10733 152 53 time time NOUN dad-10733 152 54 t t PROPN dad-10733 152 55 , , PUNCT dad-10733 152 56 and and CCONJ dad-10733 152 57 θ θ PROPN dad-10733 152 58 is be AUX dad-10733 152 59 the the DET dad-10733 152 60 set set NOUN dad-10733 152 61 of of ADP dad-10733 152 62 parameters parameter NOUN dad-10733 152 63 that that PRON dad-10733 152 64 defines define VERB dad-10733 152 65 f f X dad-10733 152 66 . . PUNCT dad-10733 153 1 while while SCONJ dad-10733 153 2 the the DET dad-10733 153 3 goal goal NOUN dad-10733 153 4 of of ADP dad-10733 153 5 end end NOUN dad-10733 153 6 - - PUNCT dad-10733 153 7 to to ADP dad-10733 153 8 - - PUNCT dad-10733 153 9 end end NOUN dad-10733 153 10 systems system NOUN dad-10733 153 11 is be AUX dad-10733 153 12 to to PART dad-10733 153 13 output output VERB dad-10733 153 14 the the DET dad-10733 153 15 response response NOUN dad-10733 153 16 directly directly ADV dad-10733 153 17 ( ( PUNCT dad-10733 153 18 for for ADP dad-10733 153 19 example example NOUN dad-10733 153 20 , , PUNCT dad-10733 153 21 taking take VERB dad-10733 153 22 a a DET dad-10733 153 23 word word NOUN dad-10733 153 24 output output NOUN dad-10733 153 25 as as ADP dad-10733 153 26 an an DET dad-10733 153 27 action action NOUN dad-10733 153 28 ) ) PUNCT dad-10733 153 29 , , PUNCT dad-10733 153 30 in in ADP dad-10733 153 31 current current ADJ dad-10733 153 32 systems system NOUN dad-10733 153 33 , , PUNCT dad-10733 153 34 the the DET dad-10733 153 35 response response NOUN dad-10733 153 36 action action NOUN dad-10733 153 37 may may AUX dad-10733 153 38 also also ADV dad-10733 153 39 refer refer VERB dad-10733 153 40 to to ADP dad-10733 153 41 a a DET dad-10733 153 42 selection selection NOUN dad-10733 153 43 from from ADP dad-10733 153 44 a a DET dad-10733 153 45 pre pre ADJ dad-10733 153 46 - - ADJ dad-10733 153 47 defined define VERB dad-10733 153 48 set set NOUN dad-10733 153 49 of of ADP dad-10733 153 50 linguistic linguistic ADJ dad-10733 153 51 responses response NOUN dad-10733 153 52 — — PUNCT dad-10733 153 53 perhaps perhaps ADV dad-10733 153 54 corresponding correspond VERB dad-10733 153 55 to to ADP dad-10733 153 56 different different ADJ dad-10733 153 57 dialogue dialogue NOUN dad-10733 153 58 acts act VERB dad-10733 153 59 . . PUNCT dad-10733 154 1 information information NOUN dad-10733 154 2 retrieval retrieval NOUN dad-10733 154 3 and and CCONJ dad-10733 154 4 ranking ranking NOUN dad-10733 154 5 - - PUNCT dad-10733 154 6 based base VERB dad-10733 154 7 systems system NOUN dad-10733 154 8 — — PUNCT dad-10733 154 9 systems system NOUN dad-10733 154 10 that that PRON dad-10733 154 11 search search VERB dad-10733 154 12 through through ADP dad-10733 154 13 a a DET dad-10733 154 14 database database NOUN dad-10733 154 15 of of ADP dad-10733 154 16 dialogues dialogue NOUN dad-10733 154 17 and and CCONJ dad-10733 154 18 pick pick VERB dad-10733 154 19 responses response NOUN dad-10733 154 20 with with ADP dad-10733 154 21 the the DET dad-10733 154 22 most most ADV dad-10733 154 23 similar similar ADJ dad-10733 154 24 context context NOUN dad-10733 154 25 , , PUNCT dad-10733 154 26 such such ADJ dad-10733 154 27 as as ADP dad-10733 154 28 the the DET dad-10733 154 29 model model NOUN dad-10733 154 30 proposed propose VERB dad-10733 154 31 by by ADP dad-10733 154 32 banchs banch NOUN dad-10733 154 33 and and CCONJ dad-10733 154 34 li li PROPN dad-10733 154 35 ( ( PUNCT dad-10733 154 36 2012 2012 NUM dad-10733 154 37 ) ) PUNCT dad-10733 154 38 — — PUNCT dad-10733 154 39 belong belong VERB dad-10733 154 40 to to ADP dad-10733 154 41 this this DET dad-10733 154 42 category category NOUN dad-10733 154 43 . . PUNCT dad-10733 155 1 in in ADP dad-10733 155 2 this this DET dad-10733 155 3 case case NOUN dad-10733 155 4 , , PUNCT dad-10733 155 5 the the DET dad-10733 155 6 mapping mapping NOUN dad-10733 155 7 function function NOUN dad-10733 155 8 fθ fθ NOUN dad-10733 155 9 projects project VERB dad-10733 155 10 the the DET dad-10733 155 11 dialogue dialogue NOUN dad-10733 155 12 history history NOUN dad-10733 155 13 into into ADP dad-10733 155 14 a a DET dad-10733 155 15 euclidean euclidean ADJ dad-10733 155 16 space space NOUN dad-10733 155 17 ( ( PUNCT dad-10733 155 18 e.g. e.g. ADV dad-10733 155 19 using use VERB dad-10733 155 20 tf tf PROPN dad-10733 155 21 - - PUNCT dad-10733 155 22 idf idf NOUN dad-10733 155 23 bag bag NOUN dad-10733 155 24 - - PUNCT dad-10733 155 25 of of ADP dad-10733 155 26 - - PUNCT dad-10733 155 27 words word NOUN dad-10733 155 28 representations representation NOUN dad-10733 155 29 ) ) PUNCT dad-10733 155 30 . . PUNCT dad-10733 156 1 the the DET dad-10733 156 2 response response NOUN dad-10733 156 3 is be AUX dad-10733 156 4 then then ADV dad-10733 156 5 found find VERB dad-10733 156 6 by by ADP dad-10733 156 7 projecting project VERB dad-10733 156 8 all all DET dad-10733 156 9 potential potential ADJ dad-10733 156 10 responses response NOUN dad-10733 156 11 into into ADP dad-10733 156 12 the the DET dad-10733 156 13 same same ADJ dad-10733 156 14 euclidean euclidean ADJ dad-10733 156 15 space space NOUN dad-10733 156 16 , , PUNCT dad-10733 156 17 and and CCONJ dad-10733 156 18 the the DET dad-10733 156 19 response response NOUN dad-10733 156 20 closest close ADJ dad-10733 156 21 to to ADP dad-10733 156 22 the the DET dad-10733 156 23 desirable desirable ADJ dad-10733 156 24 response response NOUN dad-10733 156 25 region region NOUN dad-10733 156 26 is be AUX dad-10733 156 27 selected select VERB dad-10733 156 28 . . PUNCT dad-10733 157 1 the the DET dad-10733 157 2 neural neural ADJ dad-10733 157 3 network network NOUN dad-10733 157 4 proposed propose VERB dad-10733 157 5 by by ADP dad-10733 157 6 lowe lowe PROPN dad-10733 157 7 et et PROPN dad-10733 157 8 al al PROPN dad-10733 157 9 . . PROPN dad-10733 157 10 ( ( PUNCT dad-10733 157 11 2015a 2015a NUM dad-10733 157 12 ) ) PUNCT dad-10733 157 13 also also ADV dad-10733 157 14 belongs belong VERB dad-10733 157 15 to to ADP dad-10733 157 16 this this DET dad-10733 157 17 category category NOUN dad-10733 157 18 . . PUNCT dad-10733 158 1 in in ADP dad-10733 158 2 this this DET dad-10733 158 3 case case NOUN dad-10733 158 4 , , PUNCT dad-10733 158 5 the the DET dad-10733 158 6 dialogue dialogue NOUN dad-10733 158 7 history history NOUN dad-10733 158 8 is be AUX dad-10733 158 9 projected project VERB dad-10733 158 10 into into ADP dad-10733 158 11 a a DET dad-10733 158 12 euclidean euclidean ADJ dad-10733 158 13 space space NOUN dad-10733 158 14 using use VERB dad-10733 158 15 a a DET dad-10733 158 16 recurrent recurrent ADJ dad-10733 158 17 neural neural ADJ dad-10733 158 18 network network NOUN dad-10733 158 19 encoding encode VERB dad-10733 158 20 the the DET dad-10733 158 21 dialogue dialogue NOUN dad-10733 158 22 word word NOUN dad-10733 158 23 - - PUNCT dad-10733 158 24 by by ADP dad-10733 158 25 - - PUNCT dad-10733 158 26 word word NOUN dad-10733 158 27 . . PUNCT dad-10733 159 1 similarly similarly ADV dad-10733 159 2 , , PUNCT dad-10733 159 3 a a DET dad-10733 159 4 set set NOUN dad-10733 159 5 of of ADP dad-10733 159 6 candidate candidate NOUN dad-10733 159 7 responses response NOUN dad-10733 159 8 are be AUX dad-10733 159 9 mapped map VERB dad-10733 159 10 into into ADP dad-10733 159 11 the the DET dad-10733 159 12 same same ADJ dad-10733 159 13 euclidean euclidean ADJ dad-10733 159 14 space space NOUN dad-10733 159 15 using use VERB dad-10733 159 16 another another DET dad-10733 159 17 recurrent recurrent ADJ dad-10733 159 18 neural neural ADJ dad-10733 159 19 network network NOUN dad-10733 159 20 encoding encode VERB dad-10733 159 21 the the DET dad-10733 159 22 response response NOUN dad-10733 159 23 word word NOUN dad-10733 159 24 - - PUNCT dad-10733 159 25 by by ADP dad-10733 159 26 - - PUNCT dad-10733 159 27 word word NOUN dad-10733 159 28 . . PUNCT dad-10733 160 1 finally finally ADV dad-10733 160 2 , , PUNCT dad-10733 160 3 a a DET dad-10733 160 4 relevance relevance NOUN dad-10733 160 5 score score NOUN dad-10733 160 6 is be AUX dad-10733 160 7 computed compute VERB dad-10733 160 8 between between ADP dad-10733 160 9 the the DET dad-10733 160 10 dialogue dialogue NOUN dad-10733 160 11 context context NOUN dad-10733 160 12 and and CCONJ dad-10733 160 13 each each DET dad-10733 160 14 candidate candidate NOUN dad-10733 160 15 response response NOUN dad-10733 160 16 , , PUNCT dad-10733 160 17 and and CCONJ dad-10733 160 18 the the DET dad-10733 160 19 response response NOUN dad-10733 160 20 with with ADP dad-10733 160 21 the the DET dad-10733 160 22 highest high ADJ dad-10733 160 23 score score NOUN dad-10733 160 24 is be AUX dad-10733 160 25 returned return VERB dad-10733 160 26 . . PUNCT dad-10733 161 1 hybrid hybrid NOUN dad-10733 161 2 or or CCONJ dad-10733 161 3 combined combined ADJ dad-10733 161 4 models model NOUN dad-10733 161 5 , , PUNCT dad-10733 161 6 such such ADJ dad-10733 161 7 as as ADP dad-10733 161 8 the the DET dad-10733 161 9 model model NOUN dad-10733 161 10 built build VERB dad-10733 161 11 on on ADP dad-10733 161 12 both both CCONJ dad-10733 161 13 a a DET dad-10733 161 14 phrase phrase NOUN dad-10733 161 15 - - PUNCT dad-10733 161 16 based base VERB dad-10733 161 17 statistical statistical ADJ dad-10733 161 18 machine machine NOUN dad-10733 161 19 translation translation NOUN dad-10733 161 20 system system NOUN dad-10733 161 21 and and CCONJ dad-10733 161 22 a a DET dad-10733 161 23 recurrent recurrent ADJ dad-10733 161 24 neural neural ADJ dad-10733 161 25 network network NOUN dad-10733 161 26 proposed propose VERB dad-10733 161 27 by by ADP dad-10733 161 28 sordoni sordoni PROPN dad-10733 161 29 et et PROPN dad-10733 161 30 al al PROPN dad-10733 161 31 . . PROPN dad-10733 161 32 ( ( PUNCT dad-10733 161 33 2015 2015 NUM dad-10733 161 34 ) ) PUNCT dad-10733 161 35 , , PUNCT dad-10733 161 36 also also ADV dad-10733 161 37 belong belong VERB dad-10733 161 38 to to ADP dad-10733 161 39 this this DET dad-10733 161 40 category category NOUN dad-10733 161 41 . . PUNCT dad-10733 162 1 in in ADP dad-10733 162 2 this this DET dad-10733 162 3 case case NOUN dad-10733 162 4 , , PUNCT dad-10733 162 5 a a DET dad-10733 162 6 response response NOUN dad-10733 162 7 is be AUX dad-10733 162 8 generated generate VERB dad-10733 162 9 by by ADP dad-10733 162 10 deterministically deterministically ADV dad-10733 162 11 creating create VERB dad-10733 162 12 a a DET dad-10733 162 13 fixed fix VERB dad-10733 162 14 number number NOUN dad-10733 162 15 of of ADP dad-10733 162 16 answers answer NOUN dad-10733 162 17 using use VERB dad-10733 162 18 the the DET dad-10733 162 19 machine machine NOUN dad-10733 162 20 translation translation NOUN dad-10733 162 21 system system NOUN dad-10733 162 22 and and CCONJ dad-10733 162 23 then then ADV dad-10733 162 24 picking pick VERB dad-10733 162 25 the the DET dad-10733 162 26 response response NOUN dad-10733 162 27 according accord VERB dad-10733 162 28 to to ADP dad-10733 162 29 the the DET dad-10733 162 30 score score NOUN dad-10733 162 31 given give VERB dad-10733 162 32 by by ADP dad-10733 162 33 a a DET dad-10733 162 34 neural neural ADJ dad-10733 162 35 network network NOUN dad-10733 162 36 . . PUNCT dad-10733 163 1 although although SCONJ dad-10733 163 2 both both PRON dad-10733 163 3 of of ADP dad-10733 163 4 its its PRON dad-10733 163 5 sub sub NOUN dad-10733 163 6 - - NOUN dad-10733 163 7 components component NOUN dad-10733 163 8 are be AUX dad-10733 163 9 based base VERB dad-10733 163 10 on on ADP dad-10733 163 11 probabilistic probabilistic ADJ dad-10733 163 12 models model NOUN dad-10733 163 13 , , PUNCT dad-10733 163 14 the the DET dad-10733 163 15 final final ADJ dad-10733 163 16 model model NOUN dad-10733 163 17 does do AUX dad-10733 163 18 not not PART dad-10733 163 19 construct construct VERB dad-10733 163 20 a a DET dad-10733 163 21 probability probability NOUN dad-10733 163 22 distribution distribution NOUN dad-10733 163 23 over over ADP dad-10733 163 24 all all DET dad-10733 163 25 possible possible ADJ dad-10733 163 26 responses.1 responses.1 NOUN dad-10733 163 27 1 1 NUM dad-10733 163 28 . . PUNCT dad-10733 164 1 although although SCONJ dad-10733 164 2 the the DET dad-10733 164 3 model model NOUN dad-10733 164 4 does do AUX dad-10733 164 5 not not PART dad-10733 164 6 require require VERB dad-10733 164 7 intermediate intermediate ADJ dad-10733 164 8 labels label NOUN dad-10733 164 9 , , PUNCT dad-10733 164 10 it it PRON dad-10733 164 11 consists consist VERB dad-10733 164 12 of of ADP dad-10733 164 13 sub sub NOUN dad-10733 164 14 - - NOUN dad-10733 164 15 components component NOUN dad-10733 164 16 whose whose DET dad-10733 164 17 parameters parameter NOUN dad-10733 164 18 are be AUX dad-10733 164 19 trained train VERB dad-10733 164 20 with with ADP dad-10733 164 21 different different ADJ dad-10733 164 22 objective objective ADJ dad-10733 164 23 functions function NOUN dad-10733 164 24 . . PUNCT dad-10733 165 1 therefore therefore ADV dad-10733 165 2 , , PUNCT dad-10733 165 3 strictly strictly ADV dad-10733 165 4 speaking speak VERB dad-10733 165 5 , , PUNCT dad-10733 165 6 this this PRON dad-10733 165 7 is be AUX dad-10733 165 8 not not PART dad-10733 165 9 an an DET dad-10733 165 10 end end NOUN dad-10733 165 11 - - PUNCT dad-10733 165 12 to to ADP dad-10733 165 13 - - PUNCT dad-10733 165 14 end end NOUN dad-10733 165 15 model model NOUN dad-10733 165 16 . . PUNCT dad-10733 166 1 8 8 NUM dad-10733 166 2 a a DET dad-10733 166 3 survey survey NOUN dad-10733 166 4 of of ADP dad-10733 166 5 available available ADJ dad-10733 166 6 corpora corpora PROPN dad-10733 166 7 for for ADP dad-10733 166 8 building build VERB dad-10733 166 9 data data NOUN dad-10733 166 10 - - PUNCT dad-10733 166 11 driven drive VERB dad-10733 166 12 dialogue dialogue NOUN dad-10733 166 13 systems system NOUN dad-10733 166 14 in in ADP dad-10733 166 15 contrast contrast NOUN dad-10733 166 16 to to ADP dad-10733 166 17 a a DET dad-10733 166 18 deterministic deterministic ADJ dad-10733 166 19 system system NOUN dad-10733 166 20 , , PUNCT dad-10733 166 21 a a DET dad-10733 166 22 stochastic stochastic ADJ dad-10733 166 23 system system NOUN dad-10733 166 24 explicitly explicitly ADV dad-10733 166 25 computes compute VERB dad-10733 166 26 a a DET dad-10733 166 27 full full ADJ dad-10733 166 28 posterior posterior ADJ dad-10733 166 29 probability probability NOUN dad-10733 166 30 distribution distribution NOUN dad-10733 166 31 over over ADP dad-10733 166 32 possible possible ADJ dad-10733 166 33 system system NOUN dad-10733 166 34 response response NOUN dad-10733 166 35 actions action NOUN dad-10733 166 36 at at ADP dad-10733 166 37 every every DET dad-10733 166 38 turn turn NOUN dad-10733 166 39 : : PUNCT dad-10733 166 40 pθ(action pθ(action NOUN dad-10733 166 41 at at ADP dad-10733 166 42 | | ADV dad-10733 166 43 dialogue dialogue NOUN dad-10733 166 44 history history NOUN dad-10733 166 45 , , PUNCT dad-10733 166 46 state state NOUN dad-10733 166 47 tracking tracking NOUN dad-10733 166 48 outputs output NOUN dad-10733 166 49 , , PUNCT dad-10733 166 50 external external ADJ dad-10733 166 51 knowledge knowledge NOUN dad-10733 166 52 , , PUNCT dad-10733 166 53 t t PROPN dad-10733 166 54 ) ) PUNCT dad-10733 166 55 . . PUNCT dad-10733 167 1 ( ( PUNCT dad-10733 167 2 2 2 X dad-10733 167 3 ) ) PUNCT dad-10733 167 4 systems system NOUN dad-10733 167 5 based base VERB dad-10733 167 6 on on ADP dad-10733 167 7 generative generative ADJ dad-10733 167 8 recurrent recurrent ADJ dad-10733 167 9 neural neural ADJ dad-10733 167 10 networks network NOUN dad-10733 167 11 typically typically ADV dad-10733 167 12 belong belong VERB dad-10733 167 13 to to ADP dad-10733 167 14 this this DET dad-10733 167 15 category category NOUN dad-10733 167 16 ( ( PUNCT dad-10733 167 17 vinyals vinyal NOUN dad-10733 167 18 and and CCONJ dad-10733 167 19 le le NOUN dad-10733 167 20 , , PUNCT dad-10733 167 21 2015 2015 NUM dad-10733 167 22 ; ; PUNCT dad-10733 167 23 serban serban PROPN dad-10733 167 24 et et PROPN dad-10733 167 25 al al PROPN dad-10733 167 26 . . PROPN dad-10733 167 27 , , PUNCT dad-10733 167 28 2016 2016 NUM dad-10733 167 29 ) ) PUNCT dad-10733 167 30 . . PUNCT dad-10733 168 1 by by ADP dad-10733 168 2 breaking break VERB dad-10733 168 3 down down ADP dad-10733 168 4 eq eq ADP dad-10733 168 5 . . PUNCT dad-10733 169 1 ( ( PUNCT dad-10733 169 2 2 2 NUM dad-10733 169 3 ) ) PUNCT dad-10733 169 4 into into ADP dad-10733 169 5 a a DET dad-10733 169 6 product product NOUN dad-10733 169 7 of of ADP dad-10733 169 8 probabilities probability NOUN dad-10733 169 9 over over ADP dad-10733 169 10 words word NOUN dad-10733 169 11 , , PUNCT dad-10733 169 12 responses response NOUN dad-10733 169 13 can can AUX dad-10733 169 14 be be AUX dad-10733 169 15 generated generate VERB dad-10733 169 16 by by ADP dad-10733 169 17 sampling sample VERB dad-10733 169 18 word word NOUN dad-10733 169 19 - - PUNCT dad-10733 169 20 by by ADP dad-10733 169 21 - - PUNCT dad-10733 169 22 word word NOUN dad-10733 169 23 from from ADP dad-10733 169 24 their their PRON dad-10733 169 25 probability probability NOUN dad-10733 169 26 distribution distribution NOUN dad-10733 169 27 . . PUNCT dad-10733 170 1 these these DET dad-10733 170 2 systems system NOUN dad-10733 170 3 are be AUX dad-10733 170 4 also also ADV dad-10733 170 5 able able ADJ dad-10733 170 6 to to PART dad-10733 170 7 generate generate VERB dad-10733 170 8 entirely entirely ADV dad-10733 170 9 novel novel ADJ dad-10733 170 10 responses response NOUN dad-10733 170 11 by by ADP dad-10733 170 12 sampling sample VERB dad-10733 170 13 word word NOUN dad-10733 170 14 - - PUNCT dad-10733 170 15 by by ADP dad-10733 170 16 - - PUNCT dad-10733 170 17 word word NOUN dad-10733 170 18 ( ( PUNCT dad-10733 170 19 though though ADV dad-10733 170 20 , , PUNCT dad-10733 170 21 some some DET dad-10733 170 22 such such ADJ dad-10733 170 23 models model NOUN dad-10733 170 24 require require VERB dad-10733 170 25 modification modification NOUN dad-10733 170 26 to to PART dad-10733 170 27 elicit elicit VERB dad-10733 170 28 diversity diversity NOUN dad-10733 170 29 in in ADP dad-10733 170 30 responses response NOUN dad-10733 170 31 ( ( PUNCT dad-10733 170 32 li li PROPN dad-10733 170 33 et et PROPN dad-10733 170 34 al al PROPN dad-10733 170 35 . . PROPN dad-10733 170 36 , , PUNCT dad-10733 170 37 2015 2015 NUM dad-10733 170 38 ) ) PUNCT dad-10733 170 39 ) ) PUNCT dad-10733 170 40 . . PUNCT dad-10733 171 1 highly highly ADV dad-10733 171 2 probable probable ADJ dad-10733 171 3 responses response NOUN dad-10733 171 4 , , PUNCT dad-10733 171 5 i.e. i.e. X dad-10733 171 6 the the DET dad-10733 171 7 response response NOUN dad-10733 171 8 with with ADP dad-10733 171 9 the the DET dad-10733 171 10 highest high ADJ dad-10733 171 11 probability probability NOUN dad-10733 171 12 , , PUNCT dad-10733 171 13 can can AUX dad-10733 171 14 further far ADV dad-10733 171 15 be be AUX dad-10733 171 16 generated generate VERB dad-10733 171 17 by by ADP dad-10733 171 18 using use VERB dad-10733 171 19 a a DET dad-10733 171 20 method method NOUN dad-10733 171 21 known know VERB dad-10733 171 22 as as ADP dad-10733 171 23 beam beam NOUN dad-10733 171 24 - - PUNCT dad-10733 171 25 search search NOUN dad-10733 171 26 ( ( PUNCT dad-10733 171 27 graves grave NOUN dad-10733 171 28 , , PUNCT dad-10733 171 29 2012 2012 NUM dad-10733 171 30 ) ) PUNCT dad-10733 171 31 . . PUNCT dad-10733 172 1 these these DET dad-10733 172 2 systems system NOUN dad-10733 172 3 project project VERB dad-10733 172 4 each each DET dad-10733 172 5 word word NOUN dad-10733 172 6 into into ADP dad-10733 172 7 a a DET dad-10733 172 8 euclidean euclidean ADJ dad-10733 172 9 space space NOUN dad-10733 172 10 ( ( PUNCT dad-10733 172 11 known know VERB dad-10733 172 12 as as ADP dad-10733 172 13 a a DET dad-10733 172 14 word word NOUN dad-10733 172 15 embedding embed VERB dad-10733 172 16 ) ) PUNCT dad-10733 172 17 ( ( PUNCT dad-10733 172 18 bengio bengio NOUN dad-10733 172 19 et et PROPN dad-10733 172 20 al al PROPN dad-10733 172 21 . . PROPN dad-10733 172 22 , , PUNCT dad-10733 172 23 2003 2003 NUM dad-10733 172 24 ) ) PUNCT dad-10733 172 25 ; ; PUNCT dad-10733 172 26 they they PRON dad-10733 172 27 also also ADV dad-10733 172 28 project project VERB dad-10733 172 29 the the DET dad-10733 172 30 dialogue dialogue NOUN dad-10733 172 31 history history NOUN dad-10733 172 32 and and CCONJ dad-10733 172 33 external external ADJ dad-10733 172 34 knowledge knowledge NOUN dad-10733 172 35 into into ADP dad-10733 172 36 a a DET dad-10733 172 37 euclidean euclidean ADJ dad-10733 172 38 space space NOUN dad-10733 172 39 ( ( PUNCT dad-10733 172 40 wen wen PROPN dad-10733 172 41 et et PROPN dad-10733 172 42 al al PROPN dad-10733 172 43 . . PROPN dad-10733 172 44 , , PUNCT dad-10733 172 45 2015a 2015a NUM dad-10733 172 46 ; ; PUNCT dad-10733 172 47 lowe lowe PROPN dad-10733 172 48 et et PROPN dad-10733 172 49 al al PROPN dad-10733 172 50 . . PROPN dad-10733 172 51 , , PUNCT dad-10733 172 52 2015b 2015b NUM dad-10733 172 53 ) ) PUNCT dad-10733 172 54 . . PUNCT dad-10733 173 1 similarly similarly ADV dad-10733 173 2 , , PUNCT dad-10733 173 3 the the DET dad-10733 173 4 system system NOUN dad-10733 173 5 proposed propose VERB dad-10733 173 6 by by ADP dad-10733 173 7 ritter ritter PROPN dad-10733 173 8 et et PROPN dad-10733 173 9 al al PROPN dad-10733 173 10 . . PROPN dad-10733 174 1 ( ( PUNCT dad-10733 174 2 2011 2011 NUM dad-10733 174 3 ) ) PUNCT dad-10733 174 4 belongs belong VERB dad-10733 174 5 to to ADP dad-10733 174 6 this this DET dad-10733 174 7 category category NOUN dad-10733 174 8 . . PUNCT dad-10733 175 1 their their PRON dad-10733 175 2 model model NOUN dad-10733 175 3 uses use VERB dad-10733 175 4 a a DET dad-10733 175 5 statistical statistical ADJ dad-10733 175 6 machine machine NOUN dad-10733 175 7 translation translation NOUN dad-10733 175 8 model model NOUN dad-10733 175 9 to to PART dad-10733 175 10 map map VERB dad-10733 175 11 a a DET dad-10733 175 12 dialogue dialogue NOUN dad-10733 175 13 history history NOUN dad-10733 175 14 to to ADP dad-10733 175 15 its its PRON dad-10733 175 16 response response NOUN dad-10733 175 17 . . PUNCT dad-10733 176 1 when when SCONJ dad-10733 176 2 trained train VERB dad-10733 176 3 solely solely ADV dad-10733 176 4 on on ADP dad-10733 176 5 text text NOUN dad-10733 176 6 , , PUNCT dad-10733 176 7 these these DET dad-10733 176 8 generative generative ADJ dad-10733 176 9 models model NOUN dad-10733 176 10 can can AUX dad-10733 176 11 be be AUX dad-10733 176 12 viewed view VERB dad-10733 176 13 as as ADP dad-10733 176 14 unsupervised unsupervised ADJ dad-10733 176 15 learning learning NOUN dad-10733 176 16 models model NOUN dad-10733 176 17 , , PUNCT dad-10733 176 18 because because SCONJ dad-10733 176 19 they they PRON dad-10733 176 20 aim aim VERB dad-10733 176 21 to to PART dad-10733 176 22 reproduce reproduce VERB dad-10733 176 23 the the DET dad-10733 176 24 training training NOUN dad-10733 176 25 data datum NOUN dad-10733 176 26 distribution distribution NOUN dad-10733 176 27 . . PUNCT dad-10733 177 1 in in ADP dad-10733 177 2 other other ADJ dad-10733 177 3 words word NOUN dad-10733 177 4 , , PUNCT dad-10733 177 5 such such ADJ dad-10733 177 6 models model NOUN dad-10733 177 7 learn learn VERB dad-10733 177 8 to to PART dad-10733 177 9 assign assign VERB dad-10733 177 10 a a DET dad-10733 177 11 probability probability NOUN dad-10733 177 12 to to ADP dad-10733 177 13 every every DET dad-10733 177 14 possible possible ADJ dad-10733 177 15 conversation conversation NOUN dad-10733 177 16 , , PUNCT dad-10733 177 17 and and CCONJ dad-10733 177 18 since since SCONJ dad-10733 177 19 they they PRON dad-10733 177 20 generate generate VERB dad-10733 177 21 responses response NOUN dad-10733 177 22 word word NOUN dad-10733 177 23 - - PUNCT dad-10733 177 24 by by ADP dad-10733 177 25 - - PUNCT dad-10733 177 26 word word NOUN dad-10733 177 27 , , PUNCT dad-10733 177 28 they they PRON dad-10733 177 29 must must AUX dad-10733 177 30 learn learn VERB dad-10733 177 31 to to PART dad-10733 177 32 simulate simulate VERB dad-10733 177 33 the the DET dad-10733 177 34 behaviour behaviour NOUN dad-10733 177 35 of of ADP dad-10733 177 36 the the DET dad-10733 177 37 agents agent NOUN dad-10733 177 38 in in ADP dad-10733 177 39 the the DET dad-10733 177 40 training training NOUN dad-10733 177 41 corpus corpus NOUN dad-10733 177 42 . . PUNCT dad-10733 178 1 early early ADJ dad-10733 178 2 reinforcement reinforcement NOUN dad-10733 178 3 learning learn VERB dad-10733 178 4 dialogue dialogue NOUN dad-10733 178 5 systems system NOUN dad-10733 178 6 with with ADP dad-10733 178 7 stochastic stochastic ADJ dad-10733 178 8 policies policy NOUN dad-10733 178 9 also also ADV dad-10733 178 10 belong belong VERB dad-10733 178 11 to to ADP dad-10733 178 12 this this DET dad-10733 178 13 category category NOUN dad-10733 178 14 ( ( PUNCT dad-10733 178 15 e.g. e.g. ADV dad-10733 178 16 the the DET dad-10733 178 17 njfun njfun NOUN dad-10733 178 18 system system NOUN dad-10733 178 19 of of ADP dad-10733 178 20 singh singh PROPN dad-10733 178 21 et et PROPN dad-10733 178 22 al al PROPN dad-10733 178 23 . . PROPN dad-10733 179 1 ( ( PUNCT dad-10733 179 2 2002 2002 NUM dad-10733 179 3 ) ) PUNCT dad-10733 179 4 ) ) PUNCT dad-10733 179 5 . . PUNCT dad-10733 180 1 in in ADP dad-10733 180 2 contrast contrast NOUN dad-10733 180 3 to to ADP dad-10733 180 4 the the DET dad-10733 180 5 neural neural ADJ dad-10733 180 6 network network NOUN dad-10733 180 7 and and CCONJ dad-10733 180 8 statistical statistical ADJ dad-10733 180 9 machine machine NOUN dad-10733 180 10 translation translation NOUN dad-10733 180 11 systems system NOUN dad-10733 180 12 , , PUNCT dad-10733 180 13 these these DET dad-10733 180 14 reinforcement reinforcement NOUN dad-10733 180 15 learning learning NOUN dad-10733 180 16 systems system NOUN dad-10733 180 17 typically typically ADV dad-10733 180 18 have have VERB dad-10733 180 19 very very ADV dad-10733 180 20 small small ADJ dad-10733 180 21 sets set NOUN dad-10733 180 22 of of ADP dad-10733 180 23 possible possible ADJ dad-10733 180 24 hand hand NOUN dad-10733 180 25 - - PUNCT dad-10733 180 26 crafted craft VERB dad-10733 180 27 system system NOUN dad-10733 180 28 states state NOUN dad-10733 180 29 ( ( PUNCT dad-10733 180 30 e.g. e.g. ADV dad-10733 180 31 hand hand NOUN dad-10733 180 32 - - PUNCT dad-10733 180 33 crafted craft VERB dad-10733 180 34 features feature NOUN dad-10733 180 35 describing describe VERB dad-10733 180 36 the the DET dad-10733 180 37 dialogue dialogue NOUN dad-10733 180 38 state state NOUN dad-10733 180 39 ) ) PUNCT dad-10733 180 40 . . PUNCT dad-10733 181 1 the the DET dad-10733 181 2 action action NOUN dad-10733 181 3 space space NOUN dad-10733 181 4 is be AUX dad-10733 181 5 also also ADV dad-10733 181 6 limited limit VERB dad-10733 181 7 to to ADP dad-10733 181 8 a a DET dad-10733 181 9 small small ADJ dad-10733 181 10 set set NOUN dad-10733 181 11 of of ADP dad-10733 181 12 pre pre ADJ dad-10733 181 13 - - ADJ dad-10733 181 14 defined define VERB dad-10733 181 15 responses response NOUN dad-10733 181 16 . . PUNCT dad-10733 182 1 this this PRON dad-10733 182 2 makes make VERB dad-10733 182 3 it it PRON dad-10733 182 4 possible possible ADJ dad-10733 182 5 to to PART dad-10733 182 6 apply apply VERB dad-10733 182 7 established establish VERB dad-10733 182 8 reinforcement reinforcement NOUN dad-10733 182 9 learning learning NOUN dad-10733 182 10 algorithms algorithm NOUN dad-10733 182 11 to to PART dad-10733 182 12 train train VERB dad-10733 182 13 them they PRON dad-10733 182 14 either either CCONJ dad-10733 182 15 online online ADV dad-10733 182 16 or or CCONJ dad-10733 182 17 offline offline ADJ dad-10733 182 18 , , PUNCT dad-10733 182 19 however however ADV dad-10733 182 20 it it PRON dad-10733 182 21 also also ADV dad-10733 182 22 severely severely ADV dad-10733 182 23 limits limit VERB dad-10733 182 24 their their PRON dad-10733 182 25 application application NOUN dad-10733 182 26 area area NOUN dad-10733 182 27 . . PUNCT dad-10733 183 1 as as ADP dad-10733 183 2 singh singh PROPN dad-10733 183 3 et et PROPN dad-10733 183 4 al al PROPN dad-10733 183 5 . . PUNCT dad-10733 184 1 ( ( PUNCT dad-10733 184 2 singh singh PROPN dad-10733 184 3 et et PROPN dad-10733 184 4 al al PROPN dad-10733 184 5 . . PROPN dad-10733 184 6 , , PUNCT dad-10733 184 7 2002 2002 NUM dad-10733 184 8 , , PUNCT dad-10733 184 9 p.5 p.5 X dad-10733 184 10 ) ) PUNCT dad-10733 184 11 remark remark NOUN dad-10733 184 12 : : PUNCT dad-10733 184 13 “ " PUNCT dad-10733 184 14 we we PRON dad-10733 184 15 view view VERB dad-10733 184 16 the the DET dad-10733 184 17 design design NOUN dad-10733 184 18 of of ADP dad-10733 184 19 an an DET dad-10733 184 20 appropriate appropriate ADJ dad-10733 184 21 state state NOUN dad-10733 184 22 space space NOUN dad-10733 184 23 as as ADP dad-10733 184 24 application application NOUN dad-10733 184 25 - - PUNCT dad-10733 184 26 dependent dependent ADJ dad-10733 184 27 , , PUNCT dad-10733 184 28 and and CCONJ dad-10733 184 29 a a DET dad-10733 184 30 task task NOUN dad-10733 184 31 for for ADP dad-10733 184 32 a a DET dad-10733 184 33 skilled skilled ADJ dad-10733 184 34 system system NOUN dad-10733 184 35 designer designer NOUN dad-10733 184 36 . . PUNCT dad-10733 184 37 ” " PUNCT dad-10733 185 1 3 3 X dad-10733 185 2 . . PUNCT dad-10733 185 3 dialogue dialogue NOUN dad-10733 185 4 interaction interaction NOUN dad-10733 185 5 types type NOUN dad-10733 185 6 & & CCONJ dad-10733 185 7 aspects aspect NOUN dad-10733 185 8 this this DET dad-10733 185 9 section section NOUN dad-10733 185 10 provides provide VERB dad-10733 185 11 a a DET dad-10733 185 12 high high ADJ dad-10733 185 13 - - PUNCT dad-10733 185 14 level level NOUN dad-10733 185 15 discussion discussion NOUN dad-10733 185 16 of of ADP dad-10733 185 17 different different ADJ dad-10733 185 18 types type NOUN dad-10733 185 19 of of ADP dad-10733 185 20 dialogue dialogue NOUN dad-10733 185 21 interactions interaction NOUN dad-10733 185 22 and and CCONJ dad-10733 185 23 their their PRON dad-10733 185 24 salient salient NOUN dad-10733 185 25 aspects aspect NOUN dad-10733 185 26 . . PUNCT dad-10733 186 1 the the DET dad-10733 186 2 categorization categorization NOUN dad-10733 186 3 of of ADP dad-10733 186 4 dialogues dialogue NOUN dad-10733 186 5 is be AUX dad-10733 186 6 useful useful ADJ dad-10733 186 7 for for ADP dad-10733 186 8 understanding understand VERB dad-10733 186 9 the the DET dad-10733 186 10 utility utility NOUN dad-10733 186 11 of of ADP dad-10733 186 12 various various ADJ dad-10733 186 13 datasets dataset NOUN dad-10733 186 14 for for ADP dad-10733 186 15 particular particular ADJ dad-10733 186 16 applications application NOUN dad-10733 186 17 , , PUNCT dad-10733 186 18 as as ADV dad-10733 186 19 well well ADV dad-10733 186 20 as as ADP dad-10733 186 21 for for ADP dad-10733 186 22 grouping group VERB dad-10733 186 23 these these DET dad-10733 186 24 datasets dataset NOUN dad-10733 186 25 together together ADV dad-10733 186 26 to to PART dad-10733 186 27 demonstrate demonstrate VERB dad-10733 186 28 available available ADJ dad-10733 186 29 corpora corpora PROPN dad-10733 186 30 in in ADP dad-10733 186 31 a a DET dad-10733 186 32 given give VERB dad-10733 186 33 area area NOUN dad-10733 186 34 . . PUNCT dad-10733 187 1 here here ADV dad-10733 187 2 , , PUNCT dad-10733 187 3 we we PRON dad-10733 187 4 discuss discuss VERB dad-10733 187 5 the the DET dad-10733 187 6 important important ADJ dad-10733 187 7 characteristics characteristic NOUN dad-10733 187 8 and and CCONJ dad-10733 187 9 distinctions distinction NOUN dad-10733 187 10 within within ADP dad-10733 187 11 dialogue dialogue NOUN dad-10733 187 12 corpora corpora PROPN dad-10733 187 13 : : PUNCT dad-10733 187 14 whether whether SCONJ dad-10733 187 15 a a DET dad-10733 187 16 corpus corpus NOUN dad-10733 187 17 is be AUX dad-10733 187 18 written write VERB dad-10733 187 19 , , PUNCT dad-10733 187 20 spoken speak VERB dad-10733 187 21 , , PUNCT dad-10733 187 22 or or CCONJ dad-10733 187 23 multi multi ADJ dad-10733 187 24 - - ADJ dad-10733 187 25 modal modal ADJ dad-10733 187 26 ; ; PUNCT dad-10733 187 27 whether whether SCONJ dad-10733 187 28 a a DET dad-10733 187 29 corpus corpus NOUN dad-10733 187 30 features feature VERB dad-10733 187 31 human human ADJ dad-10733 187 32 - - PUNCT dad-10733 187 33 human human NOUN dad-10733 187 34 interactions interaction NOUN dad-10733 187 35 or or CCONJ dad-10733 187 36 human human ADJ dad-10733 187 37 - - PUNCT dad-10733 187 38 machine machine NOUN dad-10733 187 39 interactions interaction NOUN dad-10733 187 40 ; ; PUNCT dad-10733 187 41 whether whether SCONJ dad-10733 187 42 the the DET dad-10733 187 43 corpus corpus NOUN dad-10733 187 44 features feature VERB dad-10733 187 45 constrained constrain VERB dad-10733 187 46 or or CCONJ dad-10733 187 47 unconstrained unconstrained ADJ dad-10733 187 48 dialogues dialogue NOUN dad-10733 187 49 ; ; PUNCT dad-10733 187 50 whether whether SCONJ dad-10733 187 51 the the DET dad-10733 187 52 corpus corpus NOUN dad-10733 187 53 includes include VERB dad-10733 187 54 topic topic NOUN dad-10733 187 55 oriented orient VERB dad-10733 187 56 or or CCONJ dad-10733 187 57 goal goal NOUN dad-10733 187 58 driven drive VERB dad-10733 187 59 dialogues dialogue NOUN dad-10733 187 60 ; ; PUNCT dad-10733 187 61 whether whether SCONJ dad-10733 187 62 the the DET dad-10733 187 63 dialogues dialogue NOUN dad-10733 187 64 are be AUX dad-10733 187 65 fictional fictional ADJ dad-10733 187 66 or or CCONJ dad-10733 187 67 scripted script VERB dad-10733 187 68 ; ; PUNCT dad-10733 187 69 corpus corpus NOUN dad-10733 187 70 size size NOUN dad-10733 187 71 . . PUNCT dad-10733 188 1 3.1 3.1 NUM dad-10733 188 2 written write VERB dad-10733 188 3 , , PUNCT dad-10733 188 4 spoken spoken ADJ dad-10733 188 5 & & CCONJ dad-10733 188 6 multi multi ADJ dad-10733 188 7 - - ADJ dad-10733 188 8 modal modal ADJ dad-10733 188 9 corpora corpora VERB dad-10733 188 10 an an DET dad-10733 188 11 important important ADJ dad-10733 188 12 distinction distinction NOUN dad-10733 188 13 between between ADP dad-10733 188 14 dialogue dialogue NOUN dad-10733 188 15 corpora corpora NOUN dad-10733 188 16 is be AUX dad-10733 188 17 whether whether SCONJ dad-10733 188 18 participants participant NOUN dad-10733 188 19 ( ( PUNCT dad-10733 188 20 interlocutors interlocutor NOUN dad-10733 188 21 ) ) PUNCT dad-10733 188 22 interact interact VERB dad-10733 188 23 through through ADP dad-10733 188 24 written write VERB dad-10733 188 25 language language NOUN dad-10733 188 26 , , PUNCT dad-10733 188 27 spoken spoken ADJ dad-10733 188 28 language language NOUN dad-10733 188 29 , , PUNCT dad-10733 188 30 or or CCONJ dad-10733 188 31 in in ADP dad-10733 188 32 a a DET dad-10733 188 33 multi multi ADJ dad-10733 188 34 - - ADJ dad-10733 188 35 modal modal ADJ dad-10733 188 36 setting setting NOUN dad-10733 188 37 ( ( PUNCT dad-10733 188 38 e.g. e.g. ADV dad-10733 188 39 using use VERB dad-10733 188 40 both both PRON dad-10733 188 41 speech speech NOUN dad-10733 188 42 and and CCONJ dad-10733 188 43 visual visual ADJ dad-10733 188 44 modalities modality NOUN dad-10733 188 45 ) ) PUNCT dad-10733 188 46 . . PUNCT dad-10733 189 1 written write VERB dad-10733 189 2 and and CCONJ dad-10733 189 3 spoken spoken ADJ dad-10733 189 4 language language NOUN dad-10733 189 5 differ differ VERB dad-10733 189 6 substantially substantially ADV dad-10733 189 7 w.r.t w.r.t VERB dad-10733 189 8 . . PUNCT dad-10733 190 1 their their PRON dad-10733 190 2 linguistic linguistic ADJ dad-10733 190 3 properties property NOUN dad-10733 190 4 . . PUNCT dad-10733 191 1 9 9 NUM dad-10733 191 2 serban serban PROPN dad-10733 191 3 , , PUNCT dad-10733 191 4 lowe lowe PROPN dad-10733 191 5 , , PUNCT dad-10733 191 6 henderson henderson PROPN dad-10733 191 7 , , PUNCT dad-10733 191 8 charlin charlin PROPN dad-10733 191 9 and and CCONJ dad-10733 191 10 pineau pineau PROPN dad-10733 191 11 spoken speak VERB dad-10733 191 12 language language NOUN dad-10733 191 13 tends tend VERB dad-10733 191 14 to to PART dad-10733 191 15 be be AUX dad-10733 191 16 less less ADV dad-10733 191 17 formal formal ADJ dad-10733 191 18 , , PUNCT dad-10733 191 19 containing contain VERB dad-10733 191 20 lower low ADJ dad-10733 191 21 information information NOUN dad-10733 191 22 content content NOUN dad-10733 191 23 and and CCONJ dad-10733 191 24 many many ADJ dad-10733 191 25 more more ADJ dad-10733 191 26 pronouns pronoun NOUN dad-10733 191 27 than than ADP dad-10733 191 28 written write VERB dad-10733 191 29 language language NOUN dad-10733 191 30 ( ( PUNCT dad-10733 191 31 carter carter NOUN dad-10733 191 32 and and CCONJ dad-10733 191 33 mccarthy mccarthy PROPN dad-10733 191 34 , , PUNCT dad-10733 191 35 2006 2006 NUM dad-10733 191 36 ; ; PUNCT dad-10733 191 37 biber biber PROPN dad-10733 191 38 and and CCONJ dad-10733 191 39 finegan finegan ADJ dad-10733 191 40 , , PUNCT dad-10733 191 41 2001 2001 NUM dad-10733 191 42 , , PUNCT dad-10733 191 43 1986 1986 NUM dad-10733 191 44 ) ) PUNCT dad-10733 191 45 . . PUNCT dad-10733 192 1 in in ADP dad-10733 192 2 particular particular ADJ dad-10733 192 3 , , PUNCT dad-10733 192 4 the the DET dad-10733 192 5 differences difference NOUN dad-10733 192 6 are be AUX dad-10733 192 7 magnified magnify VERB dad-10733 192 8 when when SCONJ dad-10733 192 9 written write VERB dad-10733 192 10 language language NOUN dad-10733 192 11 is be AUX dad-10733 192 12 compared compare VERB dad-10733 192 13 to to PART dad-10733 192 14 spoken speak VERB dad-10733 192 15 face face NOUN dad-10733 192 16 - - PUNCT dad-10733 192 17 toface toface NOUN dad-10733 192 18 conversations conversation NOUN dad-10733 192 19 , , PUNCT dad-10733 192 20 which which PRON dad-10733 192 21 are be AUX dad-10733 192 22 multi multi ADJ dad-10733 192 23 - - ADJ dad-10733 192 24 modal modal ADJ dad-10733 192 25 and and CCONJ dad-10733 192 26 highly highly ADV dad-10733 192 27 socially socially ADV dad-10733 192 28 situated situate VERB dad-10733 192 29 . . PUNCT dad-10733 193 1 as as SCONJ dad-10733 193 2 biber biber PROPN dad-10733 193 3 and and CCONJ dad-10733 193 4 finegan finegan ADJ dad-10733 193 5 ( ( PUNCT dad-10733 193 6 1986 1986 NUM dad-10733 193 7 ) ) PUNCT dad-10733 193 8 observed observe VERB dad-10733 193 9 , , PUNCT dad-10733 193 10 pronouns pronoun NOUN dad-10733 193 11 , , PUNCT dad-10733 193 12 questions question NOUN dad-10733 193 13 , , PUNCT dad-10733 193 14 and and CCONJ dad-10733 193 15 contradictions contradiction NOUN dad-10733 193 16 , , PUNCT dad-10733 193 17 as as ADV dad-10733 193 18 well well ADV dad-10733 193 19 as as ADP dad-10733 193 20 that that DET dad-10733 193 21 - - PUNCT dad-10733 193 22 clauses clause NOUN dad-10733 193 23 and and CCONJ dad-10733 193 24 if if SCONJ dad-10733 193 25 - - PUNCT dad-10733 193 26 clauses clause NOUN dad-10733 193 27 , , PUNCT dad-10733 193 28 appear appear VERB dad-10733 193 29 with with ADP dad-10733 193 30 a a DET dad-10733 193 31 high high ADJ dad-10733 193 32 frequency frequency NOUN dad-10733 193 33 in in ADP dad-10733 193 34 face face NOUN dad-10733 193 35 - - PUNCT dad-10733 193 36 to to ADP dad-10733 193 37 - - PUNCT dad-10733 193 38 face face NOUN dad-10733 193 39 conversations conversation NOUN dad-10733 193 40 . . PUNCT dad-10733 194 1 forchini forchini PROPN dad-10733 194 2 ( ( PUNCT dad-10733 194 3 2012 2012 NUM dad-10733 194 4 ) ) PUNCT dad-10733 194 5 summarized summarize VERB dad-10733 194 6 these these DET dad-10733 194 7 differences difference NOUN dad-10733 194 8 : : PUNCT dad-10733 194 9 “ " PUNCT dad-10733 194 10 ... ... PUNCT dad-10733 194 11 studies study NOUN dad-10733 194 12 show show VERB dad-10733 194 13 that that SCONJ dad-10733 194 14 face face NOUN dad-10733 194 15 - - PUNCT dad-10733 194 16 to to ADP dad-10733 194 17 - - PUNCT dad-10733 194 18 face face NOUN dad-10733 194 19 conversation conversation NOUN dad-10733 194 20 is be AUX dad-10733 194 21 interpersonal interpersonal ADJ dad-10733 194 22 , , PUNCT dad-10733 194 23 situation situation NOUN dad-10733 194 24 - - PUNCT dad-10733 194 25 dependent dependent ADJ dad-10733 194 26 has have VERB dad-10733 194 27 no no DET dad-10733 194 28 narrative narrative NOUN dad-10733 194 29 concern concern NOUN dad-10733 194 30 or or CCONJ dad-10733 194 31 as as ADP dad-10733 194 32 biber biber PROPN dad-10733 194 33 and and CCONJ dad-10733 194 34 finegan finegan ADJ dad-10733 194 35 ( ( PUNCT dad-10733 194 36 1986 1986 NUM dad-10733 194 37 ) ) PUNCT dad-10733 194 38 put put VERB dad-10733 194 39 it it PRON dad-10733 194 40 , , PUNCT dad-10733 194 41 is be AUX dad-10733 194 42 a a DET dad-10733 194 43 highly highly ADV dad-10733 194 44 interactive interactive ADJ dad-10733 194 45 , , PUNCT dad-10733 194 46 situated situated ADJ dad-10733 194 47 and and CCONJ dad-10733 194 48 immediate immediate ADJ dad-10733 194 49 text text NOUN dad-10733 194 50 type type NOUN dad-10733 194 51 ... ... PUNCT dad-10733 194 52 ” " PUNCT dad-10733 195 1 due due ADP dad-10733 195 2 to to ADP dad-10733 195 3 these these DET dad-10733 195 4 differences difference NOUN dad-10733 195 5 between between ADP dad-10733 195 6 spoken spoken ADJ dad-10733 195 7 and and CCONJ dad-10733 195 8 written write VERB dad-10733 195 9 language language NOUN dad-10733 195 10 , , PUNCT dad-10733 195 11 we we PRON dad-10733 195 12 emphasize emphasize VERB dad-10733 195 13 the the DET dad-10733 195 14 distinction distinction NOUN dad-10733 195 15 between between ADP dad-10733 195 16 dialogue dialogue NOUN dad-10733 195 17 corpora corpora PROPN dad-10733 195 18 in in ADP dad-10733 195 19 written write VERB dad-10733 195 20 and and CCONJ dad-10733 195 21 spoken spoken ADJ dad-10733 195 22 language language NOUN dad-10733 195 23 in in ADP dad-10733 195 24 the the DET dad-10733 195 25 following follow VERB dad-10733 195 26 sections section NOUN dad-10733 195 27 . . PUNCT dad-10733 196 1 similarly similarly ADV dad-10733 196 2 , , PUNCT dad-10733 196 3 dialogues dialogue NOUN dad-10733 196 4 involving involve VERB dad-10733 196 5 visual visual ADJ dad-10733 196 6 and and CCONJ dad-10733 196 7 other other ADJ dad-10733 196 8 modalities modality NOUN dad-10733 196 9 differ differ VERB dad-10733 196 10 from from ADP dad-10733 196 11 dialogues dialogue NOUN dad-10733 196 12 without without ADP dad-10733 196 13 these these DET dad-10733 196 14 modalities modality NOUN dad-10733 196 15 ( ( PUNCT dad-10733 196 16 card card NOUN dad-10733 196 17 et et PROPN dad-10733 196 18 al al PROPN dad-10733 196 19 . . PROPN dad-10733 196 20 , , PUNCT dad-10733 196 21 1983 1983 NUM dad-10733 196 22 ; ; PUNCT dad-10733 196 23 goodwin goodwin PROPN dad-10733 196 24 , , PUNCT dad-10733 196 25 1981 1981 NUM dad-10733 196 26 ) ) PUNCT dad-10733 196 27 . . PUNCT dad-10733 197 1 when when SCONJ dad-10733 197 2 a a DET dad-10733 197 3 visual visual ADJ dad-10733 197 4 modality modality NOUN dad-10733 197 5 is be AUX dad-10733 197 6 available available ADJ dad-10733 197 7 — — PUNCT dad-10733 197 8 for for ADP dad-10733 197 9 example example NOUN dad-10733 197 10 , , PUNCT dad-10733 197 11 when when SCONJ dad-10733 197 12 two two NUM dad-10733 197 13 human human ADJ dad-10733 197 14 interlocutors interlocutor NOUN dad-10733 197 15 converse converse NOUN dad-10733 197 16 face face NOUN dad-10733 197 17 - - PUNCT dad-10733 197 18 to to ADP dad-10733 197 19 - - PUNCT dad-10733 197 20 face face NOUN dad-10733 197 21 — — PUNCT dad-10733 197 22 body body NOUN dad-10733 197 23 language language NOUN dad-10733 197 24 and and CCONJ dad-10733 197 25 eye eye NOUN dad-10733 197 26 gaze gaze NOUN dad-10733 197 27 have have VERB dad-10733 197 28 a a DET dad-10733 197 29 significant significant ADJ dad-10733 197 30 impact impact NOUN dad-10733 197 31 on on ADP dad-10733 197 32 what what PRON dad-10733 197 33 is be AUX dad-10733 197 34 said say VERB dad-10733 197 35 and and CCONJ dad-10733 197 36 how how SCONJ dad-10733 197 37 it it PRON dad-10733 197 38 is be AUX dad-10733 197 39 said say VERB dad-10733 197 40 ( ( PUNCT dad-10733 197 41 gibson gibson PROPN dad-10733 197 42 and and CCONJ dad-10733 197 43 pick pick PROPN dad-10733 197 44 , , PUNCT dad-10733 197 45 1963 1963 NUM dad-10733 197 46 ; ; PUNCT dad-10733 197 47 lord lord PROPN dad-10733 197 48 and and CCONJ dad-10733 197 49 haith haith NOUN dad-10733 197 50 , , PUNCT dad-10733 197 51 1974 1974 NUM dad-10733 197 52 ; ; PUNCT dad-10733 197 53 cooper cooper NOUN dad-10733 197 54 , , PUNCT dad-10733 197 55 1974 1974 NUM dad-10733 197 56 ; ; PUNCT dad-10733 197 57 chartrand chartrand NOUN dad-10733 197 58 and and CCONJ dad-10733 197 59 bargh bargh PROPN dad-10733 197 60 , , PUNCT dad-10733 197 61 1999 1999 NUM dad-10733 197 62 ; ; PUNCT dad-10733 197 63 de de PROPN dad-10733 197 64 kok kok PROPN dad-10733 197 65 et et PROPN dad-10733 197 66 al al PROPN dad-10733 197 67 . . PROPN dad-10733 197 68 , , PUNCT dad-10733 197 69 2013 2013 NUM dad-10733 197 70 ) ) PUNCT dad-10733 197 71 . . PUNCT dad-10733 198 1 aside aside ADV dad-10733 198 2 from from ADP dad-10733 198 3 the the DET dad-10733 198 4 visual visual ADJ dad-10733 198 5 modality modality NOUN dad-10733 198 6 , , PUNCT dad-10733 198 7 dialogue dialogue NOUN dad-10733 198 8 systems system NOUN dad-10733 198 9 may may AUX dad-10733 198 10 also also ADV dad-10733 198 11 incorporate incorporate VERB dad-10733 198 12 other other ADJ dad-10733 198 13 situational situational ADJ dad-10733 198 14 modalities modality NOUN dad-10733 198 15 , , PUNCT dad-10733 198 16 including include VERB dad-10733 198 17 aspects aspect NOUN dad-10733 198 18 of of ADP dad-10733 198 19 virtual virtual ADJ dad-10733 198 20 environments environment NOUN dad-10733 198 21 ( ( PUNCT dad-10733 198 22 rickel rickel NOUN dad-10733 198 23 and and CCONJ dad-10733 198 24 johnson johnson PROPN dad-10733 198 25 , , PUNCT dad-10733 198 26 1999 1999 NUM dad-10733 198 27 ; ; PUNCT dad-10733 198 28 traum traum PROPN dad-10733 198 29 and and CCONJ dad-10733 198 30 rickel rickel NOUN dad-10733 198 31 , , PUNCT dad-10733 198 32 2002 2002 NUM dad-10733 198 33 ) ) PUNCT dad-10733 198 34 and and CCONJ dad-10733 198 35 user user NOUN dad-10733 198 36 profiles profile NOUN dad-10733 198 37 ( ( PUNCT dad-10733 198 38 li li PROPN dad-10733 198 39 et et PROPN dad-10733 198 40 al al PROPN dad-10733 198 41 . . PROPN dad-10733 198 42 , , PUNCT dad-10733 198 43 2016 2016 NUM dad-10733 198 44 ) ) PUNCT dad-10733 198 45 . . PUNCT dad-10733 199 1 3.2 3.2 NUM dad-10733 199 2 human human NOUN dad-10733 199 3 - - PUNCT dad-10733 199 4 human human NOUN dad-10733 199 5 vs. vs. ADP dad-10733 199 6 human human NOUN dad-10733 199 7 - - PUNCT dad-10733 199 8 machine machine NOUN dad-10733 199 9 corpora corpora VERB dad-10733 199 10 another another DET dad-10733 199 11 salient salient NOUN dad-10733 199 12 distinction distinction NOUN dad-10733 199 13 between between ADP dad-10733 199 14 dialogue dialogue NOUN dad-10733 199 15 datasets dataset NOUN dad-10733 199 16 resides reside VERB dad-10733 199 17 in in ADP dad-10733 199 18 the the DET dad-10733 199 19 types type NOUN dad-10733 199 20 of of ADP dad-10733 199 21 interlocutors interlocutor NOUN dad-10733 199 22 — — PUNCT dad-10733 199 23 notably notably ADV dad-10733 199 24 , , PUNCT dad-10733 199 25 whether whether SCONJ dad-10733 199 26 it it PRON dad-10733 199 27 involves involve VERB dad-10733 199 28 interactions interaction NOUN dad-10733 199 29 between between ADP dad-10733 199 30 two two NUM dad-10733 199 31 humans human NOUN dad-10733 199 32 , , PUNCT dad-10733 199 33 or or CCONJ dad-10733 199 34 between between ADP dad-10733 199 35 a a DET dad-10733 199 36 human human NOUN dad-10733 199 37 and and CCONJ dad-10733 199 38 a a DET dad-10733 199 39 computer.2 computer.2 NOUN dad-10733 199 40 the the DET dad-10733 199 41 distinction distinction NOUN dad-10733 199 42 is be AUX dad-10733 199 43 important important ADJ dad-10733 199 44 because because SCONJ dad-10733 199 45 current current ADJ dad-10733 199 46 artificial artificial ADJ dad-10733 199 47 dialogue dialogue NOUN dad-10733 199 48 systems system NOUN dad-10733 199 49 are be AUX dad-10733 199 50 significantly significantly ADV dad-10733 199 51 constrained constrain VERB dad-10733 199 52 . . PUNCT dad-10733 200 1 these these DET dad-10733 200 2 systems system NOUN dad-10733 200 3 do do AUX dad-10733 200 4 not not PART dad-10733 200 5 produce produce VERB dad-10733 200 6 nearly nearly ADV dad-10733 200 7 the the DET dad-10733 200 8 same same ADJ dad-10733 200 9 distribution distribution NOUN dad-10733 200 10 of of ADP dad-10733 200 11 possible possible ADJ dad-10733 200 12 responses response NOUN dad-10733 200 13 as as SCONJ dad-10733 200 14 humans human NOUN dad-10733 200 15 do do VERB dad-10733 200 16 under under ADP dad-10733 200 17 equivalent equivalent ADJ dad-10733 200 18 circumstances circumstance NOUN dad-10733 200 19 . . PUNCT dad-10733 201 1 as as SCONJ dad-10733 201 2 stated state VERB dad-10733 201 3 by by ADP dad-10733 201 4 williams williams PROPN dad-10733 201 5 and and CCONJ dad-10733 201 6 young young ADJ dad-10733 201 7 ( ( PUNCT dad-10733 201 8 2007 2007 NUM dad-10733 201 9 ): ): PUNCT dad-10733 201 10 ( ( PUNCT dad-10733 201 11 human human NOUN dad-10733 201 12 - - PUNCT dad-10733 201 13 human human ADJ dad-10733 201 14 conversation conversation NOUN dad-10733 201 15 ) ) PUNCT dad-10733 201 16 does do AUX dad-10733 201 17 not not PART dad-10733 201 18 contain contain VERB dad-10733 201 19 the the DET dad-10733 201 20 same same ADJ dad-10733 201 21 distribution distribution NOUN dad-10733 201 22 of of ADP dad-10733 201 23 understanding understand VERB dad-10733 201 24 errors error NOUN dad-10733 201 25 , , PUNCT dad-10733 201 26 and and CCONJ dad-10733 201 27 human human ADJ dad-10733 201 28 - - PUNCT dad-10733 201 29 human human ADJ dad-10733 201 30 turn turn NOUN dad-10733 201 31 - - PUNCT dad-10733 201 32 taking taking NOUN dad-10733 201 33 is be AUX dad-10733 201 34 much much ADV dad-10733 201 35 richer rich ADJ dad-10733 201 36 than than ADP dad-10733 201 37 human human ADJ dad-10733 201 38 - - PUNCT dad-10733 201 39 machine machine NOUN dad-10733 201 40 dialog dialog NOUN dad-10733 201 41 . . PUNCT dad-10733 202 1 as as ADP dad-10733 202 2 a a DET dad-10733 202 3 result result NOUN dad-10733 202 4 , , PUNCT dad-10733 202 5 human human ADJ dad-10733 202 6 - - PUNCT dad-10733 202 7 machine machine NOUN dad-10733 202 8 dialogue dialogue NOUN dad-10733 202 9 exhibits exhibit VERB dad-10733 202 10 very very ADV dad-10733 202 11 different different ADJ dad-10733 202 12 traits trait NOUN dad-10733 202 13 than than ADP dad-10733 202 14 human human ADJ dad-10733 202 15 - - PUNCT dad-10733 202 16 human human ADJ dad-10733 202 17 dialogue dialogue NOUN dad-10733 202 18 ( ( PUNCT dad-10733 202 19 doran doran PROPN dad-10733 202 20 et et PROPN dad-10733 202 21 al al PROPN dad-10733 202 22 . . PROPN dad-10733 202 23 , , PUNCT dad-10733 202 24 2001 2001 NUM dad-10733 202 25 ; ; PUNCT dad-10733 202 26 moore moore PROPN dad-10733 202 27 and and CCONJ dad-10733 202 28 browning browning NOUN dad-10733 202 29 , , PUNCT dad-10733 202 30 1992 1992 NUM dad-10733 202 31 ) ) PUNCT dad-10733 202 32 . . PUNCT dad-10733 203 1 the the DET dad-10733 203 2 expectation expectation NOUN dad-10733 203 3 a a DET dad-10733 203 4 human human ADJ dad-10733 203 5 interlocutor interlocutor NOUN dad-10733 203 6 begins begin VERB dad-10733 203 7 with with ADP dad-10733 203 8 , , PUNCT dad-10733 203 9 and and CCONJ dad-10733 203 10 the the DET dad-10733 203 11 interface interface NOUN dad-10733 203 12 through through ADP dad-10733 203 13 which which PRON dad-10733 203 14 they they PRON dad-10733 203 15 interact interact VERB dad-10733 203 16 , , PUNCT dad-10733 203 17 also also ADV dad-10733 203 18 affect affect VERB dad-10733 203 19 the the DET dad-10733 203 20 nature nature NOUN dad-10733 203 21 of of ADP dad-10733 203 22 the the DET dad-10733 203 23 conversation conversation NOUN dad-10733 203 24 ( ( PUNCT dad-10733 203 25 jonsson jonsson NOUN dad-10733 203 26 and and CCONJ dad-10733 203 27 dahlback dahlback PROPN dad-10733 203 28 , , PUNCT dad-10733 203 29 1988 1988 NUM dad-10733 203 30 ) ) PUNCT dad-10733 203 31 . . PUNCT dad-10733 204 1 for for ADP dad-10733 204 2 goal goal NOUN dad-10733 204 3 - - PUNCT dad-10733 204 4 driven drive VERB dad-10733 204 5 settings setting NOUN dad-10733 204 6 , , PUNCT dad-10733 204 7 williams williams PROPN dad-10733 204 8 and and CCONJ dad-10733 204 9 young young ADJ dad-10733 204 10 ( ( PUNCT dad-10733 204 11 2007 2007 NUM dad-10733 204 12 ) ) PUNCT dad-10733 204 13 have have AUX dad-10733 204 14 argued argue VERB dad-10733 204 15 against against ADP dad-10733 204 16 building build VERB dad-10733 204 17 data data NOUN dad-10733 204 18 - - PUNCT dad-10733 204 19 driven drive VERB dad-10733 204 20 dialogue dialogue NOUN dad-10733 204 21 systems system NOUN dad-10733 204 22 using use VERB dad-10733 204 23 human human ADJ dad-10733 204 24 - - PUNCT dad-10733 204 25 human human ADJ dad-10733 204 26 dialogues dialogue NOUN dad-10733 204 27 , , PUNCT dad-10733 204 28 as as SCONJ dad-10733 204 29 it it PRON dad-10733 204 30 contains contain VERB dad-10733 204 31 a a DET dad-10733 204 32 different different ADJ dad-10733 204 33 distribution distribution NOUN dad-10733 204 34 of of ADP dad-10733 204 35 understanding understand VERB dad-10733 204 36 errors error NOUN dad-10733 204 37 . . PUNCT dad-10733 205 1 this this DET dad-10733 205 2 line line NOUN dad-10733 205 3 of of ADP dad-10733 205 4 reasoning reasoning NOUN dad-10733 205 5 seems seem VERB dad-10733 205 6 particularly particularly ADV dad-10733 205 7 applicable applicable ADJ dad-10733 205 8 to to ADP dad-10733 205 9 spoken speak VERB dad-10733 205 10 dialogue dialogue NOUN dad-10733 205 11 systems system NOUN dad-10733 205 12 , , PUNCT dad-10733 205 13 where where SCONJ dad-10733 205 14 speech speech NOUN dad-10733 205 15 recognition recognition NOUN dad-10733 205 16 errors error NOUN dad-10733 205 17 can can AUX dad-10733 205 18 have have VERB dad-10733 205 19 a a DET dad-10733 205 20 critical critical ADJ dad-10733 205 21 impact impact NOUN dad-10733 205 22 on on ADP dad-10733 205 23 performance performance NOUN dad-10733 205 24 and and CCONJ dad-10733 205 25 therefore therefore ADV dad-10733 205 26 must must AUX dad-10733 205 27 be be AUX dad-10733 205 28 taken take VERB dad-10733 205 29 into into ADP dad-10733 205 30 account account NOUN dad-10733 205 31 when when SCONJ dad-10733 205 32 learning learn VERB dad-10733 205 33 the the DET dad-10733 205 34 dialogue dialogue NOUN dad-10733 205 35 model model NOUN dad-10733 205 36 . . PUNCT dad-10733 206 1 the the DET dad-10733 206 2 argument argument NOUN dad-10733 206 3 is be AUX dad-10733 206 4 also also ADV dad-10733 206 5 relevant relevant ADJ dad-10733 206 6 to to ADP dad-10733 206 7 goal goal NOUN dad-10733 206 8 - - PUNCT dad-10733 206 9 driven drive VERB dad-10733 206 10 dialogue dialogue NOUN dad-10733 206 11 systems system NOUN dad-10733 206 12 , , PUNCT dad-10733 206 13 where where SCONJ dad-10733 206 14 an an DET dad-10733 206 15 effective effective ADJ dad-10733 206 16 dialogue dialogue NOUN dad-10733 206 17 model model NOUN dad-10733 206 18 can can AUX dad-10733 206 19 often often ADV dad-10733 206 20 be be AUX dad-10733 206 21 learned learn VERB dad-10733 206 22 using use VERB dad-10733 206 23 reinforcement reinforcement NOUN dad-10733 206 24 learning learning NOUN dad-10733 206 25 techniques technique NOUN dad-10733 206 26 . . PUNCT dad-10733 207 1 williams williams PROPN dad-10733 207 2 and and CCONJ dad-10733 207 3 young young ADJ dad-10733 207 4 ( ( PUNCT dad-10733 207 5 2007 2007 NUM dad-10733 207 6 ) ) PUNCT dad-10733 207 7 also also ADV dad-10733 207 8 argue argue VERB dad-10733 207 9 against against ADP dad-10733 207 10 learning learn VERB dad-10733 207 11 from from ADP dad-10733 207 12 corpora corpora PROPN dad-10733 207 13 generated generate VERB dad-10733 207 14 between between ADP dad-10733 207 15 humans human NOUN dad-10733 207 16 and and CCONJ dad-10733 207 17 existing exist VERB dad-10733 207 18 dialogue dialogue NOUN dad-10733 207 19 systems system NOUN dad-10733 207 20 , , PUNCT dad-10733 207 21 as as SCONJ dad-10733 207 22 the the DET dad-10733 207 23 trained train VERB dad-10733 207 24 dialogue dialogue NOUN dad-10733 207 25 system system NOUN dad-10733 207 26 would would AUX dad-10733 207 27 simply simply ADV dad-10733 207 28 learn learn VERB dad-10733 207 29 to to PART dad-10733 207 30 approximate approximate VERB dad-10733 207 31 the the DET dad-10733 207 32 policy policy NOUN dad-10733 207 33 of of ADP dad-10733 207 34 the the DET dad-10733 207 35 spoken spoken ADJ dad-10733 207 36 dialogue dialogue NOUN dad-10733 207 37 system system NOUN dad-10733 207 38 . . PUNCT dad-10733 208 1 thus thus ADV dad-10733 208 2 , , PUNCT dad-10733 208 3 if if SCONJ dad-10733 208 4 one one NUM dad-10733 208 5 ’s ’s PART dad-10733 208 6 goal goal NOUN dad-10733 208 7 is be AUX dad-10733 208 8 to to PART dad-10733 208 9 develop develop VERB dad-10733 208 10 a a DET dad-10733 208 11 dialogue dialogue NOUN dad-10733 208 12 system system NOUN dad-10733 208 13 that that PRON dad-10733 208 14 can can AUX dad-10733 208 15 interact interact VERB dad-10733 208 16 with with ADP dad-10733 208 17 real real ADJ dad-10733 208 18 users user NOUN dad-10733 208 19 , , PUNCT dad-10733 208 20 the the DET dad-10733 208 21 most most ADV dad-10733 208 22 effective effective ADJ dad-10733 208 23 strategy strategy NOUN dad-10733 208 24 may may AUX dad-10733 208 25 be be AUX dad-10733 208 26 learning learn VERB dad-10733 208 27 online online ADV dad-10733 208 28 through through ADP dad-10733 208 29 interaction interaction NOUN dad-10733 208 30 with with ADP dad-10733 208 31 the the DET dad-10733 208 32 users user NOUN dad-10733 208 33 . . PUNCT dad-10733 209 1 for for ADP dad-10733 209 2 example example NOUN dad-10733 209 3 , , PUNCT dad-10733 209 4 there there ADV dad-10733 209 5 2 2 NUM dad-10733 209 6 . . PUNCT dad-10733 209 7 machine machine NOUN dad-10733 209 8 - - PUNCT dad-10733 209 9 machine machine NOUN dad-10733 209 10 dialogue dialogue NOUN dad-10733 209 11 corpora corpora NOUN dad-10733 209 12 are be AUX dad-10733 209 13 not not PART dad-10733 209 14 of of ADP dad-10733 209 15 interest interest NOUN dad-10733 209 16 to to ADP dad-10733 209 17 us we PRON dad-10733 209 18 , , PUNCT dad-10733 209 19 because because SCONJ dad-10733 209 20 they they PRON dad-10733 209 21 typically typically ADV dad-10733 209 22 differ differ VERB dad-10733 209 23 significantly significantly ADV dad-10733 209 24 from from ADP dad-10733 209 25 natural natural ADJ dad-10733 209 26 human human ADJ dad-10733 209 27 language language NOUN dad-10733 209 28 . . PUNCT dad-10733 210 1 furthermore furthermore ADV dad-10733 210 2 , , PUNCT dad-10733 210 3 user user NOUN dad-10733 210 4 simulation simulation NOUN dad-10733 210 5 models model NOUN dad-10733 210 6 are be AUX dad-10733 210 7 outside outside ADP dad-10733 210 8 the the DET dad-10733 210 9 scope scope NOUN dad-10733 210 10 of of ADP dad-10733 210 11 this this DET dad-10733 210 12 survey survey NOUN dad-10733 210 13 . . PUNCT dad-10733 211 1 10 10 NUM dad-10733 211 2 a a DET dad-10733 211 3 survey survey NOUN dad-10733 211 4 of of ADP dad-10733 211 5 available available ADJ dad-10733 211 6 corpora corpora PROPN dad-10733 211 7 for for ADP dad-10733 211 8 building build VERB dad-10733 211 9 data data NOUN dad-10733 211 10 - - PUNCT dad-10733 211 11 driven drive VERB dad-10733 211 12 dialogue dialogue NOUN dad-10733 211 13 systems system NOUN dad-10733 211 14 exists exist VERB dad-10733 211 15 useful useful ADJ dad-10733 211 16 human human NOUN dad-10733 211 17 - - PUNCT dad-10733 211 18 machine machine NOUN dad-10733 211 19 corpora corpora NOUN dad-10733 211 20 where where SCONJ dad-10733 211 21 the the DET dad-10733 211 22 interacting interact VERB dad-10733 211 23 machine machine NOUN dad-10733 211 24 uses use VERB dad-10733 211 25 a a DET dad-10733 211 26 stochastic stochastic ADJ dad-10733 211 27 policy policy NOUN dad-10733 211 28 that that PRON dad-10733 211 29 can can AUX dad-10733 211 30 generate generate VERB dad-10733 211 31 sufficient sufficient ADJ dad-10733 211 32 coverage coverage NOUN dad-10733 211 33 of of ADP dad-10733 211 34 the the DET dad-10733 211 35 task task NOUN dad-10733 211 36 ( ( PUNCT dad-10733 211 37 e.g. e.g. ADV dad-10733 211 38 enough enough ADJ dad-10733 211 39 good good ADJ dad-10733 211 40 and and CCONJ dad-10733 211 41 enough enough ADJ dad-10733 211 42 bad bad ADJ dad-10733 211 43 dialogue dialogue NOUN dad-10733 211 44 examples example NOUN dad-10733 211 45 ) ) PUNCT dad-10733 211 46 to to PART dad-10733 211 47 allow allow VERB dad-10733 211 48 an an DET dad-10733 211 49 effective effective ADJ dad-10733 211 50 dialogue dialogue NOUN dad-10733 211 51 model model NOUN dad-10733 211 52 to to PART dad-10733 211 53 be be AUX dad-10733 211 54 learned learn VERB dad-10733 211 55 . . PUNCT dad-10733 212 1 in in ADP dad-10733 212 2 this this DET dad-10733 212 3 case case NOUN dad-10733 212 4 , , PUNCT dad-10733 212 5 the the DET dad-10733 212 6 goal goal NOUN dad-10733 212 7 is be AUX dad-10733 212 8 to to PART dad-10733 212 9 learn learn VERB dad-10733 212 10 a a DET dad-10733 212 11 policy policy NOUN dad-10733 212 12 that that PRON dad-10733 212 13 is be AUX dad-10733 212 14 eventually eventually ADV dad-10733 212 15 better well ADJ dad-10733 212 16 than than ADP dad-10733 212 17 the the DET dad-10733 212 18 original original ADJ dad-10733 212 19 stochastic stochastic ADJ dad-10733 212 20 policy policy NOUN dad-10733 212 21 used use VERB dad-10733 212 22 to to PART dad-10733 212 23 generate generate VERB dad-10733 212 24 the the DET dad-10733 212 25 corpus corpus NOUN dad-10733 212 26 through through ADP dad-10733 212 27 a a DET dad-10733 212 28 process process NOUN dad-10733 212 29 known know VERB dad-10733 212 30 as as ADP dad-10733 212 31 bootstrapping bootstrappe VERB dad-10733 212 32 . . PUNCT dad-10733 213 1 furthermore furthermore ADV dad-10733 213 2 , , PUNCT dad-10733 213 3 there there PRON dad-10733 213 4 may may AUX dad-10733 213 5 be be AUX dad-10733 213 6 other other ADJ dad-10733 213 7 reasons reason NOUN dad-10733 213 8 to to PART dad-10733 213 9 prefer prefer VERB dad-10733 213 10 human human ADJ dad-10733 213 11 - - PUNCT dad-10733 213 12 machine machine NOUN dad-10733 213 13 over over ADP dad-10733 213 14 human human ADJ dad-10733 213 15 - - PUNCT dad-10733 213 16 human human NOUN dad-10733 213 17 corpora corpora NOUN dad-10733 213 18 , , PUNCT dad-10733 213 19 for for ADP dad-10733 213 20 example example NOUN dad-10733 213 21 if if SCONJ dad-10733 213 22 researchers researcher NOUN dad-10733 213 23 desire desire VERB dad-10733 213 24 to to PART dad-10733 213 25 study study VERB dad-10733 213 26 the the DET dad-10733 213 27 behavior behavior NOUN dad-10733 213 28 of of ADP dad-10733 213 29 a a DET dad-10733 213 30 particular particular ADJ dad-10733 213 31 dialogue dialogue NOUN dad-10733 213 32 system system NOUN dad-10733 213 33 . . PUNCT dad-10733 214 1 another another DET dad-10733 214 2 possible possible ADJ dad-10733 214 3 alternative alternative NOUN dad-10733 214 4 is be AUX dad-10733 214 5 the the DET dad-10733 214 6 case case NOUN dad-10733 214 7 of of ADP dad-10733 214 8 wizard wizard NOUN dad-10733 214 9 - - PUNCT dad-10733 214 10 of of ADP dad-10733 214 11 - - PUNCT dad-10733 214 12 oz oz NOUN dad-10733 214 13 experiments experiment NOUN dad-10733 214 14 ( ( PUNCT dad-10733 214 15 bohus bohus NOUN dad-10733 214 16 and and CCONJ dad-10733 214 17 rudnicky rudnicky NOUN dad-10733 214 18 , , PUNCT dad-10733 214 19 2008 2008 NUM dad-10733 214 20 ; ; PUNCT dad-10733 214 21 petrik petrik PROPN dad-10733 214 22 , , PUNCT dad-10733 214 23 2004 2004 NUM dad-10733 214 24 ) ) PUNCT dad-10733 214 25 . . PUNCT dad-10733 215 1 in in ADP dad-10733 215 2 these these DET dad-10733 215 3 dialogue dialogue NOUN dad-10733 215 4 collection collection NOUN dad-10733 215 5 methods method NOUN dad-10733 215 6 , , PUNCT dad-10733 215 7 a a DET dad-10733 215 8 human human NOUN dad-10733 215 9 thinks think VERB dad-10733 215 10 ( ( PUNCT dad-10733 215 11 s)he s)he PROPN dad-10733 215 12 is be AUX dad-10733 215 13 speaking speak VERB dad-10733 215 14 to to ADP dad-10733 215 15 a a DET dad-10733 215 16 machine machine NOUN dad-10733 215 17 , , PUNCT dad-10733 215 18 but but CCONJ dad-10733 215 19 a a DET dad-10733 215 20 human human ADJ dad-10733 215 21 operator operator NOUN dad-10733 215 22 is be AUX dad-10733 215 23 in in ADP dad-10733 215 24 fact fact NOUN dad-10733 215 25 controlling control VERB dad-10733 215 26 the the DET dad-10733 215 27 dialogue dialogue NOUN dad-10733 215 28 system system NOUN dad-10733 215 29 . . PUNCT dad-10733 216 1 this this PRON dad-10733 216 2 enables enable VERB dad-10733 216 3 the the DET dad-10733 216 4 generation generation NOUN dad-10733 216 5 of of ADP dad-10733 216 6 datasets dataset NOUN dad-10733 216 7 that that PRON dad-10733 216 8 are be AUX dad-10733 216 9 closer close ADJ dad-10733 216 10 in in ADP dad-10733 216 11 nature nature NOUN dad-10733 216 12 to to ADP dad-10733 216 13 the the DET dad-10733 216 14 dialogues dialogue NOUN dad-10733 216 15 humans human NOUN dad-10733 216 16 may may AUX dad-10733 216 17 wish wish VERB dad-10733 216 18 to to PART dad-10733 216 19 achieve achieve VERB dad-10733 216 20 in in ADP dad-10733 216 21 a a DET dad-10733 216 22 given give VERB dad-10733 216 23 setting setting NOUN dad-10733 216 24 . . PUNCT dad-10733 217 1 for for ADP dad-10733 217 2 such such ADJ dad-10733 217 3 experiments experiment NOUN dad-10733 217 4 , , PUNCT dad-10733 217 5 it it PRON dad-10733 217 6 may may AUX dad-10733 217 7 also also ADV dad-10733 217 8 be be AUX dad-10733 217 9 beneficial beneficial ADJ dad-10733 217 10 to to PART dad-10733 217 11 influence influence VERB dad-10733 217 12 either either ADV dad-10733 217 13 or or CCONJ dad-10733 217 14 both both CCONJ dad-10733 217 15 the the DET dad-10733 217 16 human human ADJ dad-10733 217 17 wizard wizard NOUN dad-10733 217 18 and and CCONJ dad-10733 217 19 user user NOUN dad-10733 217 20 to to PART dad-10733 217 21 collect collect VERB dad-10733 217 22 a a DET dad-10733 217 23 diverse diverse ADJ dad-10733 217 24 dataset dataset NOUN dad-10733 217 25 . . PUNCT dad-10733 218 1 for for ADP dad-10733 218 2 example example NOUN dad-10733 218 3 , , PUNCT dad-10733 218 4 in in ADP dad-10733 218 5 a a DET dad-10733 218 6 negotiation negotiation NOUN dad-10733 218 7 task task NOUN dad-10733 218 8 konovalov konovalov X dad-10733 218 9 et et PROPN dad-10733 218 10 al al PROPN dad-10733 218 11 . . PUNCT dad-10733 218 12 ( ( PUNCT dad-10733 218 13 2016 2016 NUM dad-10733 218 14 ) ) PUNCT dad-10733 218 15 propose propose VERB dad-10733 218 16 to to ADP dad-10733 218 17 1 1 NUM dad-10733 218 18 ) ) PUNCT dad-10733 218 19 influence influence NOUN dad-10733 218 20 the the DET dad-10733 218 21 human human ADJ dad-10733 218 22 wizard wizard NOUN dad-10733 218 23 by by ADP dad-10733 218 24 asking ask VERB dad-10733 218 25 them they PRON dad-10733 218 26 to to PART dad-10733 218 27 change change VERB dad-10733 218 28 their their PRON dad-10733 218 29 negotiation negotiation NOUN dad-10733 218 30 strategy strategy NOUN dad-10733 218 31 , , PUNCT dad-10733 218 32 and and CCONJ dad-10733 218 33 2 2 X dad-10733 218 34 ) ) PUNCT dad-10733 218 35 have have VERB dad-10733 218 36 the the DET dad-10733 218 37 human human ADJ dad-10733 218 38 user user NOUN dad-10733 218 39 rephrase rephrase VERB dad-10733 218 40 their their PRON dad-10733 218 41 utterances utterance NOUN dad-10733 218 42 for for ADP dad-10733 218 43 low low ADJ dad-10733 218 44 - - PUNCT dad-10733 218 45 frequency frequency NOUN dad-10733 218 46 intentions intention NOUN dad-10733 218 47 . . PUNCT dad-10733 219 1 however however ADV dad-10733 219 2 , , PUNCT dad-10733 219 3 wizard wizard NOUN dad-10733 219 4 - - PUNCT dad-10733 219 5 of of ADP dad-10733 219 6 - - PUNCT dad-10733 219 7 oz oz NOUN dad-10733 219 8 experiments experiment NOUN dad-10733 219 9 are be AUX dad-10733 219 10 typically typically ADV dad-10733 219 11 expensive expensive ADJ dad-10733 219 12 and and CCONJ dad-10733 219 13 time time NOUN dad-10733 219 14 - - PUNCT dad-10733 219 15 consuming consume VERB dad-10733 219 16 to to PART dad-10733 219 17 carry carry VERB dad-10733 219 18 out out ADP dad-10733 219 19 . . PUNCT dad-10733 220 1 3.3 3.3 NUM dad-10733 220 2 spontaneous spontaneous ADJ dad-10733 220 3 vs. vs. ADP dad-10733 220 4 constrained constrain VERB dad-10733 220 5 corpora corpora NOUN dad-10733 220 6 the the DET dad-10733 220 7 way way NOUN dad-10733 220 8 in in ADP dad-10733 220 9 which which PRON dad-10733 220 10 a a DET dad-10733 220 11 dialogue dialogue NOUN dad-10733 220 12 corpus corpus NOUN dad-10733 220 13 is be AUX dad-10733 220 14 generated generate VERB dad-10733 220 15 and and CCONJ dad-10733 220 16 collected collect VERB dad-10733 220 17 can can AUX dad-10733 220 18 have have VERB dad-10733 220 19 a a DET dad-10733 220 20 significant significant ADJ dad-10733 220 21 influence influence NOUN dad-10733 220 22 on on ADP dad-10733 220 23 the the DET dad-10733 220 24 trained train VERB dad-10733 220 25 data data NOUN dad-10733 220 26 - - PUNCT dad-10733 220 27 driven drive VERB dad-10733 220 28 dialogue dialogue NOUN dad-10733 220 29 system system NOUN dad-10733 220 30 . . PUNCT dad-10733 221 1 many many ADJ dad-10733 221 2 dialogue dialogue NOUN dad-10733 221 3 corpora corpus NOUN dad-10733 221 4 contain contain VERB dad-10733 221 5 dialogues dialogue NOUN dad-10733 221 6 in in ADP dad-10733 221 7 which which PRON dad-10733 221 8 the the DET dad-10733 221 9 topics topic NOUN dad-10733 221 10 of of ADP dad-10733 221 11 conversation conversation NOUN dad-10733 221 12 are be AUX dad-10733 221 13 either either CCONJ dad-10733 221 14 casual casual ADJ dad-10733 221 15 or or CCONJ dad-10733 221 16 not not PART dad-10733 221 17 pre pre VERB dad-10733 221 18 - - VERB dad-10733 221 19 specified specified ADJ dad-10733 221 20 in in ADP dad-10733 221 21 any any DET dad-10733 221 22 way way NOUN dad-10733 221 23 . . PUNCT dad-10733 222 1 these these DET dad-10733 222 2 corpora corpora NOUN dad-10733 222 3 can can AUX dad-10733 222 4 be be AUX dad-10733 222 5 referred refer VERB dad-10733 222 6 to to ADP dad-10733 222 7 as as ADV dad-10733 222 8 spontaneous spontaneous ADJ dad-10733 222 9 ( ( PUNCT dad-10733 222 10 unconstrained unconstrained PROPN dad-10733 222 11 ) ) PUNCT dad-10733 222 12 corpora corpus NOUN dad-10733 222 13 , , PUNCT dad-10733 222 14 as as SCONJ dad-10733 222 15 we we PRON dad-10733 222 16 believe believe VERB dad-10733 222 17 they they PRON dad-10733 222 18 most most ADV dad-10733 222 19 closely closely ADV dad-10733 222 20 mimic mimic VERB dad-10733 222 21 spontaneous spontaneous ADJ dad-10733 222 22 and and CCONJ dad-10733 222 23 unplanned unplanned ADJ dad-10733 222 24 spoken spoken ADJ dad-10733 222 25 interactions interaction NOUN dad-10733 222 26 between between ADP dad-10733 222 27 humans human NOUN dad-10733 222 28 . . PUNCT dad-10733 223 1 however however ADV dad-10733 223 2 , , PUNCT dad-10733 223 3 in in ADP dad-10733 223 4 some some DET dad-10733 223 5 corpora corpus NOUN dad-10733 223 6 , , PUNCT dad-10733 223 7 conversations conversation NOUN dad-10733 223 8 focus focus VERB dad-10733 223 9 on on ADP dad-10733 223 10 a a DET dad-10733 223 11 particular particular ADJ dad-10733 223 12 topic topic NOUN dad-10733 223 13 or or CCONJ dad-10733 223 14 intend intend VERB dad-10733 223 15 to to PART dad-10733 223 16 solve solve VERB dad-10733 223 17 a a DET dad-10733 223 18 specific specific ADJ dad-10733 223 19 task task NOUN dad-10733 223 20 . . PUNCT dad-10733 224 1 in in ADP dad-10733 224 2 such such ADJ dad-10733 224 3 situations situation NOUN dad-10733 224 4 , , PUNCT dad-10733 224 5 the the DET dad-10733 224 6 task task NOUN dad-10733 224 7 or or CCONJ dad-10733 224 8 topic topic NOUN dad-10733 224 9 is be AUX dad-10733 224 10 pre pre ADJ dad-10733 224 11 - - VERB dad-10733 224 12 specified specified ADJ dad-10733 224 13 and and CCONJ dad-10733 224 14 participants participant NOUN dad-10733 224 15 are be AUX dad-10733 224 16 discouraged discourage VERB dad-10733 224 17 from from ADP dad-10733 224 18 deviating deviate VERB dad-10733 224 19 from from ADP dad-10733 224 20 the the DET dad-10733 224 21 topic topic NOUN dad-10733 224 22 . . PUNCT dad-10733 225 1 we we PRON dad-10733 225 2 refer refer VERB dad-10733 225 3 to to ADP dad-10733 225 4 these these PRON dad-10733 225 5 as as ADP dad-10733 225 6 constrained constrain VERB dad-10733 225 7 dialogue dialogue NOUN dad-10733 225 8 corpora corpora PROPN dad-10733 225 9 . . PUNCT dad-10733 226 1 spontaneous spontaneous ADJ dad-10733 226 2 corpora corpora PROPN dad-10733 226 3 bear bear NOUN dad-10733 226 4 a a DET dad-10733 226 5 close close ADJ dad-10733 226 6 resemblance resemblance NOUN dad-10733 226 7 to to ADP dad-10733 226 8 natural natural ADJ dad-10733 226 9 dialogues dialogue NOUN dad-10733 226 10 — — PUNCT dad-10733 226 11 that that ADV dad-10733 226 12 is is ADV dad-10733 226 13 , , PUNCT dad-10733 226 14 they they PRON dad-10733 226 15 are be AUX dad-10733 226 16 close close ADJ dad-10733 226 17 to to ADP dad-10733 226 18 the the DET dad-10733 226 19 generally generally ADV dad-10733 226 20 unplanned unplanned ADJ dad-10733 226 21 nature nature NOUN dad-10733 226 22 of of ADP dad-10733 226 23 most most ADJ dad-10733 226 24 spoken spoken ADJ dad-10733 226 25 interactions interaction NOUN dad-10733 226 26 between between ADP dad-10733 226 27 humans human NOUN dad-10733 226 28 . . PUNCT dad-10733 227 1 in in ADP dad-10733 227 2 the the DET dad-10733 227 3 latter latter ADJ dad-10733 227 4 case case NOUN dad-10733 227 5 — — PUNCT dad-10733 227 6 that that PRON dad-10733 227 7 of of ADP dad-10733 227 8 constrained constrained ADJ dad-10733 227 9 dialogues dialogue NOUN dad-10733 227 10 — — PUNCT dad-10733 227 11 some some DET dad-10733 227 12 experimental experimental ADJ dad-10733 227 13 conditions condition NOUN dad-10733 227 14 in in ADP dad-10733 227 15 which which PRON dad-10733 227 16 dialogues dialogue NOUN dad-10733 227 17 were be AUX dad-10733 227 18 collected collect VERB dad-10733 227 19 can can AUX dad-10733 227 20 result result VERB dad-10733 227 21 in in ADP dad-10733 227 22 unnatural unnatural ADJ dad-10733 227 23 behaviours behaviour NOUN dad-10733 227 24 that that PRON dad-10733 227 25 do do AUX dad-10733 227 26 not not PART dad-10733 227 27 correlate correlate VERB dad-10733 227 28 well well ADV dad-10733 227 29 to to ADP dad-10733 227 30 the the DET dad-10733 227 31 true true ADJ dad-10733 227 32 typical typical ADJ dad-10733 227 33 dialogue dialogue NOUN dad-10733 227 34 patterns pattern NOUN dad-10733 227 35 of of ADP dad-10733 227 36 human human ADJ dad-10733 227 37 - - PUNCT dad-10733 227 38 human human NOUN dad-10733 227 39 interaction interaction NOUN dad-10733 227 40 in in ADP dad-10733 227 41 day day NOUN dad-10733 227 42 - - PUNCT dad-10733 227 43 to to ADP dad-10733 227 44 - - PUNCT dad-10733 227 45 day day NOUN dad-10733 227 46 settings setting NOUN dad-10733 227 47 . . PUNCT dad-10733 228 1 due due ADP dad-10733 228 2 to to ADP dad-10733 228 3 ethical ethical ADJ dad-10733 228 4 considerations consideration NOUN dad-10733 228 5 and and CCONJ dad-10733 228 6 resource resource NOUN dad-10733 228 7 constraints constraint NOUN dad-10733 228 8 , , PUNCT dad-10733 228 9 researchers researcher NOUN dad-10733 228 10 may may AUX dad-10733 228 11 be be AUX dad-10733 228 12 forced force VERB dad-10733 228 13 to to PART dad-10733 228 14 inform inform VERB dad-10733 228 15 the the DET dad-10733 228 16 human human ADJ dad-10733 228 17 interlocutors interlocutor NOUN dad-10733 228 18 that that SCONJ dad-10733 228 19 they they PRON dad-10733 228 20 are be AUX dad-10733 228 21 being be AUX dad-10733 228 22 recorded record VERB dad-10733 228 23 or or CCONJ dad-10733 228 24 to to PART dad-10733 228 25 setup setup VERB dad-10733 228 26 artificial artificial ADJ dad-10733 228 27 experiments experiment NOUN dad-10733 228 28 in in ADP dad-10733 228 29 which which PRON dad-10733 228 30 they they PRON dad-10733 228 31 hire hire VERB dad-10733 228 32 humans human NOUN dad-10733 228 33 and and CCONJ dad-10733 228 34 instruct instruct VERB dad-10733 228 35 them they PRON dad-10733 228 36 to to PART dad-10733 228 37 carry carry VERB dad-10733 228 38 out out ADP dad-10733 228 39 a a DET dad-10733 228 40 particular particular ADJ dad-10733 228 41 task task NOUN dad-10733 228 42 by by ADP dad-10733 228 43 interacting interact VERB dad-10733 228 44 with with ADP dad-10733 228 45 a a DET dad-10733 228 46 dialogue dialogue NOUN dad-10733 228 47 system system NOUN dad-10733 228 48 . . PUNCT dad-10733 229 1 in in ADP dad-10733 229 2 these these DET dad-10733 229 3 cases case NOUN dad-10733 229 4 , , PUNCT dad-10733 229 5 there there PRON dad-10733 229 6 is be VERB dad-10733 229 7 no no DET dad-10733 229 8 guarantee guarantee NOUN dad-10733 229 9 that that SCONJ dad-10733 229 10 the the DET dad-10733 229 11 interactions interaction NOUN dad-10733 229 12 in in ADP dad-10733 229 13 the the DET dad-10733 229 14 corpus corpus NOUN dad-10733 229 15 will will AUX dad-10733 229 16 reflect reflect VERB dad-10733 229 17 natural natural ADJ dad-10733 229 18 human human ADJ dad-10733 229 19 interactions interaction NOUN dad-10733 229 20 , , PUNCT dad-10733 229 21 since since SCONJ dad-10733 229 22 the the DET dad-10733 229 23 hired hire VERB dad-10733 229 24 humans human NOUN dad-10733 229 25 may may AUX dad-10733 229 26 behave behave VERB dad-10733 229 27 differently differently ADV dad-10733 229 28 from from ADP dad-10733 229 29 the the DET dad-10733 229 30 population population NOUN dad-10733 229 31 . . PUNCT dad-10733 230 1 one one NUM dad-10733 230 2 factor factor NOUN dad-10733 230 3 that that PRON dad-10733 230 4 may may AUX dad-10733 230 5 cause cause VERB dad-10733 230 6 behavioural behavioural ADJ dad-10733 230 7 differences difference NOUN dad-10733 230 8 is be AUX dad-10733 230 9 the the DET dad-10733 230 10 fact fact NOUN dad-10733 230 11 that that SCONJ dad-10733 230 12 the the DET dad-10733 230 13 hired hire VERB dad-10733 230 14 humans human NOUN dad-10733 230 15 may may AUX dad-10733 230 16 not not PART dad-10733 230 17 share share VERB dad-10733 230 18 the the DET dad-10733 230 19 same same ADJ dad-10733 230 20 intentions intention NOUN dad-10733 230 21 and and CCONJ dad-10733 230 22 motivations motivation NOUN dad-10733 230 23 as as ADP dad-10733 230 24 the the DET dad-10733 230 25 population population NOUN dad-10733 230 26 ( ( PUNCT dad-10733 230 27 ai ai VERB dad-10733 230 28 et et PROPN dad-10733 230 29 al al PROPN dad-10733 230 30 . . PROPN dad-10733 230 31 , , PUNCT dad-10733 230 32 2007 2007 NUM dad-10733 230 33 ; ; PUNCT dad-10733 230 34 young young PROPN dad-10733 230 35 et et PROPN dad-10733 230 36 al al PROPN dad-10733 230 37 . . PROPN dad-10733 230 38 , , PUNCT dad-10733 230 39 2013 2013 NUM dad-10733 230 40 ) ) PUNCT dad-10733 230 41 . . PUNCT dad-10733 231 1 the the DET dad-10733 231 2 unnaturalness unnaturalness NOUN dad-10733 231 3 may may AUX dad-10733 231 4 be be AUX dad-10733 231 5 further far ADV dad-10733 231 6 exacerbated exacerbate VERB dad-10733 231 7 by by ADP dad-10733 231 8 the the DET dad-10733 231 9 hiring hiring NOUN dad-10733 231 10 process process NOUN dad-10733 231 11 , , PUNCT dad-10733 231 12 as as ADV dad-10733 231 13 well well ADV dad-10733 231 14 as as ADP dad-10733 231 15 the the DET dad-10733 231 16 platform platform NOUN dad-10733 231 17 through through ADP dad-10733 231 18 which which PRON dad-10733 231 19 they they PRON dad-10733 231 20 interact interact VERB dad-10733 231 21 . . PUNCT dad-10733 232 1 such such ADJ dad-10733 232 2 factors factor NOUN dad-10733 232 3 are be AUX dad-10733 232 4 becoming become VERB dad-10733 232 5 more more ADV dad-10733 232 6 prevalent prevalent ADJ dad-10733 232 7 as as SCONJ dad-10733 232 8 researchers researcher NOUN dad-10733 232 9 increasingly increasingly ADV dad-10733 232 10 rely rely VERB dad-10733 232 11 on on ADP dad-10733 232 12 crowdsourcing crowdsourcing NOUN dad-10733 232 13 platforms platform NOUN dad-10733 232 14 , , PUNCT dad-10733 232 15 such such ADJ dad-10733 232 16 as as ADP dad-10733 232 17 amazon amazon PROPN dad-10733 232 18 mechanical mechanical ADJ dad-10733 232 19 turk turk PROPN dad-10733 232 20 , , PUNCT dad-10733 232 21 to to PART dad-10733 232 22 collect collect VERB dad-10733 232 23 and and CCONJ dad-10733 232 24 evaluate evaluate VERB dad-10733 232 25 dialogue dialogue NOUN dad-10733 232 26 data datum NOUN dad-10733 232 27 ( ( PUNCT dad-10733 232 28 jurcıcek jurcıcek PROPN dad-10733 232 29 et et PROPN dad-10733 232 30 al al PROPN dad-10733 232 31 . . PROPN dad-10733 232 32 , , PUNCT dad-10733 232 33 2011 2011 NUM dad-10733 232 34 ) ) PUNCT dad-10733 232 35 . . PUNCT dad-10733 233 1 while while SCONJ dad-10733 233 2 these these DET dad-10733 233 3 factors factor NOUN dad-10733 233 4 concerning concern VERB dad-10733 233 5 constrained constrain VERB dad-10733 233 6 corpora corpus NOUN dad-10733 233 7 are be AUX dad-10733 233 8 important important ADJ dad-10733 233 9 to to PART dad-10733 233 10 consider consider VERB dad-10733 233 11 , , PUNCT dad-10733 233 12 there there PRON dad-10733 233 13 are be VERB dad-10733 233 14 many many ADJ dad-10733 233 15 use use NOUN dad-10733 233 16 cases case NOUN dad-10733 233 17 where where SCONJ dad-10733 233 18 such such ADJ dad-10733 233 19 corpora corpus NOUN dad-10733 233 20 are be AUX dad-10733 233 21 beneficial beneficial ADJ dad-10733 233 22 or or CCONJ dad-10733 233 23 necessary necessary ADJ dad-10733 233 24 . . PUNCT dad-10733 234 1 certain certain ADJ dad-10733 234 2 researchers researcher NOUN dad-10733 234 3 may may AUX dad-10733 234 4 prefer prefer VERB dad-10733 234 5 laboratorylike laboratorylike ADJ dad-10733 234 6 conditions condition NOUN dad-10733 234 7 to to PART dad-10733 234 8 study study VERB dad-10733 234 9 certain certain ADJ dad-10733 234 10 variables variable NOUN dad-10733 234 11 of of ADP dad-10733 234 12 interest interest NOUN dad-10733 234 13 in in ADP dad-10733 234 14 a a DET dad-10733 234 15 conversation conversation NOUN dad-10733 234 16 . . PUNCT dad-10733 235 1 further far ADV dad-10733 235 2 , , PUNCT dad-10733 235 3 constrained constrain VERB dad-10733 235 4 corpora corpora PROPN dad-10733 235 5 11 11 NUM dad-10733 235 6 serban serban PROPN dad-10733 235 7 , , PUNCT dad-10733 235 8 lowe lowe PROPN dad-10733 235 9 , , PUNCT dad-10733 235 10 henderson henderson PROPN dad-10733 235 11 , , PUNCT dad-10733 235 12 charlin charlin PROPN dad-10733 235 13 and and CCONJ dad-10733 235 14 pineau pineau PROPN dad-10733 235 15 in in ADP dad-10733 235 16 the the DET dad-10733 235 17 form form NOUN dad-10733 235 18 of of ADP dad-10733 235 19 debate debate NOUN dad-10733 235 20 settings setting NOUN dad-10733 235 21 , , PUNCT dad-10733 235 22 topical topical ADJ dad-10733 235 23 discussions discussion NOUN dad-10733 235 24 , , PUNCT dad-10733 235 25 etc etc X dad-10733 235 26 . . X dad-10733 235 27 are be AUX dad-10733 235 28 useful useful ADJ dad-10733 235 29 to to PART dad-10733 235 30 study study VERB dad-10733 235 31 in in ADP dad-10733 235 32 and and CCONJ dad-10733 235 33 of of ADP dad-10733 235 34 themselves themselves PRON dad-10733 235 35 . . PUNCT dad-10733 236 1 in in ADP dad-10733 236 2 sections section NOUN dad-10733 236 3 4.2 4.2 NUM dad-10733 236 4 and and CCONJ dad-10733 236 5 4.3 4.3 NUM dad-10733 236 6 , , PUNCT dad-10733 236 7 we we PRON dad-10733 236 8 separate separate VERB dad-10733 236 9 our our PRON dad-10733 236 10 discussion discussion NOUN dad-10733 236 11 of of ADP dad-10733 236 12 dialogue dialogue NOUN dad-10733 236 13 datasets dataset NOUN dad-10733 236 14 based base VERB dad-10733 236 15 on on ADP dad-10733 236 16 whether whether SCONJ dad-10733 236 17 the the DET dad-10733 236 18 corpora corpora NOUN dad-10733 236 19 are be AUX dad-10733 236 20 constrained constrain VERB dad-10733 236 21 or or CCONJ dad-10733 236 22 spontaneous spontaneous ADJ dad-10733 236 23 . . PUNCT dad-10733 237 1 3.4 3.4 NUM dad-10733 237 2 topic topic NOUN dad-10733 237 3 - - PUNCT dad-10733 237 4 oriented orient VERB dad-10733 237 5 & & CCONJ dad-10733 237 6 goal goal NOUN dad-10733 237 7 - - PUNCT dad-10733 237 8 driven drive VERB dad-10733 237 9 datasets dataset NOUN dad-10733 237 10 many many ADJ dad-10733 237 11 human human ADJ dad-10733 237 12 - - PUNCT dad-10733 237 13 human human ADJ dad-10733 237 14 datasets dataset NOUN dad-10733 237 15 may may AUX dad-10733 237 16 be be AUX dad-10733 237 17 described describe VERB dad-10733 237 18 as as ADP dad-10733 237 19 containing contain VERB dad-10733 237 20 casual casual ADJ dad-10733 237 21 or or CCONJ dad-10733 237 22 unrestricted unrestricted ADJ dad-10733 237 23 topics topic NOUN dad-10733 237 24 , , PUNCT dad-10733 237 25 while while SCONJ dad-10733 237 26 human human ADJ dad-10733 237 27 - - PUNCT dad-10733 237 28 machine machine NOUN dad-10733 237 29 datasets dataset NOUN dad-10733 237 30 often often ADV dad-10733 237 31 focus focus VERB dad-10733 237 32 on on ADP dad-10733 237 33 specific specific ADJ dad-10733 237 34 , , PUNCT dad-10733 237 35 narrow narrow ADJ dad-10733 237 36 topics topic NOUN dad-10733 237 37 . . PUNCT dad-10733 238 1 it it PRON dad-10733 238 2 is be AUX dad-10733 238 3 useful useful ADJ dad-10733 238 4 to to PART dad-10733 238 5 keep keep VERB dad-10733 238 6 this this DET dad-10733 238 7 distinction distinction NOUN dad-10733 238 8 between between ADP dad-10733 238 9 restricted restricted ADJ dad-10733 238 10 and and CCONJ dad-10733 238 11 unrestricted unrestricted ADJ dad-10733 238 12 topics topic NOUN dad-10733 238 13 in in ADP dad-10733 238 14 mind mind NOUN dad-10733 238 15 , , PUNCT dad-10733 238 16 since since SCONJ dad-10733 238 17 goal goal NOUN dad-10733 238 18 - - PUNCT dad-10733 238 19 driven drive VERB dad-10733 238 20 dialogue dialogue NOUN dad-10733 238 21 systems system NOUN dad-10733 238 22 — — PUNCT dad-10733 238 23 which which PRON dad-10733 238 24 often often ADV dad-10733 238 25 have have VERB dad-10733 238 26 a a DET dad-10733 238 27 well well ADV dad-10733 238 28 - - PUNCT dad-10733 238 29 defined define VERB dad-10733 238 30 measure measure NOUN dad-10733 238 31 of of ADP dad-10733 238 32 performance performance NOUN dad-10733 238 33 related relate VERB dad-10733 238 34 to to ADP dad-10733 238 35 task task NOUN dad-10733 238 36 completion completion NOUN dad-10733 238 37 — — PUNCT dad-10733 238 38 are be AUX dad-10733 238 39 usually usually ADV dad-10733 238 40 developed develop VERB dad-10733 238 41 in in ADP dad-10733 238 42 the the DET dad-10733 238 43 former former ADJ dad-10733 238 44 setting setting NOUN dad-10733 238 45 . . PUNCT dad-10733 239 1 when when SCONJ dad-10733 239 2 the the DET dad-10733 239 3 corpus corpus NOUN dad-10733 239 4 domain domain NOUN dad-10733 239 5 is be AUX dad-10733 239 6 restricted restrict VERB dad-10733 239 7 and and CCONJ dad-10733 239 8 a a DET dad-10733 239 9 completion completion NOUN dad-10733 239 10 metric metric NOUN dad-10733 239 11 is be AUX dad-10733 239 12 available available ADJ dad-10733 239 13 , , PUNCT dad-10733 239 14 it it PRON dad-10733 239 15 may may AUX dad-10733 239 16 be be AUX dad-10733 239 17 useful useful ADJ dad-10733 239 18 to to PART dad-10733 239 19 incorporate incorporate VERB dad-10733 239 20 this this PRON dad-10733 239 21 explicitly explicitly ADV dad-10733 239 22 into into ADP dad-10733 239 23 the the DET dad-10733 239 24 learning learning NOUN dad-10733 239 25 procedure procedure NOUN dad-10733 239 26 . . PUNCT dad-10733 240 1 in in ADP dad-10733 240 2 contrast contrast NOUN dad-10733 240 3 , , PUNCT dad-10733 240 4 when when SCONJ dad-10733 240 5 building build VERB dad-10733 240 6 non non ADJ dad-10733 240 7 - - ADJ dad-10733 240 8 goal goal ADJ dad-10733 240 9 - - PUNCT dad-10733 240 10 driven drive VERB dad-10733 240 11 dialogue dialogue NOUN dad-10733 240 12 systems system NOUN dad-10733 240 13 based base VERB dad-10733 240 14 on on ADP dad-10733 240 15 a a DET dad-10733 240 16 corpus corpus NOUN dad-10733 240 17 with with ADP dad-10733 240 18 unrestricted unrestricted ADJ dad-10733 240 19 topics topic NOUN dad-10733 240 20 , , PUNCT dad-10733 240 21 it it PRON dad-10733 240 22 may may AUX dad-10733 240 23 not not PART dad-10733 240 24 be be AUX dad-10733 240 25 possible possible ADJ dad-10733 240 26 to to PART dad-10733 240 27 explicitly explicitly ADV dad-10733 240 28 incorporate incorporate VERB dad-10733 240 29 any any DET dad-10733 240 30 topic topic NOUN dad-10733 240 31 information information NOUN dad-10733 240 32 or or CCONJ dad-10733 240 33 completion completion NOUN dad-10733 240 34 metric metric ADJ dad-10733 240 35 into into ADP dad-10733 240 36 the the DET dad-10733 240 37 learning learning NOUN dad-10733 240 38 procedure procedure NOUN dad-10733 240 39 . . PUNCT dad-10733 241 1 in in ADP dad-10733 241 2 some some DET dad-10733 241 3 cases case NOUN dad-10733 241 4 , , PUNCT dad-10733 241 5 the the DET dad-10733 241 6 line line NOUN dad-10733 241 7 between between ADP dad-10733 241 8 restricted restricted ADJ dad-10733 241 9 and and CCONJ dad-10733 241 10 unrestricted unrestricted ADJ dad-10733 241 11 topics topic NOUN dad-10733 241 12 blurs blur VERB dad-10733 241 13 . . PUNCT dad-10733 242 1 for for ADP dad-10733 242 2 example example NOUN dad-10733 242 3 , , PUNCT dad-10733 242 4 in in ADP dad-10733 242 5 the the DET dad-10733 242 6 case case NOUN dad-10733 242 7 of of ADP dad-10733 242 8 conversations conversation NOUN dad-10733 242 9 between between ADP dad-10733 242 10 players player NOUN dad-10733 242 11 of of ADP dad-10733 242 12 an an DET dad-10733 242 13 online online ADJ dad-10733 242 14 game game NOUN dad-10733 242 15 ( ( PUNCT dad-10733 242 16 afantenos afantenos PROPN dad-10733 242 17 et et PROPN dad-10733 242 18 al al PROPN dad-10733 242 19 . . PROPN dad-10733 242 20 , , PUNCT dad-10733 242 21 2012 2012 NUM dad-10733 242 22 ) ) PUNCT dad-10733 242 23 , , PUNCT dad-10733 242 24 the the DET dad-10733 242 25 outcome outcome NOUN dad-10733 242 26 of of ADP dad-10733 242 27 the the DET dad-10733 242 28 game game NOUN dad-10733 242 29 is be AUX dad-10733 242 30 determined determine VERB dad-10733 242 31 by by ADP dad-10733 242 32 how how SCONJ dad-10733 242 33 participants participant NOUN dad-10733 242 34 play play VERB dad-10733 242 35 in in ADP dad-10733 242 36 the the DET dad-10733 242 37 game game NOUN dad-10733 242 38 environment environment NOUN dad-10733 242 39 , , PUNCT dad-10733 242 40 not not PART dad-10733 242 41 by by ADP dad-10733 242 42 their their PRON dad-10733 242 43 conversation conversation NOUN dad-10733 242 44 . . PUNCT dad-10733 243 1 in in ADP dad-10733 243 2 this this DET dad-10733 243 3 case case NOUN dad-10733 243 4 , , PUNCT dad-10733 243 5 some some DET dad-10733 243 6 conversations conversation NOUN dad-10733 243 7 may may AUX dad-10733 243 8 have have VERB dad-10733 243 9 a a DET dad-10733 243 10 direct direct ADJ dad-10733 243 11 impact impact NOUN dad-10733 243 12 on on ADP dad-10733 243 13 a a DET dad-10733 243 14 player player NOUN dad-10733 243 15 ’s ’s PART dad-10733 243 16 performance performance NOUN dad-10733 243 17 in in ADP dad-10733 243 18 the the DET dad-10733 243 19 game game NOUN dad-10733 243 20 . . PUNCT dad-10733 244 1 other other ADJ dad-10733 244 2 conversations conversation NOUN dad-10733 244 3 may may AUX dad-10733 244 4 be be AUX dad-10733 244 5 related relate VERB dad-10733 244 6 to to ADP dad-10733 244 7 the the DET dad-10733 244 8 game game NOUN dad-10733 244 9 but but CCONJ dad-10733 244 10 irrelevant irrelevant ADJ dad-10733 244 11 to to ADP dad-10733 244 12 the the DET dad-10733 244 13 goal goal NOUN dad-10733 244 14 ( ( PUNCT dad-10733 244 15 e.g. e.g. ADV dad-10733 244 16 commentary commentary NOUN dad-10733 244 17 on on ADP dad-10733 244 18 past past ADJ dad-10733 244 19 events event NOUN dad-10733 244 20 ) ) PUNCT dad-10733 244 21 . . PUNCT dad-10733 245 1 finally finally ADV dad-10733 245 2 , , PUNCT dad-10733 245 3 some some DET dad-10733 245 4 conversations conversation NOUN dad-10733 245 5 may may AUX dad-10733 245 6 be be AUX dad-10733 245 7 completely completely ADV dad-10733 245 8 unrelated unrelated ADJ dad-10733 245 9 to to ADP dad-10733 245 10 the the DET dad-10733 245 11 game game NOUN dad-10733 245 12 . . PUNCT dad-10733 246 1 3.5 3.5 NUM dad-10733 246 2 scripted script VERB dad-10733 246 3 corpora corpora NOUN dad-10733 246 4 or or CCONJ dad-10733 246 5 corpora corpora VERB dad-10733 246 6 from from ADP dad-10733 246 7 fiction fiction NOUN dad-10733 246 8 it it PRON dad-10733 246 9 is be AUX dad-10733 246 10 also also ADV dad-10733 246 11 possible possible ADJ dad-10733 246 12 to to PART dad-10733 246 13 use use VERB dad-10733 246 14 artificial artificial ADJ dad-10733 246 15 dialogue dialogue NOUN dad-10733 246 16 corpora corpora NOUN dad-10733 246 17 for for ADP dad-10733 246 18 data data NOUN dad-10733 246 19 - - PUNCT dad-10733 246 20 driven drive VERB dad-10733 246 21 learning learning NOUN dad-10733 246 22 . . PUNCT dad-10733 247 1 this this PRON dad-10733 247 2 includes include VERB dad-10733 247 3 corpora corpus NOUN dad-10733 247 4 based base VERB dad-10733 247 5 on on ADP dad-10733 247 6 works work NOUN dad-10733 247 7 of of ADP dad-10733 247 8 fiction fiction NOUN dad-10733 247 9 such such ADJ dad-10733 247 10 as as ADP dad-10733 247 11 novels novel NOUN dad-10733 247 12 , , PUNCT dad-10733 247 13 movie movie NOUN dad-10733 247 14 manuscripts manuscript NOUN dad-10733 247 15 and and CCONJ dad-10733 247 16 audio audio ADJ dad-10733 247 17 subtitles subtitle NOUN dad-10733 247 18 . . PUNCT dad-10733 248 1 however however ADV dad-10733 248 2 , , PUNCT dad-10733 248 3 unlike unlike ADP dad-10733 248 4 transcribed transcribe VERB dad-10733 248 5 human human ADJ dad-10733 248 6 - - PUNCT dad-10733 248 7 human human NOUN dad-10733 248 8 conversations conversation NOUN dad-10733 248 9 , , PUNCT dad-10733 248 10 novels novel NOUN dad-10733 248 11 , , PUNCT dad-10733 248 12 movie movie NOUN dad-10733 248 13 manuscripts manuscript NOUN dad-10733 248 14 , , PUNCT dad-10733 248 15 and and CCONJ dad-10733 248 16 audio audio ADJ dad-10733 248 17 subtitles subtitle NOUN dad-10733 248 18 depend depend VERB dad-10733 248 19 upon upon SCONJ dad-10733 248 20 events event NOUN dad-10733 248 21 outside outside ADP dad-10733 248 22 the the DET dad-10733 248 23 current current ADJ dad-10733 248 24 conversation conversation NOUN dad-10733 248 25 , , PUNCT dad-10733 248 26 which which PRON dad-10733 248 27 are be AUX dad-10733 248 28 not not PART dad-10733 248 29 observed observe VERB dad-10733 248 30 . . PUNCT dad-10733 249 1 this this PRON dad-10733 249 2 makes make VERB dad-10733 249 3 data data NOUN dad-10733 249 4 - - PUNCT dad-10733 249 5 driven drive VERB dad-10733 249 6 learning learning NOUN dad-10733 249 7 more more ADV dad-10733 249 8 difficult difficult ADJ dad-10733 249 9 because because SCONJ dad-10733 249 10 the the DET dad-10733 249 11 dialogue dialogue NOUN dad-10733 249 12 system system NOUN dad-10733 249 13 has have VERB dad-10733 249 14 to to PART dad-10733 249 15 account account VERB dad-10733 249 16 for for ADP dad-10733 249 17 unknown unknown ADJ dad-10733 249 18 factors factor NOUN dad-10733 249 19 . . PUNCT dad-10733 250 1 the the DET dad-10733 250 2 same same ADJ dad-10733 250 3 problem problem NOUN dad-10733 250 4 is be AUX dad-10733 250 5 also also ADV dad-10733 250 6 observed observe VERB dad-10733 250 7 in in ADP dad-10733 250 8 certain certain ADJ dad-10733 250 9 other other ADJ dad-10733 250 10 media medium NOUN dad-10733 250 11 , , PUNCT dad-10733 250 12 such such ADJ dad-10733 250 13 as as ADP dad-10733 250 14 microblogging microblogge VERB dad-10733 250 15 websites website NOUN dad-10733 250 16 ( ( PUNCT dad-10733 250 17 e.g. e.g. ADV dad-10733 250 18 twitter twitter NOUN dad-10733 250 19 and and CCONJ dad-10733 250 20 weibo weibo NOUN dad-10733 250 21 ) ) PUNCT dad-10733 250 22 , , PUNCT dad-10733 250 23 where where SCONJ dad-10733 250 24 conversations conversation NOUN dad-10733 250 25 also also ADV dad-10733 250 26 may may AUX dad-10733 250 27 depend depend VERB dad-10733 250 28 on on ADP dad-10733 250 29 external external ADJ dad-10733 250 30 unobserved unobserved ADJ dad-10733 250 31 events event NOUN dad-10733 250 32 . . PUNCT dad-10733 251 1 nevertheless nevertheless ADV dad-10733 251 2 , , PUNCT dad-10733 251 3 recent recent ADJ dad-10733 251 4 studies study NOUN dad-10733 251 5 have have AUX dad-10733 251 6 found find VERB dad-10733 251 7 that that SCONJ dad-10733 251 8 spoken spoken ADJ dad-10733 251 9 language language NOUN dad-10733 251 10 in in ADP dad-10733 251 11 movies movie NOUN dad-10733 251 12 resembles resemble VERB dad-10733 251 13 spontaneous spontaneous ADJ dad-10733 251 14 human human ADJ dad-10733 251 15 spoken spoken ADJ dad-10733 251 16 language language NOUN dad-10733 251 17 ( ( PUNCT dad-10733 251 18 forchini forchini PROPN dad-10733 251 19 , , PUNCT dad-10733 251 20 2009 2009 NUM dad-10733 251 21 ) ) PUNCT dad-10733 251 22 . . PUNCT dad-10733 252 1 although although SCONJ dad-10733 252 2 movie movie NOUN dad-10733 252 3 dialogues dialogue NOUN dad-10733 252 4 are be AUX dad-10733 252 5 explicitly explicitly ADV dad-10733 252 6 written write VERB dad-10733 252 7 to to PART dad-10733 252 8 be be AUX dad-10733 252 9 spoken speak VERB dad-10733 252 10 and and CCONJ dad-10733 252 11 contain contain VERB dad-10733 252 12 certain certain ADJ dad-10733 252 13 artificial artificial ADJ dad-10733 252 14 elements element NOUN dad-10733 252 15 , , PUNCT dad-10733 252 16 many many ADJ dad-10733 252 17 of of ADP dad-10733 252 18 the the DET dad-10733 252 19 linguistic linguistic ADJ dad-10733 252 20 and and CCONJ dad-10733 252 21 paralinguistic paralinguistic ADJ dad-10733 252 22 features feature NOUN dad-10733 252 23 contained contain VERB dad-10733 252 24 within within ADP dad-10733 252 25 the the DET dad-10733 252 26 dialogues dialogue NOUN dad-10733 252 27 are be AUX dad-10733 252 28 similar similar ADJ dad-10733 252 29 to to ADP dad-10733 252 30 natural natural ADJ dad-10733 252 31 spoken speak VERB dad-10733 252 32 language language NOUN dad-10733 252 33 , , PUNCT dad-10733 252 34 including include VERB dad-10733 252 35 dialogue dialogue NOUN dad-10733 252 36 acts act NOUN dad-10733 252 37 such such ADJ dad-10733 252 38 as as ADP dad-10733 252 39 turn turn NOUN dad-10733 252 40 - - PUNCT dad-10733 252 41 taking taking NOUN dad-10733 252 42 and and CCONJ dad-10733 252 43 reciprocity reciprocity NOUN dad-10733 252 44 ( ( PUNCT dad-10733 252 45 e.g. e.g. ADV dad-10733 252 46 returning return VERB dad-10733 252 47 a a DET dad-10733 252 48 greeting greeting NOUN dad-10733 252 49 when when SCONJ dad-10733 252 50 greeted greet VERB dad-10733 252 51 ) ) PUNCT dad-10733 252 52 . . PUNCT dad-10733 253 1 the the DET dad-10733 253 2 artificial artificial ADJ dad-10733 253 3 differences difference NOUN dad-10733 253 4 that that PRON dad-10733 253 5 exist exist VERB dad-10733 253 6 may may AUX dad-10733 253 7 even even ADV dad-10733 253 8 be be AUX dad-10733 253 9 helpful helpful ADJ dad-10733 253 10 for for ADP dad-10733 253 11 data data NOUN dad-10733 253 12 - - PUNCT dad-10733 253 13 driven drive VERB dad-10733 253 14 dialogue dialogue NOUN dad-10733 253 15 learning learning NOUN dad-10733 253 16 since since SCONJ dad-10733 253 17 movie movie NOUN dad-10733 253 18 dialogues dialogue NOUN dad-10733 253 19 are be AUX dad-10733 253 20 more more ADV dad-10733 253 21 compact compact ADJ dad-10733 253 22 , , PUNCT dad-10733 253 23 follow follow VERB dad-10733 253 24 a a DET dad-10733 253 25 steady steady ADJ dad-10733 253 26 rhythm rhythm NOUN dad-10733 253 27 , , PUNCT dad-10733 253 28 and and CCONJ dad-10733 253 29 contain contain VERB dad-10733 253 30 less less ADV dad-10733 253 31 garbling garbling ADJ dad-10733 253 32 and and CCONJ dad-10733 253 33 repetition repetition NOUN dad-10733 253 34 , , PUNCT dad-10733 253 35 all all PRON dad-10733 253 36 while while SCONJ dad-10733 253 37 still still ADV dad-10733 253 38 presenting present VERB dad-10733 253 39 a a DET dad-10733 253 40 clear clear ADJ dad-10733 253 41 event event NOUN dad-10733 253 42 or or CCONJ dad-10733 253 43 message message NOUN dad-10733 253 44 to to ADP dad-10733 253 45 the the DET dad-10733 253 46 viewer viewer NOUN dad-10733 253 47 ( ( PUNCT dad-10733 253 48 dose dose PROPN dad-10733 253 49 , , PUNCT dad-10733 253 50 2013 2013 NUM dad-10733 253 51 ; ; PUNCT dad-10733 253 52 forchini forchini PROPN dad-10733 253 53 , , PUNCT dad-10733 253 54 2009 2009 NUM dad-10733 253 55 , , PUNCT dad-10733 253 56 2012 2012 NUM dad-10733 253 57 ) ) PUNCT dad-10733 253 58 . . PUNCT dad-10733 254 1 unlike unlike ADP dad-10733 254 2 dialogues dialogue NOUN dad-10733 254 3 extracted extract VERB dad-10733 254 4 from from ADP dad-10733 254 5 wizard wizard NOUN dad-10733 254 6 - - PUNCT dad-10733 254 7 of of ADP dad-10733 254 8 - - PUNCT dad-10733 254 9 oz oz NOUN dad-10733 254 10 human human ADJ dad-10733 254 11 experiments experiment NOUN dad-10733 254 12 , , PUNCT dad-10733 254 13 movie movie NOUN dad-10733 254 14 dialogues dialogue NOUN dad-10733 254 15 span span VERB dad-10733 254 16 many many ADJ dad-10733 254 17 different different ADJ dad-10733 254 18 topics topic NOUN dad-10733 254 19 and and CCONJ dad-10733 254 20 occur occur VERB dad-10733 254 21 in in ADP dad-10733 254 22 many many ADJ dad-10733 254 23 different different ADJ dad-10733 254 24 environments environment NOUN dad-10733 254 25 ( ( PUNCT dad-10733 254 26 webb webb NOUN dad-10733 254 27 , , PUNCT dad-10733 254 28 2010 2010 NUM dad-10733 254 29 ) ) PUNCT dad-10733 254 30 . . PUNCT dad-10733 255 1 they they PRON dad-10733 255 2 contain contain VERB dad-10733 255 3 different different ADJ dad-10733 255 4 actors actor NOUN dad-10733 255 5 with with ADP dad-10733 255 6 varying vary VERB dad-10733 255 7 intentions intention NOUN dad-10733 255 8 and and CCONJ dad-10733 255 9 relationships relationship NOUN dad-10733 255 10 to to ADP dad-10733 255 11 one one NUM dad-10733 255 12 another another DET dad-10733 255 13 , , PUNCT dad-10733 255 14 which which PRON dad-10733 255 15 could could AUX dad-10733 255 16 potentially potentially ADV dad-10733 255 17 allow allow VERB dad-10733 255 18 a a DET dad-10733 255 19 data data NOUN dad-10733 255 20 - - PUNCT dad-10733 255 21 driven drive VERB dad-10733 255 22 dialogue dialogue NOUN dad-10733 255 23 system system NOUN dad-10733 255 24 to to PART dad-10733 255 25 learn learn VERB dad-10733 255 26 to to PART dad-10733 255 27 personalize personalize VERB dad-10733 255 28 itself itself PRON dad-10733 255 29 to to ADP dad-10733 255 30 each each DET dad-10733 255 31 user user NOUN dad-10733 255 32 by by ADP dad-10733 255 33 identifying identify VERB dad-10733 255 34 different different ADJ dad-10733 255 35 interaction interaction NOUN dad-10733 255 36 patterns pattern NOUN dad-10733 255 37 ( ( PUNCT dad-10733 255 38 li li PROPN dad-10733 255 39 et et PROPN dad-10733 255 40 al al PROPN dad-10733 255 41 . . PROPN dad-10733 255 42 , , PUNCT dad-10733 255 43 2016 2016 NUM dad-10733 255 44 ) ) PUNCT dad-10733 255 45 . . PUNCT dad-10733 256 1 12 12 NUM dad-10733 256 2 a a DET dad-10733 256 3 survey survey NOUN dad-10733 256 4 of of ADP dad-10733 256 5 available available ADJ dad-10733 256 6 corpora corpora PROPN dad-10733 256 7 for for ADP dad-10733 256 8 building build VERB dad-10733 256 9 data data NOUN dad-10733 256 10 - - PUNCT dad-10733 256 11 driven drive VERB dad-10733 256 12 dialogue dialogue NOUN dad-10733 256 13 systems system NOUN dad-10733 256 14 3.6 3.6 NUM dad-10733 256 15 corpus corpus NOUN dad-10733 256 16 size size NOUN dad-10733 256 17 as as ADP dad-10733 256 18 in in ADP dad-10733 256 19 other other ADJ dad-10733 256 20 machine machine NOUN dad-10733 256 21 learning learning NOUN dad-10733 256 22 applications application NOUN dad-10733 256 23 such such ADJ dad-10733 256 24 as as ADP dad-10733 256 25 machine machine NOUN dad-10733 256 26 translation translation NOUN dad-10733 256 27 ( ( PUNCT dad-10733 256 28 al al PROPN dad-10733 256 29 - - PUNCT dad-10733 256 30 onaizan onaizan NOUN dad-10733 256 31 et et PROPN dad-10733 256 32 al al PROPN dad-10733 256 33 . . PROPN dad-10733 256 34 , , PUNCT dad-10733 256 35 2000 2000 NUM dad-10733 256 36 ; ; PUNCT dad-10733 256 37 gülçehre gülçehre PROPN dad-10733 256 38 et et PROPN dad-10733 256 39 al al PROPN dad-10733 256 40 . . PROPN dad-10733 256 41 , , PUNCT dad-10733 256 42 2015 2015 NUM dad-10733 256 43 ) ) PUNCT dad-10733 256 44 and and CCONJ dad-10733 256 45 speech speech NOUN dad-10733 256 46 recognition recognition NOUN dad-10733 256 47 ( ( PUNCT dad-10733 256 48 deng deng PROPN dad-10733 256 49 and and CCONJ dad-10733 256 50 li li PROPN dad-10733 256 51 , , PUNCT dad-10733 256 52 2013 2013 NUM dad-10733 256 53 ; ; PUNCT dad-10733 256 54 bengio bengio PROPN dad-10733 256 55 et et PROPN dad-10733 256 56 al al PROPN dad-10733 256 57 . . PROPN dad-10733 256 58 , , PUNCT dad-10733 256 59 2014 2014 NUM dad-10733 256 60 ) ) PUNCT dad-10733 256 61 , , PUNCT dad-10733 256 62 the the DET dad-10733 256 63 size size NOUN dad-10733 256 64 of of ADP dad-10733 256 65 the the DET dad-10733 256 66 dialogue dialogue NOUN dad-10733 256 67 corpus corpus NOUN dad-10733 256 68 is be AUX dad-10733 256 69 important important ADJ dad-10733 256 70 for for ADP dad-10733 256 71 building build VERB dad-10733 256 72 an an DET dad-10733 256 73 effective effective ADJ dad-10733 256 74 data data NOUN dad-10733 256 75 - - PUNCT dad-10733 256 76 driven drive VERB dad-10733 256 77 dialogue dialogue NOUN dad-10733 256 78 system system NOUN dad-10733 256 79 ( ( PUNCT dad-10733 256 80 lowe lowe PROPN dad-10733 256 81 et et PROPN dad-10733 256 82 al al PROPN dad-10733 256 83 . . PROPN dad-10733 256 84 , , PUNCT dad-10733 256 85 2015a 2015a NUM dad-10733 256 86 ; ; PUNCT dad-10733 256 87 serban serban PROPN dad-10733 256 88 et et PROPN dad-10733 256 89 al al PROPN dad-10733 256 90 . . PROPN dad-10733 256 91 , , PUNCT dad-10733 256 92 2016 2016 NUM dad-10733 256 93 ) ) PUNCT dad-10733 256 94 . . PUNCT dad-10733 257 1 there there PRON dad-10733 257 2 are be VERB dad-10733 257 3 two two NUM dad-10733 257 4 primary primary ADJ dad-10733 257 5 perspectives perspective NOUN dad-10733 257 6 on on ADP dad-10733 257 7 the the DET dad-10733 257 8 importance importance NOUN dad-10733 257 9 of of ADP dad-10733 257 10 dataset dataset ADJ dad-10733 257 11 size size NOUN dad-10733 257 12 for for ADP dad-10733 257 13 building build VERB dad-10733 257 14 data data NOUN dad-10733 257 15 - - PUNCT dad-10733 257 16 driven drive VERB dad-10733 257 17 dialogue dialogue NOUN dad-10733 257 18 systems system NOUN dad-10733 257 19 . . PUNCT dad-10733 258 1 the the DET dad-10733 258 2 first first ADJ dad-10733 258 3 perspective perspective NOUN dad-10733 258 4 comes come VERB dad-10733 258 5 from from ADP dad-10733 258 6 the the DET dad-10733 258 7 machine machine NOUN dad-10733 258 8 learning learn VERB dad-10733 258 9 literature literature NOUN dad-10733 258 10 : : PUNCT dad-10733 258 11 larger large ADJ dad-10733 258 12 datasets dataset NOUN dad-10733 258 13 place place VERB dad-10733 258 14 constraints constraint NOUN dad-10733 258 15 on on ADP dad-10733 258 16 the the DET dad-10733 258 17 dialogue dialogue NOUN dad-10733 258 18 model model NOUN dad-10733 258 19 trained train VERB dad-10733 258 20 from from ADP dad-10733 258 21 that that DET dad-10733 258 22 data data NOUN dad-10733 258 23 . . PUNCT dad-10733 259 1 datasets dataset NOUN dad-10733 259 2 with with ADP dad-10733 259 3 few few ADJ dad-10733 259 4 examples example NOUN dad-10733 259 5 typically typically ADV dad-10733 259 6 require require VERB dad-10733 259 7 strong strong ADJ dad-10733 259 8 structural structural ADJ dad-10733 259 9 priors prior NOUN dad-10733 259 10 placed place VERB dad-10733 259 11 on on ADP dad-10733 259 12 the the DET dad-10733 259 13 model model NOUN dad-10733 259 14 , , PUNCT dad-10733 259 15 such such ADJ dad-10733 259 16 as as ADP dad-10733 259 17 using use VERB dad-10733 259 18 a a DET dad-10733 259 19 modular modular ADJ dad-10733 259 20 system system NOUN dad-10733 259 21 , , PUNCT dad-10733 259 22 whereas whereas SCONJ dad-10733 259 23 large large ADJ dad-10733 259 24 datasets dataset NOUN dad-10733 259 25 can can AUX dad-10733 259 26 be be AUX dad-10733 259 27 used use VERB dad-10733 259 28 to to PART dad-10733 259 29 train train VERB dad-10733 259 30 end end VERB dad-10733 259 31 - - PUNCT dad-10733 259 32 to to ADP dad-10733 259 33 - - PUNCT dad-10733 259 34 end end NOUN dad-10733 259 35 dialogue dialogue NOUN dad-10733 259 36 systems system NOUN dad-10733 259 37 with with ADP dad-10733 259 38 less less ADJ dad-10733 259 39 a a DET dad-10733 259 40 priori priori ADJ dad-10733 259 41 structure structure NOUN dad-10733 259 42 . . PUNCT dad-10733 260 1 the the DET dad-10733 260 2 second second NOUN dad-10733 260 3 comes come VERB dad-10733 260 4 from from ADP dad-10733 260 5 a a DET dad-10733 260 6 statistical statistical ADJ dad-10733 260 7 natural natural ADJ dad-10733 260 8 language language NOUN dad-10733 260 9 processing processing NOUN dad-10733 260 10 perspective perspective NOUN dad-10733 260 11 : : PUNCT dad-10733 260 12 since since SCONJ dad-10733 260 13 the the DET dad-10733 260 14 statistical statistical ADJ dad-10733 260 15 complexity complexity NOUN dad-10733 260 16 of of ADP dad-10733 260 17 a a DET dad-10733 260 18 corpus corpus NOUN dad-10733 260 19 grows grow VERB dad-10733 260 20 with with ADP dad-10733 260 21 the the DET dad-10733 260 22 linguistic linguistic ADJ dad-10733 260 23 diversity diversity NOUN dad-10733 260 24 and and CCONJ dad-10733 260 25 number number NOUN dad-10733 260 26 of of ADP dad-10733 260 27 topics topic NOUN dad-10733 260 28 , , PUNCT dad-10733 260 29 the the DET dad-10733 260 30 number number NOUN dad-10733 260 31 of of ADP dad-10733 260 32 examples example NOUN dad-10733 260 33 required require VERB dad-10733 260 34 by by ADP dad-10733 260 35 a a DET dad-10733 260 36 machine machine NOUN dad-10733 260 37 learning learn VERB dad-10733 260 38 algorithm algorithm NOUN dad-10733 260 39 to to PART dad-10733 260 40 model model VERB dad-10733 260 41 the the DET dad-10733 260 42 patterns pattern NOUN dad-10733 260 43 in in ADP dad-10733 260 44 it it PRON dad-10733 260 45 will will AUX dad-10733 260 46 also also ADV dad-10733 260 47 grow grow VERB dad-10733 260 48 with with ADP dad-10733 260 49 the the DET dad-10733 260 50 linguistic linguistic ADJ dad-10733 260 51 diversity diversity NOUN dad-10733 260 52 and and CCONJ dad-10733 260 53 number number NOUN dad-10733 260 54 of of ADP dad-10733 260 55 topics topic NOUN dad-10733 260 56 . . PUNCT dad-10733 261 1 consider consider VERB dad-10733 261 2 two two NUM dad-10733 261 3 small small ADJ dad-10733 261 4 datasets dataset NOUN dad-10733 261 5 with with ADP dad-10733 261 6 the the DET dad-10733 261 7 same same ADJ dad-10733 261 8 number number NOUN dad-10733 261 9 of of ADP dad-10733 261 10 dialogues dialogue NOUN dad-10733 261 11 in in ADP dad-10733 261 12 the the DET dad-10733 261 13 domain domain NOUN dad-10733 261 14 of of ADP dad-10733 261 15 bus bus NOUN dad-10733 261 16 schedule schedule NOUN dad-10733 261 17 information information NOUN dad-10733 261 18 : : PUNCT dad-10733 261 19 in in SCONJ dad-10733 261 20 one one NUM dad-10733 261 21 dataset dataset VERB dad-10733 261 22 the the DET dad-10733 261 23 conversations conversation NOUN dad-10733 261 24 between between ADP dad-10733 261 25 the the DET dad-10733 261 26 users user NOUN dad-10733 261 27 and and CCONJ dad-10733 261 28 operator operator NOUN dad-10733 261 29 is be AUX dad-10733 261 30 natural natural ADJ dad-10733 261 31 , , PUNCT dad-10733 261 32 and and CCONJ dad-10733 261 33 the the DET dad-10733 261 34 operator operator NOUN dad-10733 261 35 can can AUX dad-10733 261 36 improvise improvise VERB dad-10733 261 37 and and CCONJ dad-10733 261 38 chitchat chitchat NOUN dad-10733 261 39 ; ; PUNCT dad-10733 261 40 in in ADP dad-10733 261 41 the the DET dad-10733 261 42 other other ADJ dad-10733 261 43 dataset dataset NOUN dad-10733 261 44 , , PUNCT dad-10733 261 45 the the DET dad-10733 261 46 operator operator NOUN dad-10733 261 47 reads read VERB dad-10733 261 48 from from ADP dad-10733 261 49 a a DET dad-10733 261 50 script script NOUN dad-10733 261 51 to to PART dad-10733 261 52 provide provide VERB dad-10733 261 53 the the DET dad-10733 261 54 bus bus NOUN dad-10733 261 55 information information NOUN dad-10733 261 56 . . PUNCT dad-10733 262 1 despite despite SCONJ dad-10733 262 2 having have VERB dad-10733 262 3 the the DET dad-10733 262 4 same same ADJ dad-10733 262 5 size size NOUN dad-10733 262 6 , , PUNCT dad-10733 262 7 the the DET dad-10733 262 8 second second ADJ dad-10733 262 9 dataset dataset NOUN dad-10733 262 10 will will AUX dad-10733 262 11 have have VERB dad-10733 262 12 less less ADJ dad-10733 262 13 linguistic linguistic ADJ dad-10733 262 14 diversity diversity NOUN dad-10733 262 15 and and CCONJ dad-10733 262 16 not not PART dad-10733 262 17 include include VERB dad-10733 262 18 chitchat chitchat NOUN dad-10733 262 19 topics topic NOUN dad-10733 262 20 . . PUNCT dad-10733 263 1 therefore therefore ADV dad-10733 263 2 , , PUNCT dad-10733 263 3 it it PRON dad-10733 263 4 will will AUX dad-10733 263 5 be be AUX dad-10733 263 6 easier easy ADJ dad-10733 263 7 to to PART dad-10733 263 8 train train VERB dad-10733 263 9 a a DET dad-10733 263 10 data data NOUN dad-10733 263 11 - - PUNCT dad-10733 263 12 driven drive VERB dad-10733 263 13 dialogue dialogue NOUN dad-10733 263 14 system system NOUN dad-10733 263 15 mimicking mimic VERB dad-10733 263 16 the the DET dad-10733 263 17 behaviour behaviour NOUN dad-10733 263 18 of of ADP dad-10733 263 19 the the DET dad-10733 263 20 operator operator NOUN dad-10733 263 21 in in ADP dad-10733 263 22 the the DET dad-10733 263 23 second second ADJ dad-10733 263 24 dataset dataset NOUN dad-10733 263 25 , , PUNCT dad-10733 263 26 however however ADV dad-10733 263 27 it it PRON dad-10733 263 28 will will AUX dad-10733 263 29 also also ADV dad-10733 263 30 exhibit exhibit VERB dad-10733 263 31 a a DET dad-10733 263 32 highly highly ADV dad-10733 263 33 pedantic pedantic ADJ dad-10733 263 34 style style NOUN dad-10733 263 35 and and CCONJ dad-10733 263 36 not not PART dad-10733 263 37 be be AUX dad-10733 263 38 able able ADJ dad-10733 263 39 to to PART dad-10733 263 40 chitchat chitchat VERB dad-10733 263 41 . . PUNCT dad-10733 264 1 in in ADP dad-10733 264 2 addition addition NOUN dad-10733 264 3 to to ADP dad-10733 264 4 this this PRON dad-10733 264 5 , , PUNCT dad-10733 264 6 to to PART dad-10733 264 7 have have VERB dad-10733 264 8 an an DET dad-10733 264 9 effective effective ADJ dad-10733 264 10 discussion discussion NOUN dad-10733 264 11 between between ADP dad-10733 264 12 any any DET dad-10733 264 13 two two NUM dad-10733 264 14 agents agent NOUN dad-10733 264 15 , , PUNCT dad-10733 264 16 their their PRON dad-10733 264 17 common common ADJ dad-10733 264 18 knowledge knowledge NOUN dad-10733 264 19 must must AUX dad-10733 264 20 be be AUX dad-10733 264 21 represented represent VERB dad-10733 264 22 and and CCONJ dad-10733 264 23 understood understand VERB dad-10733 264 24 by by ADP dad-10733 264 25 both both DET dad-10733 264 26 parties party NOUN dad-10733 264 27 . . PUNCT dad-10733 265 1 the the DET dad-10733 265 2 process process NOUN dad-10733 265 3 of of ADP dad-10733 265 4 establishing establish VERB dad-10733 265 5 this this DET dad-10733 265 6 common common ADJ dad-10733 265 7 knowledge knowledge NOUN dad-10733 265 8 , , PUNCT dad-10733 265 9 also also ADV dad-10733 265 10 known know VERB dad-10733 265 11 as as ADP dad-10733 265 12 grounding ground VERB dad-10733 265 13 , , PUNCT dad-10733 265 14 is be AUX dad-10733 265 15 especially especially ADV dad-10733 265 16 critical critical ADJ dad-10733 265 17 to to PART dad-10733 265 18 repair repair VERB dad-10733 265 19 misunderstandings misunderstanding NOUN dad-10733 265 20 between between ADP dad-10733 265 21 humans human NOUN dad-10733 265 22 and and CCONJ dad-10733 265 23 dialogue dialogue NOUN dad-10733 265 24 systems system NOUN dad-10733 265 25 ( ( PUNCT dad-10733 265 26 cahn cahn NOUN dad-10733 265 27 and and CCONJ dad-10733 265 28 brennan brennan PROPN dad-10733 265 29 , , PUNCT dad-10733 265 30 1999 1999 NUM dad-10733 265 31 ) ) PUNCT dad-10733 265 32 . . PUNCT dad-10733 266 1 since since SCONJ dad-10733 266 2 the the DET dad-10733 266 3 number number NOUN dad-10733 266 4 of of ADP dad-10733 266 5 misunderstandings misunderstanding NOUN dad-10733 266 6 can can AUX dad-10733 266 7 grow grow VERB dad-10733 266 8 with with ADP dad-10733 266 9 the the DET dad-10733 266 10 lexical lexical ADJ dad-10733 266 11 diversity diversity NOUN dad-10733 266 12 and and CCONJ dad-10733 266 13 number number NOUN dad-10733 266 14 of of ADP dad-10733 266 15 topics topic NOUN dad-10733 266 16 ( ( PUNCT dad-10733 266 17 e.g. e.g. ADV dad-10733 266 18 misunderstanding misunderstand VERB dad-10733 266 19 the the DET dad-10733 266 20 paraphrase paraphrase NOUN dad-10733 266 21 of of ADP dad-10733 266 22 an an DET dad-10733 266 23 existing exist VERB dad-10733 266 24 word word NOUN dad-10733 266 25 , , PUNCT dad-10733 266 26 or or CCONJ dad-10733 266 27 misunderstanding misunderstand VERB dad-10733 266 28 a a DET dad-10733 266 29 rarely rarely ADV dad-10733 266 30 seen see VERB dad-10733 266 31 keyword keyword NOUN dad-10733 266 32 ) ) PUNCT dad-10733 266 33 , , PUNCT dad-10733 266 34 the the DET dad-10733 266 35 number number NOUN dad-10733 266 36 of of ADP dad-10733 266 37 examples example NOUN dad-10733 266 38 required require VERB dad-10733 266 39 to to PART dad-10733 266 40 repair repair VERB dad-10733 266 41 these these DET dad-10733 266 42 grow grow NOUN dad-10733 266 43 with with ADP dad-10733 266 44 linguistic linguistic ADJ dad-10733 266 45 diversity diversity NOUN dad-10733 266 46 and and CCONJ dad-10733 266 47 topics topic NOUN dad-10733 266 48 . . PUNCT dad-10733 267 1 in in ADP dad-10733 267 2 particular particular ADJ dad-10733 267 3 , , PUNCT dad-10733 267 4 the the DET dad-10733 267 5 effect effect NOUN dad-10733 267 6 of of ADP dad-10733 267 7 linguistic linguistic ADJ dad-10733 267 8 diversity diversity NOUN dad-10733 267 9 has have AUX dad-10733 267 10 been be AUX dad-10733 267 11 observed observe VERB dad-10733 267 12 in in ADP dad-10733 267 13 practice practice NOUN dad-10733 267 14 : : PUNCT dad-10733 267 15 vinyals vinyal NOUN dad-10733 267 16 and and CCONJ dad-10733 267 17 le le X dad-10733 267 18 ( ( PUNCT dad-10733 267 19 2015 2015 NUM dad-10733 267 20 ) ) PUNCT dad-10733 267 21 train train VERB dad-10733 267 22 a a DET dad-10733 267 23 simple simple ADJ dad-10733 267 24 encoder encoder NOUN dad-10733 267 25 - - PUNCT dad-10733 267 26 decoder decoder NOUN dad-10733 267 27 neural neural ADJ dad-10733 267 28 network network NOUN dad-10733 267 29 on on ADP dad-10733 267 30 a a DET dad-10733 267 31 proprietary proprietary ADJ dad-10733 267 32 dataset dataset NOUN dad-10733 267 33 of of ADP dad-10733 267 34 technical technical ADJ dad-10733 267 35 support support NOUN dad-10733 267 36 dialogues dialogue NOUN dad-10733 267 37 . . PUNCT dad-10733 268 1 although although SCONJ dad-10733 268 2 it it PRON dad-10733 268 3 has have VERB dad-10733 268 4 a a DET dad-10733 268 5 similar similar ADJ dad-10733 268 6 size size NOUN dad-10733 268 7 and and CCONJ dad-10733 268 8 purpose purpose NOUN dad-10733 268 9 as as ADP dad-10733 268 10 the the DET dad-10733 268 11 ubuntu ubuntu ADJ dad-10733 268 12 dialogue dialogue NOUN dad-10733 268 13 corpus corpus PROPN dad-10733 268 14 ( ( PUNCT dad-10733 268 15 lowe lowe PROPN dad-10733 268 16 et et PROPN dad-10733 268 17 al al PROPN dad-10733 268 18 . . PROPN dad-10733 268 19 , , PUNCT dad-10733 268 20 2015a 2015a NUM dad-10733 268 21 ) ) PUNCT dad-10733 268 22 , , PUNCT dad-10733 268 23 the the DET dad-10733 268 24 qualitative qualitative ADJ dad-10733 268 25 examples example NOUN dad-10733 268 26 shown show VERB dad-10733 268 27 by by ADP dad-10733 268 28 vinyals vinyal NOUN dad-10733 268 29 and and CCONJ dad-10733 268 30 le le X dad-10733 268 31 ( ( PUNCT dad-10733 268 32 2015 2015 NUM dad-10733 268 33 ) ) PUNCT dad-10733 268 34 are be AUX dad-10733 268 35 significantly significantly ADV dad-10733 268 36 superior superior ADJ dad-10733 268 37 to to ADP dad-10733 268 38 those those PRON dad-10733 268 39 obtained obtain VERB dad-10733 268 40 by by ADP dad-10733 268 41 more more ADJ dad-10733 268 42 complex complex ADJ dad-10733 268 43 models model NOUN dad-10733 268 44 on on ADP dad-10733 268 45 the the DET dad-10733 268 46 ubuntu ubuntu ADJ dad-10733 268 47 corpus corpus PROPN dad-10733 268 48 ( ( PUNCT dad-10733 268 49 serban serban PROPN dad-10733 268 50 et et PROPN dad-10733 268 51 al al PROPN dad-10733 268 52 . . PROPN dad-10733 268 53 , , PUNCT dad-10733 268 54 2017a 2017a NUM dad-10733 268 55 ) ) PUNCT dad-10733 268 56 . . PUNCT dad-10733 269 1 this this DET dad-10733 269 2 result result NOUN dad-10733 269 3 may may AUX dad-10733 269 4 likely likely ADV dad-10733 269 5 be be AUX dad-10733 269 6 explained explain VERB dad-10733 269 7 in in ADP dad-10733 269 8 part part NOUN dad-10733 269 9 due due ADP dad-10733 269 10 to to ADP dad-10733 269 11 the the DET dad-10733 269 12 fact fact NOUN dad-10733 269 13 that that SCONJ dad-10733 269 14 technical technical ADJ dad-10733 269 15 support support NOUN dad-10733 269 16 operators operator NOUN dad-10733 269 17 often often ADV dad-10733 269 18 follow follow VERB dad-10733 269 19 a a DET dad-10733 269 20 comprehensive comprehensive ADJ dad-10733 269 21 script script NOUN dad-10733 269 22 for for ADP dad-10733 269 23 solving solve VERB dad-10733 269 24 problems problem NOUN dad-10733 269 25 . . PUNCT dad-10733 270 1 as as ADP dad-10733 270 2 such such ADJ dad-10733 270 3 , , PUNCT dad-10733 270 4 the the DET dad-10733 270 5 script script NOUN dad-10733 270 6 would would AUX dad-10733 270 7 reduce reduce VERB dad-10733 270 8 the the DET dad-10733 270 9 linguistic linguistic ADJ dad-10733 270 10 diversity diversity NOUN dad-10733 270 11 of of ADP dad-10733 270 12 their their PRON dad-10733 270 13 responses response NOUN dad-10733 270 14 . . PUNCT dad-10733 271 1 furthermore furthermore ADV dad-10733 271 2 , , PUNCT dad-10733 271 3 since since SCONJ dad-10733 271 4 the the DET dad-10733 271 5 majority majority NOUN dad-10733 271 6 of of ADP dad-10733 271 7 human human ADJ dad-10733 271 8 - - PUNCT dad-10733 271 9 human human ADJ dad-10733 271 10 dialogues dialogue NOUN dad-10733 271 11 are be AUX dad-10733 271 12 multi multi ADJ dad-10733 271 13 - - ADJ dad-10733 271 14 modal modal ADJ dad-10733 271 15 and and CCONJ dad-10733 271 16 highly highly ADV dad-10733 271 17 ambiguous ambiguous ADJ dad-10733 271 18 in in ADP dad-10733 271 19 nature nature NOUN dad-10733 271 20 ( ( PUNCT dad-10733 271 21 chartrand chartrand NOUN dad-10733 271 22 and and CCONJ dad-10733 271 23 bargh bargh PROPN dad-10733 271 24 , , PUNCT dad-10733 271 25 1999 1999 NUM dad-10733 271 26 ; ; PUNCT dad-10733 271 27 de de PROPN dad-10733 271 28 kok kok PROPN dad-10733 271 29 et et PROPN dad-10733 271 30 al al PROPN dad-10733 271 31 . . PROPN dad-10733 271 32 , , PUNCT dad-10733 271 33 2013 2013 NUM dad-10733 271 34 ) ) PUNCT dad-10733 271 35 , , PUNCT dad-10733 271 36 the the DET dad-10733 271 37 size size NOUN dad-10733 271 38 of of ADP dad-10733 271 39 the the DET dad-10733 271 40 corpus corpus NOUN dad-10733 271 41 may may AUX dad-10733 271 42 compensate compensate VERB dad-10733 271 43 for for ADP dad-10733 271 44 some some PRON dad-10733 271 45 of of ADP dad-10733 271 46 the the DET dad-10733 271 47 ambiguities ambiguity NOUN dad-10733 271 48 and and CCONJ dad-10733 271 49 missing miss VERB dad-10733 271 50 modalities modality NOUN dad-10733 271 51 . . PUNCT dad-10733 272 1 that that PRON dad-10733 272 2 is be AUX dad-10733 272 3 , , PUNCT dad-10733 272 4 humans human NOUN dad-10733 272 5 express express VERB dad-10733 272 6 themselves themselves PRON dad-10733 272 7 in in ADP dad-10733 272 8 conversation conversation NOUN dad-10733 272 9 through through ADP dad-10733 272 10 intonation intonation NOUN dad-10733 272 11 , , PUNCT dad-10733 272 12 emotional emotional ADJ dad-10733 272 13 undertones undertone NOUN dad-10733 272 14 , , PUNCT dad-10733 272 15 contextual contextual ADJ dad-10733 272 16 cues cue NOUN dad-10733 272 17 , , PUNCT dad-10733 272 18 body body NOUN dad-10733 272 19 language language NOUN dad-10733 272 20 , , PUNCT dad-10733 272 21 and and CCONJ dad-10733 272 22 other other ADJ dad-10733 272 23 aspects aspect NOUN dad-10733 272 24 which which PRON dad-10733 272 25 may may AUX dad-10733 272 26 not not PART dad-10733 272 27 be be AUX dad-10733 272 28 conveyed convey VERB dad-10733 272 29 fully fully ADV dad-10733 272 30 in in ADP dad-10733 272 31 dialogue dialogue NOUN dad-10733 272 32 corpora corpora PROPN dad-10733 272 33 . . PUNCT dad-10733 273 1 if if SCONJ dad-10733 273 2 the the DET dad-10733 273 3 corpus corpus NOUN dad-10733 273 4 is be AUX dad-10733 273 5 sufficiently sufficiently ADV dad-10733 273 6 large large ADJ dad-10733 273 7 , , PUNCT dad-10733 273 8 then then ADV dad-10733 273 9 the the DET dad-10733 273 10 resolved resolved ADJ dad-10733 273 11 ambiguities ambiguity NOUN dad-10733 273 12 and and CCONJ dad-10733 273 13 missing miss VERB dad-10733 273 14 modalities modality NOUN dad-10733 273 15 may may AUX dad-10733 273 16 , , PUNCT dad-10733 273 17 for for ADP dad-10733 273 18 example example NOUN dad-10733 273 19 , , PUNCT dad-10733 273 20 be be AUX dad-10733 273 21 approximated approximate VERB dad-10733 273 22 using use VERB dad-10733 273 23 latent latent NOUN dad-10733 273 24 stochastic stochastic ADJ dad-10733 273 25 variables variable NOUN dad-10733 273 26 ( ( PUNCT dad-10733 273 27 serban serban PROPN dad-10733 273 28 et et PROPN dad-10733 273 29 al al PROPN dad-10733 273 30 . . PROPN dad-10733 273 31 , , PUNCT dad-10733 273 32 2017d 2017d NUM dad-10733 273 33 ) ) PUNCT dad-10733 273 34 . . PUNCT dad-10733 274 1 thus thus ADV dad-10733 274 2 , , PUNCT dad-10733 274 3 we we PRON dad-10733 274 4 include include VERB dad-10733 274 5 corpus corpus NOUN dad-10733 274 6 size size NOUN dad-10733 274 7 as as ADP dad-10733 274 8 a a DET dad-10733 274 9 dimension dimension NOUN dad-10733 274 10 of of ADP dad-10733 274 11 analysis analysis NOUN dad-10733 274 12 . . PUNCT dad-10733 275 1 we we PRON dad-10733 275 2 also also ADV dad-10733 275 3 discuss discuss VERB dad-10733 275 4 the the DET dad-10733 275 5 benefits benefit NOUN dad-10733 275 6 and and CCONJ dad-10733 275 7 drawbacks drawback NOUN dad-10733 275 8 of of ADP dad-10733 275 9 several several ADJ dad-10733 275 10 popular popular ADJ dad-10733 275 11 large large ADJ dad-10733 275 12 - - PUNCT dad-10733 275 13 scale scale NOUN dad-10733 275 14 datasets dataset NOUN dad-10733 275 15 in in ADP dad-10733 275 16 section section NOUN dad-10733 275 17 5.1 5.1 NUM dad-10733 275 18 . . PUNCT dad-10733 276 1 13 13 NUM dad-10733 276 2 serban serban PROPN dad-10733 276 3 , , PUNCT dad-10733 276 4 lowe lowe PROPN dad-10733 276 5 , , PUNCT dad-10733 276 6 henderson henderson PROPN dad-10733 276 7 , , PUNCT dad-10733 276 8 charlin charlin PROPN dad-10733 276 9 and and CCONJ dad-10733 276 10 pineau pineau PROPN dad-10733 276 11 4 4 NUM dad-10733 276 12 . . PUNCT dad-10733 276 13 available available ADJ dad-10733 276 14 dialogue dialogue NOUN dad-10733 276 15 datasets dataset NOUN dad-10733 276 16 there there PRON dad-10733 276 17 is be VERB dad-10733 276 18 a a DET dad-10733 276 19 vast vast ADJ dad-10733 276 20 amount amount NOUN dad-10733 276 21 of of ADP dad-10733 276 22 data datum NOUN dad-10733 276 23 available available ADJ dad-10733 276 24 documenting document VERB dad-10733 276 25 human human ADJ dad-10733 276 26 communication communication NOUN dad-10733 276 27 . . PUNCT dad-10733 277 1 much much ADJ dad-10733 277 2 of of ADP dad-10733 277 3 this this DET dad-10733 277 4 data datum NOUN dad-10733 277 5 could could AUX dad-10733 277 6 be be AUX dad-10733 277 7 used use VERB dad-10733 277 8 — — PUNCT dad-10733 277 9 perhaps perhaps ADV dad-10733 277 10 after after SCONJ dad-10733 277 11 some some DET dad-10733 277 12 pre pre ADJ dad-10733 277 13 - - ADJ dad-10733 277 14 processing processing NOUN dad-10733 277 15 — — PUNCT dad-10733 277 16 to to PART dad-10733 277 17 train train VERB dad-10733 277 18 a a DET dad-10733 277 19 dialogue dialogue NOUN dad-10733 277 20 system system NOUN dad-10733 277 21 . . PUNCT dad-10733 278 1 however however ADV dad-10733 278 2 , , PUNCT dad-10733 278 3 covering cover VERB dad-10733 278 4 all all DET dad-10733 278 5 such such ADJ dad-10733 278 6 sources source NOUN dad-10733 278 7 of of ADP dad-10733 278 8 data datum NOUN dad-10733 278 9 would would AUX dad-10733 278 10 be be AUX dad-10733 278 11 infeasible infeasible ADJ dad-10733 278 12 . . PUNCT dad-10733 279 1 thus thus ADV dad-10733 279 2 , , PUNCT dad-10733 279 3 we we PRON dad-10733 279 4 restrict restrict VERB dad-10733 279 5 the the DET dad-10733 279 6 scope scope NOUN dad-10733 279 7 of of ADP dad-10733 279 8 this this DET dad-10733 279 9 survey survey NOUN dad-10733 279 10 to to ADP dad-10733 279 11 datasets dataset NOUN dad-10733 279 12 that that PRON dad-10733 279 13 have have AUX dad-10733 279 14 already already ADV dad-10733 279 15 been be AUX dad-10733 279 16 used use VERB dad-10733 279 17 to to PART dad-10733 279 18 study study VERB dad-10733 279 19 dialogue dialogue NOUN dad-10733 279 20 or or CCONJ dad-10733 279 21 build build VERB dad-10733 279 22 dialogue dialogue NOUN dad-10733 279 23 systems system NOUN dad-10733 279 24 or or CCONJ dad-10733 279 25 which which PRON dad-10733 279 26 could could AUX dad-10733 279 27 be be AUX dad-10733 279 28 leveraged leverage VERB dad-10733 279 29 in in ADP dad-10733 279 30 the the DET dad-10733 279 31 near near ADJ dad-10733 279 32 future future NOUN dad-10733 279 33 to to PART dad-10733 279 34 build build VERB dad-10733 279 35 more more ADV dad-10733 279 36 sophisticated sophisticated ADJ dad-10733 279 37 data data NOUN dad-10733 279 38 - - PUNCT dad-10733 279 39 driven drive VERB dad-10733 279 40 dialogue dialogue NOUN dad-10733 279 41 models model NOUN dad-10733 279 42 ( ( PUNCT dad-10733 279 43 due due ADP dad-10733 279 44 to to ADP dad-10733 279 45 properties property NOUN dad-10733 279 46 of of ADP dad-10733 279 47 dataset dataset ADJ dad-10733 279 48 size size NOUN dad-10733 279 49 or or CCONJ dad-10733 279 50 annotations annotation NOUN dad-10733 279 51 useful useful ADJ dad-10733 279 52 for for ADP dad-10733 279 53 different different ADJ dad-10733 279 54 data data NOUN dad-10733 279 55 - - PUNCT dad-10733 279 56 driven drive VERB dad-10733 279 57 dialogue dialogue NOUN dad-10733 279 58 components component NOUN dad-10733 279 59 ) ) PUNCT dad-10733 279 60 . . PUNCT dad-10733 280 1 we we PRON dad-10733 280 2 restrict restrict VERB dad-10733 280 3 the the DET dad-10733 280 4 selection selection NOUN dad-10733 280 5 further far ADV dad-10733 280 6 to to PART dad-10733 280 7 contain contain VERB dad-10733 280 8 only only ADV dad-10733 280 9 corpora corpora PROPN dad-10733 280 10 generated generate VERB dad-10733 280 11 from from ADP dad-10733 280 12 spoken speak VERB dad-10733 280 13 or or CCONJ dad-10733 280 14 written write VERB dad-10733 280 15 english english PROPN dad-10733 280 16 , , PUNCT dad-10733 280 17 and and CCONJ dad-10733 280 18 to to PART dad-10733 280 19 corpora corpora VERB dad-10733 280 20 which which PRON dad-10733 280 21 , , PUNCT dad-10733 280 22 to to ADP dad-10733 280 23 the the DET dad-10733 280 24 best good ADJ dad-10733 280 25 of of ADP dad-10733 280 26 our our PRON dad-10733 280 27 knowledge knowledge NOUN dad-10733 280 28 , , PUNCT dad-10733 280 29 either either CCONJ dad-10733 280 30 are be AUX dad-10733 280 31 publicly publicly ADV dad-10733 280 32 available available ADJ dad-10733 280 33 or or CCONJ dad-10733 280 34 will will AUX dad-10733 280 35 be be AUX dad-10733 280 36 made make VERB dad-10733 280 37 available available ADJ dad-10733 280 38 in in ADP dad-10733 280 39 the the DET dad-10733 280 40 near near ADJ dad-10733 280 41 future future NOUN dad-10733 280 42 . . PUNCT dad-10733 281 1 we we PRON dad-10733 281 2 first first ADV dad-10733 281 3 give give VERB dad-10733 281 4 a a DET dad-10733 281 5 brief brief ADJ dad-10733 281 6 overview overview NOUN dad-10733 281 7 of of ADP dad-10733 281 8 each each PRON dad-10733 281 9 of of ADP dad-10733 281 10 the the DET dad-10733 281 11 considered consider VERB dad-10733 281 12 corpora corpora PROPN dad-10733 281 13 . . PUNCT dad-10733 282 1 later later ADV dad-10733 282 2 , , PUNCT dad-10733 282 3 we we PRON dad-10733 282 4 highlight highlight VERB dad-10733 282 5 promising promise VERB dad-10733 282 6 examples example NOUN dad-10733 282 7 and and CCONJ dad-10733 282 8 explain explain VERB dad-10733 282 9 how how SCONJ dad-10733 282 10 they they PRON dad-10733 282 11 could could AUX dad-10733 282 12 be be AUX dad-10733 282 13 used use VERB dad-10733 282 14 to to PART dad-10733 282 15 further further ADJ dad-10733 282 16 dialogue dialogue VERB dad-10733 282 17 research.3 research.3 NOUN dad-10733 282 18 the the DET dad-10733 282 19 dialogue dialogue NOUN dad-10733 282 20 datasets dataset NOUN dad-10733 282 21 analyzed analyze VERB dad-10733 282 22 are be AUX dad-10733 282 23 listed list VERB dad-10733 282 24 in in ADP dad-10733 282 25 tables table NOUN dad-10733 282 26 1–5 1–5 NUM dad-10733 282 27 . . PUNCT dad-10733 282 28 column column NOUN dad-10733 282 29 features feature NOUN dad-10733 282 30 indicate indicate VERB dad-10733 282 31 properties property NOUN dad-10733 282 32 of of ADP dad-10733 282 33 the the DET dad-10733 282 34 datasets dataset NOUN dad-10733 282 35 , , PUNCT dad-10733 282 36 including include VERB dad-10733 282 37 the the DET dad-10733 282 38 number number NOUN dad-10733 282 39 of of ADP dad-10733 282 40 dialogues dialogue NOUN dad-10733 282 41 , , PUNCT dad-10733 282 42 average average ADJ dad-10733 282 43 dialogue dialogue NOUN dad-10733 282 44 length length NOUN dad-10733 282 45 , , PUNCT dad-10733 282 46 number number NOUN dad-10733 282 47 of of ADP dad-10733 282 48 words word NOUN dad-10733 282 49 , , PUNCT dad-10733 282 50 whether whether SCONJ dad-10733 282 51 the the DET dad-10733 282 52 interactions interaction NOUN dad-10733 282 53 are be AUX dad-10733 282 54 between between ADP dad-10733 282 55 humans human NOUN dad-10733 282 56 or or CCONJ dad-10733 282 57 with with ADP dad-10733 282 58 an an DET dad-10733 282 59 automated automate VERB dad-10733 282 60 system system NOUN dad-10733 282 61 , , PUNCT dad-10733 282 62 and and CCONJ dad-10733 282 63 whether whether SCONJ dad-10733 282 64 the the DET dad-10733 282 65 dialogues dialogue NOUN dad-10733 282 66 are be AUX dad-10733 282 67 written write VERB dad-10733 282 68 or or CCONJ dad-10733 282 69 spoken speak VERB dad-10733 282 70 . . PUNCT dad-10733 283 1 below below ADV dad-10733 283 2 , , PUNCT dad-10733 283 3 we we PRON dad-10733 283 4 discuss discuss VERB dad-10733 283 5 qualitative qualitative ADJ dad-10733 283 6 features feature NOUN dad-10733 283 7 of of ADP dad-10733 283 8 the the DET dad-10733 283 9 datasets dataset NOUN dad-10733 283 10 , , PUNCT dad-10733 283 11 while while SCONJ dad-10733 283 12 statistics statistic NOUN dad-10733 283 13 can can AUX dad-10733 283 14 be be AUX dad-10733 283 15 found find VERB dad-10733 283 16 in in ADP dad-10733 283 17 the the DET dad-10733 283 18 aforementioned aforementioned ADJ dad-10733 283 19 table table NOUN dad-10733 283 20 . . PUNCT dad-10733 284 1 we we PRON dad-10733 284 2 generally generally ADV dad-10733 284 3 divide divide VERB dad-10733 284 4 the the DET dad-10733 284 5 corpora corpora NOUN dad-10733 284 6 according accord VERB dad-10733 284 7 to to ADP dad-10733 284 8 the the DET dad-10733 284 9 main main ADJ dad-10733 284 10 characteristics characteristic NOUN dad-10733 284 11 mentioned mention VERB dad-10733 284 12 previously previously ADV dad-10733 284 13 : : PUNCT dad-10733 284 14 human human ADJ dad-10733 284 15 - - PUNCT dad-10733 284 16 machine machine NOUN dad-10733 284 17 corpora corpora NOUN dad-10733 284 18 ( ( PUNCT dad-10733 284 19 including include VERB dad-10733 284 20 spoken speak VERB dad-10733 284 21 and and CCONJ dad-10733 284 22 written write VERB dad-10733 284 23 systems system NOUN dad-10733 284 24 ) ) PUNCT dad-10733 284 25 , , PUNCT dad-10733 284 26 human human NOUN dad-10733 284 27 - - PUNCT dad-10733 284 28 human human NOUN dad-10733 284 29 spontaneous spontaneous ADJ dad-10733 284 30 ( ( PUNCT dad-10733 284 31 unconstrained unconstrained ADJ dad-10733 284 32 ) ) PUNCT dad-10733 284 33 spoken speak VERB dad-10733 284 34 corpora corpora PROPN dad-10733 284 35 , , PUNCT dad-10733 284 36 human human ADJ dad-10733 284 37 - - PUNCT dad-10733 284 38 human human NOUN dad-10733 284 39 constrained constrain VERB dad-10733 284 40 spoken speak VERB dad-10733 284 41 corpora corpora PROPN dad-10733 284 42 , , PUNCT dad-10733 284 43 human human ADJ dad-10733 284 44 - - PUNCT dad-10733 284 45 human human NOUN dad-10733 284 46 scripted script VERB dad-10733 284 47 ( ( PUNCT dad-10733 284 48 mostly mostly ADV dad-10733 284 49 fictional fictional ADJ dad-10733 284 50 ) ) PUNCT dad-10733 284 51 spoken speak VERB dad-10733 284 52 corpora corpora PROPN dad-10733 284 53 , , PUNCT dad-10733 284 54 human human ADJ dad-10733 284 55 - - PUNCT dad-10733 284 56 human human NOUN dad-10733 284 57 spontaneous spontaneous ADJ dad-10733 284 58 ( ( PUNCT dad-10733 284 59 unconstrained unconstrained ADJ dad-10733 284 60 ) ) PUNCT dad-10733 284 61 written write VERB dad-10733 284 62 corpora corpora PROPN dad-10733 284 63 , , PUNCT dad-10733 284 64 and and CCONJ dad-10733 284 65 human human ADJ dad-10733 284 66 - - PUNCT dad-10733 284 67 human human NOUN dad-10733 284 68 constrained constrain VERB dad-10733 284 69 written write VERB dad-10733 284 70 corpora corpora PROPN dad-10733 284 71 . . PUNCT dad-10733 285 1 4.1 4.1 NUM dad-10733 285 2 human human ADJ dad-10733 285 3 - - PUNCT dad-10733 285 4 machine machine NOUN dad-10733 285 5 corpora corpora NOUN dad-10733 285 6 as as SCONJ dad-10733 285 7 discussed discuss VERB dad-10733 285 8 in in ADP dad-10733 285 9 subsection subsection NOUN dad-10733 285 10 3.2 3.2 NUM dad-10733 285 11 , , PUNCT dad-10733 285 12 an an DET dad-10733 285 13 important important ADJ dad-10733 285 14 distinction distinction NOUN dad-10733 285 15 between between ADP dad-10733 285 16 dialogue dialogue NOUN dad-10733 285 17 datasets dataset NOUN dad-10733 285 18 is be AUX dad-10733 285 19 whether whether SCONJ dad-10733 285 20 they they PRON dad-10733 285 21 consist consist VERB dad-10733 285 22 of of ADP dad-10733 285 23 dialogues dialogue NOUN dad-10733 285 24 between between ADP dad-10733 285 25 two two NUM dad-10733 285 26 humans human NOUN dad-10733 285 27 or or CCONJ dad-10733 285 28 between between ADP dad-10733 285 29 a a DET dad-10733 285 30 human human NOUN dad-10733 285 31 and and CCONJ dad-10733 285 32 a a DET dad-10733 285 33 machine machine NOUN dad-10733 285 34 . . PUNCT dad-10733 286 1 thus thus ADV dad-10733 286 2 , , PUNCT dad-10733 286 3 we we PRON dad-10733 286 4 begin begin VERB dad-10733 286 5 by by ADP dad-10733 286 6 outlining outline VERB dad-10733 286 7 some some PRON dad-10733 286 8 of of ADP dad-10733 286 9 the the DET dad-10733 286 10 existing exist VERB dad-10733 286 11 human human NOUN dad-10733 286 12 - - PUNCT dad-10733 286 13 machine machine NOUN dad-10733 286 14 corpora corpora NOUN dad-10733 286 15 in in ADP dad-10733 286 16 several several ADJ dad-10733 286 17 categories category NOUN dad-10733 286 18 based base VERB dad-10733 286 19 on on ADP dad-10733 286 20 the the DET dad-10733 286 21 types type NOUN dad-10733 286 22 of of ADP dad-10733 286 23 systems system NOUN dad-10733 286 24 the the DET dad-10733 286 25 humans human NOUN dad-10733 286 26 interact interact VERB dad-10733 286 27 with with ADP dad-10733 286 28 : : PUNCT dad-10733 286 29 restaurant restaurant NOUN dad-10733 286 30 and and CCONJ dad-10733 286 31 travel travel NOUN dad-10733 286 32 information information NOUN dad-10733 286 33 , , PUNCT dad-10733 286 34 open open ADJ dad-10733 286 35 - - PUNCT dad-10733 286 36 domain domain NOUN dad-10733 286 37 knowledge knowledge NOUN dad-10733 286 38 retrieval retrieval NOUN dad-10733 286 39 , , PUNCT dad-10733 286 40 and and CCONJ dad-10733 286 41 other other ADJ dad-10733 286 42 specialized specialized ADJ dad-10733 286 43 systems system NOUN dad-10733 286 44 . . PUNCT dad-10733 287 1 note note NOUN dad-10733 287 2 , , PUNCT dad-10733 287 3 we we PRON dad-10733 287 4 also also ADV dad-10733 287 5 include include VERB dad-10733 287 6 human human ADJ dad-10733 287 7 - - PUNCT dad-10733 287 8 human human NOUN dad-10733 287 9 corpora corpora NOUN dad-10733 287 10 here here ADV dad-10733 287 11 where where SCONJ dad-10733 287 12 one one NUM dad-10733 287 13 human human NOUN dad-10733 287 14 plays play VERB dad-10733 287 15 the the DET dad-10733 287 16 role role NOUN dad-10733 287 17 of of ADP dad-10733 287 18 the the DET dad-10733 287 19 machine machine NOUN dad-10733 287 20 in in ADP dad-10733 287 21 a a DET dad-10733 287 22 wizard wizard NOUN dad-10733 287 23 - - PUNCT dad-10733 287 24 of of ADP dad-10733 287 25 - - PUNCT dad-10733 287 26 oz oz NOUN dad-10733 287 27 fashion fashion NOUN dad-10733 287 28 . . PUNCT dad-10733 288 1 4.1.1 4.1.1 NUM dad-10733 288 2 restaurant restaurant NOUN dad-10733 288 3 and and CCONJ dad-10733 288 4 travel travel NOUN dad-10733 288 5 information information NOUN dad-10733 288 6 one one NUM dad-10733 288 7 common common ADJ dad-10733 288 8 theme theme NOUN dad-10733 288 9 in in ADP dad-10733 288 10 human human ADJ dad-10733 288 11 - - PUNCT dad-10733 288 12 machine machine NOUN dad-10733 288 13 language language NOUN dad-10733 288 14 datasets dataset NOUN dad-10733 288 15 is be AUX dad-10733 288 16 interaction interaction NOUN dad-10733 288 17 with with ADP dad-10733 288 18 systems system NOUN dad-10733 288 19 that that PRON dad-10733 288 20 provide provide VERB dad-10733 288 21 restaurant restaurant NOUN dad-10733 288 22 or or CCONJ dad-10733 288 23 travel travel NOUN dad-10733 288 24 information information NOUN dad-10733 288 25 . . PUNCT dad-10733 289 1 here here ADV dad-10733 289 2 we we PRON dad-10733 289 3 briefly briefly ADV dad-10733 289 4 describe describe VERB dad-10733 289 5 some some DET dad-10733 289 6 human human ADJ dad-10733 289 7 - - PUNCT dad-10733 289 8 machine machine NOUN dad-10733 289 9 dialogue dialogue NOUN dad-10733 289 10 datasets dataset NOUN dad-10733 289 11 in in ADP dad-10733 289 12 this this DET dad-10733 289 13 domain domain NOUN dad-10733 289 14 . . PUNCT dad-10733 290 1 one one NUM dad-10733 290 2 of of ADP dad-10733 290 3 the the DET dad-10733 290 4 early early ADJ dad-10733 290 5 and and CCONJ dad-10733 290 6 most most ADV dad-10733 290 7 influential influential ADJ dad-10733 290 8 sources source NOUN dad-10733 290 9 of of ADP dad-10733 290 10 such such ADJ dad-10733 290 11 data datum NOUN dad-10733 290 12 is be AUX dad-10733 290 13 the the DET dad-10733 290 14 let let VERB dad-10733 290 15 ’s ’s NOUN dad-10733 290 16 go go VERB dad-10733 290 17 ! ! PUNCT dad-10733 291 1 dataset dataset NOUN dad-10733 291 2 ( ( PUNCT dad-10733 291 3 raux raux PROPN dad-10733 291 4 et et PROPN dad-10733 291 5 al al PROPN dad-10733 291 6 . . PROPN dad-10733 291 7 , , PUNCT dad-10733 291 8 2005 2005 NUM dad-10733 291 9 ) ) PUNCT dad-10733 291 10 , , PUNCT dad-10733 291 11 which which PRON dad-10733 291 12 was be AUX dad-10733 291 13 collected collect VERB dad-10733 291 14 from from ADP dad-10733 291 15 people people NOUN dad-10733 291 16 calling call VERB dad-10733 291 17 a a DET dad-10733 291 18 bus bus NOUN dad-10733 291 19 scheduling scheduling NOUN dad-10733 291 20 service service NOUN dad-10733 291 21 at at ADP dad-10733 291 22 off off ADP dad-10733 291 23 - - PUNCT dad-10733 291 24 peak peak NOUN dad-10733 291 25 times.4 times.4 NOUN dad-10733 291 26 the the DET dad-10733 291 27 dataset dataset NOUN dad-10733 291 28 provides provide VERB dad-10733 291 29 over over ADP dad-10733 291 30 170,000 170,000 NUM dad-10733 291 31 conversations conversation NOUN dad-10733 291 32 recorded record VERB dad-10733 291 33 between between ADP dad-10733 291 34 an an DET dad-10733 291 35 automated automate VERB dad-10733 291 36 bus bus NOUN dad-10733 291 37 information information NOUN dad-10733 291 38 system system NOUN dad-10733 291 39 and and CCONJ dad-10733 291 40 callers caller NOUN dad-10733 291 41 requesting request VERB dad-10733 291 42 bus bus NOUN dad-10733 291 43 schedule schedule NOUN dad-10733 291 44 information information NOUN dad-10733 291 45 . . PUNCT dad-10733 292 1 one one NUM dad-10733 292 2 of of ADP dad-10733 292 3 the the DET dad-10733 292 4 more more ADV dad-10733 292 5 recent recent ADJ dad-10733 292 6 sources source NOUN dad-10733 292 7 of of ADP dad-10733 292 8 such such ADJ dad-10733 292 9 data datum NOUN dad-10733 292 10 has have AUX dad-10733 292 11 come come VERB dad-10733 292 12 from from ADP dad-10733 292 13 the the DET dad-10733 292 14 datasets dataset NOUN dad-10733 292 15 for for ADP dad-10733 292 16 structured structured ADJ dad-10733 292 17 dialogue dialogue NOUN dad-10733 292 18 prediction prediction NOUN dad-10733 292 19 released release VERB dad-10733 292 20 in in ADP dad-10733 292 21 conjunction conjunction NOUN dad-10733 292 22 with with ADP dad-10733 292 23 the the DET dad-10733 292 24 dialog dialog NOUN dad-10733 292 25 state state NOUN dad-10733 292 26 tracking tracking NOUN dad-10733 292 27 challenge challenge NOUN dad-10733 292 28 ( ( PUNCT dad-10733 292 29 dstc dstc NOUN dad-10733 292 30 ) ) PUNCT dad-10733 292 31 ( ( PUNCT dad-10733 292 32 williams williams PROPN dad-10733 292 33 et et PROPN dad-10733 292 34 al al PROPN dad-10733 292 35 . . PROPN dad-10733 292 36 , , PUNCT dad-10733 292 37 2013 2013 NUM dad-10733 292 38 ) ) PUNCT dad-10733 292 39 . . PUNCT dad-10733 293 1 as as SCONJ dad-10733 293 2 the the DET dad-10733 293 3 name name NOUN dad-10733 293 4 implies imply VERB dad-10733 293 5 , , PUNCT dad-10733 293 6 these these DET dad-10733 293 7 datasets dataset NOUN dad-10733 293 8 are be AUX dad-10733 293 9 used use VERB dad-10733 293 10 to to PART dad-10733 293 11 learn learn VERB dad-10733 293 12 a a DET dad-10733 293 13 strategy strategy NOUN dad-10733 293 14 for for ADP dad-10733 293 15 dialogue dialogue NOUN dad-10733 293 16 state state NOUN dad-10733 293 17 3 3 X dad-10733 293 18 . . PUNCT dad-10733 294 1 we we PRON dad-10733 294 2 form form VERB dad-10733 294 3 a a DET dad-10733 294 4 live live ADJ dad-10733 294 5 list list NOUN dad-10733 294 6 of of ADP dad-10733 294 7 the the DET dad-10733 294 8 corpora corpora NOUN dad-10733 294 9 discussed discuss VERB dad-10733 294 10 in in ADP dad-10733 294 11 this this DET dad-10733 294 12 work work NOUN dad-10733 294 13 , , PUNCT dad-10733 294 14 along along ADP dad-10733 294 15 with with ADP dad-10733 294 16 links link NOUN dad-10733 294 17 to to ADP dad-10733 294 18 downloads download NOUN dad-10733 294 19 , , PUNCT dad-10733 294 20 at at ADP dad-10733 294 21 : : PUNCT dad-10733 294 22 http://breakend http://breakend NOUN dad-10733 294 23 . . PUNCT dad-10733 294 24 github.io/dialogdatasets github.io/dialogdataset NOUN dad-10733 294 25 . . PUNCT dad-10733 295 1 pull pull NOUN dad-10733 295 2 requests request NOUN dad-10733 295 3 can can AUX dad-10733 295 4 be be AUX dad-10733 295 5 made make VERB dad-10733 295 6 to to ADP dad-10733 295 7 the the DET dad-10733 295 8 github github PROPN dad-10733 295 9 repository repository NOUN dad-10733 295 10 ( ( PUNCT dad-10733 295 11 https://github https://github PROPN dad-10733 295 12 . . PUNCT dad-10733 295 13 com com NOUN dad-10733 295 14 / / SYM dad-10733 295 15 breakend breakend NOUN dad-10733 295 16 / / SYM dad-10733 295 17 dialogdatasets dialogdataset NOUN dad-10733 295 18 ) ) PUNCT dad-10733 295 19 hosting host VERB dad-10733 295 20 the the DET dad-10733 295 21 website website NOUN dad-10733 295 22 for for ADP dad-10733 295 23 continuing continue VERB dad-10733 295 24 updates update NOUN dad-10733 295 25 to to ADP dad-10733 295 26 the the DET dad-10733 295 27 list list NOUN dad-10733 295 28 of of ADP dad-10733 295 29 corpora corpora PROPN dad-10733 295 30 . . PUNCT dad-10733 296 1 4 4 X dad-10733 296 2 . . X dad-10733 296 3 see see VERB dad-10733 296 4 https://dialrc.github.io/letsgodataset/. https://dialrc.github.io/letsgodataset/. PROPN dad-10733 296 5 14 14 NUM dad-10733 296 6 http://breakend.github.io/dialogdatasets http://breakend.github.io/dialogdataset NOUN dad-10733 296 7 http://breakend.github.io/dialogdatasets http://breakend.github.io/dialogdataset NOUN dad-10733 296 8 https://github.com/breakend/dialogdatasets https://github.com/breakend/dialogdataset NOUN dad-10733 296 9 https://github.com/breakend/dialogdatasets https://github.com/breakend/dialogdataset VERB dad-10733 296 10 https://dialrc.github.io/letsgodataset/ https://dialrc.github.io/letsgodataset/ PRON dad-10733 296 11 a a DET dad-10733 296 12 survey survey NOUN dad-10733 296 13 of of ADP dad-10733 296 14 available available ADJ dad-10733 296 15 corpora corpora PROPN dad-10733 296 16 for for ADP dad-10733 296 17 building build VERB dad-10733 296 18 data data NOUN dad-10733 296 19 - - PUNCT dad-10733 296 20 driven drive VERB dad-10733 296 21 dialogue dialogue NOUN dad-10733 296 22 systems system NOUN dad-10733 296 23 tracking tracking NOUN dad-10733 296 24 ( ( PUNCT dad-10733 296 25 sometimes sometimes ADV dad-10733 296 26 called call VERB dad-10733 296 27 “ " PUNCT dad-10733 296 28 belief belief NOUN dad-10733 296 29 tracking tracking NOUN dad-10733 296 30 ” " PUNCT dad-10733 296 31 ) ) PUNCT dad-10733 296 32 , , PUNCT dad-10733 296 33 which which PRON dad-10733 296 34 involves involve VERB dad-10733 296 35 estimating estimate VERB dad-10733 296 36 the the DET dad-10733 296 37 intentions intention NOUN dad-10733 296 38 of of ADP dad-10733 296 39 a a DET dad-10733 296 40 user user NOUN dad-10733 296 41 throughout throughout ADP dad-10733 296 42 a a DET dad-10733 296 43 dialog dialog NOUN dad-10733 296 44 . . PUNCT dad-10733 297 1 state state NOUN dad-10733 297 2 tracking tracking NOUN dad-10733 297 3 is be AUX dad-10733 297 4 useful useful ADJ dad-10733 297 5 as as SCONJ dad-10733 297 6 it it PRON dad-10733 297 7 can can AUX dad-10733 297 8 increase increase VERB dad-10733 297 9 the the DET dad-10733 297 10 robustness robustness NOUN dad-10733 297 11 of of ADP dad-10733 297 12 speech speech NOUN dad-10733 297 13 recognition recognition NOUN dad-10733 297 14 systems system NOUN dad-10733 297 15 , , PUNCT dad-10733 297 16 and and CCONJ dad-10733 297 17 can can AUX dad-10733 297 18 provide provide VERB dad-10733 297 19 an an DET dad-10733 297 20 implementable implementable ADJ dad-10733 297 21 framework framework NOUN dad-10733 297 22 for for ADP dad-10733 297 23 real real ADJ dad-10733 297 24 - - PUNCT dad-10733 297 25 world world NOUN dad-10733 297 26 dialogue dialogue NOUN dad-10733 297 27 systems system NOUN dad-10733 297 28 . . PUNCT dad-10733 298 1 particularly particularly ADV dad-10733 298 2 in in ADP dad-10733 298 3 the the DET dad-10733 298 4 context context NOUN dad-10733 298 5 of of ADP dad-10733 298 6 goal goal NOUN dad-10733 298 7 - - PUNCT dad-10733 298 8 oriented orient VERB dad-10733 298 9 dialogue dialogue NOUN dad-10733 298 10 systems system NOUN dad-10733 298 11 ( ( PUNCT dad-10733 298 12 such such ADJ dad-10733 298 13 as as ADP dad-10733 298 14 those those PRON dad-10733 298 15 providing provide VERB dad-10733 298 16 travel travel NOUN dad-10733 298 17 and and CCONJ dad-10733 298 18 restaurant restaurant NOUN dad-10733 298 19 information information NOUN dad-10733 298 20 ) ) PUNCT dad-10733 298 21 , , PUNCT dad-10733 298 22 state state NOUN dad-10733 298 23 tracking tracking NOUN dad-10733 298 24 may may AUX dad-10733 298 25 be be AUX dad-10733 298 26 necessary necessary ADJ dad-10733 298 27 for for ADP dad-10733 298 28 creating create VERB dad-10733 298 29 coherent coherent ADJ dad-10733 298 30 conversational conversational ADJ dad-10733 298 31 interfaces interface NOUN dad-10733 298 32 . . PUNCT dad-10733 299 1 that that PRON dad-10733 299 2 is be AUX dad-10733 299 3 , , PUNCT dad-10733 299 4 to to PART dad-10733 299 5 form form VERB dad-10733 299 6 a a DET dad-10733 299 7 coherent coherent ADJ dad-10733 299 8 dialogue dialogue NOUN dad-10733 299 9 , , PUNCT dad-10733 299 10 previous previous ADJ dad-10733 299 11 contexts context NOUN dad-10733 299 12 must must AUX dad-10733 299 13 be be AUX dad-10733 299 14 accounted account VERB dad-10733 299 15 for for ADP dad-10733 299 16 – – PUNCT dad-10733 299 17 either either CCONJ dad-10733 299 18 explicitly explicitly ADV dad-10733 299 19 or or CCONJ dad-10733 299 20 in in ADP dad-10733 299 21 an an DET dad-10733 299 22 end end NOUN dad-10733 299 23 - - PUNCT dad-10733 299 24 to to ADP dad-10733 299 25 - - PUNCT dad-10733 299 26 end end NOUN dad-10733 299 27 manner manner NOUN dad-10733 299 28 . . PUNCT dad-10733 300 1 as as ADP dad-10733 300 2 such such ADJ dad-10733 300 3 , , PUNCT dad-10733 300 4 the the DET dad-10733 300 5 first first ADJ dad-10733 300 6 three three NUM dad-10733 300 7 datasets dataset NOUN dad-10733 300 8 in in ADP dad-10733 300 9 the the DET dad-10733 300 10 dstc dstc NOUN dad-10733 300 11 — — PUNCT dad-10733 300 12 referred refer VERB dad-10733 300 13 to to ADP dad-10733 300 14 as as ADP dad-10733 300 15 dstc1 dstc1 PROPN dad-10733 300 16 , , PUNCT dad-10733 300 17 dstc2 dstc2 PROPN dad-10733 300 18 , , PUNCT dad-10733 300 19 and and CCONJ dad-10733 300 20 dstc3 dstc3 NOUN dad-10733 300 21 respectively respectively ADV dad-10733 300 22 — — PUNCT dad-10733 300 23 are be AUX dad-10733 300 24 medium medium ADJ dad-10733 300 25 - - PUNCT dad-10733 300 26 sized sized ADJ dad-10733 300 27 spoken spoken ADJ dad-10733 300 28 datasets dataset NOUN dad-10733 300 29 obtained obtain VERB dad-10733 300 30 from from ADP dad-10733 300 31 human human ADJ dad-10733 300 32 - - PUNCT dad-10733 300 33 machine machine NOUN dad-10733 300 34 interactions interaction NOUN dad-10733 300 35 with with ADP dad-10733 300 36 restaurant restaurant NOUN dad-10733 300 37 and and CCONJ dad-10733 300 38 travel travel NOUN dad-10733 300 39 information information NOUN dad-10733 300 40 systems system NOUN dad-10733 300 41 . . PUNCT dad-10733 301 1 all all DET dad-10733 301 2 datasets dataset NOUN dad-10733 301 3 provide provide VERB dad-10733 301 4 labels label NOUN dad-10733 301 5 specifying specify VERB dad-10733 301 6 the the DET dad-10733 301 7 current current ADJ dad-10733 301 8 goal goal NOUN dad-10733 301 9 and and CCONJ dad-10733 301 10 desired desire VERB dad-10733 301 11 action action NOUN dad-10733 301 12 of of ADP dad-10733 301 13 the the DET dad-10733 301 14 system system NOUN dad-10733 301 15 . . PUNCT dad-10733 302 1 dstc1 dstc1 PROPN dad-10733 302 2 ( ( PUNCT dad-10733 302 3 williams williams PROPN dad-10733 302 4 et et PROPN dad-10733 302 5 al al PROPN dad-10733 302 6 . . PROPN dad-10733 302 7 , , PUNCT dad-10733 302 8 2013 2013 NUM dad-10733 302 9 ) ) PUNCT dad-10733 302 10 is be AUX dad-10733 302 11 an an DET dad-10733 302 12 annotated annotate VERB dad-10733 302 13 subset subset NOUN dad-10733 302 14 of of ADP dad-10733 302 15 the the DET dad-10733 302 16 conversations conversation NOUN dad-10733 302 17 from from ADP dad-10733 302 18 the the DET dad-10733 302 19 let let ADJ dad-10733 302 20 ’s ’s NOUN dad-10733 302 21 go go VERB dad-10733 302 22 ! ! PUNCT dad-10733 303 1 dataset dataset NOUN dad-10733 303 2 ( ( PUNCT dad-10733 303 3 parent parent NOUN dad-10733 303 4 and and CCONJ dad-10733 303 5 eskenazi eskenazi ADJ dad-10733 303 6 , , PUNCT dad-10733 303 7 2010 2010 NUM dad-10733 303 8 ) ) PUNCT dad-10733 303 9 discussed discuss VERB dad-10733 303 10 earlier early ADV dad-10733 303 11 , , PUNCT dad-10733 303 12 involving involve VERB dad-10733 303 13 conversations conversation NOUN dad-10733 303 14 between between ADP dad-10733 303 15 callers caller NOUN dad-10733 303 16 and and CCONJ dad-10733 303 17 an an DET dad-10733 303 18 automated automate VERB dad-10733 303 19 bus bus NOUN dad-10733 303 20 information information NOUN dad-10733 303 21 system system NOUN dad-10733 303 22 . . PUNCT dad-10733 304 1 dstc2 dstc2 NOUN dad-10733 304 2 introduces introduce VERB dad-10733 304 3 changing change VERB dad-10733 304 4 user user NOUN dad-10733 304 5 goals goal NOUN dad-10733 304 6 in in ADP dad-10733 304 7 a a DET dad-10733 304 8 restaurant restaurant NOUN dad-10733 304 9 booking booking NOUN dad-10733 304 10 system system NOUN dad-10733 304 11 , , PUNCT dad-10733 304 12 while while SCONJ dad-10733 304 13 trying try VERB dad-10733 304 14 to to PART dad-10733 304 15 provide provide VERB dad-10733 304 16 a a DET dad-10733 304 17 desired desire VERB dad-10733 304 18 reservation reservation NOUN dad-10733 304 19 ( ( PUNCT dad-10733 304 20 henderson henderson PROPN dad-10733 304 21 et et PROPN dad-10733 304 22 al al PROPN dad-10733 304 23 . . PROPN dad-10733 304 24 , , PUNCT dad-10733 304 25 2014b 2014b NUM dad-10733 304 26 ) ) PUNCT dad-10733 304 27 . . PUNCT dad-10733 305 1 dstc3 dstc3 NOUN dad-10733 305 2 introduces introduce VERB dad-10733 305 3 a a DET dad-10733 305 4 small small ADJ dad-10733 305 5 amount amount NOUN dad-10733 305 6 of of ADP dad-10733 305 7 labeled label VERB dad-10733 305 8 data datum NOUN dad-10733 305 9 in in ADP dad-10733 305 10 the the DET dad-10733 305 11 domain domain NOUN dad-10733 305 12 of of ADP dad-10733 305 13 tourist tourist NOUN dad-10733 305 14 information information NOUN dad-10733 305 15 . . PUNCT dad-10733 306 1 it it PRON dad-10733 306 2 is be AUX dad-10733 306 3 intended intend VERB dad-10733 306 4 to to PART dad-10733 306 5 be be AUX dad-10733 306 6 used use VERB dad-10733 306 7 in in ADP dad-10733 306 8 conjunction conjunction NOUN dad-10733 306 9 with with ADP dad-10733 306 10 the the DET dad-10733 306 11 dstc2 dstc2 NOUN dad-10733 306 12 dataset dataset VERB dad-10733 306 13 as as ADP dad-10733 306 14 a a DET dad-10733 306 15 domain domain NOUN dad-10733 306 16 adaptation adaptation NOUN dad-10733 306 17 problem problem NOUN dad-10733 306 18 ( ( PUNCT dad-10733 306 19 henderson henderson PROPN dad-10733 306 20 et et PROPN dad-10733 306 21 al al PROPN dad-10733 306 22 . . PROPN dad-10733 306 23 , , PUNCT dad-10733 306 24 2014a 2014a NUM dad-10733 306 25 ) ) PUNCT dad-10733 306 26 . . PUNCT dad-10733 307 1 the the DET dad-10733 307 2 carnegie carnegie PROPN dad-10733 307 3 mellon mellon PROPN dad-10733 307 4 communicator communicator PROPN dad-10733 307 5 corpus corpus PROPN dad-10733 307 6 ( ( PUNCT dad-10733 307 7 bennett bennett PROPN dad-10733 307 8 and and CCONJ dad-10733 307 9 rudnicky rudnicky PROPN dad-10733 307 10 , , PUNCT dad-10733 307 11 2002 2002 NUM dad-10733 307 12 ) ) PUNCT dad-10733 307 13 also also ADV dad-10733 307 14 contains contain VERB dad-10733 307 15 human human ADJ dad-10733 307 16 - - PUNCT dad-10733 307 17 machine machine NOUN dad-10733 307 18 interactions interaction NOUN dad-10733 307 19 with with ADP dad-10733 307 20 a a DET dad-10733 307 21 travel travel NOUN dad-10733 307 22 booking booking NOUN dad-10733 307 23 system system NOUN dad-10733 307 24 . . PUNCT dad-10733 308 1 it it PRON dad-10733 308 2 is be AUX dad-10733 308 3 a a DET dad-10733 308 4 medium medium ADJ dad-10733 308 5 - - PUNCT dad-10733 308 6 sized sized ADJ dad-10733 308 7 dataset dataset NOUN dad-10733 308 8 of of ADP dad-10733 308 9 interactions interaction NOUN dad-10733 308 10 with with ADP dad-10733 308 11 a a DET dad-10733 308 12 system system NOUN dad-10733 308 13 providing provide VERB dad-10733 308 14 up up ADP dad-10733 308 15 - - PUNCT dad-10733 308 16 to to ADP dad-10733 308 17 - - PUNCT dad-10733 308 18 the the DET dad-10733 308 19 - - PUNCT dad-10733 308 20 minute minute NOUN dad-10733 308 21 flight flight NOUN dad-10733 308 22 information information NOUN dad-10733 308 23 , , PUNCT dad-10733 308 24 hotel hotel NOUN dad-10733 308 25 information information NOUN dad-10733 308 26 , , PUNCT dad-10733 308 27 and and CCONJ dad-10733 308 28 car car NOUN dad-10733 308 29 rentals rental NOUN dad-10733 308 30 . . PUNCT dad-10733 309 1 conversations conversation NOUN dad-10733 309 2 with with ADP dad-10733 309 3 the the DET dad-10733 309 4 system system NOUN dad-10733 309 5 were be AUX dad-10733 309 6 transcribed transcribe VERB dad-10733 309 7 , , PUNCT dad-10733 309 8 along along ADP dad-10733 309 9 with with ADP dad-10733 309 10 user user NOUN dad-10733 309 11 ’s ’s PART dad-10733 309 12 comments comment NOUN dad-10733 309 13 after after ADP dad-10733 309 14 the the DET dad-10733 309 15 interaction interaction NOUN dad-10733 309 16 . . PUNCT dad-10733 310 1 the the DET dad-10733 310 2 atis atis PROPN dad-10733 310 3 ( ( PUNCT dad-10733 310 4 air air NOUN dad-10733 310 5 travel travel NOUN dad-10733 310 6 information information NOUN dad-10733 310 7 system system NOUN dad-10733 310 8 ) ) PUNCT dad-10733 310 9 pilot pilot NOUN dad-10733 310 10 corpus corpus NOUN dad-10733 310 11 ( ( PUNCT dad-10733 310 12 hemphill hemphill PROPN dad-10733 310 13 et et PROPN dad-10733 310 14 al al PROPN dad-10733 310 15 . . PROPN dad-10733 310 16 , , PUNCT dad-10733 310 17 1990 1990 NUM dad-10733 310 18 ) ) PUNCT dad-10733 310 19 is be AUX dad-10733 310 20 one one NUM dad-10733 310 21 of of ADP dad-10733 310 22 the the DET dad-10733 310 23 first first ADJ dad-10733 310 24 human human NOUN dad-10733 310 25 - - PUNCT dad-10733 310 26 machine machine NOUN dad-10733 310 27 corpora corpora NOUN dad-10733 310 28 . . PUNCT dad-10733 311 1 it it PRON dad-10733 311 2 consists consist VERB dad-10733 311 3 of of ADP dad-10733 311 4 interactions interaction NOUN dad-10733 311 5 , , PUNCT dad-10733 311 6 lasting last VERB dad-10733 311 7 about about ADP dad-10733 311 8 40 40 NUM dad-10733 311 9 minutes minute NOUN dad-10733 311 10 each each PRON dad-10733 311 11 , , PUNCT dad-10733 311 12 between between ADP dad-10733 311 13 human human ADJ dad-10733 311 14 participants participant NOUN dad-10733 311 15 and and CCONJ dad-10733 311 16 a a DET dad-10733 311 17 travel travel NOUN dad-10733 311 18 - - PUNCT dad-10733 311 19 type type NOUN dad-10733 311 20 booking booking NOUN dad-10733 311 21 system system NOUN dad-10733 311 22 , , PUNCT dad-10733 311 23 secretly secretly ADV dad-10733 311 24 operated operate VERB dad-10733 311 25 by by ADP dad-10733 311 26 humans human NOUN dad-10733 311 27 . . PUNCT dad-10733 312 1 this this DET dad-10733 312 2 dataset dataset NOUN dad-10733 312 3 contains contain VERB dad-10733 312 4 1041 1041 NUM dad-10733 312 5 utterances utterance NOUN dad-10733 312 6 . . PUNCT dad-10733 313 1 in in ADP dad-10733 313 2 the the DET dad-10733 313 3 maluuba maluuba NOUN dad-10733 313 4 frames frame NOUN dad-10733 313 5 corpus corpus PROPN dad-10733 313 6 ( ( PUNCT dad-10733 313 7 el el PROPN dad-10733 313 8 asri asri PROPN dad-10733 313 9 et et PROPN dad-10733 313 10 al al PROPN dad-10733 313 11 . . PROPN dad-10733 313 12 , , PUNCT dad-10733 313 13 2017 2017 NUM dad-10733 313 14 ) ) PUNCT dad-10733 313 15 , , PUNCT dad-10733 313 16 one one NUM dad-10733 313 17 user user NOUN dad-10733 313 18 plays play VERB dad-10733 313 19 the the DET dad-10733 313 20 role role NOUN dad-10733 313 21 of of ADP dad-10733 313 22 a a DET dad-10733 313 23 conversational conversational ADJ dad-10733 313 24 agent agent NOUN dad-10733 313 25 in in ADP dad-10733 313 26 a a DET dad-10733 313 27 wizard wizard NOUN dad-10733 313 28 - - PUNCT dad-10733 313 29 of of ADP dad-10733 313 30 - - PUNCT dad-10733 313 31 oz oz NOUN dad-10733 313 32 fashion fashion NOUN dad-10733 313 33 , , PUNCT dad-10733 313 34 while while SCONJ dad-10733 313 35 the the DET dad-10733 313 36 other other ADJ dad-10733 313 37 user user NOUN dad-10733 313 38 is be AUX dad-10733 313 39 tasked task VERB dad-10733 313 40 with with ADP dad-10733 313 41 finding find VERB dad-10733 313 42 available available ADJ dad-10733 313 43 travel travel NOUN dad-10733 313 44 or or CCONJ dad-10733 313 45 vacation vacation NOUN dad-10733 313 46 accommodations accommodation NOUN dad-10733 313 47 according accord VERB dad-10733 313 48 to to ADP dad-10733 313 49 a a DET dad-10733 313 50 pre pre ADJ dad-10733 313 51 - - ADJ dad-10733 313 52 specified specified ADJ dad-10733 313 53 task task NOUN dad-10733 313 54 . . PUNCT dad-10733 314 1 the the DET dad-10733 314 2 wizard wizard NOUN dad-10733 314 3 is be AUX dad-10733 314 4 provided provide VERB dad-10733 314 5 with with ADP dad-10733 314 6 a a DET dad-10733 314 7 knowledge knowledge NOUN dad-10733 314 8 database database NOUN dad-10733 314 9 which which PRON dad-10733 314 10 records record VERB dad-10733 314 11 its its PRON dad-10733 314 12 actions action NOUN dad-10733 314 13 . . PUNCT dad-10733 315 1 semantic semantic ADJ dad-10733 315 2 frames frame NOUN dad-10733 315 3 are be AUX dad-10733 315 4 annotated annotate VERB dad-10733 315 5 in in ADP dad-10733 315 6 addition addition NOUN dad-10733 315 7 to to ADP dad-10733 315 8 actions action NOUN dad-10733 315 9 which which PRON dad-10733 315 10 the the DET dad-10733 315 11 wizard wizard NOUN dad-10733 315 12 performed perform VERB dad-10733 315 13 on on ADP dad-10733 315 14 the the DET dad-10733 315 15 database database NOUN dad-10733 315 16 to to PART dad-10733 315 17 accompany accompany VERB dad-10733 315 18 a a DET dad-10733 315 19 line line NOUN dad-10733 315 20 of of ADP dad-10733 315 21 dialogue dialogue NOUN dad-10733 315 22 . . PUNCT dad-10733 316 1 in in ADP dad-10733 316 2 this this DET dad-10733 316 3 way way NOUN dad-10733 316 4 , , PUNCT dad-10733 316 5 the the DET dad-10733 316 6 frames frame NOUN dad-10733 316 7 corpus corpus PROPN dad-10733 316 8 aims aim VERB dad-10733 316 9 to to PART dad-10733 316 10 track track VERB dad-10733 316 11 decision decision NOUN dad-10733 316 12 - - PUNCT dad-10733 316 13 making make VERB dad-10733 316 14 processes process NOUN dad-10733 316 15 in in ADP dad-10733 316 16 traveland traveland ADP dad-10733 316 17 hotel hotel NOUN dad-10733 316 18 - - PUNCT dad-10733 316 19 booking booking NOUN dad-10733 316 20 through through ADP dad-10733 316 21 natural natural ADJ dad-10733 316 22 dialog dialog NOUN dad-10733 316 23 . . PUNCT dad-10733 317 1 4.1.2 4.1.2 NUM dad-10733 317 2 open open ADJ dad-10733 317 3 - - PUNCT dad-10733 317 4 domain domain NOUN dad-10733 317 5 knowledge knowledge NOUN dad-10733 317 6 retrieval retrieval NOUN dad-10733 317 7 knowledge knowledge NOUN dad-10733 317 8 retrieval retrieval NOUN dad-10733 317 9 and and CCONJ dad-10733 317 10 question question NOUN dad-10733 317 11 & & CCONJ dad-10733 317 12 answer answer NOUN dad-10733 317 13 ( ( PUNCT dad-10733 317 14 qa qa PROPN dad-10733 317 15 ) ) PUNCT dad-10733 317 16 corpora corpora PROPN dad-10733 317 17 are be AUX dad-10733 317 18 a a DET dad-10733 317 19 broad broad ADJ dad-10733 317 20 distinction distinction NOUN dad-10733 317 21 of of ADP dad-10733 317 22 corpora corpora NOUN dad-10733 317 23 that that SCONJ dad-10733 317 24 we we PRON dad-10733 317 25 will will AUX dad-10733 317 26 not not PART dad-10733 317 27 extensively extensively ADV dad-10733 317 28 review review VERB dad-10733 317 29 here here ADV dad-10733 317 30 . . PUNCT dad-10733 318 1 instead instead ADV dad-10733 318 2 , , PUNCT dad-10733 318 3 we we PRON dad-10733 318 4 include include VERB dad-10733 318 5 only only ADV dad-10733 318 6 those those DET dad-10733 318 7 qa qa PROPN dad-10733 318 8 corpora corpora PROPN dad-10733 318 9 which which PRON dad-10733 318 10 explicitly explicitly ADV dad-10733 318 11 record record VERB dad-10733 318 12 interactions interaction NOUN dad-10733 318 13 of of ADP dad-10733 318 14 humans human NOUN dad-10733 318 15 with with ADP dad-10733 318 16 existing exist VERB dad-10733 318 17 systems system NOUN dad-10733 318 18 . . PUNCT dad-10733 319 1 the the DET dad-10733 319 2 ritel ritel PROPN dad-10733 319 3 corpus corpus PROPN dad-10733 319 4 ( ( PUNCT dad-10733 319 5 rosset rosset NOUN dad-10733 319 6 and and CCONJ dad-10733 319 7 petel petel NOUN dad-10733 319 8 , , PUNCT dad-10733 319 9 2006 2006 NUM dad-10733 319 10 ) ) PUNCT dad-10733 319 11 is be AUX dad-10733 319 12 a a DET dad-10733 319 13 small small ADJ dad-10733 319 14 dataset dataset NOUN dad-10733 319 15 of of ADP dad-10733 319 16 528 528 NUM dad-10733 319 17 dialogues dialogue NOUN dad-10733 319 18 with with ADP dad-10733 319 19 the the DET dad-10733 319 20 wizard wizard NOUN dad-10733 319 21 - - PUNCT dad-10733 319 22 of of ADP dad-10733 319 23 - - PUNCT dad-10733 319 24 oz oz NOUN dad-10733 319 25 ritel ritel NOUN dad-10733 319 26 platform platform NOUN dad-10733 319 27 . . PUNCT dad-10733 320 1 the the DET dad-10733 320 2 project project NOUN dad-10733 320 3 ’s ’s PART dad-10733 320 4 purpose purpose NOUN dad-10733 320 5 was be AUX dad-10733 320 6 to to PART dad-10733 320 7 integrate integrate VERB dad-10733 320 8 spoken spoken ADJ dad-10733 320 9 language language NOUN dad-10733 320 10 dialogue dialogue NOUN dad-10733 320 11 systems system NOUN dad-10733 320 12 with with ADP dad-10733 320 13 open open ADJ dad-10733 320 14 - - PUNCT dad-10733 320 15 domain domain NOUN dad-10733 320 16 information information NOUN dad-10733 320 17 retrieval retrieval NOUN dad-10733 320 18 systems system NOUN dad-10733 320 19 , , PUNCT dad-10733 320 20 with with ADP dad-10733 320 21 the the DET dad-10733 320 22 end end NOUN dad-10733 320 23 goal goal NOUN dad-10733 320 24 of of ADP dad-10733 320 25 allowing allow VERB dad-10733 320 26 humans human NOUN dad-10733 320 27 to to PART dad-10733 320 28 ask ask VERB dad-10733 320 29 general general ADJ dad-10733 320 30 questions question NOUN dad-10733 320 31 and and CCONJ dad-10733 320 32 iteratively iteratively ADV dad-10733 320 33 refine refine VERB dad-10733 320 34 their their PRON dad-10733 320 35 search search NOUN dad-10733 320 36 . . PUNCT dad-10733 321 1 the the DET dad-10733 321 2 questions question NOUN dad-10733 321 3 in in ADP dad-10733 321 4 the the DET dad-10733 321 5 corpus corpus NOUN dad-10733 321 6 mostly mostly ADV dad-10733 321 7 revolve revolve VERB dad-10733 321 8 around around ADP dad-10733 321 9 politics politic NOUN dad-10733 321 10 and and CCONJ dad-10733 321 11 the the DET dad-10733 321 12 economy economy NOUN dad-10733 321 13 ( ( PUNCT dad-10733 321 14 e.g. e.g. ADV dad-10733 321 15 “ " PUNCT dad-10733 321 16 who who PRON dad-10733 321 17 is be AUX dad-10733 321 18 currently currently ADV dad-10733 321 19 presiding preside VERB dad-10733 321 20 the the DET dad-10733 321 21 senate senate NOUN dad-10733 321 22 ? ? PUNCT dad-10733 321 23 ” " PUNCT dad-10733 321 24 ) ) PUNCT dad-10733 321 25 , , PUNCT dad-10733 321 26 along along ADP dad-10733 321 27 with with ADP dad-10733 321 28 some some DET dad-10733 321 29 conversations conversation NOUN dad-10733 321 30 about about ADP dad-10733 321 31 artsand artsand NOUN dad-10733 321 32 science science NOUN dad-10733 321 33 - - PUNCT dad-10733 321 34 related relate VERB dad-10733 321 35 topics topic NOUN dad-10733 321 36 . . PUNCT dad-10733 322 1 other other ADJ dad-10733 322 2 similar similar ADJ dad-10733 322 3 open open ADJ dad-10733 322 4 - - PUNCT dad-10733 322 5 domain domain NOUN dad-10733 322 6 corpora corpora NOUN dad-10733 322 7 in in ADP dad-10733 322 8 this this DET dad-10733 322 9 area area NOUN dad-10733 322 10 include include VERB dad-10733 322 11 wikiqa wikiqa PROPN dad-10733 322 12 yang yang PROPN dad-10733 322 13 et et PROPN dad-10733 322 14 al al PROPN dad-10733 322 15 . . PROPN dad-10733 323 1 ( ( PUNCT dad-10733 323 2 2015 2015 NUM dad-10733 323 3 ) ) PUNCT dad-10733 323 4 and and CCONJ dad-10733 323 5 ms ms PROPN dad-10733 323 6 marco marco PROPN dad-10733 323 7 nguyen nguyen PROPN dad-10733 323 8 et et PROPN dad-10733 323 9 al al PROPN dad-10733 323 10 . . PUNCT dad-10733 324 1 ( ( PUNCT dad-10733 324 2 2016 2016 NUM dad-10733 324 3 ) ) PUNCT dad-10733 324 4 , , PUNCT dad-10733 324 5 which which PRON dad-10733 324 6 compile compile VERB dad-10733 324 7 responses response NOUN dad-10733 324 8 from from ADP dad-10733 324 9 automated automate VERB dad-10733 324 10 bing bing NOUN dad-10733 324 11 searches search NOUN dad-10733 324 12 and and CCONJ dad-10733 324 13 human human ADJ dad-10733 324 14 annotators annotator NOUN dad-10733 324 15 . . PUNCT dad-10733 325 1 these these PRON dad-10733 325 2 do do AUX dad-10733 325 3 not not PART dad-10733 325 4 record record VERB dad-10733 325 5 dialogues dialogue NOUN dad-10733 325 6 , , PUNCT dad-10733 325 7 but but CCONJ dad-10733 325 8 rather rather ADV dad-10733 325 9 gather gather VERB dad-10733 325 10 possible possible ADJ dad-10733 325 11 responses response NOUN dad-10733 325 12 to to ADP dad-10733 325 13 queries query NOUN dad-10733 325 14 . . PUNCT dad-10733 326 1 we we PRON dad-10733 326 2 will will AUX dad-10733 326 3 only only ADV dad-10733 326 4 mention mention VERB dad-10733 326 5 them they PRON dad-10733 326 6 briefly briefly ADV dad-10733 326 7 as as ADP dad-10733 326 8 examples example NOUN dad-10733 326 9 of of ADP dad-10733 326 10 other other ADJ dad-10733 326 11 open open ADJ dad-10733 326 12 - - PUNCT dad-10733 326 13 domain domain NOUN dad-10733 326 14 corpora corpora NOUN dad-10733 326 15 in in ADP dad-10733 326 16 the the DET dad-10733 326 17 field field NOUN dad-10733 326 18 . . PUNCT dad-10733 327 1 15 15 NUM dad-10733 327 2 serban serban PROPN dad-10733 327 3 , , PUNCT dad-10733 327 4 lowe lowe PROPN dad-10733 327 5 , , PUNCT dad-10733 327 6 henderson henderson PROPN dad-10733 327 7 , , PUNCT dad-10733 327 8 charlin charlin PROPN dad-10733 327 9 and and CCONJ dad-10733 327 10 pineau pineau PROPN dad-10733 327 11 n n PRON dad-10733 327 12 am be AUX dad-10733 327 13 e e X dad-10733 327 14 ty ty INTJ dad-10733 327 15 pe pe INTJ dad-10733 327 16 to to ADP dad-10733 327 17 pi pi PROPN dad-10733 327 18 cs cs PROPN dad-10733 327 19 a a DET dad-10733 327 20 vg vg NOUN dad-10733 327 21 . . PUNCT dad-10733 328 1 # # NOUN dad-10733 328 2 to to ADP dad-10733 328 3 ta ta PROPN dad-10733 328 4 l l NOUN dad-10733 328 5 # # NOUN dad-10733 328 6 to to ADP dad-10733 328 7 ta ta ADP dad-10733 328 8 l l NOUN dad-10733 328 9 # # X dad-10733 328 10 d d PROPN dad-10733 328 11 es es PROPN dad-10733 328 12 cr cr PROPN dad-10733 328 13 ip ip PROPN dad-10733 328 14 tio tio PROPN dad-10733 328 15 n n PROPN dad-10733 328 16 of of ADP dad-10733 328 17 tu tu PROPN dad-10733 328 18 rn rn PROPN dad-10733 328 19 s s PROPN dad-10733 328 20 of of ADP dad-10733 328 21 di di NOUN dad-10733 328 22 al al PROPN dad-10733 328 23 og og PROPN dad-10733 328 24 ue ue PROPN dad-10733 328 25 s s PROPN dad-10733 328 26 of of ADP dad-10733 328 27 w w NOUN dad-10733 328 28 or or CCONJ dad-10733 328 29 ds ds PRON dad-10733 328 30 l l NOUN dad-10733 328 31 et et NOUN dad-10733 328 32 ’s ’ VERB dad-10733 328 33 g g PROPN dad-10733 328 34 o o NOUN dad-10733 328 35 ! ! PUNCT dad-10733 329 1 ( ( PUNCT dad-10733 329 2 r r NOUN dad-10733 329 3 au au NOUN dad-10733 329 4 x x VERB dad-10733 329 5 et et NOUN dad-10733 329 6 al al PROPN dad-10733 329 7 . . PUNCT dad-10733 329 8 , , PUNCT dad-10733 329 9 20 20 NUM dad-10733 329 10 05 05 NUM dad-10733 329 11 ) ) PUNCT dad-10733 329 12 sp sp ADP dad-10733 329 13 ok ok INTJ dad-10733 329 14 en en PROPN dad-10733 329 15 b b PROPN dad-10733 329 16 us us PROPN dad-10733 329 17 sc sc PROPN dad-10733 329 18 he he PRON dad-10733 329 19 du du PROPN dad-10733 329 20 le le X dad-10733 329 21 s s PROPN dad-10733 329 22 – – PUNCT dad-10733 329 23 17 17 NUM dad-10733 329 24 1 1 NUM dad-10733 329 25 , , PUNCT dad-10733 329 26 12 12 NUM dad-10733 329 27 8 8 NUM dad-10733 329 28 – – PUNCT dad-10733 329 29 b b NUM dad-10733 329 30 us us PROPN dad-10733 329 31 ri ri PROPN dad-10733 329 32 de de X dad-10733 329 33 in in ADP dad-10733 329 34 fo fo ADP dad-10733 329 35 rm rm PROPN dad-10733 329 36 at at ADP dad-10733 329 37 io io PROPN dad-10733 329 38 n n PROPN dad-10733 329 39 sy sy PROPN dad-10733 329 40 st st PROPN dad-10733 329 41 em em PROPN dad-10733 329 42 d d PROPN dad-10733 329 43 st st PROPN dad-10733 329 44 c c PROPN dad-10733 329 45 1 1 NUM dad-10733 329 46 ( ( PUNCT dad-10733 329 47 w w PROPN dad-10733 329 48 ill ill PROPN dad-10733 329 49 ia ia PROPN dad-10733 329 50 m m PROPN dad-10733 329 51 s s NOUN dad-10733 329 52 et et NOUN dad-10733 329 53 al al PROPN dad-10733 329 54 . . PUNCT dad-10733 329 55 , , PUNCT dad-10733 329 56 20 20 NUM dad-10733 329 57 13 13 NUM dad-10733 329 58 ) ) PUNCT dad-10733 329 59 sp sp ADP dad-10733 329 60 ok ok INTJ dad-10733 329 61 en en PROPN dad-10733 329 62 b b PROPN dad-10733 329 63 us us PROPN dad-10733 329 64 sc sc PROPN dad-10733 329 65 he he PRON dad-10733 329 66 du du PROPN dad-10733 329 67 le le PROPN dad-10733 329 68 s s PROPN dad-10733 329 69 13 13 NUM dad-10733 329 70 .5 .5 NUM dad-10733 329 71 6 6 NUM dad-10733 329 72 15 15 NUM dad-10733 329 73 , , PUNCT dad-10733 329 74 0 0 NUM dad-10733 329 75 00 00 NUM dad-10733 329 76 3 3 NUM dad-10733 329 77 . . NOUN dad-10733 329 78 7 7 NUM dad-10733 329 79 m m PROPN dad-10733 329 80 b b NOUN dad-10733 329 81 us we PRON dad-10733 329 82 ri ri PROPN dad-10733 329 83 de de X dad-10733 329 84 in in ADP dad-10733 329 85 fo fo ADP dad-10733 329 86 rm rm PROPN dad-10733 329 87 at at ADP dad-10733 329 88 io io PROPN dad-10733 329 89 n n PROPN dad-10733 329 90 sy sy PROPN dad-10733 329 91 st st PROPN dad-10733 329 92 em em PROPN dad-10733 329 93 d d PROPN dad-10733 329 94 st st PROPN dad-10733 329 95 c c PROPN dad-10733 329 96 2 2 NUM dad-10733 329 97 ( ( PUNCT dad-10733 329 98 h h NOUN dad-10733 329 99 en en X dad-10733 329 100 de de X dad-10733 329 101 rs rs PROPN dad-10733 329 102 on on ADP dad-10733 329 103 et et PROPN dad-10733 329 104 al al PROPN dad-10733 329 105 . . PUNCT dad-10733 329 106 , , PUNCT dad-10733 329 107 20 20 NUM dad-10733 329 108 14 14 NUM dad-10733 329 109 b b NOUN dad-10733 329 110 ) ) PUNCT dad-10733 329 111 sp sp ADP dad-10733 329 112 ok ok INTJ dad-10733 329 113 en en INTJ dad-10733 329 114 r r NOUN dad-10733 329 115 es es NOUN dad-10733 329 116 ta ta AUX dad-10733 329 117 ur ur VERB dad-10733 329 118 an an PRON dad-10733 329 119 ts ts ADP dad-10733 329 120 7 7 NUM dad-10733 329 121 . . NOUN dad-10733 329 122 88 88 NUM dad-10733 329 123 3 3 NUM dad-10733 329 124 , , PUNCT dad-10733 329 125 00 00 NUM dad-10733 329 126 0 0 NUM dad-10733 330 1 43 43 NUM dad-10733 330 2 2k 2k NOUN dad-10733 330 3 r r NOUN dad-10733 330 4 es es NOUN dad-10733 330 5 ta ta AUX dad-10733 330 6 ur ur INTJ dad-10733 330 7 an an DET dad-10733 330 8 tb tb NOUN dad-10733 331 1 oo oo INTJ dad-10733 331 2 ki ki PROPN dad-10733 332 1 ng ng PROPN dad-10733 332 2 sy sy PROPN dad-10733 332 3 st st PROPN dad-10733 332 4 em em PROPN dad-10733 332 5 d d PROPN dad-10733 332 6 st st PROPN dad-10733 332 7 c c PROPN dad-10733 332 8 3 3 NUM dad-10733 332 9 ( ( PUNCT dad-10733 332 10 h h NOUN dad-10733 332 11 en en X dad-10733 332 12 de de X dad-10733 332 13 rs rs PROPN dad-10733 332 14 on on ADP dad-10733 332 15 et et PROPN dad-10733 332 16 al al PROPN dad-10733 332 17 . . PUNCT dad-10733 332 18 , , PUNCT dad-10733 332 19 20 20 NUM dad-10733 332 20 14 14 NUM dad-10733 332 21 a a NOUN dad-10733 332 22 ) ) PUNCT dad-10733 332 23 sp sp ADP dad-10733 332 24 ok ok ADV dad-10733 332 25 en en ADV dad-10733 332 26 to to PART dad-10733 332 27 ur ur PROPN dad-10733 332 28 is be AUX dad-10733 332 29 ti ti X dad-10733 332 30 nf nf NOUN dad-10733 332 31 or or CCONJ dad-10733 332 32 m m VERB dad-10733 332 33 at at ADP dad-10733 332 34 io io PROPN dad-10733 332 35 n n PRON dad-10733 332 36 8 8 NUM dad-10733 332 37 . . PUNCT dad-10733 332 38 27 27 NUM dad-10733 332 39 2 2 NUM dad-10733 332 40 , , PUNCT dad-10733 332 41 26 26 NUM dad-10733 332 42 5 5 NUM dad-10733 332 43 40 40 NUM dad-10733 332 44 3k 3k NUM dad-10733 332 45 in in ADP dad-10733 332 46 fo fo ADP dad-10733 332 47 rm rm PROPN dad-10733 332 48 at at ADP dad-10733 332 49 io io PROPN dad-10733 333 1 n n ADV dad-10733 333 2 fo fo INTJ dad-10733 333 3 rt rt PROPN dad-10733 333 4 ou ou PROPN dad-10733 333 5 ri ri PROPN dad-10733 334 1 st st PROPN dad-10733 334 2 s s PROPN dad-10733 335 1 c c NOUN dad-10733 335 2 m m VERB dad-10733 335 3 u u NOUN dad-10733 335 4 c c PROPN dad-10733 335 5 om om PROPN dad-10733 335 6 m m PROPN dad-10733 335 7 un un PROPN dad-10733 335 8 ic ic PROPN dad-10733 335 9 at at ADP dad-10733 335 10 or or CCONJ dad-10733 335 11 c c PROPN dad-10733 335 12 or or CCONJ dad-10733 335 13 pu pu PROPN dad-10733 335 14 s s PROPN dad-10733 335 15 sp sp ADP dad-10733 335 16 ok ok NOUN dad-10733 335 17 en en ADV dad-10733 335 18 tr tr PROPN dad-10733 335 19 av av PROPN dad-10733 335 20 el el PROPN dad-10733 335 21 11 11 NUM dad-10733 336 1 .6 .6 NUM dad-10733 336 2 7 7 NUM dad-10733 336 3 15 15 NUM dad-10733 336 4 , , PUNCT dad-10733 336 5 4 4 NUM dad-10733 336 6 81 81 NUM dad-10733 336 7 2 2 NUM dad-10733 336 8 m m VERB dad-10733 336 9 * * PUNCT dad-10733 336 10 tr tr VERB dad-10733 336 11 av av PROPN dad-10733 336 12 el el PROPN dad-10733 336 13 pl pl PROPN dad-10733 336 14 an an DET dad-10733 336 15 ni ni PROPN dad-10733 336 16 ng ng PROPN dad-10733 336 17 an an PROPN dad-10733 337 1 d d X dad-10733 337 2 bo bo VERB dad-10733 337 3 ok ok INTJ dad-10733 337 4 in in ADP dad-10733 337 5 g g PROPN dad-10733 337 6 sy sy PROPN dad-10733 337 7 st st PROPN dad-10733 338 1 em em PRON dad-10733 338 2 ( ( PUNCT dad-10733 338 3 b b PROPN dad-10733 338 4 en en ADP dad-10733 338 5 ne ne X dad-10733 338 6 tt tt PROPN dad-10733 339 1 an an DET dad-10733 339 2 d d NOUN dad-10733 339 3 r r NOUN dad-10733 339 4 ud ud INTJ dad-10733 339 5 ni ni PROPN dad-10733 339 6 ck ck PROPN dad-10733 339 7 y y PROPN dad-10733 339 8 , , PUNCT dad-10733 339 9 20 20 NUM dad-10733 339 10 02 02 NUM dad-10733 339 11 ) ) PUNCT dad-10733 339 12 a a DET dad-10733 339 13 t t NOUN dad-10733 339 14 is be AUX dad-10733 339 15 pi pi NOUN dad-10733 339 16 lo lo PROPN dad-10733 339 17 tc tc NOUN dad-10733 340 1 or or CCONJ dad-10733 340 2 pu pu PROPN dad-10733 341 1 s† s† NOUN dad-10733 341 2 sp sp ADP dad-10733 341 3 ok ok NOUN dad-10733 341 4 en en X dad-10733 341 5 tr tr PROPN dad-10733 341 6 av av PROPN dad-10733 341 7 el el PROPN dad-10733 341 8 25 25 NUM dad-10733 341 9 .4 .4 NUM dad-10733 342 1 41 41 NUM dad-10733 342 2 11 11 NUM dad-10733 342 3 .4 .4 NUM dad-10733 343 1 k k X dad-10733 343 2 * * PUNCT dad-10733 343 3 tr tr PROPN dad-10733 343 4 av av PROPN dad-10733 343 5 el el PROPN dad-10733 343 6 pl pl PROPN dad-10733 343 7 an an DET dad-10733 343 8 ni ni PROPN dad-10733 343 9 ng ng PROPN dad-10733 343 10 an an PROPN dad-10733 343 11 d d X dad-10733 343 12 bo bo VERB dad-10733 343 13 ok ok INTJ dad-10733 343 14 in in ADP dad-10733 343 15 g g PROPN dad-10733 343 16 sy sy PROPN dad-10733 343 17 st st PROPN dad-10733 344 1 em em PRON dad-10733 345 1 ( ( PUNCT dad-10733 345 2 h h NOUN dad-10733 345 3 em em PRON dad-10733 345 4 ph ph VERB dad-10733 345 5 ill ill ADJ dad-10733 345 6 et et PROPN dad-10733 345 7 al al PROPN dad-10733 345 8 . . PUNCT dad-10733 345 9 , , PUNCT dad-10733 345 10 19 19 NUM dad-10733 345 11 90 90 NUM dad-10733 345 12 ) ) PUNCT dad-10733 345 13 r r NOUN dad-10733 345 14 ite ite PROPN dad-10733 345 15 lc lc PROPN dad-10733 345 16 or or CCONJ dad-10733 345 17 pu pu PROPN dad-10733 345 18 s† s† VERB dad-10733 345 19 sp sp ADP dad-10733 345 20 ok ok INTJ dad-10733 345 21 en en X dad-10733 345 22 u u PROPN dad-10733 345 23 nr nr PROPN dad-10733 345 24 es es PROPN dad-10733 345 25 tr tr PROPN dad-10733 345 26 ic ic PROPN dad-10733 345 27 te te PROPN dad-10733 345 28 d/ d/ NOUN dad-10733 345 29 d d NOUN dad-10733 345 30 iv iv X dad-10733 345 31 er er INTJ dad-10733 345 32 se se ADV dad-10733 345 33 to to PART dad-10733 345 34 pi pi VERB dad-10733 345 35 cs cs PROPN dad-10733 345 36 9 9 NUM dad-10733 345 37 . . PUNCT dad-10733 346 1 3 3 NUM dad-10733 346 2 * * SYM dad-10733 346 3 58 58 NUM dad-10733 346 4 2 2 NUM dad-10733 346 5 60 60 NUM dad-10733 346 6 k k NOUN dad-10733 346 7 a a PRON dad-10733 346 8 n n NOUN dad-10733 346 9 an an DET dad-10733 346 10 no no INTJ dad-10733 346 11 ta ta X dad-10733 346 12 te te PROPN dad-10733 346 13 d d X dad-10733 346 14 op op NOUN dad-10733 346 15 en en X dad-10733 346 16 -d -d DET dad-10733 346 17 om om PROPN dad-10733 346 18 ai ai VERB dad-10733 346 19 n n ADV dad-10733 346 20 qu qu PROPN dad-10733 346 21 es es X dad-10733 346 22 tio tio PROPN dad-10733 346 23 n n PROPN dad-10733 346 24 ( ( PUNCT dad-10733 346 25 r r NOUN dad-10733 346 26 os os NOUN dad-10733 346 27 se se PROPN dad-10733 346 28 ta ta PROPN dad-10733 346 29 nd nd INTJ dad-10733 346 30 pe pe INTJ dad-10733 346 31 te te PROPN dad-10733 346 32 l l NOUN dad-10733 346 33 , , PUNCT dad-10733 346 34 20 20 NUM dad-10733 346 35 06 06 NUM dad-10733 346 36 ) ) PUNCT dad-10733 346 37 an an DET dad-10733 346 38 sw sw X dad-10733 346 39 er er INTJ dad-10733 346 40 in in ADP dad-10733 346 41 g g NOUN dad-10733 346 42 sp sp ADP dad-10733 346 43 ok ok X dad-10733 346 44 en en X dad-10733 346 45 di di X dad-10733 346 46 al al PROPN dad-10733 346 47 og og PROPN dad-10733 347 1 ue ue PROPN dad-10733 348 1 sy sy PROPN dad-10733 348 2 st st PROPN dad-10733 349 1 em em PROPN dad-10733 349 2 d d PROPN dad-10733 349 3 ia ia PROPN dad-10733 350 1 l l NOUN dad-10733 350 2 o o X dad-10733 350 3 g g X dad-10733 350 4 m m VERB dad-10733 350 5 at at ADP dad-10733 350 6 he he PRON dad-10733 350 7 m m VERB dad-10733 350 8 at at ADP dad-10733 350 9 ic ic PROPN dad-10733 350 10 al al PROPN dad-10733 350 11 sp sp ADP dad-10733 350 12 ok ok PROPN dad-10733 350 13 en en INTJ dad-10733 350 14 m m VERB dad-10733 350 15 at at ADP dad-10733 350 16 he he PRON dad-10733 350 17 m m VERB dad-10733 350 18 at at ADP dad-10733 350 19 ic ic PROPN dad-10733 350 20 s s PROPN dad-10733 350 21 12 12 NUM dad-10733 350 22 66 66 NUM dad-10733 350 23 8 8 NUM dad-10733 350 24 . . PUNCT dad-10733 351 1 7k 7k NOUN dad-10733 352 1 * * PUNCT dad-10733 352 2 h h INTJ dad-10733 352 3 um um INTJ dad-10733 352 4 an an DET dad-10733 352 5 s s NOUN dad-10733 352 6 in in ADP dad-10733 352 7 te te ADP dad-10733 352 8 ra ra PROPN dad-10733 353 1 ct ct PROPN dad-10733 353 2 w w PROPN dad-10733 353 3 ith ith PROPN dad-10733 353 4 co co PROPN dad-10733 353 5 m m PROPN dad-10733 353 6 pu pu PROPN dad-10733 353 7 te te PROPN dad-10733 353 8 rs rs PROPN dad-10733 354 1 ys ys INTJ dad-10733 354 2 te te PROPN dad-10733 354 3 m m PRON dad-10733 354 4 pr pr INTJ dad-10733 354 5 oo oo INTJ dad-10733 354 6 fs fs ADP dad-10733 354 7 ( ( PUNCT dad-10733 354 8 w w NOUN dad-10733 354 9 ol ol PROPN dad-10733 354 10 sk sk VERB dad-10733 354 11 a a PRON dad-10733 354 12 et et NOUN dad-10733 354 13 al al PROPN dad-10733 354 14 . . PUNCT dad-10733 355 1 , , PUNCT dad-10733 355 2 20 20 NUM dad-10733 355 3 04 04 NUM dad-10733 355 4 ) ) PUNCT dad-10733 356 1 to to PART dad-10733 356 2 do do VERB dad-10733 356 3 m m NOUN dad-10733 356 4 at at ADP dad-10733 356 5 he he PRON dad-10733 356 6 m m VERB dad-10733 356 7 at at ADP dad-10733 356 8 ic ic PROPN dad-10733 356 9 al al PROPN dad-10733 356 10 th th PROPN dad-10733 356 11 eo eo PROPN dad-10733 356 12 re re PROPN dad-10733 356 13 m m PROPN dad-10733 356 14 pr pr VERB dad-10733 356 15 ov ov PROPN dad-10733 356 16 in in ADP dad-10733 356 17 g g PROPN dad-10733 356 18 m m PROPN dad-10733 356 19 a a DET dad-10733 356 20 t t NOUN dad-10733 356 21 c c NOUN dad-10733 356 22 h h NOUN dad-10733 356 23 c c PROPN dad-10733 356 24 or or CCONJ dad-10733 356 25 pu pu PROPN dad-10733 356 26 s† s† VERB dad-10733 356 27 sp sp ADP dad-10733 356 28 ok ok INTJ dad-10733 356 29 en en INTJ dad-10733 356 30 a a DET dad-10733 356 31 pp pp INTJ dad-10733 356 32 oi oi INTJ dad-10733 356 33 nt not PART dad-10733 356 34 m m VERB dad-10733 356 35 en en X dad-10733 356 36 ts ts ADP dad-10733 356 37 ch ch PROPN dad-10733 356 38 ed ed PROPN dad-10733 356 39 ul ul INTJ dad-10733 356 40 in in ADP dad-10733 356 41 g g PROPN dad-10733 356 42 14 14 NUM dad-10733 356 43 .0 .0 NUM dad-10733 357 1 44 44 NUM dad-10733 357 2 7 7 NUM dad-10733 357 3 69 69 NUM dad-10733 357 4 k k NOUN dad-10733 357 5 * * PUNCT dad-10733 357 6 a a PRON dad-10733 357 7 sy sy PROPN dad-10733 357 8 st st NOUN dad-10733 358 1 em em PRON dad-10733 359 1 fo fo INTJ dad-10733 359 2 rs rs INTJ dad-10733 359 3 ch ch PROPN dad-10733 359 4 ed ed PROPN dad-10733 359 5 ul ul INTJ dad-10733 359 6 in in ADP dad-10733 359 7 g g PROPN dad-10733 359 8 ap ap PROPN dad-10733 359 9 po po PROPN dad-10733 359 10 in in ADP dad-10733 359 11 tm tm PROPN dad-10733 359 12 en en X dad-10733 359 13 ts ts X dad-10733 359 14 . . PUNCT dad-10733 360 1 ( ( PUNCT dad-10733 360 2 g g NOUN dad-10733 360 3 eo eo INTJ dad-10733 360 4 rg rg PROPN dad-10733 360 5 ila ila PROPN dad-10733 360 6 et et PROPN dad-10733 360 7 al al PROPN dad-10733 360 8 . . PROPN dad-10733 361 1 , , PUNCT dad-10733 361 2 20 20 NUM dad-10733 361 3 10 10 NUM dad-10733 361 4 ) ) PUNCT dad-10733 361 5 in in ADP dad-10733 361 6 cl cl NOUN dad-10733 362 1 ud ud INTJ dad-10733 362 2 es es X dad-10733 362 3 di di X dad-10733 362 4 al al PROPN dad-10733 362 5 og og PROPN dad-10733 363 1 ue ue PROPN dad-10733 364 1 ac ac PROPN dad-10733 364 2 ta ta PROPN dad-10733 364 3 nn nn PROPN dad-10733 364 4 ot ot PROPN dad-10733 364 5 at at ADP dad-10733 364 6 io io PROPN dad-10733 364 7 ns ns PROPN dad-10733 364 8 m m PROPN dad-10733 364 9 al al PROPN dad-10733 364 10 uu uu INTJ dad-10733 365 1 ba ba PROPN dad-10733 365 2 fr fr PROPN dad-10733 365 3 am be AUX dad-10733 365 4 es es X dad-10733 365 5 † † PROPN dad-10733 365 6 c c PROPN dad-10733 365 7 ha ha INTJ dad-10733 365 8 t t PROPN dad-10733 365 9 , , PUNCT dad-10733 365 10 q q PROPN dad-10733 365 11 a a PROPN dad-10733 365 12 & & CCONJ dad-10733 365 13 tr tr PROPN dad-10733 365 14 av av PROPN dad-10733 365 15 el el PROPN dad-10733 365 16 & & CCONJ dad-10733 365 17 v v PROPN dad-10733 365 18 ac ac PROPN dad-10733 365 19 at at ADP dad-10733 365 20 io io PROPN dad-10733 365 21 n n ADV dad-10733 365 22 15 15 NUM dad-10733 365 23 13 13 NUM dad-10733 365 24 69 69 NUM dad-10733 365 25 – – PUNCT dad-10733 365 26 fo fo INTJ dad-10733 365 27 rg rg INTJ dad-10733 365 28 oa oa INTJ dad-10733 365 29 ldr ldr PROPN dad-10733 365 30 iv iv NUM dad-10733 365 31 en en X dad-10733 365 32 di di X dad-10733 365 33 al al PROPN dad-10733 365 34 og og PROPN dad-10733 365 35 ue ue PROPN dad-10733 365 36 sy sy PROPN dad-10733 365 37 st st PROPN dad-10733 365 38 em em PROPN dad-10733 365 39 s. s. PROPN dad-10733 365 40 ( ( PUNCT dad-10733 365 41 e e X dad-10733 365 42 la la X dad-10733 365 43 sr sr PROPN dad-10733 365 44 ie ie X dad-10733 365 45 ta ta PROPN dad-10733 365 46 l. l. PROPN dad-10733 365 47 , , PUNCT dad-10733 365 48 20 20 NUM dad-10733 365 49 17 17 NUM dad-10733 365 50 ) ) PUNCT dad-10733 365 51 r r NOUN dad-10733 365 52 ec ec PROPN dad-10733 366 1 om om PROPN dad-10733 366 2 m m PROPN dad-10733 366 3 en en X dad-10733 366 4 da da X dad-10733 366 5 tio tio PROPN dad-10733 366 6 n n PRON dad-10733 366 7 b b NOUN dad-10733 367 1 oo oo INTJ dad-10733 367 2 ki ki PROPN dad-10733 367 3 ng ng PROPN dad-10733 367 4 se se PROPN dad-10733 367 5 m m VERB dad-10733 367 6 an an DET dad-10733 367 7 tic tic ADJ dad-10733 367 8 fr fr NOUN dad-10733 367 9 am be AUX dad-10733 367 10 es es X dad-10733 367 11 la la X dad-10733 367 12 be be AUX dad-10733 367 13 le le X dad-10733 367 14 d d X dad-10733 367 15 an an DET dad-10733 367 16 d d X dad-10733 367 17 ac ac NOUN dad-10733 367 18 tio tio PROPN dad-10733 367 19 ns ns INTJ dad-10733 367 20 ta ta PROPN dad-10733 367 21 ke ke NOUN dad-10733 367 22 n n PROPN dad-10733 367 23 on on ADP dad-10733 367 24 a a DET dad-10733 367 25 kn kn PROPN dad-10733 367 26 ow ow INTJ dad-10733 367 27 le le X dad-10733 367 28 dg dg PROPN dad-10733 367 29 eba eba PROPN dad-10733 367 30 se se PROPN dad-10733 368 1 an an DET dad-10733 368 2 no no INTJ dad-10733 368 3 ta ta AUX dad-10733 368 4 te te ADP dad-10733 368 5 d. d. PROPN dad-10733 368 6 ta ta PROPN dad-10733 368 7 bl bl PROPN dad-10733 368 8 e e PROPN dad-10733 368 9 1 1 NUM dad-10733 368 10 : : PUNCT dad-10733 368 11 h h NOUN dad-10733 368 12 um um INTJ dad-10733 368 13 an an PRON dad-10733 368 14 -m -m INTJ dad-10733 368 15 ac ac PROPN dad-10733 368 16 hi hi PROPN dad-10733 368 17 ne ne X dad-10733 368 18 di di PROPN dad-10733 368 19 al al PROPN dad-10733 368 20 og og PROPN dad-10733 368 21 ue ue PROPN dad-10733 368 22 da da PROPN dad-10733 368 23 ta ta PROPN dad-10733 368 24 se se PROPN dad-10733 368 25 ts ts PROPN dad-10733 368 26 . . PUNCT dad-10733 369 1 st st PROPN dad-10733 369 2 ar ar PROPN dad-10733 369 3 re re PROPN dad-10733 369 4 d d PROPN dad-10733 369 5 ( ( PUNCT dad-10733 369 6 * * PUNCT dad-10733 369 7 ) ) PUNCT dad-10733 369 8 nu nu INTJ dad-10733 369 9 m m AUX dad-10733 369 10 be be VERB dad-10733 369 11 rs rs PROPN dad-10733 369 12 ar ar PROPN dad-10733 369 13 e e PROPN dad-10733 369 14 ap ap PROPN dad-10733 369 15 pr pr PROPN dad-10733 369 16 ox ox NOUN dad-10733 370 1 i i PRON dad-10733 370 2 m m VERB dad-10733 370 3 at at ADP dad-10733 370 4 ed ed PROPN dad-10733 370 5 ba ba PROPN dad-10733 370 6 se se PROPN dad-10733 371 1 d d PROPN dad-10733 371 2 on on ADP dad-10733 371 3 th th ADP dad-10733 371 4 e e X dad-10733 371 5 av av PROPN dad-10733 371 6 er er INTJ dad-10733 371 7 ag ag PROPN dad-10733 371 8 e e PROPN dad-10733 371 9 nu nu PROPN dad-10733 371 10 m m AUX dad-10733 371 11 be be VERB dad-10733 371 12 r r NOUN dad-10733 371 13 of of ADP dad-10733 371 14 w w NOUN dad-10733 371 15 or or CCONJ dad-10733 371 16 ds ds PRON dad-10733 371 17 pe pe INTJ dad-10733 371 18 r r NOUN dad-10733 371 19 ut ut PROPN dad-10733 372 1 te te PROPN dad-10733 372 2 ra ra PROPN dad-10733 372 3 nc nc PROPN dad-10733 372 4 e. e. PROPN dad-10733 372 5 d d PROPN dad-10733 372 6 at at ADP dad-10733 372 7 as as SCONJ dad-10733 372 8 et et PROPN dad-10733 372 9 s s PART dad-10733 372 10 m m PROPN dad-10733 372 11 ar ar NOUN dad-10733 372 12 ke ke PROPN dad-10733 372 13 d d PROPN dad-10733 372 14 w w PROPN dad-10733 372 15 ith ith PROPN dad-10733 372 16 ( ( PUNCT dad-10733 372 17 † † PROPN dad-10733 372 18 ) ) PUNCT dad-10733 372 19 i i PRON dad-10733 372 20 nd nd INTJ dad-10733 372 21 ic ic X dad-10733 372 22 at at ADP dad-10733 372 23 e e PROPN dad-10733 372 24 w w PROPN dad-10733 372 25 iz iz PROPN dad-10733 372 26 ar ar PROPN dad-10733 372 27 dof dof NOUN dad-10733 372 28 -o -o INTJ dad-10733 372 29 z z NOUN dad-10733 372 30 di di NOUN dad-10733 372 31 al al PROPN dad-10733 372 32 og og PROPN dad-10733 372 33 ue ue PROPN dad-10733 372 34 s s PROPN dad-10733 372 35 , , PUNCT dad-10733 372 36 w w VERB dad-10733 372 37 he he PRON dad-10733 372 38 re re X dad-10733 372 39 th th X dad-10733 372 40 e e X dad-10733 372 41 m m VERB dad-10733 372 42 ac ac PROPN dad-10733 372 43 hi hi INTJ dad-10733 372 44 ne ne PROPN dad-10733 372 45 is be AUX dad-10733 372 46 se se PROPN dad-10733 372 47 cr cr X dad-10733 372 48 et et PROPN dad-10733 372 49 ly ly ADP dad-10733 372 50 op op NOUN dad-10733 372 51 er er INTJ dad-10733 372 52 at at ADP dad-10733 372 53 ed ed NOUN dad-10733 372 54 by by ADP dad-10733 372 55 a a DET dad-10733 372 56 hu hu PROPN dad-10733 372 57 m m VERB dad-10733 372 58 an an PRON dad-10733 372 59 . . PUNCT dad-10733 373 1 16 16 NUM dad-10733 373 2 a a DET dad-10733 373 3 survey survey NOUN dad-10733 373 4 of of ADP dad-10733 373 5 available available ADJ dad-10733 373 6 corpora corpora PROPN dad-10733 373 7 for for ADP dad-10733 373 8 building build VERB dad-10733 373 9 data data NOUN dad-10733 373 10 - - PUNCT dad-10733 373 11 driven drive VERB dad-10733 373 12 dialogue dialogue NOUN dad-10733 373 13 systems system NOUN dad-10733 373 14 4.1.3 4.1.3 NUM dad-10733 373 15 other other ADJ dad-10733 373 16 the the DET dad-10733 373 17 dialog dialog NOUN dad-10733 373 18 mathematical mathematical ADJ dad-10733 373 19 proof proof NOUN dad-10733 373 20 dataset dataset NOUN dad-10733 373 21 ( ( PUNCT dad-10733 373 22 wolska wolska NOUN dad-10733 373 23 et et PROPN dad-10733 373 24 al al PROPN dad-10733 373 25 . . PROPN dad-10733 373 26 , , PUNCT dad-10733 373 27 2004 2004 NUM dad-10733 373 28 ) ) PUNCT dad-10733 373 29 is be AUX dad-10733 373 30 a a DET dad-10733 373 31 wizard wizard NOUN dad-10733 373 32 - - PUNCT dad-10733 373 33 of of ADP dad-10733 373 34 - - PUNCT dad-10733 373 35 oz oz NOUN dad-10733 373 36 dataset dataset NOUN dad-10733 373 37 involving involve VERB dad-10733 373 38 an an DET dad-10733 373 39 automated automate VERB dad-10733 373 40 tutoring tutoring NOUN dad-10733 373 41 system system NOUN dad-10733 373 42 that that PRON dad-10733 373 43 attempts attempt VERB dad-10733 373 44 to to PART dad-10733 373 45 advise advise VERB dad-10733 373 46 students student NOUN dad-10733 373 47 on on ADP dad-10733 373 48 proving prove VERB dad-10733 373 49 mathematical mathematical ADJ dad-10733 373 50 theorems theorem NOUN dad-10733 373 51 . . PUNCT dad-10733 374 1 this this PRON dad-10733 374 2 is be AUX dad-10733 374 3 done do VERB dad-10733 374 4 using use VERB dad-10733 374 5 a a DET dad-10733 374 6 hinting hint VERB dad-10733 374 7 algorithm algorithm NOUN dad-10733 374 8 that that PRON dad-10733 374 9 provides provide VERB dad-10733 374 10 clues clue NOUN dad-10733 374 11 when when SCONJ dad-10733 374 12 students student NOUN dad-10733 374 13 come come VERB dad-10733 374 14 up up ADP dad-10733 374 15 with with ADP dad-10733 374 16 an an DET dad-10733 374 17 incorrect incorrect ADJ dad-10733 374 18 answer answer NOUN dad-10733 374 19 . . PUNCT dad-10733 375 1 at at ADP dad-10733 375 2 only only ADV dad-10733 375 3 66 66 NUM dad-10733 375 4 dialogues dialogue NOUN dad-10733 375 5 , , PUNCT dad-10733 375 6 the the DET dad-10733 375 7 dataset dataset NOUN dad-10733 375 8 is be AUX dad-10733 375 9 very very ADV dad-10733 375 10 small small ADJ dad-10733 375 11 , , PUNCT dad-10733 375 12 and and CCONJ dad-10733 375 13 consists consist VERB dad-10733 375 14 of of ADP dad-10733 375 15 a a DET dad-10733 375 16 conglomeration conglomeration NOUN dad-10733 375 17 of of ADP dad-10733 375 18 text text NOUN dad-10733 375 19 - - PUNCT dad-10733 375 20 based base VERB dad-10733 375 21 interactions interaction NOUN dad-10733 375 22 with with ADP dad-10733 375 23 the the DET dad-10733 375 24 system system NOUN dad-10733 375 25 , , PUNCT dad-10733 375 26 as as ADV dad-10733 375 27 well well ADV dad-10733 375 28 as as ADP dad-10733 375 29 think think VERB dad-10733 375 30 - - PUNCT dad-10733 375 31 aloud aloud NOUN dad-10733 375 32 audio audio NOUN dad-10733 375 33 and and CCONJ dad-10733 375 34 video video NOUN dad-10733 375 35 footage footage NOUN dad-10733 375 36 recorded record VERB dad-10733 375 37 by by ADP dad-10733 375 38 the the DET dad-10733 375 39 users user NOUN dad-10733 375 40 as as SCONJ dad-10733 375 41 they they PRON dad-10733 375 42 interacted interact VERB dad-10733 375 43 with with ADP dad-10733 375 44 the the DET dad-10733 375 45 system system NOUN dad-10733 375 46 . . PUNCT dad-10733 376 1 the the DET dad-10733 376 2 latter latter ADJ dad-10733 376 3 was be AUX dad-10733 376 4 transcribed transcribe VERB dad-10733 376 5 and and CCONJ dad-10733 376 6 annotated annotate VERB dad-10733 376 7 with with ADP dad-10733 376 8 simple simple ADJ dad-10733 376 9 speech speech NOUN dad-10733 376 10 acts act NOUN dad-10733 376 11 such such ADJ dad-10733 376 12 as as ADP dad-10733 376 13 “ " PUNCT dad-10733 376 14 signaling signal VERB dad-10733 376 15 emotions emotion NOUN dad-10733 376 16 ” " PUNCT dad-10733 376 17 or or CCONJ dad-10733 376 18 “ " PUNCT dad-10733 376 19 self self NOUN dad-10733 376 20 - - PUNCT dad-10733 376 21 addressing addressing NOUN dad-10733 376 22 ” " PUNCT dad-10733 376 23 . . PUNCT dad-10733 377 1 the the DET dad-10733 377 2 match match NOUN dad-10733 377 3 corpus corpus NOUN dad-10733 377 4 ( ( PUNCT dad-10733 377 5 georgila georgila NOUN dad-10733 377 6 et et PROPN dad-10733 377 7 al al PROPN dad-10733 377 8 . . PROPN dad-10733 377 9 , , PUNCT dad-10733 377 10 2010 2010 NUM dad-10733 377 11 ) ) PUNCT dad-10733 377 12 is be AUX dad-10733 377 13 a a DET dad-10733 377 14 small small ADJ dad-10733 377 15 corpus corpus NOUN dad-10733 377 16 of of ADP dad-10733 377 17 447 447 NUM dad-10733 377 18 dialogues dialogue NOUN dad-10733 377 19 based base VERB dad-10733 377 20 on on ADP dad-10733 377 21 a a DET dad-10733 377 22 wizard wizard NOUN dad-10733 377 23 - - PUNCT dad-10733 377 24 of of ADP dad-10733 377 25 - - PUNCT dad-10733 377 26 oz oz NOUN dad-10733 377 27 experiment experiment NOUN dad-10733 377 28 , , PUNCT dad-10733 377 29 which which PRON dad-10733 377 30 contains contain VERB dad-10733 377 31 conversations conversation NOUN dad-10733 377 32 from from ADP dad-10733 377 33 50 50 NUM dad-10733 377 34 young young ADJ dad-10733 377 35 and and CCONJ dad-10733 377 36 old old ADJ dad-10733 377 37 adults adult NOUN dad-10733 377 38 interacting interact VERB dad-10733 377 39 with with ADP dad-10733 377 40 spoken spoken ADJ dad-10733 377 41 dialogue dialogue NOUN dad-10733 377 42 systems system NOUN dad-10733 377 43 . . PUNCT dad-10733 378 1 these these DET dad-10733 378 2 conversations conversation NOUN dad-10733 378 3 were be AUX dad-10733 378 4 annotated annotate VERB dad-10733 378 5 semi semi ADJ dad-10733 378 6 - - ADJ dad-10733 378 7 automatically automatically ADV dad-10733 378 8 with with ADP dad-10733 378 9 dialogue dialogue NOUN dad-10733 378 10 acts act NOUN dad-10733 378 11 and and CCONJ dad-10733 378 12 “ " PUNCT dad-10733 378 13 information information NOUN dad-10733 378 14 state state NOUN dad-10733 378 15 update update NOUN dad-10733 378 16 ” " PUNCT dad-10733 378 17 ( ( PUNCT dad-10733 378 18 isu isu NOUN dad-10733 378 19 ) ) PUNCT dad-10733 378 20 representations representation NOUN dad-10733 378 21 of of ADP dad-10733 378 22 dialogue dialogue NOUN dad-10733 378 23 context context NOUN dad-10733 378 24 . . PUNCT dad-10733 379 1 the the DET dad-10733 379 2 corpus corpus NOUN dad-10733 379 3 also also ADV dad-10733 379 4 contains contain VERB dad-10733 379 5 information information NOUN dad-10733 379 6 about about ADP dad-10733 379 7 the the DET dad-10733 379 8 users user NOUN dad-10733 379 9 ’ ’ PART dad-10733 379 10 cognitive cognitive ADJ dad-10733 379 11 abilities ability NOUN dad-10733 379 12 , , PUNCT dad-10733 379 13 with with ADP dad-10733 379 14 the the DET dad-10733 379 15 motivation motivation NOUN dad-10733 379 16 of of ADP dad-10733 379 17 modeling model VERB dad-10733 379 18 how how SCONJ dad-10733 379 19 the the DET dad-10733 379 20 elderly elderly ADJ dad-10733 379 21 interact interact VERB dad-10733 379 22 with with ADP dad-10733 379 23 dialogue dialogue NOUN dad-10733 379 24 systems system NOUN dad-10733 379 25 . . PUNCT dad-10733 380 1 4.2 4.2 NUM dad-10733 380 2 human human ADJ dad-10733 380 3 - - PUNCT dad-10733 380 4 human human NOUN dad-10733 380 5 spoken spoken NOUN dad-10733 380 6 corpora corpora NOUN dad-10733 380 7 naturally naturally ADV dad-10733 380 8 , , PUNCT dad-10733 380 9 there there PRON dad-10733 380 10 is be VERB dad-10733 380 11 much much ADV dad-10733 380 12 more more ADJ dad-10733 380 13 data datum NOUN dad-10733 380 14 available available ADJ dad-10733 380 15 for for ADP dad-10733 380 16 conversations conversation NOUN dad-10733 380 17 between between ADP dad-10733 380 18 humans human NOUN dad-10733 380 19 than than ADP dad-10733 380 20 conversations conversation NOUN dad-10733 380 21 between between ADP dad-10733 380 22 humans human NOUN dad-10733 380 23 and and CCONJ dad-10733 380 24 machines machine NOUN dad-10733 380 25 . . PUNCT dad-10733 381 1 thus thus ADV dad-10733 381 2 , , PUNCT dad-10733 381 3 we we PRON dad-10733 381 4 break break VERB dad-10733 381 5 down down ADP dad-10733 381 6 this this DET dad-10733 381 7 category category NOUN dad-10733 381 8 further far ADV dad-10733 381 9 , , PUNCT dad-10733 381 10 into into ADP dad-10733 381 11 spoken spoken ADJ dad-10733 381 12 dialogues dialogue NOUN dad-10733 381 13 ( ( PUNCT dad-10733 381 14 this this DET dad-10733 381 15 section section NOUN dad-10733 381 16 ) ) PUNCT dad-10733 381 17 and and CCONJ dad-10733 381 18 written write VERB dad-10733 381 19 dialogues dialogue NOUN dad-10733 381 20 ( ( PUNCT dad-10733 381 21 section section NOUN dad-10733 381 22 4.3 4.3 NUM dad-10733 381 23 ) ) PUNCT dad-10733 381 24 . . PUNCT dad-10733 382 1 the the DET dad-10733 382 2 distinction distinction NOUN dad-10733 382 3 between between ADP dad-10733 382 4 spoken speak VERB dad-10733 382 5 and and CCONJ dad-10733 382 6 written write VERB dad-10733 382 7 dialogues dialogue NOUN dad-10733 382 8 is be AUX dad-10733 382 9 important important ADJ dad-10733 382 10 , , PUNCT dad-10733 382 11 since since SCONJ dad-10733 382 12 the the DET dad-10733 382 13 distribution distribution NOUN dad-10733 382 14 of of ADP dad-10733 382 15 utterances utterance NOUN dad-10733 382 16 changes change NOUN dad-10733 382 17 dramatically dramatically ADV dad-10733 382 18 according accord VERB dad-10733 382 19 to to ADP dad-10733 382 20 the the DET dad-10733 382 21 nature nature NOUN dad-10733 382 22 of of ADP dad-10733 382 23 the the DET dad-10733 382 24 interaction interaction NOUN dad-10733 382 25 . . PUNCT dad-10733 383 1 as as SCONJ dad-10733 383 2 discussed discuss VERB dad-10733 383 3 in in ADP dad-10733 383 4 subsection subsection NOUN dad-10733 383 5 3.1 3.1 NUM dad-10733 383 6 , , PUNCT dad-10733 383 7 spoken speak VERB dad-10733 383 8 dialogues dialogue NOUN dad-10733 383 9 can can AUX dad-10733 383 10 potentially potentially ADV dad-10733 383 11 be be AUX dad-10733 383 12 less less ADV dad-10733 383 13 focused focused ADJ dad-10733 383 14 as as SCONJ dad-10733 383 15 the the DET dad-10733 383 16 user user NOUN dad-10733 383 17 speaks speak VERB dad-10733 383 18 in in ADP dad-10733 383 19 train train NOUN dad-10733 383 20 - - PUNCT dad-10733 383 21 of of ADP dad-10733 383 22 - - PUNCT dad-10733 383 23 thought thought NOUN dad-10733 383 24 manner manner NOUN dad-10733 383 25 . . PUNCT dad-10733 384 1 they they PRON dad-10733 384 2 also also ADV dad-10733 384 3 tend tend VERB dad-10733 384 4 to to PART dad-10733 384 5 use use VERB dad-10733 384 6 shorter short ADJ dad-10733 384 7 words word NOUN dad-10733 384 8 and and CCONJ dad-10733 384 9 phrases phrase NOUN dad-10733 384 10 . . PUNCT dad-10733 385 1 conversely conversely ADV dad-10733 385 2 , , PUNCT dad-10733 385 3 in in ADP dad-10733 385 4 written write VERB dad-10733 385 5 communication communication NOUN dad-10733 385 6 , , PUNCT dad-10733 385 7 users user NOUN dad-10733 385 8 have have VERB dad-10733 385 9 the the DET dad-10733 385 10 ability ability NOUN dad-10733 385 11 to to PART dad-10733 385 12 reflect reflect VERB dad-10733 385 13 on on ADP dad-10733 385 14 what what PRON dad-10733 385 15 they they PRON dad-10733 385 16 are be AUX dad-10733 385 17 writing write VERB dad-10733 385 18 before before SCONJ dad-10733 385 19 they they PRON dad-10733 385 20 send send VERB dad-10733 385 21 a a DET dad-10733 385 22 message message NOUN dad-10733 385 23 and and CCONJ dad-10733 385 24 thus thus ADV dad-10733 385 25 are be AUX dad-10733 385 26 more more ADV dad-10733 385 27 precise precise ADJ dad-10733 385 28 . . PUNCT dad-10733 386 1 written write VERB dad-10733 386 2 dialogues dialogue NOUN dad-10733 386 3 can can AUX dad-10733 386 4 also also ADV dad-10733 386 5 contain contain VERB dad-10733 386 6 spelling spelling NOUN dad-10733 386 7 errors error NOUN dad-10733 386 8 or or CCONJ dad-10733 386 9 abbreviations abbreviation NOUN dad-10733 386 10 ; ; PUNCT dad-10733 386 11 such such ADJ dad-10733 386 12 artifacts artifact NOUN dad-10733 386 13 are be AUX dad-10733 386 14 usually usually ADV dad-10733 386 15 not not PART dad-10733 386 16 present present ADJ dad-10733 386 17 in in ADP dad-10733 386 18 datasets dataset NOUN dad-10733 386 19 transcribed transcribe VERB dad-10733 386 20 from from ADP dad-10733 386 21 spoken spoken ADJ dad-10733 386 22 dialogues dialogue NOUN dad-10733 386 23 . . PUNCT dad-10733 387 1 4.2.1 4.2.1 NUM dad-10733 387 2 spontaneous spontaneous ADJ dad-10733 387 3 spoken spoken ADJ dad-10733 387 4 corpora corpora NOUN dad-10733 387 5 we we PRON dad-10733 387 6 first first ADV dad-10733 387 7 introduce introduce VERB dad-10733 387 8 datasets dataset NOUN dad-10733 387 9 in in ADP dad-10733 387 10 which which PRON dad-10733 387 11 the the DET dad-10733 387 12 topics topic NOUN dad-10733 387 13 of of ADP dad-10733 387 14 conversation conversation NOUN dad-10733 387 15 are be AUX dad-10733 387 16 either either CCONJ dad-10733 387 17 casual casual ADJ dad-10733 387 18 or or CCONJ dad-10733 387 19 not not PART dad-10733 387 20 pre pre VERB dad-10733 387 21 - - VERB dad-10733 387 22 specified specified ADJ dad-10733 387 23 in in ADP dad-10733 387 24 any any DET dad-10733 387 25 way way NOUN dad-10733 387 26 . . PUNCT dad-10733 388 1 we we PRON dad-10733 388 2 refer refer VERB dad-10733 388 3 to to ADP dad-10733 388 4 these these DET dad-10733 388 5 corpora corpora NOUN dad-10733 388 6 as as ADP dad-10733 388 7 spontaneous spontaneous ADJ dad-10733 388 8 , , PUNCT dad-10733 388 9 as as SCONJ dad-10733 388 10 we we PRON dad-10733 388 11 believe believe VERB dad-10733 388 12 they they PRON dad-10733 388 13 most most ADV dad-10733 388 14 closely closely ADV dad-10733 388 15 mimic mimic ADJ dad-10733 388 16 spontaneous spontaneous ADJ dad-10733 388 17 , , PUNCT dad-10733 388 18 unplanned unplanned ADJ dad-10733 388 19 spoken spoken ADJ dad-10733 388 20 interactions interaction NOUN dad-10733 388 21 between between ADP dad-10733 388 22 humans human NOUN dad-10733 388 23 . . PUNCT dad-10733 389 1 perhaps perhaps ADV dad-10733 389 2 one one NUM dad-10733 389 3 of of ADP dad-10733 389 4 the the DET dad-10733 389 5 most most ADV dad-10733 389 6 influential influential ADJ dad-10733 389 7 spoken spoken ADJ dad-10733 389 8 corpora corpora PROPN dad-10733 389 9 is be AUX dad-10733 389 10 the the DET dad-10733 389 11 switchboard switchboard NOUN dad-10733 389 12 dataset dataset NOUN dad-10733 389 13 ( ( PUNCT dad-10733 389 14 godfrey godfrey PROPN dad-10733 389 15 et et PROPN dad-10733 389 16 al al PROPN dad-10733 389 17 . . PROPN dad-10733 389 18 , , PUNCT dad-10733 389 19 1992 1992 NUM dad-10733 389 20 ) ) PUNCT dad-10733 389 21 . . PUNCT dad-10733 390 1 this this DET dad-10733 390 2 dataset dataset NOUN dad-10733 390 3 consists consist VERB dad-10733 390 4 of of ADP dad-10733 390 5 approximately approximately ADV dad-10733 390 6 2,500 2,500 NUM dad-10733 390 7 dialogues dialogue NOUN dad-10733 390 8 from from ADP dad-10733 390 9 phone phone NOUN dad-10733 390 10 calls call NOUN dad-10733 390 11 , , PUNCT dad-10733 390 12 along along ADP dad-10733 390 13 with with ADP dad-10733 390 14 wordby wordby ADJ dad-10733 390 15 - - PUNCT dad-10733 390 16 word word NOUN dad-10733 390 17 transcriptions transcription NOUN dad-10733 390 18 , , PUNCT dad-10733 390 19 with with ADP dad-10733 390 20 about about ADV dad-10733 390 21 500 500 NUM dad-10733 390 22 different different ADJ dad-10733 390 23 speakers speaker NOUN dad-10733 390 24 . . PUNCT dad-10733 391 1 a a DET dad-10733 391 2 computer computer NOUN dad-10733 391 3 - - PUNCT dad-10733 391 4 driven drive VERB dad-10733 391 5 robot robot NOUN dad-10733 391 6 operator operator NOUN dad-10733 391 7 system system NOUN dad-10733 391 8 introduced introduce VERB dad-10733 391 9 a a DET dad-10733 391 10 topic topic NOUN dad-10733 391 11 for for ADP dad-10733 391 12 discussion discussion NOUN dad-10733 391 13 between between ADP dad-10733 391 14 two two NUM dad-10733 391 15 participants participant NOUN dad-10733 391 16 , , PUNCT dad-10733 391 17 and and CCONJ dad-10733 391 18 recorded record VERB dad-10733 391 19 the the DET dad-10733 391 20 resulting result VERB dad-10733 391 21 conversation conversation NOUN dad-10733 391 22 . . PUNCT dad-10733 392 1 about about ADP dad-10733 392 2 70 70 NUM dad-10733 392 3 casual casual ADJ dad-10733 392 4 topics topic NOUN dad-10733 392 5 were be AUX dad-10733 392 6 provided provide VERB dad-10733 392 7 , , PUNCT dad-10733 392 8 of of ADP dad-10733 392 9 which which PRON dad-10733 392 10 about about ADP dad-10733 392 11 50 50 NUM dad-10733 392 12 were be AUX dad-10733 392 13 frequently frequently ADV dad-10733 392 14 used use VERB dad-10733 392 15 . . PUNCT dad-10733 393 1 the the DET dad-10733 393 2 corpus corpus NOUN dad-10733 393 3 was be AUX dad-10733 393 4 originally originally ADV dad-10733 393 5 designed design VERB dad-10733 393 6 for for ADP dad-10733 393 7 training training NOUN dad-10733 393 8 and and CCONJ dad-10733 393 9 testing test VERB dad-10733 393 10 various various ADJ dad-10733 393 11 speech speech NOUN dad-10733 393 12 processing processing NOUN dad-10733 393 13 algorithms algorithm NOUN dad-10733 393 14 ; ; PUNCT dad-10733 393 15 however however ADV dad-10733 393 16 , , PUNCT dad-10733 393 17 it it PRON dad-10733 393 18 has have AUX dad-10733 393 19 since since ADV dad-10733 393 20 been be AUX dad-10733 393 21 used use VERB dad-10733 393 22 for for ADP dad-10733 393 23 a a DET dad-10733 393 24 wide wide ADJ dad-10733 393 25 variety variety NOUN dad-10733 393 26 tasks task NOUN dad-10733 393 27 , , PUNCT dad-10733 393 28 including include VERB dad-10733 393 29 the the DET dad-10733 393 30 modeling modeling NOUN dad-10733 393 31 of of ADP dad-10733 393 32 dialogue dialogue NOUN dad-10733 393 33 acts act VERB dad-10733 393 34 such such ADJ dad-10733 393 35 as as ADP dad-10733 393 36 ‘ ' PUNCT dad-10733 393 37 statement statement NOUN dad-10733 393 38 ’ ' PUNCT dad-10733 393 39 , , PUNCT dad-10733 393 40 ‘ ' PUNCT dad-10733 393 41 question question NOUN dad-10733 393 42 ’ ' PUNCT dad-10733 393 43 , , PUNCT dad-10733 393 44 and and CCONJ dad-10733 393 45 ‘ ' PUNCT dad-10733 393 46 agreement agreement NOUN dad-10733 393 47 ’ ' PUNCT dad-10733 393 48 ( ( PUNCT dad-10733 393 49 stolcke stolcke NOUN dad-10733 393 50 et et PROPN dad-10733 393 51 al al PROPN dad-10733 393 52 . . PROPN dad-10733 393 53 , , PUNCT dad-10733 393 54 2000 2000 NUM dad-10733 393 55 ) ) PUNCT dad-10733 393 56 . . PUNCT dad-10733 394 1 another another DET dad-10733 394 2 important important ADJ dad-10733 394 3 dataset dataset NOUN dad-10733 394 4 is be AUX dad-10733 394 5 the the DET dad-10733 394 6 british british ADJ dad-10733 394 7 national national PROPN dad-10733 394 8 corpus corpus PROPN dad-10733 394 9 ( ( PUNCT dad-10733 394 10 bnc bnc NOUN dad-10733 394 11 ) ) PUNCT dad-10733 394 12 ( ( PUNCT dad-10733 394 13 leech leech NOUN dad-10733 394 14 , , PUNCT dad-10733 394 15 1992 1992 NUM dad-10733 394 16 ) ) PUNCT dad-10733 394 17 , , PUNCT dad-10733 394 18 which which PRON dad-10733 394 19 contains contain VERB dad-10733 394 20 approximately approximately ADV dad-10733 394 21 10 10 NUM dad-10733 394 22 million million NUM dad-10733 394 23 words word NOUN dad-10733 394 24 of of ADP dad-10733 394 25 dialogue dialogue NOUN dad-10733 394 26 . . PUNCT dad-10733 395 1 these these PRON dad-10733 395 2 were be AUX dad-10733 395 3 collected collect VERB dad-10733 395 4 in in ADP dad-10733 395 5 a a DET dad-10733 395 6 variety variety NOUN dad-10733 395 7 of of ADP dad-10733 395 8 contexts context NOUN dad-10733 395 9 ranging range VERB dad-10733 395 10 from from ADP dad-10733 395 11 formal formal ADJ dad-10733 395 12 business business NOUN dad-10733 395 13 or or CCONJ dad-10733 395 14 government government NOUN dad-10733 395 15 meetings meeting NOUN dad-10733 395 16 , , PUNCT dad-10733 395 17 to to ADP dad-10733 395 18 radio radio NOUN dad-10733 395 19 shows show NOUN dad-10733 395 20 and and CCONJ dad-10733 395 21 phone phone NOUN dad-10733 395 22 - - PUNCT dad-10733 395 23 ins in NOUN dad-10733 395 24 . . PUNCT dad-10733 396 1 although although SCONJ dad-10733 396 2 most most ADJ dad-10733 396 3 of of ADP dad-10733 396 4 the the DET dad-10733 396 5 conversations conversation NOUN dad-10733 396 6 are be AUX dad-10733 396 7 spoken speak VERB dad-10733 396 8 in in ADP dad-10733 396 9 nature nature NOUN dad-10733 396 10 , , PUNCT dad-10733 396 11 some some PRON dad-10733 396 12 of of ADP dad-10733 396 13 them they PRON dad-10733 396 14 are be AUX dad-10733 396 15 also also ADV dad-10733 396 16 written write VERB dad-10733 396 17 . . PUNCT dad-10733 397 1 bnc bnc NOUN dad-10733 397 2 covers cover VERB dad-10733 397 3 a a DET dad-10733 397 4 large large ADJ dad-10733 397 5 number number NOUN dad-10733 397 6 of of ADP dad-10733 397 7 sources source NOUN dad-10733 397 8 , , PUNCT dad-10733 397 9 and and CCONJ dad-10733 397 10 was be AUX dad-10733 397 11 designed design VERB dad-10733 397 12 to to PART dad-10733 397 13 represent represent VERB dad-10733 397 14 a a DET dad-10733 397 15 wide wide ADJ dad-10733 397 16 cross cross NOUN dad-10733 397 17 - - NOUN dad-10733 397 18 section section NOUN dad-10733 397 19 of of ADP dad-10733 397 20 british british PROPN dad-10733 397 21 english english PROPN dad-10733 397 22 from from ADP dad-10733 397 23 the the DET dad-10733 397 24 late late ADJ dad-10733 397 25 17 17 NUM dad-10733 397 26 serban serban PROPN dad-10733 397 27 , , PUNCT dad-10733 397 28 lowe lowe PROPN dad-10733 397 29 , , PUNCT dad-10733 397 30 henderson henderson PROPN dad-10733 397 31 , , PUNCT dad-10733 397 32 charlin charlin PROPN dad-10733 397 33 and and CCONJ dad-10733 397 34 pineau pineau PROPN dad-10733 397 35 twentieth twentieth ADJ dad-10733 397 36 century century NOUN dad-10733 397 37 . . PUNCT dad-10733 398 1 the the DET dad-10733 398 2 corpus corpus NOUN dad-10733 398 3 also also ADV dad-10733 398 4 includes include VERB dad-10733 398 5 part part NOUN dad-10733 398 6 - - PUNCT dad-10733 398 7 of of ADP dad-10733 398 8 - - PUNCT dad-10733 398 9 speech speech NOUN dad-10733 398 10 ( ( PUNCT dad-10733 398 11 pos pos NOUN dad-10733 398 12 ) ) PUNCT dad-10733 398 13 tagging tag VERB dad-10733 398 14 for for ADP dad-10733 398 15 every every DET dad-10733 398 16 word word NOUN dad-10733 398 17 . . PUNCT dad-10733 399 1 the the DET dad-10733 399 2 vast vast ADJ dad-10733 399 3 array array NOUN dad-10733 399 4 of of ADP dad-10733 399 5 settings setting NOUN dad-10733 399 6 and and CCONJ dad-10733 399 7 topics topic NOUN dad-10733 399 8 covered cover VERB dad-10733 399 9 by by ADP dad-10733 399 10 this this DET dad-10733 399 11 corpus corpus NOUN dad-10733 399 12 renders render VERB dad-10733 399 13 it it PRON dad-10733 399 14 very very ADV dad-10733 399 15 useful useful ADJ dad-10733 399 16 as as ADP dad-10733 399 17 a a DET dad-10733 399 18 general general ADJ dad-10733 399 19 - - PUNCT dad-10733 399 20 purpose purpose NOUN dad-10733 399 21 spoken spoken ADJ dad-10733 399 22 dialogue dialogue NOUN dad-10733 399 23 dataset dataset NOUN dad-10733 399 24 . . PUNCT dad-10733 400 1 other other ADJ dad-10733 400 2 datasets dataset NOUN dad-10733 400 3 have have AUX dad-10733 400 4 been be AUX dad-10733 400 5 collected collect VERB dad-10733 400 6 for for ADP dad-10733 400 7 the the DET dad-10733 400 8 analysis analysis NOUN dad-10733 400 9 of of ADP dad-10733 400 10 spoken spoken ADJ dad-10733 400 11 english english PROPN dad-10733 400 12 over over ADP dad-10733 400 13 the the DET dad-10733 400 14 telephone telephone NOUN dad-10733 400 15 . . PUNCT dad-10733 401 1 the the DET dad-10733 401 2 callhome callhome ADJ dad-10733 401 3 american american PROPN dad-10733 401 4 english english PROPN dad-10733 401 5 speech speech NOUN dad-10733 401 6 corpus corpus NOUN dad-10733 401 7 ( ( PUNCT dad-10733 401 8 canavan canavan NOUN dad-10733 401 9 et et PROPN dad-10733 401 10 al al PROPN dad-10733 401 11 . . PROPN dad-10733 401 12 , , PUNCT dad-10733 401 13 1997 1997 NUM dad-10733 401 14 ) ) PUNCT dad-10733 401 15 consists consist VERB dad-10733 401 16 of of ADP dad-10733 401 17 120 120 NUM dad-10733 401 18 such such ADJ dad-10733 401 19 conversations conversation NOUN dad-10733 401 20 totalling total VERB dad-10733 401 21 about about ADV dad-10733 401 22 60 60 NUM dad-10733 401 23 hours hour NOUN dad-10733 401 24 , , PUNCT dad-10733 401 25 mostly mostly ADV dad-10733 401 26 between between ADP dad-10733 401 27 family family NOUN dad-10733 401 28 members member NOUN dad-10733 401 29 or or CCONJ dad-10733 401 30 close close ADJ dad-10733 401 31 friends friend NOUN dad-10733 401 32 . . PUNCT dad-10733 402 1 similarly similarly ADV dad-10733 402 2 , , PUNCT dad-10733 402 3 the the DET dad-10733 402 4 callfriend callfriend NOUN dad-10733 402 5 american american PROPN dad-10733 402 6 english english PROPN dad-10733 402 7 - - PUNCT dad-10733 402 8 non non ADJ dad-10733 402 9 - - ADJ dad-10733 402 10 southern southern ADJ dad-10733 402 11 dialect dialect NOUN dad-10733 402 12 corpus corpus NOUN dad-10733 402 13 ( ( PUNCT dad-10733 402 14 canavan canavan NOUN dad-10733 402 15 and and CCONJ dad-10733 402 16 zipperlen zipperlen NOUN dad-10733 402 17 , , PUNCT dad-10733 402 18 1996 1996 NUM dad-10733 402 19 ) ) PUNCT dad-10733 402 20 consists consist VERB dad-10733 402 21 of of ADP dad-10733 402 22 60 60 NUM dad-10733 402 23 telephone telephone NOUN dad-10733 402 24 conversations conversation NOUN dad-10733 402 25 lasting last VERB dad-10733 402 26 between between ADP dad-10733 402 27 5 5 NUM dad-10733 402 28 and and CCONJ dad-10733 402 29 30 30 NUM dad-10733 402 30 minutes minute NOUN dad-10733 402 31 each each PRON dad-10733 402 32 between between ADP dad-10733 402 33 english english PROPN dad-10733 402 34 speakers speaker NOUN dad-10733 402 35 in in ADP dad-10733 402 36 north north PROPN dad-10733 402 37 america america PROPN dad-10733 402 38 without without ADP dad-10733 402 39 a a DET dad-10733 402 40 southern southern ADJ dad-10733 402 41 accent accent NOUN dad-10733 402 42 . . PUNCT dad-10733 403 1 it it PRON dad-10733 403 2 is be AUX dad-10733 403 3 annotated annotate VERB dad-10733 403 4 with with ADP dad-10733 403 5 speaker speaker NOUN dad-10733 403 6 information information NOUN dad-10733 403 7 such such ADJ dad-10733 403 8 as as ADP dad-10733 403 9 gender gender NOUN dad-10733 403 10 , , PUNCT dad-10733 403 11 age age NOUN dad-10733 403 12 , , PUNCT dad-10733 403 13 and and CCONJ dad-10733 403 14 education education NOUN dad-10733 403 15 . . PUNCT dad-10733 404 1 the the DET dad-10733 404 2 goal goal NOUN dad-10733 404 3 of of ADP dad-10733 404 4 the the DET dad-10733 404 5 project project NOUN dad-10733 404 6 was be AUX dad-10733 404 7 to to PART dad-10733 404 8 support support VERB dad-10733 404 9 the the DET dad-10733 404 10 development development NOUN dad-10733 404 11 of of ADP dad-10733 404 12 language language NOUN dad-10733 404 13 identification identification NOUN dad-10733 404 14 technologies technology NOUN dad-10733 404 15 , , PUNCT dad-10733 404 16 yet yet ADV dad-10733 404 17 , , PUNCT dad-10733 404 18 there there PRON dad-10733 404 19 are be VERB dad-10733 404 20 no no DET dad-10733 404 21 distinguishing distinguish VERB dad-10733 404 22 features feature NOUN dad-10733 404 23 in in ADP dad-10733 404 24 either either PRON dad-10733 404 25 of of ADP dad-10733 404 26 these these DET dad-10733 404 27 corpora corpora NOUN dad-10733 404 28 in in ADP dad-10733 404 29 terms term NOUN dad-10733 404 30 of of ADP dad-10733 404 31 the the DET dad-10733 404 32 topics topic NOUN dad-10733 404 33 of of ADP dad-10733 404 34 conversation conversation NOUN dad-10733 404 35 . . PUNCT dad-10733 405 1 an an DET dad-10733 405 2 attempt attempt NOUN dad-10733 405 3 to to PART dad-10733 405 4 capture capture VERB dad-10733 405 5 exclusively exclusively ADV dad-10733 405 6 teenage teenage ADJ dad-10733 405 7 spoken spoken ADJ dad-10733 405 8 language language NOUN dad-10733 405 9 was be AUX dad-10733 405 10 made make VERB dad-10733 405 11 in in ADP dad-10733 405 12 the the DET dad-10733 405 13 bergen bergen PROPN dad-10733 405 14 corpus corpus PROPN dad-10733 405 15 of of ADP dad-10733 405 16 london london PROPN dad-10733 405 17 teenager teenager NOUN dad-10733 405 18 language language NOUN dad-10733 405 19 ( ( PUNCT dad-10733 405 20 colt colt NOUN dad-10733 405 21 ) ) PUNCT dad-10733 405 22 ( ( PUNCT dad-10733 405 23 haslerud haslerud NOUN dad-10733 405 24 and and CCONJ dad-10733 405 25 stenström stenström NOUN dad-10733 405 26 , , PUNCT dad-10733 405 27 1995 1995 NUM dad-10733 405 28 ) ) PUNCT dad-10733 405 29 . . PUNCT dad-10733 406 1 conversations conversation NOUN dad-10733 406 2 were be AUX dad-10733 406 3 recorded record VERB dad-10733 406 4 surreptitiously surreptitiously ADV dad-10733 406 5 by by ADP dad-10733 406 6 student student NOUN dad-10733 406 7 ‘ ' PUNCT dad-10733 406 8 recruits recruit NOUN dad-10733 406 9 ’ ' PUNCT dad-10733 406 10 , , PUNCT dad-10733 406 11 with with ADP dad-10733 406 12 a a DET dad-10733 406 13 sony sony PROPN dad-10733 406 14 walkman walkman NOUN dad-10733 406 15 and and CCONJ dad-10733 406 16 a a DET dad-10733 406 17 lapel lapel NOUN dad-10733 406 18 microphone microphone NOUN dad-10733 406 19 , , PUNCT dad-10733 406 20 in in ADP dad-10733 406 21 order order NOUN dad-10733 406 22 to to PART dad-10733 406 23 obtain obtain VERB dad-10733 406 24 a a DET dad-10733 406 25 better well ADJ dad-10733 406 26 representation representation NOUN dad-10733 406 27 of of ADP dad-10733 406 28 teenager teenager NOUN dad-10733 406 29 interactions interaction NOUN dad-10733 406 30 ‘ ' PUNCT dad-10733 406 31 in in ADP dad-10733 406 32 - - PUNCT dad-10733 406 33 the the DET dad-10733 406 34 - - PUNCT dad-10733 406 35 wild wild ADJ dad-10733 406 36 ’ ' PUNCT dad-10733 406 37 . . PUNCT dad-10733 407 1 this this DET dad-10733 407 2 dataset dataset NOUN dad-10733 407 3 has have AUX dad-10733 407 4 been be AUX dad-10733 407 5 used use VERB dad-10733 407 6 to to PART dad-10733 407 7 identify identify VERB dad-10733 407 8 trends trend NOUN dad-10733 407 9 in in ADP dad-10733 407 10 language language NOUN dad-10733 407 11 evolution evolution NOUN dad-10733 407 12 in in ADP dad-10733 407 13 teenagers teenager NOUN dad-10733 407 14 ( ( PUNCT dad-10733 407 15 stenström stenström NOUN dad-10733 407 16 et et PROPN dad-10733 407 17 al al PROPN dad-10733 407 18 . . PROPN dad-10733 407 19 , , PUNCT dad-10733 407 20 2002 2002 NUM dad-10733 407 21 ) ) PUNCT dad-10733 407 22 . . PUNCT dad-10733 408 1 the the DET dad-10733 408 2 cambridge cambridge PROPN dad-10733 408 3 and and CCONJ dad-10733 408 4 nottingham nottingham PROPN dad-10733 408 5 corpus corpus PROPN dad-10733 408 6 of of ADP dad-10733 408 7 discourse discourse NOUN dad-10733 408 8 in in ADP dad-10733 408 9 english english PROPN dad-10733 408 10 ( ( PUNCT dad-10733 408 11 cancode cancode NOUN dad-10733 408 12 ) ) PUNCT dad-10733 408 13 ( ( PUNCT dad-10733 408 14 mccarthy mccarthy PROPN dad-10733 408 15 , , PUNCT dad-10733 408 16 1998 1998 NUM dad-10733 408 17 ) ) PUNCT dad-10733 408 18 is be AUX dad-10733 408 19 a a DET dad-10733 408 20 subset subset NOUN dad-10733 408 21 of of ADP dad-10733 408 22 the the DET dad-10733 408 23 cambridge cambridge PROPN dad-10733 408 24 international international PROPN dad-10733 408 25 corpus corpus PROPN dad-10733 408 26 , , PUNCT dad-10733 408 27 containing contain VERB dad-10733 408 28 about about ADV dad-10733 408 29 5 5 NUM dad-10733 408 30 million million NUM dad-10733 408 31 words word NOUN dad-10733 408 32 collected collect VERB dad-10733 408 33 from from ADP dad-10733 408 34 recordings recording NOUN dad-10733 408 35 made make VERB dad-10733 408 36 throughout throughout ADP dad-10733 408 37 the the DET dad-10733 408 38 islands island NOUN dad-10733 408 39 of of ADP dad-10733 408 40 britain britain PROPN dad-10733 408 41 and and CCONJ dad-10733 408 42 ireland ireland PROPN dad-10733 408 43 . . PUNCT dad-10733 409 1 it it PRON dad-10733 409 2 was be AUX dad-10733 409 3 constructed construct VERB dad-10733 409 4 by by ADP dad-10733 409 5 cambridge cambridge PROPN dad-10733 409 6 university university PROPN dad-10733 409 7 press press NOUN dad-10733 409 8 and and CCONJ dad-10733 409 9 the the DET dad-10733 409 10 university university NOUN dad-10733 409 11 of of ADP dad-10733 409 12 nottingham nottingham PROPN dad-10733 409 13 using use VERB dad-10733 409 14 dialogue dialogue NOUN dad-10733 409 15 data datum NOUN dad-10733 409 16 on on ADP dad-10733 409 17 general general ADJ dad-10733 409 18 topics topic NOUN dad-10733 409 19 between between ADP dad-10733 409 20 1995 1995 NUM dad-10733 409 21 and and CCONJ dad-10733 409 22 2000 2000 NUM dad-10733 409 23 . . PUNCT dad-10733 410 1 it it PRON dad-10733 410 2 focuses focus VERB dad-10733 410 3 on on ADP dad-10733 410 4 interpersonal interpersonal ADJ dad-10733 410 5 communication communication NOUN dad-10733 410 6 in in ADP dad-10733 410 7 a a DET dad-10733 410 8 range range NOUN dad-10733 410 9 of of ADP dad-10733 410 10 social social ADJ dad-10733 410 11 contexts contexts NOUN dad-10733 410 12 , , PUNCT dad-10733 410 13 varying vary VERB dad-10733 410 14 from from ADP dad-10733 410 15 hair hair NOUN dad-10733 410 16 salons salon NOUN dad-10733 410 17 , , PUNCT dad-10733 410 18 to to PART dad-10733 410 19 post post VERB dad-10733 410 20 offices office NOUN dad-10733 410 21 , , PUNCT dad-10733 410 22 to to ADP dad-10733 410 23 restaurants restaurant NOUN dad-10733 410 24 . . PUNCT dad-10733 411 1 this this PRON dad-10733 411 2 has have AUX dad-10733 411 3 been be AUX dad-10733 411 4 used use VERB dad-10733 411 5 , , PUNCT dad-10733 411 6 for for ADP dad-10733 411 7 example example NOUN dad-10733 411 8 , , PUNCT dad-10733 411 9 to to PART dad-10733 411 10 study study VERB dad-10733 411 11 language language NOUN dad-10733 411 12 awareness awareness NOUN dad-10733 411 13 in in ADP dad-10733 411 14 relation relation NOUN dad-10733 411 15 to to PART dad-10733 411 16 spoken speak VERB dad-10733 411 17 texts text NOUN dad-10733 411 18 and and CCONJ dad-10733 411 19 their their PRON dad-10733 411 20 cultural cultural ADJ dad-10733 411 21 contexts contexts NOUN dad-10733 411 22 ( ( PUNCT dad-10733 411 23 carter carter PROPN dad-10733 411 24 , , PUNCT dad-10733 411 25 1998 1998 NUM dad-10733 411 26 ) ) PUNCT dad-10733 411 27 . . PUNCT dad-10733 412 1 in in ADP dad-10733 412 2 the the DET dad-10733 412 3 dataset dataset NOUN dad-10733 412 4 , , PUNCT dad-10733 412 5 the the DET dad-10733 412 6 relationships relationship NOUN dad-10733 412 7 between between ADP dad-10733 412 8 speakers speaker NOUN dad-10733 412 9 ( ( PUNCT dad-10733 412 10 e.g. e.g. ADV dad-10733 412 11 roommates roommate NOUN dad-10733 412 12 , , PUNCT dad-10733 412 13 strangers stranger NOUN dad-10733 412 14 ) ) PUNCT dad-10733 412 15 are be AUX dad-10733 412 16 labeled label VERB dad-10733 412 17 and and CCONJ dad-10733 412 18 the the DET dad-10733 412 19 interaction interaction NOUN dad-10733 412 20 types type NOUN dad-10733 412 21 are be AUX dad-10733 412 22 provided provide VERB dad-10733 412 23 ( ( PUNCT dad-10733 412 24 e.g. e.g. ADV dad-10733 412 25 professional professional ADJ dad-10733 412 26 , , PUNCT dad-10733 412 27 intimate intimate ADJ dad-10733 412 28 ) ) PUNCT dad-10733 412 29 . . PUNCT dad-10733 413 1 other other ADJ dad-10733 413 2 works work NOUN dad-10733 413 3 have have AUX dad-10733 413 4 attempted attempt VERB dad-10733 413 5 to to PART dad-10733 413 6 record record VERB dad-10733 413 7 the the DET dad-10733 413 8 physical physical ADJ dad-10733 413 9 elements element NOUN dad-10733 413 10 of of ADP dad-10733 413 11 conversations conversation NOUN dad-10733 413 12 between between ADP dad-10733 413 13 humans human NOUN dad-10733 413 14 . . PUNCT dad-10733 414 1 to to ADP dad-10733 414 2 this this DET dad-10733 414 3 end end NOUN dad-10733 414 4 , , PUNCT dad-10733 414 5 a a DET dad-10733 414 6 small small ADJ dad-10733 414 7 corpus corpus NOUN dad-10733 414 8 entitled entitle VERB dad-10733 414 9 d64 d64 PROPN dad-10733 414 10 multimodal multimodal ADJ dad-10733 414 11 conversational conversational ADJ dad-10733 414 12 corpus corpus NOUN dad-10733 414 13 ( ( PUNCT dad-10733 414 14 oertel oertel NOUN dad-10733 414 15 et et PROPN dad-10733 414 16 al al PROPN dad-10733 414 17 . . PROPN dad-10733 414 18 , , PUNCT dad-10733 414 19 2013 2013 NUM dad-10733 414 20 ) ) PUNCT dad-10733 414 21 was be AUX dad-10733 414 22 collected collect VERB dad-10733 414 23 , , PUNCT dad-10733 414 24 incorporating incorporate VERB dad-10733 414 25 data datum NOUN dad-10733 414 26 from from ADP dad-10733 414 27 7 7 NUM dad-10733 414 28 video video NOUN dad-10733 414 29 cameras camera NOUN dad-10733 414 30 , , PUNCT dad-10733 414 31 and and CCONJ dad-10733 414 32 the the DET dad-10733 414 33 registration registration NOUN dad-10733 414 34 of of ADP dad-10733 414 35 3 3 NUM dad-10733 414 36 - - PUNCT dad-10733 414 37 d d NOUN dad-10733 414 38 head head NOUN dad-10733 414 39 , , PUNCT dad-10733 414 40 torso torso NOUN dad-10733 414 41 , , PUNCT dad-10733 414 42 and and CCONJ dad-10733 414 43 arm arm NOUN dad-10733 414 44 motion motion NOUN dad-10733 414 45 using use VERB dad-10733 414 46 an an DET dad-10733 414 47 optitrack optitrack NOUN dad-10733 414 48 system system NOUN dad-10733 414 49 . . PUNCT dad-10733 415 1 significant significant ADJ dad-10733 415 2 effort effort NOUN dad-10733 415 3 was be AUX dad-10733 415 4 made make VERB dad-10733 415 5 to to PART dad-10733 415 6 make make VERB dad-10733 415 7 the the DET dad-10733 415 8 data datum NOUN dad-10733 415 9 collection collection NOUN dad-10733 415 10 process process NOUN dad-10733 415 11 as as ADP dad-10733 415 12 non non ADJ dad-10733 415 13 - - ADJ dad-10733 415 14 intrusive intrusive ADJ dad-10733 415 15 — — PUNCT dad-10733 415 16 and and CCONJ dad-10733 415 17 thus thus ADV dad-10733 415 18 , , PUNCT dad-10733 415 19 natural natural ADJ dad-10733 415 20 — — PUNCT dad-10733 415 21 as as ADP dad-10733 415 22 possible possible ADJ dad-10733 415 23 . . PUNCT dad-10733 416 1 annotations annotation NOUN dad-10733 416 2 were be AUX dad-10733 416 3 made make VERB dad-10733 416 4 to to PART dad-10733 416 5 attempt attempt VERB dad-10733 416 6 to to PART dad-10733 416 7 quantify quantify VERB dad-10733 416 8 overall overall ADJ dad-10733 416 9 group group NOUN dad-10733 416 10 excitement excitement NOUN dad-10733 416 11 and and CCONJ dad-10733 416 12 pairwise pairwise NOUN dad-10733 416 13 social social ADJ dad-10733 416 14 distance distance NOUN dad-10733 416 15 between between ADP dad-10733 416 16 participants participant NOUN dad-10733 416 17 . . PUNCT dad-10733 417 1 a a DET dad-10733 417 2 similar similar ADJ dad-10733 417 3 attempt attempt NOUN dad-10733 417 4 to to PART dad-10733 417 5 incorporate incorporate VERB dad-10733 417 6 computer computer NOUN dad-10733 417 7 vision vision NOUN dad-10733 417 8 features feature NOUN dad-10733 417 9 was be AUX dad-10733 417 10 made make VERB dad-10733 417 11 in in ADP dad-10733 417 12 the the DET dad-10733 417 13 ami ami NOUN dad-10733 417 14 meeting meeting NOUN dad-10733 417 15 corpus corpus NOUN dad-10733 417 16 ( ( PUNCT dad-10733 417 17 renals renal NOUN dad-10733 417 18 et et NOUN dad-10733 417 19 al al PROPN dad-10733 417 20 . . PROPN dad-10733 417 21 , , PUNCT dad-10733 417 22 2007 2007 NUM dad-10733 417 23 ) ) PUNCT dad-10733 417 24 , , PUNCT dad-10733 417 25 where where SCONJ dad-10733 417 26 cameras camera NOUN dad-10733 417 27 , , PUNCT dad-10733 417 28 a a DET dad-10733 417 29 vga vga NOUN dad-10733 417 30 data data NOUN dad-10733 417 31 projector projector NOUN dad-10733 417 32 capture capture NOUN dad-10733 417 33 , , PUNCT dad-10733 417 34 whiteboard whiteboard NOUN dad-10733 417 35 capture capture NOUN dad-10733 417 36 , , PUNCT dad-10733 417 37 and and CCONJ dad-10733 417 38 digital digital ADJ dad-10733 417 39 pen pen NOUN dad-10733 417 40 capture capture NOUN dad-10733 417 41 , , PUNCT dad-10733 417 42 were be AUX dad-10733 417 43 all all PRON dad-10733 417 44 used use VERB dad-10733 417 45 in in ADP dad-10733 417 46 addition addition NOUN dad-10733 417 47 to to ADP dad-10733 417 48 speech speech NOUN dad-10733 417 49 recordings recording NOUN dad-10733 417 50 for for ADP dad-10733 417 51 various various ADJ dad-10733 417 52 meeting meeting NOUN dad-10733 417 53 scenarios scenario NOUN dad-10733 417 54 . . PUNCT dad-10733 418 1 as as ADP dad-10733 418 2 with with ADP dad-10733 418 3 the the DET dad-10733 418 4 d64 d64 PROPN dad-10733 418 5 corpus corpus NOUN dad-10733 418 6 , , PUNCT dad-10733 418 7 the the DET dad-10733 418 8 ami ami NOUN dad-10733 418 9 meeting meeting NOUN dad-10733 418 10 corpus corpus NOUN dad-10733 418 11 is be AUX dad-10733 418 12 a a DET dad-10733 418 13 dataset dataset NOUN dad-10733 418 14 of of ADP dad-10733 418 15 multi multi ADJ dad-10733 418 16 - - ADJ dad-10733 418 17 participant participant ADJ dad-10733 418 18 chats chat NOUN dad-10733 418 19 ( ( PUNCT dad-10733 418 20 four four NUM dad-10733 418 21 - - PUNCT dad-10733 418 22 party party NOUN dad-10733 418 23 dialogues dialogue NOUN dad-10733 418 24 ) ) PUNCT dad-10733 418 25 where where SCONJ dad-10733 418 26 all all DET dad-10733 418 27 members member NOUN dad-10733 418 28 of of ADP dad-10733 418 29 the the DET dad-10733 418 30 party party NOUN dad-10733 418 31 interact interact VERB dad-10733 418 32 with with ADP dad-10733 418 33 one one NUM dad-10733 418 34 another another DET dad-10733 418 35 . . PUNCT dad-10733 419 1 it it PRON dad-10733 419 2 has have AUX dad-10733 419 3 been be AUX dad-10733 419 4 used use VERB dad-10733 419 5 for for ADP dad-10733 419 6 analysis analysis NOUN dad-10733 419 7 of of ADP dad-10733 419 8 the the DET dad-10733 419 9 dynamics dynamic NOUN dad-10733 419 10 of of ADP dad-10733 419 11 various various ADJ dad-10733 419 12 corporate corporate ADJ dad-10733 419 13 and and CCONJ dad-10733 419 14 academic academic ADJ dad-10733 419 15 meeting meeting NOUN dad-10733 419 16 scenarios scenario NOUN dad-10733 419 17 , , PUNCT dad-10733 419 18 such such ADJ dad-10733 419 19 as as ADP dad-10733 419 20 addressee addressee ADJ dad-10733 419 21 detection detection NOUN dad-10733 419 22 in in ADP dad-10733 419 23 a a DET dad-10733 419 24 multi multi ADJ dad-10733 419 25 - - ADJ dad-10733 419 26 party party ADJ dad-10733 419 27 chat chat NOUN dad-10733 419 28 ( ( PUNCT dad-10733 419 29 akker akker NOUN dad-10733 419 30 and and CCONJ dad-10733 419 31 traum traum PROPN dad-10733 419 32 , , PUNCT dad-10733 419 33 2009 2009 NUM dad-10733 419 34 ) ) PUNCT dad-10733 419 35 . . PUNCT dad-10733 420 1 in in ADP dad-10733 420 2 a a DET dad-10733 420 3 similar similar ADJ dad-10733 420 4 vein vein NOUN dad-10733 420 5 , , PUNCT dad-10733 420 6 the the DET dad-10733 420 7 cardiff cardiff ADJ dad-10733 420 8 conversation conversation NOUN dad-10733 420 9 database database NOUN dad-10733 420 10 ( ( PUNCT dad-10733 420 11 ccdb ccdb NOUN dad-10733 420 12 ) ) PUNCT dad-10733 420 13 ( ( PUNCT dad-10733 420 14 aubrey aubrey PROPN dad-10733 420 15 et et PROPN dad-10733 420 16 al al PROPN dad-10733 420 17 . . PROPN dad-10733 420 18 , , PUNCT dad-10733 420 19 2013 2013 NUM dad-10733 420 20 ) ) PUNCT dad-10733 420 21 is be AUX dad-10733 420 22 an an DET dad-10733 420 23 audiovisual audiovisual ADJ dad-10733 420 24 database database NOUN dad-10733 420 25 containing contain VERB dad-10733 420 26 unscripted unscripte VERB dad-10733 420 27 natural natural ADJ dad-10733 420 28 conversations conversation NOUN dad-10733 420 29 between between ADP dad-10733 420 30 pairs pair NOUN dad-10733 420 31 of of ADP dad-10733 420 32 people people NOUN dad-10733 420 33 . . PUNCT dad-10733 421 1 the the DET dad-10733 421 2 original original ADJ dad-10733 421 3 dataset dataset NOUN dad-10733 421 4 consisted consist VERB dad-10733 421 5 of of ADP dad-10733 421 6 30 30 NUM dad-10733 421 7 five five NUM dad-10733 421 8 - - PUNCT dad-10733 421 9 minute minute NOUN dad-10733 421 10 conversations conversation NOUN dad-10733 421 11 , , PUNCT dad-10733 421 12 7 7 NUM dad-10733 421 13 of of ADP dad-10733 421 14 which which PRON dad-10733 421 15 were be AUX dad-10733 421 16 fully fully ADV dad-10733 421 17 annotated annotate VERB dad-10733 421 18 with with ADP dad-10733 421 19 transcriptions transcription NOUN dad-10733 421 20 and and CCONJ dad-10733 421 21 behavioural behavioural ADJ dad-10733 421 22 annotations annotation NOUN dad-10733 421 23 such such ADJ dad-10733 421 24 as as ADP dad-10733 421 25 speaker speaker NOUN dad-10733 421 26 activity activity NOUN dad-10733 421 27 , , PUNCT dad-10733 421 28 facial facial ADJ dad-10733 421 29 expressions expression NOUN dad-10733 421 30 , , PUNCT dad-10733 421 31 head head NOUN dad-10733 421 32 motions motion NOUN dad-10733 421 33 , , PUNCT dad-10733 421 34 and and CCONJ dad-10733 421 35 smiles smile VERB dad-10733 421 36 . . PUNCT dad-10733 422 1 the the DET dad-10733 422 2 content content NOUN dad-10733 422 3 of of ADP dad-10733 422 4 the the DET dad-10733 422 5 conversation conversation NOUN dad-10733 422 6 is be AUX dad-10733 422 7 an an DET dad-10733 422 8 unconstrained unconstrained ADJ dad-10733 422 9 discussion discussion NOUN dad-10733 422 10 on on ADP dad-10733 422 11 topics topic NOUN dad-10733 422 12 such such ADJ dad-10733 422 13 as as ADP dad-10733 422 14 movies movie NOUN dad-10733 422 15 . . PUNCT dad-10733 423 1 while while SCONJ dad-10733 423 2 the the DET dad-10733 423 3 original original ADJ dad-10733 423 4 dataset dataset NOUN dad-10733 423 5 featured feature VERB dad-10733 423 6 2d 2d NUM dad-10733 423 7 visual visual ADJ dad-10733 423 8 feeds feed NOUN dad-10733 423 9 , , PUNCT dad-10733 423 10 an an DET dad-10733 423 11 updated update VERB dad-10733 423 12 version version NOUN dad-10733 423 13 with with ADP dad-10733 423 14 3d 3d PROPN dad-10733 423 15 video video NOUN dad-10733 423 16 has have AUX dad-10733 423 17 also also ADV dad-10733 423 18 been be AUX dad-10733 423 19 18 18 NUM dad-10733 423 20 a a DET dad-10733 423 21 survey survey NOUN dad-10733 423 22 of of ADP dad-10733 423 23 available available ADJ dad-10733 423 24 corpora corpora PROPN dad-10733 423 25 for for ADP dad-10733 423 26 building build VERB dad-10733 423 27 data data NOUN dad-10733 423 28 - - PUNCT dad-10733 423 29 driven drive VERB dad-10733 423 30 dialogue dialogue NOUN dad-10733 423 31 systems system NOUN dad-10733 423 32 derived derive VERB dad-10733 423 33 , , PUNCT dad-10733 423 34 called call VERB dad-10733 423 35 the the DET dad-10733 423 36 4d 4d NUM dad-10733 423 37 cardiff cardiff ADJ dad-10733 423 38 conversation conversation NOUN dad-10733 423 39 database database NOUN dad-10733 423 40 ( ( PUNCT dad-10733 423 41 4d 4d NUM dad-10733 423 42 ccdb ccdb NOUN dad-10733 423 43 ) ) PUNCT dad-10733 423 44 ( ( PUNCT dad-10733 423 45 vandeventer vandeventer NOUN dad-10733 423 46 et et PROPN dad-10733 423 47 al al PROPN dad-10733 423 48 . . PROPN dad-10733 423 49 , , PUNCT dad-10733 423 50 2015 2015 NUM dad-10733 423 51 ) ) PUNCT dad-10733 423 52 . . PUNCT dad-10733 424 1 this this DET dad-10733 424 2 version version NOUN dad-10733 424 3 contains contain VERB dad-10733 424 4 17 17 NUM dad-10733 424 5 one one NUM dad-10733 424 6 - - PUNCT dad-10733 424 7 minute minute NOUN dad-10733 424 8 conversations conversation NOUN dad-10733 424 9 from from ADP dad-10733 424 10 4 4 NUM dad-10733 424 11 participants participant NOUN dad-10733 424 12 on on ADP dad-10733 424 13 similarly similarly ADV dad-10733 424 14 un un ADJ dad-10733 424 15 - - ADJ dad-10733 424 16 constrained constrain VERB dad-10733 424 17 topics topic NOUN dad-10733 424 18 . . PUNCT dad-10733 425 1 the the DET dad-10733 425 2 diachronic diachronic ADJ dad-10733 425 3 corpus corpus NOUN dad-10733 425 4 of of ADP dad-10733 425 5 present present ADJ dad-10733 425 6 - - PUNCT dad-10733 425 7 day day NOUN dad-10733 425 8 spoken spoken ADJ dad-10733 425 9 english english PROPN dad-10733 425 10 ( ( PUNCT dad-10733 425 11 dcpse dcpse NOUN dad-10733 425 12 ) ) PUNCT dad-10733 425 13 ( ( PUNCT dad-10733 425 14 aarts aart NOUN dad-10733 425 15 and and CCONJ dad-10733 425 16 wallis wallis PROPN dad-10733 425 17 , , PUNCT dad-10733 425 18 2006 2006 NUM dad-10733 425 19 ) ) PUNCT dad-10733 425 20 is be AUX dad-10733 425 21 a a DET dad-10733 425 22 parsed parse VERB dad-10733 425 23 corpus corpus NOUN dad-10733 425 24 of of ADP dad-10733 425 25 spoken spoken ADJ dad-10733 425 26 english english PROPN dad-10733 425 27 made make VERB dad-10733 425 28 up up ADP dad-10733 425 29 of of ADP dad-10733 425 30 two two NUM dad-10733 425 31 separate separate ADJ dad-10733 425 32 datasets dataset NOUN dad-10733 425 33 . . PUNCT dad-10733 426 1 it it PRON dad-10733 426 2 contains contain VERB dad-10733 426 3 more more ADJ dad-10733 426 4 than than ADP dad-10733 426 5 400,000 400,000 NUM dad-10733 426 6 words word NOUN dad-10733 426 7 from from ADP dad-10733 426 8 the the DET dad-10733 426 9 ice ice NOUN dad-10733 426 10 - - PUNCT dad-10733 426 11 gb gb NOUN dad-10733 426 12 corpus corpus NOUN dad-10733 426 13 ( ( PUNCT dad-10733 426 14 collected collect VERB dad-10733 426 15 in in ADP dad-10733 426 16 the the DET dad-10733 426 17 early early ADJ dad-10733 426 18 1990s 1990s NUM dad-10733 426 19 ) ) PUNCT dad-10733 426 20 and and CCONJ dad-10733 426 21 400,000 400,000 NUM dad-10733 426 22 words word NOUN dad-10733 426 23 from from ADP dad-10733 426 24 the the DET dad-10733 426 25 londonlund londonlund PROPN dad-10733 426 26 corpus corpus NOUN dad-10733 426 27 ( ( PUNCT dad-10733 426 28 collected collect VERB dad-10733 426 29 from from ADP dad-10733 426 30 the the DET dad-10733 426 31 late late ADJ dad-10733 426 32 1960s 1960 NOUN dad-10733 426 33 to to ADP dad-10733 426 34 the the DET dad-10733 426 35 early early ADJ dad-10733 426 36 1980s 1980s NUM dad-10733 426 37 ) ) PUNCT dad-10733 426 38 . . PUNCT dad-10733 427 1 ice ice NOUN dad-10733 427 2 - - PUNCT dad-10733 427 3 gb gb NOUN dad-10733 427 4 refers refer VERB dad-10733 427 5 to to ADP dad-10733 427 6 the the DET dad-10733 427 7 british british ADJ dad-10733 427 8 component component NOUN dad-10733 427 9 of of ADP dad-10733 427 10 the the DET dad-10733 427 11 international international ADJ dad-10733 427 12 corpus corpus NOUN dad-10733 427 13 of of ADP dad-10733 427 14 english english PROPN dad-10733 427 15 ( ( PUNCT dad-10733 427 16 greenbaum greenbaum PROPN dad-10733 427 17 and and CCONJ dad-10733 427 18 nelson nelson PROPN dad-10733 427 19 , , PUNCT dad-10733 427 20 1996 1996 NUM dad-10733 427 21 ; ; PUNCT dad-10733 427 22 greenbaum greenbaum PROPN dad-10733 427 23 , , PUNCT dad-10733 427 24 1996 1996 NUM dad-10733 427 25 ) ) PUNCT dad-10733 427 26 and and CCONJ dad-10733 427 27 contains contain VERB dad-10733 427 28 both both PRON dad-10733 427 29 spoken speak VERB dad-10733 427 30 and and CCONJ dad-10733 427 31 written write VERB dad-10733 427 32 dialogues dialogue NOUN dad-10733 427 33 from from ADP dad-10733 427 34 english english ADJ dad-10733 427 35 adults adult NOUN dad-10733 427 36 who who PRON dad-10733 427 37 have have AUX dad-10733 427 38 completed complete VERB dad-10733 427 39 secondary secondary ADJ dad-10733 427 40 education education NOUN dad-10733 427 41 . . PUNCT dad-10733 428 1 the the DET dad-10733 428 2 dataset dataset NOUN dad-10733 428 3 was be AUX dad-10733 428 4 selected select VERB dad-10733 428 5 to to PART dad-10733 428 6 provide provide VERB dad-10733 428 7 a a DET dad-10733 428 8 representative representative ADJ dad-10733 428 9 sample sample NOUN dad-10733 428 10 of of ADP dad-10733 428 11 british british PROPN dad-10733 428 12 english english PROPN dad-10733 428 13 . . PUNCT dad-10733 429 1 the the DET dad-10733 429 2 london london PROPN dad-10733 429 3 - - PUNCT dad-10733 429 4 lund lund PROPN dad-10733 429 5 corpus corpus PROPN dad-10733 429 6 ( ( PUNCT dad-10733 429 7 svartvik svartvik NOUN dad-10733 429 8 , , PUNCT dad-10733 429 9 1990 1990 NUM dad-10733 429 10 ) ) PUNCT dad-10733 429 11 consists consist VERB dad-10733 429 12 exclusively exclusively ADV dad-10733 429 13 of of ADP dad-10733 429 14 spoken spoken ADJ dad-10733 429 15 british british ADJ dad-10733 429 16 conversations conversation NOUN dad-10733 429 17 , , PUNCT dad-10733 429 18 both both DET dad-10733 429 19 dialogues dialogue NOUN dad-10733 429 20 and and CCONJ dad-10733 429 21 monologues monologue NOUN dad-10733 429 22 . . PUNCT dad-10733 430 1 it it PRON dad-10733 430 2 contains contain VERB dad-10733 430 3 a a DET dad-10733 430 4 selection selection NOUN dad-10733 430 5 of of ADP dad-10733 430 6 face face NOUN dad-10733 430 7 - - PUNCT dad-10733 430 8 to to ADP dad-10733 430 9 - - PUNCT dad-10733 430 10 face face NOUN dad-10733 430 11 , , PUNCT dad-10733 430 12 telephone telephone NOUN dad-10733 430 13 , , PUNCT dad-10733 430 14 and and CCONJ dad-10733 430 15 public public ADJ dad-10733 430 16 discussion discussion NOUN dad-10733 430 17 dialogues dialogue NOUN dad-10733 430 18 ; ; PUNCT dad-10733 430 19 the the DET dad-10733 430 20 latter latter ADJ dad-10733 430 21 refers refer VERB dad-10733 430 22 to to ADP dad-10733 430 23 dialogues dialogue NOUN dad-10733 430 24 that that PRON dad-10733 430 25 are be AUX dad-10733 430 26 heard hear VERB dad-10733 430 27 by by ADP dad-10733 430 28 an an DET dad-10733 430 29 audience audience NOUN dad-10733 430 30 that that PRON dad-10733 430 31 does do AUX dad-10733 430 32 not not PART dad-10733 430 33 participate participate VERB dad-10733 430 34 in in ADP dad-10733 430 35 the the DET dad-10733 430 36 dialogue dialogue NOUN dad-10733 430 37 , , PUNCT dad-10733 430 38 including include VERB dad-10733 430 39 interviews interview NOUN dad-10733 430 40 and and CCONJ dad-10733 430 41 panel panel NOUN dad-10733 430 42 discussions discussion NOUN dad-10733 430 43 that that PRON dad-10733 430 44 have have AUX dad-10733 430 45 been be AUX dad-10733 430 46 broadcast broadcast VERB dad-10733 430 47 . . PUNCT dad-10733 431 1 the the DET dad-10733 431 2 orthographic orthographic ADJ dad-10733 431 3 transcriptions transcription NOUN dad-10733 431 4 of of ADP dad-10733 431 5 the the DET dad-10733 431 6 datasets dataset NOUN dad-10733 431 7 are be AUX dad-10733 431 8 normalized normalize VERB dad-10733 431 9 and and CCONJ dad-10733 431 10 annotated annotate VERB dad-10733 431 11 according accord VERB dad-10733 431 12 to to ADP dad-10733 431 13 the the DET dad-10733 431 14 same same ADJ dad-10733 431 15 criteria criterion NOUN dad-10733 431 16 ; ; PUNCT dad-10733 431 17 ice ice NOUN dad-10733 431 18 - - PUNCT dad-10733 431 19 gb gb NOUN dad-10733 431 20 was be AUX dad-10733 431 21 used use VERB dad-10733 431 22 as as ADP dad-10733 431 23 a a DET dad-10733 431 24 gold gold NOUN dad-10733 431 25 standard standard NOUN dad-10733 431 26 for for ADP dad-10733 431 27 the the DET dad-10733 431 28 parsing parsing NOUN dad-10733 431 29 of of ADP dad-10733 431 30 dcpse dcpse NOUN dad-10733 431 31 . . PUNCT dad-10733 432 1 the the DET dad-10733 432 2 spoken spoken ADJ dad-10733 432 3 corpus corpus NOUN dad-10733 432 4 of of ADP dad-10733 432 5 the the DET dad-10733 432 6 survey survey NOUN dad-10733 432 7 of of ADP dad-10733 432 8 english english ADJ dad-10733 432 9 dialects dialect NOUN dad-10733 432 10 ( ( PUNCT dad-10733 432 11 beare beare NOUN dad-10733 432 12 and and CCONJ dad-10733 432 13 scott scott PROPN dad-10733 432 14 , , PUNCT dad-10733 432 15 1999 1999 NUM dad-10733 432 16 ) ) PUNCT dad-10733 432 17 consists consist VERB dad-10733 432 18 of of ADP dad-10733 432 19 1000 1000 NUM dad-10733 432 20 recordings recording NOUN dad-10733 432 21 , , PUNCT dad-10733 432 22 with with ADP dad-10733 432 23 about about ADV dad-10733 432 24 0.8 0.8 NUM dad-10733 432 25 million million NUM dad-10733 432 26 total total ADJ dad-10733 432 27 words word NOUN dad-10733 432 28 , , PUNCT dad-10733 432 29 collected collect VERB dad-10733 432 30 from from ADP dad-10733 432 31 1948 1948 NUM dad-10733 432 32 to to ADP dad-10733 432 33 1961 1961 NUM dad-10733 432 34 in in ADP dad-10733 432 35 order order NOUN dad-10733 432 36 to to PART dad-10733 432 37 document document VERB dad-10733 432 38 various various ADJ dad-10733 432 39 existing exist VERB dad-10733 432 40 english english ADJ dad-10733 432 41 dialects dialect NOUN dad-10733 432 42 . . PUNCT dad-10733 433 1 people people NOUN dad-10733 433 2 aged age VERB dad-10733 433 3 60 60 NUM dad-10733 433 4 and and CCONJ dad-10733 433 5 over over ADV dad-10733 433 6 were be AUX dad-10733 433 7 recruited recruit VERB dad-10733 433 8 , , PUNCT dad-10733 433 9 being be AUX dad-10733 433 10 most most ADV dad-10733 433 11 likely likely ADJ dad-10733 433 12 to to PART dad-10733 433 13 speak speak VERB dad-10733 433 14 the the DET dad-10733 433 15 traditional traditional ADJ dad-10733 433 16 ‘ ' PUNCT dad-10733 433 17 uncontaminated uncontaminated ADJ dad-10733 433 18 ’ ' PUNCT dad-10733 433 19 dialects dialect NOUN dad-10733 433 20 of of ADP dad-10733 433 21 their their PRON dad-10733 433 22 area area NOUN dad-10733 433 23 and and CCONJ dad-10733 433 24 encouraged encourage VERB dad-10733 433 25 to to PART dad-10733 433 26 talk talk VERB dad-10733 433 27 about about ADP dad-10733 433 28 their their PRON dad-10733 433 29 memories memory NOUN dad-10733 433 30 , , PUNCT dad-10733 433 31 families family NOUN dad-10733 433 32 , , PUNCT dad-10733 433 33 work work NOUN dad-10733 433 34 , , PUNCT dad-10733 433 35 and and CCONJ dad-10733 433 36 their their PRON dad-10733 433 37 countryside countryside NOUN dad-10733 433 38 folklore folklore NOUN dad-10733 433 39 . . PUNCT dad-10733 434 1 the the DET dad-10733 434 2 child child NOUN dad-10733 434 3 language language NOUN dad-10733 434 4 data datum NOUN dad-10733 434 5 exchange exchange NOUN dad-10733 434 6 system system NOUN dad-10733 434 7 ( ( PUNCT dad-10733 434 8 childes childe NOUN dad-10733 434 9 ) ) PUNCT dad-10733 434 10 ( ( PUNCT dad-10733 434 11 macwhinney macwhinney NOUN dad-10733 434 12 and and CCONJ dad-10733 434 13 snow snow NOUN dad-10733 434 14 , , PUNCT dad-10733 434 15 1985 1985 NUM dad-10733 434 16 ) ) PUNCT dad-10733 434 17 is be AUX dad-10733 434 18 a a DET dad-10733 434 19 database database NOUN dad-10733 434 20 organized organize VERB dad-10733 434 21 for for ADP dad-10733 434 22 the the DET dad-10733 434 23 study study NOUN dad-10733 434 24 of of ADP dad-10733 434 25 first first ADJ dad-10733 434 26 and and CCONJ dad-10733 434 27 second second ADJ dad-10733 434 28 language language NOUN dad-10733 434 29 acquisition acquisition NOUN dad-10733 434 30 . . PUNCT dad-10733 435 1 the the DET dad-10733 435 2 database database NOUN dad-10733 435 3 contains contain VERB dad-10733 435 4 10 10 NUM dad-10733 435 5 million million NUM dad-10733 435 6 english english ADJ dad-10733 435 7 words word NOUN dad-10733 435 8 and and CCONJ dad-10733 435 9 approximately approximately ADV dad-10733 435 10 the the DET dad-10733 435 11 same same ADJ dad-10733 435 12 number number NOUN dad-10733 435 13 of of ADP dad-10733 435 14 non non ADJ dad-10733 435 15 - - ADJ dad-10733 435 16 english english ADJ dad-10733 435 17 words word NOUN dad-10733 435 18 . . PUNCT dad-10733 436 1 it it PRON dad-10733 436 2 also also ADV dad-10733 436 3 contains contain VERB dad-10733 436 4 transcripts transcript NOUN dad-10733 436 5 , , PUNCT dad-10733 436 6 with with ADP dad-10733 436 7 occasional occasional ADJ dad-10733 436 8 audio audio ADJ dad-10733 436 9 and and CCONJ dad-10733 436 10 video video NOUN dad-10733 436 11 recordings recording NOUN dad-10733 436 12 of of ADP dad-10733 436 13 data datum NOUN dad-10733 436 14 collected collect VERB dad-10733 436 15 from from ADP dad-10733 436 16 children child NOUN dad-10733 436 17 and and CCONJ dad-10733 436 18 adults adult NOUN dad-10733 436 19 learning learn VERB dad-10733 436 20 both both CCONJ dad-10733 436 21 first first ADJ dad-10733 436 22 and and CCONJ dad-10733 436 23 second second ADJ dad-10733 436 24 languages language NOUN dad-10733 436 25 , , PUNCT dad-10733 436 26 although although SCONJ dad-10733 436 27 the the DET dad-10733 436 28 english english ADJ dad-10733 436 29 transcripts transcript NOUN dad-10733 436 30 are be AUX dad-10733 436 31 mostly mostly ADV dad-10733 436 32 from from ADP dad-10733 436 33 children child NOUN dad-10733 436 34 . . PUNCT dad-10733 437 1 this this DET dad-10733 437 2 corpus corpus NOUN dad-10733 437 3 could could AUX dad-10733 437 4 be be AUX dad-10733 437 5 leveraged leverage VERB dad-10733 437 6 in in ADP dad-10733 437 7 order order NOUN dad-10733 437 8 to to PART dad-10733 437 9 build build VERB dad-10733 437 10 automated automate VERB dad-10733 437 11 teaching teaching NOUN dad-10733 437 12 assistants assistant NOUN dad-10733 437 13 . . PUNCT dad-10733 438 1 the the DET dad-10733 438 2 expanded expand VERB dad-10733 438 3 charlotte charlotte PROPN dad-10733 438 4 narrative narrative NOUN dad-10733 438 5 and and CCONJ dad-10733 438 6 conversation conversation NOUN dad-10733 438 7 collection collection NOUN dad-10733 438 8 ( ( PUNCT dad-10733 438 9 cncc cncc ADJ dad-10733 438 10 ) ) PUNCT dad-10733 438 11 , , PUNCT dad-10733 438 12 a a DET dad-10733 438 13 subset subset NOUN dad-10733 438 14 of of ADP dad-10733 438 15 the the DET dad-10733 438 16 first first ADJ dad-10733 438 17 release release NOUN dad-10733 438 18 of of ADP dad-10733 438 19 the the DET dad-10733 438 20 american american PROPN dad-10733 438 21 national national PROPN dad-10733 438 22 corpus corpus PROPN dad-10733 438 23 ( ( PUNCT dad-10733 438 24 reppen reppen VERB dad-10733 438 25 and and CCONJ dad-10733 438 26 ide ide ADJ dad-10733 438 27 , , PUNCT dad-10733 438 28 2004 2004 NUM dad-10733 438 29 ) ) PUNCT dad-10733 438 30 , , PUNCT dad-10733 438 31 contains contain VERB dad-10733 438 32 95 95 NUM dad-10733 438 33 narratives narrative NOUN dad-10733 438 34 , , PUNCT dad-10733 438 35 conversations conversation NOUN dad-10733 438 36 and and CCONJ dad-10733 438 37 interviews interview NOUN dad-10733 438 38 representative representative NOUN dad-10733 438 39 of of ADP dad-10733 438 40 the the DET dad-10733 438 41 residents resident NOUN dad-10733 438 42 of of ADP dad-10733 438 43 mecklenburg mecklenburg PROPN dad-10733 438 44 county county PROPN dad-10733 438 45 , , PUNCT dad-10733 438 46 north north PROPN dad-10733 438 47 carolina carolina PROPN dad-10733 438 48 and and CCONJ dad-10733 438 49 its its PRON dad-10733 438 50 surrounding surround VERB dad-10733 438 51 communities community NOUN dad-10733 438 52 . . PUNCT dad-10733 439 1 the the DET dad-10733 439 2 purpose purpose NOUN dad-10733 439 3 of of ADP dad-10733 439 4 the the DET dad-10733 439 5 cncc cncc NOUN dad-10733 439 6 was be AUX dad-10733 439 7 to to PART dad-10733 439 8 create create VERB dad-10733 439 9 a a DET dad-10733 439 10 corpus corpus NOUN dad-10733 439 11 of of ADP dad-10733 439 12 conversation conversation NOUN dad-10733 439 13 and and CCONJ dad-10733 439 14 conversational conversational ADJ dad-10733 439 15 narration narration NOUN dad-10733 439 16 in in ADP dad-10733 439 17 a a DET dad-10733 439 18 ’ ' PUNCT dad-10733 439 19 new new ADJ dad-10733 439 20 south south ADJ dad-10733 439 21 ’ ' PUNCT dad-10733 439 22 city city NOUN dad-10733 439 23 at at ADP dad-10733 439 24 the the DET dad-10733 439 25 beginning beginning NOUN dad-10733 439 26 of of ADP dad-10733 439 27 the the DET dad-10733 439 28 21st 21st ADJ dad-10733 439 29 century century NOUN dad-10733 439 30 , , PUNCT dad-10733 439 31 that that PRON dad-10733 439 32 could could AUX dad-10733 439 33 be be AUX dad-10733 439 34 used use VERB dad-10733 439 35 as as ADP dad-10733 439 36 a a DET dad-10733 439 37 resource resource NOUN dad-10733 439 38 for for ADP dad-10733 439 39 linguistic linguistic ADJ dad-10733 439 40 analysis analysis NOUN dad-10733 439 41 . . PUNCT dad-10733 440 1 it it PRON dad-10733 440 2 was be AUX dad-10733 440 3 originally originally ADV dad-10733 440 4 released release VERB dad-10733 440 5 as as ADP dad-10733 440 6 one one NUM dad-10733 440 7 of of ADP dad-10733 440 8 several several ADJ dad-10733 440 9 collections collection NOUN dad-10733 440 10 in in ADP dad-10733 440 11 the the DET dad-10733 440 12 new new ADJ dad-10733 440 13 south south ADJ dad-10733 440 14 voices voice NOUN dad-10733 440 15 corpus corpu NOUN dad-10733 440 16 , , PUNCT dad-10733 440 17 which which PRON dad-10733 440 18 otherwise otherwise ADV dad-10733 440 19 contained contain VERB dad-10733 440 20 mostly mostly ADV dad-10733 440 21 oral oral ADJ dad-10733 440 22 histories history NOUN dad-10733 440 23 . . PUNCT dad-10733 441 1 information information NOUN dad-10733 441 2 on on ADP dad-10733 441 3 speaker speaker NOUN dad-10733 441 4 age age NOUN dad-10733 441 5 and and CCONJ dad-10733 441 6 gender gender NOUN dad-10733 441 7 in in ADP dad-10733 441 8 the the DET dad-10733 441 9 cncc cncc NOUN dad-10733 441 10 is be AUX dad-10733 441 11 included include VERB dad-10733 441 12 in in ADP dad-10733 441 13 the the DET dad-10733 441 14 header header NOUN dad-10733 441 15 for for ADP dad-10733 441 16 each each DET dad-10733 441 17 transcript transcript NOUN dad-10733 441 18 . . PUNCT dad-10733 442 1 4.2.2 4.2.2 NUM dad-10733 442 2 constrained constrain VERB dad-10733 442 3 spoken speak VERB dad-10733 442 4 corpora corpora NOUN dad-10733 442 5 next next ADV dad-10733 442 6 , , PUNCT dad-10733 442 7 we we PRON dad-10733 442 8 discuss discuss VERB dad-10733 442 9 domains domain NOUN dad-10733 442 10 in in ADP dad-10733 442 11 which which PRON dad-10733 442 12 conversations conversation NOUN dad-10733 442 13 only only ADV dad-10733 442 14 occur occur VERB dad-10733 442 15 about about ADP dad-10733 442 16 a a DET dad-10733 442 17 particular particular ADJ dad-10733 442 18 topic topic NOUN dad-10733 442 19 , , PUNCT dad-10733 442 20 or or CCONJ dad-10733 442 21 towards towards ADP dad-10733 442 22 solving solve VERB dad-10733 442 23 a a DET dad-10733 442 24 specific specific ADJ dad-10733 442 25 task task NOUN dad-10733 442 26 . . PUNCT dad-10733 443 1 not not PART dad-10733 443 2 only only ADV dad-10733 443 3 is be AUX dad-10733 443 4 the the DET dad-10733 443 5 topic topic NOUN dad-10733 443 6 of of ADP dad-10733 443 7 the the DET dad-10733 443 8 conversation conversation NOUN dad-10733 443 9 specified specify VERB dad-10733 443 10 beforehand beforehand ADV dad-10733 443 11 , , PUNCT dad-10733 443 12 but but CCONJ dad-10733 443 13 participants participant NOUN dad-10733 443 14 are be AUX dad-10733 443 15 discouraged discourage VERB dad-10733 443 16 from from ADP dad-10733 443 17 deviating deviate VERB dad-10733 443 18 off off ADP dad-10733 443 19 - - PUNCT dad-10733 443 20 topic topic NOUN dad-10733 443 21 . . PUNCT dad-10733 444 1 as as ADP dad-10733 444 2 a a DET dad-10733 444 3 result result NOUN dad-10733 444 4 , , PUNCT dad-10733 444 5 these these DET dad-10733 444 6 corpora corpora NOUN dad-10733 444 7 are be AUX dad-10733 444 8 slightly slightly ADV dad-10733 444 9 less less ADV dad-10733 444 10 general general ADJ dad-10733 444 11 than than ADP dad-10733 444 12 their their PRON dad-10733 444 13 spontaneous spontaneous ADJ dad-10733 444 14 counterparts counterpart NOUN dad-10733 444 15 ; ; PUNCT dad-10733 444 16 however however ADV dad-10733 444 17 , , PUNCT dad-10733 444 18 they they PRON dad-10733 444 19 may may AUX dad-10733 444 20 be be AUX dad-10733 444 21 useful useful ADJ dad-10733 444 22 for for ADP dad-10733 444 23 building build VERB dad-10733 444 24 goal goal NOUN dad-10733 444 25 - - PUNCT dad-10733 444 26 oriented orient VERB dad-10733 444 27 dialogue dialogue NOUN dad-10733 444 28 systems system NOUN dad-10733 444 29 . . PUNCT dad-10733 445 1 as as SCONJ dad-10733 445 2 discussed discuss VERB dad-10733 445 3 in in ADP dad-10733 445 4 subsection subsection NOUN dad-10733 445 5 3.3 3.3 NUM dad-10733 445 6 , , PUNCT dad-10733 445 7 this this PRON dad-10733 445 8 may may AUX dad-10733 445 9 also also ADV dad-10733 445 10 make make VERB dad-10733 445 11 the the DET dad-10733 445 12 conversations conversation NOUN dad-10733 445 13 less less ADV dad-10733 445 14 natural natural ADJ dad-10733 445 15 . . PUNCT dad-10733 446 1 we we PRON dad-10733 446 2 can can AUX dad-10733 446 3 further far ADV dad-10733 446 4 subdivide subdivide VERB dad-10733 446 5 this this DET dad-10733 446 6 category category NOUN dad-10733 446 7 into into ADP dad-10733 446 8 the the DET dad-10733 446 9 types type NOUN dad-10733 446 10 of of ADP dad-10733 446 11 topics topic NOUN dad-10733 446 12 they they PRON dad-10733 446 13 cover cover VERB dad-10733 446 14 : : PUNCT dad-10733 446 15 path path NOUN dad-10733 446 16 - - PUNCT dad-10733 446 17 finding find VERB dad-10733 446 18 or or CCONJ dad-10733 446 19 planning planning NOUN dad-10733 446 20 tasks task NOUN dad-10733 446 21 , , PUNCT dad-10733 446 22 persuasion persuasion NOUN dad-10733 446 23 tasks task NOUN dad-10733 446 24 or or CCONJ dad-10733 446 25 debates debate NOUN dad-10733 446 26 , , PUNCT dad-10733 446 27 q&a q&a PROPN dad-10733 446 28 or or CCONJ dad-10733 446 29 information information NOUN dad-10733 446 30 retrieval retrieval NOUN dad-10733 446 31 tasks task NOUN dad-10733 446 32 , , PUNCT dad-10733 446 33 and and CCONJ dad-10733 446 34 miscellaneous miscellaneous ADJ dad-10733 446 35 topics topic NOUN dad-10733 446 36 . . PUNCT dad-10733 447 1 19 19 NUM dad-10733 447 2 serban serban PROPN dad-10733 447 3 , , PUNCT dad-10733 447 4 lowe lowe PROPN dad-10733 447 5 , , PUNCT dad-10733 447 6 henderson henderson PROPN dad-10733 447 7 , , PUNCT dad-10733 447 8 charlin charlin PROPN dad-10733 447 9 and and CCONJ dad-10733 447 10 pineau pineau PROPN dad-10733 447 11 n n PRON dad-10733 447 12 am be AUX dad-10733 447 13 e e NOUN dad-10733 447 14 to to PART dad-10733 447 15 pi pi VERB dad-10733 447 16 cs cs PROPN dad-10733 447 17 to to ADP dad-10733 447 18 ta ta X dad-10733 447 19 l l NOUN dad-10733 447 20 # # NOUN dad-10733 447 21 to to ADP dad-10733 447 22 ta ta ADP dad-10733 447 23 l l NOUN dad-10733 447 24 # # NOUN dad-10733 447 25 to to ADP dad-10733 447 26 ta ta ADP dad-10733 447 27 l l PROPN dad-10733 447 28 d d PROPN dad-10733 447 29 es es PROPN dad-10733 447 30 cr cr PROPN dad-10733 447 31 ip ip PROPN dad-10733 447 32 tio tio PROPN dad-10733 447 33 n n PROPN dad-10733 447 34 of of ADP dad-10733 447 35 di di X dad-10733 447 36 al al PROPN dad-10733 447 37 og og PROPN dad-10733 447 38 ue ue PROPN dad-10733 447 39 s s PROPN dad-10733 447 40 of of ADP dad-10733 447 41 w w NOUN dad-10733 447 42 or or CCONJ dad-10733 447 43 ds ds PRON dad-10733 447 44 le le X dad-10733 447 45 ng ng PROPN dad-10733 447 46 th th X dad-10733 447 47 sw sw PROPN dad-10733 447 48 itc itc PROPN dad-10733 447 49 hb hb PROPN dad-10733 447 50 oa oa PROPN dad-10733 447 51 rd rd PROPN dad-10733 447 52 ( ( PUNCT dad-10733 447 53 g g PROPN dad-10733 447 54 od od INTJ dad-10733 447 55 fr fr INTJ dad-10733 448 1 ey ey INTJ dad-10733 448 2 et et NOUN dad-10733 448 3 al al PROPN dad-10733 448 4 . . PROPN dad-10733 448 5 , , PUNCT dad-10733 448 6 19 19 NUM dad-10733 448 7 92 92 NUM dad-10733 448 8 ) ) PUNCT dad-10733 448 9 c c PROPN dad-10733 448 10 as as ADP dad-10733 448 11 ua ua PROPN dad-10733 448 12 lt lt VERB dad-10733 448 13 op op PROPN dad-10733 448 14 ic ic PROPN dad-10733 448 15 s s PROPN dad-10733 448 16 2 2 NUM dad-10733 448 17 , , PUNCT dad-10733 448 18 40 40 NUM dad-10733 448 19 0 0 NUM dad-10733 448 20 3 3 NUM dad-10733 448 21 m m NUM dad-10733 448 22 30 30 NUM dad-10733 448 23 0h 0h NOUN dad-10733 448 24 rs rs NOUN dad-10733 448 25 * * PUNCT dad-10733 448 26 te te X dad-10733 448 27 le le X dad-10733 448 28 ph ph PROPN dad-10733 448 29 on on ADP dad-10733 448 30 e e PROPN dad-10733 448 31 co co X dad-10733 448 32 nv nv PROPN dad-10733 448 33 er er INTJ dad-10733 448 34 sa sa PROPN dad-10733 448 35 tio tio PROPN dad-10733 448 36 ns ns INTJ dad-10733 448 37 on on ADP dad-10733 448 38 pr pr PROPN dad-10733 448 39 esp esp PROPN dad-10733 448 40 ec ec PROPN dad-10733 448 41 ifi ifi PROPN dad-10733 448 42 ed ed PROPN dad-10733 448 43 to to ADP dad-10733 448 44 pi pi PROPN dad-10733 448 45 cs cs PROPN dad-10733 448 46 b b PROPN dad-10733 448 47 ri ri PROPN dad-10733 448 48 tis tis PROPN dad-10733 448 49 h h NOUN dad-10733 448 50 n n CCONJ dad-10733 448 51 at at ADP dad-10733 448 52 io io PROPN dad-10733 448 53 na na X dad-10733 448 54 lc lc PROPN dad-10733 448 55 or or CCONJ dad-10733 448 56 pu pu PROPN dad-10733 448 57 s s PROPN dad-10733 448 58 ( ( PUNCT dad-10733 448 59 b b PROPN dad-10733 448 60 n n PRON dad-10733 448 61 c c NOUN dad-10733 448 62 ) ) PUNCT dad-10733 448 63 c c PROPN dad-10733 449 1 as as SCONJ dad-10733 449 2 ua ua PROPN dad-10733 449 3 lt lt VERB dad-10733 449 4 op op PROPN dad-10733 449 5 ic ic PROPN dad-10733 449 6 s s PROPN dad-10733 449 7 85 85 NUM dad-10733 449 8 4 4 NUM dad-10733 449 9 10 10 NUM dad-10733 449 10 m m NUM dad-10733 449 11 1 1 NUM dad-10733 449 12 , , PUNCT dad-10733 449 13 00 00 PUNCT dad-10733 450 1 0h 0h NUM dad-10733 450 2 rs rs PROPN dad-10733 450 3 * * PUNCT dad-10733 450 4 b b X dad-10733 450 5 ri ri PROPN dad-10733 450 6 tis tis PROPN dad-10733 450 7 h h NOUN dad-10733 450 8 di di NOUN dad-10733 450 9 al al PROPN dad-10733 450 10 og og PROPN dad-10733 450 11 ue ue PROPN dad-10733 451 1 s s VERB dad-10733 451 2 m m VERB dad-10733 451 3 an an DET dad-10733 451 4 y y X dad-10733 451 5 co co NOUN dad-10733 451 6 nt not PART dad-10733 451 7 ex ex X dad-10733 451 8 ts ts ADV dad-10733 451 9 , , PUNCT dad-10733 451 10 f f PROPN dad-10733 452 1 ro ro INTJ dad-10733 452 2 m m VERB dad-10733 452 3 fo fo INTJ dad-10733 452 4 rm rm PROPN dad-10733 452 5 al al PROPN dad-10733 452 6 bu bu PROPN dad-10733 452 7 si si PROPN dad-10733 452 8 ne ne PROPN dad-10733 452 9 ss ss PROPN dad-10733 452 10 or or CCONJ dad-10733 452 11 go go VERB dad-10733 452 12 ve ve PROPN dad-10733 452 13 rn rn PROPN dad-10733 452 14 m m PROPN dad-10733 452 15 en en PROPN dad-10733 452 16 t t PROPN dad-10733 452 17 ( ( PUNCT dad-10733 452 18 l l NOUN dad-10733 452 19 ee ee PROPN dad-10733 452 20 ch ch PROPN dad-10733 452 21 , , PUNCT dad-10733 452 22 1 1 NUM dad-10733 452 23 99 99 NUM dad-10733 452 24 2 2 NUM dad-10733 452 25 ) ) PUNCT dad-10733 452 26 m m VERB dad-10733 452 27 ee ee ADP dad-10733 452 28 tin tin NOUN dad-10733 452 29 gs gs PROPN dad-10733 452 30 to to ADP dad-10733 452 31 ra ra PROPN dad-10733 452 32 di di INTJ dad-10733 452 33 o o INTJ dad-10733 453 1 sh sh INTJ dad-10733 454 1 ow ow INTJ dad-10733 454 2 s s VERB dad-10733 454 3 an an DET dad-10733 454 4 d d NOUN dad-10733 454 5 ph ph NOUN dad-10733 454 6 on on ADP dad-10733 454 7 ein ein PROPN dad-10733 454 8 s. s. PROPN dad-10733 454 9 c c PROPN dad-10733 455 1 a a DET dad-10733 455 2 l l NOUN dad-10733 455 3 l l NOUN dad-10733 455 4 h h NOUN dad-10733 456 1 o o NOUN dad-10733 456 2 m m VERB dad-10733 456 3 e e NOUN dad-10733 456 4 a a DET dad-10733 456 5 m m NOUN dad-10733 456 6 er er INTJ dad-10733 456 7 ic ic PROPN dad-10733 456 8 an an DET dad-10733 456 9 e e X dad-10733 456 10 ng ng PROPN dad-10733 456 11 lis lis X dad-10733 456 12 h h NOUN dad-10733 456 13 c c NOUN dad-10733 456 14 as as ADP dad-10733 456 15 ua ua PROPN dad-10733 456 16 lt lt VERB dad-10733 456 17 op op PROPN dad-10733 456 18 ic ic PROPN dad-10733 456 19 s s PROPN dad-10733 456 20 12 12 NUM dad-10733 456 21 0 0 NUM dad-10733 456 22 54 54 NUM dad-10733 456 23 0k 0k NOUN dad-10733 456 24 * * PUNCT dad-10733 456 25 60 60 NUM dad-10733 456 26 hr hr NOUN dad-10733 456 27 s s X dad-10733 456 28 te te X dad-10733 456 29 le le X dad-10733 456 30 ph ph PROPN dad-10733 456 31 on on ADP dad-10733 456 32 e e PROPN dad-10733 456 33 co co X dad-10733 456 34 nv nv PROPN dad-10733 456 35 er er INTJ dad-10733 456 36 sa sa PROPN dad-10733 456 37 tio tio PROPN dad-10733 456 38 ns ns NUM dad-10733 456 39 be be PROPN dad-10733 456 40 tw tw INTJ dad-10733 456 41 ee ee ADP dad-10733 456 42 n n ADV dad-10733 456 43 fa fa NOUN dad-10733 457 1 m m VERB dad-10733 458 1 ily ily ADV dad-10733 459 1 m m VERB dad-10733 459 2 em em PRON dad-10733 459 3 be be AUX dad-10733 459 4 rs rs ADJ dad-10733 459 5 or or CCONJ dad-10733 459 6 cl cl VERB dad-10733 460 1 os os INTJ dad-10733 461 1 e e NOUN dad-10733 461 2 fr fr INTJ dad-10733 461 3 ie ie ADV dad-10733 461 4 nd nd PROPN dad-10733 461 5 s. s. PROPN dad-10733 461 6 sp sp ADP dad-10733 461 7 ee ee PROPN dad-10733 461 8 ch ch PROPN dad-10733 461 9 ( ( PUNCT dad-10733 461 10 c c PROPN dad-10733 461 11 an an DET dad-10733 461 12 av av PROPN dad-10733 461 13 an an PRON dad-10733 461 14 et et NOUN dad-10733 461 15 al al PROPN dad-10733 461 16 . . PUNCT dad-10733 461 17 , , PUNCT dad-10733 461 18 19 19 NUM dad-10733 461 19 97 97 NUM dad-10733 461 20 ) ) PUNCT dad-10733 461 21 c c PROPN dad-10733 461 22 a a DET dad-10733 461 23 l l NOUN dad-10733 461 24 l l NOUN dad-10733 461 25 fr fr NOUN dad-10733 462 1 ie ie X dad-10733 462 2 n n PROPN dad-10733 462 3 d d PROPN dad-10733 462 4 a a PROPN dad-10733 462 5 m m VERB dad-10733 462 6 er er INTJ dad-10733 462 7 ic ic PROPN dad-10733 462 8 an an DET dad-10733 462 9 e e X dad-10733 462 10 ng ng PROPN dad-10733 462 11 lis lis X dad-10733 462 12 h h NOUN dad-10733 462 13 c c NOUN dad-10733 462 14 as as SCONJ dad-10733 462 15 ua ua PROPN dad-10733 462 16 lt lt VERB dad-10733 462 17 op op PROPN dad-10733 462 18 ic ic PROPN dad-10733 462 19 s s PROPN dad-10733 462 20 60 60 NUM dad-10733 462 21 18 18 NUM dad-10733 462 22 0k 0k NOUN dad-10733 462 23 * * PUNCT dad-10733 462 24 20 20 NUM dad-10733 462 25 hr hr NOUN dad-10733 462 26 s s X dad-10733 462 27 te te X dad-10733 462 28 le le X dad-10733 462 29 ph ph PROPN dad-10733 462 30 on on ADP dad-10733 462 31 e e PROPN dad-10733 462 32 co co X dad-10733 462 33 nv nv PROPN dad-10733 462 34 er er INTJ dad-10733 462 35 sa sa PROPN dad-10733 462 36 tio tio PROPN dad-10733 462 37 ns ns NUM dad-10733 462 38 be be PROPN dad-10733 462 39 tw tw INTJ dad-10733 462 40 ee ee ADP dad-10733 462 41 n n PROPN dad-10733 462 42 a a DET dad-10733 462 43 m m NOUN dad-10733 462 44 er er INTJ dad-10733 462 45 ic ic INTJ dad-10733 462 46 an an DET dad-10733 462 47 s s X dad-10733 462 48 w w PROPN dad-10733 462 49 ith ith PROPN dad-10733 462 50 a a PRON dad-10733 462 51 so so ADV dad-10733 462 52 ut ut PROPN dad-10733 462 53 he he PRON dad-10733 462 54 rn rn PROPN dad-10733 462 55 ac ac PROPN dad-10733 462 56 ce ce PROPN dad-10733 462 57 nt not PART dad-10733 462 58 . . PUNCT dad-10733 463 1 n n PROPN dad-10733 463 2 on on ADP dad-10733 463 3 -s -s PROPN dad-10733 463 4 ou ou X dad-10733 463 5 th th INTJ dad-10733 463 6 er er INTJ dad-10733 463 7 n n CCONJ dad-10733 463 8 d d PROPN dad-10733 463 9 ia ia X dad-10733 463 10 le le X dad-10733 463 11 ct ct PROPN dad-10733 463 12 ( ( PUNCT dad-10733 463 13 c c PROPN dad-10733 463 14 an an DET dad-10733 463 15 av av PROPN dad-10733 463 16 an an DET dad-10733 463 17 an an PROPN dad-10733 463 18 d d PROPN dad-10733 463 19 z z NOUN dad-10733 463 20 ip ip NOUN dad-10733 463 21 pe pe INTJ dad-10733 463 22 rl rl X dad-10733 463 23 en en PROPN dad-10733 463 24 , , PUNCT dad-10733 463 25 1 1 NUM dad-10733 463 26 99 99 NUM dad-10733 463 27 6 6 NUM dad-10733 463 28 ) ) PUNCT dad-10733 463 29 t t NOUN dad-10733 463 30 he he PRON dad-10733 464 1 b b PROPN dad-10733 464 2 er er INTJ dad-10733 464 3 ge ge PROPN dad-10733 464 4 n n PROPN dad-10733 464 5 c c PROPN dad-10733 464 6 or or CCONJ dad-10733 464 7 pu pu PROPN dad-10733 464 8 s s PROPN dad-10733 464 9 of of ADP dad-10733 464 10 l l NOUN dad-10733 464 11 on on ADP dad-10733 464 12 do do VERB dad-10733 464 13 n n ADV dad-10733 464 14 u u NOUN dad-10733 464 15 nr nr NOUN dad-10733 464 16 es es PROPN dad-10733 464 17 tr tr PROPN dad-10733 464 18 ic ic PROPN dad-10733 464 19 te te PROPN dad-10733 464 20 d d PROPN dad-10733 464 21 10 10 NUM dad-10733 464 22 0 0 NUM dad-10733 464 23 50 50 NUM dad-10733 464 24 0k 0k NOUN dad-10733 464 25 55 55 NUM dad-10733 464 26 hr hr NOUN dad-10733 464 27 s s X dad-10733 464 28 sp sp NOUN dad-10733 464 29 on on ADP dad-10733 464 30 ta ta PROPN dad-10733 464 31 ne ne PROPN dad-10733 464 32 ou ou PROPN dad-10733 464 33 s s PROPN dad-10733 464 34 te te PROPN dad-10733 464 35 en en X dad-10733 464 36 ag ag PROPN dad-10733 464 37 e e PROPN dad-10733 464 38 ta ta PROPN dad-10733 464 39 lk lk PROPN dad-10733 464 40 re re VERB dad-10733 464 41 co co PROPN dad-10733 464 42 rd rd PROPN dad-10733 464 43 ed ed PROPN dad-10733 464 44 in in ADP dad-10733 464 45 19 19 NUM dad-10733 464 46 93 93 NUM dad-10733 464 47 . . PUNCT dad-10733 465 1 te te PROPN dad-10733 465 2 en en ADP dad-10733 465 3 ag ag PROPN dad-10733 465 4 e e PROPN dad-10733 465 5 l l PROPN dad-10733 465 6 an an DET dad-10733 465 7 gu gu NOUN dad-10733 465 8 ag ag PROPN dad-10733 465 9 e e PROPN dad-10733 465 10 c c PROPN dad-10733 465 11 on on ADP dad-10733 465 12 ve ve VERB dad-10733 465 13 rs r VERB dad-10733 465 14 at at ADP dad-10733 465 15 io io PROPN dad-10733 466 1 ns ns INTJ dad-10733 466 2 w w PROPN dad-10733 466 3 er er INTJ dad-10733 466 4 e e X dad-10733 466 5 re re AUX dad-10733 466 6 co co PROPN dad-10733 466 7 rd rd PROPN dad-10733 466 8 ed ed PROPN dad-10733 466 9 se se PROPN dad-10733 466 10 cr cr PROPN dad-10733 466 11 et et PROPN dad-10733 466 12 ly ly X dad-10733 466 13 . . PUNCT dad-10733 467 1 ( ( PUNCT dad-10733 467 2 h h NOUN dad-10733 467 3 as as ADP dad-10733 467 4 le le X dad-10733 467 5 ru ru PROPN dad-10733 467 6 d d PROPN dad-10733 467 7 an an PROPN dad-10733 467 8 d d X dad-10733 467 9 st st PROPN dad-10733 467 10 en en PROPN dad-10733 467 11 st st PROPN dad-10733 467 12 rö rö PROPN dad-10733 467 13 m m PROPN dad-10733 467 14 , , PUNCT dad-10733 467 15 1 1 NUM dad-10733 467 16 99 99 NUM dad-10733 467 17 5 5 NUM dad-10733 467 18 ) ) PUNCT dad-10733 467 19 t t NOUN dad-10733 468 1 he he PRON dad-10733 468 2 c c AUX dad-10733 468 3 am be AUX dad-10733 468 4 br br INTJ dad-10733 469 1 i i PROPN dad-10733 469 2 d d PROPN dad-10733 469 3 ge ge PROPN dad-10733 470 1 an an PROPN dad-10733 470 2 d d PROPN dad-10733 470 3 n n CCONJ dad-10733 470 4 ot ot NOUN dad-10733 470 5 tin tin PROPN dad-10733 470 6 gh gh PROPN dad-10733 470 7 am be AUX dad-10733 470 8 c c NOUN dad-10733 470 9 as as ADP dad-10733 470 10 ua ua PROPN dad-10733 470 11 lt lt VERB dad-10733 470 12 op op PROPN dad-10733 470 13 ic ic PROPN dad-10733 470 14 s s PART dad-10733 470 15 – – PUNCT dad-10733 470 16 5 5 NUM dad-10733 470 17 m m NOUN dad-10733 470 18 55 55 NUM dad-10733 470 19 0h 0h NOUN dad-10733 470 20 rs rs NOUN dad-10733 470 21 * * PUNCT dad-10733 470 22 b b X dad-10733 470 23 ri ri PROPN dad-10733 470 24 tis tis PROPN dad-10733 470 25 h h NOUN dad-10733 470 26 di di NOUN dad-10733 470 27 al al PROPN dad-10733 470 28 og og PROPN dad-10733 471 1 ue ue PROPN dad-10733 471 2 s s VERB dad-10733 471 3 fr fr INTJ dad-10733 471 4 om om PROPN dad-10733 471 5 w w PROPN dad-10733 471 6 i i PROPN dad-10733 471 7 d d PROPN dad-10733 471 8 e e PROPN dad-10733 471 9 va va PROPN dad-10733 471 10 ri ri PROPN dad-10733 471 11 et et PROPN dad-10733 471 12 y y PROPN dad-10733 471 13 of of ADP dad-10733 471 14 in in ADP dad-10733 471 15 fo fo ADP dad-10733 471 16 rm rm PROPN dad-10733 471 17 al al PROPN dad-10733 471 18 co co PROPN dad-10733 471 19 nt not PART dad-10733 471 20 ex ex X dad-10733 471 21 ts ts ADV dad-10733 471 22 , , PUNCT dad-10733 471 23 s s VERB dad-10733 471 24 uc uc NOUN dad-10733 471 25 h h PROPN dad-10733 471 26 as as ADP dad-10733 471 27 c c PROPN dad-10733 471 28 or or CCONJ dad-10733 471 29 pu pu PROPN dad-10733 471 30 s s PROPN dad-10733 471 31 of of ADP dad-10733 471 32 d d PROPN dad-10733 471 33 is be AUX dad-10733 471 34 co co VERB dad-10733 471 35 ur ur INTJ dad-10733 471 36 se se PROPN dad-10733 471 37 in in ADP dad-10733 471 38 e e PROPN dad-10733 471 39 ng ng PROPN dad-10733 471 40 lis lis PROPN dad-10733 471 41 h h NOUN dad-10733 471 42 ha ha INTJ dad-10733 471 43 ir ir PROPN dad-10733 471 44 sa sa PROPN dad-10733 471 45 lo lo PROPN dad-10733 472 1 ns ns INTJ dad-10733 472 2 , , PUNCT dad-10733 472 3 r r NOUN dad-10733 472 4 es es X dad-10733 472 5 ta ta AUX dad-10733 472 6 ur ur VERB dad-10733 472 7 an an DET dad-10733 472 8 ts ts X dad-10733 472 9 , , PUNCT dad-10733 472 10 e e X dad-10733 472 11 tc tc NUM dad-10733 472 12 . . PUNCT dad-10733 473 1 ( ( PUNCT dad-10733 473 2 m m PROPN dad-10733 473 3 cc cc PROPN dad-10733 473 4 ar ar PROPN dad-10733 473 5 th th PROPN dad-10733 473 6 y y PROPN dad-10733 473 7 , , PUNCT dad-10733 473 8 19 19 NUM dad-10733 473 9 98 98 NUM dad-10733 473 10 ) ) PUNCT dad-10733 474 1 d d ADP dad-10733 474 2 64 64 NUM dad-10733 474 3 m m VERB dad-10733 474 4 ul ul NOUN dad-10733 474 5 tim tim PROPN dad-10733 474 6 od od PROPN dad-10733 474 7 al al PROPN dad-10733 474 8 c c PROPN dad-10733 474 9 on on ADP dad-10733 474 10 ve ve VERB dad-10733 474 11 rs r VERB dad-10733 474 12 at at ADP dad-10733 474 13 io io PROPN dad-10733 474 14 n n PRON dad-10733 474 15 c c PROPN dad-10733 474 16 or or CCONJ dad-10733 474 17 pu pu PROPN dad-10733 474 18 s s PROPN dad-10733 474 19 u u PROPN dad-10733 474 20 nr nr NOUN dad-10733 474 21 es es PROPN dad-10733 474 22 tr tr PROPN dad-10733 474 23 ic ic PROPN dad-10733 474 24 te te PROPN dad-10733 474 25 d d PROPN dad-10733 475 1 2 2 NUM dad-10733 475 2 70 70 NUM dad-10733 475 3 k k NOUN dad-10733 475 4 * * PUNCT dad-10733 475 5 8h 8h NUM dad-10733 475 6 rs rs X dad-10733 475 7 se se PROPN dad-10733 475 8 ve ve VERB dad-10733 475 9 ra ra INTJ dad-10733 475 10 lh lh INTJ dad-10733 475 11 ou ou INTJ dad-10733 475 12 rs rs PROPN dad-10733 475 13 of of ADP dad-10733 475 14 na na INTJ dad-10733 475 15 tu tu PROPN dad-10733 475 16 ra ra PROPN dad-10733 475 17 li li PROPN dad-10733 475 18 nt not PART dad-10733 475 19 er er INTJ dad-10733 475 20 ac ac PROPN dad-10733 475 21 tio tio PROPN dad-10733 475 22 n n AUX dad-10733 475 23 be be AUX dad-10733 475 24 tw tw INTJ dad-10733 475 25 ee ee ADP dad-10733 475 26 n n PROPN dad-10733 475 27 a a DET dad-10733 475 28 gr gr NOUN dad-10733 475 29 ou ou ADP dad-10733 475 30 p p NOUN dad-10733 475 31 of of ADP dad-10733 475 32 pe pe INTJ dad-10733 475 33 op op NOUN dad-10733 475 34 le le X dad-10733 476 1 ( ( PUNCT dad-10733 476 2 o o X dad-10733 476 3 er er INTJ dad-10733 476 4 te te X dad-10733 476 5 le le X dad-10733 476 6 ta ta PROPN dad-10733 476 7 l. l. PROPN dad-10733 476 8 , , PUNCT dad-10733 476 9 20 20 NUM dad-10733 476 10 13 13 NUM dad-10733 476 11 ) ) PUNCT dad-10733 476 12 a a DET dad-10733 476 13 m m VERB dad-10733 476 14 i i PRON dad-10733 476 15 m m VERB dad-10733 476 16 ee ee ADP dad-10733 476 17 tin tin NOUN dad-10733 476 18 g g PROPN dad-10733 476 19 c c PROPN dad-10733 476 20 or or CCONJ dad-10733 476 21 pu pu PROPN dad-10733 476 22 s s X dad-10733 476 23 m m VERB dad-10733 476 24 ee ee ADP dad-10733 476 25 tin tin NOUN dad-10733 476 26 gs gs ADP dad-10733 476 27 17 17 NUM dad-10733 476 28 5 5 NUM dad-10733 476 29 90 90 NUM dad-10733 476 30 0k 0k NOUN dad-10733 476 31 * * PUNCT dad-10733 476 32 10 10 NUM dad-10733 476 33 0h 0h NUM dad-10733 476 34 rs rs NOUN dad-10733 476 35 fa fa INTJ dad-10733 476 36 ce ce PROPN dad-10733 476 37 -t -t PROPN dad-10733 477 1 ofa ofa PROPN dad-10733 477 2 ce ce PROPN dad-10733 477 3 m m PROPN dad-10733 477 4 ee ee ADP dad-10733 477 5 tin tin NOUN dad-10733 477 6 g g PROPN dad-10733 477 7 re re VERB dad-10733 477 8 co co PROPN dad-10733 477 9 rd rd PROPN dad-10733 477 10 in in ADP dad-10733 477 11 gs gs PROPN dad-10733 477 12 . . PUNCT dad-10733 478 1 ( ( PUNCT dad-10733 478 2 r r AUX dad-10733 478 3 en en PROPN dad-10733 478 4 al al PROPN dad-10733 478 5 s s PROPN dad-10733 478 6 et et NOUN dad-10733 478 7 al al PROPN dad-10733 478 8 . . PUNCT dad-10733 478 9 , , PUNCT dad-10733 478 10 20 20 NUM dad-10733 478 11 07 07 NUM dad-10733 478 12 ) ) PUNCT dad-10733 478 13 c c PROPN dad-10733 478 14 ar ar PROPN dad-10733 478 15 di di PROPN dad-10733 478 16 ff ff PROPN dad-10733 478 17 c c PROPN dad-10733 478 18 on on ADP dad-10733 478 19 ve ve VERB dad-10733 478 20 rs r VERB dad-10733 478 21 at at ADP dad-10733 478 22 io io PROPN dad-10733 478 23 n n PROPN dad-10733 478 24 d d PROPN dad-10733 478 25 at at ADP dad-10733 478 26 ab ab PROPN dad-10733 478 27 as as ADP dad-10733 478 28 e e PROPN dad-10733 478 29 u u PROPN dad-10733 478 30 nr nr PROPN dad-10733 478 31 es es VERB dad-10733 478 32 tr tr PROPN dad-10733 478 33 ic ic PROPN dad-10733 478 34 te te PROPN dad-10733 478 35 d d PROPN dad-10733 478 36 30 30 NUM dad-10733 478 37 20 20 NUM dad-10733 478 38 k k X dad-10733 478 39 * * PUNCT dad-10733 478 40 15 15 NUM dad-10733 478 41 0 0 NUM dad-10733 478 42 m m VERB dad-10733 478 43 in in ADP dad-10733 478 44 a a DET dad-10733 478 45 ud ud INTJ dad-10733 478 46 io io X dad-10733 478 47 -v -v X dad-10733 478 48 is be AUX dad-10733 478 49 ua ua PROPN dad-10733 478 50 ld ld PROPN dad-10733 478 51 at at ADP dad-10733 478 52 ab ab PROPN dad-10733 478 53 as as ADP dad-10733 478 54 e e PROPN dad-10733 478 55 w w PROPN dad-10733 478 56 ith ith PROPN dad-10733 478 57 un un PROPN dad-10733 478 58 sc sc PROPN dad-10733 478 59 ri ri PROPN dad-10733 478 60 pt pt PROPN dad-10733 478 61 ed ed NOUN dad-10733 478 62 na na VERB dad-10733 478 63 tu tu PROPN dad-10733 478 64 ra ra PROPN dad-10733 478 65 lc lc PROPN dad-10733 478 66 on on ADP dad-10733 478 67 ve ve VERB dad-10733 478 68 rs r VERB dad-10733 478 69 at at ADP dad-10733 478 70 io io PROPN dad-10733 478 71 ns ns INTJ dad-10733 478 72 , , PUNCT dad-10733 478 73 ( ( PUNCT dad-10733 478 74 c c NOUN dad-10733 478 75 c c PROPN dad-10733 478 76 d d PROPN dad-10733 478 77 b b PROPN dad-10733 478 78 ) ) PUNCT dad-10733 478 79 ( ( PUNCT dad-10733 478 80 a a DET dad-10733 478 81 ub ub INTJ dad-10733 478 82 re re NOUN dad-10733 478 83 y y NOUN dad-10733 478 84 et et PROPN dad-10733 478 85 al al PROPN dad-10733 478 86 . . PUNCT dad-10733 479 1 , , PUNCT dad-10733 479 2 20 20 NUM dad-10733 479 3 13 13 NUM dad-10733 479 4 ) ) PUNCT dad-10733 480 1 in in ADP dad-10733 480 2 cl cl NOUN dad-10733 480 3 ud ud INTJ dad-10733 480 4 in in ADP dad-10733 480 5 g g PROPN dad-10733 480 6 vi vi PROPN dad-10733 480 7 su su PROPN dad-10733 480 8 al al PROPN dad-10733 480 9 an an PRON dad-10733 480 10 no no INTJ dad-10733 480 11 ta ta AUX dad-10733 480 12 tio tio NOUN dad-10733 480 13 ns ns INTJ dad-10733 480 14 . . PUNCT dad-10733 480 15 4d 4d PROPN dad-10733 480 16 c c PROPN dad-10733 480 17 ar ar PROPN dad-10733 480 18 di di PROPN dad-10733 480 19 ff ff PROPN dad-10733 480 20 c c PROPN dad-10733 480 21 on on ADP dad-10733 480 22 ve ve VERB dad-10733 480 23 rs r VERB dad-10733 480 24 at at ADP dad-10733 480 25 io io PROPN dad-10733 480 26 n n PROPN dad-10733 480 27 d d PROPN dad-10733 480 28 at at ADP dad-10733 480 29 ab ab PROPN dad-10733 480 30 as as ADP dad-10733 480 31 e e PROPN dad-10733 480 32 u u PROPN dad-10733 480 33 nr nr PROPN dad-10733 480 34 es es VERB dad-10733 480 35 tr tr PROPN dad-10733 480 36 ic ic PROPN dad-10733 480 37 te te PROPN dad-10733 480 38 d d PROPN dad-10733 480 39 17 17 NUM dad-10733 480 40 2 2 NUM dad-10733 480 41 . . PUNCT dad-10733 480 42 5k 5k NUM dad-10733 480 43 * * PUNCT dad-10733 480 44 17 17 NUM dad-10733 480 45 m m NOUN dad-10733 480 46 in in ADP dad-10733 480 47 a a DET dad-10733 480 48 ve ve NOUN dad-10733 480 49 rs rs NOUN dad-10733 480 50 io io PROPN dad-10733 480 51 n n PROPN dad-10733 480 52 of of ADP dad-10733 480 53 th th X dad-10733 480 54 e e X dad-10733 480 55 c c NOUN dad-10733 480 56 c c PROPN dad-10733 480 57 d d PROPN dad-10733 480 58 b b PROPN dad-10733 480 59 w w PROPN dad-10733 480 60 ith ith PROPN dad-10733 480 61 3d 3d PROPN dad-10733 480 62 vi vi PROPN dad-10733 480 63 de de PROPN dad-10733 480 64 o o X dad-10733 480 65 ( ( PUNCT dad-10733 480 66 4 4 NUM dad-10733 480 67 d d NOUN dad-10733 480 68 c c NOUN dad-10733 480 69 c c NOUN dad-10733 480 70 d d PROPN dad-10733 480 71 b b PROPN dad-10733 480 72 ) ) PUNCT dad-10733 480 73 ( ( PUNCT dad-10733 480 74 v v ADP dad-10733 480 75 an an DET dad-10733 480 76 de de X dad-10733 480 77 ve ve VERB dad-10733 480 78 nt not PART dad-10733 480 79 er er INTJ dad-10733 480 80 et et NOUN dad-10733 480 81 al al PROPN dad-10733 480 82 . . PUNCT dad-10733 480 83 , , PUNCT dad-10733 480 84 20 20 NUM dad-10733 480 85 15 15 NUM dad-10733 480 86 ) ) PUNCT dad-10733 480 87 t t NOUN dad-10733 481 1 he he PRON dad-10733 481 2 d d PROPN dad-10733 481 3 ia ia PROPN dad-10733 481 4 ch ch PROPN dad-10733 481 5 ro ro PROPN dad-10733 481 6 ni ni PROPN dad-10733 481 7 c c PROPN dad-10733 481 8 c c PROPN dad-10733 481 9 or or CCONJ dad-10733 481 10 pu pu PROPN dad-10733 481 11 s s PROPN dad-10733 481 12 of of ADP dad-10733 481 13 c c PROPN dad-10733 481 14 as as ADP dad-10733 481 15 ua ua PROPN dad-10733 481 16 lt lt VERB dad-10733 481 17 op op PROPN dad-10733 481 18 ic ic PROPN dad-10733 481 19 s s PROPN dad-10733 481 20 28 28 NUM dad-10733 481 21 0 0 NUM dad-10733 481 22 80 80 NUM dad-10733 481 23 0k 0k NOUN dad-10733 481 24 80 80 NUM dad-10733 482 1 hr hr NOUN dad-10733 482 2 s s PROPN dad-10733 482 3 * * X dad-10733 482 4 se se X dad-10733 482 5 le le X dad-10733 482 6 ct ct PROPN dad-10733 482 7 io io PROPN dad-10733 482 8 n n PROPN dad-10733 482 9 of of ADP dad-10733 482 10 fa fa PROPN dad-10733 482 11 ce ce PROPN dad-10733 482 12 -t -t PROPN dad-10733 482 13 ofa ofa PROPN dad-10733 482 14 ce ce PROPN dad-10733 482 15 , , PUNCT dad-10733 482 16 t t PROPN dad-10733 482 17 el el PROPN dad-10733 482 18 ep ep PROPN dad-10733 482 19 ho ho PROPN dad-10733 482 20 ne ne PROPN dad-10733 482 21 , , PUNCT dad-10733 482 22 a a DET dad-10733 482 23 nd nd NOUN dad-10733 482 24 pu pu PROPN dad-10733 482 25 bl bl PROPN dad-10733 483 1 ic ic PROPN dad-10733 483 2 pr pr PROPN dad-10733 483 3 es es X dad-10733 483 4 en en ADP dad-10733 483 5 td td NOUN dad-10733 483 6 ay ay PROPN dad-10733 483 7 sp sp ADP dad-10733 483 8 ok ok INTJ dad-10733 483 9 en en X dad-10733 483 10 e e X dad-10733 483 11 ng ng PROPN dad-10733 483 12 lis lis PROPN dad-10733 483 13 h h PROPN dad-10733 483 14 di di X dad-10733 483 15 sc sc PROPN dad-10733 483 16 us us PROPN dad-10733 483 17 si si X dad-10733 483 18 on on ADP dad-10733 483 19 di di X dad-10733 483 20 al al PROPN dad-10733 483 21 og og PROPN dad-10733 483 22 ue ue INTJ dad-10733 484 1 fr fr INTJ dad-10733 484 2 om om PROPN dad-10733 484 3 b b PROPN dad-10733 484 4 ri ri PROPN dad-10733 484 5 ta ta X dad-10733 484 6 in in ADV dad-10733 484 7 . . PUNCT dad-10733 485 1 ( ( PUNCT dad-10733 485 2 a a DET dad-10733 485 3 ar ar NOUN dad-10733 485 4 ts ts ADP dad-10733 485 5 an an DET dad-10733 485 6 d d X dad-10733 485 7 w w PROPN dad-10733 485 8 al al PROPN dad-10733 485 9 lis lis PROPN dad-10733 485 10 , , PUNCT dad-10733 485 11 2 2 NUM dad-10733 485 12 00 00 NUM dad-10733 485 13 6 6 NUM dad-10733 485 14 ) ) PUNCT dad-10733 485 15 t t NOUN dad-10733 486 1 he he PRON dad-10733 486 2 sp sp ADP dad-10733 486 3 ok ok INTJ dad-10733 486 4 en en PROPN dad-10733 486 5 c c NOUN dad-10733 487 1 or or CCONJ dad-10733 487 2 pu pu PROPN dad-10733 487 3 s s PROPN dad-10733 487 4 of of ADP dad-10733 487 5 th th X dad-10733 487 6 e e X dad-10733 487 7 c c PROPN dad-10733 487 8 as as ADP dad-10733 487 9 ua ua PROPN dad-10733 487 10 lt lt VERB dad-10733 487 11 op op PROPN dad-10733 487 12 ic ic PROPN dad-10733 487 13 s s PROPN dad-10733 487 14 31 31 NUM dad-10733 487 15 4 4 NUM dad-10733 487 16 80 80 NUM dad-10733 487 17 0k 0k NOUN dad-10733 487 18 60 60 NUM dad-10733 488 1 hr hr NOUN dad-10733 488 2 s s PROPN dad-10733 488 3 d d X dad-10733 488 4 ia ia PROPN dad-10733 488 5 lo lo PROPN dad-10733 488 6 gu gu NOUN dad-10733 488 7 e e PROPN dad-10733 488 8 of of ADP dad-10733 488 9 pe pe PROPN dad-10733 488 10 op op PROPN dad-10733 488 11 le le X dad-10733 488 12 ag ag PROPN dad-10733 488 13 ed ed PROPN dad-10733 488 14 60 60 NUM dad-10733 488 15 or or CCONJ dad-10733 488 16 ab ab PROPN dad-10733 488 17 ov ov NOUN dad-10733 488 18 e e X dad-10733 488 19 ta ta X dad-10733 488 20 lk lk VERB dad-10733 488 21 in in ADP dad-10733 488 22 g g PROPN dad-10733 488 23 ab ab PROPN dad-10733 488 24 ou ou ADP dad-10733 488 25 tt tt PROPN dad-10733 489 1 he he PRON dad-10733 489 2 ir ir VERB dad-10733 489 3 m m VERB dad-10733 489 4 em em PRON dad-10733 489 5 or or CCONJ dad-10733 489 6 ie ie X dad-10733 489 7 s s PROPN dad-10733 489 8 , , PUNCT dad-10733 489 9 su su PROPN dad-10733 489 10 rv rv PROPN dad-10733 489 11 ey ey PROPN dad-10733 489 12 of of ADP dad-10733 489 13 e e X dad-10733 489 14 ng ng PROPN dad-10733 489 15 lis lis PROPN dad-10733 489 16 h h NOUN dad-10733 490 1 d d X dad-10733 490 2 ia ia PROPN dad-10733 490 3 le le X dad-10733 490 4 ct ct PROPN dad-10733 490 5 s s PROPN dad-10733 490 6 fa fa INTJ dad-10733 490 7 m m PROPN dad-10733 490 8 ili ili PROPN dad-10733 490 9 es es PROPN dad-10733 490 10 , , PUNCT dad-10733 490 11 w w PROPN dad-10733 490 12 or or CCONJ dad-10733 490 13 k k PROPN dad-10733 491 1 an an X dad-10733 491 2 d d X dad-10733 491 3 th th X dad-10733 491 4 e e NOUN dad-10733 491 5 fo fo INTJ dad-10733 491 6 lk lk PROPN dad-10733 491 7 lo lo PROPN dad-10733 491 8 re re X dad-10733 491 9 of of ADP dad-10733 491 10 th th X dad-10733 491 11 e e X dad-10733 491 12 co co PROPN dad-10733 491 13 un un PROPN dad-10733 491 14 tr tr PROPN dad-10733 491 15 ys ys PROPN dad-10733 492 1 i i PROPN dad-10733 492 2 d d PROPN dad-10733 493 1 e e NOUN dad-10733 493 2 fr fr INTJ dad-10733 493 3 om om PROPN dad-10733 493 4 a a DET dad-10733 493 5 ce ce PROPN dad-10733 493 6 nt not PART dad-10733 493 7 ur ur PROPN dad-10733 493 8 y y PROPN dad-10733 493 9 ag ag PROPN dad-10733 494 1 o. o. PROPN dad-10733 494 2 ( ( PUNCT dad-10733 494 3 b b PROPN dad-10733 494 4 ea ea X dad-10733 494 5 re re ADP dad-10733 494 6 an an DET dad-10733 494 7 d d PROPN dad-10733 494 8 sc sc PROPN dad-10733 494 9 ot ot PROPN dad-10733 494 10 t t PROPN dad-10733 494 11 , , PUNCT dad-10733 494 12 19 19 NUM dad-10733 494 13 99 99 NUM dad-10733 494 14 ) ) PUNCT dad-10733 494 15 t t NOUN dad-10733 495 1 he he PRON dad-10733 495 2 c c INTJ dad-10733 495 3 hi hi INTJ dad-10733 495 4 ld ld PROPN dad-10733 495 5 l l PROPN dad-10733 496 1 an an DET dad-10733 496 2 gu gu NOUN dad-10733 496 3 ag ag PROPN dad-10733 496 4 e e PROPN dad-10733 496 5 d d PROPN dad-10733 496 6 at at ADP dad-10733 496 7 a a DET dad-10733 496 8 u u NOUN dad-10733 496 9 nr nr NOUN dad-10733 496 10 es es PROPN dad-10733 496 11 tr tr PROPN dad-10733 496 12 ic ic PROPN dad-10733 496 13 te te PROPN dad-10733 496 14 d d PROPN dad-10733 496 15 11 11 NUM dad-10733 496 16 k k PROPN dad-10733 496 17 10 10 NUM dad-10733 496 18 m m NOUN dad-10733 496 19 1 1 NUM dad-10733 496 20 , , PUNCT dad-10733 496 21 00 00 PUNCT dad-10733 497 1 0h 0h NUM dad-10733 497 2 rs rs PROPN dad-10733 497 3 * * PUNCT dad-10733 497 4 in in ADP dad-10733 497 5 te te PROPN dad-10733 497 6 rn rn PROPN dad-10733 497 7 at at ADP dad-10733 497 8 io io PROPN dad-10733 497 9 na na PROPN dad-10733 497 10 ld ld PROPN dad-10733 497 11 at at ADP dad-10733 497 12 ab ab PROPN dad-10733 497 13 as as ADP dad-10733 497 14 e e PROPN dad-10733 497 15 or or CCONJ dad-10733 497 16 ga ga PROPN dad-10733 497 17 ni ni PROPN dad-10733 497 18 ze ze PROPN dad-10733 498 1 d d NOUN dad-10733 499 1 fo fo INTJ dad-10733 499 2 rt rt INTJ dad-10733 499 3 he he PRON dad-10733 500 1 e e PROPN dad-10733 500 2 xc xc PROPN dad-10733 500 3 ha ha INTJ dad-10733 500 4 ng ng PROPN dad-10733 500 5 e e PROPN dad-10733 500 6 sy sy PROPN dad-10733 500 7 st st PROPN dad-10733 501 1 em em PRON dad-10733 501 2 st st PROPN dad-10733 501 3 ud ud INTJ dad-10733 501 4 y y PROPN dad-10733 501 5 of of ADP dad-10733 501 6 fir fir PROPN dad-10733 501 7 st st PROPN dad-10733 502 1 an an PROPN dad-10733 502 2 d d X dad-10733 502 3 se se X dad-10733 502 4 co co PROPN dad-10733 502 5 nd nd PROPN dad-10733 502 6 la la PROPN dad-10733 502 7 ng ng PROPN dad-10733 502 8 ua ua PROPN dad-10733 502 9 ge ge PROPN dad-10733 502 10 ac ac PROPN dad-10733 502 11 qu qu PROPN dad-10733 502 12 is be AUX dad-10733 502 13 iti iti PROPN dad-10733 502 14 on on ADP dad-10733 502 15 . . PUNCT dad-10733 503 1 ( ( PUNCT dad-10733 503 2 m m VERB dad-10733 503 3 ac ac PROPN dad-10733 504 1 w w PROPN dad-10733 504 2 hi hi INTJ dad-10733 504 3 nn nn INTJ dad-10733 504 4 ey ey INTJ dad-10733 504 5 an an DET dad-10733 504 6 d d X dad-10733 504 7 sn sn INTJ dad-10733 504 8 ow ow INTJ dad-10733 504 9 , , PUNCT dad-10733 504 10 1 1 NUM dad-10733 504 11 98 98 NUM dad-10733 504 12 5 5 NUM dad-10733 504 13 ) ) PUNCT dad-10733 504 14 t t NOUN dad-10733 505 1 he he PRON dad-10733 505 2 c c INTJ dad-10733 505 3 ha ha INTJ dad-10733 506 1 rl rl INTJ dad-10733 506 2 ot ot NOUN dad-10733 506 3 te te PROPN dad-10733 506 4 n n PART dad-10733 506 5 ar ar PROPN dad-10733 506 6 ra ra PROPN dad-10733 506 7 tiv tiv PROPN dad-10733 506 8 e e PROPN dad-10733 506 9 an an PROPN dad-10733 506 10 d d X dad-10733 506 11 c c PROPN dad-10733 506 12 as as ADP dad-10733 506 13 ua ua PROPN dad-10733 506 14 lt lt VERB dad-10733 506 15 op op PROPN dad-10733 506 16 ic ic PROPN dad-10733 506 17 s s PROPN dad-10733 506 18 95 95 NUM dad-10733 506 19 20 20 NUM dad-10733 506 20 k k NOUN dad-10733 506 21 2h 2h NUM dad-10733 506 22 rs rs NOUN dad-10733 506 23 * * PUNCT dad-10733 506 24 n n X dad-10733 506 25 ar ar PROPN dad-10733 506 26 ra ra PROPN dad-10733 506 27 tiv tiv PROPN dad-10733 506 28 es es PROPN dad-10733 506 29 , , PUNCT dad-10733 506 30 c c PROPN dad-10733 506 31 on on ADP dad-10733 506 32 ve ve VERB dad-10733 506 33 rs r VERB dad-10733 506 34 at at ADP dad-10733 506 35 io io PROPN dad-10733 506 36 ns ns NUM dad-10733 506 37 an an DET dad-10733 506 38 d d NOUN dad-10733 506 39 in in ADP dad-10733 506 40 te te PROPN dad-10733 506 41 rv rv PROPN dad-10733 507 1 ie ie X dad-10733 507 2 w w PROPN dad-10733 507 3 s s X dad-10733 507 4 re re AUX dad-10733 507 5 pr pr NOUN dad-10733 507 6 es es VERB dad-10733 507 7 en en X dad-10733 507 8 ta ta X dad-10733 507 9 tiv tiv PROPN dad-10733 507 10 e e PROPN dad-10733 507 11 c c PROPN dad-10733 507 12 on on ADP dad-10733 507 13 ve ve VERB dad-10733 507 14 rs r VERB dad-10733 507 15 at at ADP dad-10733 507 16 io io PROPN dad-10733 507 17 n n ADP dad-10733 507 18 c c NOUN dad-10733 507 19 ol ol PROPN dad-10733 507 20 le le X dad-10733 507 21 ct ct PROPN dad-10733 507 22 io io PROPN dad-10733 507 23 n n PROPN dad-10733 507 24 ( ( PUNCT dad-10733 507 25 c c NOUN dad-10733 507 26 n n PROPN dad-10733 507 27 c c NOUN dad-10733 507 28 c c NOUN dad-10733 507 29 ) ) PUNCT dad-10733 507 30 of of ADP dad-10733 507 31 th th X dad-10733 507 32 e e X dad-10733 507 33 re re X dad-10733 507 34 si si PROPN dad-10733 507 35 de de PROPN dad-10733 507 36 nt nt PROPN dad-10733 507 37 s s X dad-10733 507 38 of of ADP dad-10733 507 39 m m PROPN dad-10733 507 40 ec ec PROPN dad-10733 507 41 kl kl PROPN dad-10733 507 42 en en PROPN dad-10733 507 43 bu bu INTJ dad-10733 508 1 rg rg PROPN dad-10733 508 2 c c PROPN dad-10733 508 3 ou ou ADP dad-10733 508 4 nt not PART dad-10733 508 5 y y PROPN dad-10733 508 6 , , PUNCT dad-10733 508 7 n n PROPN dad-10733 508 8 or or CCONJ dad-10733 508 9 th th X dad-10733 508 10 c c X dad-10733 508 11 ar ar NOUN dad-10733 508 12 ol ol ADJ dad-10733 508 13 in in ADP dad-10733 508 14 a. a. NOUN dad-10733 509 1 ( ( PUNCT dad-10733 509 2 r r NOUN dad-10733 509 3 ep ep PROPN dad-10733 509 4 pe pe PROPN dad-10733 509 5 n n ADV dad-10733 509 6 an an PROPN dad-10733 509 7 d d X dad-10733 509 8 i i PROPN dad-10733 509 9 d d PROPN dad-10733 509 10 e e PROPN dad-10733 509 11 , , PUNCT dad-10733 509 12 20 20 NUM dad-10733 509 13 04 04 NUM dad-10733 509 14 ) ) PUNCT dad-10733 509 15 ta ta X dad-10733 509 16 bl bl PROPN dad-10733 509 17 e e PROPN dad-10733 509 18 2 2 NUM dad-10733 509 19 : : PUNCT dad-10733 509 20 h h NOUN dad-10733 509 21 um um INTJ dad-10733 509 22 an an DET dad-10733 509 23 -h -h PROPN dad-10733 509 24 um um INTJ dad-10733 509 25 an an DET dad-10733 509 26 sp sp NOUN dad-10733 509 27 on on ADP dad-10733 509 28 ta ta PROPN dad-10733 509 29 ne ne PROPN dad-10733 509 30 ou ou PROPN dad-10733 509 31 ss ss PROPN dad-10733 509 32 po po PROPN dad-10733 509 33 ke ke PROPN dad-10733 509 34 n n PROPN dad-10733 509 35 di di NOUN dad-10733 509 36 al al PROPN dad-10733 509 37 og og PROPN dad-10733 509 38 ue ue PROPN dad-10733 509 39 da da PROPN dad-10733 509 40 ta ta X dad-10733 509 41 se se X dad-10733 509 42 ts ts ADP dad-10733 509 43 .s .s PROPN dad-10733 509 44 ta ta PART dad-10733 509 45 rr rr VERB dad-10733 509 46 ed ed PROPN dad-10733 509 47 ( ( PUNCT dad-10733 509 48 * * NOUN dad-10733 509 49 ) ) PUNCT dad-10733 509 50 n n AUX dad-10733 509 51 um um INTJ dad-10733 509 52 be be AUX dad-10733 509 53 rs rs ADJ dad-10733 509 54 ar ar PROPN dad-10733 509 55 e e PROPN dad-10733 509 56 es es ADP dad-10733 509 57 tim tim PROPN dad-10733 509 58 at at ADP dad-10733 509 59 es es PRON dad-10733 509 60 ba ba PROPN dad-10733 509 61 se se PROPN dad-10733 510 1 d d PROPN dad-10733 510 2 on on ADP dad-10733 510 3 th th ADP dad-10733 510 4 e e X dad-10733 510 5 av av PROPN dad-10733 510 6 er er INTJ dad-10733 510 7 ag ag PROPN dad-10733 510 8 e e PROPN dad-10733 510 9 ra ra PROPN dad-10733 510 10 te te INTJ dad-10733 510 11 of of ADP dad-10733 510 12 e e PROPN dad-10733 510 13 ng ng PROPN dad-10733 510 14 lis lis PROPN dad-10733 510 15 h h NOUN dad-10733 510 16 sp sp ADP dad-10733 510 17 ee ee PROPN dad-10733 510 18 ch ch NOUN dad-10733 510 19 fr fr INTJ dad-10733 511 1 om om INTJ dad-10733 511 2 th th X dad-10733 511 3 e e X dad-10733 511 4 n n CCONJ dad-10733 511 5 at at ADP dad-10733 511 6 io io PROPN dad-10733 511 7 na na ADP dad-10733 511 8 lc lc PROPN dad-10733 511 9 en en ADP dad-10733 511 10 te te PROPN dad-10733 511 11 rf rf NOUN dad-10733 511 12 or or CCONJ dad-10733 511 13 vo vo INTJ dad-10733 511 14 ic ic PROPN dad-10733 511 15 e e PROPN dad-10733 511 16 an an DET dad-10733 511 17 d d PROPN dad-10733 511 18 sp sp ADP dad-10733 511 19 ee ee PROPN dad-10733 511 20 ch ch PROPN dad-10733 511 21 ( ( PUNCT dad-10733 511 22 w w PROPN dad-10733 511 23 w w PROPN dad-10733 511 24 w w PROPN dad-10733 511 25 . . PUNCT dad-10733 512 1 n n PROPN dad-10733 512 2 c c NOUN dad-10733 512 3 v v NOUN dad-10733 512 4 s s NOUN dad-10733 512 5 . . PUNCT dad-10733 513 1 o o NOUN dad-10733 513 2 r r NOUN dad-10733 513 3 g g PROPN dad-10733 513 4 / / SYM dad-10733 513 5 n n PROPN dad-10733 513 6 c c NOUN dad-10733 513 7 v v NOUN dad-10733 513 8 s s X dad-10733 513 9 / / SYM dad-10733 513 10 t t PROPN dad-10733 513 11 u u NOUN dad-10733 513 12 t t NOUN dad-10733 513 13 o o NOUN dad-10733 513 14 r r NOUN dad-10733 513 15 i i PRON dad-10733 513 16 a a DET dad-10733 513 17 l l NOUN dad-10733 513 18 s s NOUN dad-10733 513 19 / / SYM dad-10733 513 20 v v NOUN dad-10733 513 21 o o NOUN dad-10733 514 1 i i NOUN dad-10733 514 2 c c NOUN dad-10733 515 1 e e NOUN dad-10733 515 2 p p NOUN dad-10733 515 3 r r NOUN dad-10733 515 4 o o X dad-10733 515 5 d d X dad-10733 515 6 / / SYM dad-10733 515 7 t t PROPN dad-10733 515 8 u u NOUN dad-10733 515 9 t t NOUN dad-10733 515 10 o o NOUN dad-10733 516 1 r r NOUN dad-10733 516 2 i i PRON dad-10733 516 3 a a DET dad-10733 516 4 l l NOUN dad-10733 516 5 / / SYM dad-10733 516 6 q q SYM dad-10733 516 7 u u NOUN dad-10733 516 8 a a NOUN dad-10733 516 9 l l NOUN dad-10733 517 1 i i PRON dad-10733 517 2 t t VERB dad-10733 517 3 y y PROPN dad-10733 517 4 . . PUNCT dad-10733 518 1 h h PROPN dad-10733 518 2 t t PROPN dad-10733 518 3 m m PROPN dad-10733 518 4 l l NOUN dad-10733 518 5 ) ) PUNCT dad-10733 518 6 20 20 NUM dad-10733 518 7 www.ncvs.org/ncvs/tutorials/voiceprod/tutorial/quality.html www.ncvs.org/ncvs/tutorials/voiceprod/tutorial/quality.html VERB dad-10733 518 8 a a DET dad-10733 518 9 survey survey NOUN dad-10733 518 10 of of ADP dad-10733 518 11 available available ADJ dad-10733 518 12 corpora corpora PROPN dad-10733 518 13 for for ADP dad-10733 518 14 building build VERB dad-10733 518 15 data data NOUN dad-10733 518 16 - - PUNCT dad-10733 518 17 driven drive VERB dad-10733 518 18 dialogue dialogue NOUN dad-10733 518 19 systems system NOUN dad-10733 518 20 collaborative collaborative ADJ dad-10733 518 21 path path NOUN dad-10733 518 22 - - PUNCT dad-10733 518 23 finding find VERB dad-10733 518 24 or or CCONJ dad-10733 518 25 planning planning NOUN dad-10733 518 26 tasks task NOUN dad-10733 518 27 several several ADJ dad-10733 518 28 corpora corpora NOUN dad-10733 518 29 focus focus NOUN dad-10733 518 30 on on ADP dad-10733 518 31 task task NOUN dad-10733 518 32 planning planning NOUN dad-10733 518 33 or or CCONJ dad-10733 518 34 pathfinding pathfinde VERB dad-10733 518 35 through through ADP dad-10733 518 36 the the DET dad-10733 518 37 collaboration collaboration NOUN dad-10733 518 38 of of ADP dad-10733 518 39 two two NUM dad-10733 518 40 interlocutors interlocutor NOUN dad-10733 518 41 . . PUNCT dad-10733 519 1 in in ADP dad-10733 519 2 these these DET dad-10733 519 3 corpora corpora NOUN dad-10733 519 4 typically typically ADV dad-10733 519 5 one one NUM dad-10733 519 6 person person NOUN dad-10733 519 7 acts act VERB dad-10733 519 8 as as ADP dad-10733 519 9 the the DET dad-10733 519 10 decision decision NOUN dad-10733 519 11 maker maker NOUN dad-10733 519 12 and and CCONJ dad-10733 519 13 the the DET dad-10733 519 14 other other ADJ dad-10733 519 15 acts act NOUN dad-10733 519 16 as as ADP dad-10733 519 17 the the DET dad-10733 519 18 observer observer NOUN dad-10733 519 19 . . PUNCT dad-10733 520 1 a a DET dad-10733 520 2 well well ADV dad-10733 520 3 - - PUNCT dad-10733 520 4 known know VERB dad-10733 520 5 example example NOUN dad-10733 520 6 of of ADP dad-10733 520 7 such such DET dad-10733 520 8 a a DET dad-10733 520 9 dataset dataset NOUN dad-10733 520 10 is be AUX dad-10733 520 11 the the DET dad-10733 520 12 hcrc hcrc PROPN dad-10733 520 13 map map NOUN dad-10733 520 14 task task PROPN dad-10733 520 15 corpus corpus PROPN dad-10733 520 16 ( ( PUNCT dad-10733 520 17 anderson anderson PROPN dad-10733 520 18 et et PROPN dad-10733 520 19 al al PROPN dad-10733 520 20 . . PROPN dad-10733 520 21 , , PUNCT dad-10733 520 22 1991 1991 NUM dad-10733 520 23 ) ) PUNCT dad-10733 520 24 , , PUNCT dad-10733 520 25 that that PRON dad-10733 520 26 consists consist VERB dad-10733 520 27 of of ADP dad-10733 520 28 unscripted unscripte VERB dad-10733 520 29 , , PUNCT dad-10733 520 30 task task NOUN dad-10733 520 31 - - PUNCT dad-10733 520 32 oriented orient VERB dad-10733 520 33 dialogues dialogue NOUN dad-10733 520 34 that that PRON dad-10733 520 35 have have AUX dad-10733 520 36 been be AUX dad-10733 520 37 digitally digitally ADV dad-10733 520 38 recorded record VERB dad-10733 520 39 and and CCONJ dad-10733 520 40 transcribed transcribe VERB dad-10733 520 41 . . PUNCT dad-10733 521 1 the the DET dad-10733 521 2 corpus corpus NOUN dad-10733 521 3 uses use VERB dad-10733 521 4 the the DET dad-10733 521 5 map map NOUN dad-10733 521 6 task task NOUN dad-10733 521 7 ( ( PUNCT dad-10733 521 8 brown brown PROPN dad-10733 521 9 et et PROPN dad-10733 521 10 al al PROPN dad-10733 521 11 . . PROPN dad-10733 521 12 , , PUNCT dad-10733 521 13 1984 1984 NUM dad-10733 521 14 ) ) PUNCT dad-10733 521 15 , , PUNCT dad-10733 521 16 where where SCONJ dad-10733 521 17 participants participant NOUN dad-10733 521 18 must must AUX dad-10733 521 19 collaborate collaborate VERB dad-10733 521 20 verbally verbally ADV dad-10733 521 21 to to PART dad-10733 521 22 reproduce reproduce VERB dad-10733 521 23 a a DET dad-10733 521 24 route route NOUN dad-10733 521 25 from from ADP dad-10733 521 26 one one NUM dad-10733 521 27 of of ADP dad-10733 521 28 the the DET dad-10733 521 29 participant participant NOUN dad-10733 521 30 ’s ’s PART dad-10733 521 31 map map NOUN dad-10733 521 32 to to ADP dad-10733 521 33 the the DET dad-10733 521 34 map map NOUN dad-10733 521 35 of of ADP dad-10733 521 36 another another DET dad-10733 521 37 participant participant NOUN dad-10733 521 38 . . PUNCT dad-10733 522 1 the the DET dad-10733 522 2 corpus corpus NOUN dad-10733 522 3 is be AUX dad-10733 522 4 fairly fairly ADV dad-10733 522 5 small small ADJ dad-10733 522 6 , , PUNCT dad-10733 522 7 but but CCONJ dad-10733 522 8 it it PRON dad-10733 522 9 controls control VERB dad-10733 522 10 for for ADP dad-10733 522 11 the the DET dad-10733 522 12 familiarity familiarity NOUN dad-10733 522 13 between between ADP dad-10733 522 14 speakers speaker NOUN dad-10733 522 15 , , PUNCT dad-10733 522 16 eye eye NOUN dad-10733 522 17 contact contact NOUN dad-10733 522 18 between between ADP dad-10733 522 19 speakers speaker NOUN dad-10733 522 20 , , PUNCT dad-10733 522 21 matching match VERB dad-10733 522 22 between between ADP dad-10733 522 23 landmarks landmark NOUN dad-10733 522 24 on on ADP dad-10733 522 25 the the DET dad-10733 522 26 participants participant NOUN dad-10733 522 27 ’ ' PUNCT dad-10733 522 28 maps map NOUN dad-10733 522 29 , , PUNCT dad-10733 522 30 opportunities opportunity NOUN dad-10733 522 31 for for ADP dad-10733 522 32 contrastive contrastive ADJ dad-10733 522 33 stress stress NOUN dad-10733 522 34 , , PUNCT dad-10733 522 35 and and CCONJ dad-10733 522 36 phonological phonological ADJ dad-10733 522 37 characteristics characteristic NOUN dad-10733 522 38 of of ADP dad-10733 522 39 landmark landmark NOUN dad-10733 522 40 names name NOUN dad-10733 522 41 . . PUNCT dad-10733 523 1 by by ADP dad-10733 523 2 adding add VERB dad-10733 523 3 these these DET dad-10733 523 4 controls control NOUN dad-10733 523 5 , , PUNCT dad-10733 523 6 the the DET dad-10733 523 7 dataset dataset NOUN dad-10733 523 8 attempts attempt NOUN dad-10733 523 9 to to PART dad-10733 523 10 focus focus VERB dad-10733 523 11 on on ADP dad-10733 523 12 solely solely ADV dad-10733 523 13 the the DET dad-10733 523 14 dialogue dialogue NOUN dad-10733 523 15 and and CCONJ dad-10733 523 16 human human ADJ dad-10733 523 17 speech speech NOUN dad-10733 523 18 involved involve VERB dad-10733 523 19 in in ADP dad-10733 523 20 the the DET dad-10733 523 21 planning planning NOUN dad-10733 523 22 process process NOUN dad-10733 523 23 . . PUNCT dad-10733 524 1 the the DET dad-10733 524 2 walking walk VERB dad-10733 524 3 around around ADP dad-10733 524 4 corpus corpus PROPN dad-10733 524 5 ( ( PUNCT dad-10733 524 6 brennan brennan PROPN dad-10733 524 7 et et PROPN dad-10733 524 8 al al PROPN dad-10733 524 9 . . PROPN dad-10733 524 10 , , PUNCT dad-10733 524 11 2013 2013 NUM dad-10733 524 12 ) ) PUNCT dad-10733 524 13 consists consist VERB dad-10733 524 14 of of ADP dad-10733 524 15 36 36 NUM dad-10733 524 16 dialogues dialogue NOUN dad-10733 524 17 between between ADP dad-10733 524 18 people people NOUN dad-10733 524 19 communicating communicate VERB dad-10733 524 20 over over ADP dad-10733 524 21 mobile mobile ADJ dad-10733 524 22 telephone telephone NOUN dad-10733 524 23 . . PUNCT dad-10733 525 1 the the DET dad-10733 525 2 dialogues dialogue NOUN dad-10733 525 3 have have VERB dad-10733 525 4 two two NUM dad-10733 525 5 parts part NOUN dad-10733 525 6 : : PUNCT dad-10733 525 7 first first ADV dad-10733 525 8 , , PUNCT dad-10733 525 9 a a DET dad-10733 525 10 ‘ ' PUNCT dad-10733 525 11 stationary stationary ADJ dad-10733 525 12 partner partner NOUN dad-10733 525 13 ’ ' PUNCT dad-10733 525 14 is be AUX dad-10733 525 15 asked ask VERB dad-10733 525 16 to to PART dad-10733 525 17 direct direct VERB dad-10733 525 18 a a DET dad-10733 525 19 ‘ ' PUNCT dad-10733 525 20 mobile mobile ADJ dad-10733 525 21 partner partner NOUN dad-10733 525 22 ’ ' PUNCT dad-10733 525 23 to to PART dad-10733 525 24 find find VERB dad-10733 525 25 18 18 NUM dad-10733 525 26 destinations destination NOUN dad-10733 525 27 on on ADP dad-10733 525 28 a a DET dad-10733 525 29 medium medium ADJ dad-10733 525 30 - - PUNCT dad-10733 525 31 sized sized ADJ dad-10733 525 32 university university NOUN dad-10733 525 33 campus campus NOUN dad-10733 525 34 . . PUNCT dad-10733 526 1 the the DET dad-10733 526 2 stationary stationary ADJ dad-10733 526 3 partner partner NOUN dad-10733 526 4 is be AUX dad-10733 526 5 equipped equip VERB dad-10733 526 6 with with ADP dad-10733 526 7 a a DET dad-10733 526 8 map map NOUN dad-10733 526 9 marked mark VERB dad-10733 526 10 with with ADP dad-10733 526 11 the the DET dad-10733 526 12 target target NOUN dad-10733 526 13 destinations destination NOUN dad-10733 526 14 accompanied accompany VERB dad-10733 526 15 by by ADP dad-10733 526 16 photos photo NOUN dad-10733 526 17 of of ADP dad-10733 526 18 the the DET dad-10733 526 19 locations location NOUN dad-10733 526 20 , , PUNCT dad-10733 526 21 while while SCONJ dad-10733 526 22 the the DET dad-10733 526 23 mobile mobile ADJ dad-10733 526 24 partner partner NOUN dad-10733 526 25 is be AUX dad-10733 526 26 given give VERB dad-10733 526 27 a a DET dad-10733 526 28 gps gps NOUN dad-10733 526 29 navigation navigation NOUN dad-10733 526 30 system system NOUN dad-10733 526 31 and and CCONJ dad-10733 526 32 a a DET dad-10733 526 33 camera camera NOUN dad-10733 526 34 to to PART dad-10733 526 35 take take VERB dad-10733 526 36 photos photo NOUN dad-10733 526 37 . . PUNCT dad-10733 527 1 in in ADP dad-10733 527 2 the the DET dad-10733 527 3 second second ADJ dad-10733 527 4 part part NOUN dad-10733 527 5 , , PUNCT dad-10733 527 6 the the DET dad-10733 527 7 participants participant NOUN dad-10733 527 8 are be AUX dad-10733 527 9 asked ask VERB dad-10733 527 10 to to PART dad-10733 527 11 interact interact VERB dad-10733 527 12 in in ADP dad-10733 527 13 - - PUNCT dad-10733 527 14 person person NOUN dad-10733 527 15 in in ADP dad-10733 527 16 order order NOUN dad-10733 527 17 to to PART dad-10733 527 18 duplicate duplicate VERB dad-10733 527 19 the the DET dad-10733 527 20 photos photo NOUN dad-10733 527 21 taken take VERB dad-10733 527 22 by by ADP dad-10733 527 23 the the DET dad-10733 527 24 mobile mobile ADJ dad-10733 527 25 partner partner NOUN dad-10733 527 26 . . PUNCT dad-10733 528 1 the the DET dad-10733 528 2 goal goal NOUN dad-10733 528 3 of of ADP dad-10733 528 4 the the DET dad-10733 528 5 dataset dataset NOUN dad-10733 528 6 is be AUX dad-10733 528 7 to to PART dad-10733 528 8 provide provide VERB dad-10733 528 9 a a DET dad-10733 528 10 testbed testbe VERB dad-10733 528 11 for for ADP dad-10733 528 12 natural natural ADJ dad-10733 528 13 lexical lexical ADJ dad-10733 528 14 entrainment entrainment NOUN dad-10733 528 15 , , PUNCT dad-10733 528 16 and and CCONJ dad-10733 528 17 to to PART dad-10733 528 18 be be AUX dad-10733 528 19 used use VERB dad-10733 528 20 as as ADP dad-10733 528 21 a a DET dad-10733 528 22 resource resource NOUN dad-10733 528 23 for for ADP dad-10733 528 24 pedestrian pedestrian NOUN dad-10733 528 25 navigation navigation NOUN dad-10733 528 26 applications application NOUN dad-10733 528 27 . . PUNCT dad-10733 529 1 the the DET dad-10733 529 2 trains train NOUN dad-10733 529 3 93 93 NUM dad-10733 529 4 dialogues dialogue NOUN dad-10733 529 5 corpus corpus NOUN dad-10733 529 6 ( ( PUNCT dad-10733 529 7 heeman heeman NOUN dad-10733 529 8 and and CCONJ dad-10733 529 9 allen allen PROPN dad-10733 529 10 , , PUNCT dad-10733 529 11 1995 1995 NUM dad-10733 529 12 ) ) PUNCT dad-10733 529 13 consists consist VERB dad-10733 529 14 of of ADP dad-10733 529 15 recordings recording NOUN dad-10733 529 16 of of ADP dad-10733 529 17 two two NUM dad-10733 529 18 interlocutors interlocutor NOUN dad-10733 529 19 interacting interact VERB dad-10733 529 20 to to PART dad-10733 529 21 solve solve VERB dad-10733 529 22 various various ADJ dad-10733 529 23 planning planning NOUN dad-10733 529 24 tasks task NOUN dad-10733 529 25 for for ADP dad-10733 529 26 scheduling scheduling NOUN dad-10733 529 27 train train NOUN dad-10733 529 28 routes route NOUN dad-10733 529 29 and and CCONJ dad-10733 529 30 arranging arrange VERB dad-10733 529 31 railroad railroad NOUN dad-10733 529 32 freight freight NOUN dad-10733 529 33 . . PUNCT dad-10733 530 1 one one NUM dad-10733 530 2 user user NOUN dad-10733 530 3 acts act VERB dad-10733 530 4 the the DET dad-10733 530 5 role role NOUN dad-10733 530 6 of of ADP dad-10733 530 7 a a DET dad-10733 530 8 planning planning NOUN dad-10733 530 9 assistant assistant NOUN dad-10733 530 10 system system NOUN dad-10733 530 11 and and CCONJ dad-10733 530 12 the the DET dad-10733 530 13 other other ADJ dad-10733 530 14 user user NOUN dad-10733 530 15 acts act VERB dad-10733 530 16 as as ADP dad-10733 530 17 the the DET dad-10733 530 18 coordinator coordinator NOUN dad-10733 530 19 . . PUNCT dad-10733 531 1 this this PRON dad-10733 531 2 was be AUX dad-10733 531 3 not not PART dad-10733 531 4 done do VERB dad-10733 531 5 in in ADP dad-10733 531 6 a a DET dad-10733 531 7 wizard wizard NOUN dad-10733 531 8 - - PUNCT dad-10733 531 9 of of ADP dad-10733 531 10 - - PUNCT dad-10733 531 11 oz oz NOUN dad-10733 531 12 fashion fashion NOUN dad-10733 531 13 , , PUNCT dad-10733 531 14 and and CCONJ dad-10733 531 15 as as ADP dad-10733 531 16 such such ADJ dad-10733 531 17 is be AUX dad-10733 531 18 not not PART dad-10733 531 19 considered consider VERB dad-10733 531 20 a a DET dad-10733 531 21 human human ADJ dad-10733 531 22 - - PUNCT dad-10733 531 23 machine machine NOUN dad-10733 531 24 corpus corpus NOUN dad-10733 531 25 . . PUNCT dad-10733 532 1 34 34 NUM dad-10733 532 2 different different ADJ dad-10733 532 3 interlocutors interlocutor NOUN dad-10733 532 4 were be AUX dad-10733 532 5 asked ask VERB dad-10733 532 6 to to PART dad-10733 532 7 complete complete VERB dad-10733 532 8 20 20 NUM dad-10733 532 9 different different ADJ dad-10733 532 10 tasks task NOUN dad-10733 532 11 such such ADJ dad-10733 532 12 as as ADP dad-10733 532 13 : : PUNCT dad-10733 532 14 “ " PUNCT dad-10733 532 15 determine determine VERB dad-10733 532 16 the the DET dad-10733 532 17 maximum maximum ADJ dad-10733 532 18 number number NOUN dad-10733 532 19 of of ADP dad-10733 532 20 boxcars boxcar NOUN dad-10733 532 21 of of ADP dad-10733 532 22 oranges orange NOUN dad-10733 532 23 that that PRON dad-10733 532 24 you you PRON dad-10733 532 25 could could AUX dad-10733 532 26 get get VERB dad-10733 532 27 to to ADP dad-10733 532 28 bath bath NOUN dad-10733 532 29 by by ADP dad-10733 532 30 7 7 NUM dad-10733 532 31 am am NOUN dad-10733 532 32 tomorrow tomorrow NOUN dad-10733 532 33 morning morning NOUN dad-10733 532 34 . . PUNCT dad-10733 533 1 it it PRON dad-10733 533 2 is be AUX dad-10733 533 3 now now ADV dad-10733 533 4 12 12 NUM dad-10733 533 5 midnight midnight NOUN dad-10733 533 6 . . PUNCT dad-10733 533 7 ” " PUNCT dad-10733 534 1 the the DET dad-10733 534 2 person person NOUN dad-10733 534 3 playing play VERB dad-10733 534 4 the the DET dad-10733 534 5 role role NOUN dad-10733 534 6 of of ADP dad-10733 534 7 the the DET dad-10733 534 8 planning planning NOUN dad-10733 534 9 assistant assistant NOUN dad-10733 534 10 was be AUX dad-10733 534 11 provided provide VERB dad-10733 534 12 with with ADP dad-10733 534 13 access access NOUN dad-10733 534 14 to to ADP dad-10733 534 15 information information NOUN dad-10733 534 16 that that PRON dad-10733 534 17 is be AUX dad-10733 534 18 needed need VERB dad-10733 534 19 to to PART dad-10733 534 20 solve solve VERB dad-10733 534 21 the the DET dad-10733 534 22 task task NOUN dad-10733 534 23 . . PUNCT dad-10733 535 1 also also ADV dad-10733 535 2 included include VERB dad-10733 535 3 in in ADP dad-10733 535 4 the the DET dad-10733 535 5 dataset dataset NOUN dad-10733 535 6 is be AUX dad-10733 535 7 the the DET dad-10733 535 8 information information NOUN dad-10733 535 9 available available ADJ dad-10733 535 10 to to ADP dad-10733 535 11 both both DET dad-10733 535 12 users user NOUN dad-10733 535 13 , , PUNCT dad-10733 535 14 the the DET dad-10733 535 15 length length NOUN dad-10733 535 16 of of ADP dad-10733 535 17 dialogue dialogue NOUN dad-10733 535 18 , , PUNCT dad-10733 535 19 and and CCONJ dad-10733 535 20 the the DET dad-10733 535 21 speaker speaker NOUN dad-10733 535 22 and and CCONJ dad-10733 535 23 ‘ ' PUNCT dad-10733 535 24 system system NOUN dad-10733 535 25 ’ ' PUNCT dad-10733 535 26 interlocutor interlocutor ADJ dad-10733 535 27 identities identity NOUN dad-10733 535 28 . . PUNCT dad-10733 536 1 the the DET dad-10733 536 2 verbmobil verbmobil PROPN dad-10733 536 3 corpus corpus PROPN dad-10733 536 4 ( ( PUNCT dad-10733 536 5 burger burger NOUN dad-10733 536 6 et et PROPN dad-10733 536 7 al al PROPN dad-10733 536 8 . . PROPN dad-10733 536 9 , , PUNCT dad-10733 536 10 2000 2000 NUM dad-10733 536 11 ) ) PUNCT dad-10733 536 12 is be AUX dad-10733 536 13 a a DET dad-10733 536 14 multilingual multilingual ADJ dad-10733 536 15 corpus corpus NOUN dad-10733 536 16 consisting consist VERB dad-10733 536 17 of of ADP dad-10733 536 18 english english PROPN dad-10733 536 19 , , PUNCT dad-10733 536 20 german german ADJ dad-10733 536 21 , , PUNCT dad-10733 536 22 and and CCONJ dad-10733 536 23 japanese japanese ADJ dad-10733 536 24 dialogues dialogue NOUN dad-10733 536 25 collected collect VERB dad-10733 536 26 for for ADP dad-10733 536 27 the the DET dad-10733 536 28 purposes purpose NOUN dad-10733 536 29 of of ADP dad-10733 536 30 training training NOUN dad-10733 536 31 and and CCONJ dad-10733 536 32 testing test VERB dad-10733 536 33 the the DET dad-10733 536 34 verbmobil verbmobil ADJ dad-10733 536 35 project project NOUN dad-10733 536 36 system system NOUN dad-10733 536 37 . . PUNCT dad-10733 537 1 the the DET dad-10733 537 2 system system NOUN dad-10733 537 3 was be AUX dad-10733 537 4 a a DET dad-10733 537 5 designed design VERB dad-10733 537 6 for for ADP dad-10733 537 7 speech speech NOUN dad-10733 537 8 - - PUNCT dad-10733 537 9 to to ADP dad-10733 537 10 - - PUNCT dad-10733 537 11 speech speech NOUN dad-10733 537 12 machine machine NOUN dad-10733 537 13 translation translation NOUN dad-10733 537 14 tasks task NOUN dad-10733 537 15 . . PUNCT dad-10733 538 1 dialogues dialogue NOUN dad-10733 538 2 were be AUX dad-10733 538 3 recorded record VERB dad-10733 538 4 in in ADP dad-10733 538 5 a a DET dad-10733 538 6 variety variety NOUN dad-10733 538 7 of of ADP dad-10733 538 8 conditions condition NOUN dad-10733 538 9 and and CCONJ dad-10733 538 10 settings setting NOUN dad-10733 538 11 with with ADP dad-10733 538 12 room room NOUN dad-10733 538 13 microphones microphone NOUN dad-10733 538 14 , , PUNCT dad-10733 538 15 telephones telephone NOUN dad-10733 538 16 , , PUNCT dad-10733 538 17 or or CCONJ dad-10733 538 18 close close ADJ dad-10733 538 19 microphones microphone NOUN dad-10733 538 20 , , PUNCT dad-10733 538 21 and and CCONJ dad-10733 538 22 were be AUX dad-10733 538 23 subsequently subsequently ADV dad-10733 538 24 transcribed transcribe VERB dad-10733 538 25 . . PUNCT dad-10733 539 1 users user NOUN dad-10733 539 2 were be AUX dad-10733 539 3 tasked task VERB dad-10733 539 4 with with ADP dad-10733 539 5 planning planning NOUN dad-10733 539 6 and and CCONJ dad-10733 539 7 scheduling schedule VERB dad-10733 539 8 an an DET dad-10733 539 9 appointment appointment NOUN dad-10733 539 10 throughout throughout ADP dad-10733 539 11 the the DET dad-10733 539 12 course course NOUN dad-10733 539 13 of of ADP dad-10733 539 14 the the DET dad-10733 539 15 dialogue dialogue NOUN dad-10733 539 16 . . PUNCT dad-10733 540 1 note note VERB dad-10733 540 2 that that SCONJ dad-10733 540 3 while while SCONJ dad-10733 540 4 there there PRON dad-10733 540 5 have have AUX dad-10733 540 6 been be AUX dad-10733 540 7 several several ADJ dad-10733 540 8 versions version NOUN dad-10733 540 9 of of ADP dad-10733 540 10 the the DET dad-10733 540 11 verbmobil verbmobil PROPN dad-10733 540 12 corpora corpora PROPN dad-10733 540 13 released release VERB dad-10733 540 14 , , PUNCT dad-10733 540 15 we we PRON dad-10733 540 16 refer refer VERB dad-10733 540 17 to to ADP dad-10733 540 18 the the DET dad-10733 540 19 entire entire ADJ dad-10733 540 20 collection collection NOUN dad-10733 540 21 here here ADV dad-10733 540 22 as as SCONJ dad-10733 540 23 described describe VERB dad-10733 540 24 in in ADP dad-10733 540 25 ( ( PUNCT dad-10733 540 26 burger burger X dad-10733 540 27 et et PROPN dad-10733 540 28 al al PROPN dad-10733 540 29 . . PROPN dad-10733 540 30 , , PUNCT dad-10733 540 31 2000 2000 NUM dad-10733 540 32 ) ) PUNCT dad-10733 540 33 . . PUNCT dad-10733 541 1 dialogue dialogue NOUN dad-10733 541 2 acts act NOUN dad-10733 541 3 were be AUX dad-10733 541 4 annotated annotate VERB dad-10733 541 5 in in ADP dad-10733 541 6 a a DET dad-10733 541 7 subset subset NOUN dad-10733 541 8 of of ADP dad-10733 541 9 the the DET dad-10733 541 10 corpus corpus NOUN dad-10733 541 11 ( ( PUNCT dad-10733 541 12 1,505 1,505 NUM dad-10733 541 13 mixed mixed ADJ dad-10733 541 14 dialogues dialogue NOUN dad-10733 541 15 in in ADP dad-10733 541 16 german german ADJ dad-10733 541 17 , , PUNCT dad-10733 541 18 english english PROPN dad-10733 541 19 and and CCONJ dad-10733 541 20 japanese japanese PROPN dad-10733 541 21 ) ) PUNCT dad-10733 541 22 . . PUNCT dad-10733 542 1 76,210 76,210 NUM dad-10733 542 2 acts act NOUN dad-10733 542 3 were be AUX dad-10733 542 4 annotated annotate VERB dad-10733 542 5 with with ADP dad-10733 542 6 32 32 NUM dad-10733 542 7 possible possible ADJ dad-10733 542 8 categories category NOUN dad-10733 542 9 of of ADP dad-10733 542 10 dialogue dialogue NOUN dad-10733 542 11 acts act VERB dad-10733 542 12 alexandersson alexandersson PROPN dad-10733 542 13 et et PROPN dad-10733 542 14 al al PROPN dad-10733 542 15 . . PUNCT dad-10733 543 1 ( ( PUNCT dad-10733 543 2 2000).5 2000).5 NUM dad-10733 543 3 persuasion persuasion NOUN dad-10733 543 4 and and CCONJ dad-10733 543 5 debates debate NOUN dad-10733 543 6 another another DET dad-10733 543 7 theme theme NOUN dad-10733 543 8 recurring recur VERB dad-10733 543 9 among among ADP dad-10733 543 10 constrained constrain VERB dad-10733 543 11 spoken spoken ADJ dad-10733 543 12 corpora corpora NOUN dad-10733 543 13 is be AUX dad-10733 543 14 the the DET dad-10733 543 15 appearance appearance NOUN dad-10733 543 16 of of ADP dad-10733 543 17 persuasion persuasion NOUN dad-10733 543 18 or or CCONJ dad-10733 543 19 debate debate NOUN dad-10733 543 20 tasks task NOUN dad-10733 543 21 . . PUNCT dad-10733 544 1 these these PRON dad-10733 544 2 can can AUX dad-10733 544 3 involve involve VERB dad-10733 544 4 general general ADJ dad-10733 544 5 debates debate NOUN dad-10733 544 6 on on ADP dad-10733 544 7 a a DET dad-10733 544 8 topic topic NOUN dad-10733 544 9 or or CCONJ dad-10733 544 10 tasking task VERB dad-10733 544 11 a a DET dad-10733 544 12 specific specific ADJ dad-10733 544 13 interlocutor interlocutor NOUN dad-10733 544 14 to to PART dad-10733 544 15 try try VERB dad-10733 544 16 to to PART dad-10733 544 17 convince convince VERB dad-10733 544 18 another another DET dad-10733 544 19 interlocutor interlocutor NOUN dad-10733 544 20 of of ADP dad-10733 544 21 some some DET dad-10733 544 22 opinion opinion NOUN dad-10733 544 23 or or CCONJ dad-10733 544 24 topic topic NOUN dad-10733 544 25 . . PUNCT dad-10733 545 1 generally generally ADV dad-10733 545 2 , , PUNCT dad-10733 545 3 5 5 X dad-10733 545 4 . . X dad-10733 545 5 note note NOUN dad-10733 545 6 , , PUNCT dad-10733 545 7 this this DET dad-10733 545 8 information information NOUN dad-10733 545 9 and and CCONJ dad-10733 545 10 further further ADJ dad-10733 545 11 facts fact NOUN dad-10733 545 12 about about ADP dad-10733 545 13 the the DET dad-10733 545 14 verbmobil verbmobil ADJ dad-10733 545 15 project project NOUN dad-10733 545 16 and and CCONJ dad-10733 545 17 corpus corpus NOUN dad-10733 545 18 can can AUX dad-10733 545 19 be be AUX dad-10733 545 20 found find VERB dad-10733 545 21 here here ADV dad-10733 545 22 : : PUNCT dad-10733 545 23 http http ADJ dad-10733 545 24 : : PUNCT dad-10733 545 25 //verbmobil.dfki.de //verbmobil.dfki.de PUNCT dad-10733 545 26 / / SYM dad-10733 545 27 facts.html facts.html NUM dad-10733 545 28 21 21 NUM dad-10733 545 29 http://verbmobil.dfki.de/facts.html http://verbmobil.dfki.de/facts.html PROPN dad-10733 545 30 http://verbmobil.dfki.de/facts.html http://verbmobil.dfki.de/facts.html PROPN dad-10733 545 31 serban serban PROPN dad-10733 545 32 , , PUNCT dad-10733 545 33 lowe lowe PROPN dad-10733 545 34 , , PUNCT dad-10733 545 35 henderson henderson PROPN dad-10733 545 36 , , PUNCT dad-10733 545 37 charlin charlin PROPN dad-10733 545 38 and and CCONJ dad-10733 545 39 pineau pineau PROPN dad-10733 545 40 these these DET dad-10733 545 41 datasets dataset NOUN dad-10733 545 42 record record VERB dad-10733 545 43 the the DET dad-10733 545 44 outcome outcome NOUN dad-10733 545 45 of of ADP dad-10733 545 46 how how SCONJ dad-10733 545 47 convinced convince VERB dad-10733 545 48 the the DET dad-10733 545 49 audience audience NOUN dad-10733 545 50 is be AUX dad-10733 545 51 of of ADP dad-10733 545 52 the the DET dad-10733 545 53 argument argument NOUN dad-10733 545 54 at at ADP dad-10733 545 55 the the DET dad-10733 545 56 end end NOUN dad-10733 545 57 of of ADP dad-10733 545 58 the the DET dad-10733 545 59 dialogue dialogue NOUN dad-10733 545 60 or or CCONJ dad-10733 545 61 debate debate NOUN dad-10733 545 62 . . PUNCT dad-10733 546 1 the the DET dad-10733 546 2 green green PROPN dad-10733 546 3 persuasive persuasive ADJ dad-10733 546 4 dataset dataset NOUN dad-10733 546 5 ( ( PUNCT dad-10733 546 6 douglas douglas PROPN dad-10733 546 7 - - PUNCT dad-10733 546 8 cowie cowie PROPN dad-10733 546 9 et et PROPN dad-10733 546 10 al al PROPN dad-10733 546 11 . . PROPN dad-10733 546 12 , , PUNCT dad-10733 546 13 2007 2007 NUM dad-10733 546 14 ) ) PUNCT dad-10733 546 15 was be AUX dad-10733 546 16 recorded record VERB dad-10733 546 17 in in ADP dad-10733 546 18 2007 2007 NUM dad-10733 546 19 to to PART dad-10733 546 20 provide provide VERB dad-10733 546 21 data datum NOUN dad-10733 546 22 for for ADP dad-10733 546 23 the the DET dad-10733 546 24 humaine humaine PROPN dad-10733 546 25 project project NOUN dad-10733 546 26 , , PUNCT dad-10733 546 27 whose whose DET dad-10733 546 28 goal goal NOUN dad-10733 546 29 is be AUX dad-10733 546 30 to to PART dad-10733 546 31 develop develop VERB dad-10733 546 32 interfaces interface NOUN dad-10733 546 33 that that PRON dad-10733 546 34 can can AUX dad-10733 546 35 register register VERB dad-10733 546 36 and and CCONJ dad-10733 546 37 respond respond VERB dad-10733 546 38 to to ADP dad-10733 546 39 emotion emotion NOUN dad-10733 546 40 . . PUNCT dad-10733 547 1 in in ADP dad-10733 547 2 the the DET dad-10733 547 3 dataset dataset NOUN dad-10733 547 4 , , PUNCT dad-10733 547 5 a a DET dad-10733 547 6 persuader persuader NOUN dad-10733 547 7 with with ADP dad-10733 547 8 strong strong ADJ dad-10733 547 9 pro pro ADJ dad-10733 547 10 - - ADJ dad-10733 547 11 environmental environmental ADJ dad-10733 547 12 ( ( PUNCT dad-10733 547 13 ‘ ' PUNCT dad-10733 547 14 pro pro ADJ dad-10733 547 15 - - ADJ dad-10733 547 16 green green ADJ dad-10733 547 17 ’ ' PUNCT dad-10733 547 18 ) ) PUNCT dad-10733 548 1 feelings feeling NOUN dad-10733 548 2 tries try VERB dad-10733 548 3 to to PART dad-10733 548 4 convince convince VERB dad-10733 548 5 persuadees persuadee NOUN dad-10733 548 6 to to PART dad-10733 548 7 consider consider VERB dad-10733 548 8 adopting adopt VERB dad-10733 548 9 more more ADJ dad-10733 548 10 green green ADJ dad-10733 548 11 lifestyles lifestyle NOUN dad-10733 548 12 ; ; PUNCT dad-10733 548 13 these these DET dad-10733 548 14 interactions interaction NOUN dad-10733 548 15 are be AUX dad-10733 548 16 in in ADP dad-10733 548 17 the the DET dad-10733 548 18 form form NOUN dad-10733 548 19 of of ADP dad-10733 548 20 dialogues dialogue NOUN dad-10733 548 21 . . PUNCT dad-10733 549 1 it it PRON dad-10733 549 2 contains contain VERB dad-10733 549 3 8 8 NUM dad-10733 549 4 long long ADJ dad-10733 549 5 dialogues dialogue NOUN dad-10733 549 6 , , PUNCT dad-10733 549 7 totalling total VERB dad-10733 549 8 about about ADV dad-10733 549 9 30 30 NUM dad-10733 549 10 minutes minute NOUN dad-10733 549 11 each each PRON dad-10733 549 12 . . PUNCT dad-10733 550 1 since since SCONJ dad-10733 550 2 the the DET dad-10733 550 3 persuadees persuadee NOUN dad-10733 550 4 often often ADV dad-10733 550 5 either either CCONJ dad-10733 550 6 disagree disagree VERB dad-10733 550 7 or or CCONJ dad-10733 550 8 agree agree VERB dad-10733 550 9 strongly strongly ADV dad-10733 550 10 with with ADP dad-10733 550 11 the the DET dad-10733 550 12 persuaders persuader NOUN dad-10733 550 13 points point NOUN dad-10733 550 14 , , PUNCT dad-10733 550 15 this this PRON dad-10733 550 16 would would AUX dad-10733 550 17 be be AUX dad-10733 550 18 good good ADJ dad-10733 550 19 corpus corpus NOUN dad-10733 550 20 for for ADP dad-10733 550 21 studying study VERB dad-10733 550 22 social social ADJ dad-10733 550 23 signs sign NOUN dad-10733 550 24 of of ADP dad-10733 550 25 ( ( PUNCT dad-10733 550 26 dis)-agreement dis)-agreement ADJ dad-10733 550 27 between between ADP dad-10733 550 28 two two NUM dad-10733 550 29 people people NOUN dad-10733 550 30 . . PUNCT dad-10733 551 1 the the DET dad-10733 551 2 mahnob mahnob NOUN dad-10733 551 3 mimicry mimicry PROPN dad-10733 551 4 database database NOUN dad-10733 551 5 ( ( PUNCT dad-10733 551 6 sun sun PROPN dad-10733 551 7 et et PROPN dad-10733 551 8 al al PROPN dad-10733 551 9 . . PROPN dad-10733 551 10 , , PUNCT dad-10733 551 11 2011 2011 NUM dad-10733 551 12 ) ) PUNCT dad-10733 551 13 contains contain VERB dad-10733 551 14 11 11 NUM dad-10733 551 15 hours hour NOUN dad-10733 551 16 of of ADP dad-10733 551 17 recordings recording NOUN dad-10733 551 18 , , PUNCT dad-10733 551 19 split split VERB dad-10733 551 20 over over ADP dad-10733 551 21 54 54 NUM dad-10733 551 22 sessions session NOUN dad-10733 551 23 between between ADP dad-10733 551 24 60 60 NUM dad-10733 551 25 people people NOUN dad-10733 551 26 engaged engage VERB dad-10733 551 27 either either CCONJ dad-10733 551 28 in in ADP dad-10733 551 29 a a DET dad-10733 551 30 socio socio NOUN dad-10733 551 31 - - PUNCT dad-10733 551 32 political political ADJ dad-10733 551 33 discussion discussion NOUN dad-10733 551 34 or or CCONJ dad-10733 551 35 negotiating negotiate VERB dad-10733 551 36 a a DET dad-10733 551 37 tenancy tenancy NOUN dad-10733 551 38 agreement agreement NOUN dad-10733 551 39 . . PUNCT dad-10733 552 1 this this DET dad-10733 552 2 dataset dataset NOUN dad-10733 552 3 consists consist VERB dad-10733 552 4 of of ADP dad-10733 552 5 a a DET dad-10733 552 6 set set NOUN dad-10733 552 7 of of ADP dad-10733 552 8 fully fully ADV dad-10733 552 9 synchronized synchronize VERB dad-10733 552 10 audio audio ADJ dad-10733 552 11 - - ADJ dad-10733 552 12 visual visual ADJ dad-10733 552 13 recordings recording NOUN dad-10733 552 14 of of ADP dad-10733 552 15 natural natural ADJ dad-10733 552 16 dyadic dyadic NOUN dad-10733 552 17 ( ( PUNCT dad-10733 552 18 one one NUM dad-10733 552 19 - - PUNCT dad-10733 552 20 on on ADP dad-10733 552 21 - - PUNCT dad-10733 552 22 one one NUM dad-10733 552 23 ) ) PUNCT dad-10733 552 24 interactions interaction NOUN dad-10733 552 25 . . PUNCT dad-10733 553 1 it it PRON dad-10733 553 2 is be AUX dad-10733 553 3 one one NUM dad-10733 553 4 of of ADP dad-10733 553 5 several several ADJ dad-10733 553 6 dialogue dialogue NOUN dad-10733 553 7 corpora corpora NOUN dad-10733 553 8 that that PRON dad-10733 553 9 provide provide VERB dad-10733 553 10 multimodal multimodal NOUN dad-10733 553 11 data datum NOUN dad-10733 553 12 for for ADP dad-10733 553 13 analyzing analyze VERB dad-10733 553 14 human human ADJ dad-10733 553 15 behaviour behaviour NOUN dad-10733 553 16 during during ADP dad-10733 553 17 conversations conversation NOUN dad-10733 553 18 . . PUNCT dad-10733 554 1 such such ADJ dad-10733 554 2 corpora corpora NOUN dad-10733 554 3 often often ADV dad-10733 554 4 consist consist VERB dad-10733 554 5 of of ADP dad-10733 554 6 auditory auditory ADJ dad-10733 554 7 , , PUNCT dad-10733 554 8 visual visual ADJ dad-10733 554 9 , , PUNCT dad-10733 554 10 and and CCONJ dad-10733 554 11 written write VERB dad-10733 554 12 transcriptions transcription NOUN dad-10733 554 13 of of ADP dad-10733 554 14 the the DET dad-10733 554 15 dialogues dialogue NOUN dad-10733 554 16 . . PUNCT dad-10733 555 1 here here ADV dad-10733 555 2 , , PUNCT dad-10733 555 3 only only ADV dad-10733 555 4 audio audio ADJ dad-10733 555 5 - - ADJ dad-10733 555 6 visual visual ADJ dad-10733 555 7 recordings recording NOUN dad-10733 555 8 are be AUX dad-10733 555 9 provided provide VERB dad-10733 555 10 . . PUNCT dad-10733 556 1 the the DET dad-10733 556 2 purpose purpose NOUN dad-10733 556 3 of of ADP dad-10733 556 4 the the DET dad-10733 556 5 dataset dataset NOUN dad-10733 556 6 was be AUX dad-10733 556 7 to to PART dad-10733 556 8 analyze analyze VERB dad-10733 556 9 mimicry mimicry ADJ dad-10733 556 10 ( ( PUNCT dad-10733 556 11 i.e. i.e. X dad-10733 556 12 when when SCONJ dad-10733 556 13 one one NUM dad-10733 556 14 participant participant NOUN dad-10733 556 15 mimics mimic VERB dad-10733 556 16 the the DET dad-10733 556 17 verbal verbal ADJ dad-10733 556 18 and and CCONJ dad-10733 556 19 nonverbal nonverbal ADJ dad-10733 556 20 expressions expression NOUN dad-10733 556 21 of of ADP dad-10733 556 22 their their PRON dad-10733 556 23 counterpart counterpart NOUN dad-10733 556 24 ) ) PUNCT dad-10733 556 25 . . PUNCT dad-10733 557 1 the the DET dad-10733 557 2 authors author NOUN dad-10733 557 3 provide provide VERB dad-10733 557 4 some some DET dad-10733 557 5 benchmark benchmark NOUN dad-10733 557 6 video video NOUN dad-10733 557 7 classification classification NOUN dad-10733 557 8 models model NOUN dad-10733 557 9 to to ADP dad-10733 557 10 this this DET dad-10733 557 11 effect effect NOUN dad-10733 557 12 . . PUNCT dad-10733 558 1 the the DET dad-10733 558 2 intelligence intelligence NOUN dad-10733 558 3 squared square VERB dad-10733 558 4 debate debate NOUN dad-10733 558 5 dataset dataset NOUN dad-10733 558 6 ( ( PUNCT dad-10733 558 7 zhang zhang X dad-10733 558 8 et et PROPN dad-10733 558 9 al al PROPN dad-10733 558 10 . . PROPN dad-10733 558 11 , , PUNCT dad-10733 558 12 2016 2016 NUM dad-10733 558 13 ) ) PUNCT dad-10733 558 14 covers cover VERB dad-10733 558 15 the the DET dad-10733 558 16 “ " PUNCT dad-10733 558 17 intelligence intelligence NOUN dad-10733 558 18 squared square VERB dad-10733 558 19 ” " PUNCT dad-10733 558 20 oxford oxford ADJ dad-10733 558 21 - - PUNCT dad-10733 558 22 style style NOUN dad-10733 558 23 debates debate NOUN dad-10733 558 24 taking take VERB dad-10733 558 25 place place NOUN dad-10733 558 26 between between ADP dad-10733 558 27 2006 2006 NUM dad-10733 558 28 and and CCONJ dad-10733 558 29 2015 2015 NUM dad-10733 558 30 . . PUNCT dad-10733 559 1 the the DET dad-10733 559 2 topics topic NOUN dad-10733 559 3 of of ADP dad-10733 559 4 the the DET dad-10733 559 5 debates debate NOUN dad-10733 559 6 vary vary VERB dad-10733 559 7 across across ADP dad-10733 559 8 the the DET dad-10733 559 9 dataset dataset NOUN dad-10733 559 10 , , PUNCT dad-10733 559 11 but but CCONJ dad-10733 559 12 are be AUX dad-10733 559 13 constrained constrain VERB dad-10733 559 14 within within ADP dad-10733 559 15 the the DET dad-10733 559 16 context context NOUN dad-10733 559 17 of of ADP dad-10733 559 18 each each DET dad-10733 559 19 debate debate NOUN dad-10733 559 20 . . PUNCT dad-10733 560 1 speakers speaker NOUN dad-10733 560 2 are be AUX dad-10733 560 3 labeled label VERB dad-10733 560 4 and and CCONJ dad-10733 560 5 the the DET dad-10733 560 6 full full ADJ dad-10733 560 7 transcript transcript NOUN dad-10733 560 8 of of ADP dad-10733 560 9 the the DET dad-10733 560 10 debate debate NOUN dad-10733 560 11 is be AUX dad-10733 560 12 provided provide VERB dad-10733 560 13 . . PUNCT dad-10733 561 1 furthermore furthermore ADV dad-10733 561 2 , , PUNCT dad-10733 561 3 the the DET dad-10733 561 4 outcome outcome NOUN dad-10733 561 5 of of ADP dad-10733 561 6 the the DET dad-10733 561 7 debate debate NOUN dad-10733 561 8 is be AUX dad-10733 561 9 provided provide VERB dad-10733 561 10 ( ( PUNCT dad-10733 561 11 how how SCONJ dad-10733 561 12 many many ADJ dad-10733 561 13 of of ADP dad-10733 561 14 the the DET dad-10733 561 15 audience audience NOUN dad-10733 561 16 members member NOUN dad-10733 561 17 were be AUX dad-10733 561 18 for for ADP dad-10733 561 19 the the DET dad-10733 561 20 given give VERB dad-10733 561 21 proposal proposal NOUN dad-10733 561 22 or or CCONJ dad-10733 561 23 against against ADP dad-10733 561 24 , , PUNCT dad-10733 561 25 before before ADP dad-10733 561 26 and and CCONJ dad-10733 561 27 after after ADP dad-10733 561 28 the the DET dad-10733 561 29 debate debate NOUN dad-10733 561 30 ) ) PUNCT dad-10733 561 31 . . PUNCT dad-10733 562 1 qa qa NOUN dad-10733 562 2 or or CCONJ dad-10733 562 3 information information NOUN dad-10733 562 4 retrieval retrieval NOUN dad-10733 562 5 there there PRON dad-10733 562 6 are be VERB dad-10733 562 7 several several ADJ dad-10733 562 8 corpora corpora NOUN dad-10733 562 9 which which PRON dad-10733 562 10 feature feature VERB dad-10733 562 11 direct direct ADJ dad-10733 562 12 question question NOUN dad-10733 562 13 - - PUNCT dad-10733 562 14 and and CCONJ dad-10733 562 15 - - PUNCT dad-10733 562 16 answering answer VERB dad-10733 562 17 sessions session NOUN dad-10733 562 18 . . PUNCT dad-10733 563 1 these these PRON dad-10733 563 2 may may AUX dad-10733 563 3 involve involve VERB dad-10733 563 4 general general ADJ dad-10733 563 5 qa qa PROPN dad-10733 563 6 , , PUNCT dad-10733 563 7 such such ADJ dad-10733 563 8 as as ADP dad-10733 563 9 in in ADP dad-10733 563 10 a a DET dad-10733 563 11 press press NOUN dad-10733 563 12 conference conference NOUN dad-10733 563 13 , , PUNCT dad-10733 563 14 or or CCONJ dad-10733 563 15 more more ADJ dad-10733 563 16 task task NOUN dad-10733 563 17 - - PUNCT dad-10733 563 18 specific specific ADJ dad-10733 563 19 lines line NOUN dad-10733 563 20 of of ADP dad-10733 563 21 questioning question VERB dad-10733 563 22 to to PART dad-10733 563 23 retrieve retrieve VERB dad-10733 563 24 a a DET dad-10733 563 25 specific specific ADJ dad-10733 563 26 set set NOUN dad-10733 563 27 of of ADP dad-10733 563 28 information information NOUN dad-10733 563 29 . . PUNCT dad-10733 564 1 the the DET dad-10733 564 2 corpus corpus PROPN dad-10733 564 3 of of ADP dad-10733 564 4 professional professional ADJ dad-10733 564 5 spoken spoken ADJ dad-10733 564 6 american american PROPN dad-10733 564 7 english english PROPN dad-10733 564 8 ( ( PUNCT dad-10733 564 9 cpsae cpsae PROPN dad-10733 564 10 ) ) PUNCT dad-10733 564 11 ( ( PUNCT dad-10733 564 12 barlow barlow NOUN dad-10733 564 13 , , PUNCT dad-10733 564 14 2000 2000 NUM dad-10733 564 15 ) ) PUNCT dad-10733 564 16 was be AUX dad-10733 564 17 constructed construct VERB dad-10733 564 18 using use VERB dad-10733 564 19 a a DET dad-10733 564 20 selection selection NOUN dad-10733 564 21 of of ADP dad-10733 564 22 transcripts transcript NOUN dad-10733 564 23 of of ADP dad-10733 564 24 interactions interaction NOUN dad-10733 564 25 occurring occur VERB dad-10733 564 26 in in ADP dad-10733 564 27 professional professional ADJ dad-10733 564 28 settings setting NOUN dad-10733 564 29 . . PUNCT dad-10733 565 1 the the DET dad-10733 565 2 corpus corpus NOUN dad-10733 565 3 contains contain VERB dad-10733 565 4 two two NUM dad-10733 565 5 million million NUM dad-10733 565 6 words word NOUN dad-10733 565 7 involving involve VERB dad-10733 565 8 over over ADP dad-10733 565 9 400 400 NUM dad-10733 565 10 speakers speaker NOUN dad-10733 565 11 , , PUNCT dad-10733 565 12 recorded record VERB dad-10733 565 13 between between ADP dad-10733 565 14 1994 1994 NUM dad-10733 565 15 and and CCONJ dad-10733 565 16 1998 1998 NUM dad-10733 565 17 . . PUNCT dad-10733 566 1 the the DET dad-10733 566 2 cpase cpase NOUN dad-10733 566 3 has have VERB dad-10733 566 4 two two NUM dad-10733 566 5 main main ADJ dad-10733 566 6 components component NOUN dad-10733 566 7 . . PUNCT dad-10733 567 1 the the DET dad-10733 567 2 first first ADJ dad-10733 567 3 is be AUX dad-10733 567 4 a a DET dad-10733 567 5 collection collection NOUN dad-10733 567 6 of of ADP dad-10733 567 7 transcripts transcript NOUN dad-10733 567 8 ( ( PUNCT dad-10733 567 9 0.9 0.9 NUM dad-10733 567 10 million million NUM dad-10733 567 11 words word NOUN dad-10733 567 12 ) ) PUNCT dad-10733 567 13 of of ADP dad-10733 567 14 white white PROPN dad-10733 567 15 house house PROPN dad-10733 567 16 press press NOUN dad-10733 567 17 conferences conference NOUN dad-10733 567 18 , , PUNCT dad-10733 567 19 which which PRON dad-10733 567 20 contains contain VERB dad-10733 567 21 almost almost ADV dad-10733 567 22 exclusively exclusively ADV dad-10733 567 23 question question NOUN dad-10733 567 24 and and CCONJ dad-10733 567 25 answer answer NOUN dad-10733 567 26 sessions session NOUN dad-10733 567 27 , , PUNCT dad-10733 567 28 with with ADP dad-10733 567 29 some some DET dad-10733 567 30 policy policy NOUN dad-10733 567 31 statements statement NOUN dad-10733 567 32 by by ADP dad-10733 567 33 politicians politician NOUN dad-10733 567 34 . . PUNCT dad-10733 568 1 the the DET dad-10733 568 2 second second ADJ dad-10733 568 3 component component NOUN dad-10733 568 4 consists consist VERB dad-10733 568 5 of of ADP dad-10733 568 6 transcripts transcript NOUN dad-10733 568 7 ( ( PUNCT dad-10733 568 8 1.1 1.1 NUM dad-10733 568 9 million million NUM dad-10733 568 10 words word NOUN dad-10733 568 11 ) ) PUNCT dad-10733 568 12 of of ADP dad-10733 568 13 faculty faculty NOUN dad-10733 568 14 meetings meeting NOUN dad-10733 568 15 and and CCONJ dad-10733 568 16 committee committee NOUN dad-10733 568 17 meetings meeting NOUN dad-10733 568 18 related relate VERB dad-10733 568 19 to to ADP dad-10733 568 20 national national ADJ dad-10733 568 21 tests test NOUN dad-10733 568 22 that that PRON dad-10733 568 23 involve involve VERB dad-10733 568 24 statements statement NOUN dad-10733 568 25 , , PUNCT dad-10733 568 26 discussions discussion NOUN dad-10733 568 27 , , PUNCT dad-10733 568 28 and and CCONJ dad-10733 568 29 questions question NOUN dad-10733 568 30 . . PUNCT dad-10733 569 1 the the DET dad-10733 569 2 creation creation NOUN dad-10733 569 3 of of ADP dad-10733 569 4 the the DET dad-10733 569 5 corpus corpus NOUN dad-10733 569 6 was be AUX dad-10733 569 7 motivated motivate VERB dad-10733 569 8 by by ADP dad-10733 569 9 the the DET dad-10733 569 10 desire desire NOUN dad-10733 569 11 to to PART dad-10733 569 12 understand understand VERB dad-10733 569 13 and and CCONJ dad-10733 569 14 model model VERB dad-10733 569 15 formal formal ADJ dad-10733 569 16 uses use NOUN dad-10733 569 17 of of ADP dad-10733 569 18 the the DET dad-10733 569 19 english english ADJ dad-10733 569 20 language language NOUN dad-10733 569 21 . . PUNCT dad-10733 570 1 as as SCONJ dad-10733 570 2 previously previously ADV dad-10733 570 3 mentioned mention VERB dad-10733 570 4 , , PUNCT dad-10733 570 5 the the DET dad-10733 570 6 dialog dialog NOUN dad-10733 570 7 state state NOUN dad-10733 570 8 tracking tracking NOUN dad-10733 570 9 challenge challenge NOUN dad-10733 570 10 ( ( PUNCT dad-10733 570 11 dstc dstc NOUN dad-10733 570 12 ) ) PUNCT dad-10733 570 13 consists consist VERB dad-10733 570 14 of of ADP dad-10733 570 15 a a DET dad-10733 570 16 series series NOUN dad-10733 570 17 of of ADP dad-10733 570 18 datasets dataset NOUN dad-10733 570 19 evaluated evaluate VERB dad-10733 570 20 using use VERB dad-10733 570 21 a a DET dad-10733 570 22 ‘ ' PUNCT dad-10733 570 23 state state NOUN dad-10733 570 24 tracking tracking NOUN dad-10733 570 25 ’ ' PUNCT dad-10733 570 26 or or CCONJ dad-10733 570 27 ‘ ' PUNCT dad-10733 570 28 slot slot NOUN dad-10733 570 29 filling filling NOUN dad-10733 570 30 ’ ' PUNCT dad-10733 570 31 metric metric NOUN dad-10733 570 32 . . PUNCT dad-10733 571 1 while while SCONJ dad-10733 571 2 the the DET dad-10733 571 3 first first ADJ dad-10733 571 4 3 3 NUM dad-10733 571 5 installments installment NOUN dad-10733 571 6 of of ADP dad-10733 571 7 this this DET dad-10733 571 8 challenge challenge NOUN dad-10733 571 9 had have VERB dad-10733 571 10 conversations conversation NOUN dad-10733 571 11 between between ADP dad-10733 571 12 a a DET dad-10733 571 13 human human ADJ dad-10733 571 14 participant participant NOUN dad-10733 571 15 and and CCONJ dad-10733 571 16 a a DET dad-10733 571 17 computer computer NOUN dad-10733 571 18 , , PUNCT dad-10733 571 19 dstc4 dstc4 X dad-10733 571 20 ( ( PUNCT dad-10733 571 21 kim kim PROPN dad-10733 571 22 et et PROPN dad-10733 571 23 al al PROPN dad-10733 571 24 . . PROPN dad-10733 571 25 , , PUNCT dad-10733 571 26 2015 2015 NUM dad-10733 571 27 ) ) PUNCT dad-10733 571 28 contains contain VERB dad-10733 571 29 dialogues dialogue NOUN dad-10733 571 30 between between ADP dad-10733 571 31 humans human NOUN dad-10733 571 32 . . PUNCT dad-10733 572 1 in in ADP dad-10733 572 2 particular particular ADJ dad-10733 572 3 , , PUNCT dad-10733 572 4 this this DET dad-10733 572 5 dataset dataset NOUN dad-10733 572 6 has have VERB dad-10733 572 7 35 35 NUM dad-10733 572 8 conversations conversation NOUN dad-10733 572 9 with with ADP dad-10733 572 10 21 21 NUM dad-10733 572 11 hours hour NOUN dad-10733 572 12 of of ADP dad-10733 572 13 interactions interaction NOUN dad-10733 572 14 between between ADP dad-10733 572 15 tourists tourist NOUN dad-10733 572 16 and and CCONJ dad-10733 572 17 tour tour NOUN dad-10733 572 18 guides guide NOUN dad-10733 572 19 over over ADP dad-10733 572 20 skype skype NOUN dad-10733 572 21 , , PUNCT dad-10733 572 22 discussing discuss VERB dad-10733 572 23 information information NOUN dad-10733 572 24 on on ADP dad-10733 572 25 hotels hotel NOUN dad-10733 572 26 , , PUNCT dad-10733 572 27 flights flight NOUN dad-10733 572 28 , , PUNCT dad-10733 572 29 and and CCONJ dad-10733 572 30 car car NOUN dad-10733 572 31 rentals rental NOUN dad-10733 572 32 . . PUNCT dad-10733 573 1 due due ADP dad-10733 573 2 to to ADP dad-10733 573 3 the the DET dad-10733 573 4 small small ADJ dad-10733 573 5 size size NOUN dad-10733 573 6 of of ADP dad-10733 573 7 the the DET dad-10733 573 8 dataset dataset NOUN dad-10733 573 9 , , PUNCT dad-10733 573 10 researchers researcher NOUN dad-10733 573 11 were be AUX dad-10733 573 12 encouraged encourage VERB dad-10733 573 13 to to PART dad-10733 573 14 use use VERB dad-10733 573 15 transfer transfer NOUN dad-10733 573 16 learning learning NOUN dad-10733 573 17 using use VERB dad-10733 573 18 other other ADJ dad-10733 573 19 dstc dstc NOUN dad-10733 573 20 datasets dataset NOUN dad-10733 573 21 to to PART dad-10733 573 22 improve improve VERB dad-10733 573 23 state state NOUN dad-10733 573 24 tracking tracking NOUN dad-10733 573 25 performance performance NOUN dad-10733 573 26 . . PUNCT dad-10733 574 1 this this DET dad-10733 574 2 same same ADJ dad-10733 574 3 training training NOUN dad-10733 574 4 set set NOUN dad-10733 574 5 is be AUX dad-10733 574 6 used use VERB dad-10733 574 7 for for ADP dad-10733 574 8 dstc5 dstc5 NOUN dad-10733 574 9 ( ( PUNCT dad-10733 574 10 kim kim PROPN dad-10733 574 11 et et PROPN dad-10733 574 12 al al PROPN dad-10733 574 13 . . PROPN dad-10733 574 14 , , PUNCT dad-10733 574 15 2016 2016 NUM dad-10733 574 16 ) ) PUNCT dad-10733 574 17 as as ADV dad-10733 574 18 well well ADV dad-10733 574 19 . . PUNCT dad-10733 575 1 however however ADV dad-10733 575 2 , , PUNCT dad-10733 575 3 the the DET dad-10733 575 4 goal goal NOUN dad-10733 575 5 of of ADP dad-10733 575 6 dstc5 dstc5 NOUN dad-10733 575 7 is be AUX dad-10733 575 8 to to PART dad-10733 575 9 study study VERB dad-10733 575 10 22 22 NUM dad-10733 575 11 a a DET dad-10733 575 12 survey survey NOUN dad-10733 575 13 of of ADP dad-10733 575 14 available available ADJ dad-10733 575 15 corpora corpora PROPN dad-10733 575 16 for for ADP dad-10733 575 17 building build VERB dad-10733 575 18 data data NOUN dad-10733 575 19 - - PUNCT dad-10733 575 20 driven drive VERB dad-10733 575 21 dialogue dialogue NOUN dad-10733 575 22 systems system NOUN dad-10733 575 23 multi multi ADJ dad-10733 575 24 - - ADJ dad-10733 575 25 lingual lingual ADJ dad-10733 575 26 speech speech NOUN dad-10733 575 27 - - PUNCT dad-10733 575 28 act act NOUN dad-10733 575 29 prediction prediction NOUN dad-10733 575 30 , , PUNCT dad-10733 575 31 and and CCONJ dad-10733 575 32 therefore therefore ADV dad-10733 575 33 it it PRON dad-10733 575 34 combines combine VERB dad-10733 575 35 the the DET dad-10733 575 36 dstc4 dstc4 NOUN dad-10733 575 37 dialogues dialogue NOUN dad-10733 575 38 plus plus CCONJ dad-10733 575 39 a a DET dad-10733 575 40 set set NOUN dad-10733 575 41 of of ADP dad-10733 575 42 equivalent equivalent ADJ dad-10733 575 43 chinese chinese ADJ dad-10733 575 44 dialogues dialogue NOUN dad-10733 575 45 ; ; PUNCT dad-10733 575 46 evaluation evaluation NOUN dad-10733 575 47 is be AUX dad-10733 575 48 done do VERB dad-10733 575 49 on on ADP dad-10733 575 50 a a DET dad-10733 575 51 holdout holdout NOUN dad-10733 575 52 set set NOUN dad-10733 575 53 of of ADP dad-10733 575 54 chinese chinese ADJ dad-10733 575 55 dialogues dialogue NOUN dad-10733 575 56 . . PUNCT dad-10733 576 1 miscellaneous miscellaneous ADJ dad-10733 576 2 lastly lastly ADV dad-10733 576 3 , , PUNCT dad-10733 576 4 there there PRON dad-10733 576 5 are be VERB dad-10733 576 6 several several ADJ dad-10733 576 7 corpora corpora NOUN dad-10733 576 8 which which PRON dad-10733 576 9 do do AUX dad-10733 576 10 not not PART dad-10733 576 11 fall fall VERB dad-10733 576 12 into into ADP dad-10733 576 13 any any PRON dad-10733 576 14 of of ADP dad-10733 576 15 the the DET dad-10733 576 16 aforementioned aforementioned ADJ dad-10733 576 17 categories category NOUN dad-10733 576 18 , , PUNCT dad-10733 576 19 involving involve VERB dad-10733 576 20 a a DET dad-10733 576 21 range range NOUN dad-10733 576 22 of of ADP dad-10733 576 23 tasks task NOUN dad-10733 576 24 and and CCONJ dad-10733 576 25 situations situation NOUN dad-10733 576 26 . . PUNCT dad-10733 577 1 the the DET dad-10733 577 2 idiap idiap PROPN dad-10733 577 3 wolf wolf PROPN dad-10733 577 4 corpus corpus PROPN dad-10733 577 5 ( ( PUNCT dad-10733 577 6 hung hung NOUN dad-10733 577 7 and and CCONJ dad-10733 577 8 chittaranjan chittaranjan PROPN dad-10733 577 9 , , PUNCT dad-10733 577 10 2010 2010 NUM dad-10733 577 11 ) ) PUNCT dad-10733 577 12 is be AUX dad-10733 577 13 an an DET dad-10733 577 14 audio audio ADJ dad-10733 577 15 - - ADJ dad-10733 577 16 visual visual ADJ dad-10733 577 17 corpus corpus NOUN dad-10733 577 18 containing contain VERB dad-10733 577 19 natural natural ADJ dad-10733 577 20 conversational conversational ADJ dad-10733 577 21 data datum NOUN dad-10733 577 22 of of ADP dad-10733 577 23 volunteers volunteer NOUN dad-10733 577 24 who who PRON dad-10733 577 25 took take VERB dad-10733 577 26 part part NOUN dad-10733 577 27 in in ADP dad-10733 577 28 an an DET dad-10733 577 29 adversarial adversarial ADJ dad-10733 577 30 role role NOUN dad-10733 577 31 - - PUNCT dad-10733 577 32 playing play VERB dad-10733 577 33 game game NOUN dad-10733 577 34 called call VERB dad-10733 577 35 ‘ ' PUNCT dad-10733 577 36 werewolf werewolf NOUN dad-10733 577 37 ’ ' PUNCT dad-10733 577 38 . . PUNCT dad-10733 578 1 four four NUM dad-10733 578 2 groups group NOUN dad-10733 578 3 of of ADP dad-10733 578 4 8 8 NUM dad-10733 578 5 to to PART dad-10733 578 6 12 12 NUM dad-10733 578 7 people people NOUN dad-10733 578 8 were be AUX dad-10733 578 9 recorded record VERB dad-10733 578 10 using use VERB dad-10733 578 11 headset headset NOUN dad-10733 578 12 microphones microphone NOUN dad-10733 578 13 and and CCONJ dad-10733 578 14 synchronized synchronize VERB dad-10733 578 15 video video NOUN dad-10733 578 16 cameras camera NOUN dad-10733 578 17 , , PUNCT dad-10733 578 18 resulting result VERB dad-10733 578 19 in in ADP dad-10733 578 20 over over ADP dad-10733 578 21 7 7 NUM dad-10733 578 22 hours hour NOUN dad-10733 578 23 of of ADP dad-10733 578 24 conversational conversational ADJ dad-10733 578 25 data datum NOUN dad-10733 578 26 . . PUNCT dad-10733 579 1 the the DET dad-10733 579 2 novelty novelty NOUN dad-10733 579 3 of of ADP dad-10733 579 4 this this DET dad-10733 579 5 dataset dataset NOUN dad-10733 579 6 is be AUX dad-10733 579 7 that that SCONJ dad-10733 579 8 the the DET dad-10733 579 9 roles role NOUN dad-10733 579 10 of of ADP dad-10733 579 11 other other ADJ dad-10733 579 12 players player NOUN dad-10733 579 13 are be AUX dad-10733 579 14 unknown unknown ADJ dad-10733 579 15 to to ADP dad-10733 579 16 game game NOUN dad-10733 579 17 participants participant NOUN dad-10733 579 18 , , PUNCT dad-10733 579 19 and and CCONJ dad-10733 579 20 some some PRON dad-10733 579 21 of of ADP dad-10733 579 22 the the DET dad-10733 579 23 roles role NOUN dad-10733 579 24 are be AUX dad-10733 579 25 deceptive deceptive ADJ dad-10733 579 26 in in ADP dad-10733 579 27 nature nature NOUN dad-10733 579 28 . . PUNCT dad-10733 580 1 thus thus ADV dad-10733 580 2 , , PUNCT dad-10733 580 3 there there PRON dad-10733 580 4 is be VERB dad-10733 580 5 a a DET dad-10733 580 6 significant significant ADJ dad-10733 580 7 amount amount NOUN dad-10733 580 8 of of ADP dad-10733 580 9 lying lying NOUN dad-10733 580 10 that that PRON dad-10733 580 11 occurs occur VERB dad-10733 580 12 during during ADP dad-10733 580 13 the the DET dad-10733 580 14 game game NOUN dad-10733 580 15 . . PUNCT dad-10733 581 1 although although SCONJ dad-10733 581 2 specific specific ADJ dad-10733 581 3 instances instance NOUN dad-10733 581 4 of of ADP dad-10733 581 5 lying lying NOUN dad-10733 581 6 are be AUX dad-10733 581 7 not not PART dad-10733 581 8 annotated annotate VERB dad-10733 581 9 , , PUNCT dad-10733 581 10 each each DET dad-10733 581 11 speaker speaker NOUN dad-10733 581 12 is be AUX dad-10733 581 13 labeled label VERB dad-10733 581 14 with with ADP dad-10733 581 15 their their PRON dad-10733 581 16 role role NOUN dad-10733 581 17 in in ADP dad-10733 581 18 the the DET dad-10733 581 19 game game NOUN dad-10733 581 20 . . PUNCT dad-10733 582 1 in in ADP dad-10733 582 2 a a DET dad-10733 582 3 dialogue dialogue NOUN dad-10733 582 4 setting setting NOUN dad-10733 582 5 , , PUNCT dad-10733 582 6 this this PRON dad-10733 582 7 could could AUX dad-10733 582 8 be be AUX dad-10733 582 9 useful useful ADJ dad-10733 582 10 for for ADP dad-10733 582 11 analyzing analyze VERB dad-10733 582 12 the the DET dad-10733 582 13 differences difference NOUN dad-10733 582 14 in in ADP dad-10733 582 15 language language NOUN dad-10733 582 16 when when SCONJ dad-10733 582 17 deception deception NOUN dad-10733 582 18 is be AUX dad-10733 582 19 being be AUX dad-10733 582 20 used use VERB dad-10733 582 21 . . PUNCT dad-10733 583 1 the the DET dad-10733 583 2 semaine semaine PROPN dad-10733 583 3 corpus corpus PROPN dad-10733 583 4 ( ( PUNCT dad-10733 583 5 mckeown mckeown PROPN dad-10733 583 6 et et PROPN dad-10733 583 7 al al PROPN dad-10733 583 8 . . PROPN dad-10733 583 9 , , PUNCT dad-10733 583 10 2010 2010 NUM dad-10733 583 11 ) ) PUNCT dad-10733 583 12 consists consist VERB dad-10733 583 13 of of ADP dad-10733 583 14 100 100 NUM dad-10733 583 15 ‘ ' PUNCT dad-10733 583 16 emotionally emotionally ADV dad-10733 583 17 coloured coloured ADJ dad-10733 583 18 ’ ' PUNCT dad-10733 583 19 conversations conversation NOUN dad-10733 583 20 . . PUNCT dad-10733 584 1 participants participant NOUN dad-10733 584 2 held hold VERB dad-10733 584 3 conversations conversation NOUN dad-10733 584 4 with with ADP dad-10733 584 5 an an DET dad-10733 584 6 operator operator NOUN dad-10733 584 7 who who PRON dad-10733 584 8 adopted adopt VERB dad-10733 584 9 various various ADJ dad-10733 584 10 roles role NOUN dad-10733 584 11 designed design VERB dad-10733 584 12 to to PART dad-10733 584 13 evoke evoke VERB dad-10733 584 14 emotional emotional ADJ dad-10733 584 15 reactions reaction NOUN dad-10733 584 16 . . PUNCT dad-10733 585 1 these these DET dad-10733 585 2 conversations conversation NOUN dad-10733 585 3 were be AUX dad-10733 585 4 recorded record VERB dad-10733 585 5 with with ADP dad-10733 585 6 synchronous synchronous ADJ dad-10733 585 7 video video NOUN dad-10733 585 8 and and CCONJ dad-10733 585 9 audio audio NOUN dad-10733 585 10 devices device NOUN dad-10733 585 11 . . PUNCT dad-10733 586 1 importantly importantly ADV dad-10733 586 2 , , PUNCT dad-10733 586 3 the the DET dad-10733 586 4 operators operator NOUN dad-10733 586 5 ’ ' PUNCT dad-10733 586 6 responses response NOUN dad-10733 586 7 were be AUX dad-10733 586 8 stock stock NOUN dad-10733 586 9 phrases phrase NOUN dad-10733 586 10 that that PRON dad-10733 586 11 were be AUX dad-10733 586 12 independent independent ADJ dad-10733 586 13 of of ADP dad-10733 586 14 the the DET dad-10733 586 15 content content NOUN dad-10733 586 16 of of ADP dad-10733 586 17 the the DET dad-10733 586 18 user user NOUN dad-10733 586 19 ’s ’s PART dad-10733 586 20 utterances utterance NOUN dad-10733 586 21 , , PUNCT dad-10733 586 22 and and CCONJ dad-10733 586 23 only only ADV dad-10733 586 24 dependent dependent ADJ dad-10733 586 25 on on ADP dad-10733 586 26 the the DET dad-10733 586 27 user user NOUN dad-10733 586 28 ’s ’s PART dad-10733 586 29 emotional emotional ADJ dad-10733 586 30 state state NOUN dad-10733 586 31 . . PUNCT dad-10733 587 1 this this DET dad-10733 587 2 corpus corpus NOUN dad-10733 587 3 motivates motivate VERB dad-10733 587 4 building building NOUN dad-10733 587 5 dialogue dialogue NOUN dad-10733 587 6 systems system NOUN dad-10733 587 7 with with ADP dad-10733 587 8 affective affective ADJ dad-10733 587 9 and and CCONJ dad-10733 587 10 emotional emotional ADJ dad-10733 587 11 intelligence intelligence NOUN dad-10733 587 12 abilities ability NOUN dad-10733 587 13 , , PUNCT dad-10733 587 14 since since SCONJ dad-10733 587 15 the the DET dad-10733 587 16 corpus corpus NOUN dad-10733 587 17 does do AUX dad-10733 587 18 not not PART dad-10733 587 19 exhibit exhibit VERB dad-10733 587 20 the the DET dad-10733 587 21 natural natural ADJ dad-10733 587 22 language language NOUN dad-10733 587 23 understanding understanding NOUN dad-10733 587 24 that that PRON dad-10733 587 25 normally normally ADV dad-10733 587 26 occurs occur VERB dad-10733 587 27 between between ADP dad-10733 587 28 human human ADJ dad-10733 587 29 interlocutors interlocutor NOUN dad-10733 587 30 . . PUNCT dad-10733 588 1 the the DET dad-10733 588 2 loqui loqui PROPN dad-10733 588 3 human human ADJ dad-10733 588 4 - - PUNCT dad-10733 588 5 human human ADJ dad-10733 588 6 dialogue dialogue NOUN dad-10733 588 7 corpus corpus NOUN dad-10733 588 8 ( ( PUNCT dad-10733 588 9 passonneau passonneau PROPN dad-10733 588 10 and and CCONJ dad-10733 588 11 sachar sachar PROPN dad-10733 588 12 , , PUNCT dad-10733 588 13 2014 2014 NUM dad-10733 588 14 ) ) PUNCT dad-10733 588 15 consists consist VERB dad-10733 588 16 of of ADP dad-10733 588 17 annotated annotate VERB dad-10733 588 18 transcriptions transcription NOUN dad-10733 588 19 of of ADP dad-10733 588 20 telephone telephone NOUN dad-10733 588 21 interactions interaction NOUN dad-10733 588 22 between between ADP dad-10733 588 23 patrons patron NOUN dad-10733 588 24 and and CCONJ dad-10733 588 25 librarians librarian NOUN dad-10733 588 26 at at ADP dad-10733 588 27 new new PROPN dad-10733 588 28 york york PROPN dad-10733 588 29 city city PROPN dad-10733 588 30 ’s ’s PART dad-10733 588 31 andrew andrew PROPN dad-10733 588 32 heiskell heiskell PROPN dad-10733 588 33 braille braille PROPN dad-10733 588 34 & & CCONJ dad-10733 588 35 talking talk VERB dad-10733 588 36 book book NOUN dad-10733 588 37 library library NOUN dad-10733 588 38 in in ADP dad-10733 588 39 2006 2006 NUM dad-10733 588 40 . . PUNCT dad-10733 589 1 it it PRON dad-10733 589 2 stands stand VERB dad-10733 589 3 out out ADP dad-10733 589 4 as as SCONJ dad-10733 589 5 it it PRON dad-10733 589 6 has have AUX dad-10733 589 7 annotated annotate VERB dad-10733 589 8 discussion discussion NOUN dad-10733 589 9 topics topic NOUN dad-10733 589 10 , , PUNCT dad-10733 589 11 question question NOUN dad-10733 589 12 - - PUNCT dad-10733 589 13 answer answer NOUN dad-10733 589 14 pair pair NOUN dad-10733 589 15 links link NOUN dad-10733 589 16 ( ( PUNCT dad-10733 589 17 adjacency adjacency PROPN dad-10733 589 18 pairs pair NOUN dad-10733 589 19 ) ) PUNCT dad-10733 589 20 , , PUNCT dad-10733 589 21 dialogue dialogue NOUN dad-10733 589 22 acts act VERB dad-10733 589 23 , , PUNCT dad-10733 589 24 and and CCONJ dad-10733 589 25 frames frame NOUN dad-10733 589 26 ( ( PUNCT dad-10733 589 27 discourse discourse NOUN dad-10733 589 28 units unit NOUN dad-10733 589 29 ) ) PUNCT dad-10733 589 30 . . PUNCT dad-10733 590 1 similarly similarly ADV dad-10733 590 2 , , PUNCT dad-10733 590 3 the the DET dad-10733 590 4 the the DET dad-10733 590 5 icsi icsi ADJ dad-10733 590 6 meeting meeting NOUN dad-10733 590 7 recorder recorder NOUN dad-10733 590 8 dialog dialog PROPN dad-10733 590 9 act act PROPN dad-10733 590 10 ( ( PUNCT dad-10733 590 11 mrda mrda PROPN dad-10733 590 12 ) ) PUNCT dad-10733 590 13 corpus corpus NOUN dad-10733 590 14 ( ( PUNCT dad-10733 590 15 shriberg shriberg PROPN dad-10733 590 16 et et PROPN dad-10733 590 17 al al PROPN dad-10733 590 18 . . PROPN dad-10733 590 19 , , PUNCT dad-10733 590 20 2004 2004 NUM dad-10733 590 21 ) ) PUNCT dad-10733 590 22 has have AUX dad-10733 590 23 annotated annotate VERB dad-10733 590 24 dialogue dialogue NOUN dad-10733 590 25 acts act NOUN dad-10733 590 26 , , PUNCT dad-10733 590 27 question question NOUN dad-10733 590 28 - - PUNCT dad-10733 590 29 answer answer NOUN dad-10733 590 30 pair pair NOUN dad-10733 590 31 links link NOUN dad-10733 590 32 ( ( PUNCT dad-10733 590 33 adjacency adjacency PROPN dad-10733 590 34 pairs pair NOUN dad-10733 590 35 ) ) PUNCT dad-10733 590 36 , , PUNCT dad-10733 590 37 and and CCONJ dad-10733 590 38 dialogue dialogue NOUN dad-10733 590 39 hot hot ADJ dad-10733 590 40 spots.6 spots.6 PROPN dad-10733 590 41 it it PRON dad-10733 590 42 consists consist VERB dad-10733 590 43 of of ADP dad-10733 590 44 transcribed transcribe VERB dad-10733 590 45 recordings recording NOUN dad-10733 590 46 of of ADP dad-10733 590 47 75 75 NUM dad-10733 590 48 icsi icsi NOUN dad-10733 590 49 meetings meeting NOUN dad-10733 590 50 on on ADP dad-10733 590 51 several several ADJ dad-10733 590 52 classes class NOUN dad-10733 590 53 of of ADP dad-10733 590 54 topics topic NOUN dad-10733 590 55 including include VERB dad-10733 590 56 : : PUNCT dad-10733 590 57 the the DET dad-10733 590 58 icsi icsi ADJ dad-10733 590 59 meeting meeting NOUN dad-10733 590 60 recorder recorder NOUN dad-10733 590 61 project project NOUN dad-10733 590 62 itself itself PRON dad-10733 590 63 , , PUNCT dad-10733 590 64 automatic automatic ADJ dad-10733 590 65 speech speech NOUN dad-10733 590 66 recognition recognition NOUN dad-10733 590 67 , , PUNCT dad-10733 590 68 natural natural ADJ dad-10733 590 69 language language NOUN dad-10733 590 70 processing processing NOUN dad-10733 590 71 and and CCONJ dad-10733 590 72 neural neural ADJ dad-10733 590 73 theories theory NOUN dad-10733 590 74 of of ADP dad-10733 590 75 language language NOUN dad-10733 590 76 , , PUNCT dad-10733 590 77 and and CCONJ dad-10733 590 78 discussions discussion NOUN dad-10733 590 79 with with ADP dad-10733 590 80 the the DET dad-10733 590 81 annotators annotator NOUN dad-10733 590 82 for for ADP dad-10733 590 83 the the DET dad-10733 590 84 project project NOUN dad-10733 590 85 . . PUNCT dad-10733 591 1 6 6 X dad-10733 591 2 . . X dad-10733 591 3 for for ADP dad-10733 591 4 more more ADJ dad-10733 591 5 information information NOUN dad-10733 591 6 on on ADP dad-10733 591 7 dialogue dialogue NOUN dad-10733 591 8 hot hot ADJ dad-10733 591 9 spots spot NOUN dad-10733 591 10 and and CCONJ dad-10733 591 11 how how SCONJ dad-10733 591 12 they they PRON dad-10733 591 13 relate relate VERB dad-10733 591 14 to to ADP dad-10733 591 15 dialogue dialogue NOUN dad-10733 591 16 acts act NOUN dad-10733 591 17 , , PUNCT dad-10733 591 18 see see VERB dad-10733 591 19 ( ( PUNCT dad-10733 591 20 wrede wrede NOUN dad-10733 591 21 and and CCONJ dad-10733 591 22 shriberg shriberg NOUN dad-10733 591 23 , , PUNCT dad-10733 591 24 2003 2003 NUM dad-10733 591 25 ) ) PUNCT dad-10733 591 26 . . PUNCT dad-10733 592 1 23 23 NUM dad-10733 592 2 serban serban PROPN dad-10733 592 3 , , PUNCT dad-10733 592 4 lowe lowe PROPN dad-10733 592 5 , , PUNCT dad-10733 592 6 henderson henderson PROPN dad-10733 592 7 , , PUNCT dad-10733 592 8 charlin charlin PROPN dad-10733 592 9 and and CCONJ dad-10733 592 10 pineau pineau PROPN dad-10733 592 11 n n PRON dad-10733 592 12 am be AUX dad-10733 592 13 e e NOUN dad-10733 592 14 to to PART dad-10733 592 15 pi pi VERB dad-10733 592 16 cs cs PROPN dad-10733 592 17 to to ADP dad-10733 592 18 ta ta X dad-10733 592 19 l l NOUN dad-10733 592 20 # # NOUN dad-10733 592 21 to to ADP dad-10733 592 22 ta ta ADP dad-10733 592 23 l l NOUN dad-10733 592 24 # # NOUN dad-10733 592 25 to to ADP dad-10733 592 26 ta ta ADP dad-10733 592 27 l l PROPN dad-10733 593 1 d d PROPN dad-10733 593 2 es es PROPN dad-10733 593 3 cr cr PROPN dad-10733 593 4 ip ip PROPN dad-10733 593 5 tio tio PROPN dad-10733 593 6 n n PROPN dad-10733 593 7 of of ADP dad-10733 593 8 di di X dad-10733 593 9 al al PROPN dad-10733 593 10 og og PROPN dad-10733 593 11 ue ue PROPN dad-10733 593 12 s s PROPN dad-10733 593 13 of of ADP dad-10733 593 14 w w NOUN dad-10733 593 15 or or CCONJ dad-10733 593 16 ds ds PRON dad-10733 593 17 le le X dad-10733 593 18 ng ng PROPN dad-10733 593 19 th th INTJ dad-10733 593 20 h h NOUN dad-10733 593 21 c c NOUN dad-10733 593 22 r r NOUN dad-10733 593 23 c c NOUN dad-10733 593 24 m m VERB dad-10733 593 25 ap ap NOUN dad-10733 593 26 ta ta PROPN dad-10733 593 27 sk sk PROPN dad-10733 593 28 c c PROPN dad-10733 594 1 or or CCONJ dad-10733 594 2 pu pu PROPN dad-10733 594 3 s s PART dad-10733 594 4 m m VERB dad-10733 594 5 ap ap PROPN dad-10733 595 1 -r -r PUNCT dad-10733 595 2 ep ep PROPN dad-10733 595 3 ro ro PROPN dad-10733 595 4 du du PROPN dad-10733 595 5 ci ci PROPN dad-10733 595 6 ng ng PROPN dad-10733 595 7 12 12 NUM dad-10733 595 8 8 8 NUM dad-10733 595 9 14 14 NUM dad-10733 595 10 7k 7k NUM dad-10733 595 11 18 18 NUM dad-10733 595 12 hr hr NOUN dad-10733 595 13 s s PROPN dad-10733 595 14 d d X dad-10733 595 15 ia ia PROPN dad-10733 595 16 lo lo PROPN dad-10733 595 17 gu gu NOUN dad-10733 595 18 es es NOUN dad-10733 595 19 fr fr INTJ dad-10733 596 1 om om PROPN dad-10733 596 2 h h NOUN dad-10733 596 3 l l NOUN dad-10733 597 1 a a DET dad-10733 597 2 p p X dad-10733 597 3 ta ta AUX dad-10733 597 4 sk sk VERB dad-10733 597 5 in in ADP dad-10733 597 6 w w PROPN dad-10733 597 7 hi hi INTJ dad-10733 597 8 ch ch NOUN dad-10733 597 9 sp sp ADP dad-10733 597 10 ea ea PROPN dad-10733 598 1 ke ke NOUN dad-10733 598 2 rs rs PROPN dad-10733 598 3 m m VERB dad-10733 598 4 us us PROPN dad-10733 598 5 tc tc NUM dad-10733 598 6 ol ol PROPN dad-10733 599 1 la la PROPN dad-10733 599 2 bo bo PROPN dad-10733 599 3 ra ra PROPN dad-10733 599 4 te te INTJ dad-10733 599 5 ve ve VERB dad-10733 599 6 rb rb PROPN dad-10733 599 7 al al PROPN dad-10733 599 8 ly ly X dad-10733 599 9 ( ( PUNCT dad-10733 599 10 a a DET dad-10733 599 11 nd nd INTJ dad-10733 599 12 er er INTJ dad-10733 599 13 so so ADV dad-10733 599 14 n n ADP dad-10733 599 15 et et NOUN dad-10733 599 16 al al PROPN dad-10733 599 17 . . PROPN dad-10733 599 18 , , PUNCT dad-10733 599 19 19 19 NUM dad-10733 599 20 91 91 NUM dad-10733 599 21 ) ) PUNCT dad-10733 599 22 ta ta PART dad-10733 599 23 sk sk VERB dad-10733 599 24 to to PART dad-10733 599 25 re re AUX dad-10733 599 26 pr pr VERB dad-10733 599 27 od od ADV dad-10733 599 28 uc uc PROPN dad-10733 600 1 e e X dad-10733 600 2 on on ADV dad-10733 600 3 on on ADP dad-10733 600 4 e e PROPN dad-10733 600 5 pa pa PROPN dad-10733 600 6 rt rt PROPN dad-10733 600 7 ic ic PROPN dad-10733 600 8 ip ip VERB dad-10733 600 9 an an DET dad-10733 600 10 ts ts ADP dad-10733 600 11 m m PROPN dad-10733 600 12 ap ap PROPN dad-10733 600 13 a a DET dad-10733 600 14 ro ro X dad-10733 600 15 ut ut PROPN dad-10733 600 16 e e PROPN dad-10733 600 17 pr pr NOUN dad-10733 600 18 in in ADP dad-10733 600 19 te te PROPN dad-10733 600 20 d d X dad-10733 600 21 on on ADP dad-10733 600 22 th th X dad-10733 600 23 e e NOUN dad-10733 600 24 ot ot INTJ dad-10733 600 25 he he PRON dad-10733 600 26 rs rs INTJ dad-10733 600 27 . . PUNCT dad-10733 601 1 t t PROPN dad-10733 601 2 he he PRON dad-10733 601 3 w w PROPN dad-10733 601 4 al al PROPN dad-10733 601 5 ki ki PROPN dad-10733 601 6 ng ng PROPN dad-10733 602 1 a a DET dad-10733 602 2 ro ro X dad-10733 602 3 un un PROPN dad-10733 602 4 d d PROPN dad-10733 602 5 c c PROPN dad-10733 602 6 or or CCONJ dad-10733 602 7 pu pu PROPN dad-10733 602 8 s s PROPN dad-10733 602 9 l l NOUN dad-10733 602 10 oc oc NOUN dad-10733 602 11 at at ADP dad-10733 602 12 io io PROPN dad-10733 602 13 n n PROPN dad-10733 602 14 36 36 NUM dad-10733 602 15 30 30 NUM dad-10733 602 16 0k 0k NOUN dad-10733 602 17 * * PUNCT dad-10733 602 18 33 33 NUM dad-10733 602 19 hr hr NOUN dad-10733 602 20 s s X dad-10733 602 21 pe pe INTJ dad-10733 602 22 op op NOUN dad-10733 602 23 le le X dad-10733 602 24 co co PROPN dad-10733 602 25 lla lla PROPN dad-10733 602 26 bo bo PROPN dad-10733 602 27 ra ra PROPN dad-10733 602 28 tin tin NOUN dad-10733 602 29 g g PROPN dad-10733 602 30 ov ov INTJ dad-10733 602 31 er er INTJ dad-10733 602 32 te te INTJ dad-10733 602 33 le le X dad-10733 602 34 ph ph PROPN dad-10733 602 35 on on ADP dad-10733 602 36 e e PROPN dad-10733 602 37 to to AUX dad-10733 602 38 fin fin VERB dad-10733 602 39 d d PROPN dad-10733 602 40 ce ce PROPN dad-10733 602 41 rt rt PROPN dad-10733 602 42 ai ai VERB dad-10733 602 43 n n ADV dad-10733 602 44 lo lo PROPN dad-10733 602 45 ca can AUX dad-10733 602 46 tio tio VERB dad-10733 602 47 ns ns INTJ dad-10733 602 48 . . PUNCT dad-10733 603 1 ( ( PUNCT dad-10733 603 2 b b X dad-10733 603 3 re re X dad-10733 603 4 nn nn PROPN dad-10733 603 5 an an X dad-10733 603 6 et et NOUN dad-10733 603 7 al al PROPN dad-10733 603 8 . . PUNCT dad-10733 603 9 , , PUNCT dad-10733 603 10 20 20 NUM dad-10733 603 11 13 13 NUM dad-10733 603 12 ) ) PUNCT dad-10733 603 13 fi fi NOUN dad-10733 603 14 nd nd INTJ dad-10733 603 15 in in ADP dad-10733 603 16 g g PROPN dad-10733 603 17 ta ta AUX dad-10733 603 18 sk sk VERB dad-10733 603 19 g g PROPN dad-10733 603 20 re re ADP dad-10733 603 21 en en X dad-10733 603 22 pe pe X dad-10733 603 23 rs rs PROPN dad-10733 603 24 ua ua PROPN dad-10733 603 25 si si PROPN dad-10733 603 26 ve ve PROPN dad-10733 603 27 d d PROPN dad-10733 603 28 at at ADP dad-10733 603 29 ab ab PROPN dad-10733 603 30 as as ADP dad-10733 603 31 e e PROPN dad-10733 603 32 l l NOUN dad-10733 603 33 if if SCONJ dad-10733 603 34 es es ADP dad-10733 603 35 ty ty INTJ dad-10733 603 36 le le ADP dad-10733 603 37 8 8 NUM dad-10733 603 38 35 35 NUM dad-10733 603 39 k k NOUN dad-10733 603 40 * * PUNCT dad-10733 603 41 4h 4h NUM dad-10733 603 42 rs rs NOUN dad-10733 603 43 a a DET dad-10733 603 44 pe pe INTJ dad-10733 603 45 rs rs PROPN dad-10733 603 46 ua ua PROPN dad-10733 603 47 de de PROPN dad-10733 603 48 rw rw PROPN dad-10733 603 49 ith ith PROPN dad-10733 603 50 ( ( PUNCT dad-10733 603 51 g g PROPN dad-10733 603 52 en en X dad-10733 603 53 ui ui PROPN dad-10733 603 54 ne ne PROPN dad-10733 603 55 ly ly X dad-10733 603 56 ) ) PUNCT dad-10733 603 57 s s VERB dad-10733 603 58 tr tr VERB dad-10733 603 59 on on ADP dad-10733 603 60 g g PROPN dad-10733 603 61 pr pr NOUN dad-10733 603 62 ogr ogr PROPN dad-10733 603 63 ee ee PROPN dad-10733 603 64 n n PROPN dad-10733 603 65 fe fe X dad-10733 603 66 el el PROPN dad-10733 603 67 in in ADP dad-10733 603 68 gs gs PROPN dad-10733 603 69 tr tr VERB dad-10733 603 70 ie ie X dad-10733 603 71 s s PROPN dad-10733 603 72 to to PART dad-10733 603 73 co co VERB dad-10733 603 74 nv nv PROPN dad-10733 603 75 in in ADP dad-10733 603 76 ce ce PROPN dad-10733 603 77 ( ( PUNCT dad-10733 603 78 d d PROPN dad-10733 603 79 ou ou ADP dad-10733 603 80 gl gl PROPN dad-10733 603 81 as as ADP dad-10733 603 82 -c -c ADP dad-10733 603 83 ow ow INTJ dad-10733 603 84 ie ie ADV dad-10733 603 85 et et PROPN dad-10733 603 86 al al PROPN dad-10733 603 87 . . PUNCT dad-10733 603 88 , , PUNCT dad-10733 603 89 20 20 NUM dad-10733 603 90 07 07 NUM dad-10733 603 91 ) ) PUNCT dad-10733 603 92 pe pe INTJ dad-10733 603 93 rs rs PROPN dad-10733 603 94 ua ua PROPN dad-10733 603 95 de de PROPN dad-10733 603 96 es es X dad-10733 603 97 to to PART dad-10733 603 98 co co VERB dad-10733 603 99 ns ns VERB dad-10733 603 100 i i PROPN dad-10733 603 101 d d PROPN dad-10733 603 102 er er INTJ dad-10733 603 103 ad ad NOUN dad-10733 603 104 op op NOUN dad-10733 603 105 tin tin NOUN dad-10733 603 106 g g PROPN dad-10733 603 107 m m NOUN dad-10733 603 108 or or CCONJ dad-10733 603 109 e e X dad-10733 603 110 gr gr PROPN dad-10733 603 111 ee ee PROPN dad-10733 603 112 n n PROPN dad-10733 603 113 lif lif PROPN dad-10733 603 114 es es X dad-10733 603 115 ty ty X dad-10733 603 116 le le X dad-10733 603 117 s. s. PROPN dad-10733 603 118 in in ADP dad-10733 603 119 te te PROPN dad-10733 603 120 lli lli PROPN dad-10733 603 121 ge ge PROPN dad-10733 603 122 nc nc PROPN dad-10733 603 123 e e PROPN dad-10733 603 124 sq sq PROPN dad-10733 603 125 ua ua PROPN dad-10733 603 126 re re PROPN dad-10733 603 127 d d PROPN dad-10733 603 128 d d PROPN dad-10733 603 129 eb eb PROPN dad-10733 603 130 at at ADP dad-10733 603 131 es es X dad-10733 603 132 d d PROPN dad-10733 603 133 eb eb PROPN dad-10733 603 134 at at ADP dad-10733 603 135 es es X dad-10733 603 136 10 10 NUM dad-10733 603 137 8 8 NUM dad-10733 603 138 1 1 NUM dad-10733 603 139 . . NOUN dad-10733 603 140 8 8 NUM dad-10733 603 141 m m NOUN dad-10733 603 142 20 20 NUM dad-10733 603 143 0h 0h NUM dad-10733 603 144 rs rs NOUN dad-10733 604 1 * * PUNCT dad-10733 604 2 v v NUM dad-10733 604 3 ar ar PROPN dad-10733 604 4 io io PROPN dad-10733 604 5 us us PROPN dad-10733 604 6 to to ADP dad-10733 604 7 pi pi VERB dad-10733 604 8 cs cs PROPN dad-10733 604 9 in in ADP dad-10733 604 10 o o PROPN dad-10733 604 11 xf xf PROPN dad-10733 604 12 or or CCONJ dad-10733 604 13 dst dst PROPN dad-10733 604 14 yl yl NOUN dad-10733 604 15 e e PROPN dad-10733 604 16 de de ADP dad-10733 604 17 ba ba PROPN dad-10733 604 18 te te PROPN dad-10733 604 19 s s PROPN dad-10733 604 20 , , PUNCT dad-10733 604 21 ea ea X dad-10733 604 22 ch ch PROPN dad-10733 604 23 co co PROPN dad-10733 604 24 ns ns PROPN dad-10733 604 25 tr tr VERB dad-10733 604 26 ai ai PROPN dad-10733 604 27 ne ne PROPN dad-10733 604 28 d d X dad-10733 604 29 ( ( PUNCT dad-10733 604 30 z z NOUN dad-10733 604 31 ha ha INTJ dad-10733 604 32 ng ng PROPN dad-10733 604 33 et et PROPN dad-10733 604 34 al al PROPN dad-10733 604 35 . . PROPN dad-10733 604 36 , , PUNCT dad-10733 604 37 20 20 NUM dad-10733 604 38 16 16 NUM dad-10733 604 39 ) ) PUNCT dad-10733 604 40 to to ADP dad-10733 604 41 on on ADP dad-10733 604 42 e e PROPN dad-10733 604 43 su su PROPN dad-10733 604 44 bj bj VERB dad-10733 604 45 ec ec PROPN dad-10733 604 46 t. t. PROPN dad-10733 604 47 a a PROPN dad-10733 604 48 ud ud PROPN dad-10733 604 49 ie ie PROPN dad-10733 604 50 nc nc PROPN dad-10733 604 51 e e PROPN dad-10733 604 52 op op NOUN dad-10733 604 53 in in ADP dad-10733 604 54 io io PROPN dad-10733 605 1 ns ns INTJ dad-10733 605 2 pr pr INTJ dad-10733 606 1 ov ov INTJ dad-10733 606 2 i i PROPN dad-10733 606 3 d d NOUN dad-10733 606 4 ed ed NOUN dad-10733 607 1 pr pr NOUN dad-10733 607 2 ean ean NOUN dad-10733 607 3 d d PROPN dad-10733 607 4 po po PROPN dad-10733 607 5 st st PROPN dad-10733 607 6 -d -d PROPN dad-10733 607 7 eb eb PROPN dad-10733 607 8 at at ADP dad-10733 607 9 es es X dad-10733 607 10 . . PUNCT dad-10733 608 1 t t PROPN dad-10733 608 2 he he PRON dad-10733 609 1 c c PROPN dad-10733 609 2 or or CCONJ dad-10733 609 3 pu pu PROPN dad-10733 609 4 s s PROPN dad-10733 609 5 of of ADP dad-10733 609 6 pr pr NOUN dad-10733 609 7 of of ADP dad-10733 609 8 es es X dad-10733 609 9 si si X dad-10733 609 10 on on ADP dad-10733 609 11 al al PROPN dad-10733 609 12 sp sp ADP dad-10733 609 13 ok ok PROPN dad-10733 609 14 en en X dad-10733 609 15 po po X dad-10733 609 16 lit light VERB dad-10733 609 17 ic ic PROPN dad-10733 609 18 s s PROPN dad-10733 609 19 , , PUNCT dad-10733 609 20 e e X dad-10733 609 21 du du PROPN dad-10733 609 22 ca can AUX dad-10733 609 23 tio tio VERB dad-10733 609 24 n n ADV dad-10733 609 25 20 20 NUM dad-10733 609 26 0 0 NUM dad-10733 609 27 2 2 NUM dad-10733 609 28 m m NUM dad-10733 609 29 22 22 NUM dad-10733 609 30 0h 0h NOUN dad-10733 609 31 rs rs NOUN dad-10733 610 1 * * PUNCT dad-10733 611 1 in in ADP dad-10733 611 2 te te ADP dad-10733 611 3 ra ra PROPN dad-10733 611 4 ct ct NOUN dad-10733 611 5 io io PROPN dad-10733 612 1 ns ns INTJ dad-10733 612 2 fr fr INTJ dad-10733 612 3 om om PROPN dad-10733 612 4 fa fa PROPN dad-10733 613 1 cu cu PROPN dad-10733 613 2 lty lty PROPN dad-10733 613 3 m m VERB dad-10733 613 4 ee ee ADP dad-10733 613 5 tin tin NOUN dad-10733 613 6 gs gs ADP dad-10733 613 7 an an DET dad-10733 613 8 d d X dad-10733 613 9 w w PROPN dad-10733 613 10 hi hi INTJ dad-10733 613 11 te te INTJ dad-10733 613 12 h h NOUN dad-10733 613 13 ou ou X dad-10733 613 14 se se PROPN dad-10733 614 1 a a DET dad-10733 614 2 m m VERB dad-10733 614 3 er er INTJ dad-10733 614 4 ic ic PROPN dad-10733 614 5 an an DET dad-10733 614 6 e e X dad-10733 614 7 ng ng PROPN dad-10733 614 8 lis lis PROPN dad-10733 614 9 h h NOUN dad-10733 614 10 ( ( PUNCT dad-10733 614 11 b b X dad-10733 614 12 ar ar PROPN dad-10733 614 13 lo lo PROPN dad-10733 614 14 w w PROPN dad-10733 614 15 , , PUNCT dad-10733 614 16 2 2 NUM dad-10733 614 17 00 00 NUM dad-10733 614 18 0 0 NUM dad-10733 614 19 ) ) PUNCT dad-10733 614 20 pr pr NOUN dad-10733 614 21 es es X dad-10733 614 22 s s VERB dad-10733 614 23 co co VERB dad-10733 614 24 nf nf INTJ dad-10733 614 25 er er INTJ dad-10733 614 26 en en X dad-10733 614 27 ce ce PROPN dad-10733 614 28 s. s. PROPN dad-10733 614 29 m m PROPN dad-10733 614 30 a a DET dad-10733 614 31 h h NOUN dad-10733 614 32 n n ADP dad-10733 614 33 o o NOUN dad-10733 615 1 b b X dad-10733 615 2 m m VERB dad-10733 615 3 i i PRON dad-10733 615 4 m m VERB dad-10733 615 5 ic ic INTJ dad-10733 615 6 ry ry PROPN dad-10733 615 7 d d PROPN dad-10733 615 8 at at ADP dad-10733 615 9 ab ab PROPN dad-10733 615 10 as as SCONJ dad-10733 615 11 e e PROPN dad-10733 615 12 po po NOUN dad-10733 615 13 lit light VERB dad-10733 615 14 ic ic PROPN dad-10733 615 15 s s PROPN dad-10733 615 16 , , PUNCT dad-10733 615 17 g g PROPN dad-10733 615 18 am be AUX dad-10733 615 19 es es X dad-10733 615 20 54 54 NUM dad-10733 615 21 10 10 NUM dad-10733 615 22 0k 0k NOUN dad-10733 615 23 * * PUNCT dad-10733 615 24 11 11 NUM dad-10733 615 25 hr hr NOUN dad-10733 615 26 s s X dad-10733 615 27 tw tw NOUN dad-10733 615 28 o o NOUN dad-10733 615 29 ex ex X dad-10733 616 1 pe pe INTJ dad-10733 616 2 ri ri PROPN dad-10733 616 3 m m VERB dad-10733 616 4 en en X dad-10733 616 5 ts ts ADP dad-10733 616 6 : : PUNCT dad-10733 616 7 a a DET dad-10733 616 8 di di X dad-10733 616 9 sc sc PROPN dad-10733 616 10 us us PROPN dad-10733 616 11 si si INTJ dad-10733 616 12 on on ADV dad-10733 616 13 on on ADP dad-10733 616 14 a a DET dad-10733 616 15 po po NOUN dad-10733 616 16 lit light VERB dad-10733 616 17 ic ic PROPN dad-10733 616 18 al al PROPN dad-10733 616 19 to to ADP dad-10733 616 20 pi pi PROPN dad-10733 616 21 c c PROPN dad-10733 616 22 , , PUNCT dad-10733 616 23 an an DET dad-10733 616 24 d d X dad-10733 616 25 a a PRON dad-10733 616 26 ( ( PUNCT dad-10733 616 27 s s PROPN dad-10733 616 28 un un PROPN dad-10733 616 29 et et PROPN dad-10733 616 30 al al PROPN dad-10733 616 31 . . PROPN dad-10733 616 32 , , PUNCT dad-10733 616 33 20 20 NUM dad-10733 616 34 11 11 NUM dad-10733 616 35 ) ) PUNCT dad-10733 616 36 ro ro X dad-10733 616 37 le le PUNCT dad-10733 616 38 -p -p PUNCT dad-10733 616 39 la la INTJ dad-10733 616 40 yi yi PROPN dad-10733 616 41 ng ng PROPN dad-10733 616 42 ga ga PROPN dad-10733 616 43 m m PROPN dad-10733 616 44 e. e. PROPN dad-10733 616 45 t t PROPN dad-10733 617 1 he he PRON dad-10733 618 1 i i PROPN dad-10733 618 2 d d PROPN dad-10733 618 3 ia ia PROPN dad-10733 618 4 p p PROPN dad-10733 618 5 w w PROPN dad-10733 618 6 ol ol PROPN dad-10733 618 7 fc fc PROPN dad-10733 618 8 or or CCONJ dad-10733 618 9 pu pu PROPN dad-10733 618 10 s s PART dad-10733 618 11 r r NOUN dad-10733 618 12 ol ol PROPN dad-10733 618 13 epl epl PROPN dad-10733 618 14 ay ay PROPN dad-10733 618 15 in in ADP dad-10733 618 16 g g PROPN dad-10733 618 17 g g PROPN dad-10733 618 18 am be AUX dad-10733 618 19 e e NOUN dad-10733 618 20 15 15 NUM dad-10733 618 21 60 60 NUM dad-10733 618 22 k k X dad-10733 618 23 * * PUNCT dad-10733 618 24 7h 7h NUM dad-10733 618 25 rs rs NOUN dad-10733 618 26 a a DET dad-10733 618 27 re re X dad-10733 618 28 co co PROPN dad-10733 618 29 rd rd PROPN dad-10733 618 30 in in ADP dad-10733 618 31 g g PROPN dad-10733 618 32 of of ADP dad-10733 618 33 w w PROPN dad-10733 618 34 er er INTJ dad-10733 618 35 ew ew INTJ dad-10733 618 36 ol ol ADJ dad-10733 619 1 fr fr PROPN dad-10733 619 2 ol ol PROPN dad-10733 619 3 epl epl PROPN dad-10733 619 4 ay ay PROPN dad-10733 619 5 in in ADP dad-10733 619 6 g g PROPN dad-10733 619 7 ga ga PROPN dad-10733 619 8 m m PROPN dad-10733 619 9 e e PROPN dad-10733 619 10 w w PROPN dad-10733 619 11 ith ith PROPN dad-10733 619 12 an an DET dad-10733 619 13 no no INTJ dad-10733 619 14 ta ta NOUN dad-10733 619 15 tio tio NOUN dad-10733 620 1 ns ns INTJ dad-10733 621 1 ( ( PUNCT dad-10733 621 2 h h PROPN dad-10733 621 3 un un PROPN dad-10733 621 4 g g PROPN dad-10733 622 1 an an PROPN dad-10733 622 2 d d X dad-10733 622 3 c c NOUN dad-10733 622 4 hi hi INTJ dad-10733 623 1 tta tta PROPN dad-10733 623 2 ra ra PROPN dad-10733 623 3 nj nj PROPN dad-10733 623 4 an an DET dad-10733 623 5 , , PUNCT dad-10733 623 6 2 2 NUM dad-10733 623 7 01 01 NUM dad-10733 623 8 0 0 NUM dad-10733 623 9 ) ) PUNCT dad-10733 623 10 re re X dad-10733 623 11 la la X dad-10733 624 1 te te X dad-10733 624 2 d d X dad-10733 624 3 to to ADP dad-10733 624 4 ga ga PROPN dad-10733 624 5 m m NOUN dad-10733 624 6 e e NOUN dad-10733 624 7 pr pr X dad-10733 624 8 og og INTJ dad-10733 624 9 re re VERB dad-10733 624 10 ss ss PROPN dad-10733 624 11 . . PUNCT dad-10733 625 1 se se PROPN dad-10733 625 2 m m PROPN dad-10733 626 1 a a PRON dad-10733 626 2 in in ADP dad-10733 626 3 e e X dad-10733 626 4 co co X dad-10733 626 5 rp rp VERB dad-10733 626 6 us we PRON dad-10733 627 1 e e X dad-10733 627 2 m m VERB dad-10733 627 3 ot ot NOUN dad-10733 627 4 io io X dad-10733 627 5 na na X dad-10733 627 6 l l PROPN dad-10733 627 7 10 10 NUM dad-10733 627 8 0 0 NUM dad-10733 627 9 45 45 NUM dad-10733 627 10 0k 0k NOUN dad-10733 627 11 * * PUNCT dad-10733 627 12 50 50 NUM dad-10733 627 13 hr hr NOUN dad-10733 627 14 s s X dad-10733 627 15 u u X dad-10733 627 16 se se X dad-10733 627 17 rs rs PROPN dad-10733 627 18 w w PROPN dad-10733 627 19 er er INTJ dad-10733 627 20 e e X dad-10733 627 21 re re X dad-10733 627 22 co co PROPN dad-10733 627 23 rd rd PROPN dad-10733 627 24 ed ed PROPN dad-10733 627 25 w w PROPN dad-10733 627 26 hi hi INTJ dad-10733 627 27 le le PROPN dad-10733 627 28 ho ho PROPN dad-10733 627 29 ld ld PROPN dad-10733 627 30 in in ADP dad-10733 627 31 g g PROPN dad-10733 627 32 co co PROPN dad-10733 627 33 nv nv PROPN dad-10733 627 34 er er INTJ dad-10733 627 35 sa sa PROPN dad-10733 627 36 tio tio PROPN dad-10733 627 37 ns ns PROPN dad-10733 628 1 w w PROPN dad-10733 628 2 ith ith PROPN dad-10733 628 3 an an DET dad-10733 628 4 op op NOUN dad-10733 628 5 er er INTJ dad-10733 628 6 at at ADP dad-10733 628 7 or or CCONJ dad-10733 628 8 ( ( PUNCT dad-10733 628 9 m m VERB dad-10733 628 10 ck ck INTJ dad-10733 628 11 eo eo INTJ dad-10733 628 12 w w PROPN dad-10733 628 13 n n VERB dad-10733 628 14 et et NOUN dad-10733 628 15 al al PROPN dad-10733 628 16 . . PUNCT dad-10733 629 1 , , PUNCT dad-10733 629 2 20 20 NUM dad-10733 629 3 10 10 NUM dad-10733 629 4 ) ) PUNCT dad-10733 629 5 c c PROPN dad-10733 629 6 on on ADP dad-10733 629 7 ve ve VERB dad-10733 629 8 rs r VERB dad-10733 629 9 at at ADP dad-10733 629 10 io io PROPN dad-10733 629 11 ns ns PROPN dad-10733 629 12 w w PROPN dad-10733 629 13 ho ho PROPN dad-10733 629 14 ad ad NOUN dad-10733 629 15 op op NOUN dad-10733 629 16 ts ts ADP dad-10733 629 17 ro ro X dad-10733 629 18 le le X dad-10733 629 19 s s PROPN dad-10733 629 20 de de X dad-10733 629 21 si si X dad-10733 629 22 gn gn PROPN dad-10733 629 23 ed ed NOUN dad-10733 629 24 to to ADP dad-10733 629 25 ev ev PROPN dad-10733 629 26 ok ok INTJ dad-10733 629 27 e e NOUN dad-10733 629 28 em em PRON dad-10733 629 29 ot ot VERB dad-10733 629 30 io io X dad-10733 629 31 na na ADP dad-10733 629 32 lr lr X dad-10733 629 33 ea ea PROPN dad-10733 629 34 ct ct PROPN dad-10733 629 35 io io PROPN dad-10733 629 36 ns ns INTJ dad-10733 629 37 . . PUNCT dad-10733 630 1 d d PROPN dad-10733 630 2 st st PROPN dad-10733 631 1 c c PROPN dad-10733 631 2 4/ 4/ PROPN dad-10733 631 3 d d PROPN dad-10733 631 4 st st PROPN dad-10733 631 5 c c PROPN dad-10733 631 6 5 5 NUM dad-10733 631 7 c c NOUN dad-10733 631 8 or or CCONJ dad-10733 631 9 po po INTJ dad-10733 631 10 ra ra NOUN dad-10733 631 11 to to PART dad-10733 631 12 ur ur PROPN dad-10733 631 13 is be AUX dad-10733 631 14 t t PROPN dad-10733 631 15 35 35 NUM dad-10733 631 16 27 27 NUM dad-10733 631 17 3k 3k NUM dad-10733 631 18 21 21 NUM dad-10733 631 19 hr hr NOUN dad-10733 631 20 s s VERB dad-10733 631 21 to to PART dad-10733 631 22 ur ur VERB dad-10733 631 23 is be AUX dad-10733 631 24 ti ti X dad-10733 631 25 nf nf NOUN dad-10733 631 26 or or CCONJ dad-10733 631 27 m m VERB dad-10733 631 28 at at ADP dad-10733 631 29 io io PROPN dad-10733 631 30 n n PRON dad-10733 631 31 ex ex ADJ dad-10733 631 32 ch ch NOUN dad-10733 631 33 an an DET dad-10733 631 34 ge ge PROPN dad-10733 632 1 ov ov INTJ dad-10733 632 2 er er INTJ dad-10733 632 3 sk sk INTJ dad-10733 632 4 yp yp PROPN dad-10733 632 5 e. e. PROPN dad-10733 632 6 ( ( PUNCT dad-10733 632 7 k k PROPN dad-10733 633 1 i i PRON dad-10733 633 2 m m VERB dad-10733 633 3 et et NOUN dad-10733 633 4 al al PROPN dad-10733 633 5 . . PUNCT dad-10733 633 6 , , PUNCT dad-10733 633 7 20 20 NUM dad-10733 633 8 15 15 NUM dad-10733 633 9 , , PUNCT dad-10733 633 10 2 2 NUM dad-10733 633 11 01 01 NUM dad-10733 633 12 6 6 NUM dad-10733 633 13 ) ) PUNCT dad-10733 633 14 l l NOUN dad-10733 634 1 oq oq INTJ dad-10733 634 2 ui ui PROPN dad-10733 634 3 d d PROPN dad-10733 634 4 ia ia PROPN dad-10733 634 5 lo lo PROPN dad-10733 634 6 gu gu NOUN dad-10733 634 7 e e PROPN dad-10733 634 8 c c PROPN dad-10733 634 9 or or CCONJ dad-10733 634 10 pu pu PROPN dad-10733 634 11 s s PROPN dad-10733 634 12 l l NOUN dad-10733 635 1 ib ib X dad-10733 635 2 ra ra PROPN dad-10733 635 3 ry ry PROPN dad-10733 635 4 in in ADP dad-10733 635 5 qu qu PROPN dad-10733 635 6 ir ir PROPN dad-10733 635 7 ie ie PROPN dad-10733 635 8 s s PROPN dad-10733 635 9 82 82 NUM dad-10733 635 10 21 21 NUM dad-10733 635 11 k k PROPN dad-10733 635 12 14 14 NUM dad-10733 635 13 0 0 NUM dad-10733 635 14 * * PUNCT dad-10733 635 15 te te X dad-10733 635 16 le le X dad-10733 635 17 ph ph PROPN dad-10733 635 18 on on ADP dad-10733 635 19 e e PROPN dad-10733 635 20 in in ADP dad-10733 635 21 te te ADP dad-10733 635 22 ra ra PROPN dad-10733 635 23 ct ct PROPN dad-10733 635 24 io io PROPN dad-10733 636 1 ns ns INTJ dad-10733 636 2 be be PROPN dad-10733 636 3 tw tw INTJ dad-10733 636 4 ee ee ADP dad-10733 636 5 n n PROPN dad-10733 636 6 lib lib PROPN dad-10733 636 7 ra ra PROPN dad-10733 637 1 ri ri PROPN dad-10733 637 2 an an DET dad-10733 637 3 s s PROPN dad-10733 637 4 an an DET dad-10733 637 5 d d X dad-10733 637 6 pa pa NOUN dad-10733 637 7 tr tr VERB dad-10733 637 8 on on ADP dad-10733 637 9 s. s. PROPN dad-10733 637 10 ( ( PUNCT dad-10733 637 11 p p NOUN dad-10733 637 12 as as ADP dad-10733 637 13 so so ADV dad-10733 637 14 nn nn PROPN dad-10733 637 15 ea ea PROPN dad-10733 637 16 u u PROPN dad-10733 637 17 an an DET dad-10733 637 18 d d X dad-10733 637 19 sa sa PROPN dad-10733 637 20 ch ch PROPN dad-10733 637 21 ar ar PROPN dad-10733 637 22 , , PUNCT dad-10733 637 23 2 2 NUM dad-10733 637 24 01 01 NUM dad-10733 637 25 4 4 NUM dad-10733 637 26 ) ) PUNCT dad-10733 637 27 a a DET dad-10733 637 28 nn nn INTJ dad-10733 637 29 ot ot NOUN dad-10733 637 30 at at ADP dad-10733 637 31 ed ed PROPN dad-10733 637 32 di di PROPN dad-10733 637 33 al al PROPN dad-10733 637 34 og og PROPN dad-10733 637 35 ue ue PROPN dad-10733 638 1 ac ac PROPN dad-10733 638 2 ts ts ADV dad-10733 638 3 , , PUNCT dad-10733 638 4 d d PRON dad-10733 638 5 is be AUX dad-10733 638 6 cu cu PROPN dad-10733 638 7 ss ss NOUN dad-10733 638 8 io io PROPN dad-10733 638 9 n n PART dad-10733 638 10 to to PART dad-10733 638 11 pi pi VERB dad-10733 638 12 cs cs PROPN dad-10733 638 13 , , PUNCT dad-10733 638 14 f f PROPN dad-10733 639 1 ra ra PROPN dad-10733 639 2 m m VERB dad-10733 639 3 es es INTJ dad-10733 639 4 ( ( PUNCT dad-10733 639 5 d d NOUN dad-10733 639 6 is be AUX dad-10733 639 7 co co INTJ dad-10733 639 8 ur ur PROPN dad-10733 639 9 se se PROPN dad-10733 639 10 un un PROPN dad-10733 639 11 its its PRON dad-10733 639 12 ) ) PUNCT dad-10733 639 13 , , PUNCT dad-10733 639 14 qu qu PROPN dad-10733 639 15 es es X dad-10733 639 16 tio tio PROPN dad-10733 639 17 nan nan PROPN dad-10733 639 18 sw sw PROPN dad-10733 639 19 er er INTJ dad-10733 639 20 pa pa PROPN dad-10733 639 21 ir ir PROPN dad-10733 639 22 s. s. PROPN dad-10733 639 23 m m PROPN dad-10733 639 24 r r NOUN dad-10733 639 25 d d PROPN dad-10733 639 26 a a DET dad-10733 639 27 c c NOUN dad-10733 639 28 or or CCONJ dad-10733 639 29 pu pu PROPN dad-10733 639 30 s s PROPN dad-10733 639 31 ic ic PROPN dad-10733 639 32 si si PROPN dad-10733 639 33 m m VERB dad-10733 639 34 ee ee X dad-10733 639 35 tin tin NOUN dad-10733 639 36 gs gs ADP dad-10733 639 37 75 75 NUM dad-10733 639 38 11 11 NUM dad-10733 639 39 k k NOUN dad-10733 639 40 * * PUNCT dad-10733 639 41 72 72 NUM dad-10733 639 42 hr hr NOUN dad-10733 639 43 s s PART dad-10733 639 44 r r NOUN dad-10733 639 45 ec ec PROPN dad-10733 639 46 or or CCONJ dad-10733 639 47 di di INTJ dad-10733 639 48 ng ng PROPN dad-10733 639 49 s s PROPN dad-10733 639 50 of of ADP dad-10733 639 51 ic ic PROPN dad-10733 639 52 si si PROPN dad-10733 639 53 m m VERB dad-10733 639 54 ee ee PROPN dad-10733 639 55 tin tin NOUN dad-10733 640 1 gs gs PROPN dad-10733 640 2 .t .t PROPN dad-10733 640 3 op op PROPN dad-10733 640 4 ic ic PROPN dad-10733 640 5 s s VERB dad-10733 640 6 in in ADP dad-10733 640 7 cl cl NOUN dad-10733 640 8 ud ud INTJ dad-10733 640 9 e e NOUN dad-10733 640 10 : : PUNCT dad-10733 640 11 th th X dad-10733 640 12 e e X dad-10733 640 13 co co X dad-10733 640 14 rp rp VERB dad-10733 640 15 us we PRON dad-10733 640 16 pr pr NOUN dad-10733 640 17 oj oj ADP dad-10733 640 18 ec ec PROPN dad-10733 640 19 ti ti PROPN dad-10733 640 20 ts ts ADP dad-10733 640 21 el el PROPN dad-10733 640 22 f f PROPN dad-10733 640 23 , , PUNCT dad-10733 640 24 ( ( PUNCT dad-10733 640 25 s s X dad-10733 640 26 hr hr NOUN dad-10733 640 27 ib ib NOUN dad-10733 640 28 er er INTJ dad-10733 640 29 g g NOUN dad-10733 640 30 et et PROPN dad-10733 640 31 al al PROPN dad-10733 640 32 . . PUNCT dad-10733 640 33 , , PUNCT dad-10733 640 34 20 20 NUM dad-10733 640 35 04 04 NUM dad-10733 640 36 ) ) PUNCT dad-10733 641 1 au au VERB dad-10733 641 2 to to ADP dad-10733 641 3 m m PROPN dad-10733 641 4 at at ADP dad-10733 641 5 ic ic PROPN dad-10733 641 6 sp sp ADP dad-10733 641 7 ee ee PROPN dad-10733 641 8 ch ch PROPN dad-10733 641 9 re re X dad-10733 641 10 co co PROPN dad-10733 641 11 gn gn PROPN dad-10733 641 12 iti iti PROPN dad-10733 641 13 on on ADP dad-10733 641 14 , , PUNCT dad-10733 641 15 n n CCONJ dad-10733 641 16 at at ADP dad-10733 641 17 ur ur INTJ dad-10733 641 18 al al PROPN dad-10733 641 19 la la PROPN dad-10733 641 20 ng ng PROPN dad-10733 641 21 ua ua PROPN dad-10733 641 22 ge ge PROPN dad-10733 641 23 pr pr VERB dad-10733 641 24 oc oc PART dad-10733 641 25 es es X dad-10733 641 26 si si PROPN dad-10733 641 27 ng ng PROPN dad-10733 641 28 an an PROPN dad-10733 641 29 d d X dad-10733 641 30 th th X dad-10733 641 31 eo eo INTJ dad-10733 641 32 ri ri PROPN dad-10733 641 33 es es X dad-10733 641 34 of of ADP dad-10733 641 35 la la PROPN dad-10733 641 36 ng ng PROPN dad-10733 642 1 ua ua PROPN dad-10733 642 2 ge ge PROPN dad-10733 642 3 .d .d PROPN dad-10733 642 4 ia ia PROPN dad-10733 643 1 lo lo PROPN dad-10733 643 2 gu gu NOUN dad-10733 644 1 e e NOUN dad-10733 644 2 ac ac ADV dad-10733 644 3 ts ts ADV dad-10733 644 4 , , PUNCT dad-10733 644 5 q q PROPN dad-10733 644 6 ue ue PROPN dad-10733 644 7 st st PROPN dad-10733 644 8 io io PROPN dad-10733 644 9 nan nan PROPN dad-10733 644 10 sw sw PROPN dad-10733 644 11 er er INTJ dad-10733 644 12 pa pa PROPN dad-10733 644 13 ir ir PROPN dad-10733 644 14 s s PROPN dad-10733 644 15 , , PUNCT dad-10733 644 16 an an DET dad-10733 644 17 d d X dad-10733 644 18 ho ho X dad-10733 644 19 ts ts X dad-10733 644 20 po po X dad-10733 644 21 ts ts X dad-10733 644 22 . . PUNCT dad-10733 645 1 t t PROPN dad-10733 645 2 r r NOUN dad-10733 645 3 a a DET dad-10733 645 4 in in ADP dad-10733 645 5 s s PROPN dad-10733 645 6 93 93 NUM dad-10733 645 7 d d PROPN dad-10733 645 8 ia ia PROPN dad-10733 645 9 lo lo PROPN dad-10733 645 10 gu gu NOUN dad-10733 645 11 es es PROPN dad-10733 645 12 c c PROPN dad-10733 646 1 or or CCONJ dad-10733 646 2 pu pu PROPN dad-10733 646 3 s s PART dad-10733 646 4 r r NOUN dad-10733 646 5 ai ai VERB dad-10733 646 6 lr lr INTJ dad-10733 646 7 oa oa INTJ dad-10733 647 1 d d NOUN dad-10733 647 2 fr fr NOUN dad-10733 647 3 ei ei PROPN dad-10733 647 4 gh gh PROPN dad-10733 647 5 t t PROPN dad-10733 647 6 98 98 NUM dad-10733 647 7 55 55 NUM dad-10733 647 8 k k NOUN dad-10733 647 9 6 6 NUM dad-10733 647 10 . . PUNCT dad-10733 647 11 5h 5h NUM dad-10733 647 12 rs rs PROPN dad-10733 647 13 c c PROPN dad-10733 647 14 ol ol PROPN dad-10733 647 15 la la PROPN dad-10733 647 16 bo bo PROPN dad-10733 647 17 ra ra PROPN dad-10733 647 18 tiv tiv PROPN dad-10733 647 19 e e PROPN dad-10733 647 20 pl pl PROPN dad-10733 647 21 an an DET dad-10733 647 22 ni ni PROPN dad-10733 647 23 ng ng PROPN dad-10733 647 24 of of ADP dad-10733 647 25 ra ra PROPN dad-10733 647 26 ilr ilr PROPN dad-10733 648 1 oa oa INTJ dad-10733 648 2 d d NOUN dad-10733 648 3 fr fr NOUN dad-10733 648 4 ei ei X dad-10733 648 5 gh gh PROPN dad-10733 648 6 tr tr PROPN dad-10733 648 7 ou ou PROPN dad-10733 648 8 te te PROPN dad-10733 648 9 s. s. PROPN dad-10733 648 10 ( ( PUNCT dad-10733 648 11 h h NOUN dad-10733 648 12 ee ee PROPN dad-10733 648 13 m m PROPN dad-10733 648 14 an an DET dad-10733 648 15 an an PROPN dad-10733 648 16 d d NOUN dad-10733 648 17 a a DET dad-10733 648 18 lle lle PROPN dad-10733 648 19 n n CCONJ dad-10733 648 20 , , PUNCT dad-10733 648 21 19 19 NUM dad-10733 648 22 95 95 NUM dad-10733 648 23 ) ) PUNCT dad-10733 648 24 r r NOUN dad-10733 648 25 ou ou NOUN dad-10733 648 26 te te ADP dad-10733 648 27 pl pl PROPN dad-10733 648 28 an an DET dad-10733 648 29 ni ni PROPN dad-10733 648 30 ng ng PROPN dad-10733 648 31 v v PROPN dad-10733 648 32 er er INTJ dad-10733 648 33 bm bm PROPN dad-10733 648 34 ob ob PROPN dad-10733 648 35 il il PROPN dad-10733 648 36 c c PROPN dad-10733 648 37 or or CCONJ dad-10733 648 38 pu pu PROPN dad-10733 648 39 s s VERB dad-10733 649 1 a a PRON dad-10733 649 2 pp pp INTJ dad-10733 650 1 oi oi INTJ dad-10733 650 2 nt not PART dad-10733 650 3 m m VERB dad-10733 650 4 en en ADP dad-10733 650 5 t t PROPN dad-10733 650 6 72 72 NUM dad-10733 650 7 6 6 NUM dad-10733 650 8 27 27 NUM dad-10733 650 9 0k 0k NOUN dad-10733 650 10 38 38 NUM dad-10733 650 11 h h NOUN dad-10733 650 12 rs rs NOUN dad-10733 650 13 sp sp NOUN dad-10733 650 14 on on ADP dad-10733 650 15 ta ta PROPN dad-10733 650 16 ne ne X dad-10733 650 17 ou ou PROPN dad-10733 650 18 s s PROPN dad-10733 650 19 sp sp ADP dad-10733 650 20 ee ee PROPN dad-10733 650 21 ch ch PROPN dad-10733 650 22 da da PROPN dad-10733 651 1 ta ta AUX dad-10733 651 2 co co VERB dad-10733 651 3 lle lle PROPN dad-10733 651 4 ct ct PROPN dad-10733 652 1 ed ed NOUN dad-10733 653 1 fo fo INTJ dad-10733 653 2 rt rt INTJ dad-10733 654 1 he he PRON dad-10733 654 2 v v INTJ dad-10733 654 3 er er INTJ dad-10733 654 4 bm bm PROPN dad-10733 654 5 ob ob PROPN dad-10733 654 6 il il PROPN dad-10733 654 7 pr pr NOUN dad-10733 654 8 oj oj ADP dad-10733 654 9 ec ec PROPN dad-10733 654 10 t. t. PROPN dad-10733 654 11 ( ( PUNCT dad-10733 654 12 b b X dad-10733 654 13 ur ur INTJ dad-10733 654 14 ge ge PROPN dad-10733 654 15 re re ADP dad-10733 654 16 ta ta PROPN dad-10733 654 17 l. l. PROPN dad-10733 654 18 , , PUNCT dad-10733 654 19 20 20 NUM dad-10733 654 20 00 00 NUM dad-10733 654 21 ) ) PUNCT dad-10733 654 22 sc sc PROPN dad-10733 655 1 he he PRON dad-10733 655 2 du du PROPN dad-10733 655 3 lin lin PROPN dad-10733 655 4 g g PROPN dad-10733 655 5 fu fu PROPN dad-10733 655 6 ll ll AUX dad-10733 655 7 co co VERB dad-10733 655 8 rp rp VERB dad-10733 655 9 us we PRON dad-10733 655 10 is be AUX dad-10733 655 11 in in ADP dad-10733 655 12 e e PROPN dad-10733 655 13 ng ng PROPN dad-10733 655 14 lis lis PROPN dad-10733 655 15 h h NOUN dad-10733 655 16 , , PUNCT dad-10733 655 17 g g PROPN dad-10733 655 18 er er INTJ dad-10733 655 19 m m VERB dad-10733 655 20 an an PRON dad-10733 655 21 , , PUNCT dad-10733 655 22 a a DET dad-10733 655 23 nd nd INTJ dad-10733 655 24 ja ja PROPN dad-10733 655 25 pa pa PROPN dad-10733 655 26 ne ne PROPN dad-10733 655 27 se se PROPN dad-10733 655 28 . . PUNCT dad-10733 656 1 w w PROPN dad-10733 656 2 e e NOUN dad-10733 656 3 on on ADP dad-10733 656 4 ly ly ADP dad-10733 656 5 sh sh INTJ dad-10733 656 6 ow ow INTJ dad-10733 656 7 e e PROPN dad-10733 656 8 ng ng PROPN dad-10733 656 9 lis lis PROPN dad-10733 656 10 h h PROPN dad-10733 656 11 st st PROPN dad-10733 656 12 at at ADP dad-10733 656 13 is be AUX dad-10733 656 14 tic tic ADJ dad-10733 656 15 s. s. PROPN dad-10733 656 16 ta ta PROPN dad-10733 656 17 bl bl PROPN dad-10733 656 18 e e PROPN dad-10733 656 19 3 3 NUM dad-10733 656 20 : : PUNCT dad-10733 656 21 h h NOUN dad-10733 656 22 um um INTJ dad-10733 656 23 an an PRON dad-10733 656 24 -h -h PROPN dad-10733 656 25 um um INTJ dad-10733 656 26 an an DET dad-10733 656 27 co co X dad-10733 656 28 ns ns NOUN dad-10733 656 29 tr tr NOUN dad-10733 656 30 ai ai PROPN dad-10733 656 31 ne ne PROPN dad-10733 656 32 d d PROPN dad-10733 656 33 sp sp ADP dad-10733 656 34 ok ok PROPN dad-10733 656 35 en en X dad-10733 656 36 di di X dad-10733 656 37 al al PROPN dad-10733 656 38 og og PROPN dad-10733 656 39 ue ue PROPN dad-10733 656 40 da da PROPN dad-10733 656 41 ta ta X dad-10733 656 42 se se X dad-10733 656 43 ts ts ADP dad-10733 656 44 .s .s PROPN dad-10733 656 45 ta ta PART dad-10733 656 46 rr rr VERB dad-10733 657 1 ed ed PROPN dad-10733 657 2 ( ( PUNCT dad-10733 657 3 * * NOUN dad-10733 657 4 ) ) PUNCT dad-10733 657 5 n n AUX dad-10733 657 6 um um INTJ dad-10733 657 7 be be AUX dad-10733 657 8 rs rs ADJ dad-10733 657 9 ar ar PROPN dad-10733 657 10 e e PROPN dad-10733 657 11 es es ADP dad-10733 657 12 tim tim PROPN dad-10733 657 13 at at ADP dad-10733 657 14 es es PRON dad-10733 657 15 ba ba PROPN dad-10733 657 16 se se PROPN dad-10733 658 1 d d PROPN dad-10733 658 2 on on ADP dad-10733 658 3 th th ADP dad-10733 658 4 e e X dad-10733 658 5 av av PROPN dad-10733 658 6 er er INTJ dad-10733 658 7 ag ag PROPN dad-10733 658 8 e e PROPN dad-10733 658 9 ra ra PROPN dad-10733 658 10 te te INTJ dad-10733 658 11 of of ADP dad-10733 658 12 e e PROPN dad-10733 658 13 ng ng PROPN dad-10733 658 14 lis lis PROPN dad-10733 658 15 h h NOUN dad-10733 658 16 sp sp ADP dad-10733 658 17 ee ee PROPN dad-10733 658 18 ch ch NOUN dad-10733 658 19 fr fr INTJ dad-10733 659 1 om om INTJ dad-10733 659 2 th th X dad-10733 659 3 e e X dad-10733 659 4 n n CCONJ dad-10733 659 5 at at ADP dad-10733 659 6 io io PROPN dad-10733 659 7 na na ADP dad-10733 659 8 lc lc PROPN dad-10733 659 9 en en ADP dad-10733 659 10 te te PROPN dad-10733 659 11 rf rf NOUN dad-10733 659 12 or or CCONJ dad-10733 659 13 vo vo INTJ dad-10733 659 14 ic ic PROPN dad-10733 659 15 e e PROPN dad-10733 659 16 an an DET dad-10733 659 17 d d PROPN dad-10733 659 18 sp sp ADP dad-10733 659 19 ee ee PROPN dad-10733 659 20 ch ch PROPN dad-10733 659 21 ( ( PUNCT dad-10733 659 22 w w PROPN dad-10733 659 23 w w PROPN dad-10733 659 24 w w PROPN dad-10733 659 25 . . PUNCT dad-10733 660 1 n n PROPN dad-10733 660 2 c c NOUN dad-10733 660 3 v v NOUN dad-10733 660 4 s s NOUN dad-10733 660 5 . . PUNCT dad-10733 661 1 o o NOUN dad-10733 661 2 r r NOUN dad-10733 661 3 g g PROPN dad-10733 661 4 / / SYM dad-10733 661 5 n n PROPN dad-10733 661 6 c c NOUN dad-10733 661 7 v v NOUN dad-10733 661 8 s s X dad-10733 661 9 / / SYM dad-10733 661 10 t t PROPN dad-10733 661 11 u u NOUN dad-10733 661 12 t t NOUN dad-10733 661 13 o o NOUN dad-10733 661 14 r r NOUN dad-10733 661 15 i i PRON dad-10733 661 16 a a DET dad-10733 661 17 l l NOUN dad-10733 661 18 s s NOUN dad-10733 661 19 / / SYM dad-10733 661 20 v v NOUN dad-10733 661 21 o o NOUN dad-10733 662 1 i i NOUN dad-10733 662 2 c c NOUN dad-10733 663 1 e e NOUN dad-10733 663 2 p p NOUN dad-10733 663 3 r r NOUN dad-10733 663 4 o o X dad-10733 663 5 d d X dad-10733 663 6 / / SYM dad-10733 663 7 t t PROPN dad-10733 663 8 u u NOUN dad-10733 663 9 t t NOUN dad-10733 663 10 o o NOUN dad-10733 664 1 r r NOUN dad-10733 664 2 i i PRON dad-10733 664 3 a a DET dad-10733 664 4 l l NOUN dad-10733 664 5 / / SYM dad-10733 664 6 q q SYM dad-10733 664 7 u u NOUN dad-10733 664 8 a a NOUN dad-10733 664 9 l l NOUN dad-10733 665 1 i i PRON dad-10733 665 2 t t VERB dad-10733 665 3 y y PROPN dad-10733 665 4 . . PUNCT dad-10733 666 1 h h PROPN dad-10733 666 2 t t PROPN dad-10733 666 3 m m NOUN dad-10733 666 4 l l NOUN dad-10733 666 5 ) ) PUNCT dad-10733 666 6 . . PUNCT dad-10733 667 1 24 24 NUM dad-10733 667 2 www.ncvs.org/ncvs/tutorials/voiceprod/tutorial/quality.html www.ncvs.org/ncvs/tutorials/voiceprod/tutorial/quality.html VERB dad-10733 667 3 a a DET dad-10733 667 4 survey survey NOUN dad-10733 667 5 of of ADP dad-10733 667 6 available available ADJ dad-10733 667 7 corpora corpora PROPN dad-10733 667 8 for for ADP dad-10733 667 9 building build VERB dad-10733 667 10 data data NOUN dad-10733 667 11 - - PUNCT dad-10733 667 12 driven drive VERB dad-10733 667 13 dialogue dialogue NOUN dad-10733 667 14 systems system NOUN dad-10733 667 15 4.2.3 4.2.3 PROPN dad-10733 667 16 scripted script VERB dad-10733 667 17 corpora corpora VERB dad-10733 667 18 a a DET dad-10733 667 19 final final ADJ dad-10733 667 20 category category NOUN dad-10733 667 21 of of ADP dad-10733 667 22 spoken spoken ADJ dad-10733 667 23 dialogue dialogue NOUN dad-10733 667 24 consists consist VERB dad-10733 667 25 of of ADP dad-10733 667 26 conversations conversation NOUN dad-10733 667 27 that that PRON dad-10733 667 28 have have AUX dad-10733 667 29 been be AUX dad-10733 667 30 pre pre VERB dad-10733 667 31 - - VERB dad-10733 667 32 scripted scripted ADJ dad-10733 667 33 for for ADP dad-10733 667 34 the the DET dad-10733 667 35 purpose purpose NOUN dad-10733 667 36 of of ADP dad-10733 667 37 being be AUX dad-10733 667 38 spoken speak VERB dad-10733 667 39 later later ADV dad-10733 667 40 . . PUNCT dad-10733 668 1 we we PRON dad-10733 668 2 refer refer VERB dad-10733 668 3 to to ADP dad-10733 668 4 datasets dataset NOUN dad-10733 668 5 containing contain VERB dad-10733 668 6 such such ADJ dad-10733 668 7 conversations conversation NOUN dad-10733 668 8 as as ADP dad-10733 668 9 ‘ ' PUNCT dad-10733 668 10 scripted scripted ADJ dad-10733 668 11 corpora corpora NOUN dad-10733 668 12 ’ ' PUNCT dad-10733 668 13 . . PUNCT dad-10733 669 1 as as SCONJ dad-10733 669 2 discussed discuss VERB dad-10733 669 3 in in ADP dad-10733 669 4 subsection subsection NOUN dad-10733 669 5 3.5 3.5 NUM dad-10733 669 6 , , PUNCT dad-10733 669 7 these these DET dad-10733 669 8 datasets dataset NOUN dad-10733 669 9 are be AUX dad-10733 669 10 distinct distinct ADJ dad-10733 669 11 from from ADP dad-10733 669 12 spontaneous spontaneous ADJ dad-10733 669 13 human human ADJ dad-10733 669 14 - - PUNCT dad-10733 669 15 human human NOUN dad-10733 669 16 conversations conversation NOUN dad-10733 669 17 , , PUNCT dad-10733 669 18 as as SCONJ dad-10733 669 19 they they PRON dad-10733 669 20 inevitably inevitably ADV dad-10733 669 21 contain contain VERB dad-10733 669 22 fewer few ADJ dad-10733 669 23 ‘ ' PUNCT dad-10733 669 24 filler filler NOUN dad-10733 669 25 ’ ' PUNCT dad-10733 669 26 words word NOUN dad-10733 669 27 and and CCONJ dad-10733 669 28 expressions expression NOUN dad-10733 669 29 that that PRON dad-10733 669 30 are be AUX dad-10733 669 31 common common ADJ dad-10733 669 32 in in ADP dad-10733 669 33 spoken spoken ADJ dad-10733 669 34 dialogue dialogue NOUN dad-10733 669 35 . . PUNCT dad-10733 670 1 however however ADV dad-10733 670 2 , , PUNCT dad-10733 670 3 they they PRON dad-10733 670 4 should should AUX dad-10733 670 5 not not PART dad-10733 670 6 be be AUX dad-10733 670 7 confused confuse VERB dad-10733 670 8 with with ADP dad-10733 670 9 human human ADJ dad-10733 670 10 - - PUNCT dad-10733 670 11 human human ADJ dad-10733 670 12 written write VERB dad-10733 670 13 dialogues dialogue NOUN dad-10733 670 14 , , PUNCT dad-10733 670 15 as as SCONJ dad-10733 670 16 they they PRON dad-10733 670 17 are be AUX dad-10733 670 18 intended intend VERB dad-10733 670 19 to to PART dad-10733 670 20 sound sound VERB dad-10733 670 21 like like ADP dad-10733 670 22 natural natural ADJ dad-10733 670 23 spoken spoken ADJ dad-10733 670 24 conversations conversation NOUN dad-10733 670 25 when when SCONJ dad-10733 670 26 read read VERB dad-10733 670 27 aloud aloud ADV dad-10733 670 28 by by ADP dad-10733 670 29 the the DET dad-10733 670 30 participants participant NOUN dad-10733 670 31 . . PUNCT dad-10733 671 1 furthermore furthermore ADV dad-10733 671 2 , , PUNCT dad-10733 671 3 most most ADJ dad-10733 671 4 of of ADP dad-10733 671 5 the the DET dad-10733 671 6 works work NOUN dad-10733 671 7 here here ADV dad-10733 671 8 are be AUX dad-10733 671 9 fictional fictional ADJ dad-10733 671 10 — — PUNCT dad-10733 671 11 a a DET dad-10733 671 12 distinction distinction NOUN dad-10733 671 13 made make VERB dad-10733 671 14 in in ADP dad-10733 671 15 subsection subsection NOUN dad-10733 671 16 3.5 3.5 NUM dad-10733 671 17 . . PUNCT dad-10733 672 1 as as ADP dad-10733 672 2 such such ADJ dad-10733 672 3 , , PUNCT dad-10733 672 4 these these DET dad-10733 672 5 scripted script VERB dad-10733 672 6 dialogues dialogue NOUN dad-10733 672 7 are be AUX dad-10733 672 8 required require VERB dad-10733 672 9 to to PART dad-10733 672 10 be be AUX dad-10733 672 11 dramatic dramatic ADJ dad-10733 672 12 , , PUNCT dad-10733 672 13 as as SCONJ dad-10733 672 14 they they PRON dad-10733 672 15 are be AUX dad-10733 672 16 generally generally ADV dad-10733 672 17 sourced source VERB dad-10733 672 18 from from ADP dad-10733 672 19 movies movie NOUN dad-10733 672 20 or or CCONJ dad-10733 672 21 tv tv NOUN dad-10733 672 22 shows show NOUN dad-10733 672 23 . . PUNCT dad-10733 673 1 there there PRON dad-10733 673 2 exist exist VERB dad-10733 673 3 multiple multiple ADJ dad-10733 673 4 scripted script VERB dad-10733 673 5 corpora corpora NOUN dad-10733 673 6 based base VERB dad-10733 673 7 on on ADP dad-10733 673 8 movies movie NOUN dad-10733 673 9 and and CCONJ dad-10733 673 10 tv tv NOUN dad-10733 673 11 series series NOUN dad-10733 673 12 . . PUNCT dad-10733 674 1 these these PRON dad-10733 674 2 can can AUX dad-10733 674 3 be be AUX dad-10733 674 4 sub sub ADJ dad-10733 674 5 - - ADJ dad-10733 674 6 divided divide VERB dad-10733 674 7 into into ADP dad-10733 674 8 two two NUM dad-10733 674 9 categories category NOUN dad-10733 674 10 : : PUNCT dad-10733 674 11 corpora corpora VERB dad-10733 674 12 that that PRON dad-10733 674 13 provide provide VERB dad-10733 674 14 the the DET dad-10733 674 15 actual actual ADJ dad-10733 674 16 scripts script NOUN dad-10733 674 17 ( ( PUNCT dad-10733 674 18 i.e. i.e. X dad-10733 674 19 the the DET dad-10733 674 20 movie movie NOUN dad-10733 674 21 script script NOUN dad-10733 674 22 or or CCONJ dad-10733 674 23 tv tv NOUN dad-10733 674 24 series series NOUN dad-10733 674 25 script script PROPN dad-10733 674 26 ) ) PUNCT dad-10733 674 27 where where SCONJ dad-10733 674 28 each each DET dad-10733 674 29 utterance utterance NOUN dad-10733 674 30 is be AUX dad-10733 674 31 tagged tag VERB dad-10733 674 32 with with ADP dad-10733 674 33 the the DET dad-10733 674 34 appropriate appropriate ADJ dad-10733 674 35 speaker speaker NOUN dad-10733 674 36 , , PUNCT dad-10733 674 37 and and CCONJ dad-10733 674 38 those those PRON dad-10733 674 39 that that PRON dad-10733 674 40 only only ADV dad-10733 674 41 contain contain VERB dad-10733 674 42 subtitles subtitle NOUN dad-10733 674 43 and and CCONJ dad-10733 674 44 consecutive consecutive ADJ dad-10733 674 45 utterances utterance NOUN dad-10733 674 46 are be AUX dad-10733 674 47 not not PART dad-10733 674 48 divided divide VERB dad-10733 674 49 or or CCONJ dad-10733 674 50 labeled label VERB dad-10733 674 51 in in ADP dad-10733 674 52 any any DET dad-10733 674 53 way way NOUN dad-10733 674 54 . . PUNCT dad-10733 675 1 it it PRON dad-10733 675 2 is be AUX dad-10733 675 3 always always ADV dad-10733 675 4 preferable preferable ADJ dad-10733 675 5 to to PART dad-10733 675 6 have have VERB dad-10733 675 7 the the DET dad-10733 675 8 speaker speaker NOUN dad-10733 675 9 labels label NOUN dad-10733 675 10 , , PUNCT dad-10733 675 11 but but CCONJ dad-10733 675 12 there there PRON dad-10733 675 13 is be VERB dad-10733 675 14 significantly significantly ADV dad-10733 675 15 more more ADV dad-10733 675 16 unlabeled unlabele VERB dad-10733 675 17 subtitle subtitle NOUN dad-10733 675 18 data datum NOUN dad-10733 675 19 available available ADJ dad-10733 675 20 , , PUNCT dad-10733 675 21 and and CCONJ dad-10733 675 22 both both DET dad-10733 675 23 sources source NOUN dad-10733 675 24 of of ADP dad-10733 675 25 information information NOUN dad-10733 675 26 can can AUX dad-10733 675 27 be be AUX dad-10733 675 28 leveraged leverage VERB dad-10733 675 29 to to PART dad-10733 675 30 build build VERB dad-10733 675 31 a a DET dad-10733 675 32 dialogue dialogue NOUN dad-10733 675 33 system system NOUN dad-10733 675 34 . . PUNCT dad-10733 676 1 the the DET dad-10733 676 2 movie movie NOUN dad-10733 676 3 dic dic PROPN dad-10733 676 4 corpus corpus PROPN dad-10733 676 5 ( ( PUNCT dad-10733 676 6 banchs banch NOUN dad-10733 676 7 , , PUNCT dad-10733 676 8 2012 2012 NUM dad-10733 676 9 ) ) PUNCT dad-10733 676 10 is be AUX dad-10733 676 11 an an DET dad-10733 676 12 example example NOUN dad-10733 676 13 of of ADP dad-10733 676 14 the the DET dad-10733 676 15 former former ADJ dad-10733 676 16 case case NOUN dad-10733 676 17 — — PUNCT dad-10733 676 18 it it PRON dad-10733 676 19 contains contain VERB dad-10733 676 20 about about ADV dad-10733 676 21 130,000 130,000 NUM dad-10733 676 22 dialogues dialogue NOUN dad-10733 676 23 and and CCONJ dad-10733 676 24 6 6 NUM dad-10733 676 25 million million NUM dad-10733 676 26 words word NOUN dad-10733 676 27 from from ADP dad-10733 676 28 movie movie NOUN dad-10733 676 29 scripts script NOUN dad-10733 676 30 extracted extract VERB dad-10733 676 31 from from ADP dad-10733 676 32 the the DET dad-10733 676 33 internet internet NOUN dad-10733 676 34 movie movie NOUN dad-10733 676 35 script script NOUN dad-10733 676 36 data datum NOUN dad-10733 676 37 collection7 collection7 NOUN dad-10733 676 38 , , PUNCT dad-10733 676 39 carefully carefully ADV dad-10733 676 40 selected select VERB dad-10733 676 41 to to PART dad-10733 676 42 cover cover VERB dad-10733 676 43 a a DET dad-10733 676 44 wide wide ADJ dad-10733 676 45 range range NOUN dad-10733 676 46 of of ADP dad-10733 676 47 genres genre NOUN dad-10733 676 48 . . PUNCT dad-10733 677 1 these these DET dad-10733 677 2 dialogues dialogue NOUN dad-10733 677 3 also also ADV dad-10733 677 4 come come VERB dad-10733 677 5 with with ADP dad-10733 677 6 context context NOUN dad-10733 677 7 descriptions description NOUN dad-10733 677 8 , , PUNCT dad-10733 677 9 as as SCONJ dad-10733 677 10 written write VERB dad-10733 677 11 in in ADP dad-10733 677 12 the the DET dad-10733 677 13 script script NOUN dad-10733 677 14 . . PUNCT dad-10733 678 1 one one NUM dad-10733 678 2 derivation derivation NOUN dad-10733 678 3 based base VERB dad-10733 678 4 on on ADP dad-10733 678 5 this this DET dad-10733 678 6 corpus corpus NOUN dad-10733 678 7 is be AUX dad-10733 678 8 the the DET dad-10733 678 9 movie movie NOUN dad-10733 678 10 triples triple NOUN dad-10733 678 11 dataset dataset NOUN dad-10733 678 12 ( ( PUNCT dad-10733 678 13 serban serban PROPN dad-10733 678 14 et et PROPN dad-10733 678 15 al al PROPN dad-10733 678 16 . . PROPN dad-10733 678 17 , , PUNCT dad-10733 678 18 2016 2016 NUM dad-10733 678 19 ) ) PUNCT dad-10733 678 20 . . PUNCT dad-10733 679 1 there there PRON dad-10733 679 2 is be VERB dad-10733 679 3 also also ADV dad-10733 679 4 the the DET dad-10733 679 5 american american ADJ dad-10733 679 6 film film NOUN dad-10733 679 7 scripts script NOUN dad-10733 679 8 corpus corpus NOUN dad-10733 679 9 and and CCONJ dad-10733 679 10 film film NOUN dad-10733 679 11 scripts script NOUN dad-10733 679 12 online online PROPN dad-10733 679 13 corpus corpu NOUN dad-10733 679 14 which which PRON dad-10733 679 15 form form VERB dad-10733 679 16 the the DET dad-10733 679 17 film film NOUN dad-10733 679 18 scripts script NOUN dad-10733 679 19 online online PROPN dad-10733 679 20 series series PROPN dad-10733 679 21 corpus corpus PROPN dad-10733 679 22 , , PUNCT dad-10733 679 23 which which PRON dad-10733 679 24 can can AUX dad-10733 679 25 be be AUX dad-10733 679 26 purchased.8 purchased.8 PROPN dad-10733 679 27 the the DET dad-10733 679 28 latter latter ADJ dad-10733 679 29 consists consist VERB dad-10733 679 30 of of ADP dad-10733 679 31 a a DET dad-10733 679 32 mix mix NOUN dad-10733 679 33 of of ADP dad-10733 679 34 british british ADJ dad-10733 679 35 and and CCONJ dad-10733 679 36 american american ADJ dad-10733 679 37 film film NOUN dad-10733 679 38 scripts script NOUN dad-10733 679 39 , , PUNCT dad-10733 679 40 while while SCONJ dad-10733 679 41 the the DET dad-10733 679 42 former former ADJ dad-10733 679 43 consists consist VERB dad-10733 679 44 of of ADP dad-10733 679 45 solely solely ADV dad-10733 679 46 american american ADJ dad-10733 679 47 films film NOUN dad-10733 679 48 . . PUNCT dad-10733 680 1 the the DET dad-10733 680 2 majority majority NOUN dad-10733 680 3 of of ADP dad-10733 680 4 these these DET dad-10733 680 5 datasets dataset NOUN dad-10733 680 6 consist consist VERB dad-10733 680 7 of of ADP dad-10733 680 8 raw raw ADJ dad-10733 680 9 scripts script NOUN dad-10733 680 10 , , PUNCT dad-10733 680 11 which which PRON dad-10733 680 12 are be AUX dad-10733 680 13 not not PART dad-10733 680 14 guaranteed guarantee VERB dad-10733 680 15 to to PART dad-10733 680 16 portray portray VERB dad-10733 680 17 conversations conversation NOUN dad-10733 680 18 between between ADP dad-10733 680 19 only only ADV dad-10733 680 20 two two NUM dad-10733 680 21 people people NOUN dad-10733 680 22 . . PUNCT dad-10733 681 1 the the DET dad-10733 681 2 dataset dataset NOUN dad-10733 681 3 collected collect VERB dad-10733 681 4 by by ADP dad-10733 681 5 nio nio PROPN dad-10733 681 6 et et PROPN dad-10733 681 7 al al PROPN dad-10733 681 8 . . PROPN dad-10733 681 9 ( ( PUNCT dad-10733 681 10 2014 2014 NUM dad-10733 681 11 ) ) PUNCT dad-10733 681 12 , , PUNCT dad-10733 681 13 which which PRON dad-10733 681 14 we we PRON dad-10733 681 15 refer refer VERB dad-10733 681 16 to to ADP dad-10733 681 17 as as ADP dad-10733 681 18 the the DET dad-10733 681 19 filtered filter VERB dad-10733 681 20 movie movie NOUN dad-10733 681 21 script script NOUN dad-10733 681 22 corpus corpus NOUN dad-10733 681 23 , , PUNCT dad-10733 681 24 takes take VERB dad-10733 681 25 over over ADP dad-10733 681 26 1 1 NUM dad-10733 681 27 million million NUM dad-10733 681 28 utterance utterance ADJ dad-10733 681 29 - - PUNCT dad-10733 681 30 response response NOUN dad-10733 681 31 pairs pair NOUN dad-10733 681 32 from from ADP dad-10733 681 33 web web NOUN dad-10733 681 34 - - PUNCT dad-10733 681 35 based base VERB dad-10733 681 36 script script NOUN dad-10733 681 37 resources resource NOUN dad-10733 681 38 and and CCONJ dad-10733 681 39 filters filter VERB dad-10733 681 40 them they PRON dad-10733 681 41 down down ADP dad-10733 681 42 to to ADP dad-10733 681 43 86,000 86,000 NUM dad-10733 681 44 such such ADJ dad-10733 681 45 pairs pair NOUN dad-10733 681 46 . . PUNCT dad-10733 682 1 the the DET dad-10733 682 2 filtering filter VERB dad-10733 682 3 method method NOUN dad-10733 682 4 limits limit VERB dad-10733 682 5 the the DET dad-10733 682 6 extracted extract VERB dad-10733 682 7 utterances utterance NOUN dad-10733 682 8 to to ADP dad-10733 682 9 x x ADJ dad-10733 682 10 - - PROPN dad-10733 682 11 y y ADJ dad-10733 682 12 - - PUNCT dad-10733 682 13 x x NOUN dad-10733 682 14 triples triple NOUN dad-10733 682 15 , , PUNCT dad-10733 682 16 where where SCONJ dad-10733 682 17 x x PRON dad-10733 682 18 is be AUX dad-10733 682 19 spoken speak VERB dad-10733 682 20 by by ADP dad-10733 682 21 one one NUM dad-10733 682 22 actor actor NOUN dad-10733 682 23 and and CCONJ dad-10733 682 24 y y PROPN dad-10733 682 25 by by ADP dad-10733 682 26 another another PRON dad-10733 682 27 , , PUNCT dad-10733 682 28 and and CCONJ dad-10733 682 29 each each PRON dad-10733 682 30 of of ADP dad-10733 682 31 the the DET dad-10733 682 32 utterances utterance NOUN dad-10733 682 33 share share VERB dad-10733 682 34 some some DET dad-10733 682 35 semantic semantic ADJ dad-10733 682 36 similarity similarity NOUN dad-10733 682 37 . . PUNCT dad-10733 683 1 these these DET dad-10733 683 2 triples triple NOUN dad-10733 683 3 are be AUX dad-10733 683 4 then then ADV dad-10733 683 5 decomposed decompose VERB dad-10733 683 6 into into ADP dad-10733 683 7 x x PROPN dad-10733 683 8 - - NOUN dad-10733 683 9 y y PROPN dad-10733 683 10 and and CCONJ dad-10733 683 11 y y PROPN dad-10733 683 12 - - PUNCT dad-10733 683 13 x x ADJ dad-10733 683 14 pairs pair NOUN dad-10733 683 15 . . PUNCT dad-10733 684 1 such such ADJ dad-10733 684 2 filtering filtering NOUN dad-10733 684 3 largely largely ADV dad-10733 684 4 removes remove VERB dad-10733 684 5 conversations conversation NOUN dad-10733 684 6 with with ADP dad-10733 684 7 more more ADJ dad-10733 684 8 than than ADP dad-10733 684 9 two two NUM dad-10733 684 10 speakers speaker NOUN dad-10733 684 11 , , PUNCT dad-10733 684 12 which which PRON dad-10733 684 13 could could AUX dad-10733 684 14 be be AUX dad-10733 684 15 useful useful ADJ dad-10733 684 16 in in ADP dad-10733 684 17 some some DET dad-10733 684 18 applications application NOUN dad-10733 684 19 . . PUNCT dad-10733 685 1 particularly particularly ADV dad-10733 685 2 , , PUNCT dad-10733 685 3 the the DET dad-10733 685 4 filtering filter VERB dad-10733 685 5 method method NOUN dad-10733 685 6 helps help VERB dad-10733 685 7 to to PART dad-10733 685 8 retain retain VERB dad-10733 685 9 semantic semantic ADJ dad-10733 685 10 context context NOUN dad-10733 685 11 in in ADP dad-10733 685 12 the the DET dad-10733 685 13 dialogue dialogue NOUN dad-10733 685 14 and and CCONJ dad-10733 685 15 keeps keep VERB dad-10733 685 16 a a DET dad-10733 685 17 back back VERB dad-10733 685 18 - - PUNCT dad-10733 685 19 and and CCONJ dad-10733 685 20 - - PUNCT dad-10733 685 21 forth forth ADV dad-10733 685 22 conversational conversational ADJ dad-10733 685 23 flow flow NOUN dad-10733 685 24 that that PRON dad-10733 685 25 is be AUX dad-10733 685 26 desired desire VERB dad-10733 685 27 in in ADP dad-10733 685 28 training train VERB dad-10733 685 29 many many ADJ dad-10733 685 30 dialogue dialogue NOUN dad-10733 685 31 systems system NOUN dad-10733 685 32 . . PUNCT dad-10733 686 1 the the DET dad-10733 686 2 cornell cornell PROPN dad-10733 686 3 movie movie NOUN dad-10733 686 4 - - PUNCT dad-10733 686 5 dialogue dialogue NOUN dad-10733 686 6 corpus corpus NOUN dad-10733 686 7 ( ( PUNCT dad-10733 686 8 danescu danescu NOUN dad-10733 686 9 - - PUNCT dad-10733 686 10 niculescu niculescu NOUN dad-10733 686 11 - - PUNCT dad-10733 686 12 mizil mizil PROPN dad-10733 686 13 and and CCONJ dad-10733 686 14 lee lee PROPN dad-10733 686 15 , , PUNCT dad-10733 686 16 2011 2011 NUM dad-10733 686 17 ) ) PUNCT dad-10733 686 18 also also ADV dad-10733 686 19 has have VERB dad-10733 686 20 short short ADJ dad-10733 686 21 conversations conversation NOUN dad-10733 686 22 extracted extract VERB dad-10733 686 23 from from ADP dad-10733 686 24 movie movie NOUN dad-10733 686 25 scripts script NOUN dad-10733 686 26 . . PUNCT dad-10733 687 1 the the DET dad-10733 687 2 distinguishing distinguish VERB dad-10733 687 3 feature feature NOUN dad-10733 687 4 of of ADP dad-10733 687 5 this this DET dad-10733 687 6 dataset dataset NOUN dad-10733 687 7 is be AUX dad-10733 687 8 the the DET dad-10733 687 9 amount amount NOUN dad-10733 687 10 of of ADP dad-10733 687 11 metadata metadata NOUN dad-10733 687 12 available available ADJ dad-10733 687 13 for for ADP dad-10733 687 14 each each DET dad-10733 687 15 conversation conversation NOUN dad-10733 687 16 : : PUNCT dad-10733 687 17 this this PRON dad-10733 687 18 includes include VERB dad-10733 687 19 movie movie NOUN dad-10733 687 20 metadata metadata NOUN dad-10733 687 21 such such ADJ dad-10733 687 22 as as ADP dad-10733 687 23 genre genre NOUN dad-10733 687 24 , , PUNCT dad-10733 687 25 release release NOUN dad-10733 687 26 year year NOUN dad-10733 687 27 , , PUNCT dad-10733 687 28 and and CCONJ dad-10733 687 29 imdb imdb NOUN dad-10733 687 30 rating rating NOUN dad-10733 687 31 , , PUNCT dad-10733 687 32 as as ADV dad-10733 687 33 well well ADV dad-10733 687 34 as as ADP dad-10733 687 35 character character NOUN dad-10733 687 36 metadata metadata NOUN dad-10733 687 37 such such ADJ dad-10733 687 38 as as ADP dad-10733 687 39 gender gender NOUN dad-10733 687 40 and and CCONJ dad-10733 687 41 position position NOUN dad-10733 687 42 on on ADP dad-10733 687 43 movie movie NOUN dad-10733 687 44 credits credit NOUN dad-10733 687 45 . . PUNCT dad-10733 688 1 although although SCONJ dad-10733 688 2 this this DET dad-10733 688 3 corpus corpus NOUN dad-10733 688 4 contains contain VERB dad-10733 688 5 220,000 220,000 NUM dad-10733 688 6 dialogue dialogue NOUN dad-10733 688 7 excerpts excerpt NOUN dad-10733 688 8 , , PUNCT dad-10733 688 9 it it PRON dad-10733 688 10 only only ADV dad-10733 688 11 contains contain VERB dad-10733 688 12 300,000 300,000 NUM dad-10733 688 13 utterances utterance NOUN dad-10733 688 14 ; ; PUNCT dad-10733 688 15 thus thus ADV dad-10733 688 16 , , PUNCT dad-10733 688 17 many many ADJ dad-10733 688 18 of of ADP dad-10733 688 19 the the DET dad-10733 688 20 excerpts excerpt NOUN dad-10733 688 21 contain contain VERB dad-10733 688 22 a a DET dad-10733 688 23 single single ADJ dad-10733 688 24 utterance utterance NOUN dad-10733 688 25 . . PUNCT dad-10733 689 1 the the DET dad-10733 689 2 corpus corpus NOUN dad-10733 689 3 of of ADP dad-10733 689 4 american american ADJ dad-10733 689 5 soap soap NOUN dad-10733 689 6 operas opera NOUN dad-10733 689 7 ( ( PUNCT dad-10733 689 8 davies davy NOUN dad-10733 689 9 , , PUNCT dad-10733 689 10 2012b 2012b NUM dad-10733 689 11 ) ) PUNCT dad-10733 689 12 contains contain VERB dad-10733 689 13 100 100 NUM dad-10733 689 14 million million NUM dad-10733 689 15 words word NOUN dad-10733 689 16 in in ADP dad-10733 689 17 more more ADJ dad-10733 689 18 than than ADP dad-10733 689 19 22,000 22,000 NUM dad-10733 689 20 transcripts transcript NOUN dad-10733 689 21 of of ADP dad-10733 689 22 ten ten NUM dad-10733 689 23 american american ADJ dad-10733 689 24 tv tv NOUN dad-10733 689 25 - - PUNCT dad-10733 689 26 series series NOUN dad-10733 689 27 soap soap NOUN dad-10733 689 28 operas opera NOUN dad-10733 689 29 from from ADP dad-10733 689 30 2001 2001 NUM dad-10733 689 31 and and CCONJ dad-10733 689 32 2012 2012 NUM dad-10733 689 33 . . PUNCT dad-10733 690 1 because because SCONJ dad-10733 690 2 it it PRON dad-10733 690 3 is be AUX dad-10733 690 4 based base VERB dad-10733 690 5 on on ADP dad-10733 690 6 soap soap NOUN dad-10733 690 7 operas opera NOUN dad-10733 690 8 it it PRON dad-10733 690 9 is be AUX dad-10733 690 10 qualitatively qualitatively ADV dad-10733 690 11 different different ADJ dad-10733 690 12 from from ADP dad-10733 690 13 the the DET dad-10733 690 14 movie movie NOUN dad-10733 690 15 dic dic PROPN dad-10733 690 16 corpus corpus PROPN dad-10733 690 17 , , PUNCT dad-10733 690 18 which which PRON dad-10733 690 19 contains contain VERB dad-10733 690 20 movies movie NOUN dad-10733 690 21 7 7 NUM dad-10733 690 22 . . PUNCT dad-10733 690 23 http://www.imsdb.com http://www.imsdb.com X dad-10733 691 1 8 8 NUM dad-10733 691 2 . . PUNCT dad-10733 692 1 http://alexanderstreet.com/products/film-scripts-online-series http://alexanderstreet.com/products/film-scripts-online-serie NOUN dad-10733 692 2 25 25 NUM dad-10733 692 3 http://www.imsdb.com http://www.imsdb.com X dad-10733 692 4 http://alexanderstreet.com/products/film-scripts-online-series http://alexanderstreet.com/products/film-scripts-online-series PROPN dad-10733 692 5 serban serban PROPN dad-10733 692 6 , , PUNCT dad-10733 692 7 lowe lowe PROPN dad-10733 692 8 , , PUNCT dad-10733 692 9 henderson henderson PROPN dad-10733 692 10 , , PUNCT dad-10733 692 11 charlin charlin PROPN dad-10733 692 12 and and CCONJ dad-10733 692 13 pineau pineau PROPN dad-10733 692 14 in in ADP dad-10733 692 15 the the DET dad-10733 692 16 action action NOUN dad-10733 692 17 and and CCONJ dad-10733 692 18 horror horror NOUN dad-10733 692 19 genres genre NOUN dad-10733 692 20 . . PUNCT dad-10733 693 1 the the DET dad-10733 693 2 corpus corpus NOUN dad-10733 693 3 was be AUX dad-10733 693 4 collected collect VERB dad-10733 693 5 to to PART dad-10733 693 6 provide provide VERB dad-10733 693 7 insights insight NOUN dad-10733 693 8 into into ADP dad-10733 693 9 colloquial colloquial ADJ dad-10733 693 10 american american ADJ dad-10733 693 11 speech speech NOUN dad-10733 693 12 , , PUNCT dad-10733 693 13 as as SCONJ dad-10733 693 14 the the DET dad-10733 693 15 vocabulary vocabulary ADJ dad-10733 693 16 usage usage NOUN dad-10733 693 17 is be AUX dad-10733 693 18 quite quite ADV dad-10733 693 19 different different ADJ dad-10733 693 20 from from ADP dad-10733 693 21 the the DET dad-10733 693 22 british british PROPN dad-10733 693 23 national national PROPN dad-10733 693 24 corpus corpus PROPN dad-10733 693 25 ( ( PUNCT dad-10733 693 26 davies davy NOUN dad-10733 693 27 , , PUNCT dad-10733 693 28 2012a 2012a NUM dad-10733 693 29 ) ) PUNCT dad-10733 693 30 . . PUNCT dad-10733 694 1 unfortunately unfortunately ADV dad-10733 694 2 , , PUNCT dad-10733 694 3 this this DET dad-10733 694 4 corpus corpus NOUN dad-10733 694 5 does do AUX dad-10733 694 6 not not PART dad-10733 694 7 come come VERB dad-10733 694 8 with with ADP dad-10733 694 9 speaker speaker NOUN dad-10733 694 10 labels label NOUN dad-10733 694 11 . . PUNCT dad-10733 695 1 another another DET dad-10733 695 2 corpus corpus NOUN dad-10733 695 3 consisting consist VERB dad-10733 695 4 of of ADP dad-10733 695 5 dialogues dialogue NOUN dad-10733 695 6 from from ADP dad-10733 695 7 tv tv NOUN dad-10733 695 8 shows show NOUN dad-10733 695 9 is be AUX dad-10733 695 10 the the DET dad-10733 695 11 tvd tvd PROPN dad-10733 695 12 corpus corpus PROPN dad-10733 695 13 ( ( PUNCT dad-10733 695 14 roy roy PROPN dad-10733 695 15 et et PROPN dad-10733 695 16 al al PROPN dad-10733 695 17 . . PROPN dad-10733 695 18 , , PUNCT dad-10733 695 19 2014 2014 NUM dad-10733 695 20 ) ) PUNCT dad-10733 695 21 . . PUNCT dad-10733 696 1 this this DET dad-10733 696 2 dataset dataset NOUN dad-10733 696 3 consists consist VERB dad-10733 696 4 of of ADP dad-10733 696 5 191 191 NUM dad-10733 696 6 movie movie NOUN dad-10733 696 7 transcripts transcript NOUN dad-10733 696 8 from from ADP dad-10733 696 9 the the DET dad-10733 696 10 comedy comedy NOUN dad-10733 696 11 show show VERB dad-10733 696 12 the the DET dad-10733 696 13 big big ADJ dad-10733 696 14 bang bang PROPN dad-10733 696 15 theory theory NOUN dad-10733 696 16 , , PUNCT dad-10733 696 17 and and CCONJ dad-10733 696 18 the the DET dad-10733 696 19 drama drama NOUN dad-10733 696 20 show show VERB dad-10733 696 21 game game NOUN dad-10733 696 22 of of ADP dad-10733 696 23 thrones throne NOUN dad-10733 696 24 , , PUNCT dad-10733 696 25 along along ADP dad-10733 696 26 with with ADP dad-10733 696 27 crowd crowd NOUN dad-10733 696 28 - - PUNCT dad-10733 696 29 sourced source VERB dad-10733 696 30 text text NOUN dad-10733 696 31 descriptions description NOUN dad-10733 696 32 ( ( PUNCT dad-10733 696 33 brief brief ADJ dad-10733 696 34 episode episode NOUN dad-10733 696 35 summaries summary NOUN dad-10733 696 36 , , PUNCT dad-10733 696 37 longer long ADJ dad-10733 696 38 episode episode NOUN dad-10733 696 39 outlines outline NOUN dad-10733 696 40 ) ) PUNCT dad-10733 696 41 and and CCONJ dad-10733 696 42 various various ADJ dad-10733 696 43 types type NOUN dad-10733 696 44 of of ADP dad-10733 696 45 metadata metadata NOUN dad-10733 696 46 ( ( PUNCT dad-10733 696 47 speakers speaker NOUN dad-10733 696 48 , , PUNCT dad-10733 696 49 shots shot NOUN dad-10733 696 50 , , PUNCT dad-10733 696 51 scenes scene NOUN dad-10733 696 52 ) ) PUNCT dad-10733 696 53 . . PUNCT dad-10733 697 1 text text NOUN dad-10733 697 2 alignment alignment NOUN dad-10733 697 3 algorithms algorithm NOUN dad-10733 697 4 are be AUX dad-10733 697 5 used use VERB dad-10733 697 6 to to PART dad-10733 697 7 link link VERB dad-10733 697 8 descriptions description NOUN dad-10733 697 9 and and CCONJ dad-10733 697 10 metadata metadata NOUN dad-10733 697 11 to to ADP dad-10733 697 12 the the DET dad-10733 697 13 appropriate appropriate ADJ dad-10733 697 14 sections section NOUN dad-10733 697 15 of of ADP dad-10733 697 16 each each DET dad-10733 697 17 script script NOUN dad-10733 697 18 . . PUNCT dad-10733 698 1 for for ADP dad-10733 698 2 example example NOUN dad-10733 698 3 , , PUNCT dad-10733 698 4 one one PRON dad-10733 698 5 might might AUX dad-10733 698 6 align align VERB dad-10733 698 7 an an DET dad-10733 698 8 event event NOUN dad-10733 698 9 description description NOUN dad-10733 698 10 with with ADP dad-10733 698 11 all all DET dad-10733 698 12 the the DET dad-10733 698 13 utterances utterance NOUN dad-10733 698 14 associated associate VERB dad-10733 698 15 with with ADP dad-10733 698 16 that that DET dad-10733 698 17 event event NOUN dad-10733 698 18 in in ADP dad-10733 698 19 order order NOUN dad-10733 698 20 to to PART dad-10733 698 21 develop develop VERB dad-10733 698 22 algorithms algorithm NOUN dad-10733 698 23 for for ADP dad-10733 698 24 locating locate VERB dad-10733 698 25 specific specific ADJ dad-10733 698 26 events event NOUN dad-10733 698 27 from from ADP dad-10733 698 28 raw raw ADJ dad-10733 698 29 dialogue dialogue NOUN dad-10733 698 30 , , PUNCT dad-10733 698 31 such such ADJ dad-10733 698 32 as as ADP dad-10733 698 33 ’ ' PUNCT dad-10733 698 34 person person NOUN dad-10733 698 35 x x PRON dad-10733 698 36 tries try VERB dad-10733 698 37 to to PART dad-10733 698 38 convince convince VERB dad-10733 698 39 person person NOUN dad-10733 698 40 y y NOUN dad-10733 698 41 ’ ' PUNCT dad-10733 698 42 . . PUNCT dad-10733 699 1 some some DET dad-10733 699 2 work work NOUN dad-10733 699 3 has have AUX dad-10733 699 4 been be AUX dad-10733 699 5 done do VERB dad-10733 699 6 in in ADP dad-10733 699 7 order order NOUN dad-10733 699 8 to to PART dad-10733 699 9 analyze analyze VERB dad-10733 699 10 character character NOUN dad-10733 699 11 style style NOUN dad-10733 699 12 from from ADP dad-10733 699 13 movie movie NOUN dad-10733 699 14 scripts script NOUN dad-10733 699 15 . . PUNCT dad-10733 700 1 this this PRON dad-10733 700 2 is be AUX dad-10733 700 3 aided aid VERB dad-10733 700 4 by by ADP dad-10733 700 5 a a DET dad-10733 700 6 dataset dataset NOUN dad-10733 700 7 collected collect VERB dad-10733 700 8 by by ADP dad-10733 700 9 walker walker PROPN dad-10733 700 10 et et PROPN dad-10733 700 11 al al PROPN dad-10733 700 12 . . PROPN dad-10733 701 1 ( ( PUNCT dad-10733 701 2 2012a 2012a NUM dad-10733 701 3 ) ) PUNCT dad-10733 702 1 that that SCONJ dad-10733 702 2 we we PRON dad-10733 702 3 refer refer VERB dad-10733 702 4 to to ADP dad-10733 702 5 as as ADP dad-10733 702 6 the the DET dad-10733 702 7 character character NOUN dad-10733 702 8 style style NOUN dad-10733 702 9 from from ADP dad-10733 702 10 film film NOUN dad-10733 702 11 corpus corpus NOUN dad-10733 702 12 . . PUNCT dad-10733 703 1 this this DET dad-10733 703 2 corpus corpus NOUN dad-10733 703 3 was be AUX dad-10733 703 4 collected collect VERB dad-10733 703 5 from from ADP dad-10733 703 6 the the DET dad-10733 703 7 imsdb imsdb ADJ dad-10733 703 8 archive archive NOUN dad-10733 703 9 , , PUNCT dad-10733 703 10 and and CCONJ dad-10733 703 11 is be AUX dad-10733 703 12 annotated annotate VERB dad-10733 703 13 for for ADP dad-10733 703 14 linguistic linguistic ADJ dad-10733 703 15 structures structure NOUN dad-10733 703 16 and and CCONJ dad-10733 703 17 character character NOUN dad-10733 703 18 archetypes archetype NOUN dad-10733 703 19 . . PUNCT dad-10733 704 1 features feature NOUN dad-10733 704 2 , , PUNCT dad-10733 704 3 such such ADJ dad-10733 704 4 as as ADP dad-10733 704 5 the the DET dad-10733 704 6 sentiment sentiment NOUN dad-10733 704 7 behind behind ADP dad-10733 704 8 the the DET dad-10733 704 9 utterances utterance NOUN dad-10733 704 10 , , PUNCT dad-10733 704 11 are be AUX dad-10733 704 12 automatically automatically ADV dad-10733 704 13 extracted extract VERB dad-10733 704 14 and and CCONJ dad-10733 704 15 used use VERB dad-10733 704 16 to to PART dad-10733 704 17 derive derive VERB dad-10733 704 18 models model NOUN dad-10733 704 19 of of ADP dad-10733 704 20 the the DET dad-10733 704 21 characters character NOUN dad-10733 704 22 in in ADP dad-10733 704 23 order order NOUN dad-10733 704 24 to to PART dad-10733 704 25 generate generate VERB dad-10733 704 26 new new ADJ dad-10733 704 27 utterances utterance NOUN dad-10733 704 28 similar similar ADJ dad-10733 704 29 in in ADP dad-10733 704 30 style style NOUN dad-10733 704 31 to to ADP dad-10733 704 32 those those PRON dad-10733 704 33 spoken speak VERB dad-10733 704 34 by by ADP dad-10733 704 35 the the DET dad-10733 704 36 character character NOUN dad-10733 704 37 . . PUNCT dad-10733 705 1 thus thus ADV dad-10733 705 2 , , PUNCT dad-10733 705 3 this this DET dad-10733 705 4 dataset dataset NOUN dad-10733 705 5 could could AUX dad-10733 705 6 be be AUX dad-10733 705 7 useful useful ADJ dad-10733 705 8 for for ADP dad-10733 705 9 building build VERB dad-10733 705 10 dialogue dialogue NOUN dad-10733 705 11 personalization personalization NOUN dad-10733 705 12 models model NOUN dad-10733 705 13 . . PUNCT dad-10733 706 1 there there PRON dad-10733 706 2 are be VERB dad-10733 706 3 two two NUM dad-10733 706 4 primary primary ADJ dad-10733 706 5 movie movie NOUN dad-10733 706 6 subtitle subtitle NOUN dad-10733 706 7 datasets dataset NOUN dad-10733 706 8 : : PUNCT dad-10733 706 9 the the DET dad-10733 706 10 opensubtitles opensubtitle NOUN dad-10733 706 11 ( ( PUNCT dad-10733 706 12 tiedemann tiedemann NOUN dad-10733 706 13 , , PUNCT dad-10733 706 14 2012 2012 NUM dad-10733 706 15 ) ) PUNCT dad-10733 706 16 and and CCONJ dad-10733 706 17 the the DET dad-10733 706 18 subtle subtle ADJ dad-10733 706 19 corpus corpus NOUN dad-10733 706 20 ( ( PUNCT dad-10733 706 21 ameixa ameixa NOUN dad-10733 706 22 and and CCONJ dad-10733 706 23 coheur coheur ADV dad-10733 706 24 , , PUNCT dad-10733 706 25 2013 2013 NUM dad-10733 706 26 ) ) PUNCT dad-10733 706 27 . . PUNCT dad-10733 707 1 both both DET dad-10733 707 2 corpora corpus NOUN dad-10733 707 3 are be AUX dad-10733 707 4 based base VERB dad-10733 707 5 on on ADP dad-10733 707 6 the the DET dad-10733 707 7 opensubtitles opensubtitle NOUN dad-10733 707 8 website.9 website.9 VERB dad-10733 707 9 the the DET dad-10733 707 10 opensubtitles opensubtitle NOUN dad-10733 707 11 dataset dataset NOUN dad-10733 707 12 is be AUX dad-10733 707 13 a a DET dad-10733 707 14 giant giant ADJ dad-10733 707 15 collection collection NOUN dad-10733 707 16 of of ADP dad-10733 707 17 movie movie NOUN dad-10733 707 18 subtitles subtitle NOUN dad-10733 707 19 , , PUNCT dad-10733 707 20 containing contain VERB dad-10733 707 21 over over ADP dad-10733 707 22 1 1 NUM dad-10733 707 23 billion billion NUM dad-10733 707 24 words word NOUN dad-10733 707 25 , , PUNCT dad-10733 707 26 whereas whereas SCONJ dad-10733 707 27 subtle subtle ADJ dad-10733 707 28 corpus corpus NOUN dad-10733 707 29 has have AUX dad-10733 707 30 been be AUX dad-10733 707 31 pre pre VERB dad-10733 707 32 - - VERB dad-10733 707 33 processed process VERB dad-10733 707 34 in in ADP dad-10733 707 35 order order NOUN dad-10733 707 36 to to PART dad-10733 707 37 extract extract VERB dad-10733 707 38 interaction interaction NOUN dad-10733 707 39 - - PUNCT dad-10733 707 40 response response NOUN dad-10733 707 41 pairs pair NOUN dad-10733 707 42 that that PRON dad-10733 707 43 can can AUX dad-10733 707 44 help help VERB dad-10733 707 45 dialogue dialogue NOUN dad-10733 707 46 systems system NOUN dad-10733 707 47 deal deal VERB dad-10733 707 48 with with ADP dad-10733 707 49 out out ADV dad-10733 707 50 - - PUNCT dad-10733 707 51 of of ADP dad-10733 707 52 - - PUNCT dad-10733 707 53 domain domain NOUN dad-10733 707 54 ( ( PUNCT dad-10733 707 55 ood ood NOUN dad-10733 707 56 ) ) PUNCT dad-10733 707 57 interactions interaction NOUN dad-10733 707 58 . . PUNCT dad-10733 708 1 the the DET dad-10733 708 2 corpus corpus NOUN dad-10733 708 3 of of ADP dad-10733 708 4 english english ADJ dad-10733 708 5 dialogues dialogue NOUN dad-10733 708 6 1560 1560 NUM dad-10733 708 7 - - SYM dad-10733 708 8 1760 1760 NUM dad-10733 708 9 ( ( PUNCT dad-10733 708 10 ced ced PROPN dad-10733 708 11 ) ) PUNCT dad-10733 708 12 ( ( PUNCT dad-10733 708 13 kytö kytö NOUN dad-10733 708 14 and and CCONJ dad-10733 708 15 walker walker NOUN dad-10733 708 16 , , PUNCT dad-10733 708 17 2006 2006 NUM dad-10733 708 18 ) ) PUNCT dad-10733 708 19 compiles compile VERB dad-10733 708 20 dialogues dialogue NOUN dad-10733 708 21 from from ADP dad-10733 708 22 the the DET dad-10733 708 23 mid-16th mid-16th ADJ dad-10733 708 24 century century NOUN dad-10733 708 25 until until ADP dad-10733 708 26 the the DET dad-10733 708 27 mid-18th mid-18th NUM dad-10733 708 28 century century NOUN dad-10733 708 29 . . PUNCT dad-10733 709 1 the the DET dad-10733 709 2 sources source NOUN dad-10733 709 3 vary vary VERB dad-10733 709 4 from from ADP dad-10733 709 5 real real ADJ dad-10733 709 6 trial trial NOUN dad-10733 709 7 transcripts transcript NOUN dad-10733 709 8 to to ADP dad-10733 709 9 fiction fiction NOUN dad-10733 709 10 dialogues dialogue NOUN dad-10733 709 11 . . PUNCT dad-10733 710 1 due due ADP dad-10733 710 2 to to ADP dad-10733 710 3 the the DET dad-10733 710 4 scripted script VERB dad-10733 710 5 nature nature NOUN dad-10733 710 6 of of ADP dad-10733 710 7 fictional fictional ADJ dad-10733 710 8 dialogues dialogue NOUN dad-10733 710 9 and and CCONJ dad-10733 710 10 the the DET dad-10733 710 11 fact fact NOUN dad-10733 710 12 that that SCONJ dad-10733 710 13 the the DET dad-10733 710 14 majority majority NOUN dad-10733 710 15 of of ADP dad-10733 710 16 the the DET dad-10733 710 17 corpus corpus NOUN dad-10733 710 18 consists consist VERB dad-10733 710 19 of of ADP dad-10733 710 20 fictional fictional ADJ dad-10733 710 21 dialogue dialogue NOUN dad-10733 710 22 , , PUNCT dad-10733 710 23 we we PRON dad-10733 710 24 classify classify VERB dad-10733 710 25 it it PRON dad-10733 710 26 here here ADV dad-10733 710 27 as as ADP dad-10733 710 28 such such ADJ dad-10733 710 29 . . PUNCT dad-10733 711 1 the the DET dad-10733 711 2 corpus corpus NOUN dad-10733 711 3 is be AUX dad-10733 711 4 composed compose VERB dad-10733 711 5 as as SCONJ dad-10733 711 6 follows follow VERB dad-10733 711 7 : : PUNCT dad-10733 712 1 trial trial NOUN dad-10733 712 2 proceedings proceeding NOUN dad-10733 712 3 ( ( PUNCT dad-10733 712 4 285,660 285,660 NUM dad-10733 712 5 words word NOUN dad-10733 712 6 ) ) PUNCT dad-10733 712 7 , , PUNCT dad-10733 712 8 witness witness NOUN dad-10733 712 9 depositions deposition NOUN dad-10733 712 10 ( ( PUNCT dad-10733 712 11 172,940 172,940 NUM dad-10733 712 12 words word NOUN dad-10733 712 13 ) ) PUNCT dad-10733 712 14 , , PUNCT dad-10733 712 15 drama drama NOUN dad-10733 712 16 comedy comedy NOUN dad-10733 712 17 works work NOUN dad-10733 712 18 ( ( PUNCT dad-10733 712 19 238,590 238,590 NUM dad-10733 712 20 words word NOUN dad-10733 712 21 ) ) PUNCT dad-10733 712 22 , , PUNCT dad-10733 712 23 didactic didactic ADJ dad-10733 712 24 works work NOUN dad-10733 712 25 ( ( PUNCT dad-10733 712 26 236,640 236,640 NUM dad-10733 712 27 words word NOUN dad-10733 712 28 ) ) PUNCT dad-10733 712 29 , , PUNCT dad-10733 712 30 prose prose ADJ dad-10733 712 31 fiction fiction NOUN dad-10733 712 32 ( ( PUNCT dad-10733 712 33 223,890 223,890 NUM dad-10733 712 34 words word NOUN dad-10733 712 35 ) ) PUNCT dad-10733 712 36 , , PUNCT dad-10733 712 37 and and CCONJ dad-10733 712 38 miscellaneous miscellaneous ADJ dad-10733 712 39 ( ( PUNCT dad-10733 712 40 25,970 25,970 NUM dad-10733 712 41 words word NOUN dad-10733 712 42 ) ) PUNCT dad-10733 712 43 . . PUNCT dad-10733 713 1 9 9 X dad-10733 713 2 . . X dad-10733 713 3 http://www.opensubtitles.org http://www.opensubtitles.org PROPN dad-10733 713 4 26 26 NUM dad-10733 714 1 http://www.opensubtitles.org http://www.opensubtitles.org PROPN dad-10733 714 2 a a DET dad-10733 714 3 survey survey NOUN dad-10733 714 4 of of ADP dad-10733 714 5 available available ADJ dad-10733 714 6 corpora corpora PROPN dad-10733 714 7 for for ADP dad-10733 714 8 building build VERB dad-10733 714 9 data data NOUN dad-10733 714 10 - - PUNCT dad-10733 714 11 driven drive VERB dad-10733 714 12 dialogue dialogue NOUN dad-10733 714 13 systems system NOUN dad-10733 714 14 n n PRON dad-10733 714 15 am be AUX dad-10733 714 16 e e NOUN dad-10733 714 17 to to PART dad-10733 714 18 pi pi VERB dad-10733 714 19 cs cs PROPN dad-10733 714 20 to to ADP dad-10733 714 21 ta ta X dad-10733 714 22 l l NOUN dad-10733 714 23 # # NOUN dad-10733 714 24 to to ADP dad-10733 714 25 ta ta ADP dad-10733 714 26 l l NOUN dad-10733 714 27 # # NOUN dad-10733 714 28 to to ADP dad-10733 714 29 ta ta ADP dad-10733 714 30 l l NOUN dad-10733 714 31 # # NOUN dad-10733 714 32 to to ADP dad-10733 714 33 ta ta AUX dad-10733 714 34 l l NOUN dad-10733 714 35 # # X dad-10733 714 36 d d PROPN dad-10733 714 37 es es PROPN dad-10733 714 38 cr cr PROPN dad-10733 714 39 ip ip PROPN dad-10733 714 40 tio tio PROPN dad-10733 714 41 n n PROPN dad-10733 714 42 of of ADP dad-10733 714 43 ut ut PROPN dad-10733 714 44 te te PROPN dad-10733 714 45 ra ra PROPN dad-10733 714 46 nc nc PROPN dad-10733 714 47 es es PROPN dad-10733 714 48 of of ADP dad-10733 714 49 di di PROPN dad-10733 714 50 al al PROPN dad-10733 714 51 og og PROPN dad-10733 714 52 ue ue PROPN dad-10733 714 53 s s PROPN dad-10733 714 54 of of ADP dad-10733 714 55 w w NOUN dad-10733 714 56 or or CCONJ dad-10733 714 57 ks ks PROPN dad-10733 714 58 of of ADP dad-10733 714 59 w w PROPN dad-10733 714 60 or or CCONJ dad-10733 714 61 ds ds PRON dad-10733 714 62 m m NOUN dad-10733 714 63 ov ov VERB dad-10733 714 64 ie ie ADV dad-10733 714 65 -d -d PRON dad-10733 714 66 ic ic INTJ dad-10733 714 67 m m PROPN dad-10733 714 68 ov ov INTJ dad-10733 714 69 ie ie X dad-10733 714 70 76 76 NUM dad-10733 714 71 4k 4k NUM dad-10733 714 72 13 13 NUM dad-10733 714 73 2k 2k NOUN dad-10733 714 74 75 75 NUM dad-10733 714 75 3 3 NUM dad-10733 714 76 6 6 NUM dad-10733 714 77 m m NOUN dad-10733 714 78 m m VERB dad-10733 714 79 ov ov INTJ dad-10733 714 80 ie ie X dad-10733 714 81 sc sc PROPN dad-10733 714 82 ri ri PROPN dad-10733 714 83 pt pt PROPN dad-10733 714 84 s s PROPN dad-10733 714 85 of of ADP dad-10733 714 86 a a DET dad-10733 714 87 m m NOUN dad-10733 714 88 er er INTJ dad-10733 714 89 ic ic X dad-10733 714 90 an an DET dad-10733 714 91 fil fil X dad-10733 714 92 m m PROPN dad-10733 714 93 s. s. PROPN dad-10733 714 94 ( ( PUNCT dad-10733 714 95 b b PROPN dad-10733 714 96 an an DET dad-10733 714 97 ch ch NOUN dad-10733 714 98 s s PROPN dad-10733 714 99 , , PUNCT dad-10733 714 100 20 20 NUM dad-10733 714 101 12 12 NUM dad-10733 714 102 ) ) PUNCT dad-10733 714 103 di di NOUN dad-10733 714 104 al al PROPN dad-10733 714 105 og og PROPN dad-10733 714 106 ue ue PROPN dad-10733 714 107 s s VERB dad-10733 714 108 m m VERB dad-10733 714 109 ov ov INTJ dad-10733 714 110 ie ie X dad-10733 714 111 -t -t X dad-10733 714 112 ri ri NOUN dad-10733 714 113 pl pl X dad-10733 714 114 es es X dad-10733 714 115 m m NOUN dad-10733 714 116 ov ov INTJ dad-10733 714 117 ie ie ADV dad-10733 714 118 73 73 NUM dad-10733 714 119 6k 6k NOUN dad-10733 714 120 24 24 NUM dad-10733 714 121 5k 5k NUM dad-10733 714 122 61 61 NUM dad-10733 714 123 4 4 NUM dad-10733 714 124 13 13 NUM dad-10733 714 125 m m VERB dad-10733 714 126 tr tr VERB dad-10733 714 127 ip ip NOUN dad-10733 714 128 le le X dad-10733 714 129 s s PROPN dad-10733 714 130 of of ADP dad-10733 714 131 ut ut PROPN dad-10733 714 132 te te PROPN dad-10733 714 133 ra ra PROPN dad-10733 714 134 nc nc PROPN dad-10733 714 135 es es PROPN dad-10733 714 136 w w PROPN dad-10733 714 137 hi hi PROPN dad-10733 714 138 ch ch PROPN dad-10733 714 139 ar ar PROPN dad-10733 714 140 e e PROPN dad-10733 714 141 fil fil X dad-10733 714 142 te te X dad-10733 714 143 re re PROPN dad-10733 714 144 d d X dad-10733 714 145 to to PART dad-10733 714 146 co co VERB dad-10733 714 147 m m PROPN dad-10733 714 148 e e NOUN dad-10733 714 149 ( ( PUNCT dad-10733 714 150 s s VERB dad-10733 714 151 er er INTJ dad-10733 714 152 ba ba PROPN dad-10733 714 153 n n ADV dad-10733 714 154 et et NOUN dad-10733 714 155 al al PROPN dad-10733 714 156 . . PUNCT dad-10733 714 157 , , PUNCT dad-10733 715 1 20 20 NUM dad-10733 715 2 16 16 NUM dad-10733 715 3 ) ) PUNCT dad-10733 715 4 di di NOUN dad-10733 715 5 al al PROPN dad-10733 715 6 og og PROPN dad-10733 716 1 ue ue PROPN dad-10733 716 2 s s VERB dad-10733 716 3 fr fr INTJ dad-10733 716 4 om om PROPN dad-10733 716 5 x x INTJ dad-10733 716 6 -y -y PUNCT dad-10733 716 7 -x -x PUNCT dad-10733 716 8 tr tr VERB dad-10733 716 9 ip ip NOUN dad-10733 716 10 le le ADP dad-10733 716 11 s. s. PROPN dad-10733 716 12 fi fi PROPN dad-10733 717 1 lm lm INTJ dad-10733 717 2 sc sc PROPN dad-10733 717 3 ri ri PROPN dad-10733 717 4 pt pt PROPN dad-10733 717 5 s s PART dad-10733 717 6 o o X dad-10733 717 7 nl nl NOUN dad-10733 717 8 in in ADP dad-10733 717 9 e e PROPN dad-10733 717 10 se se X dad-10733 717 11 ri ri PROPN dad-10733 717 12 es es VERB dad-10733 717 13 m m VERB dad-10733 717 14 ov ov INTJ dad-10733 717 15 ie ie ADJ dad-10733 717 16 1 1 NUM dad-10733 717 17 m m NOUN dad-10733 717 18 * * NUM dad-10733 717 19 26 26 NUM dad-10733 717 20 3k 3k X dad-10733 717 21 † † PROPN dad-10733 717 22 1 1 NUM dad-10733 717 23 , , PUNCT dad-10733 717 24 50 50 NUM dad-10733 717 25 0 0 NUM dad-10733 717 26 16 16 NUM dad-10733 717 27 m m NOUN dad-10733 717 28 * * PUNCT dad-10733 717 29 tw tw INTJ dad-10733 718 1 o o INTJ dad-10733 718 2 su su INTJ dad-10733 718 3 bs bs INTJ dad-10733 718 4 et et PROPN dad-10733 718 5 s s PROPN dad-10733 718 6 of of ADP dad-10733 718 7 sc sc PROPN dad-10733 718 8 ri ri PROPN dad-10733 718 9 pt pt PROPN dad-10733 718 10 s s PROPN dad-10733 718 11 sc sc PROPN dad-10733 718 12 ri ri PROPN dad-10733 718 13 pt pt X dad-10733 718 14 s s X dad-10733 718 15 ( ( PUNCT dad-10733 718 16 1 1 NUM dad-10733 718 17 00 00 NUM dad-10733 718 18 0 0 NUM dad-10733 719 1 a a DET dad-10733 719 2 m m NOUN dad-10733 719 3 er er INTJ dad-10733 719 4 ic ic X dad-10733 719 5 an an DET dad-10733 719 6 fil fil X dad-10733 719 7 m m PROPN dad-10733 719 8 s s NOUN dad-10733 719 9 an an DET dad-10733 719 10 d d PROPN dad-10733 719 11 50 50 NUM dad-10733 719 12 0 0 NUM dad-10733 719 13 m m VERB dad-10733 719 14 ix ix ADV dad-10733 719 15 ed ed NOUN dad-10733 719 16 ) ) PUNCT dad-10733 719 17 . . PUNCT dad-10733 720 1 ( ( PUNCT dad-10733 720 2 b b X dad-10733 720 3 ri ri PROPN dad-10733 720 4 tis tis PROPN dad-10733 720 5 h/ h/ VERB dad-10733 720 6 a a DET dad-10733 720 7 m m NOUN dad-10733 720 8 er er INTJ dad-10733 720 9 ic ic X dad-10733 720 10 an an DET dad-10733 720 11 fil fil X dad-10733 720 12 m m NOUN dad-10733 720 13 s s NOUN dad-10733 720 14 ) ) PUNCT dad-10733 720 15 . . PUNCT dad-10733 721 1 c c NOUN dad-10733 721 2 or or CCONJ dad-10733 721 3 ne ne PROPN dad-10733 721 4 ll ll AUX dad-10733 721 5 m m NOUN dad-10733 721 6 ov ov VERB dad-10733 721 7 ie ie X dad-10733 721 8 -d -d PRON dad-10733 721 9 ia ia PROPN dad-10733 721 10 lo lo PROPN dad-10733 721 11 gu gu NOUN dad-10733 721 12 e e PROPN dad-10733 721 13 c c PROPN dad-10733 721 14 or or CCONJ dad-10733 721 15 pu pu PROPN dad-10733 721 16 s s PART dad-10733 721 17 m m VERB dad-10733 721 18 ov ov INTJ dad-10733 721 19 ie ie ADJ dad-10733 721 20 30 30 NUM dad-10733 721 21 5k 5k NUM dad-10733 721 22 22 22 NUM dad-10733 721 23 0k 0k NOUN dad-10733 721 24 61 61 NUM dad-10733 721 25 7 7 NUM dad-10733 721 26 9 9 NUM dad-10733 721 27 m m NOUN dad-10733 721 28 * * NOUN dad-10733 722 1 sh sh INTJ dad-10733 722 2 or or CCONJ dad-10733 722 3 tc tc X dad-10733 722 4 on on ADP dad-10733 722 5 ve ve VERB dad-10733 722 6 rs rs NOUN dad-10733 722 7 at at ADP dad-10733 722 8 io io X dad-10733 723 1 ns ns INTJ dad-10733 723 2 fr fr PROPN dad-10733 723 3 om om PROPN dad-10733 723 4 fil fil PROPN dad-10733 723 5 m m PROPN dad-10733 723 6 sc sc PROPN dad-10733 723 7 ri ri PROPN dad-10733 723 8 pt pt PROPN dad-10733 723 9 s s PROPN dad-10733 723 10 , , PUNCT dad-10733 723 11 an an DET dad-10733 723 12 no no INTJ dad-10733 723 13 ta ta X dad-10733 723 14 te te PROPN dad-10733 723 15 d d X dad-10733 723 16 ( ( PUNCT dad-10733 723 17 d d X dad-10733 723 18 an an PRON dad-10733 723 19 es es X dad-10733 723 20 cu cu PROPN dad-10733 723 21 -n -n X dad-10733 723 22 ic ic PROPN dad-10733 723 23 ul ul INTJ dad-10733 723 24 es es X dad-10733 723 25 cu cu PROPN dad-10733 723 26 -m -m PROPN dad-10733 723 27 iz iz INTJ dad-10733 723 28 il il PROPN dad-10733 723 29 an an DET dad-10733 723 30 d d PROPN dad-10733 723 31 l l PROPN dad-10733 723 32 ee ee NOUN dad-10733 723 33 , , PUNCT dad-10733 723 34 2 2 NUM dad-10733 723 35 01 01 NUM dad-10733 723 36 1 1 NUM dad-10733 723 37 ) ) PUNCT dad-10733 723 38 di di NOUN dad-10733 723 39 al al PROPN dad-10733 723 40 og og PROPN dad-10733 724 1 ue ue PROPN dad-10733 725 1 s s PROPN dad-10733 726 1 w w PROPN dad-10733 726 2 ith ith PROPN dad-10733 726 3 ch ch PROPN dad-10733 726 4 ar ar PROPN dad-10733 726 5 ac ac PROPN dad-10733 726 6 te te PROPN dad-10733 726 7 rm rm PROPN dad-10733 726 8 et et PROPN dad-10733 726 9 ad ad NOUN dad-10733 726 10 at at ADP dad-10733 726 11 a. a. PROPN dad-10733 726 12 fi fi PROPN dad-10733 726 13 lte lte PROPN dad-10733 726 14 re re PROPN dad-10733 726 15 d d PROPN dad-10733 726 16 m m VERB dad-10733 726 17 ov ov VERB dad-10733 726 18 ie ie X dad-10733 726 19 sc sc PROPN dad-10733 726 20 ri ri PROPN dad-10733 726 21 pt pt PROPN dad-10733 726 22 c c PROPN dad-10733 726 23 or or CCONJ dad-10733 726 24 pu pu PROPN dad-10733 726 25 s s PART dad-10733 726 26 m m VERB dad-10733 726 27 ov ov INTJ dad-10733 726 28 ie ie X dad-10733 726 29 17 17 NUM dad-10733 726 30 3k 3k NUM dad-10733 726 31 87 87 NUM dad-10733 727 1 k k SYM dad-10733 727 2 1 1 NUM dad-10733 727 3 , , PUNCT dad-10733 727 4 78 78 NUM dad-10733 727 5 6 6 NUM dad-10733 727 6 2 2 NUM dad-10733 727 7 m m VERB dad-10733 727 8 * * PUNCT dad-10733 727 9 tr tr VERB dad-10733 727 10 ip ip X dad-10733 727 11 le le X dad-10733 727 12 s s PROPN dad-10733 727 13 of of ADP dad-10733 727 14 ut ut PROPN dad-10733 727 15 te te PROPN dad-10733 727 16 ra ra PROPN dad-10733 727 17 nc nc PROPN dad-10733 727 18 es es PROPN dad-10733 727 19 w w PROPN dad-10733 727 20 hi hi PROPN dad-10733 727 21 ch ch PROPN dad-10733 727 22 ar ar PROPN dad-10733 727 23 e e PROPN dad-10733 727 24 fil fil X dad-10733 727 25 te te X dad-10733 727 26 re re PROPN dad-10733 727 27 d d X dad-10733 727 28 to to PART dad-10733 727 29 co co VERB dad-10733 727 30 m m PROPN dad-10733 727 31 e e X dad-10733 727 32 ( ( PUNCT dad-10733 727 33 n n X dad-10733 727 34 io io X dad-10733 727 35 et et NOUN dad-10733 727 36 al al PROPN dad-10733 727 37 . . PUNCT dad-10733 727 38 , , PUNCT dad-10733 728 1 20 20 NUM dad-10733 728 2 14 14 NUM dad-10733 728 3 ) ) PUNCT dad-10733 728 4 di di NOUN dad-10733 728 5 al al PROPN dad-10733 728 6 og og PROPN dad-10733 729 1 ue ue PROPN dad-10733 729 2 s s VERB dad-10733 729 3 fr fr INTJ dad-10733 729 4 om om PROPN dad-10733 729 5 x x INTJ dad-10733 729 6 -y -y PUNCT dad-10733 729 7 -x -x PUNCT dad-10733 729 8 tr tr VERB dad-10733 729 9 ip ip NOUN dad-10733 729 10 le le X dad-10733 729 11 s. s. PROPN dad-10733 730 1 a a DET dad-10733 730 2 m m VERB dad-10733 730 3 er er INTJ dad-10733 730 4 ic ic PROPN dad-10733 731 1 an an PRON dad-10733 731 2 so so ADV dad-10733 731 3 ap ap PROPN dad-10733 732 1 o o INTJ dad-10733 732 2 pe pe INTJ dad-10733 733 1 ra ra PROPN dad-10733 733 2 t t PROPN dad-10733 733 3 v v INTJ dad-10733 733 4 sh sh INTJ dad-10733 733 5 ow ow INTJ dad-10733 733 6 10 10 NUM dad-10733 733 7 m m NOUN dad-10733 733 8 * * NOUN dad-10733 733 9 1 1 NUM dad-10733 733 10 . . NOUN dad-10733 733 11 2 2 NUM dad-10733 733 12 m m PROPN dad-10733 733 13 † † NOUN dad-10733 733 14 22 22 NUM dad-10733 733 15 , , PUNCT dad-10733 733 16 0 0 NUM dad-10733 733 17 00 00 NUM dad-10733 733 18 10 10 NUM dad-10733 733 19 0 0 NUM dad-10733 733 20 m m VERB dad-10733 733 21 tr tr VERB dad-10733 733 22 an an DET dad-10733 733 23 sc sc PROPN dad-10733 733 24 ri ri PROPN dad-10733 733 25 pt pt PROPN dad-10733 733 26 s s PROPN dad-10733 733 27 of of ADP dad-10733 733 28 a a DET dad-10733 733 29 m m NOUN dad-10733 733 30 er er INTJ dad-10733 733 31 ic ic PROPN dad-10733 734 1 an an DET dad-10733 734 2 so so ADV dad-10733 734 3 ap ap PROPN dad-10733 734 4 op op NOUN dad-10733 734 5 er er INTJ dad-10733 734 6 as as ADP dad-10733 734 7 . . PUNCT dad-10733 735 1 c c NOUN dad-10733 735 2 or or CCONJ dad-10733 735 3 pu pu PROPN dad-10733 735 4 s s PROPN dad-10733 736 1 ( ( PUNCT dad-10733 736 2 d d X dad-10733 736 3 av av PROPN dad-10733 736 4 ie ie PROPN dad-10733 736 5 s s PROPN dad-10733 736 6 , , PUNCT dad-10733 736 7 20 20 NUM dad-10733 736 8 12 12 NUM dad-10733 736 9 b b NOUN dad-10733 736 10 ) ) PUNCT dad-10733 736 11 sc sc PROPN dad-10733 736 12 ri ri PROPN dad-10733 736 13 pt pt PROPN dad-10733 736 14 s s PROPN dad-10733 736 15 t t NOUN dad-10733 736 16 v v NOUN dad-10733 736 17 d d PROPN dad-10733 736 18 c c PROPN dad-10733 736 19 or or CCONJ dad-10733 736 20 pu pu PROPN dad-10733 736 21 s s PROPN dad-10733 736 22 t t NOUN dad-10733 736 23 v v NOUN dad-10733 736 24 sh sh INTJ dad-10733 736 25 ow ow INTJ dad-10733 736 26 60 60 NUM dad-10733 736 27 k k NOUN dad-10733 736 28 * * PROPN dad-10733 736 29 10 10 NUM dad-10733 736 30 k k PROPN dad-10733 736 31 † † X dad-10733 736 32 19 19 NUM dad-10733 736 33 1 1 NUM dad-10733 736 34 60 60 NUM dad-10733 736 35 0k 0k NOUN dad-10733 736 36 * * PUNCT dad-10733 736 37 t t PROPN dad-10733 736 38 v v NUM dad-10733 736 39 sc sc PROPN dad-10733 736 40 ri ri PROPN dad-10733 736 41 pt pt PROPN dad-10733 736 42 s s VERB dad-10733 736 43 fr fr INTJ dad-10733 736 44 om om PROPN dad-10733 736 45 a a DET dad-10733 736 46 co co X dad-10733 736 47 m m PROPN dad-10733 736 48 ed ed PROPN dad-10733 736 49 y y PROPN dad-10733 736 50 ( ( PUNCT dad-10733 736 51 b b X dad-10733 736 52 ig ig PROPN dad-10733 736 53 b b PROPN dad-10733 736 54 an an DET dad-10733 736 55 g g NOUN dad-10733 736 56 t t X dad-10733 736 57 he he PRON dad-10733 736 58 or or CCONJ dad-10733 736 59 y y PROPN dad-10733 736 60 ) ) PUNCT dad-10733 736 61 an an DET dad-10733 736 62 d d NOUN dad-10733 736 63 ( ( PUNCT dad-10733 736 64 r r NOUN dad-10733 736 65 oy oy NOUN dad-10733 736 66 et et NOUN dad-10733 736 67 al al PROPN dad-10733 736 68 . . PUNCT dad-10733 736 69 , , PUNCT dad-10733 736 70 20 20 NUM dad-10733 736 71 14 14 NUM dad-10733 736 72 ) ) PUNCT dad-10733 736 73 sc sc PROPN dad-10733 736 74 ri ri PROPN dad-10733 736 75 pt pt PROPN dad-10733 736 76 s s PROPN dad-10733 736 77 dr dr PROPN dad-10733 736 78 am be AUX dad-10733 736 79 a a DET dad-10733 736 80 ( ( PUNCT dad-10733 736 81 g g PROPN dad-10733 736 82 am am NOUN dad-10733 736 83 e e NOUN dad-10733 736 84 of of ADP dad-10733 736 85 t t PROPN dad-10733 736 86 hr hr NOUN dad-10733 736 87 on on ADP dad-10733 736 88 es es X dad-10733 736 89 ) ) PUNCT dad-10733 736 90 s s PART dad-10733 736 91 ho ho PROPN dad-10733 736 92 w w PROPN dad-10733 736 93 . . PUNCT dad-10733 737 1 c c AUX dad-10733 738 1 ha ha INTJ dad-10733 738 2 ra ra INTJ dad-10733 739 1 ct ct INTJ dad-10733 739 2 er er INTJ dad-10733 739 3 st st PROPN dad-10733 740 1 yl yl PROPN dad-10733 740 2 e e PROPN dad-10733 740 3 fr fr INTJ dad-10733 740 4 om om PROPN dad-10733 740 5 fi fi NOUN dad-10733 740 6 lm lm INTJ dad-10733 740 7 m m VERB dad-10733 740 8 ov ov INTJ dad-10733 740 9 ie ie X dad-10733 740 10 66 66 NUM dad-10733 740 11 4k 4k NUM dad-10733 740 12 15 15 NUM dad-10733 740 13 1k 1k NUM dad-10733 740 14 86 86 NUM dad-10733 740 15 2 2 NUM dad-10733 740 16 9 9 NUM dad-10733 740 17 . . NOUN dad-10733 741 1 6 6 NUM dad-10733 741 2 m m PROPN dad-10733 741 3 sc sc PROPN dad-10733 741 4 ri ri PROPN dad-10733 741 5 pt pt PROPN dad-10733 741 6 s s VERB dad-10733 742 1 fr fr INTJ dad-10733 742 2 om om PROPN dad-10733 743 1 i i PRON dad-10733 743 2 m m VERB dad-10733 743 3 sd sd ADP dad-10733 743 4 b b PROPN dad-10733 743 5 , , PUNCT dad-10733 743 6 an an DET dad-10733 743 7 no no INTJ dad-10733 744 1 ta ta X dad-10733 744 2 te te PROPN dad-10733 745 1 d d NOUN dad-10733 745 2 fo fo INTJ dad-10733 745 3 rl rl PROPN dad-10733 745 4 in in ADP dad-10733 745 5 gu gu NOUN dad-10733 745 6 is be AUX dad-10733 745 7 tic tic ADJ dad-10733 745 8 c c NOUN dad-10733 745 9 or or CCONJ dad-10733 745 10 pu pu PROPN dad-10733 745 11 s s PROPN dad-10733 745 12 ( ( PUNCT dad-10733 745 13 w w PROPN dad-10733 745 14 al al PROPN dad-10733 745 15 ke ke PROPN dad-10733 745 16 re re PROPN dad-10733 745 17 ta ta PROPN dad-10733 745 18 l. l. PROPN dad-10733 745 19 , , PUNCT dad-10733 745 20 20 20 NUM dad-10733 745 21 12 12 NUM dad-10733 745 22 a a PRON dad-10733 745 23 ) ) PUNCT dad-10733 745 24 sc sc PROPN dad-10733 745 25 ri ri PROPN dad-10733 745 26 pt pt PROPN dad-10733 745 27 s s PROPN dad-10733 745 28 st st PROPN dad-10733 745 29 ru ru PROPN dad-10733 745 30 ct ct PROPN dad-10733 745 31 ur ur INTJ dad-10733 745 32 es es ADP dad-10733 745 33 an an DET dad-10733 745 34 d d PROPN dad-10733 745 35 ch ch PROPN dad-10733 745 36 ar ar PROPN dad-10733 745 37 ac ac PROPN dad-10733 745 38 te te PROPN dad-10733 745 39 ra ra PROPN dad-10733 746 1 rc rc PROPN dad-10733 746 2 he he PRON dad-10733 747 1 ty ty INTJ dad-10733 747 2 pe pe PROPN dad-10733 747 3 s. s. PROPN dad-10733 747 4 su su PROPN dad-10733 747 5 bt bt PROPN dad-10733 747 6 le le PROPN dad-10733 747 7 c c PROPN dad-10733 747 8 or or CCONJ dad-10733 747 9 pu pu PROPN dad-10733 747 10 s s PART dad-10733 747 11 m m VERB dad-10733 747 12 ov ov ADJ dad-10733 747 13 ie ie X dad-10733 747 14 6 6 NUM dad-10733 747 15 . . NOUN dad-10733 747 16 7 7 NUM dad-10733 747 17 m m NOUN dad-10733 747 18 3 3 NUM dad-10733 747 19 . . NOUN dad-10733 747 20 35 35 NUM dad-10733 747 21 m m NOUN dad-10733 747 22 6 6 NUM dad-10733 747 23 , , PUNCT dad-10733 747 24 18 18 NUM dad-10733 747 25 4 4 NUM dad-10733 747 26 20 20 NUM dad-10733 747 27 m m NOUN dad-10733 747 28 a a DET dad-10733 747 29 lig lig PROPN dad-10733 747 30 ne ne PROPN dad-10733 747 31 d d PROPN dad-10733 747 32 in in ADP dad-10733 747 33 te te ADP dad-10733 747 34 ra ra PROPN dad-10733 747 35 ct ct PROPN dad-10733 747 36 io io X dad-10733 747 37 nre nre PROPN dad-10733 747 38 sp sp PROPN dad-10733 747 39 on on ADP dad-10733 747 40 se se PROPN dad-10733 747 41 pa pa PROPN dad-10733 747 42 ir ir PROPN dad-10733 747 43 s s VERB dad-10733 747 44 fr fr INTJ dad-10733 747 45 om om PROPN dad-10733 747 46 ( ( PUNCT dad-10733 747 47 a a DET dad-10733 747 48 m m NOUN dad-10733 747 49 ei ei X dad-10733 747 50 xa xa PROPN dad-10733 748 1 an an PRON dad-10733 749 1 d d X dad-10733 749 2 c c NOUN dad-10733 750 1 oh oh INTJ dad-10733 750 2 eu eu PROPN dad-10733 750 3 r r NOUN dad-10733 750 4 , , PUNCT dad-10733 750 5 20 20 NUM dad-10733 750 6 13 13 NUM dad-10733 750 7 ) ) PUNCT dad-10733 750 8 su su PROPN dad-10733 751 1 bt bt PROPN dad-10733 751 2 itl itl PROPN dad-10733 751 3 es es PROPN dad-10733 751 4 m m PROPN dad-10733 751 5 ov ov INTJ dad-10733 751 6 ie ie X dad-10733 751 7 su su PROPN dad-10733 751 8 bt bt PROPN dad-10733 751 9 itl itl PROPN dad-10733 751 10 es es NOUN dad-10733 751 11 . . PUNCT dad-10733 752 1 o o INTJ dad-10733 752 2 pe pe INTJ dad-10733 753 1 ns ns INTJ dad-10733 753 2 ub ub PROPN dad-10733 753 3 tit tit NOUN dad-10733 753 4 le le X dad-10733 753 5 s s NOUN dad-10733 753 6 m m VERB dad-10733 753 7 ov ov INTJ dad-10733 753 8 ie ie ADV dad-10733 753 9 14 14 NUM dad-10733 753 10 0 0 NUM dad-10733 753 11 m m VERB dad-10733 753 12 * * NUM dad-10733 753 13 36 36 NUM dad-10733 753 14 m m NOUN dad-10733 753 15 † † NOUN dad-10733 753 16 20 20 NUM dad-10733 753 17 7 7 NUM dad-10733 753 18 , , PUNCT dad-10733 753 19 90 90 NUM dad-10733 753 20 7 7 NUM dad-10733 753 21 1b 1b NUM dad-10733 753 22 m m VERB dad-10733 753 23 ov ov PROPN dad-10733 753 24 ie ie PROPN dad-10733 753 25 su su PROPN dad-10733 753 26 bt bt PROPN dad-10733 753 27 itl itl PROPN dad-10733 753 28 es es PROPN dad-10733 753 29 w w PROPN dad-10733 753 30 hi hi PROPN dad-10733 753 31 ch ch PROPN dad-10733 753 32 ar ar PROPN dad-10733 753 33 e e PROPN dad-10733 753 34 no no ADV dad-10733 753 35 ts ts ADP dad-10733 753 36 pe pe PROPN dad-10733 753 37 ak ak PROPN dad-10733 754 1 er er INTJ dad-10733 754 2 -a -a PROPN dad-10733 754 3 lig lig PROPN dad-10733 754 4 ne ne PROPN dad-10733 754 5 d. d. PROPN dad-10733 754 6 ( ( PUNCT dad-10733 754 7 t t PROPN dad-10733 754 8 ie ie X dad-10733 754 9 de de X dad-10733 754 10 m m PROPN dad-10733 754 11 an an DET dad-10733 754 12 n n CCONJ dad-10733 754 13 , , PUNCT dad-10733 754 14 20 20 NUM dad-10733 754 15 12 12 NUM dad-10733 754 16 ) ) PUNCT dad-10733 754 17 su su PROPN dad-10733 755 1 bt bt PROPN dad-10733 755 2 itl itl PROPN dad-10733 755 3 es es PROPN dad-10733 755 4 c c PROPN dad-10733 755 5 e e X dad-10733 755 6 d d X dad-10733 755 7 ( ( PUNCT dad-10733 755 8 1 1 NUM dad-10733 755 9 56 56 NUM dad-10733 755 10 0 0 NUM dad-10733 755 11 – – PUNCT dad-10733 755 12 17 17 NUM dad-10733 755 13 60 60 NUM dad-10733 755 14 ) ) PUNCT dad-10733 755 15 c c NOUN dad-10733 755 16 or or CCONJ dad-10733 755 17 pu pu PROPN dad-10733 755 18 s s PROPN dad-10733 755 19 w w PROPN dad-10733 755 20 ri ri PROPN dad-10733 755 21 tte tte PROPN dad-10733 755 22 n n PROPN dad-10733 755 23 w w PROPN dad-10733 755 24 or or CCONJ dad-10733 755 25 ks ks PROPN dad-10733 755 26 – – PUNCT dad-10733 755 27 – – PUNCT dad-10733 755 28 17 17 NUM dad-10733 755 29 7 7 NUM dad-10733 755 30 1 1 NUM dad-10733 755 31 . . NOUN dad-10733 755 32 2 2 NUM dad-10733 755 33 m m NOUN dad-10733 755 34 v v NOUN dad-10733 755 35 ar ar PROPN dad-10733 755 36 io io PROPN dad-10733 755 37 us us PROPN dad-10733 755 38 sc sc PROPN dad-10733 755 39 ri ri PROPN dad-10733 755 40 pt pt PROPN dad-10733 755 41 ed ed PROPN dad-10733 755 42 fic fic PROPN dad-10733 755 43 tio tio NOUN dad-10733 755 44 na na ADP dad-10733 755 45 lw lw NOUN dad-10733 756 1 or or CCONJ dad-10733 756 2 ks ks INTJ dad-10733 756 3 fr fr INTJ dad-10733 756 4 om om PROPN dad-10733 757 1 ( ( PUNCT dad-10733 757 2 1 1 NUM dad-10733 757 3 56 56 NUM dad-10733 757 4 0 0 NUM dad-10733 757 5 – – PUNCT dad-10733 757 6 17 17 NUM dad-10733 757 7 60 60 NUM dad-10733 757 8 ) ) PUNCT dad-10733 757 9 ( ( PUNCT dad-10733 757 10 k k NOUN dad-10733 757 11 yt yt VERB dad-10733 757 12 ö ö VERB dad-10733 757 13 an an DET dad-10733 757 14 d d X dad-10733 757 15 w w PROPN dad-10733 757 16 al al PROPN dad-10733 757 17 ke ke PROPN dad-10733 757 18 r r PROPN dad-10733 757 19 , , PUNCT dad-10733 757 20 20 20 NUM dad-10733 757 21 06 06 NUM dad-10733 757 22 ) ) PUNCT dad-10733 757 23 & & CCONJ dad-10733 757 24 tr tr PROPN dad-10733 757 25 ia ia PROPN dad-10733 757 26 lp lp PROPN dad-10733 757 27 ro ro PROPN dad-10733 757 28 ce ce PROPN dad-10733 757 29 ed ed PROPN dad-10733 757 30 in in ADP dad-10733 757 31 gs gs PROPN dad-10733 757 32 as as ADP dad-10733 757 33 w w PROPN dad-10733 757 34 el el PROPN dad-10733 757 35 la la PROPN dad-10733 757 36 s s PROPN dad-10733 757 37 co co VERB dad-10733 757 38 ur ur INTJ dad-10733 757 39 tt tt PROPN dad-10733 757 40 ri ri PROPN dad-10733 757 41 al al PROPN dad-10733 757 42 pr pr INTJ dad-10733 757 43 oc oc VERB dad-10733 757 44 ee ee PROPN dad-10733 757 45 di di PROPN dad-10733 757 46 ng ng PROPN dad-10733 757 47 s. s. PROPN dad-10733 757 48 ta ta PROPN dad-10733 757 49 bl bl PROPN dad-10733 757 50 e e PROPN dad-10733 757 51 4 4 NUM dad-10733 757 52 : : PUNCT dad-10733 757 53 h h NOUN dad-10733 757 54 um um INTJ dad-10733 757 55 an an PRON dad-10733 757 56 -h -h PROPN dad-10733 757 57 um um INTJ dad-10733 757 58 an an DET dad-10733 757 59 sc sc PROPN dad-10733 757 60 ri ri PROPN dad-10733 757 61 pt pt PROPN dad-10733 757 62 ed ed PROPN dad-10733 757 63 di di PROPN dad-10733 757 64 al al PROPN dad-10733 757 65 og og PROPN dad-10733 757 66 ue ue PROPN dad-10733 758 1 da da PROPN dad-10733 758 2 ta ta X dad-10733 758 3 se se PROPN dad-10733 758 4 ts ts PROPN dad-10733 758 5 .q .q PROPN dad-10733 758 6 ua ua PROPN dad-10733 758 7 nt nt PROPN dad-10733 758 8 iti iti PROPN dad-10733 758 9 es es X dad-10733 758 10 de de PROPN dad-10733 758 11 no no INTJ dad-10733 758 12 te te PROPN dad-10733 758 13 d d X dad-10733 758 14 w w PROPN dad-10733 758 15 ith ith PROPN dad-10733 758 16 ( ( PUNCT dad-10733 758 17 † † PROPN dad-10733 758 18 ) ) PUNCT dad-10733 758 19 i i PRON dad-10733 758 20 nd nd INTJ dad-10733 758 21 ic ic X dad-10733 758 22 at at ADP dad-10733 758 23 e e PROPN dad-10733 758 24 es es ADP dad-10733 758 25 tim tim PROPN dad-10733 758 26 at at ADP dad-10733 758 27 es es PRON dad-10733 758 28 ba ba PROPN dad-10733 758 29 se se PROPN dad-10733 759 1 d d PROPN dad-10733 759 2 on on ADP dad-10733 759 3 av av PROPN dad-10733 759 4 er er INTJ dad-10733 759 5 ag ag PROPN dad-10733 759 6 e e PROPN dad-10733 759 7 nu nu AUX dad-10733 759 8 m m VERB dad-10733 759 9 be be VERB dad-10733 759 10 ro ro INTJ dad-10733 759 11 fd fd PROPN dad-10733 759 12 ia ia PROPN dad-10733 759 13 lo lo PROPN dad-10733 759 14 gu gu NOUN dad-10733 759 15 es es NOUN dad-10733 759 16 pe pe INTJ dad-10733 760 1 r r NOUN dad-10733 760 2 m m VERB dad-10733 760 3 ov ov INTJ dad-10733 760 4 ie ie X dad-10733 760 5 ( ( PUNCT dad-10733 760 6 b b PROPN dad-10733 760 7 an an DET dad-10733 760 8 ch ch NOUN dad-10733 760 9 s s PROPN dad-10733 760 10 , , PUNCT dad-10733 760 11 20 20 NUM dad-10733 760 12 12 12 NUM dad-10733 760 13 ) ) PUNCT dad-10733 760 14 a a DET dad-10733 760 15 nd nd ADV dad-10733 760 16 th th X dad-10733 760 17 e e X dad-10733 760 18 nu nu INTJ dad-10733 760 19 m m VERB dad-10733 760 20 be be VERB dad-10733 760 21 ro ro NOUN dad-10733 760 22 fs fs ADP dad-10733 760 23 cr cr PROPN dad-10733 760 24 ip ip VERB dad-10733 760 25 ts ts ADP dad-10733 760 26 or or CCONJ dad-10733 760 27 w w NOUN dad-10733 760 28 or or CCONJ dad-10733 760 29 ks ks PROPN dad-10733 760 30 in in ADP dad-10733 760 31 th th NUM dad-10733 760 32 e e X dad-10733 760 33 co co X dad-10733 760 34 rp rp VERB dad-10733 760 35 us us PROPN dad-10733 761 1 .d .d PROPN dad-10733 761 2 ia ia PROPN dad-10733 762 1 lo lo PROPN dad-10733 762 2 gu gu NOUN dad-10733 762 3 es es NOUN dad-10733 762 4 m m PROPN dad-10733 762 5 ay ay NOUN dad-10733 763 1 no no INTJ dad-10733 763 2 tb tb ADP dad-10733 763 3 e e X dad-10733 763 4 ex ex X dad-10733 763 5 pl pl PROPN dad-10733 763 6 ic ic PROPN dad-10733 763 7 itl itl PROPN dad-10733 763 8 y y PROPN dad-10733 763 9 se se PROPN dad-10733 763 10 pa pa PROPN dad-10733 763 11 ra ra PROPN dad-10733 764 1 te te PROPN dad-10733 764 2 d d X dad-10733 764 3 in in ADP dad-10733 764 4 th th NUM dad-10733 764 5 es es X dad-10733 764 6 e e X dad-10733 764 7 da da NOUN dad-10733 764 8 ta ta PROPN dad-10733 764 9 se se PROPN dad-10733 764 10 ts ts PROPN dad-10733 764 11 . . PUNCT dad-10733 765 1 t t PROPN dad-10733 765 2 v v NOUN dad-10733 765 3 sh sh INTJ dad-10733 765 4 ow ow INTJ dad-10733 765 5 da da INTJ dad-10733 765 6 ta ta PROPN dad-10733 765 7 se se PROPN dad-10733 765 8 ts ts PROPN dad-10733 766 1 w w PROPN dad-10733 766 2 er er INTJ dad-10733 766 3 e e X dad-10733 766 4 ad ad PROPN dad-10733 766 5 ju ju PROPN dad-10733 766 6 st st PROPN dad-10733 767 1 ed ed PROPN dad-10733 767 2 ba ba PROPN dad-10733 767 3 se se PROPN dad-10733 768 1 d d PROPN dad-10733 768 2 on on ADP dad-10733 768 3 th th X dad-10733 768 4 e e NOUN dad-10733 768 5 ra ra PROPN dad-10733 768 6 tio tio NOUN dad-10733 768 7 of of ADP dad-10733 768 8 av av PROPN dad-10733 768 9 er er INTJ dad-10733 768 10 ag ag PROPN dad-10733 768 11 e e PROPN dad-10733 768 12 fil fil X dad-10733 768 13 m m PROPN dad-10733 768 14 ru ru PROPN dad-10733 768 15 nt not PART dad-10733 768 16 i i PRON dad-10733 768 17 m m VERB dad-10733 768 18 e e NOUN dad-10733 768 19 ( ( PUNCT dad-10733 768 20 1 1 NUM dad-10733 768 21 12 12 NUM dad-10733 768 22 m m NOUN dad-10733 768 23 in in ADP dad-10733 768 24 ut ut PROPN dad-10733 768 25 es es PROPN dad-10733 768 26 ) ) PUNCT dad-10733 768 27 t t NOUN dad-10733 769 1 o o NOUN dad-10733 769 2 av av PROPN dad-10733 769 3 er er INTJ dad-10733 769 4 ag ag PROPN dad-10733 769 5 e e PROPN dad-10733 769 6 t t PROPN dad-10733 769 7 v v INTJ dad-10733 769 8 sh sh INTJ dad-10733 769 9 ow ow INTJ dad-10733 769 10 ru ru PROPN dad-10733 769 11 nt not PART dad-10733 769 12 i i PRON dad-10733 769 13 m m VERB dad-10733 769 14 e e NOUN dad-10733 769 15 ( ( PUNCT dad-10733 769 16 3 3 NUM dad-10733 769 17 6 6 NUM dad-10733 769 18 m m NOUN dad-10733 769 19 in in ADP dad-10733 769 20 ut ut PROPN dad-10733 769 21 es es PROPN dad-10733 769 22 ) ) PUNCT dad-10733 769 23 . . PUNCT dad-10733 770 1 t t PROPN dad-10733 771 1 hi hi INTJ dad-10733 771 2 s s X dad-10733 771 3 da da NOUN dad-10733 771 4 ta ta X dad-10733 771 5 w w PROPN dad-10733 772 1 as as ADP dad-10733 772 2 sc sc PROPN dad-10733 772 3 ra ra NOUN dad-10733 773 1 pe pe INTJ dad-10733 774 1 d d NOUN dad-10733 774 2 fr fr INTJ dad-10733 775 1 om om X dad-10733 775 2 th th X dad-10733 775 3 e e X dad-10733 776 1 i i NOUN dad-10733 776 2 m m PROPN dad-10733 776 3 b b PROPN dad-10733 776 4 d d X dad-10733 776 5 da da X dad-10733 776 6 ta ta X dad-10733 776 7 ba ba PROPN dad-10733 776 8 se se PROPN dad-10733 776 9 ( ( PUNCT dad-10733 776 10 h h NOUN dad-10733 776 11 t t PROPN dad-10733 776 12 t t PROPN dad-10733 777 1 p p X dad-10733 777 2 : : PUNCT dad-10733 777 3 / / SYM dad-10733 777 4 / / SYM dad-10733 777 5 w w PROPN dad-10733 777 6 w w PROPN dad-10733 777 7 w w PROPN dad-10733 777 8 . . PUNCT dad-10733 778 1 i i PRON dad-10733 778 2 m m VERB dad-10733 778 3 d d NOUN dad-10733 778 4 b b PROPN dad-10733 778 5 . . PUNCT dad-10733 779 1 c c NOUN dad-10733 780 1 o o NOUN dad-10733 780 2 m m VERB dad-10733 780 3 / / SYM dad-10733 781 1 i i PRON dad-10733 781 2 n n VERB dad-10733 781 3 t t X dad-10733 781 4 e e X dad-10733 781 5 r r NOUN dad-10733 781 6 f f PROPN dad-10733 782 1 a a DET dad-10733 782 2 c c NOUN dad-10733 782 3 e e NOUN dad-10733 782 4 s s PROPN dad-10733 782 5 ) ) PUNCT dad-10733 782 6 . . PUNCT dad-10733 783 1 ( ( PUNCT dad-10733 783 2 s s X dad-10733 783 3 ta ta X dad-10733 783 4 rr rr PROPN dad-10733 783 5 ed ed PROPN dad-10733 783 6 ( ( PUNCT dad-10733 783 7 * * PUNCT dad-10733 783 8 ) ) PUNCT dad-10733 783 9 q q PROPN dad-10733 784 1 ua ua PROPN dad-10733 784 2 nt nt PROPN dad-10733 784 3 iti iti PROPN dad-10733 784 4 es es PROPN dad-10733 784 5 ar ar PROPN dad-10733 784 6 e e PROPN dad-10733 784 7 es es ADP dad-10733 784 8 tim tim PROPN dad-10733 784 9 at at ADP dad-10733 784 10 ed ed PROPN dad-10733 784 11 ba ba PROPN dad-10733 784 12 se se PROPN dad-10733 785 1 d d PROPN dad-10733 785 2 on on ADP dad-10733 785 3 th th ADP dad-10733 785 4 e e X dad-10733 785 5 av av PROPN dad-10733 785 6 er er INTJ dad-10733 785 7 ag ag PROPN dad-10733 785 8 e e PROPN dad-10733 785 9 nu nu PROPN dad-10733 785 10 m m AUX dad-10733 785 11 be be VERB dad-10733 785 12 r r NOUN dad-10733 785 13 of of ADP dad-10733 785 14 w w NOUN dad-10733 785 15 or or CCONJ dad-10733 785 16 ds ds ADJ dad-10733 786 1 an an DET dad-10733 786 2 d d X dad-10733 786 3 ut ut PROPN dad-10733 786 4 te te PROPN dad-10733 786 5 ra ra PROPN dad-10733 786 6 nc nc PROPN dad-10733 786 7 es es PROPN dad-10733 786 8 pe pe PROPN dad-10733 786 9 r r PROPN dad-10733 786 10 fil fil X dad-10733 786 11 m m PROPN dad-10733 786 12 , , PUNCT dad-10733 786 13 a a DET dad-10733 786 14 nd nd ADV dad-10733 786 15 th th X dad-10733 786 16 e e X dad-10733 786 17 av av PROPN dad-10733 786 18 er er INTJ dad-10733 786 19 ag ag PROPN dad-10733 786 20 e e PROPN dad-10733 786 21 le le X dad-10733 786 22 ng ng PROPN dad-10733 786 23 th th X dad-10733 786 24 s s X dad-10733 786 25 of of ADP dad-10733 786 26 fil fil X dad-10733 786 27 m m PROPN dad-10733 786 28 s s PROPN dad-10733 786 29 an an PRON dad-10733 786 30 d d X dad-10733 786 31 t t NOUN dad-10733 786 32 v v NOUN dad-10733 787 1 sh sh INTJ dad-10733 787 2 ow ow INTJ dad-10733 787 3 s. s. PROPN dad-10733 787 4 e e PROPN dad-10733 787 5 st st PROPN dad-10733 788 1 i i PRON dad-10733 788 2 m m VERB dad-10733 788 3 at at ADP dad-10733 788 4 es es X dad-10733 788 5 de de PROPN dad-10733 788 6 riv riv PROPN dad-10733 789 1 ed ed NOUN dad-10733 790 1 fr fr INTJ dad-10733 790 2 om om PROPN dad-10733 790 3 th th X dad-10733 790 4 e e X dad-10733 790 5 ta ta ADP dad-10733 790 6 m m INTJ dad-10733 790 7 er er INTJ dad-10733 790 8 i i PRON dad-10733 790 9 g g PROPN dad-10733 790 10 ui ui PROPN dad-10733 790 11 de de PROPN dad-10733 790 12 fo fo ADP dad-10733 790 13 rw rw NOUN dad-10733 790 14 ri ri PROPN dad-10733 790 15 te te INTJ dad-10733 790 16 rs rs INTJ dad-10733 790 17 ( ( PUNCT dad-10733 790 18 h h NOUN dad-10733 790 19 t t PROPN dad-10733 790 20 t t PROPN dad-10733 791 1 p p X dad-10733 791 2 : : PUNCT dad-10733 791 3 / / SYM dad-10733 791 4 / / SYM dad-10733 791 5 w w PROPN dad-10733 791 6 w w PROPN dad-10733 791 7 w w PROPN dad-10733 791 8 . . PUNCT dad-10733 791 9 t t PROPN dad-10733 791 10 a a DET dad-10733 791 11 m m NOUN dad-10733 791 12 e e NOUN dad-10733 791 13 r r NOUN dad-10733 791 14 i i PRON dad-10733 791 15 . . PUNCT dad-10733 792 1 c c NOUN dad-10733 793 1 o o NOUN dad-10733 793 2 m m VERB dad-10733 793 3 / / SYM dad-10733 793 4 f f NOUN dad-10733 794 1 o o NOUN dad-10733 794 2 r r NOUN dad-10733 794 3 m m VERB dad-10733 794 4 a a DET dad-10733 794 5 t t NOUN dad-10733 794 6 / / SYM dad-10733 794 7 w w NOUN dad-10733 794 8 o o NOUN dad-10733 794 9 r r NOUN dad-10733 795 1 d d NOUN dad-10733 795 2 c c NOUN dad-10733 795 3 o o NOUN dad-10733 795 4 u u NOUN dad-10733 795 5 n n ADP dad-10733 795 6 t t NOUN dad-10733 795 7 s s PART dad-10733 795 8 . . PUNCT dad-10733 796 1 h h PROPN dad-10733 796 2 t t NOUN dad-10733 796 3 m m NOUN dad-10733 796 4 l l NOUN dad-10733 796 5 ) ) PUNCT dad-10733 796 6 . . PUNCT dad-10733 797 1 27 27 NUM dad-10733 797 2 http://www.imdb.com/interfaces http://www.imdb.com/interface NOUN dad-10733 797 3 http://www.tameri.com/format/wordcounts.html http://www.tameri.com/format/wordcounts.html PRON dad-10733 797 4 serban serban PROPN dad-10733 797 5 , , PUNCT dad-10733 797 6 lowe lowe PROPN dad-10733 797 7 , , PUNCT dad-10733 797 8 henderson henderson PROPN dad-10733 797 9 , , PUNCT dad-10733 797 10 charlin charlin PROPN dad-10733 797 11 and and CCONJ dad-10733 797 12 pineau pineau PROPN dad-10733 797 13 4.3 4.3 NUM dad-10733 797 14 human human NOUN dad-10733 797 15 - - PUNCT dad-10733 797 16 human human NOUN dad-10733 797 17 written written NOUN dad-10733 797 18 corpora corpora NOUN dad-10733 797 19 we we PRON dad-10733 797 20 proceed proceed VERB dad-10733 797 21 to to PART dad-10733 797 22 survey survey VERB dad-10733 797 23 corpora corpora PROPN dad-10733 797 24 of of ADP dad-10733 797 25 conversations conversation NOUN dad-10733 797 26 between between ADP dad-10733 797 27 humans human NOUN dad-10733 797 28 in in ADP dad-10733 797 29 written write VERB dad-10733 797 30 form form NOUN dad-10733 797 31 . . PUNCT dad-10733 798 1 as as ADP dad-10733 798 2 before before ADV dad-10733 798 3 , , PUNCT dad-10733 798 4 we we PRON dad-10733 798 5 sub sub VERB dad-10733 798 6 - - NOUN dad-10733 798 7 divide divide VERB dad-10733 798 8 this this DET dad-10733 798 9 section section NOUN dad-10733 798 10 into into ADP dad-10733 798 11 spontaneous spontaneous ADJ dad-10733 798 12 and and CCONJ dad-10733 798 13 constrained constrained ADJ dad-10733 798 14 corpora corpus NOUN dad-10733 798 15 , , PUNCT dad-10733 798 16 depending depend VERB dad-10733 798 17 on on ADP dad-10733 798 18 whether whether SCONJ dad-10733 798 19 there there PRON dad-10733 798 20 are be VERB dad-10733 798 21 restrictions restriction NOUN dad-10733 798 22 on on ADP dad-10733 798 23 the the DET dad-10733 798 24 topic topic NOUN dad-10733 798 25 of of ADP dad-10733 798 26 conversation conversation NOUN dad-10733 798 27 . . PUNCT dad-10733 799 1 however however ADV dad-10733 799 2 , , PUNCT dad-10733 799 3 we we PRON dad-10733 799 4 make make VERB dad-10733 799 5 a a DET dad-10733 799 6 further further ADJ dad-10733 799 7 distinction distinction NOUN dad-10733 799 8 between between ADP dad-10733 799 9 forum forum PROPN dad-10733 799 10 , , PUNCT dad-10733 799 11 micro micro NOUN dad-10733 799 12 - - NOUN dad-10733 799 13 blogging blogging ADJ dad-10733 799 14 , , PUNCT dad-10733 799 15 and and CCONJ dad-10733 799 16 chat chat VERB dad-10733 799 17 corpora corpora PROPN dad-10733 799 18 . . PUNCT dad-10733 800 1 forum forum PROPN dad-10733 800 2 corpora corpora VERB dad-10733 800 3 consist consist NOUN dad-10733 800 4 of of ADP dad-10733 800 5 conversations conversation NOUN dad-10733 800 6 on on ADP dad-10733 800 7 forum forum NOUN dad-10733 800 8 - - PUNCT dad-10733 800 9 based base VERB dad-10733 800 10 websites website NOUN dad-10733 800 11 such such ADJ dad-10733 800 12 as as ADP dad-10733 800 13 reddit10 reddit10 NOUN dad-10733 800 14 where where SCONJ dad-10733 800 15 users user NOUN dad-10733 800 16 can can AUX dad-10733 800 17 make make VERB dad-10733 800 18 posts post NOUN dad-10733 800 19 , , PUNCT dad-10733 800 20 and and CCONJ dad-10733 800 21 other other ADJ dad-10733 800 22 users user NOUN dad-10733 800 23 can can AUX dad-10733 800 24 make make VERB dad-10733 800 25 comments comment NOUN dad-10733 800 26 or or CCONJ dad-10733 800 27 replies reply NOUN dad-10733 800 28 to to PART dad-10733 800 29 said say VERB dad-10733 800 30 post post NOUN dad-10733 800 31 . . PUNCT dad-10733 801 1 in in ADP dad-10733 801 2 some some DET dad-10733 801 3 cases case NOUN dad-10733 801 4 , , PUNCT dad-10733 801 5 comments comment NOUN dad-10733 801 6 can can AUX dad-10733 801 7 be be AUX dad-10733 801 8 nested nest VERB dad-10733 801 9 indefinitely indefinitely ADV dad-10733 801 10 , , PUNCT dad-10733 801 11 as as SCONJ dad-10733 801 12 users user NOUN dad-10733 801 13 make make VERB dad-10733 801 14 replies reply NOUN dad-10733 801 15 to to ADP dad-10733 801 16 previous previous ADJ dad-10733 801 17 replies reply NOUN dad-10733 801 18 . . PUNCT dad-10733 802 1 utterances utterance NOUN dad-10733 802 2 in in ADP dad-10733 802 3 forum forum NOUN dad-10733 802 4 corpora corpora PROPN dad-10733 802 5 tend tend VERB dad-10733 802 6 to to PART dad-10733 802 7 be be AUX dad-10733 802 8 longer long ADJ dad-10733 802 9 , , PUNCT dad-10733 802 10 and and CCONJ dad-10733 802 11 there there PRON dad-10733 802 12 is be VERB dad-10733 802 13 no no DET dad-10733 802 14 restriction restriction NOUN dad-10733 802 15 on on ADP dad-10733 802 16 the the DET dad-10733 802 17 number number NOUN dad-10733 802 18 of of ADP dad-10733 802 19 participants participant NOUN dad-10733 802 20 in in ADP dad-10733 802 21 a a DET dad-10733 802 22 discussion discussion NOUN dad-10733 802 23 . . PUNCT dad-10733 803 1 on on ADP dad-10733 803 2 the the DET dad-10733 803 3 other other ADJ dad-10733 803 4 hand hand NOUN dad-10733 803 5 , , PUNCT dad-10733 803 6 conversations conversation NOUN dad-10733 803 7 on on ADP dad-10733 803 8 micro micro ADJ dad-10733 803 9 - - ADJ dad-10733 803 10 blogging blogging ADJ dad-10733 803 11 websites website NOUN dad-10733 803 12 such such ADJ dad-10733 803 13 as as ADP dad-10733 803 14 twitter11 twitter11 NOUN dad-10733 803 15 tend tend VERB dad-10733 803 16 to to PART dad-10733 803 17 have have VERB dad-10733 803 18 very very ADV dad-10733 803 19 short short ADJ dad-10733 803 20 utterances utterance NOUN dad-10733 803 21 as as SCONJ dad-10733 803 22 there there PRON dad-10733 803 23 is be VERB dad-10733 803 24 an an DET dad-10733 803 25 upper upper ADJ dad-10733 803 26 bound bind VERB dad-10733 803 27 on on ADP dad-10733 803 28 the the DET dad-10733 803 29 number number NOUN dad-10733 803 30 of of ADP dad-10733 803 31 characters character NOUN dad-10733 803 32 permitted permit VERB dad-10733 803 33 in in ADP dad-10733 803 34 each each DET dad-10733 803 35 message message NOUN dad-10733 803 36 . . PUNCT dad-10733 804 1 as as ADP dad-10733 804 2 a a DET dad-10733 804 3 result result NOUN dad-10733 804 4 , , PUNCT dad-10733 804 5 these these PRON dad-10733 804 6 tend tend VERB dad-10733 804 7 to to PART dad-10733 804 8 exhibit exhibit VERB dad-10733 804 9 highly highly ADV dad-10733 804 10 colloquial colloquial ADJ dad-10733 804 11 language language NOUN dad-10733 804 12 with with ADP dad-10733 804 13 many many ADJ dad-10733 804 14 abbreviations abbreviation NOUN dad-10733 804 15 . . PUNCT dad-10733 805 1 the the DET dad-10733 805 2 identifying identify VERB dad-10733 805 3 feature feature NOUN dad-10733 805 4 of of ADP dad-10733 805 5 chat chat NOUN dad-10733 805 6 corpora corpora PROPN dad-10733 805 7 is be AUX dad-10733 805 8 that that SCONJ dad-10733 805 9 the the DET dad-10733 805 10 conversations conversation NOUN dad-10733 805 11 take take VERB dad-10733 805 12 place place NOUN dad-10733 805 13 in in ADP dad-10733 805 14 real real ADJ dad-10733 805 15 - - PUNCT dad-10733 805 16 time time NOUN dad-10733 805 17 between between ADP dad-10733 805 18 users user NOUN dad-10733 805 19 . . PUNCT dad-10733 806 1 thus thus ADV dad-10733 806 2 , , PUNCT dad-10733 806 3 these these DET dad-10733 806 4 conversations conversation NOUN dad-10733 806 5 share share VERB dad-10733 806 6 more more ADJ dad-10733 806 7 similarities similarity NOUN dad-10733 806 8 with with ADP dad-10733 806 9 spoken spoken ADJ dad-10733 806 10 dialogue dialogue NOUN dad-10733 806 11 between between ADP dad-10733 806 12 humans human NOUN dad-10733 806 13 , , PUNCT dad-10733 806 14 such such ADJ dad-10733 806 15 as as ADP dad-10733 806 16 common common ADJ dad-10733 806 17 grounding grounding NOUN dad-10733 806 18 phenomena phenomenon NOUN dad-10733 806 19 . . PUNCT dad-10733 807 1 4.3.1 4.3.1 PRON dad-10733 807 2 spontaneous spontaneous ADJ dad-10733 807 3 written written NOUN dad-10733 807 4 corpora corpora NOUN dad-10733 807 5 we we PRON dad-10733 807 6 begin begin VERB dad-10733 807 7 with with ADP dad-10733 807 8 written write VERB dad-10733 807 9 corpora corpora NOUN dad-10733 807 10 where where SCONJ dad-10733 807 11 the the DET dad-10733 807 12 topic topic NOUN dad-10733 807 13 of of ADP dad-10733 807 14 conversation conversation NOUN dad-10733 807 15 is be AUX dad-10733 807 16 not not PART dad-10733 807 17 pre pre ADJ dad-10733 807 18 - - VERB dad-10733 807 19 specified specified ADJ dad-10733 807 20 . . PUNCT dad-10733 808 1 such such ADJ dad-10733 808 2 is be AUX dad-10733 808 3 the the DET dad-10733 808 4 case case NOUN dad-10733 808 5 for for ADP dad-10733 808 6 the the DET dad-10733 808 7 nps nps PROPN dad-10733 808 8 internet internet NOUN dad-10733 808 9 chatroom chatroom NOUN dad-10733 808 10 conversations conversation NOUN dad-10733 808 11 corpus corpus NOUN dad-10733 808 12 ( ( PUNCT dad-10733 808 13 forsyth forsyth NOUN dad-10733 808 14 and and CCONJ dad-10733 808 15 martell martell PROPN dad-10733 808 16 , , PUNCT dad-10733 808 17 2007 2007 NUM dad-10733 808 18 ) ) PUNCT dad-10733 808 19 , , PUNCT dad-10733 808 20 which which PRON dad-10733 808 21 consists consist VERB dad-10733 808 22 of of ADP dad-10733 808 23 10,567 10,567 NUM dad-10733 808 24 english english ADJ dad-10733 808 25 utterances utterance NOUN dad-10733 808 26 gathered gather VERB dad-10733 808 27 from from ADP dad-10733 808 28 age age NOUN dad-10733 808 29 - - PUNCT dad-10733 808 30 specific specific ADJ dad-10733 808 31 chat chat NOUN dad-10733 808 32 rooms room NOUN dad-10733 808 33 of of ADP dad-10733 808 34 various various ADJ dad-10733 808 35 online online ADJ dad-10733 808 36 chat chat NOUN dad-10733 808 37 services service NOUN dad-10733 808 38 from from ADP dad-10733 808 39 october october PROPN dad-10733 808 40 and and CCONJ dad-10733 808 41 november november PROPN dad-10733 808 42 of of ADP dad-10733 808 43 2006 2006 NUM dad-10733 808 44 . . PUNCT dad-10733 809 1 each each DET dad-10733 809 2 utterance utterance NOUN dad-10733 809 3 is be AUX dad-10733 809 4 annotated annotate VERB dad-10733 809 5 with with ADP dad-10733 809 6 part part NOUN dad-10733 809 7 - - PUNCT dad-10733 809 8 of of ADP dad-10733 809 9 - - PUNCT dad-10733 809 10 speech speech NOUN dad-10733 809 11 and and CCONJ dad-10733 809 12 dialogue dialogue NOUN dad-10733 809 13 act act PROPN dad-10733 809 14 information information NOUN dad-10733 809 15 ; ; PUNCT dad-10733 809 16 the the DET dad-10733 809 17 correctness correctness NOUN dad-10733 809 18 of of ADP dad-10733 809 19 these these DET dad-10733 809 20 labels label NOUN dad-10733 809 21 was be AUX dad-10733 809 22 verified verify VERB dad-10733 809 23 manually manually ADV dad-10733 809 24 . . PUNCT dad-10733 810 1 the the DET dad-10733 810 2 nps nps PROPN dad-10733 810 3 internet internet NOUN dad-10733 810 4 chatroom chatroom NOUN dad-10733 810 5 conversations conversation NOUN dad-10733 810 6 corpus corpus NOUN dad-10733 810 7 was be AUX dad-10733 810 8 one one NUM dad-10733 810 9 of of ADP dad-10733 810 10 the the DET dad-10733 810 11 first first ADJ dad-10733 810 12 corpora corpora NOUN dad-10733 810 13 of of ADP dad-10733 810 14 computer computer NOUN dad-10733 810 15 - - PUNCT dad-10733 810 16 mediated mediate VERB dad-10733 810 17 communication communication NOUN dad-10733 810 18 ( ( PUNCT dad-10733 810 19 cmc cmc NOUN dad-10733 810 20 ) ) PUNCT dad-10733 810 21 , , PUNCT dad-10733 810 22 and and CCONJ dad-10733 810 23 it it PRON dad-10733 810 24 was be AUX dad-10733 810 25 intended intend VERB dad-10733 810 26 for for ADP dad-10733 810 27 various various ADJ dad-10733 810 28 nlp nlp NOUN dad-10733 810 29 applications application NOUN dad-10733 810 30 such such ADJ dad-10733 810 31 as as ADP dad-10733 810 32 conversation conversation ADJ dad-10733 810 33 thread thread NOUN dad-10733 810 34 topic topic NOUN dad-10733 810 35 detection detection NOUN dad-10733 810 36 , , PUNCT dad-10733 810 37 author author NOUN dad-10733 810 38 profiling profiling NOUN dad-10733 810 39 , , PUNCT dad-10733 810 40 entity entity NOUN dad-10733 810 41 identification identification NOUN dad-10733 810 42 , , PUNCT dad-10733 810 43 and and CCONJ dad-10733 810 44 social social ADJ dad-10733 810 45 network network NOUN dad-10733 810 46 analysis analysis NOUN dad-10733 810 47 . . PUNCT dad-10733 811 1 several several ADJ dad-10733 811 2 corpora corpora PROPN dad-10733 811 3 of of ADP dad-10733 811 4 spontaneous spontaneous ADJ dad-10733 811 5 micro micro ADJ dad-10733 811 6 - - ADJ dad-10733 811 7 blogging blogging ADJ dad-10733 811 8 conversations conversation NOUN dad-10733 811 9 have have AUX dad-10733 811 10 been be AUX dad-10733 811 11 collected collect VERB dad-10733 811 12 , , PUNCT dad-10733 811 13 such such ADJ dad-10733 811 14 as as ADP dad-10733 811 15 the the DET dad-10733 811 16 twitter twitter NOUN dad-10733 811 17 corpus corpus NOUN dad-10733 811 18 from from ADP dad-10733 811 19 ritter ritter PROPN dad-10733 811 20 et et PROPN dad-10733 811 21 al al PROPN dad-10733 811 22 . . PROPN dad-10733 812 1 ( ( PUNCT dad-10733 812 2 2010 2010 NUM dad-10733 812 3 ) ) PUNCT dad-10733 812 4 , , PUNCT dad-10733 812 5 which which PRON dad-10733 812 6 contains contain VERB dad-10733 812 7 1.3 1.3 NUM dad-10733 812 8 million million NUM dad-10733 812 9 post post ADJ dad-10733 812 10 - - ADJ dad-10733 812 11 reply reply ADJ dad-10733 812 12 pairs pair NOUN dad-10733 812 13 extracted extract VERB dad-10733 812 14 from from ADP dad-10733 812 15 twitter twitter NOUN dad-10733 812 16 . . PUNCT dad-10733 813 1 the the DET dad-10733 813 2 corpus corpus NOUN dad-10733 813 3 was be AUX dad-10733 813 4 originally originally ADV dad-10733 813 5 constructed construct VERB dad-10733 813 6 to to PART dad-10733 813 7 aid aid VERB dad-10733 813 8 in in ADP dad-10733 813 9 the the DET dad-10733 813 10 production production NOUN dad-10733 813 11 of of ADP dad-10733 813 12 unsupervised unsupervised ADJ dad-10733 813 13 approaches approach NOUN dad-10733 813 14 to to ADP dad-10733 813 15 modeling model VERB dad-10733 813 16 dialogue dialogue NOUN dad-10733 813 17 acts act NOUN dad-10733 813 18 . . PUNCT dad-10733 814 1 larger large ADJ dad-10733 814 2 twitter twitter NOUN dad-10733 814 3 corpora corpora NOUN dad-10733 814 4 have have AUX dad-10733 814 5 been be AUX dad-10733 814 6 collected collect VERB dad-10733 814 7 . . PUNCT dad-10733 815 1 the the DET dad-10733 815 2 twitter twitter NOUN dad-10733 815 3 triples triple NOUN dad-10733 815 4 corpus corpus NOUN dad-10733 815 5 ( ( PUNCT dad-10733 815 6 sordoni sordoni NOUN dad-10733 815 7 et et PROPN dad-10733 815 8 al al PROPN dad-10733 815 9 . . PROPN dad-10733 815 10 , , PUNCT dad-10733 815 11 2015 2015 NUM dad-10733 815 12 ) ) PUNCT dad-10733 815 13 is be AUX dad-10733 815 14 one one NUM dad-10733 815 15 such such ADJ dad-10733 815 16 example example NOUN dad-10733 815 17 , , PUNCT dad-10733 815 18 with with ADP dad-10733 815 19 a a DET dad-10733 815 20 described describe VERB dad-10733 815 21 original original ADJ dad-10733 815 22 dataset dataset NOUN dad-10733 815 23 of of ADP dad-10733 815 24 127 127 NUM dad-10733 815 25 million million NUM dad-10733 815 26 context context NOUN dad-10733 815 27 - - PUNCT dad-10733 815 28 message message NOUN dad-10733 815 29 - - PUNCT dad-10733 815 30 response response NOUN dad-10733 815 31 triples triple NOUN dad-10733 815 32 , , PUNCT dad-10733 815 33 but but CCONJ dad-10733 815 34 only only ADV dad-10733 815 35 a a DET dad-10733 815 36 small small ADJ dad-10733 815 37 labeled label VERB dad-10733 815 38 subset subset NOUN dad-10733 815 39 of of ADP dad-10733 815 40 this this DET dad-10733 815 41 corpus corpus NOUN dad-10733 815 42 has have AUX dad-10733 815 43 been be AUX dad-10733 815 44 released release VERB dad-10733 815 45 . . PUNCT dad-10733 816 1 specifically specifically ADV dad-10733 816 2 , , PUNCT dad-10733 816 3 the the DET dad-10733 816 4 released release VERB dad-10733 816 5 labeled label VERB dad-10733 816 6 subset subset NOUN dad-10733 816 7 contains contain VERB dad-10733 816 8 4,232 4,232 NUM dad-10733 816 9 pairs pair NOUN dad-10733 816 10 that that PRON dad-10733 816 11 scored score VERB dad-10733 816 12 an an DET dad-10733 816 13 average average NOUN dad-10733 816 14 of of ADP dad-10733 816 15 greater great ADJ dad-10733 816 16 than than ADP dad-10733 816 17 4 4 NUM dad-10733 816 18 on on ADP dad-10733 816 19 the the DET dad-10733 816 20 likert likert ADJ dad-10733 816 21 - - PUNCT dad-10733 816 22 type type NOUN dad-10733 816 23 scale scale NOUN dad-10733 816 24 by by ADP dad-10733 816 25 crowdsourced crowdsourced ADJ dad-10733 816 26 evaluators evaluator NOUN dad-10733 816 27 for for ADP dad-10733 816 28 quality quality NOUN dad-10733 816 29 of of ADP dad-10733 816 30 the the DET dad-10733 816 31 response response NOUN dad-10733 816 32 to to ADP dad-10733 816 33 the the DET dad-10733 816 34 contextmessage contextmessage NOUN dad-10733 816 35 pair pair NOUN dad-10733 816 36 . . PUNCT dad-10733 817 1 similarly similarly ADV dad-10733 817 2 , , PUNCT dad-10733 817 3 a a DET dad-10733 817 4 large large ADJ dad-10733 817 5 micro micro ADJ dad-10733 817 6 - - ADJ dad-10733 817 7 blogging blogging ADJ dad-10733 817 8 dataset dataset NOUN dad-10733 817 9 , , PUNCT dad-10733 817 10 the the DET dad-10733 817 11 sina sina PROPN dad-10733 817 12 weibo weibo PROPN dad-10733 817 13 corpus corpus PROPN dad-10733 817 14 ( ( PUNCT dad-10733 817 15 shang shang PROPN dad-10733 817 16 et et PROPN dad-10733 817 17 al al PROPN dad-10733 817 18 . . PROPN dad-10733 817 19 , , PUNCT dad-10733 817 20 2015 2015 NUM dad-10733 817 21 ) ) PUNCT dad-10733 817 22 , , PUNCT dad-10733 817 23 which which PRON dad-10733 817 24 contains contain VERB dad-10733 817 25 4.5 4.5 NUM dad-10733 817 26 million million NUM dad-10733 817 27 post post ADJ dad-10733 817 28 - - ADJ dad-10733 817 29 reply reply ADJ dad-10733 817 30 pairs pair NOUN dad-10733 817 31 , , PUNCT dad-10733 817 32 has have AUX dad-10733 817 33 been be AUX dad-10733 817 34 collected collect VERB dad-10733 817 35 and and CCONJ dad-10733 817 36 used use VERB dad-10733 817 37 in in ADP dad-10733 817 38 literature literature NOUN dad-10733 817 39 , , PUNCT dad-10733 817 40 but but CCONJ dad-10733 817 41 this this DET dad-10733 817 42 resource resource NOUN dad-10733 817 43 has have AUX dad-10733 817 44 not not PART dad-10733 817 45 yet yet ADV dad-10733 817 46 been be AUX dad-10733 817 47 made make VERB dad-10733 817 48 publicly publicly ADV dad-10733 817 49 available available ADJ dad-10733 817 50 . . PUNCT dad-10733 818 1 we we PRON dad-10733 818 2 do do AUX dad-10733 818 3 not not PART dad-10733 818 4 include include VERB dad-10733 818 5 the the DET dad-10733 818 6 sina sina PROPN dad-10733 818 7 weibo weibo PROPN dad-10733 818 8 corpus corpus PROPN dad-10733 818 9 ( ( PUNCT dad-10733 818 10 and and CCONJ dad-10733 818 11 its its PRON dad-10733 818 12 derivatives derivative NOUN dad-10733 818 13 ) ) PUNCT dad-10733 818 14 in in ADP dad-10733 818 15 the the DET dad-10733 818 16 tables table NOUN dad-10733 818 17 in in ADP dad-10733 818 18 this this DET dad-10733 818 19 section section NOUN dad-10733 818 20 , , PUNCT dad-10733 818 21 as as SCONJ dad-10733 818 22 they they PRON dad-10733 818 23 are be AUX dad-10733 818 24 not not PART dad-10733 818 25 primarily primarily ADV dad-10733 818 26 in in ADP dad-10733 818 27 english english PROPN dad-10733 818 28 . . PUNCT dad-10733 819 1 the the DET dad-10733 819 2 usenet usenet NOUN dad-10733 819 3 corpus corpus NOUN dad-10733 819 4 ( ( PUNCT dad-10733 819 5 shaoul shaoul PROPN dad-10733 819 6 and and CCONJ dad-10733 819 7 westbury westbury NOUN dad-10733 819 8 , , PUNCT dad-10733 819 9 2009 2009 NUM dad-10733 819 10 ) ) PUNCT dad-10733 819 11 is be AUX dad-10733 819 12 a a DET dad-10733 819 13 gigantic gigantic ADJ dad-10733 819 14 collection collection NOUN dad-10733 819 15 of of ADP dad-10733 819 16 public public ADJ dad-10733 819 17 usenet usenet NOUN dad-10733 819 18 postings12 postings12 NOUN dad-10733 819 19 containing contain VERB dad-10733 819 20 over over ADP dad-10733 819 21 7 7 NUM dad-10733 819 22 billion billion NUM dad-10733 819 23 words word NOUN dad-10733 819 24 from from ADP dad-10733 819 25 october october PROPN dad-10733 819 26 2005 2005 NUM dad-10733 819 27 to to ADP dad-10733 819 28 january january PROPN dad-10733 819 29 2011 2011 NUM dad-10733 819 30 . . PUNCT dad-10733 820 1 usenet usenet NOUN dad-10733 820 2 was be AUX dad-10733 820 3 a a DET dad-10733 820 4 distributed distribute VERB dad-10733 820 5 discussion discussion NOUN dad-10733 820 6 system system NOUN dad-10733 820 7 established establish VERB dad-10733 820 8 in in ADP dad-10733 820 9 1980 1980 NUM dad-10733 820 10 where where SCONJ dad-10733 820 11 participants participant NOUN dad-10733 820 12 could could AUX dad-10733 820 13 post post VERB dad-10733 820 14 articles article NOUN dad-10733 820 15 to to ADP dad-10733 820 16 one one NUM dad-10733 820 17 of of ADP dad-10733 820 18 47,860 47,860 NUM dad-10733 820 19 ‘ ' PUNCT dad-10733 820 20 newsgroup newsgroup NOUN dad-10733 820 21 ’ ' PUNCT dad-10733 820 22 categories category NOUN dad-10733 820 23 . . PUNCT dad-10733 821 1 it it PRON dad-10733 821 2 is be AUX dad-10733 821 3 seen see VERB dad-10733 821 4 as as ADP dad-10733 821 5 the the DET dad-10733 821 6 precursor precursor NOUN dad-10733 821 7 to to ADP dad-10733 821 8 many many ADJ dad-10733 821 9 current current ADJ dad-10733 821 10 internet internet NOUN dad-10733 821 11 forums forum NOUN dad-10733 821 12 . . PUNCT dad-10733 822 1 the the DET dad-10733 822 2 10 10 NUM dad-10733 822 3 . . PUNCT dad-10733 822 4 http://www.reddit.com http://www.reddit.com X dad-10733 823 1 11 11 NUM dad-10733 823 2 . . PUNCT dad-10733 824 1 http://www.twitter.com http://www.twitter.com X dad-10733 824 2 12 12 NUM dad-10733 824 3 . . PUNCT dad-10733 825 1 http://www.usenet.net http://www.usenet.net X dad-10733 825 2 28 28 NUM dad-10733 825 3 http://www.reddit.com http://www.reddit.com X dad-10733 825 4 http://www.twitter.com http://www.twitter.com X dad-10733 825 5 http://www.usenet.net http://www.usenet.net X dad-10733 826 1 a a DET dad-10733 826 2 survey survey NOUN dad-10733 826 3 of of ADP dad-10733 826 4 available available ADJ dad-10733 826 5 corpora corpora PROPN dad-10733 826 6 for for ADP dad-10733 826 7 building build VERB dad-10733 826 8 data data NOUN dad-10733 826 9 - - PUNCT dad-10733 826 10 driven drive VERB dad-10733 826 11 dialogue dialogue NOUN dad-10733 826 12 systems system NOUN dad-10733 826 13 corpus corpus NOUN dad-10733 826 14 derived derive VERB dad-10733 826 15 from from ADP dad-10733 826 16 these these DET dad-10733 826 17 posts post NOUN dad-10733 826 18 has have AUX dad-10733 826 19 been be AUX dad-10733 826 20 used use VERB dad-10733 826 21 for for ADP dad-10733 826 22 research research NOUN dad-10733 826 23 in in ADP dad-10733 826 24 collaborative collaborative ADJ dad-10733 826 25 filtering filtering NOUN dad-10733 826 26 ( ( PUNCT dad-10733 826 27 konstan konstan PROPN dad-10733 826 28 et et PROPN dad-10733 826 29 al al PROPN dad-10733 826 30 . . PROPN dad-10733 826 31 , , PUNCT dad-10733 826 32 1997 1997 NUM dad-10733 826 33 ) ) PUNCT dad-10733 826 34 and and CCONJ dad-10733 826 35 role role NOUN dad-10733 826 36 detection detection NOUN dad-10733 826 37 ( ( PUNCT dad-10733 826 38 fisher fisher PROPN dad-10733 826 39 et et PROPN dad-10733 826 40 al al PROPN dad-10733 826 41 . . PROPN dad-10733 826 42 , , PUNCT dad-10733 826 43 2006 2006 NUM dad-10733 826 44 ) ) PUNCT dad-10733 826 45 . . PUNCT dad-10733 827 1 the the DET dad-10733 827 2 nus nus PROPN dad-10733 827 3 sms sms PROPN dad-10733 827 4 corpus corpus PROPN dad-10733 827 5 ( ( PUNCT dad-10733 827 6 chen chen PROPN dad-10733 827 7 and and CCONJ dad-10733 827 8 kan kan PROPN dad-10733 827 9 , , PUNCT dad-10733 827 10 2013 2013 NUM dad-10733 827 11 ) ) PUNCT dad-10733 827 12 consists consist VERB dad-10733 827 13 of of ADP dad-10733 827 14 conversations conversation NOUN dad-10733 827 15 carried carry VERB dad-10733 827 16 out out ADP dad-10733 827 17 over over ADP dad-10733 827 18 mobile mobile ADJ dad-10733 827 19 phone phone NOUN dad-10733 827 20 sms sms NOUN dad-10733 827 21 messages message NOUN dad-10733 827 22 between between ADP dad-10733 827 23 two two NUM dad-10733 827 24 users user NOUN dad-10733 827 25 . . PUNCT dad-10733 828 1 while while SCONJ dad-10733 828 2 the the DET dad-10733 828 3 original original ADJ dad-10733 828 4 purpose purpose NOUN dad-10733 828 5 of of ADP dad-10733 828 6 the the DET dad-10733 828 7 dataset dataset NOUN dad-10733 828 8 was be AUX dad-10733 828 9 to to PART dad-10733 828 10 improve improve VERB dad-10733 828 11 predictive predictive ADJ dad-10733 828 12 text text NOUN dad-10733 828 13 entry entry NOUN dad-10733 828 14 when when SCONJ dad-10733 828 15 mobile mobile ADJ dad-10733 828 16 phones phone NOUN dad-10733 828 17 still still ADV dad-10733 828 18 mapped map VERB dad-10733 828 19 multiple multiple ADJ dad-10733 828 20 letters letter NOUN dad-10733 828 21 to to ADP dad-10733 828 22 a a DET dad-10733 828 23 single single ADJ dad-10733 828 24 number number NOUN dad-10733 828 25 , , PUNCT dad-10733 828 26 aided aid VERB dad-10733 828 27 by by ADP dad-10733 828 28 video video NOUN dad-10733 828 29 and and CCONJ dad-10733 828 30 timing time VERB dad-10733 828 31 analysis analysis NOUN dad-10733 828 32 of of ADP dad-10733 828 33 users user NOUN dad-10733 828 34 entering enter VERB dad-10733 828 35 their their PRON dad-10733 828 36 messages message NOUN dad-10733 828 37 it it PRON dad-10733 828 38 could could AUX dad-10733 828 39 equally equally ADV dad-10733 828 40 be be AUX dad-10733 828 41 used use VERB dad-10733 828 42 for for ADP dad-10733 828 43 analysis analysis NOUN dad-10733 828 44 of of ADP dad-10733 828 45 informal informal ADJ dad-10733 828 46 dialogue dialogue NOUN dad-10733 828 47 . . PUNCT dad-10733 829 1 it it PRON dad-10733 829 2 is be AUX dad-10733 829 3 worth worth ADJ dad-10733 829 4 noting note VERB dad-10733 829 5 that that SCONJ dad-10733 829 6 the the DET dad-10733 829 7 corpus corpus NOUN dad-10733 829 8 does do AUX dad-10733 829 9 not not PART dad-10733 829 10 consist consist VERB dad-10733 829 11 of of ADP dad-10733 829 12 dialogues dialogue NOUN dad-10733 829 13 , , PUNCT dad-10733 829 14 but but CCONJ dad-10733 829 15 rather rather ADV dad-10733 829 16 single single ADJ dad-10733 829 17 sms sms NOUN dad-10733 829 18 messages message NOUN dad-10733 829 19 . . PUNCT dad-10733 830 1 sms sms NOUN dad-10733 830 2 messages message NOUN dad-10733 830 3 are be AUX dad-10733 830 4 similar similar ADJ dad-10733 830 5 in in ADP dad-10733 830 6 style style NOUN dad-10733 830 7 to to ADP dad-10733 830 8 twitter twitter VERB dad-10733 830 9 , , PUNCT dad-10733 830 10 in in SCONJ dad-10733 830 11 that that SCONJ dad-10733 830 12 they they PRON dad-10733 830 13 use use VERB dad-10733 830 14 many many ADJ dad-10733 830 15 abbreviations abbreviation NOUN dad-10733 830 16 and and CCONJ dad-10733 830 17 acronyms acronym NOUN dad-10733 830 18 . . PUNCT dad-10733 831 1 the the DET dad-10733 831 2 dailydialog dailydialog PROPN dad-10733 831 3 dataset dataset PROPN dad-10733 831 4 ( ( PUNCT dad-10733 831 5 li li PROPN dad-10733 831 6 et et PROPN dad-10733 831 7 al al PROPN dad-10733 831 8 . . PROPN dad-10733 831 9 , , PUNCT dad-10733 831 10 2017 2017 NUM dad-10733 831 11 ) ) PUNCT dad-10733 831 12 consists consist VERB dad-10733 831 13 of of ADP dad-10733 831 14 conversations conversation NOUN dad-10733 831 15 crawled crawl VERB dad-10733 831 16 from from ADP dad-10733 831 17 websites website NOUN dad-10733 831 18 which which PRON dad-10733 831 19 teach teach VERB dad-10733 831 20 english english PROPN dad-10733 831 21 through through ADP dad-10733 831 22 dialogue dialogue NOUN dad-10733 831 23 . . PUNCT dad-10733 832 1 these these DET dad-10733 832 2 dialogues dialogue NOUN dad-10733 832 3 consist consist VERB dad-10733 832 4 of of ADP dad-10733 832 5 everyday everyday ADJ dad-10733 832 6 conversations conversation NOUN dad-10733 832 7 such such ADJ dad-10733 832 8 as as ADP dad-10733 832 9 a a DET dad-10733 832 10 customer customer NOUN dad-10733 832 11 looking look VERB dad-10733 832 12 for for ADP dad-10733 832 13 a a DET dad-10733 832 14 product product NOUN dad-10733 832 15 or or CCONJ dad-10733 832 16 conversing converse VERB dad-10733 832 17 with with ADP dad-10733 832 18 a a DET dad-10733 832 19 salesperson salesperson NOUN dad-10733 832 20 . . PUNCT dad-10733 833 1 since since SCONJ dad-10733 833 2 the the DET dad-10733 833 3 collected collect VERB dad-10733 833 4 data datum NOUN dad-10733 833 5 comes come VERB dad-10733 833 6 from from ADP dad-10733 833 7 educational educational ADJ dad-10733 833 8 sources source NOUN dad-10733 833 9 , , PUNCT dad-10733 833 10 the the DET dad-10733 833 11 dialogues dialogue NOUN dad-10733 833 12 are be AUX dad-10733 833 13 well well ADV dad-10733 833 14 - - PUNCT dad-10733 833 15 defined define VERB dad-10733 833 16 and and CCONJ dad-10733 833 17 generally generally ADV dad-10733 833 18 free free ADJ dad-10733 833 19 of of ADP dad-10733 833 20 grammatical grammatical ADJ dad-10733 833 21 mistakes mistake NOUN dad-10733 833 22 or or CCONJ dad-10733 833 23 abbreviations abbreviation NOUN dad-10733 833 24 . . PUNCT dad-10733 834 1 furthermore furthermore ADV dad-10733 834 2 , , PUNCT dad-10733 834 3 the the DET dad-10733 834 4 data data NOUN dad-10733 834 5 is be AUX dad-10733 834 6 hand hand NOUN dad-10733 834 7 - - PUNCT dad-10733 834 8 labeled label VERB dad-10733 834 9 with with ADP dad-10733 834 10 emotions emotion NOUN dad-10733 834 11 . . PUNCT dad-10733 835 1 this this DET dad-10733 835 2 added add VERB dad-10733 835 3 labeling labeling NOUN dad-10733 835 4 may may AUX dad-10733 835 5 provide provide VERB dad-10733 835 6 a a DET dad-10733 835 7 useful useful ADJ dad-10733 835 8 complementary complementary ADJ dad-10733 835 9 signal signal NOUN dad-10733 835 10 in in ADP dad-10733 835 11 training training NOUN dad-10733 835 12 dialogue dialogue NOUN dad-10733 835 13 systems system NOUN dad-10733 835 14 — — PUNCT dad-10733 835 15 for for ADP dad-10733 835 16 example example NOUN dad-10733 835 17 as as ADP dad-10733 835 18 a a DET dad-10733 835 19 latent latent NOUN dad-10733 835 20 variable variable NOUN dad-10733 835 21 for for ADP dad-10733 835 22 eliciting elicit VERB dad-10733 835 23 different different ADJ dad-10733 835 24 types type NOUN dad-10733 835 25 of of ADP dad-10733 835 26 emotion emotion NOUN dad-10733 835 27 from from ADP dad-10733 835 28 a a DET dad-10733 835 29 dialogue dialogue NOUN dad-10733 835 30 agent agent NOUN dad-10733 835 31 . . PUNCT dad-10733 836 1 currently currently ADV dad-10733 836 2 , , PUNCT dad-10733 836 3 one one NUM dad-10733 836 4 of of ADP dad-10733 836 5 the the DET dad-10733 836 6 most most ADV dad-10733 836 7 popular popular ADJ dad-10733 836 8 forum forum NOUN dad-10733 836 9 - - PUNCT dad-10733 836 10 based base VERB dad-10733 836 11 websites website NOUN dad-10733 836 12 is be AUX dad-10733 836 13 reddit reddit NOUN dad-10733 836 14 where where SCONJ dad-10733 836 15 users user NOUN dad-10733 836 16 can can AUX dad-10733 836 17 create create VERB dad-10733 836 18 discussions discussion NOUN dad-10733 836 19 and and CCONJ dad-10733 836 20 post post VERB dad-10733 836 21 comments comment NOUN dad-10733 836 22 in in ADP dad-10733 836 23 various various ADJ dad-10733 836 24 sub sub NOUN dad-10733 836 25 - - ADJ dad-10733 836 26 forums forum NOUN dad-10733 836 27 called call VERB dad-10733 836 28 ‘ ' PUNCT dad-10733 836 29 subreddits subreddit NOUN dad-10733 836 30 ’ ' PUNCT dad-10733 836 31 . . PUNCT dad-10733 837 1 each each DET dad-10733 837 2 subreddit subreddit NOUN dad-10733 837 3 addresses address NOUN dad-10733 837 4 its its PRON dad-10733 837 5 own own ADJ dad-10733 837 6 particular particular ADJ dad-10733 837 7 topic topic NOUN dad-10733 837 8 . . PUNCT dad-10733 838 1 over over ADP dad-10733 838 2 1.7 1.7 NUM dad-10733 838 3 billion billion NUM dad-10733 838 4 of of ADP dad-10733 838 5 these these DET dad-10733 838 6 comments comment NOUN dad-10733 838 7 have have AUX dad-10733 838 8 been be AUX dad-10733 838 9 collected collect VERB dad-10733 838 10 in in ADP dad-10733 838 11 the the DET dad-10733 838 12 reddit reddit NOUN dad-10733 838 13 corpus.13 corpus.13 NOUN dad-10733 838 14 each each DET dad-10733 838 15 comment comment NOUN dad-10733 838 16 is be AUX dad-10733 838 17 labeled label VERB dad-10733 838 18 with with ADP dad-10733 838 19 the the DET dad-10733 838 20 author author NOUN dad-10733 838 21 , , PUNCT dad-10733 838 22 score score NOUN dad-10733 838 23 ( ( PUNCT dad-10733 838 24 rating rating NOUN dad-10733 838 25 from from ADP dad-10733 838 26 other other ADJ dad-10733 838 27 users user NOUN dad-10733 838 28 ) ) PUNCT dad-10733 838 29 , , PUNCT dad-10733 838 30 and and CCONJ dad-10733 838 31 position position NOUN dad-10733 838 32 in in ADP dad-10733 838 33 the the DET dad-10733 838 34 comment comment NOUN dad-10733 838 35 tree tree NOUN dad-10733 838 36 ; ; PUNCT dad-10733 838 37 the the DET dad-10733 838 38 position position NOUN dad-10733 838 39 is be AUX dad-10733 838 40 important important ADJ dad-10733 838 41 as as SCONJ dad-10733 838 42 it it PRON dad-10733 838 43 determines determine VERB dad-10733 838 44 which which DET dad-10733 838 45 comment comment NOUN dad-10733 838 46 is be AUX dad-10733 838 47 being be AUX dad-10733 838 48 replied reply VERB dad-10733 838 49 to to ADP dad-10733 838 50 . . PUNCT dad-10733 839 1 researchers researcher NOUN dad-10733 839 2 are be AUX dad-10733 839 3 just just ADV dad-10733 839 4 starting start VERB dad-10733 839 5 to to PART dad-10733 839 6 investigate investigate VERB dad-10733 839 7 dialogue dialogue NOUN dad-10733 839 8 problems problem NOUN dad-10733 839 9 using use VERB dad-10733 839 10 this this DET dad-10733 839 11 reddit reddit NOUN dad-10733 839 12 discussion discussion NOUN dad-10733 839 13 corpus corpu NOUN dad-10733 839 14 ; ; PUNCT dad-10733 839 15 its its PRON dad-10733 839 16 large large ADJ dad-10733 839 17 size size NOUN dad-10733 839 18 makes make VERB dad-10733 839 19 it it PRON dad-10733 839 20 a a DET dad-10733 839 21 particularly particularly ADV dad-10733 839 22 interesting interesting ADJ dad-10733 839 23 candidate candidate NOUN dad-10733 839 24 for for ADP dad-10733 839 25 studying study VERB dad-10733 839 26 transfer transfer NOUN dad-10733 839 27 learning learning NOUN dad-10733 839 28 . . PUNCT dad-10733 840 1 additionally additionally ADV dad-10733 840 2 , , PUNCT dad-10733 840 3 researchers researcher NOUN dad-10733 840 4 have have AUX dad-10733 840 5 used use VERB dad-10733 840 6 smaller small ADJ dad-10733 840 7 collections collection NOUN dad-10733 840 8 of of ADP dad-10733 840 9 reddit reddit NOUN dad-10733 840 10 discussions discussion NOUN dad-10733 840 11 for for ADP dad-10733 840 12 broad broad ADJ dad-10733 840 13 discourse discourse NOUN dad-10733 840 14 classification classification NOUN dad-10733 840 15 ( ( PUNCT dad-10733 840 16 schrading schrade VERB dad-10733 840 17 et et PROPN dad-10733 840 18 al al PROPN dad-10733 840 19 . . PROPN dad-10733 840 20 , , PUNCT dad-10733 840 21 2015 2015 NUM dad-10733 840 22 ) ) PUNCT dad-10733 840 23 . . PUNCT dad-10733 841 1 some some DET dad-10733 841 2 more more ADV dad-10733 841 3 specialized specialized ADJ dad-10733 841 4 versions version NOUN dad-10733 841 5 of of ADP dad-10733 841 6 the the DET dad-10733 841 7 reddit reddit NOUN dad-10733 841 8 dataset dataset NOUN dad-10733 841 9 have have AUX dad-10733 841 10 been be AUX dad-10733 841 11 curated curate VERB dad-10733 841 12 . . PUNCT dad-10733 842 1 the the DET dad-10733 842 2 reddit reddit NOUN dad-10733 842 3 domestic domestic ADJ dad-10733 842 4 abuse abuse NOUN dad-10733 842 5 corpus corpus NOUN dad-10733 842 6 ( ( PUNCT dad-10733 842 7 schrading schrade VERB dad-10733 842 8 et et PROPN dad-10733 842 9 al al PROPN dad-10733 842 10 . . PROPN dad-10733 842 11 , , PUNCT dad-10733 842 12 2015 2015 NUM dad-10733 842 13 ) ) PUNCT dad-10733 842 14 consists consist VERB dad-10733 842 15 of of ADP dad-10733 842 16 reddit reddit NOUN dad-10733 842 17 posts post NOUN dad-10733 842 18 and and CCONJ dad-10733 842 19 comments comment NOUN dad-10733 842 20 taken take VERB dad-10733 842 21 from from ADP dad-10733 842 22 either either DET dad-10733 842 23 subreddits subreddit NOUN dad-10733 842 24 specific specific ADJ dad-10733 842 25 to to ADP dad-10733 842 26 domestic domestic ADJ dad-10733 842 27 abuse abuse NOUN dad-10733 842 28 , , PUNCT dad-10733 842 29 or or CCONJ dad-10733 842 30 from from ADP dad-10733 842 31 subreddits subreddit NOUN dad-10733 842 32 representing represent VERB dad-10733 842 33 casual casual ADJ dad-10733 842 34 conversations conversation NOUN dad-10733 842 35 , , PUNCT dad-10733 842 36 advice advice NOUN dad-10733 842 37 , , PUNCT dad-10733 842 38 and and CCONJ dad-10733 842 39 general general ADJ dad-10733 842 40 anxiety anxiety NOUN dad-10733 842 41 or or CCONJ dad-10733 842 42 anger anger NOUN dad-10733 842 43 . . PUNCT dad-10733 843 1 the the DET dad-10733 843 2 motivation motivation NOUN dad-10733 843 3 is be AUX dad-10733 843 4 to to PART dad-10733 843 5 build build VERB dad-10733 843 6 classifiers classifier NOUN dad-10733 843 7 that that PRON dad-10733 843 8 can can AUX dad-10733 843 9 detect detect VERB dad-10733 843 10 occurrences occurrence NOUN dad-10733 843 11 of of ADP dad-10733 843 12 domestic domestic ADJ dad-10733 843 13 abuse abuse NOUN dad-10733 843 14 in in ADP dad-10733 843 15 other other ADJ dad-10733 843 16 areas area NOUN dad-10733 843 17 , , PUNCT dad-10733 843 18 which which PRON dad-10733 843 19 could could AUX dad-10733 843 20 provide provide VERB dad-10733 843 21 insights insight NOUN dad-10733 843 22 into into ADP dad-10733 843 23 the the DET dad-10733 843 24 prevalence prevalence NOUN dad-10733 843 25 and and CCONJ dad-10733 843 26 consequences consequence NOUN dad-10733 843 27 of of ADP dad-10733 843 28 these these DET dad-10733 843 29 situations situation NOUN dad-10733 843 30 . . PUNCT dad-10733 844 1 these these DET dad-10733 844 2 conversations conversation NOUN dad-10733 844 3 have have AUX dad-10733 844 4 been be AUX dad-10733 844 5 pre pre VERB dad-10733 844 6 - - VERB dad-10733 844 7 processed process VERB dad-10733 844 8 with with ADP dad-10733 844 9 lower lower ADV dad-10733 844 10 - - PUNCT dad-10733 844 11 casing casing NOUN dad-10733 844 12 , , PUNCT dad-10733 844 13 lemmatizing lemmatizing NOUN dad-10733 844 14 , , PUNCT dad-10733 844 15 and and CCONJ dad-10733 844 16 removal removal NOUN dad-10733 844 17 of of ADP dad-10733 844 18 stop stop NOUN dad-10733 844 19 words word NOUN dad-10733 844 20 , , PUNCT dad-10733 844 21 and and CCONJ dad-10733 844 22 semantic semantic ADJ dad-10733 844 23 role role NOUN dad-10733 844 24 labels label NOUN dad-10733 844 25 are be AUX dad-10733 844 26 provided provide VERB dad-10733 844 27 . . PUNCT dad-10733 845 1 13 13 NUM dad-10733 845 2 . . X dad-10733 846 1 see see VERB dad-10733 846 2 : : PUNCT dad-10733 846 3 https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly ADV dad-10733 846 4 _ _ PUNCT dad-10733 847 1 available_reddit_comment/. available_reddit_comment/. PROPN dad-10733 847 2 29 29 NUM dad-10733 847 3 https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/ https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/ PROPN dad-10733 847 4 https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/ https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/ PROPN dad-10733 847 5 serban serban PROPN dad-10733 847 6 , , PUNCT dad-10733 847 7 lowe lowe PROPN dad-10733 847 8 , , PUNCT dad-10733 847 9 henderson henderson PROPN dad-10733 847 10 , , PUNCT dad-10733 847 11 charlin charlin PROPN dad-10733 847 12 and and CCONJ dad-10733 847 13 pineau pineau PROPN dad-10733 847 14 n n PRON dad-10733 847 15 am be AUX dad-10733 847 16 e e X dad-10733 847 17 ty ty INTJ dad-10733 847 18 pe pe INTJ dad-10733 847 19 to to ADP dad-10733 847 20 pi pi PROPN dad-10733 847 21 cs cs PROPN dad-10733 847 22 a a DET dad-10733 847 23 vg vg NOUN dad-10733 847 24 . . PUNCT dad-10733 848 1 # # NOUN dad-10733 848 2 to to ADP dad-10733 848 3 ta ta PROPN dad-10733 848 4 l l NOUN dad-10733 848 5 # # NOUN dad-10733 848 6 to to ADP dad-10733 848 7 ta ta ADP dad-10733 848 8 l l NOUN dad-10733 848 9 # # X dad-10733 848 10 d d PROPN dad-10733 848 11 es es PROPN dad-10733 848 12 cr cr PROPN dad-10733 848 13 ip ip PROPN dad-10733 848 14 tio tio PROPN dad-10733 848 15 n n PROPN dad-10733 848 16 of of ADP dad-10733 848 17 tu tu PROPN dad-10733 848 18 rn rn PROPN dad-10733 848 19 s s PROPN dad-10733 848 20 of of ADP dad-10733 848 21 di di NOUN dad-10733 848 22 al al PROPN dad-10733 848 23 og og PROPN dad-10733 848 24 ue ue PROPN dad-10733 848 25 s s PROPN dad-10733 848 26 of of ADP dad-10733 848 27 w w NOUN dad-10733 848 28 or or CCONJ dad-10733 848 29 ds ds PRON dad-10733 848 30 n n NOUN dad-10733 848 31 ps ps VERB dad-10733 849 1 c c NOUN dad-10733 849 2 ha ha INTJ dad-10733 849 3 tc tc INTJ dad-10733 849 4 or or CCONJ dad-10733 849 5 pu pu PROPN dad-10733 849 6 s s PROPN dad-10733 850 1 c c X dad-10733 850 2 ha ha INTJ dad-10733 850 3 t t PROPN dad-10733 850 4 u u PROPN dad-10733 850 5 nr nr PROPN dad-10733 850 6 es es PROPN dad-10733 850 7 tr tr PROPN dad-10733 850 8 ic ic PROPN dad-10733 850 9 te te PROPN dad-10733 850 10 d d PROPN dad-10733 850 11 70 70 NUM dad-10733 850 12 4 4 NUM dad-10733 850 13 15 15 NUM dad-10733 850 14 † † NOUN dad-10733 850 15 10 10 NUM dad-10733 850 16 0 0 NUM dad-10733 850 17 m m NOUN dad-10733 850 18 po po PROPN dad-10733 850 19 st st PROPN dad-10733 850 20 s s X dad-10733 850 21 fr fr INTJ dad-10733 850 22 om om PROPN dad-10733 850 23 ag ag PROPN dad-10733 850 24 esp esp PROPN dad-10733 850 25 ec ec PROPN dad-10733 850 26 ifi ifi PROPN dad-10733 850 27 c c PROPN dad-10733 850 28 on on ADP dad-10733 850 29 lin lin PROPN dad-10733 850 30 e e PROPN dad-10733 850 31 ch ch NOUN dad-10733 850 32 at at ADP dad-10733 850 33 ro ro PROPN dad-10733 850 34 om om PROPN dad-10733 850 35 s. s. PROPN dad-10733 850 36 ( ( PUNCT dad-10733 850 37 f f PROPN dad-10733 850 38 or or CCONJ dad-10733 850 39 sy sy INTJ dad-10733 850 40 th th X dad-10733 850 41 an an DET dad-10733 850 42 d d PROPN dad-10733 850 43 m m PROPN dad-10733 850 44 ar ar PROPN dad-10733 850 45 te te PROPN dad-10733 850 46 ll ll AUX dad-10733 850 47 , , PUNCT dad-10733 850 48 20 20 NUM dad-10733 850 49 07 07 NUM dad-10733 850 50 ) ) PUNCT dad-10733 850 51 tw tw NOUN dad-10733 850 52 itt itt INTJ dad-10733 850 53 er er INTJ dad-10733 850 54 c c NOUN dad-10733 851 1 or or CCONJ dad-10733 851 2 pu pu PROPN dad-10733 851 3 s s PART dad-10733 851 4 m m VERB dad-10733 851 5 ic ic INTJ dad-10733 851 6 ro ro INTJ dad-10733 851 7 bl bl INTJ dad-10733 851 8 og og PROPN dad-10733 851 9 u u PROPN dad-10733 851 10 nr nr PROPN dad-10733 851 11 es es PROPN dad-10733 851 12 tr tr PROPN dad-10733 851 13 ic ic PROPN dad-10733 851 14 te te PROPN dad-10733 851 15 d d PROPN dad-10733 851 16 2 2 NUM dad-10733 851 17 1 1 NUM dad-10733 851 18 . . PUNCT dad-10733 852 1 3 3 NUM dad-10733 852 2 m m NOUN dad-10733 852 3 12 12 NUM dad-10733 852 4 5 5 NUM dad-10733 852 5 m m NOUN dad-10733 852 6 ‡ ‡ NOUN dad-10733 852 7 tw tw INTJ dad-10733 852 8 ee ee INTJ dad-10733 852 9 ts ts ADP dad-10733 852 10 an an DET dad-10733 852 11 d d X dad-10733 852 12 re re X dad-10733 852 13 pl pl X dad-10733 852 14 ie ie X dad-10733 852 15 s s PART dad-10733 852 16 ex ex PUNCT dad-10733 852 17 tr tr VERB dad-10733 852 18 ac ac PROPN dad-10733 852 19 te te PROPN dad-10733 853 1 d d NOUN dad-10733 853 2 fr fr INTJ dad-10733 853 3 om om PROPN dad-10733 853 4 tw tw INTJ dad-10733 853 5 itt itt INTJ dad-10733 853 6 er er INTJ dad-10733 853 7 ( ( PUNCT dad-10733 853 8 r r NOUN dad-10733 853 9 itt itt INTJ dad-10733 853 10 er er INTJ dad-10733 853 11 et et NOUN dad-10733 853 12 al al PROPN dad-10733 853 13 . . PUNCT dad-10733 853 14 , , PUNCT dad-10733 853 15 20 20 NUM dad-10733 853 16 10 10 NUM dad-10733 853 17 ) ) PUNCT dad-10733 853 18 tw tw NOUN dad-10733 854 1 itt itt INTJ dad-10733 854 2 er er INTJ dad-10733 854 3 tr tr VERB dad-10733 854 4 ip ip NOUN dad-10733 854 5 le le X dad-10733 854 6 c c PROPN dad-10733 854 7 or or CCONJ dad-10733 854 8 pu pu PROPN dad-10733 854 9 s s PART dad-10733 854 10 m m VERB dad-10733 854 11 ic ic INTJ dad-10733 854 12 ro ro INTJ dad-10733 854 13 bl bl INTJ dad-10733 854 14 og og PROPN dad-10733 854 15 u u PROPN dad-10733 854 16 nr nr PROPN dad-10733 854 17 es es PROPN dad-10733 854 18 tr tr PROPN dad-10733 854 19 ic ic PROPN dad-10733 854 20 te te PROPN dad-10733 854 21 d d PROPN dad-10733 854 22 3 3 NUM dad-10733 854 23 4 4 NUM dad-10733 854 24 , , PUNCT dad-10733 854 25 23 23 NUM dad-10733 854 26 2 2 NUM dad-10733 854 27 65 65 NUM dad-10733 854 28 k k NOUN dad-10733 854 29 ‡ ‡ X dad-10733 854 30 a a DET dad-10733 854 31 -b -b X dad-10733 854 32 -a -a PUNCT dad-10733 854 33 tr tr NOUN dad-10733 854 34 ip ip NOUN dad-10733 854 35 le le X dad-10733 854 36 s s X dad-10733 854 37 ex ex PUNCT dad-10733 854 38 tr tr VERB dad-10733 854 39 ac ac PROPN dad-10733 854 40 te te PROPN dad-10733 855 1 d d NOUN dad-10733 855 2 fr fr INTJ dad-10733 855 3 om om PROPN dad-10733 855 4 tw tw INTJ dad-10733 855 5 itt itt INTJ dad-10733 856 1 er er INTJ dad-10733 856 2 ( ( PUNCT dad-10733 856 3 s s VERB dad-10733 856 4 or or CCONJ dad-10733 856 5 do do VERB dad-10733 856 6 ni ni PROPN dad-10733 856 7 et et PROPN dad-10733 856 8 al al PROPN dad-10733 856 9 . . PROPN dad-10733 856 10 , , PUNCT dad-10733 856 11 20 20 NUM dad-10733 856 12 15 15 NUM dad-10733 856 13 ) ) PUNCT dad-10733 856 14 u u PROPN dad-10733 856 15 se se X dad-10733 856 16 n n X dad-10733 856 17 et et NOUN dad-10733 856 18 c c NOUN dad-10733 856 19 or or CCONJ dad-10733 856 20 pu pu PROPN dad-10733 856 21 s s PART dad-10733 856 22 m m VERB dad-10733 856 23 ic ic INTJ dad-10733 856 24 ro ro INTJ dad-10733 856 25 bl bl INTJ dad-10733 856 26 og og PROPN dad-10733 856 27 u u PROPN dad-10733 856 28 nr nr PROPN dad-10733 856 29 es es PROPN dad-10733 856 30 tr tr PROPN dad-10733 856 31 ic ic PROPN dad-10733 856 32 te te PROPN dad-10733 856 33 d d PROPN dad-10733 856 34 68 68 NUM dad-10733 856 35 7 7 NUM dad-10733 856 36 47 47 NUM dad-10733 856 37 86 86 NUM dad-10733 856 38 0† 0† ADP dad-10733 856 39 7b 7b NUM dad-10733 856 40 u u PROPN dad-10733 856 41 se se X dad-10733 856 42 n n ADV dad-10733 856 43 et et NOUN dad-10733 856 44 fo fo INTJ dad-10733 856 45 ru ru PROPN dad-10733 856 46 m m PROPN dad-10733 856 47 po po PROPN dad-10733 856 48 st st PROPN dad-10733 856 49 in in ADP dad-10733 856 50 gs gs PROPN dad-10733 856 51 ( ( PUNCT dad-10733 856 52 s s AUX dad-10733 856 53 ha ha INTJ dad-10733 856 54 ou ou PROPN dad-10733 856 55 la la PROPN dad-10733 856 56 nd nd PROPN dad-10733 856 57 w w NOUN dad-10733 856 58 es es NOUN dad-10733 856 59 tb tb ADP dad-10733 856 60 ur ur INTJ dad-10733 856 61 y y PROPN dad-10733 856 62 , , PUNCT dad-10733 856 63 20 20 NUM dad-10733 856 64 09 09 NUM dad-10733 856 65 ) ) PUNCT dad-10733 856 66 n n CCONJ dad-10733 856 67 u u NOUN dad-10733 856 68 s s VERB dad-10733 856 69 sm sm PROPN dad-10733 856 70 s s PROPN dad-10733 856 71 c c NOUN dad-10733 856 72 or or CCONJ dad-10733 856 73 pu pu PROPN dad-10733 856 74 s s PROPN dad-10733 857 1 sm sm PROPN dad-10733 857 2 s s NOUN dad-10733 857 3 m m VERB dad-10733 857 4 es es NOUN dad-10733 857 5 sa sa X dad-10733 857 6 ge ge PROPN dad-10733 857 7 s s PROPN dad-10733 857 8 u u PROPN dad-10733 857 9 nr nr NOUN dad-10733 857 10 es es PROPN dad-10733 857 11 tr tr PROPN dad-10733 857 12 ic ic PROPN dad-10733 857 13 te te PROPN dad-10733 857 14 d d PROPN dad-10733 857 15 18 18 NUM dad-10733 857 16 3k 3k NUM dad-10733 857 17 58 58 NUM dad-10733 857 18 0 0 NUM dad-10733 857 19 , , PUNCT dad-10733 857 20 66 66 NUM dad-10733 857 21 8 8 NUM dad-10733 857 22 * * SYM dad-10733 857 23 2 2 NUM dad-10733 858 1 sm sm NOUN dad-10733 858 2 s s NOUN dad-10733 858 3 m m VERB dad-10733 858 4 es es NOUN dad-10733 858 5 sa sa X dad-10733 858 6 ge ge PROPN dad-10733 858 7 s s PROPN dad-10733 858 8 co co PROPN dad-10733 858 9 lle lle PROPN dad-10733 858 10 ct ct PROPN dad-10733 858 11 ed ed PROPN dad-10733 858 12 be be AUX dad-10733 858 13 tw tw INTJ dad-10733 858 14 ee ee ADP dad-10733 858 15 n n PROPN dad-10733 858 16 tw tw NOUN dad-10733 858 17 o o NOUN dad-10733 859 1 ( ( PUNCT dad-10733 859 2 c c VERB dad-10733 859 3 he he PRON dad-10733 859 4 n n PROPN dad-10733 859 5 an an PROPN dad-10733 859 6 d d X dad-10733 859 7 k k PROPN dad-10733 859 8 an an DET dad-10733 859 9 , , PUNCT dad-10733 859 10 2 2 NUM dad-10733 859 11 01 01 NUM dad-10733 859 12 3 3 NUM dad-10733 859 13 ) ) PUNCT dad-10733 859 14 us we PRON dad-10733 859 15 er er INTJ dad-10733 859 16 s s PROPN dad-10733 859 17 , , PUNCT dad-10733 859 18 w w PROPN dad-10733 859 19 ith ith PROPN dad-10733 859 20 tim tim PROPN dad-10733 859 21 in in ADP dad-10733 859 22 g g PROPN dad-10733 859 23 an an DET dad-10733 859 24 al al PROPN dad-10733 859 25 ys ys PROPN dad-10733 859 26 is be AUX dad-10733 859 27 . . PUNCT dad-10733 860 1 r r NOUN dad-10733 860 2 ed ed PROPN dad-10733 860 3 di di NOUN dad-10733 860 4 t t PROPN dad-10733 860 5 fo fo ADP dad-10733 860 6 ru ru PROPN dad-10733 860 7 m m PROPN dad-10733 860 8 u u NOUN dad-10733 860 9 nr nr NOUN dad-10733 860 10 es es PROPN dad-10733 860 11 tr tr PROPN dad-10733 860 12 ic ic PROPN dad-10733 860 13 te te PROPN dad-10733 860 14 d d PROPN dad-10733 860 15 – – PUNCT dad-10733 860 16 – – PUNCT dad-10733 860 17 – – PUNCT dad-10733 860 18 1 1 X dad-10733 860 19 . . X dad-10733 861 1 7b 7b NUM dad-10733 861 2 co co NOUN dad-10733 861 3 m m VERB dad-10733 861 4 m m VERB dad-10733 861 5 en en ADP dad-10733 861 6 ts ts X dad-10733 861 7 ac ac PROPN dad-10733 861 8 ro ro INTJ dad-10733 861 9 ss ss NOUN dad-10733 861 10 r r NOUN dad-10733 861 11 ed ed NOUN dad-10733 861 12 di di NOUN dad-10733 861 13 t. t. NOUN dad-10733 861 14 r r NOUN dad-10733 861 15 ed ed PROPN dad-10733 861 16 di di NOUN dad-10733 861 17 td td NOUN dad-10733 861 18 om om PROPN dad-10733 861 19 es es PROPN dad-10733 861 20 tic tic ADJ dad-10733 861 21 a a DET dad-10733 861 22 bu bu PROPN dad-10733 861 23 se se PROPN dad-10733 861 24 c c PROPN dad-10733 862 1 or or CCONJ dad-10733 862 2 pu pu PROPN dad-10733 862 3 s s VERB dad-10733 863 1 fo fo INTJ dad-10733 863 2 ru ru PROPN dad-10733 863 3 m m PROPN dad-10733 863 4 a a DET dad-10733 863 5 bu bu INTJ dad-10733 863 6 se se ADV dad-10733 863 7 he he PRON dad-10733 863 8 lp lp VERB dad-10733 863 9 17 17 NUM dad-10733 863 10 .5 .5 NUM dad-10733 863 11 3 3 NUM dad-10733 863 12 21 21 NUM dad-10733 863 13 , , PUNCT dad-10733 863 14 1 1 NUM dad-10733 863 15 33 33 NUM dad-10733 863 16 19 19 NUM dad-10733 863 17 m m NOUN dad-10733 863 18 -1 -1 NOUN dad-10733 863 19 03 03 NUM dad-10733 864 1 m m VERB dad-10733 864 2 4 4 NUM dad-10733 864 3 r r NOUN dad-10733 864 4 ed ed NOUN dad-10733 864 5 di di NOUN dad-10733 864 6 tp tp X dad-10733 864 7 os os NOUN dad-10733 864 8 ts ts INTJ dad-10733 865 1 fr fr INTJ dad-10733 865 2 om om PROPN dad-10733 866 1 ei ei INTJ dad-10733 866 2 th th INTJ dad-10733 866 3 er er INTJ dad-10733 866 4 do do AUX dad-10733 866 5 m m AUX dad-10733 866 6 es es ADP dad-10733 866 7 tic tic ADJ dad-10733 866 8 ab ab PROPN dad-10733 866 9 us us PROPN dad-10733 866 10 e e X dad-10733 866 11 ( ( PUNCT dad-10733 866 12 s s PROPN dad-10733 866 13 ch ch PROPN dad-10733 866 14 ra ra PROPN dad-10733 866 15 di di INTJ dad-10733 866 16 ng ng PROPN dad-10733 866 17 et et PROPN dad-10733 866 18 al al PROPN dad-10733 866 19 . . PROPN dad-10733 866 20 , , PUNCT dad-10733 866 21 20 20 NUM dad-10733 866 22 15 15 NUM dad-10733 866 23 ) ) PUNCT dad-10733 866 24 su su NOUN dad-10733 866 25 br br PROPN dad-10733 866 26 ed ed PROPN dad-10733 866 27 di di NOUN dad-10733 866 28 ts ts X dad-10733 866 29 , , PUNCT dad-10733 866 30 o o INTJ dad-10733 866 31 rg rg X dad-10733 866 32 en en INTJ dad-10733 866 33 er er INTJ dad-10733 866 34 al al PROPN dad-10733 866 35 ch ch PROPN dad-10733 866 36 at at ADP dad-10733 866 37 . . PUNCT dad-10733 867 1 se se PROPN dad-10733 867 2 ttl ttl PROPN dad-10733 867 3 er er INTJ dad-10733 867 4 s s PROPN dad-10733 867 5 of of ADP dad-10733 867 6 c c PROPN dad-10733 867 7 at at ADP dad-10733 867 8 an an DET dad-10733 867 9 c c NOUN dad-10733 867 10 ha ha INTJ dad-10733 867 11 t t PROPN dad-10733 867 12 g g PROPN dad-10733 867 13 am be AUX dad-10733 867 14 e e NOUN dad-10733 867 15 te te ADP dad-10733 867 16 rm rm PROPN dad-10733 867 17 s s PROPN dad-10733 867 18 95 95 NUM dad-10733 867 19 21 21 NUM dad-10733 867 20 – – PUNCT dad-10733 867 21 c c NOUN dad-10733 867 22 on on ADP dad-10733 867 23 ve ve VERB dad-10733 867 24 rs r VERB dad-10733 867 25 at at ADP dad-10733 867 26 io io PROPN dad-10733 867 27 ns ns PROPN dad-10733 867 28 be be PROPN dad-10733 867 29 tw tw INTJ dad-10733 867 30 ee ee ADP dad-10733 867 31 n n ADV dad-10733 867 32 pl pl INTJ dad-10733 867 33 ay ay INTJ dad-10733 868 1 er er INTJ dad-10733 868 2 s s X dad-10733 868 3 ( ( PUNCT dad-10733 868 4 a a DET dad-10733 868 5 fa fa X dad-10733 868 6 nt not PART dad-10733 868 7 en en ADV dad-10733 868 8 os os NOUN dad-10733 868 9 et et PROPN dad-10733 868 10 al al PROPN dad-10733 868 11 . . PUNCT dad-10733 868 12 , , PUNCT dad-10733 868 13 20 20 NUM dad-10733 868 14 12 12 NUM dad-10733 868 15 ) ) PUNCT dad-10733 868 16 in in ADP dad-10733 868 17 th th X dad-10733 868 18 e e X dad-10733 868 19 ga ga PROPN dad-10733 868 20 m m PROPN dad-10733 868 21 e e NOUN dad-10733 868 22 ‘s ‘s NOUN dad-10733 868 23 et et NOUN dad-10733 868 24 tle tle NOUN dad-10733 868 25 rs rs NOUN dad-10733 868 26 of of ADP dad-10733 868 27 c c PROPN dad-10733 868 28 at at ADP dad-10733 868 29 an an PRON dad-10733 868 30 . . PUNCT dad-10733 868 31 ’ ' PUNCT dad-10733 869 1 c c NOUN dad-10733 869 2 ar ar NOUN dad-10733 869 3 ds ds PROPN dad-10733 869 4 c c PROPN dad-10733 869 5 or or CCONJ dad-10733 869 6 pu pu PROPN dad-10733 869 7 s s PROPN dad-10733 870 1 c c AUX dad-10733 870 2 ha ha INTJ dad-10733 870 3 t t PROPN dad-10733 870 4 g g PROPN dad-10733 870 5 am be AUX dad-10733 870 6 e e NOUN dad-10733 870 7 te te ADP dad-10733 870 8 rm rm PROPN dad-10733 870 9 s s PROPN dad-10733 870 10 38 38 NUM dad-10733 870 11 .1 .1 NUM dad-10733 870 12 1 1 NUM dad-10733 870 13 , , PUNCT dad-10733 870 14 26 26 NUM dad-10733 870 15 6 6 NUM dad-10733 870 16 28 28 NUM dad-10733 870 17 2k 2k NUM dad-10733 870 18 c c PROPN dad-10733 870 19 on on ADP dad-10733 870 20 ve ve VERB dad-10733 870 21 rs r VERB dad-10733 870 22 at at ADP dad-10733 870 23 io io PROPN dad-10733 870 24 ns ns PROPN dad-10733 870 25 be be PROPN dad-10733 870 26 tw tw INTJ dad-10733 870 27 ee ee ADP dad-10733 870 28 n n ADV dad-10733 870 29 pl pl INTJ dad-10733 870 30 ay ay INTJ dad-10733 871 1 er er INTJ dad-10733 871 2 s s X dad-10733 871 3 ( ( PUNCT dad-10733 871 4 d d X dad-10733 871 5 ja ja PROPN dad-10733 871 6 la la PROPN dad-10733 871 7 li li PROPN dad-10733 871 8 et et PROPN dad-10733 871 9 al al PROPN dad-10733 871 10 . . PUNCT dad-10733 871 11 , , PUNCT dad-10733 871 12 20 20 NUM dad-10733 871 13 12 12 NUM dad-10733 871 14 ) ) PUNCT dad-10733 871 15 pl pl NOUN dad-10733 871 16 ay ay NOUN dad-10733 871 17 in in ADP dad-10733 871 18 g g PROPN dad-10733 871 19 ‘ ' PUNCT dad-10733 871 20 c c X dad-10733 871 21 ar ar NOUN dad-10733 871 22 ds ds PROPN dad-10733 871 23 w w PROPN dad-10733 871 24 or or CCONJ dad-10733 871 25 ld ld PROPN dad-10733 871 26 . . PUNCT dad-10733 871 27 ’ ' PUNCT dad-10733 872 1 a a DET dad-10733 872 2 gr gr INTJ dad-10733 872 3 ee ee NOUN dad-10733 872 4 m m PROPN dad-10733 872 5 en en ADP dad-10733 872 6 ti ti PROPN dad-10733 872 7 n n PROPN dad-10733 872 8 w w PROPN dad-10733 872 9 ik ik PROPN dad-10733 872 10 ip ip PROPN dad-10733 872 11 ed ed PROPN dad-10733 872 12 ia ia PROPN dad-10733 872 13 ta ta PROPN dad-10733 872 14 lk lk PROPN dad-10733 872 15 pa pa PROPN dad-10733 872 16 ge ge PROPN dad-10733 872 17 s s PART dad-10733 873 1 fo fo INTJ dad-10733 873 2 ru ru PROPN dad-10733 873 3 m m PROPN dad-10733 873 4 u u NOUN dad-10733 873 5 nr nr NOUN dad-10733 873 6 es es PROPN dad-10733 873 7 tr tr PROPN dad-10733 873 8 ic ic PROPN dad-10733 873 9 te te PROPN dad-10733 873 10 d d PROPN dad-10733 873 11 2 2 NUM dad-10733 873 12 82 82 NUM dad-10733 873 13 2 2 NUM dad-10733 873 14 11 11 NUM dad-10733 873 15 0k 0k NOUN dad-10733 873 16 l l NOUN dad-10733 873 17 iv iv X dad-10733 873 18 ej ej PROPN dad-10733 873 19 ou ou PROPN dad-10733 873 20 rn rn PROPN dad-10733 873 21 al al PROPN dad-10733 873 22 an an PROPN dad-10733 873 23 d d X dad-10733 873 24 w w PROPN dad-10733 873 25 ik ik PROPN dad-10733 873 26 ip ip PROPN dad-10733 873 27 ed ed PROPN dad-10733 873 28 ia ia PROPN dad-10733 873 29 d d PROPN dad-10733 873 30 is be AUX dad-10733 873 31 cu cu PROPN dad-10733 873 32 ss ss NOUN dad-10733 873 33 io io PROPN dad-10733 874 1 ns ns INTJ dad-10733 874 2 fo fo ADP dad-10733 874 3 ru ru PROPN dad-10733 874 4 m m PROPN dad-10733 874 5 ( ( PUNCT dad-10733 874 6 a a PRON dad-10733 874 7 nd nd ADV dad-10733 874 8 re re NOUN dad-10733 874 9 as as ADP dad-10733 874 10 et et PROPN dad-10733 874 11 al al PROPN dad-10733 874 12 . . PUNCT dad-10733 874 13 , , PUNCT dad-10733 874 14 20 20 NUM dad-10733 874 15 12 12 NUM dad-10733 874 16 ) ) PUNCT dad-10733 874 17 th th NOUN dad-10733 874 18 re re ADP dad-10733 874 19 ad ad PROPN dad-10733 874 20 s. s. PROPN dad-10733 874 21 a a DET dad-10733 874 22 gr gr INTJ dad-10733 874 23 ee ee PROPN dad-10733 874 24 m m PROPN dad-10733 874 25 en en ADP dad-10733 874 26 tt tt PROPN dad-10733 874 27 yp yp PROPN dad-10733 874 28 e e PROPN dad-10733 874 29 an an PROPN dad-10733 874 30 d d X dad-10733 874 31 le le X dad-10733 874 32 ve ve PROPN dad-10733 874 33 la la ADV dad-10733 874 34 nn nn PROPN dad-10733 874 35 ot ot NOUN dad-10733 874 36 at at ADP dad-10733 874 37 ed ed PROPN dad-10733 874 38 . . PUNCT dad-10733 875 1 a a DET dad-10733 875 2 gr gr INTJ dad-10733 875 3 ee ee PROPN dad-10733 875 4 m m PROPN dad-10733 875 5 en en ADP dad-10733 875 6 tb tb X dad-10733 875 7 y y PROPN dad-10733 875 8 c c X dad-10733 875 9 re re VERB dad-10733 875 10 at at ADP dad-10733 875 11 e e PROPN dad-10733 875 12 d d PROPN dad-10733 875 13 eb eb PROPN dad-10733 875 14 at at ADP dad-10733 875 15 er er INTJ dad-10733 875 16 s s VERB dad-10733 876 1 fo fo INTJ dad-10733 876 2 ru ru PROPN dad-10733 876 3 m m PROPN dad-10733 876 4 u u NOUN dad-10733 876 5 nr nr NOUN dad-10733 876 6 es es PROPN dad-10733 876 7 tr tr PROPN dad-10733 876 8 ic ic PROPN dad-10733 876 9 te te PROPN dad-10733 876 10 d d PROPN dad-10733 876 11 2 2 NUM dad-10733 876 12 10 10 NUM dad-10733 876 13 k k NOUN dad-10733 876 14 1 1 NUM dad-10733 876 15 . . NOUN dad-10733 876 16 4 4 NUM dad-10733 876 17 m m NOUN dad-10733 876 18 c c NOUN dad-10733 876 19 re re NOUN dad-10733 876 20 at at ADP dad-10733 876 21 e e PROPN dad-10733 876 22 d d PROPN dad-10733 876 23 eb eb PROPN dad-10733 876 24 at at ADP dad-10733 876 25 e e PROPN dad-10733 876 26 fo fo ADP dad-10733 876 27 ru ru PROPN dad-10733 876 28 m m PROPN dad-10733 876 29 co co PROPN dad-10733 876 30 nv nv PROPN dad-10733 876 31 er er INTJ dad-10733 876 32 sa sa PROPN dad-10733 876 33 tio tio PROPN dad-10733 876 34 ns ns PROPN dad-10733 876 35 .a .a PROPN dad-10733 876 36 nn nn PROPN dad-10733 877 1 ot ot NOUN dad-10733 877 2 at at ADP dad-10733 877 3 ed ed PROPN dad-10733 877 4 ( ( PUNCT dad-10733 877 5 r r NOUN dad-10733 877 6 os os NOUN dad-10733 877 7 en en X dad-10733 877 8 th th X dad-10733 877 9 al al PROPN dad-10733 878 1 an an PROPN dad-10733 878 2 d d NOUN dad-10733 878 3 m m VERB dad-10733 878 4 ck ck INTJ dad-10733 878 5 eo eo PROPN dad-10733 878 6 w w PROPN dad-10733 878 7 n n CCONJ dad-10733 878 8 , , PUNCT dad-10733 878 9 20 20 NUM dad-10733 878 10 15 15 NUM dad-10733 878 11 ) ) PUNCT dad-10733 878 12 w w NOUN dad-10733 878 13 ith ith INTJ dad-10733 878 14 ty ty INTJ dad-10733 878 15 pe pe INTJ dad-10733 878 16 of of ADP dad-10733 878 17 ag ag PROPN dad-10733 878 18 re re VERB dad-10733 878 19 em em PRON dad-10733 878 20 en en INTJ dad-10733 878 21 to to ADP dad-10733 878 22 rd rd PROPN dad-10733 878 23 is be AUX dad-10733 878 24 ag ag PROPN dad-10733 878 25 re re ADP dad-10733 878 26 em em PRON dad-10733 878 27 en en ADP dad-10733 878 28 t. t. PROPN dad-10733 878 29 in in ADP dad-10733 878 30 te te PROPN dad-10733 878 31 rn rn PROPN dad-10733 878 32 et et PROPN dad-10733 878 33 a a DET dad-10733 878 34 rg rg X dad-10733 878 35 um um INTJ dad-10733 878 36 en en ADP dad-10733 878 37 tc tc NOUN dad-10733 879 1 or or CCONJ dad-10733 879 2 pu pu PROPN dad-10733 879 3 s s PART dad-10733 880 1 fo fo INTJ dad-10733 880 2 ru ru PROPN dad-10733 880 3 m m PROPN dad-10733 880 4 po po NOUN dad-10733 880 5 lit light VERB dad-10733 880 6 ic ic PROPN dad-10733 880 7 s s PROPN dad-10733 880 8 35 35 NUM dad-10733 880 9 .4 .4 NUM dad-10733 880 10 5 5 NUM dad-10733 880 11 11 11 NUM dad-10733 880 12 k k NOUN dad-10733 880 13 73 73 NUM dad-10733 880 14 m m NOUN dad-10733 880 15 d d PROPN dad-10733 880 16 eb eb PROPN dad-10733 880 17 at at ADP dad-10733 880 18 es es X dad-10733 880 19 ab ab PROPN dad-10733 880 20 ou ou ADV dad-10733 880 21 ts ts ADP dad-10733 880 22 pe pe PROPN dad-10733 880 23 ci ci PROPN dad-10733 880 24 fic fic PROPN dad-10733 881 1 ( ( PUNCT dad-10733 881 2 w w PROPN dad-10733 881 3 al al PROPN dad-10733 881 4 ke ke PROPN dad-10733 881 5 re re PROPN dad-10733 881 6 ta ta PROPN dad-10733 881 7 l. l. PROPN dad-10733 881 8 , , PUNCT dad-10733 881 9 20 20 NUM dad-10733 881 10 12 12 NUM dad-10733 881 11 b b NOUN dad-10733 881 12 ) ) PUNCT dad-10733 881 13 po po NOUN dad-10733 881 14 lit light VERB dad-10733 881 15 ic ic PROPN dad-10733 881 16 al al PROPN dad-10733 881 17 or or CCONJ dad-10733 881 18 m m PROPN dad-10733 881 19 or or CCONJ dad-10733 881 20 al al PROPN dad-10733 881 21 po po PROPN dad-10733 881 22 si si PROPN dad-10733 881 23 tio tio PROPN dad-10733 881 24 ns ns INTJ dad-10733 881 25 . . PUNCT dad-10733 882 1 m m VERB dad-10733 882 2 pc pc NOUN dad-10733 882 3 c c NOUN dad-10733 883 1 or or CCONJ dad-10733 883 2 pu pu PROPN dad-10733 883 3 s s PROPN dad-10733 883 4 c c X dad-10733 883 5 ha ha INTJ dad-10733 883 6 t t PROPN dad-10733 884 1 so so ADV dad-10733 884 2 ci ci PROPN dad-10733 884 3 al al PROPN dad-10733 884 4 ta ta PROPN dad-10733 884 5 sk sk VERB dad-10733 884 6 s s PROPN dad-10733 884 7 52 52 NUM dad-10733 884 8 0 0 NUM dad-10733 884 9 14 14 NUM dad-10733 884 10 58 58 NUM dad-10733 885 1 k k NOUN dad-10733 885 2 c c PROPN dad-10733 885 3 on on ADP dad-10733 885 4 ve ve VERB dad-10733 885 5 rs r VERB dad-10733 885 6 at at ADP dad-10733 885 7 io io PROPN dad-10733 885 8 ns ns X dad-10733 885 9 ab ab PROPN dad-10733 885 10 ou ou X dad-10733 885 11 tg tg PROPN dad-10733 885 12 en en PROPN dad-10733 885 13 er er INTJ dad-10733 885 14 al al PROPN dad-10733 885 15 , , PUNCT dad-10733 885 16 ( ( PUNCT dad-10733 885 17 s s VERB dad-10733 885 18 ha ha INTJ dad-10733 885 19 ik ik PROPN dad-10733 885 20 h h PROPN dad-10733 885 21 et et PROPN dad-10733 885 22 al al PROPN dad-10733 885 23 . . PUNCT dad-10733 885 24 , , PUNCT dad-10733 885 25 20 20 NUM dad-10733 885 26 10 10 NUM dad-10733 885 27 ) ) PUNCT dad-10733 885 28 po po NOUN dad-10733 885 29 lit light VERB dad-10733 885 30 ic ic PROPN dad-10733 885 31 al al PROPN dad-10733 885 32 , , PUNCT dad-10733 885 33 a a DET dad-10733 885 34 nd nd NOUN dad-10733 885 35 in in ADP dad-10733 885 36 te te PROPN dad-10733 885 37 rv rv PROPN dad-10733 885 38 ie ie X dad-10733 885 39 w w PROPN dad-10733 885 40 to to ADP dad-10733 885 41 pi pi PROPN dad-10733 885 42 cs cs PROPN dad-10733 885 43 . . PUNCT dad-10733 886 1 u u PRON dad-10733 887 1 bu bu PROPN dad-10733 887 2 nt not PART dad-10733 887 3 u u PROPN dad-10733 888 1 d d PROPN dad-10733 888 2 ia ia PROPN dad-10733 888 3 lo lo PROPN dad-10733 888 4 gu gu NOUN dad-10733 888 5 e e PROPN dad-10733 888 6 c c PROPN dad-10733 888 7 or or CCONJ dad-10733 888 8 pu pu PROPN dad-10733 888 9 s s PROPN dad-10733 889 1 c c X dad-10733 889 2 ha ha INTJ dad-10733 889 3 t t X dad-10733 889 4 u u NOUN dad-10733 889 5 bu bu INTJ dad-10733 889 6 nt not PART dad-10733 889 7 u u NOUN dad-10733 889 8 o o NOUN dad-10733 889 9 pe pe INTJ dad-10733 889 10 ra ra PROPN dad-10733 889 11 tin tin NOUN dad-10733 889 12 g g PROPN dad-10733 889 13 7 7 NUM dad-10733 889 14 . . PUNCT dad-10733 889 15 71 71 NUM dad-10733 889 16 93 93 NUM dad-10733 889 17 0k 0k NOUN dad-10733 889 18 10 10 NUM dad-10733 889 19 0 0 NUM dad-10733 889 20 m m NOUN dad-10733 889 21 d d PROPN dad-10733 889 22 ia ia NOUN dad-10733 889 23 lo lo PROPN dad-10733 889 24 gu gu NOUN dad-10733 889 25 es es X dad-10733 889 26 ex ex PRON dad-10733 889 27 tr tr VERB dad-10733 889 28 ac ac PROPN dad-10733 889 29 te te PROPN dad-10733 890 1 d d NOUN dad-10733 890 2 fr fr INTJ dad-10733 890 3 om om PROPN dad-10733 891 1 ( ( PUNCT dad-10733 891 2 l l NOUN dad-10733 891 3 ow ow INTJ dad-10733 891 4 e e X dad-10733 891 5 et et NOUN dad-10733 891 6 al al PROPN dad-10733 891 7 . . PUNCT dad-10733 891 8 , , PUNCT dad-10733 891 9 20 20 NUM dad-10733 891 10 15 15 NUM dad-10733 891 11 a a PRON dad-10733 891 12 ) ) PUNCT dad-10733 892 1 sy sy PROPN dad-10733 892 2 st st PROPN dad-10733 893 1 em em PRON dad-10733 893 2 u u INTJ dad-10733 893 3 bu bu VERB dad-10733 893 4 nt not PART dad-10733 893 5 u u PROPN dad-10733 893 6 ch ch NOUN dad-10733 893 7 at at ADP dad-10733 893 8 st st PROPN dad-10733 893 9 re re VERB dad-10733 893 10 am be AUX dad-10733 893 11 on on ADP dad-10733 893 12 ir ir PROPN dad-10733 893 13 c c NOUN dad-10733 893 14 . . PUNCT dad-10733 894 1 u u PRON dad-10733 894 2 bu bu VERB dad-10733 894 3 nt not PART dad-10733 894 4 u u VERB dad-10733 895 1 c c NOUN dad-10733 895 2 ha ha INTJ dad-10733 895 3 tc tc INTJ dad-10733 895 4 or or CCONJ dad-10733 895 5 pu pu PROPN dad-10733 895 6 s s PROPN dad-10733 896 1 c c X dad-10733 896 2 ha ha INTJ dad-10733 896 3 t t X dad-10733 896 4 u u NOUN dad-10733 896 5 bu bu INTJ dad-10733 896 6 nt not PART dad-10733 896 7 u u NOUN dad-10733 896 8 o o NOUN dad-10733 896 9 pe pe INTJ dad-10733 896 10 ra ra PROPN dad-10733 896 11 tin tin NOUN dad-10733 896 12 g g PROPN dad-10733 896 13 33 33 NUM dad-10733 896 14 81 81 NUM dad-10733 896 15 .6 .6 NUM dad-10733 896 16 10 10 NUM dad-10733 896 17 66 66 NUM dad-10733 896 18 5† 5† NUM dad-10733 896 19 2b 2b NOUN dad-10733 896 20 * * SYM dad-10733 896 21 2 2 NUM dad-10733 896 22 c c NOUN dad-10733 896 23 ha ha INTJ dad-10733 896 24 ts ts X dad-10733 896 25 tr tr PROPN dad-10733 896 26 ea ea PROPN dad-10733 896 27 m m PROPN dad-10733 896 28 sc sc PROPN dad-10733 896 29 ra ra INTJ dad-10733 897 1 pe pe INTJ dad-10733 898 1 d d NOUN dad-10733 898 2 fr fr INTJ dad-10733 898 3 om om PROPN dad-10733 898 4 ( ( PUNCT dad-10733 898 5 u u X dad-10733 898 6 th th X dad-10733 898 7 us we PRON dad-10733 899 1 an an PRON dad-10733 899 2 d d X dad-10733 899 3 a a DET dad-10733 899 4 ha ha INTJ dad-10733 899 5 , , PUNCT dad-10733 899 6 2 2 NUM dad-10733 899 7 01 01 NUM dad-10733 899 8 3 3 NUM dad-10733 899 9 ) ) PUNCT dad-10733 899 10 sy sy PROPN dad-10733 899 11 st st PROPN dad-10733 899 12 em em PRON dad-10733 900 1 ir ir INTJ dad-10733 900 2 c c NOUN dad-10733 900 3 lo lo INTJ dad-10733 900 4 gs gs INTJ dad-10733 900 5 ( ( PUNCT dad-10733 900 6 n n CCONJ dad-10733 900 7 o o PROPN dad-10733 900 8 di di X dad-10733 900 9 al al PROPN dad-10733 900 10 og og PROPN dad-10733 901 1 ue ue PROPN dad-10733 901 2 s s X dad-10733 901 3 ex ex PUNCT dad-10733 901 4 tr tr VERB dad-10733 901 5 ac ac PROPN dad-10733 901 6 te te PROPN dad-10733 901 7 d d PROPN dad-10733 901 8 ) ) PUNCT dad-10733 901 9 . . PUNCT dad-10733 902 1 m m VERB dad-10733 902 2 ov ov INTJ dad-10733 903 1 ie ie ADV dad-10733 903 2 d d PROPN dad-10733 903 3 ia ia NOUN dad-10733 904 1 lo lo NOUN dad-10733 904 2 g g PROPN dad-10733 905 1 d d PROPN dad-10733 905 2 at at ADP dad-10733 905 3 as as ADP dad-10733 905 4 et et NOUN dad-10733 905 5 c c PROPN dad-10733 905 6 ha ha INTJ dad-10733 905 7 t t PROPN dad-10733 905 8 , , PUNCT dad-10733 905 9 q q PROPN dad-10733 905 10 a a PROPN dad-10733 905 11 & & CCONJ dad-10733 905 12 m m PROPN dad-10733 905 13 ov ov PROPN dad-10733 905 14 ie ie X dad-10733 905 15 s s PROPN dad-10733 905 16 3 3 NUM dad-10733 905 17 . . NOUN dad-10733 905 18 3 3 NUM dad-10733 905 19 3 3 NUM dad-10733 905 20 . . NOUN dad-10733 906 1 1 1 NUM dad-10733 906 2 m m NOUN dad-10733 906 3 h h NOUN dad-10733 906 4 18 18 NUM dad-10733 906 5 5 5 NUM dad-10733 906 6 m m NOUN dad-10733 906 7 fo fo INTJ dad-10733 906 8 rg rg INTJ dad-10733 906 9 oa oa PROPN dad-10733 906 10 ldr ldr PROPN dad-10733 906 11 iv iv NUM dad-10733 906 12 en en X dad-10733 906 13 di di X dad-10733 906 14 al al PROPN dad-10733 906 15 og og PROPN dad-10733 906 16 ue ue PROPN dad-10733 906 17 sy sy PROPN dad-10733 906 18 st st PROPN dad-10733 906 19 em em PROPN dad-10733 906 20 s. s. PROPN dad-10733 906 21 in in ADP dad-10733 906 22 cl cl NOUN dad-10733 906 23 ud ud INTJ dad-10733 906 24 es es INTJ dad-10733 906 25 ( ( PUNCT dad-10733 906 26 d d X dad-10733 906 27 od od X dad-10733 906 28 ge ge PROPN dad-10733 906 29 et et PROPN dad-10733 906 30 al al PROPN dad-10733 906 31 . . PROPN dad-10733 906 32 , , PUNCT dad-10733 906 33 20 20 NUM dad-10733 906 34 15 15 NUM dad-10733 906 35 ) ) PUNCT dad-10733 906 36 r r NOUN dad-10733 906 37 ec ec PROPN dad-10733 907 1 om om PROPN dad-10733 907 2 m m PROPN dad-10733 907 3 en en X dad-10733 907 4 da da X dad-10733 907 5 tio tio PROPN dad-10733 907 6 n n INTJ dad-10733 907 7 m m VERB dad-10733 907 8 ov ov VERB dad-10733 907 9 ie ie X dad-10733 907 10 m m PROPN dad-10733 907 11 et et NOUN dad-10733 907 12 ad ad NOUN dad-10733 907 13 at at ADP dad-10733 907 14 a a PRON dad-10733 907 15 as as ADP dad-10733 907 16 kn kn PROPN dad-10733 907 17 ow ow PROPN dad-10733 907 18 le le X dad-10733 907 19 dg dg X dad-10733 907 20 e e PRON dad-10733 907 21 tr tr VERB dad-10733 907 22 ip ip NOUN dad-10733 907 23 le le ADP dad-10733 907 24 s. s. PROPN dad-10733 908 1 d d PROPN dad-10733 908 2 ai ai VERB dad-10733 908 3 ly ly X dad-10733 909 1 d d PROPN dad-10733 909 2 ia ia PROPN dad-10733 909 3 lo lo PROPN dad-10733 909 4 g g PROPN dad-10733 910 1 c c PROPN dad-10733 910 2 ha ha INTJ dad-10733 911 1 t t PROPN dad-10733 911 2 d d NOUN dad-10733 911 3 ai ai VERB dad-10733 911 4 ly ly ADP dad-10733 911 5 l l NOUN dad-10733 911 6 if if SCONJ dad-10733 911 7 e e PROPN dad-10733 911 8 7 7 NUM dad-10733 911 9 . . NOUN dad-10733 911 10 9 9 NUM dad-10733 911 11 13 13 NUM dad-10733 911 12 k k NOUN dad-10733 911 13 1 1 NUM dad-10733 911 14 . . NOUN dad-10733 912 1 5 5 NUM dad-10733 912 2 m m NOUN dad-10733 912 3 c c NOUN dad-10733 912 4 on on ADP dad-10733 912 5 ve ve VERB dad-10733 912 6 rs r VERB dad-10733 912 7 at at ADP dad-10733 912 8 io io X dad-10733 912 9 ns ns INTJ dad-10733 912 10 ex ex X dad-10733 912 11 tr tr VERB dad-10733 912 12 ac ac PROPN dad-10733 912 13 te te PROPN dad-10733 913 1 d d NOUN dad-10733 913 2 fr fr INTJ dad-10733 913 3 om om PROPN dad-10733 913 4 e e PROPN dad-10733 913 5 ng ng PROPN dad-10733 913 6 lis lis PROPN dad-10733 913 7 h h NOUN dad-10733 913 8 la la PROPN dad-10733 913 9 ng ng PROPN dad-10733 913 10 ua ua PROPN dad-10733 913 11 ge ge PROPN dad-10733 913 12 ( ( PUNCT dad-10733 913 13 l l X dad-10733 913 14 ie ie X dad-10733 913 15 ta ta X dad-10733 913 16 l. l. PROPN dad-10733 913 17 , , PUNCT dad-10733 913 18 20 20 NUM dad-10733 913 19 17 17 NUM dad-10733 913 20 ) ) PUNCT dad-10733 913 21 ed ed NOUN dad-10733 913 22 uc uc INTJ dad-10733 913 23 at at ADP dad-10733 913 24 io io PROPN dad-10733 913 25 na na ADP dad-10733 913 26 lt lt DET dad-10733 913 27 ex ex X dad-10733 913 28 ts ts ADP dad-10733 913 29 .l .l PROPN dad-10733 913 30 ab ab PROPN dad-10733 914 1 el el PROPN dad-10733 914 2 ed ed PROPN dad-10733 914 3 w w PROPN dad-10733 914 4 ith ith PROPN dad-10733 915 1 em em PRON dad-10733 915 2 ot ot INTJ dad-10733 915 3 io io X dad-10733 915 4 ns ns INTJ dad-10733 915 5 . . PUNCT dad-10733 916 1 ta ta X dad-10733 916 2 bl bl PROPN dad-10733 916 3 e e PROPN dad-10733 916 4 5 5 NUM dad-10733 916 5 : : PUNCT dad-10733 916 6 h h NOUN dad-10733 916 7 um um INTJ dad-10733 916 8 an an PRON dad-10733 916 9 -h -h PROPN dad-10733 916 10 um um INTJ dad-10733 916 11 an an DET dad-10733 916 12 w w PROPN dad-10733 916 13 ri ri PROPN dad-10733 916 14 tte tte PROPN dad-10733 916 15 n n X dad-10733 916 16 di di NOUN dad-10733 916 17 al al PROPN dad-10733 916 18 og og PROPN dad-10733 916 19 ue ue PROPN dad-10733 916 20 da da PROPN dad-10733 916 21 ta ta PROPN dad-10733 916 22 se se PROPN dad-10733 916 23 ts ts PROPN dad-10733 916 24 . . PUNCT dad-10733 917 1 st st PROPN dad-10733 917 2 ar ar PROPN dad-10733 917 3 re re PROPN dad-10733 917 4 d d PROPN dad-10733 917 5 ( ( PUNCT dad-10733 917 6 * * PUNCT dad-10733 917 7 ) ) PUNCT dad-10733 917 8 q q PROPN dad-10733 917 9 ua ua PROPN dad-10733 917 10 nt nt PROPN dad-10733 917 11 iti iti PROPN dad-10733 917 12 es es PROPN dad-10733 917 13 ar ar PROPN dad-10733 917 14 e e PROPN dad-10733 917 15 co co NOUN dad-10733 917 16 m m PROPN dad-10733 917 17 pu pu PROPN dad-10733 917 18 te te PROPN dad-10733 918 1 d d VERB dad-10733 918 2 us we PRON dad-10733 918 3 in in ADP dad-10733 918 4 g g PROPN dad-10733 918 5 w w PROPN dad-10733 918 6 or or CCONJ dad-10733 918 7 d d PROPN dad-10733 918 8 co co PROPN dad-10733 918 9 un un PROPN dad-10733 918 10 ts ts PROPN dad-10733 919 1 ba ba PROPN dad-10733 919 2 se se PROPN dad-10733 920 1 d d PROPN dad-10733 920 2 on on ADP dad-10733 920 3 sp sp ADP dad-10733 920 4 ac ac PROPN dad-10733 920 5 es es PROPN dad-10733 920 6 . . PUNCT dad-10733 921 1 tr tr VERB dad-10733 921 2 ia ia PROPN dad-10733 921 3 ng ng PROPN dad-10733 921 4 le le X dad-10733 921 5 ( ( PUNCT dad-10733 921 6 4 4 X dad-10733 921 7 ) ) PUNCT dad-10733 921 8 i i PRON dad-10733 921 9 nd nd VERB dad-10733 921 10 ic ic INTJ dad-10733 921 11 at at ADP dad-10733 921 12 es es X dad-10733 921 13 lo lo PROPN dad-10733 921 14 w w NOUN dad-10733 921 15 er er INTJ dad-10733 921 16 an an PRON dad-10733 921 17 d d NOUN dad-10733 921 18 up up ADP dad-10733 921 19 pe pe NOUN dad-10733 921 20 r r NOUN dad-10733 921 21 bo bo PROPN dad-10733 921 22 un un PROPN dad-10733 921 23 ds ds PROPN dad-10733 921 24 co co NOUN dad-10733 921 25 m m PROPN dad-10733 921 26 pu pu PROPN dad-10733 921 27 te te PROPN dad-10733 922 1 d d VERB dad-10733 922 2 us we PRON dad-10733 922 3 in in ADP dad-10733 922 4 g g PROPN dad-10733 922 5 av av PROPN dad-10733 922 6 er er INTJ dad-10733 922 7 ag ag PROPN dad-10733 922 8 e e PROPN dad-10733 922 9 w w PROPN dad-10733 922 10 or or CCONJ dad-10733 922 11 ds ds INTJ dad-10733 922 12 pe pe INTJ dad-10733 922 13 r r NOUN dad-10733 922 14 ut ut PROPN dad-10733 922 15 te te PROPN dad-10733 922 16 ra ra PROPN dad-10733 922 17 nc nc PROPN dad-10733 922 18 e e PROPN dad-10733 922 19 es es ADP dad-10733 922 20 tim tim PROPN dad-10733 922 21 at at ADP dad-10733 922 22 ed ed NOUN dad-10733 922 23 on on ADP dad-10733 922 24 a a DET dad-10733 922 25 si si NOUN dad-10733 922 26 m m NOUN dad-10733 922 27 ila ila NOUN dad-10733 922 28 r r NOUN dad-10733 922 29 r r NOUN dad-10733 922 30 ed ed NOUN dad-10733 922 31 di di NOUN dad-10733 922 32 tc tc NOUN dad-10733 922 33 or or CCONJ dad-10733 922 34 pu pu PROPN dad-10733 922 35 s s PROPN dad-10733 922 36 sc sc PROPN dad-10733 922 37 hr hr NOUN dad-10733 922 38 ad ad NOUN dad-10733 922 39 in in ADP dad-10733 922 40 g g PROPN dad-10733 922 41 ( ( PUNCT dad-10733 922 42 2 2 NUM dad-10733 922 43 01 01 NUM dad-10733 922 44 5 5 NUM dad-10733 922 45 ) ) PUNCT dad-10733 922 46 . . PUNCT dad-10733 923 1 sq sq PROPN dad-10733 923 2 ua ua PROPN dad-10733 923 3 re re X dad-10733 923 4 ( ( PUNCT dad-10733 923 5 2 2 NUM dad-10733 923 6 ) ) PUNCT dad-10733 923 7 in in ADP dad-10733 923 8 di di X dad-10733 923 9 ca can AUX dad-10733 923 10 te te INTJ dad-10733 923 11 s s VERB dad-10733 923 12 es es ADJ dad-10733 923 13 tim tim PROPN dad-10733 923 14 at at ADP dad-10733 923 15 es es PRON dad-10733 923 16 ba ba PROPN dad-10733 923 17 se se PROPN dad-10733 924 1 d d X dad-10733 924 2 on on ADP dad-10733 924 3 ly ly X dad-10733 924 4 on on ADP dad-10733 924 5 th th ADP dad-10733 924 6 e e X dad-10733 924 7 e e X dad-10733 924 8 ng ng PROPN dad-10733 924 9 lis lis PROPN dad-10733 924 10 h h NOUN dad-10733 924 11 pa pa PROPN dad-10733 924 12 rt rt PROPN dad-10733 924 13 of of ADP dad-10733 924 14 th th X dad-10733 924 15 e e X dad-10733 924 16 co co X dad-10733 924 17 rp rp NOUN dad-10733 924 18 us we PRON dad-10733 924 19 . . PUNCT dad-10733 925 1 d d PROPN dad-10733 925 2 ia ia PROPN dad-10733 925 3 lo lo PROPN dad-10733 925 4 gu gu NOUN dad-10733 925 5 es es X dad-10733 925 6 in in ADP dad-10733 925 7 di di X dad-10733 925 8 ca ca NOUN dad-10733 925 9 te te PROPN dad-10733 925 10 d d X dad-10733 925 11 by by ADP dad-10733 925 12 ( ( PUNCT dad-10733 925 13 † † PROPN dad-10733 925 14 ) ) PUNCT dad-10733 925 15 ar ar PROPN dad-10733 925 16 e e PROPN dad-10733 925 17 co co PROPN dad-10733 925 18 nt not PART dad-10733 925 19 ig ig PRON dad-10733 925 20 uo uo VERB dad-10733 925 21 us we PRON dad-10733 925 22 bl bl INTJ dad-10733 925 23 oc oc ADP dad-10733 925 24 ks ks PROPN dad-10733 925 25 of of ADP dad-10733 925 26 re re X dad-10733 925 27 co co PROPN dad-10733 925 28 rd rd PROPN dad-10733 925 29 ed ed PROPN dad-10733 925 30 co co PROPN dad-10733 925 31 nv nv PROPN dad-10733 925 32 er er INTJ dad-10733 925 33 sa sa PROPN dad-10733 925 34 tio tio PROPN dad-10733 925 35 n n PROPN dad-10733 925 36 in in ADP dad-10733 925 37 a a DET dad-10733 925 38 m m NOUN dad-10733 925 39 ul ul NOUN dad-10733 925 40 tipa tipa PROPN dad-10733 925 41 rt rt PROPN dad-10733 925 42 ic ic PROPN dad-10733 925 43 ip ip VERB dad-10733 925 44 an an DET dad-10733 925 45 tc tc NOUN dad-10733 926 1 ha ha INTJ dad-10733 926 2 t. t. NOUN dad-10733 926 3 fo fo INTJ dad-10733 926 4 r r PROPN dad-10733 926 5 u u NOUN dad-10733 926 6 se se X dad-10733 926 7 n n X dad-10733 926 8 et et PROPN dad-10733 926 9 , , PUNCT dad-10733 926 10 t t PROPN dad-10733 927 1 he he PRON dad-10733 927 2 av av PROPN dad-10733 927 3 er er INTJ dad-10733 927 4 ag ag PROPN dad-10733 927 5 e e PROPN dad-10733 927 6 nu nu PROPN dad-10733 927 7 m m VERB dad-10733 927 8 be be VERB dad-10733 927 9 ro ro PROPN dad-10733 927 10 f f PROPN dad-10733 927 11 tu tu PROPN dad-10733 927 12 rn rn PROPN dad-10733 927 13 s s PROPN dad-10733 927 14 ar ar PROPN dad-10733 927 15 e e PROPN dad-10733 927 16 ca can AUX dad-10733 927 17 lc lc PROPN dad-10733 927 18 ul ul INTJ dad-10733 927 19 at at ADP dad-10733 927 20 ed ed PROPN dad-10733 927 21 as as SCONJ dad-10733 927 22 th th X dad-10733 927 23 e e X dad-10733 927 24 av av PROPN dad-10733 927 25 er er INTJ dad-10733 927 26 ag ag PROPN dad-10733 927 27 e e PROPN dad-10733 927 28 nu nu PROPN dad-10733 927 29 m m VERB dad-10733 927 30 be be VERB dad-10733 927 31 ro ro PROPN dad-10733 927 32 f f PROPN dad-10733 927 33 po po PROPN dad-10733 927 34 st st PROPN dad-10733 927 35 s s PROPN dad-10733 927 36 co co X dad-10733 927 37 lle lle PROPN dad-10733 927 38 ct ct PROPN dad-10733 928 1 ed ed NOUN dad-10733 928 2 pe pe PROPN dad-10733 928 3 r r PROPN dad-10733 928 4 ne ne PROPN dad-10733 928 5 w w PROPN dad-10733 928 6 sg sg ADP dad-10733 928 7 ro ro NOUN dad-10733 928 8 up up ADP dad-10733 928 9 . . PUNCT dad-10733 929 1 ( ( PUNCT dad-10733 929 2 ‡ ‡ X dad-10733 929 3 ) ) PUNCT dad-10733 929 4 in in ADP dad-10733 929 5 di di X dad-10733 929 6 ca can AUX dad-10733 929 7 te te PROPN dad-10733 929 8 s s VERB dad-10733 929 9 an an DET dad-10733 929 10 es es X dad-10733 929 11 tim tim PROPN dad-10733 929 12 at at ADP dad-10733 929 13 e e PROPN dad-10733 930 1 ba ba PROPN dad-10733 930 2 se se PROPN dad-10733 931 1 d d PROPN dad-10733 931 2 on on ADP dad-10733 931 3 a a DET dad-10733 931 4 tw tw NOUN dad-10733 932 1 itt itt INTJ dad-10733 932 2 er er INTJ dad-10733 932 3 da da X dad-10733 932 4 ta ta X dad-10733 932 5 se se PROPN dad-10733 932 6 to to PART dad-10733 932 7 fs fs VERB dad-10733 933 1 i i PRON dad-10733 933 2 m m VERB dad-10733 933 3 ila ila INTJ dad-10733 933 4 rs rs INTJ dad-10733 934 1 iz iz INTJ dad-10733 934 2 e e PROPN dad-10733 934 3 an an PRON dad-10733 934 4 d d X dad-10733 934 5 re re X dad-10733 934 6 fe fe X dad-10733 934 7 rs rs VERB dad-10733 934 8 to to PART dad-10733 934 9 to to PART dad-10733 934 10 ke ke VERB dad-10733 934 11 ns ns PROPN dad-10733 934 12 as as ADP dad-10733 934 13 w w PROPN dad-10733 934 14 el el PROPN dad-10733 934 15 la la PROPN dad-10733 934 16 s s PROPN dad-10733 934 17 w w NOUN dad-10733 934 18 or or CCONJ dad-10733 934 19 ds ds ADJ dad-10733 934 20 . . PUNCT dad-10733 935 1 30 30 NUM dad-10733 935 2 a a DET dad-10733 935 3 survey survey NOUN dad-10733 935 4 of of ADP dad-10733 935 5 available available ADJ dad-10733 935 6 corpora corpora PROPN dad-10733 935 7 for for ADP dad-10733 935 8 building build VERB dad-10733 935 9 data data NOUN dad-10733 935 10 - - PUNCT dad-10733 935 11 driven drive VERB dad-10733 935 12 dialogue dialogue NOUN dad-10733 935 13 systems system NOUN dad-10733 935 14 4.3.2 4.3.2 NUM dad-10733 935 15 constrained constrain VERB dad-10733 935 16 written write VERB dad-10733 935 17 corpora corpora NOUN dad-10733 935 18 there there PRON dad-10733 935 19 are be VERB dad-10733 935 20 also also ADV dad-10733 935 21 several several ADJ dad-10733 935 22 written write VERB dad-10733 935 23 corpora corpora NOUN dad-10733 935 24 where where SCONJ dad-10733 935 25 users user NOUN dad-10733 935 26 are be AUX dad-10733 935 27 limited limit VERB dad-10733 935 28 in in ADP dad-10733 935 29 terms term NOUN dad-10733 935 30 of of ADP dad-10733 935 31 topics topic NOUN dad-10733 935 32 of of ADP dad-10733 935 33 conversation conversation NOUN dad-10733 935 34 . . PUNCT dad-10733 936 1 for for ADP dad-10733 936 2 example example NOUN dad-10733 936 3 , , PUNCT dad-10733 936 4 the the DET dad-10733 936 5 settlers settler NOUN dad-10733 936 6 of of ADP dad-10733 936 7 catan catan PROPN dad-10733 936 8 corpus corpus PROPN dad-10733 936 9 ( ( PUNCT dad-10733 936 10 afantenos afantenos PROPN dad-10733 936 11 et et PROPN dad-10733 936 12 al al PROPN dad-10733 936 13 . . PROPN dad-10733 936 14 , , PUNCT dad-10733 936 15 2012 2012 NUM dad-10733 936 16 ) ) PUNCT dad-10733 936 17 contains contain VERB dad-10733 936 18 logs log NOUN dad-10733 936 19 of of ADP dad-10733 936 20 40 40 NUM dad-10733 936 21 games game NOUN dad-10733 936 22 of of ADP dad-10733 936 23 ‘ ' PUNCT dad-10733 936 24 settlers settler NOUN dad-10733 936 25 of of ADP dad-10733 936 26 catan catan PROPN dad-10733 936 27 ’ ' PUNCT dad-10733 936 28 , , PUNCT dad-10733 936 29 with with ADP dad-10733 936 30 about about ADV dad-10733 936 31 80,000 80,000 NUM dad-10733 936 32 total total ADJ dad-10733 936 33 labeled label VERB dad-10733 936 34 utterances utterance NOUN dad-10733 936 35 . . PUNCT dad-10733 937 1 the the DET dad-10733 937 2 game game NOUN dad-10733 937 3 is be AUX dad-10733 937 4 played play VERB dad-10733 937 5 with with ADP dad-10733 937 6 up up ADP dad-10733 937 7 to to PART dad-10733 937 8 4 4 NUM dad-10733 937 9 players player NOUN dad-10733 937 10 , , PUNCT dad-10733 937 11 and and CCONJ dad-10733 937 12 is be AUX dad-10733 937 13 predicated predicate VERB dad-10733 937 14 on on ADP dad-10733 937 15 trading trade VERB dad-10733 937 16 certain certain ADJ dad-10733 937 17 goods good NOUN dad-10733 937 18 between between ADP dad-10733 937 19 players player NOUN dad-10733 937 20 . . PUNCT dad-10733 938 1 the the DET dad-10733 938 2 goal goal NOUN dad-10733 938 3 of of ADP dad-10733 938 4 the the DET dad-10733 938 5 game game NOUN dad-10733 938 6 is be AUX dad-10733 938 7 to to PART dad-10733 938 8 be be AUX dad-10733 938 9 the the DET dad-10733 938 10 first first ADJ dad-10733 938 11 player player NOUN dad-10733 938 12 to to PART dad-10733 938 13 achieve achieve VERB dad-10733 938 14 a a DET dad-10733 938 15 pre pre ADJ dad-10733 938 16 - - ADJ dad-10733 938 17 specified specified ADJ dad-10733 938 18 number number NOUN dad-10733 938 19 of of ADP dad-10733 938 20 points point NOUN dad-10733 938 21 . . PUNCT dad-10733 939 1 therefore therefore ADV dad-10733 939 2 , , PUNCT dad-10733 939 3 the the DET dad-10733 939 4 game game NOUN dad-10733 939 5 is be AUX dad-10733 939 6 adversarial adversarial ADJ dad-10733 939 7 in in ADP dad-10733 939 8 nature nature NOUN dad-10733 939 9 , , PUNCT dad-10733 939 10 and and CCONJ dad-10733 939 11 can can AUX dad-10733 939 12 be be AUX dad-10733 939 13 used use VERB dad-10733 939 14 to to PART dad-10733 939 15 analyze analyze VERB dad-10733 939 16 situations situation NOUN dad-10733 939 17 of of ADP dad-10733 939 18 strategic strategic ADJ dad-10733 939 19 conversation conversation NOUN dad-10733 939 20 where where SCONJ dad-10733 939 21 the the DET dad-10733 939 22 agents agent NOUN dad-10733 939 23 have have AUX dad-10733 939 24 diverging diverge VERB dad-10733 939 25 motives motive NOUN dad-10733 939 26 . . PUNCT dad-10733 940 1 another another DET dad-10733 940 2 corpus corpus NOUN dad-10733 940 3 that that PRON dad-10733 940 4 deals deal VERB dad-10733 940 5 with with ADP dad-10733 940 6 game game NOUN dad-10733 940 7 playing playing NOUN dad-10733 940 8 is be AUX dad-10733 940 9 the the DET dad-10733 940 10 cards card NOUN dad-10733 940 11 corpus corpus NOUN dad-10733 940 12 ( ( PUNCT dad-10733 940 13 djalali djalali PROPN dad-10733 940 14 et et PROPN dad-10733 940 15 al al PROPN dad-10733 940 16 . . PROPN dad-10733 940 17 , , PUNCT dad-10733 940 18 2012 2012 NUM dad-10733 940 19 ) ) PUNCT dad-10733 940 20 , , PUNCT dad-10733 940 21 which which PRON dad-10733 940 22 consists consist VERB dad-10733 940 23 of of ADP dad-10733 940 24 1,266 1,266 NUM dad-10733 940 25 transcripts transcript NOUN dad-10733 940 26 of of ADP dad-10733 940 27 conversations conversation NOUN dad-10733 940 28 between between ADP dad-10733 940 29 players player NOUN dad-10733 940 30 playing play VERB dad-10733 940 31 a a DET dad-10733 940 32 game game NOUN dad-10733 940 33 in in ADP dad-10733 940 34 the the DET dad-10733 940 35 ‘ ' PUNCT dad-10733 940 36 cards card NOUN dad-10733 940 37 world world NOUN dad-10733 940 38 ’ ' PUNCT dad-10733 940 39 . . PUNCT dad-10733 941 1 this this DET dad-10733 941 2 world world NOUN dad-10733 941 3 is be AUX dad-10733 941 4 a a DET dad-10733 941 5 simple simple ADJ dad-10733 941 6 2 2 NUM dad-10733 941 7 - - PUNCT dad-10733 941 8 d d NOUN dad-10733 941 9 environment environment NOUN dad-10733 941 10 where where SCONJ dad-10733 941 11 players player NOUN dad-10733 941 12 collaborate collaborate VERB dad-10733 941 13 to to PART dad-10733 941 14 collect collect VERB dad-10733 941 15 cards card NOUN dad-10733 941 16 . . PUNCT dad-10733 942 1 the the DET dad-10733 942 2 goal goal NOUN dad-10733 942 3 of of ADP dad-10733 942 4 the the DET dad-10733 942 5 game game NOUN dad-10733 942 6 is be AUX dad-10733 942 7 to to PART dad-10733 942 8 collect collect VERB dad-10733 942 9 six six NUM dad-10733 942 10 cards card NOUN dad-10733 942 11 of of ADP dad-10733 942 12 a a DET dad-10733 942 13 particular particular ADJ dad-10733 942 14 suit suit NOUN dad-10733 942 15 ( ( PUNCT dad-10733 942 16 cards card NOUN dad-10733 942 17 in in ADP dad-10733 942 18 the the DET dad-10733 942 19 environment environment NOUN dad-10733 942 20 are be AUX dad-10733 942 21 only only ADV dad-10733 942 22 visible visible ADJ dad-10733 942 23 to to ADP dad-10733 942 24 a a DET dad-10733 942 25 player player NOUN dad-10733 942 26 when when SCONJ dad-10733 942 27 they they PRON dad-10733 942 28 are be AUX dad-10733 942 29 near near ADP dad-10733 942 30 the the DET dad-10733 942 31 location location NOUN dad-10733 942 32 of of ADP dad-10733 942 33 that that DET dad-10733 942 34 player player NOUN dad-10733 942 35 ) ) PUNCT dad-10733 942 36 , , PUNCT dad-10733 942 37 or or CCONJ dad-10733 942 38 to to PART dad-10733 942 39 determine determine VERB dad-10733 942 40 that that SCONJ dad-10733 942 41 this this DET dad-10733 942 42 goal goal NOUN dad-10733 942 43 is be AUX dad-10733 942 44 impossible impossible ADJ dad-10733 942 45 in in ADP dad-10733 942 46 the the DET dad-10733 942 47 environment environment NOUN dad-10733 942 48 . . PUNCT dad-10733 943 1 the the DET dad-10733 943 2 catch catch NOUN dad-10733 943 3 is be AUX dad-10733 943 4 that that SCONJ dad-10733 943 5 each each DET dad-10733 943 6 player player NOUN dad-10733 943 7 can can AUX dad-10733 943 8 only only ADV dad-10733 943 9 hold hold VERB dad-10733 943 10 3 3 NUM dad-10733 943 11 cards card NOUN dad-10733 943 12 , , PUNCT dad-10733 943 13 thus thus ADV dad-10733 943 14 players player NOUN dad-10733 943 15 must must AUX dad-10733 943 16 collaborate collaborate VERB dad-10733 943 17 in in ADP dad-10733 943 18 order order NOUN dad-10733 943 19 to to PART dad-10733 943 20 achieve achieve VERB dad-10733 943 21 the the DET dad-10733 943 22 goal goal NOUN dad-10733 943 23 . . PUNCT dad-10733 944 1 further far ADV dad-10733 944 2 , , PUNCT dad-10733 944 3 each each DET dad-10733 944 4 player player NOUN dad-10733 944 5 ’s ’s PART dad-10733 944 6 location location NOUN dad-10733 944 7 is be AUX dad-10733 944 8 hidden hide VERB dad-10733 944 9 to to ADP dad-10733 944 10 the the DET dad-10733 944 11 other other ADJ dad-10733 944 12 player player NOUN dad-10733 944 13 , , PUNCT dad-10733 944 14 and and CCONJ dad-10733 944 15 there there PRON dad-10733 944 16 are be VERB dad-10733 944 17 a a DET dad-10733 944 18 fixed fix VERB dad-10733 944 19 number number NOUN dad-10733 944 20 of of ADP dad-10733 944 21 non non ADJ dad-10733 944 22 - - ADJ dad-10733 944 23 chatting chatting ADJ dad-10733 944 24 moves move NOUN dad-10733 944 25 . . PUNCT dad-10733 945 1 thus thus ADV dad-10733 945 2 , , PUNCT dad-10733 945 3 players player NOUN dad-10733 945 4 must must AUX dad-10733 945 5 use use VERB dad-10733 945 6 the the DET dad-10733 945 7 chat chat NOUN dad-10733 945 8 to to PART dad-10733 945 9 formulate formulate VERB dad-10733 945 10 a a DET dad-10733 945 11 plan plan NOUN dad-10733 945 12 , , PUNCT dad-10733 945 13 rather rather ADV dad-10733 945 14 than than ADP dad-10733 945 15 exhaustively exhaustively ADV dad-10733 945 16 exploring explore VERB dad-10733 945 17 the the DET dad-10733 945 18 environment environment NOUN dad-10733 945 19 themselves themselves PRON dad-10733 945 20 . . PUNCT dad-10733 946 1 the the DET dad-10733 946 2 dataset dataset NOUN dad-10733 946 3 has have AUX dad-10733 946 4 been be AUX dad-10733 946 5 further far ADV dad-10733 946 6 annotated annotate VERB dad-10733 946 7 by by ADP dad-10733 946 8 potts potts PROPN dad-10733 946 9 ( ( PUNCT dad-10733 946 10 2012 2012 NUM dad-10733 946 11 ) ) PUNCT dad-10733 946 12 to to PART dad-10733 946 13 collect collect VERB dad-10733 946 14 all all DET dad-10733 946 15 locative locative ADJ dad-10733 946 16 question question NOUN dad-10733 946 17 - - PUNCT dad-10733 946 18 answer answer NOUN dad-10733 946 19 pairs pair NOUN dad-10733 946 20 ( ( PUNCT dad-10733 946 21 i.e. i.e. X dad-10733 946 22 all all DET dad-10733 946 23 questions question NOUN dad-10733 946 24 of of ADP dad-10733 946 25 the the DET dad-10733 946 26 form form NOUN dad-10733 946 27 “ " PUNCT dad-10733 946 28 where where SCONJ dad-10733 946 29 are be AUX dad-10733 946 30 you you PRON dad-10733 946 31 ? ? PUNCT dad-10733 946 32 ” " PUNCT dad-10733 946 33 ) ) PUNCT dad-10733 946 34 . . PUNCT dad-10733 947 1 the the DET dad-10733 947 2 agreement agreement NOUN dad-10733 947 3 by by ADP dad-10733 947 4 create create VERB dad-10733 947 5 debaters debater NOUN dad-10733 947 6 corpus corpus NOUN dad-10733 947 7 ( ( PUNCT dad-10733 947 8 rosenthal rosenthal NOUN dad-10733 947 9 and and CCONJ dad-10733 947 10 mckeown mckeown PROPN dad-10733 947 11 , , PUNCT dad-10733 947 12 2015 2015 NUM dad-10733 947 13 ) ) PUNCT dad-10733 947 14 , , PUNCT dad-10733 947 15 the the DET dad-10733 947 16 agreement agreement NOUN dad-10733 947 17 in in ADP dad-10733 947 18 wikipedia wikipedia PROPN dad-10733 947 19 talk talk NOUN dad-10733 947 20 pages page NOUN dad-10733 947 21 corpus corpus PROPN dad-10733 947 22 ( ( PUNCT dad-10733 947 23 andreas andreas PROPN dad-10733 947 24 et et PROPN dad-10733 947 25 al al PROPN dad-10733 947 26 . . PROPN dad-10733 947 27 , , PUNCT dad-10733 947 28 2012 2012 NUM dad-10733 947 29 ) ) PUNCT dad-10733 947 30 and and CCONJ dad-10733 947 31 the the DET dad-10733 947 32 internet internet NOUN dad-10733 947 33 argument argument NOUN dad-10733 947 34 corpus corpus NOUN dad-10733 947 35 ( ( PUNCT dad-10733 947 36 abbott abbott PROPN dad-10733 947 37 et et PROPN dad-10733 947 38 al al PROPN dad-10733 947 39 . . PROPN dad-10733 947 40 , , PUNCT dad-10733 947 41 2016 2016 NUM dad-10733 947 42 ) ) PUNCT dad-10733 947 43 all all PRON dad-10733 947 44 cover cover VERB dad-10733 947 45 dialogues dialogue NOUN dad-10733 947 46 with with ADP dad-10733 947 47 annotations annotation NOUN dad-10733 947 48 measuring measure VERB dad-10733 947 49 levels level NOUN dad-10733 947 50 of of ADP dad-10733 947 51 agreement agreement NOUN dad-10733 947 52 or or CCONJ dad-10733 947 53 disagreement disagreement NOUN dad-10733 947 54 in in ADP dad-10733 947 55 responses response NOUN dad-10733 947 56 to to ADP dad-10733 947 57 posts post NOUN dad-10733 947 58 in in ADP dad-10733 947 59 various various ADJ dad-10733 947 60 media medium NOUN dad-10733 947 61 . . PUNCT dad-10733 948 1 the the DET dad-10733 948 2 agreement agreement NOUN dad-10733 948 3 by by ADP dad-10733 948 4 create create VERB dad-10733 948 5 debaters debater NOUN dad-10733 948 6 corpus corpus NOUN dad-10733 948 7 and and CCONJ dad-10733 948 8 the the DET dad-10733 948 9 agreement agreement NOUN dad-10733 948 10 in in ADP dad-10733 948 11 wikipedia wikipedia PROPN dad-10733 948 12 talk talk NOUN dad-10733 948 13 pages page NOUN dad-10733 948 14 corpus corpu NOUN dad-10733 948 15 both both PRON dad-10733 948 16 are be AUX dad-10733 948 17 formatted format VERB dad-10733 948 18 in in ADP dad-10733 948 19 the the DET dad-10733 948 20 same same ADJ dad-10733 948 21 way way NOUN dad-10733 948 22 . . PUNCT dad-10733 949 1 post post ADJ dad-10733 949 2 - - ADJ dad-10733 949 3 reply reply ADJ dad-10733 949 4 pairs pair NOUN dad-10733 949 5 are be AUX dad-10733 949 6 annotated annotate VERB dad-10733 949 7 with with ADP dad-10733 949 8 whether whether SCONJ dad-10733 949 9 they they PRON dad-10733 949 10 are be AUX dad-10733 949 11 in in ADP dad-10733 949 12 agreement agreement NOUN dad-10733 949 13 or or CCONJ dad-10733 949 14 disagreement disagreement NOUN dad-10733 949 15 , , PUNCT dad-10733 949 16 as as ADV dad-10733 949 17 well well ADV dad-10733 949 18 as as ADP dad-10733 949 19 the the DET dad-10733 949 20 type type NOUN dad-10733 949 21 of of ADP dad-10733 949 22 agreement agreement NOUN dad-10733 949 23 they they PRON dad-10733 949 24 are be AUX dad-10733 949 25 in in ADP dad-10733 949 26 if if SCONJ dad-10733 949 27 applicable applicable ADJ dad-10733 949 28 ( ( PUNCT dad-10733 949 29 e.g. e.g. ADV dad-10733 949 30 paraphrasing paraphrasing NOUN dad-10733 949 31 ) ) PUNCT dad-10733 949 32 . . PUNCT dad-10733 950 1 the the DET dad-10733 950 2 difference difference NOUN dad-10733 950 3 between between ADP dad-10733 950 4 the the DET dad-10733 950 5 two two NUM dad-10733 950 6 corpora corpora NOUN dad-10733 950 7 is be AUX dad-10733 950 8 the the DET dad-10733 950 9 source source NOUN dad-10733 950 10 : : PUNCT dad-10733 950 11 the the DET dad-10733 950 12 former former ADJ dad-10733 950 13 is be AUX dad-10733 950 14 collected collect VERB dad-10733 950 15 from from ADP dad-10733 950 16 create create NOUN dad-10733 950 17 debate debate NOUN dad-10733 950 18 forums forum NOUN dad-10733 950 19 and and CCONJ dad-10733 950 20 the the DET dad-10733 950 21 latter latter ADJ dad-10733 950 22 from from ADP dad-10733 950 23 a a DET dad-10733 950 24 mix mix NOUN dad-10733 950 25 of of ADP dad-10733 950 26 wikipedia wikipedia PROPN dad-10733 950 27 discussion discussion NOUN dad-10733 950 28 pages page NOUN dad-10733 950 29 and and CCONJ dad-10733 950 30 livejournal livejournal ADJ dad-10733 950 31 postings posting NOUN dad-10733 950 32 . . PUNCT dad-10733 951 1 the the DET dad-10733 951 2 internet internet NOUN dad-10733 951 3 argument argument NOUN dad-10733 951 4 corpus corpus NOUN dad-10733 951 5 ( ( PUNCT dad-10733 951 6 iac iac PROPN dad-10733 951 7 ) ) PUNCT dad-10733 951 8 ( ( PUNCT dad-10733 951 9 walker walker PROPN dad-10733 951 10 et et PROPN dad-10733 951 11 al al PROPN dad-10733 951 12 . . PROPN dad-10733 951 13 , , PUNCT dad-10733 951 14 2012b 2012b NUM dad-10733 951 15 ) ) PUNCT dad-10733 951 16 is be AUX dad-10733 951 17 a a DET dad-10733 951 18 forum forum NOUN dad-10733 951 19 - - PUNCT dad-10733 951 20 based base VERB dad-10733 951 21 corpus corpus NOUN dad-10733 951 22 with with ADP dad-10733 951 23 390,000 390,000 NUM dad-10733 951 24 posts post NOUN dad-10733 951 25 on on ADP dad-10733 951 26 11,000 11,000 NUM dad-10733 951 27 discussion discussion NOUN dad-10733 951 28 topics topic NOUN dad-10733 951 29 . . PUNCT dad-10733 952 1 each each DET dad-10733 952 2 topic topic NOUN dad-10733 952 3 is be AUX dad-10733 952 4 controversial controversial ADJ dad-10733 952 5 in in ADP dad-10733 952 6 nature nature NOUN dad-10733 952 7 , , PUNCT dad-10733 952 8 including include VERB dad-10733 952 9 subjects subject NOUN dad-10733 952 10 such such ADJ dad-10733 952 11 as as ADP dad-10733 952 12 evolution evolution NOUN dad-10733 952 13 , , PUNCT dad-10733 952 14 gay gay ADJ dad-10733 952 15 marriage marriage NOUN dad-10733 952 16 and and CCONJ dad-10733 952 17 climate climate NOUN dad-10733 952 18 change change NOUN dad-10733 952 19 ; ; PUNCT dad-10733 952 20 users user NOUN dad-10733 952 21 participate participate VERB dad-10733 952 22 by by ADP dad-10733 952 23 sharing share VERB dad-10733 952 24 their their PRON dad-10733 952 25 opinions opinion NOUN dad-10733 952 26 on on ADP dad-10733 952 27 one one NUM dad-10733 952 28 of of ADP dad-10733 952 29 these these DET dad-10733 952 30 topics topic NOUN dad-10733 952 31 . . PUNCT dad-10733 953 1 posts post NOUN dad-10733 953 2 - - NOUN dad-10733 953 3 reply reply NOUN dad-10733 953 4 pairs pair NOUN dad-10733 953 5 have have AUX dad-10733 953 6 been be AUX dad-10733 953 7 labeled label VERB dad-10733 953 8 as as ADP dad-10733 953 9 being be AUX dad-10733 953 10 either either CCONJ dad-10733 953 11 in in ADP dad-10733 953 12 agreement agreement NOUN dad-10733 953 13 or or CCONJ dad-10733 953 14 disagreement disagreement NOUN dad-10733 953 15 , , PUNCT dad-10733 953 16 and and CCONJ dad-10733 953 17 sarcasm sarcasm NOUN dad-10733 953 18 ratings rating NOUN dad-10733 953 19 are be AUX dad-10733 953 20 given give VERB dad-10733 953 21 to to ADP dad-10733 953 22 each each DET dad-10733 953 23 post post NOUN dad-10733 953 24 . . PUNCT dad-10733 954 1 another another DET dad-10733 954 2 source source NOUN dad-10733 954 3 of of ADP dad-10733 954 4 constrained constrain VERB dad-10733 954 5 text text NOUN dad-10733 954 6 - - PUNCT dad-10733 954 7 based base VERB dad-10733 954 8 corpora corpora PROPN dad-10733 954 9 are be AUX dad-10733 954 10 chat chat NOUN dad-10733 954 11 - - PUNCT dad-10733 954 12 room room NOUN dad-10733 954 13 environments environment NOUN dad-10733 954 14 . . PUNCT dad-10733 955 1 such such DET dad-10733 955 2 a a DET dad-10733 955 3 set set NOUN dad-10733 955 4 - - PUNCT dad-10733 955 5 up up ADP dad-10733 955 6 forms form NOUN dad-10733 955 7 the the DET dad-10733 955 8 basis basis NOUN dad-10733 955 9 of of ADP dad-10733 955 10 the the DET dad-10733 955 11 mpc mpc PROPN dad-10733 955 12 corpus corpus PROPN dad-10733 955 13 ( ( PUNCT dad-10733 955 14 shaikh shaikh PROPN dad-10733 955 15 et et PROPN dad-10733 955 16 al al PROPN dad-10733 955 17 . . PROPN dad-10733 955 18 , , PUNCT dad-10733 955 19 2010 2010 NUM dad-10733 955 20 ) ) PUNCT dad-10733 955 21 , , PUNCT dad-10733 955 22 which which PRON dad-10733 955 23 consists consist VERB dad-10733 955 24 of of ADP dad-10733 955 25 14 14 NUM dad-10733 955 26 multi multi ADJ dad-10733 955 27 - - ADJ dad-10733 955 28 party party ADJ dad-10733 955 29 dialogue dialogue NOUN dad-10733 955 30 sessions session NOUN dad-10733 955 31 of of ADP dad-10733 955 32 approximately approximately ADV dad-10733 955 33 90 90 NUM dad-10733 955 34 minutes minute NOUN dad-10733 955 35 each each PRON dad-10733 955 36 . . PUNCT dad-10733 956 1 in in ADP dad-10733 956 2 some some DET dad-10733 956 3 cases case NOUN dad-10733 956 4 , , PUNCT dad-10733 956 5 discussion discussion NOUN dad-10733 956 6 topics topic NOUN dad-10733 956 7 were be AUX dad-10733 956 8 constrained constrain VERB dad-10733 956 9 to to PART dad-10733 956 10 be be AUX dad-10733 956 11 about about ADP dad-10733 956 12 certain certain ADJ dad-10733 956 13 political political ADJ dad-10733 956 14 stances stance NOUN dad-10733 956 15 , , PUNCT dad-10733 956 16 or or CCONJ dad-10733 956 17 mock mock ADJ dad-10733 956 18 committees committee NOUN dad-10733 956 19 for for ADP dad-10733 956 20 choosing choose VERB dad-10733 956 21 job job NOUN dad-10733 956 22 candidates candidate NOUN dad-10733 956 23 . . PUNCT dad-10733 957 1 an an DET dad-10733 957 2 interesting interesting ADJ dad-10733 957 3 feature feature NOUN dad-10733 957 4 is be AUX dad-10733 957 5 that that SCONJ dad-10733 957 6 different different ADJ dad-10733 957 7 participants participant NOUN dad-10733 957 8 are be AUX dad-10733 957 9 given give VERB dad-10733 957 10 different different ADJ dad-10733 957 11 roles role NOUN dad-10733 957 12 — — PUNCT dad-10733 957 13 leader leader NOUN dad-10733 957 14 , , PUNCT dad-10733 957 15 disruptor disruptor NOUN dad-10733 957 16 , , PUNCT dad-10733 957 17 and and CCONJ dad-10733 957 18 consensus consensus NOUN dad-10733 957 19 builder builder NOUN dad-10733 957 20 — — PUNCT dad-10733 957 21 with with ADP dad-10733 957 22 only only ADV dad-10733 957 23 a a DET dad-10733 957 24 general general ADJ dad-10733 957 25 outline outline NOUN dad-10733 957 26 of of ADP dad-10733 957 27 their their PRON dad-10733 957 28 goals goal NOUN dad-10733 957 29 in in ADP dad-10733 957 30 the the DET dad-10733 957 31 conversation conversation NOUN dad-10733 957 32 . . PUNCT dad-10733 958 1 thus thus ADV dad-10733 958 2 , , PUNCT dad-10733 958 3 this this DET dad-10733 958 4 dataset dataset NOUN dad-10733 958 5 could could AUX dad-10733 958 6 be be AUX dad-10733 958 7 used use VERB dad-10733 958 8 to to PART dad-10733 958 9 model model VERB dad-10733 958 10 social social ADJ dad-10733 958 11 phenomena phenomenon NOUN dad-10733 958 12 such such ADJ dad-10733 958 13 as as ADP dad-10733 958 14 agenda agenda NOUN dad-10733 958 15 control control NOUN dad-10733 958 16 , , PUNCT dad-10733 958 17 influence influence NOUN dad-10733 958 18 , , PUNCT dad-10733 958 19 and and CCONJ dad-10733 958 20 leadership leadership NOUN dad-10733 958 21 in in ADP dad-10733 958 22 on on ADP dad-10733 958 23 - - PUNCT dad-10733 958 24 line line NOUN dad-10733 958 25 interactions interaction NOUN dad-10733 958 26 . . PUNCT dad-10733 959 1 the the DET dad-10733 959 2 largest large ADJ dad-10733 959 3 written write VERB dad-10733 959 4 corpus corpus NOUN dad-10733 959 5 with with ADP dad-10733 959 6 a a DET dad-10733 959 7 constrained constrain VERB dad-10733 959 8 topic topic NOUN dad-10733 959 9 is be AUX dad-10733 959 10 the the DET dad-10733 959 11 recently recently ADV dad-10733 959 12 released release VERB dad-10733 959 13 ubuntu ubuntu ADJ dad-10733 959 14 dialogue dialogue NOUN dad-10733 959 15 corpus corpus NOUN dad-10733 959 16 ( ( PUNCT dad-10733 959 17 lowe lowe PROPN dad-10733 959 18 et et PROPN dad-10733 959 19 al al PROPN dad-10733 959 20 . . PROPN dad-10733 959 21 , , PUNCT dad-10733 959 22 2015a 2015a NUM dad-10733 959 23 ) ) PUNCT dad-10733 959 24 , , PUNCT dad-10733 959 25 which which PRON dad-10733 959 26 has have VERB dad-10733 959 27 almost almost ADV dad-10733 959 28 1 1 NUM dad-10733 959 29 million million NUM dad-10733 959 30 dialogues dialogue NOUN dad-10733 959 31 of of ADP dad-10733 959 32 3 3 NUM dad-10733 959 33 turns turn NOUN dad-10733 959 34 or or CCONJ dad-10733 959 35 more more ADJ dad-10733 959 36 , , PUNCT dad-10733 959 37 and and CCONJ dad-10733 959 38 100 100 NUM dad-10733 959 39 million million NUM dad-10733 959 40 words word NOUN dad-10733 959 41 . . PUNCT dad-10733 960 1 it it PRON dad-10733 960 2 is be AUX dad-10733 960 3 related relate VERB dad-10733 960 4 to to ADP dad-10733 960 5 the the DET dad-10733 960 6 former former ADJ dad-10733 960 7 ubuntu ubuntu ADJ dad-10733 960 8 chat chat PROPN dad-10733 960 9 corpus corpus NOUN dad-10733 960 10 ( ( PUNCT dad-10733 960 11 uthus uthus PROPN dad-10733 960 12 and and CCONJ dad-10733 960 13 aha aha INTJ dad-10733 960 14 , , PUNCT dad-10733 960 15 2013 2013 NUM dad-10733 960 16 ) ) PUNCT dad-10733 960 17 . . PUNCT dad-10733 961 1 both both PRON dad-10733 961 2 31 31 NUM dad-10733 961 3 serban serban PROPN dad-10733 961 4 , , PUNCT dad-10733 961 5 lowe lowe PROPN dad-10733 961 6 , , PUNCT dad-10733 961 7 henderson henderson PROPN dad-10733 961 8 , , PUNCT dad-10733 961 9 charlin charlin PROPN dad-10733 961 10 and and CCONJ dad-10733 961 11 pineau pineau PROPN dad-10733 961 12 corpora corpora PROPN dad-10733 961 13 were be AUX dad-10733 961 14 scraped scrape VERB dad-10733 961 15 from from ADP dad-10733 961 16 the the DET dad-10733 961 17 ubuntu ubuntu NOUN dad-10733 961 18 irc irc PROPN dad-10733 961 19 channel channel VERB dad-10733 961 20 logs.14 logs.14 PROPN dad-10733 961 21 on on ADP dad-10733 961 22 this this DET dad-10733 961 23 channel channel NOUN dad-10733 961 24 , , PUNCT dad-10733 961 25 users user NOUN dad-10733 961 26 can can AUX dad-10733 961 27 log log VERB dad-10733 961 28 in in ADP dad-10733 961 29 and and CCONJ dad-10733 961 30 ask ask VERB dad-10733 961 31 a a DET dad-10733 961 32 question question NOUN dad-10733 961 33 about about ADP dad-10733 961 34 a a DET dad-10733 961 35 problem problem NOUN dad-10733 961 36 they they PRON dad-10733 961 37 are be AUX dad-10733 961 38 having have VERB dad-10733 961 39 with with ADP dad-10733 961 40 ubuntu ubuntu NOUN dad-10733 961 41 ; ; PUNCT dad-10733 961 42 these these DET dad-10733 961 43 questions question NOUN dad-10733 961 44 are be AUX dad-10733 961 45 answered answer VERB dad-10733 961 46 by by ADP dad-10733 961 47 other other ADJ dad-10733 961 48 users user NOUN dad-10733 961 49 . . PUNCT dad-10733 962 1 although although SCONJ dad-10733 962 2 the the DET dad-10733 962 3 chat chat NOUN dad-10733 962 4 room room NOUN dad-10733 962 5 allows allow VERB dad-10733 962 6 everyone everyone PRON dad-10733 962 7 to to PART dad-10733 962 8 chat chat VERB dad-10733 962 9 with with ADP dad-10733 962 10 each each DET dad-10733 962 11 other other ADJ dad-10733 962 12 in in ADP dad-10733 962 13 a a DET dad-10733 962 14 multi multi ADJ dad-10733 962 15 - - ADJ dad-10733 962 16 party party ADJ dad-10733 962 17 setting setting NOUN dad-10733 962 18 , , PUNCT dad-10733 962 19 the the DET dad-10733 962 20 ubuntu ubuntu ADJ dad-10733 962 21 dialogue dialogue NOUN dad-10733 962 22 corpus corpus PROPN dad-10733 962 23 uses use VERB dad-10733 962 24 a a DET dad-10733 962 25 series series NOUN dad-10733 962 26 of of ADP dad-10733 962 27 heuristics heuristic NOUN dad-10733 962 28 to to PART dad-10733 962 29 disentangle disentangle VERB dad-10733 962 30 it it PRON dad-10733 962 31 into into ADP dad-10733 962 32 dyadic dyadic ADJ dad-10733 962 33 dialogue dialogue NOUN dad-10733 962 34 . . PUNCT dad-10733 963 1 the the DET dad-10733 963 2 technical technical ADJ dad-10733 963 3 nature nature NOUN dad-10733 963 4 and and CCONJ dad-10733 963 5 size size NOUN dad-10733 963 6 of of ADP dad-10733 963 7 this this DET dad-10733 963 8 corpus corpus NOUN dad-10733 963 9 lends lend VERB dad-10733 963 10 itself itself PRON dad-10733 963 11 particularly particularly ADV dad-10733 963 12 well well ADV dad-10733 963 13 to to ADP dad-10733 963 14 applications application NOUN dad-10733 963 15 in in ADP dad-10733 963 16 technical technical ADJ dad-10733 963 17 support support NOUN dad-10733 963 18 . . PUNCT dad-10733 964 1 other other ADJ dad-10733 964 2 corpora corpora PROPN dad-10733 964 3 have have AUX dad-10733 964 4 been be AUX dad-10733 964 5 extracted extract VERB dad-10733 964 6 from from ADP dad-10733 964 7 irc irc PROPN dad-10733 964 8 chat chat NOUN dad-10733 964 9 logs log NOUN dad-10733 964 10 . . PUNCT dad-10733 965 1 the the DET dad-10733 965 2 irc irc PROPN dad-10733 965 3 corpus corpus NOUN dad-10733 965 4 ( ( PUNCT dad-10733 965 5 elsner elsner NOUN dad-10733 965 6 and and CCONJ dad-10733 965 7 charniak charniak PROPN dad-10733 965 8 , , PUNCT dad-10733 965 9 2008 2008 NUM dad-10733 965 10 ) ) PUNCT dad-10733 965 11 contains contain VERB dad-10733 965 12 approximately approximately ADV dad-10733 965 13 50 50 NUM dad-10733 965 14 hours hour NOUN dad-10733 965 15 of of ADP dad-10733 965 16 chat chat NOUN dad-10733 965 17 , , PUNCT dad-10733 965 18 with with ADP dad-10733 965 19 an an DET dad-10733 965 20 estimated estimate VERB dad-10733 965 21 20,000 20,000 NUM dad-10733 965 22 utterances utterance NOUN dad-10733 965 23 from from ADP dad-10733 965 24 the the DET dad-10733 965 25 linux linux PROPN dad-10733 965 26 channel channel NOUN dad-10733 965 27 on on ADP dad-10733 965 28 irc irc PROPN dad-10733 965 29 , , PUNCT dad-10733 965 30 complete complete ADJ dad-10733 965 31 with with ADP dad-10733 965 32 the the DET dad-10733 965 33 posting posting NOUN dad-10733 965 34 times time NOUN dad-10733 965 35 . . PUNCT dad-10733 966 1 therefore therefore ADV dad-10733 966 2 , , PUNCT dad-10733 966 3 this this DET dad-10733 966 4 dataset dataset NOUN dad-10733 966 5 consists consist VERB dad-10733 966 6 of of ADP dad-10733 966 7 technical technical ADJ dad-10733 966 8 conversations conversation NOUN dad-10733 966 9 similar similar ADJ dad-10733 966 10 to to ADP dad-10733 966 11 the the DET dad-10733 966 12 ubuntu ubuntu ADJ dad-10733 966 13 corpus corpus PROPN dad-10733 966 14 , , PUNCT dad-10733 966 15 with with ADP dad-10733 966 16 the the DET dad-10733 966 17 occasional occasional ADJ dad-10733 966 18 social social ADJ dad-10733 966 19 chat chat NOUN dad-10733 966 20 . . PUNCT dad-10733 967 1 the the DET dad-10733 967 2 purpose purpose NOUN dad-10733 967 3 of of ADP dad-10733 967 4 this this DET dad-10733 967 5 dataset dataset NOUN dad-10733 967 6 was be AUX dad-10733 967 7 to to PART dad-10733 967 8 investigate investigate VERB dad-10733 967 9 approaches approach NOUN dad-10733 967 10 for for ADP dad-10733 967 11 conversation conversation NOUN dad-10733 967 12 disentanglement disentanglement NOUN dad-10733 967 13 ; ; PUNCT dad-10733 967 14 given give VERB dad-10733 967 15 a a DET dad-10733 967 16 multi multi ADJ dad-10733 967 17 - - ADJ dad-10733 967 18 party party ADJ dad-10733 967 19 chat chat NOUN dad-10733 967 20 room room NOUN dad-10733 967 21 , , PUNCT dad-10733 967 22 one one NUM dad-10733 967 23 attempts attempt VERB dad-10733 967 24 to to PART dad-10733 967 25 recover recover VERB dad-10733 967 26 the the DET dad-10733 967 27 individual individual ADJ dad-10733 967 28 conversations conversation NOUN dad-10733 967 29 of of ADP dad-10733 967 30 which which PRON dad-10733 967 31 it it PRON dad-10733 967 32 is be AUX dad-10733 967 33 composed compose VERB dad-10733 967 34 . . PUNCT dad-10733 968 1 for for ADP dad-10733 968 2 this this DET dad-10733 968 3 purpose purpose NOUN dad-10733 968 4 , , PUNCT dad-10733 968 5 there there PRON dad-10733 968 6 are be VERB dad-10733 968 7 approximately approximately ADV dad-10733 968 8 1,500 1,500 NUM dad-10733 968 9 utterances utterance NOUN dad-10733 968 10 with with ADP dad-10733 968 11 annotated annotate VERB dad-10733 968 12 ground ground NOUN dad-10733 968 13 - - PUNCT dad-10733 968 14 truth truth NOUN dad-10733 968 15 conversations conversation NOUN dad-10733 968 16 . . PUNCT dad-10733 969 1 more more ADJ dad-10733 969 2 recent recent ADJ dad-10733 969 3 efforts effort NOUN dad-10733 969 4 have have AUX dad-10733 969 5 combined combine VERB dad-10733 969 6 traditional traditional ADJ dad-10733 969 7 conversational conversational ADJ dad-10733 969 8 corpora corpora NOUN dad-10733 969 9 with with ADP dad-10733 969 10 question question NOUN dad-10733 969 11 answering answering NOUN dad-10733 969 12 and and CCONJ dad-10733 969 13 recommendation recommendation NOUN dad-10733 969 14 datasets dataset NOUN dad-10733 969 15 in in ADP dad-10733 969 16 order order NOUN dad-10733 969 17 to to PART dad-10733 969 18 facilitate facilitate VERB dad-10733 969 19 the the DET dad-10733 969 20 construction construction NOUN dad-10733 969 21 of of ADP dad-10733 969 22 goal goal NOUN dad-10733 969 23 - - PUNCT dad-10733 969 24 driven drive VERB dad-10733 969 25 dialogue dialogue NOUN dad-10733 969 26 systems system NOUN dad-10733 969 27 . . PUNCT dad-10733 970 1 such such ADJ dad-10733 970 2 is be AUX dad-10733 970 3 the the DET dad-10733 970 4 case case NOUN dad-10733 970 5 for for ADP dad-10733 970 6 the the DET dad-10733 970 7 movie movie NOUN dad-10733 970 8 dialog dialog NOUN dad-10733 970 9 dataset dataset NOUN dad-10733 970 10 ( ( PUNCT dad-10733 970 11 dodge dodge VERB dad-10733 970 12 et et PROPN dad-10733 970 13 al al PROPN dad-10733 970 14 . . PROPN dad-10733 970 15 , , PUNCT dad-10733 970 16 2015 2015 NUM dad-10733 970 17 ) ) PUNCT dad-10733 970 18 . . PUNCT dad-10733 971 1 there there PRON dad-10733 971 2 are be VERB dad-10733 971 3 four four NUM dad-10733 971 4 tasks task NOUN dad-10733 971 5 that that SCONJ dad-10733 971 6 the the DET dad-10733 971 7 authors author NOUN dad-10733 971 8 propose propose VERB dad-10733 971 9 as as ADP dad-10733 971 10 a a DET dad-10733 971 11 prerequisite prerequisite NOUN dad-10733 971 12 for for ADP dad-10733 971 13 a a DET dad-10733 971 14 working work VERB dad-10733 971 15 dialogue dialogue NOUN dad-10733 971 16 system system NOUN dad-10733 971 17 : : PUNCT dad-10733 971 18 question question NOUN dad-10733 971 19 answering answering NOUN dad-10733 971 20 , , PUNCT dad-10733 971 21 recommendation recommendation NOUN dad-10733 971 22 , , PUNCT dad-10733 971 23 question question NOUN dad-10733 971 24 answering answer VERB dad-10733 971 25 with with ADP dad-10733 971 26 recommendation recommendation NOUN dad-10733 971 27 , , PUNCT dad-10733 971 28 and and CCONJ dad-10733 971 29 casual casual ADJ dad-10733 971 30 conversation conversation NOUN dad-10733 971 31 . . PUNCT dad-10733 972 1 the the DET dad-10733 972 2 movie movie NOUN dad-10733 972 3 dialog dialog NOUN dad-10733 972 4 dataset dataset NOUN dad-10733 972 5 consists consist VERB dad-10733 972 6 of of ADP dad-10733 972 7 four four NUM dad-10733 972 8 sub sub NOUN dad-10733 972 9 - - NOUN dad-10733 972 10 datasets dataset NOUN dad-10733 972 11 used use VERB dad-10733 972 12 for for ADP dad-10733 972 13 training training NOUN dad-10733 972 14 models model NOUN dad-10733 972 15 to to PART dad-10733 972 16 complete complete VERB dad-10733 972 17 these these DET dad-10733 972 18 tasks task NOUN dad-10733 972 19 : : PUNCT dad-10733 972 20 a a DET dad-10733 972 21 qa qa NOUN dad-10733 972 22 dataset dataset VERB dad-10733 972 23 from from ADP dad-10733 972 24 the the DET dad-10733 972 25 open open ADJ dad-10733 972 26 movie movie NOUN dad-10733 972 27 database database NOUN dad-10733 972 28 ( ( PUNCT dad-10733 972 29 omdb)15 omdb)15 PROPN dad-10733 972 30 of of ADP dad-10733 972 31 116k 116k NUM dad-10733 972 32 examples example NOUN dad-10733 972 33 with with ADP dad-10733 972 34 accompanying accompany VERB dad-10733 972 35 movie movie NOUN dad-10733 972 36 and and CCONJ dad-10733 972 37 actor actor NOUN dad-10733 972 38 metadata metadata NOUN dad-10733 972 39 in in ADP dad-10733 972 40 the the DET dad-10733 972 41 form form NOUN dad-10733 972 42 of of ADP dad-10733 972 43 knowledge knowledge NOUN dad-10733 972 44 triples triple NOUN dad-10733 972 45 ; ; PUNCT dad-10733 972 46 a a DET dad-10733 972 47 recommendation recommendation NOUN dad-10733 972 48 dataset dataset VERB dad-10733 972 49 from from ADP dad-10733 972 50 movielens16 movielens16 NOUN dad-10733 972 51 with with ADP dad-10733 972 52 110k 110k PROPN dad-10733 972 53 users user NOUN dad-10733 972 54 and and CCONJ dad-10733 972 55 1 1 NUM dad-10733 972 56 m m NOUN dad-10733 972 57 questions question NOUN dad-10733 972 58 ; ; PUNCT dad-10733 972 59 a a DET dad-10733 972 60 combined combine VERB dad-10733 972 61 recommendation recommendation NOUN dad-10733 972 62 and and CCONJ dad-10733 972 63 qa qa PROPN dad-10733 972 64 dataset dataset VERB dad-10733 972 65 with with ADP dad-10733 972 66 1 1 NUM dad-10733 972 67 m m NOUN dad-10733 972 68 conversations conversation NOUN dad-10733 972 69 of of ADP dad-10733 972 70 6 6 NUM dad-10733 972 71 turns turn NOUN dad-10733 972 72 each each PRON dad-10733 972 73 ; ; PUNCT dad-10733 972 74 and and CCONJ dad-10733 972 75 a a DET dad-10733 972 76 discussion discussion NOUN dad-10733 972 77 dataset dataset VERB dad-10733 972 78 from from ADP dad-10733 972 79 reddit reddit NOUN dad-10733 972 80 ’s ’s PART dad-10733 972 81 movie movie NOUN dad-10733 972 82 subreddit subreddit NOUN dad-10733 972 83 . . PUNCT dad-10733 973 1 the the DET dad-10733 973 2 former former ADJ dad-10733 973 3 is be AUX dad-10733 973 4 evaluated evaluate VERB dad-10733 973 5 using use VERB dad-10733 973 6 recall recall NOUN dad-10733 973 7 metrics metric NOUN dad-10733 973 8 in in ADP dad-10733 973 9 a a DET dad-10733 973 10 manner manner NOUN dad-10733 973 11 similar similar ADJ dad-10733 973 12 to to ADP dad-10733 973 13 lowe lowe PROPN dad-10733 973 14 et et PROPN dad-10733 973 15 al al PROPN dad-10733 973 16 . . PROPN dad-10733 974 1 ( ( PUNCT dad-10733 974 2 2015a 2015a NUM dad-10733 974 3 ) ) PUNCT dad-10733 974 4 . . PUNCT dad-10733 975 1 it it PRON dad-10733 975 2 should should AUX dad-10733 975 3 be be AUX dad-10733 975 4 noted note VERB dad-10733 975 5 that that SCONJ dad-10733 975 6 , , PUNCT dad-10733 975 7 other other ADJ dad-10733 975 8 than than ADP dad-10733 975 9 the the DET dad-10733 975 10 reddit reddit NOUN dad-10733 975 11 dataset dataset NOUN dad-10733 975 12 , , PUNCT dad-10733 975 13 the the DET dad-10733 975 14 dialogues dialogue NOUN dad-10733 975 15 in in ADP dad-10733 975 16 the the DET dad-10733 975 17 sub sub NOUN dad-10733 975 18 - - NOUN dad-10733 975 19 datasets dataset NOUN dad-10733 975 20 are be AUX dad-10733 975 21 simulated simulate VERB dad-10733 975 22 qa qa PROPN dad-10733 975 23 pairs pair NOUN dad-10733 975 24 , , PUNCT dad-10733 975 25 where where SCONJ dad-10733 975 26 each each DET dad-10733 975 27 response response NOUN dad-10733 975 28 corresponds correspond VERB dad-10733 975 29 to to ADP dad-10733 975 30 a a DET dad-10733 975 31 list list NOUN dad-10733 975 32 of of ADP dad-10733 975 33 entities entity NOUN dad-10733 975 34 from from ADP dad-10733 975 35 the the DET dad-10733 975 36 knowledge knowledge NOUN dad-10733 975 37 base base NOUN dad-10733 975 38 . . PUNCT dad-10733 976 1 5 5 X dad-10733 976 2 . . X dad-10733 976 3 discussion discussion NOUN dad-10733 976 4 we we PRON dad-10733 976 5 now now ADV dad-10733 976 6 discuss discuss VERB dad-10733 976 7 a a DET dad-10733 976 8 number number NOUN dad-10733 976 9 of of ADP dad-10733 976 10 challenges challenge NOUN dad-10733 976 11 and and CCONJ dad-10733 976 12 general general ADJ dad-10733 976 13 methods method NOUN dad-10733 976 14 related relate VERB dad-10733 976 15 to to ADP dad-10733 976 16 the the DET dad-10733 976 17 development development NOUN dad-10733 976 18 and and CCONJ dad-10733 976 19 evaluation evaluation NOUN dad-10733 976 20 of of ADP dad-10733 976 21 data data NOUN dad-10733 976 22 - - PUNCT dad-10733 976 23 driven drive VERB dad-10733 976 24 dialogue dialogue NOUN dad-10733 976 25 systems system NOUN dad-10733 976 26 . . PUNCT dad-10733 977 1 we we PRON dad-10733 977 2 highlight highlight VERB dad-10733 977 3 challenges challenge NOUN dad-10733 977 4 relevant relevant ADJ dad-10733 977 5 to to ADP dad-10733 977 6 working work VERB dad-10733 977 7 with with ADP dad-10733 977 8 large large ADJ dad-10733 977 9 - - PUNCT dad-10733 977 10 scale scale NOUN dad-10733 977 11 datasets dataset NOUN dad-10733 977 12 , , PUNCT dad-10733 977 13 colloquial colloquial ADJ dad-10733 977 14 language language NOUN dad-10733 977 15 , , PUNCT dad-10733 977 16 spelling spelling NOUN dad-10733 977 17 mistakes mistake NOUN dad-10733 977 18 and and CCONJ dad-10733 977 19 acronyms acronym NOUN dad-10733 977 20 , , PUNCT dad-10733 977 21 as as ADV dad-10733 977 22 well well ADV dad-10733 977 23 as as ADP dad-10733 977 24 missing missing ADJ dad-10733 977 25 and and CCONJ dad-10733 977 26 unobservable unobservable ADJ dad-10733 977 27 data datum NOUN dad-10733 977 28 . . PUNCT dad-10733 978 1 we we PRON dad-10733 978 2 also also ADV dad-10733 978 3 discuss discuss VERB dad-10733 978 4 methods method NOUN dad-10733 978 5 to to PART dad-10733 978 6 improve improve VERB dad-10733 978 7 data data NOUN dad-10733 978 8 - - PUNCT dad-10733 978 9 driven drive VERB dad-10733 978 10 dialogue dialogue NOUN dad-10733 978 11 systems system NOUN dad-10733 978 12 beyond beyond ADP dad-10733 978 13 a a DET dad-10733 978 14 single single ADJ dad-10733 978 15 corpus corpus NOUN dad-10733 978 16 , , PUNCT dad-10733 978 17 such such ADJ dad-10733 978 18 as as ADP dad-10733 978 19 transfer transfer NOUN dad-10733 978 20 learning learning NOUN dad-10733 978 21 between between ADP dad-10733 978 22 datasets dataset NOUN dad-10733 978 23 and and CCONJ dad-10733 978 24 the the DET dad-10733 978 25 usage usage NOUN dad-10733 978 26 of of ADP dad-10733 978 27 external external ADJ dad-10733 978 28 knowledge knowledge NOUN dad-10733 978 29 . . PUNCT dad-10733 979 1 researchers researcher NOUN dad-10733 979 2 and and CCONJ dad-10733 979 3 developers developer NOUN dad-10733 979 4 may may AUX dad-10733 979 5 consider consider VERB dad-10733 979 6 applying apply VERB dad-10733 979 7 these these DET dad-10733 979 8 methods method NOUN dad-10733 979 9 once once SCONJ dad-10733 979 10 they they PRON dad-10733 979 11 have have AUX dad-10733 979 12 settled settle VERB dad-10733 979 13 on on ADP dad-10733 979 14 using use VERB dad-10733 979 15 one one NUM dad-10733 979 16 or or CCONJ dad-10733 979 17 several several ADJ dad-10733 979 18 corpora corpus NOUN dad-10733 979 19 . . PUNCT dad-10733 980 1 we we PRON dad-10733 980 2 also also ADV dad-10733 980 3 discuss discuss VERB dad-10733 980 4 user user NOUN dad-10733 980 5 personalization personalization NOUN dad-10733 980 6 , , PUNCT dad-10733 980 7 applicable applicable ADJ dad-10733 980 8 in in ADP dad-10733 980 9 the the DET dad-10733 980 10 case case NOUN dad-10733 980 11 where where SCONJ dad-10733 980 12 there there PRON dad-10733 980 13 is be VERB dad-10733 980 14 rich rich ADJ dad-10733 980 15 information information NOUN dad-10733 980 16 available available ADJ dad-10733 980 17 for for ADP dad-10733 980 18 each each DET dad-10733 980 19 user user NOUN dad-10733 980 20 . . PUNCT dad-10733 981 1 finally finally ADV dad-10733 981 2 , , PUNCT dad-10733 981 3 we we PRON dad-10733 981 4 discuss discuss VERB dad-10733 981 5 different different ADJ dad-10733 981 6 methods method NOUN dad-10733 981 7 for for ADP dad-10733 981 8 evaluating evaluate VERB dad-10733 981 9 data data NOUN dad-10733 981 10 - - PUNCT dad-10733 981 11 driven drive VERB dad-10733 981 12 dialogue dialogue NOUN dad-10733 981 13 systems system NOUN dad-10733 981 14 , , PUNCT dad-10733 981 15 including include VERB dad-10733 981 16 corpus corpus NOUN dad-10733 981 17 - - PUNCT dad-10733 981 18 based base VERB dad-10733 981 19 evaluation evaluation NOUN dad-10733 981 20 methods method NOUN dad-10733 981 21 . . PUNCT dad-10733 982 1 evaluating evaluate VERB dad-10733 982 2 a a DET dad-10733 982 3 data data NOUN dad-10733 982 4 - - PUNCT dad-10733 982 5 driven drive VERB dad-10733 982 6 dialogue dialogue NOUN dad-10733 982 7 system system NOUN dad-10733 982 8 properly properly ADV dad-10733 982 9 is be AUX dad-10733 982 10 critical critical ADJ dad-10733 982 11 for for ADP dad-10733 982 12 real real ADJ dad-10733 982 13 - - PUNCT dad-10733 982 14 world world NOUN dad-10733 982 15 deployments deployment NOUN dad-10733 982 16 as as ADV dad-10733 982 17 well well ADV dad-10733 982 18 as as ADP dad-10733 982 19 for for ADP dad-10733 982 20 advancing advance VERB dad-10733 982 21 state state NOUN dad-10733 982 22 - - PUNCT dad-10733 982 23 of of ADP dad-10733 982 24 - - PUNCT dad-10733 982 25 the the DET dad-10733 982 26 - - PUNCT dad-10733 982 27 art art NOUN dad-10733 982 28 research research NOUN dad-10733 982 29 , , PUNCT dad-10733 982 30 in in ADP dad-10733 982 31 which which DET dad-10733 982 32 case case NOUN dad-10733 982 33 reproducibility reproducibility NOUN dad-10733 982 34 of of ADP dad-10733 982 35 methods method NOUN dad-10733 982 36 and and CCONJ dad-10733 982 37 results result NOUN dad-10733 982 38 is be AUX dad-10733 982 39 crucial crucial ADJ dad-10733 982 40 . . PUNCT dad-10733 983 1 14 14 NUM dad-10733 983 2 . . PUNCT dad-10733 983 3 http://irclogs.ubuntu.com http://irclogs.ubuntu.com X dad-10733 983 4 15 15 NUM dad-10733 983 5 . . PUNCT dad-10733 983 6 http://en.omdb.org http://en.omdb.org PROPN dad-10733 983 7 16 16 NUM dad-10733 983 8 . . PUNCT dad-10733 984 1 http://movielens.org http://movielens.org PROPN dad-10733 984 2 32 32 NUM dad-10733 984 3 http://irclogs.ubuntu.com http://irclogs.ubuntu.com X dad-10733 984 4 http://en.omdb.org http://en.omdb.org VERB dad-10733 984 5 http://movielens.org http://movielens.org PROPN dad-10733 984 6 a a DET dad-10733 984 7 survey survey NOUN dad-10733 984 8 of of ADP dad-10733 984 9 available available ADJ dad-10733 984 10 corpora corpora PROPN dad-10733 984 11 for for ADP dad-10733 984 12 building build VERB dad-10733 984 13 data data NOUN dad-10733 984 14 - - PUNCT dad-10733 984 15 driven drive VERB dad-10733 984 16 dialogue dialogue NOUN dad-10733 984 17 systems system NOUN dad-10733 984 18 5.1 5.1 NUM dad-10733 984 19 challenges challenge NOUN dad-10733 984 20 of of ADP dad-10733 984 21 learning learn VERB dad-10733 984 22 from from ADP dad-10733 984 23 large large ADJ dad-10733 984 24 datasets dataset NOUN dad-10733 984 25 recently recently ADV dad-10733 984 26 , , PUNCT dad-10733 984 27 several several ADJ dad-10733 984 28 of of ADP dad-10733 984 29 the the DET dad-10733 984 30 larger large ADJ dad-10733 984 31 dialogue dialogue NOUN dad-10733 984 32 datasets dataset NOUN dad-10733 984 33 have have AUX dad-10733 984 34 been be AUX dad-10733 984 35 used use VERB dad-10733 984 36 to to PART dad-10733 984 37 train train VERB dad-10733 984 38 data data NOUN dad-10733 984 39 - - PUNCT dad-10733 984 40 driven drive VERB dad-10733 984 41 dialogue dialogue NOUN dad-10733 984 42 systems system NOUN dad-10733 984 43 ; ; PUNCT dad-10733 984 44 the the DET dad-10733 984 45 twitter twitter NOUN dad-10733 984 46 corpus corpus NOUN dad-10733 984 47 ( ( PUNCT dad-10733 984 48 ritter ritter PROPN dad-10733 984 49 et et PROPN dad-10733 984 50 al al PROPN dad-10733 984 51 . . PROPN dad-10733 984 52 , , PUNCT dad-10733 984 53 2010 2010 NUM dad-10733 984 54 ) ) PUNCT dad-10733 984 55 and and CCONJ dad-10733 984 56 the the DET dad-10733 984 57 ubuntu ubuntu ADJ dad-10733 984 58 dialogue dialogue NOUN dad-10733 984 59 corpus corpus PROPN dad-10733 984 60 ( ( PUNCT dad-10733 984 61 lowe lowe PROPN dad-10733 984 62 et et PROPN dad-10733 984 63 al al PROPN dad-10733 984 64 . . PROPN dad-10733 984 65 , , PUNCT dad-10733 984 66 2015a 2015a NUM dad-10733 984 67 ) ) PUNCT dad-10733 984 68 are be AUX dad-10733 984 69 two two NUM dad-10733 984 70 examples example NOUN dad-10733 984 71 . . PUNCT dad-10733 985 1 in in ADP dad-10733 985 2 this this DET dad-10733 985 3 section section NOUN dad-10733 985 4 , , PUNCT dad-10733 985 5 we we PRON dad-10733 985 6 discuss discuss VERB dad-10733 985 7 the the DET dad-10733 985 8 benefits benefit NOUN dad-10733 985 9 and and CCONJ dad-10733 985 10 drawbacks drawback NOUN dad-10733 985 11 of of ADP dad-10733 985 12 these these DET dad-10733 985 13 datasets dataset NOUN dad-10733 985 14 based base VERB dad-10733 985 15 on on ADP dad-10733 985 16 our our PRON dad-10733 985 17 experience experience NOUN dad-10733 985 18 using use VERB dad-10733 985 19 them they PRON dad-10733 985 20 for for ADP dad-10733 985 21 building build VERB dad-10733 985 22 data data NOUN dad-10733 985 23 - - PUNCT dad-10733 985 24 driven drive VERB dad-10733 985 25 models model NOUN dad-10733 985 26 . . PUNCT dad-10733 986 1 unlike unlike ADP dad-10733 986 2 the the DET dad-10733 986 3 previous previous ADJ dad-10733 986 4 section section NOUN dad-10733 986 5 , , PUNCT dad-10733 986 6 we we PRON dad-10733 986 7 now now ADV dad-10733 986 8 focus focus VERB dad-10733 986 9 on on ADP dad-10733 986 10 highly highly ADV dad-10733 986 11 relevant relevant ADJ dad-10733 986 12 aspects aspect NOUN dad-10733 986 13 and and CCONJ dad-10733 986 14 characteristics characteristic NOUN dad-10733 986 15 of of ADP dad-10733 986 16 these these DET dad-10733 986 17 datasets dataset NOUN dad-10733 986 18 specifically specifically ADV dad-10733 986 19 for for ADP dad-10733 986 20 learning learn VERB dad-10733 986 21 in in ADP dad-10733 986 22 data data NOUN dad-10733 986 23 - - PUNCT dad-10733 986 24 driven drive VERB dad-10733 986 25 dialogue dialogue NOUN dad-10733 986 26 systems system NOUN dad-10733 986 27 based base VERB dad-10733 986 28 on on ADP dad-10733 986 29 neural neural ADJ dad-10733 986 30 - - PUNCT dad-10733 986 31 network network NOUN dad-10733 986 32 architectures architecture NOUN dad-10733 986 33 . . PUNCT dad-10733 987 1 5.1.1 5.1.1 NOUN dad-10733 987 2 the the DET dad-10733 987 3 twitter twitter NOUN dad-10733 987 4 corpus corpus NOUN dad-10733 987 5 the the DET dad-10733 987 6 twitter twitter NOUN dad-10733 987 7 corpus corpus NOUN dad-10733 987 8 consists consist VERB dad-10733 987 9 of of ADP dad-10733 987 10 a a DET dad-10733 987 11 series series NOUN dad-10733 987 12 of of ADP dad-10733 987 13 conversations conversation NOUN dad-10733 987 14 extracted extract VERB dad-10733 987 15 from from ADP dad-10733 987 16 tweets tweet NOUN dad-10733 987 17 . . PUNCT dad-10733 988 1 while while SCONJ dad-10733 988 2 the the DET dad-10733 988 3 dataset dataset NOUN dad-10733 988 4 is be AUX dad-10733 988 5 large large ADJ dad-10733 988 6 and and CCONJ dad-10733 988 7 general general ADJ dad-10733 988 8 - - PUNCT dad-10733 988 9 purpose purpose NOUN dad-10733 988 10 , , PUNCT dad-10733 988 11 the the DET dad-10733 988 12 micro micro ADJ dad-10733 988 13 - - ADJ dad-10733 988 14 blogging blogging ADJ dad-10733 988 15 nature nature NOUN dad-10733 988 16 of of ADP dad-10733 988 17 the the DET dad-10733 988 18 source source NOUN dad-10733 988 19 material material NOUN dad-10733 988 20 leads lead VERB dad-10733 988 21 to to ADP dad-10733 988 22 several several ADJ dad-10733 988 23 drawbacks drawback NOUN dad-10733 988 24 for for ADP dad-10733 988 25 building build VERB dad-10733 988 26 conversational conversational ADJ dad-10733 988 27 dialogue dialogue NOUN dad-10733 988 28 agents agent NOUN dad-10733 988 29 . . PUNCT dad-10733 989 1 however however ADV dad-10733 989 2 , , PUNCT dad-10733 989 3 some some PRON dad-10733 989 4 of of ADP dad-10733 989 5 these these DET dad-10733 989 6 drawbacks drawback NOUN dad-10733 989 7 do do AUX dad-10733 989 8 not not PART dad-10733 989 9 apply apply VERB dad-10733 989 10 if if SCONJ dad-10733 989 11 the the DET dad-10733 989 12 end end NOUN dad-10733 989 13 goal goal NOUN dad-10733 989 14 is be AUX dad-10733 989 15 to to PART dad-10733 989 16 build build VERB dad-10733 989 17 an an DET dad-10733 989 18 agent agent NOUN dad-10733 989 19 that that PRON dad-10733 989 20 interacts interact VERB dad-10733 989 21 with with ADP dad-10733 989 22 users user NOUN dad-10733 989 23 on on ADP dad-10733 989 24 the the DET dad-10733 989 25 twitter twitter NOUN dad-10733 989 26 platform platform NOUN dad-10733 989 27 . . PUNCT dad-10733 990 1 the the DET dad-10733 990 2 twitter twitter NOUN dad-10733 990 3 corpus corpus NOUN dad-10733 990 4 has have VERB dad-10733 990 5 an an DET dad-10733 990 6 enormous enormous ADJ dad-10733 990 7 amount amount NOUN dad-10733 990 8 of of ADP dad-10733 990 9 typos typos NOUN dad-10733 990 10 , , PUNCT dad-10733 990 11 slang slang PROPN dad-10733 990 12 , , PUNCT dad-10733 990 13 and and CCONJ dad-10733 990 14 abbreviations abbreviation NOUN dad-10733 990 15 . . PUNCT dad-10733 991 1 due due ADP dad-10733 991 2 to to ADP dad-10733 991 3 the the DET dad-10733 991 4 140 140 NUM dad-10733 991 5 - - PUNCT dad-10733 991 6 character character NOUN dad-10733 991 7 limit limit NOUN dad-10733 991 8 in in ADP dad-10733 991 9 this this DET dad-10733 991 10 dataset dataset NOUN dad-10733 991 11 , , PUNCT dad-10733 991 12 tweets tweet NOUN dad-10733 991 13 are be AUX dad-10733 991 14 often often ADV dad-10733 991 15 very very ADV dad-10733 991 16 short short ADJ dad-10733 991 17 and and CCONJ dad-10733 991 18 compressed compressed ADJ dad-10733 991 19 . . PUNCT dad-10733 992 1 in in ADP dad-10733 992 2 addition addition NOUN dad-10733 992 3 , , PUNCT dad-10733 992 4 users user NOUN dad-10733 992 5 frequently frequently ADV dad-10733 992 6 use use VERB dad-10733 992 7 twitter twitter NOUN dad-10733 992 8 - - PUNCT dad-10733 992 9 specific specific ADJ dad-10733 992 10 devices device NOUN dad-10733 992 11 such such ADJ dad-10733 992 12 as as ADP dad-10733 992 13 hashtags hashtag NOUN dad-10733 992 14 . . PUNCT dad-10733 993 1 unless unless SCONJ dad-10733 993 2 one one NUM dad-10733 993 3 is be AUX dad-10733 993 4 building build VERB dad-10733 993 5 a a DET dad-10733 993 6 dialogue dialogue NOUN dad-10733 993 7 agent agent NOUN dad-10733 993 8 specifically specifically ADV dad-10733 993 9 for for ADP dad-10733 993 10 twitter twitter NOUN dad-10733 993 11 , , PUNCT dad-10733 993 12 it it PRON dad-10733 993 13 is be AUX dad-10733 993 14 often often ADV dad-10733 993 15 not not PART dad-10733 993 16 desirable desirable ADJ dad-10733 993 17 to to PART dad-10733 993 18 have have VERB dad-10733 993 19 a a DET dad-10733 993 20 chatbot chatbot NOUN dad-10733 993 21 use use NOUN dad-10733 993 22 hashtags hashtag NOUN dad-10733 993 23 and and CCONJ dad-10733 993 24 excessive excessive ADJ dad-10733 993 25 abbreviations abbreviation NOUN dad-10733 993 26 as as SCONJ dad-10733 993 27 it it PRON dad-10733 993 28 is be AUX dad-10733 993 29 not not PART dad-10733 993 30 reflective reflective ADJ dad-10733 993 31 of of ADP dad-10733 993 32 how how SCONJ dad-10733 993 33 humans human NOUN dad-10733 993 34 converse converse VERB dad-10733 993 35 in in ADP dad-10733 993 36 other other ADJ dad-10733 993 37 environments environment NOUN dad-10733 993 38 . . PUNCT dad-10733 994 1 this this PRON dad-10733 994 2 also also ADV dad-10733 994 3 results result VERB dad-10733 994 4 in in ADP dad-10733 994 5 a a DET dad-10733 994 6 significant significant ADJ dad-10733 994 7 increase increase NOUN dad-10733 994 8 in in ADP dad-10733 994 9 the the DET dad-10733 994 10 word word NOUN dad-10733 994 11 vocabulary vocabulary NOUN dad-10733 994 12 required require VERB dad-10733 994 13 for for ADP dad-10733 994 14 dialogue dialogue NOUN dad-10733 994 15 systems system NOUN dad-10733 994 16 trained train VERB dad-10733 994 17 at at ADP dad-10733 994 18 the the DET dad-10733 994 19 word word NOUN dad-10733 994 20 level level NOUN dad-10733 994 21 . . PUNCT dad-10733 995 1 as as ADP dad-10733 995 2 such such ADJ dad-10733 995 3 , , PUNCT dad-10733 995 4 it it PRON dad-10733 995 5 is be AUX dad-10733 995 6 not not PART dad-10733 995 7 surprising surprising ADJ dad-10733 995 8 that that SCONJ dad-10733 995 9 character character NOUN dad-10733 995 10 - - PUNCT dad-10733 995 11 level level NOUN dad-10733 995 12 models model NOUN dad-10733 995 13 have have AUX dad-10733 995 14 shown show VERB dad-10733 995 15 promising promising ADJ dad-10733 995 16 results result NOUN dad-10733 995 17 on on ADP dad-10733 995 18 twitter twitter NOUN dad-10733 995 19 ( ( PUNCT dad-10733 995 20 dhingra dhingra PROPN dad-10733 995 21 et et PROPN dad-10733 995 22 al al PROPN dad-10733 995 23 . . PROPN dad-10733 995 24 , , PUNCT dad-10733 995 25 2016 2016 NUM dad-10733 995 26 ) ) PUNCT dad-10733 995 27 . . PUNCT dad-10733 996 1 twitter twitter NOUN dad-10733 996 2 conversations conversation NOUN dad-10733 996 3 often often ADV dad-10733 996 4 contain contain VERB dad-10733 996 5 various various ADJ dad-10733 996 6 kinds kind NOUN dad-10733 996 7 of of ADP dad-10733 996 8 verbal verbal ADJ dad-10733 996 9 role role NOUN dad-10733 996 10 - - PUNCT dad-10733 996 11 playing playing NOUN dad-10733 996 12 and and CCONJ dad-10733 996 13 imaginative imaginative ADJ dad-10733 996 14 actions action NOUN dad-10733 996 15 similar similar ADJ dad-10733 996 16 to to ADP dad-10733 996 17 stage stage NOUN dad-10733 996 18 directions direction NOUN dad-10733 996 19 in in ADP dad-10733 996 20 theater theater NOUN dad-10733 996 21 plays play NOUN dad-10733 996 22 ( ( PUNCT dad-10733 996 23 e.g. e.g. ADV dad-10733 996 24 instead instead ADV dad-10733 996 25 of of ADP dad-10733 996 26 writing write VERB dad-10733 996 27 “ " PUNCT dad-10733 996 28 goodbye goodbye NOUN dad-10733 996 29 ” " PUNCT dad-10733 996 30 , , PUNCT dad-10733 996 31 a a DET dad-10733 996 32 user user NOUN dad-10733 996 33 might might AUX dad-10733 996 34 write write VERB dad-10733 996 35 “ " PUNCT dad-10733 996 36 * * PUNCT dad-10733 996 37 waves wave NOUN dad-10733 996 38 goodbye goodbye NOUN dad-10733 996 39 and and CCONJ dad-10733 996 40 leaves leave VERB dad-10733 996 41 * * PUNCT dad-10733 996 42 ” " PUNCT dad-10733 996 43 ) ) PUNCT dad-10733 996 44 . . PUNCT dad-10733 997 1 these these DET dad-10733 997 2 conversations conversation NOUN dad-10733 997 3 are be AUX dad-10733 997 4 very very ADV dad-10733 997 5 different different ADJ dad-10733 997 6 from from ADP dad-10733 997 7 the the DET dad-10733 997 8 majority majority NOUN dad-10733 997 9 of of ADP dad-10733 997 10 textbased textbase VERB dad-10733 997 11 chats chat NOUN dad-10733 997 12 . . PUNCT dad-10733 998 1 therefore therefore ADV dad-10733 998 2 , , PUNCT dad-10733 998 3 dialogue dialogue NOUN dad-10733 998 4 models model NOUN dad-10733 998 5 trained train VERB dad-10733 998 6 on on ADP dad-10733 998 7 this this DET dad-10733 998 8 dataset dataset NOUN dad-10733 998 9 are be AUX dad-10733 998 10 often often ADV dad-10733 998 11 able able ADJ dad-10733 998 12 to to PART dad-10733 998 13 provide provide VERB dad-10733 998 14 interesting interesting ADJ dad-10733 998 15 and and CCONJ dad-10733 998 16 accurate accurate ADJ dad-10733 998 17 responses response NOUN dad-10733 998 18 to to ADP dad-10733 998 19 contexts context NOUN dad-10733 998 20 involving involve VERB dad-10733 998 21 role role NOUN dad-10733 998 22 - - PUNCT dad-10733 998 23 playing playing NOUN dad-10733 998 24 and and CCONJ dad-10733 998 25 imaginative imaginative ADJ dad-10733 998 26 actions action NOUN dad-10733 998 27 ( ( PUNCT dad-10733 998 28 serban serban PROPN dad-10733 998 29 et et PROPN dad-10733 998 30 al al PROPN dad-10733 998 31 . . PROPN dad-10733 998 32 , , PUNCT dad-10733 998 33 2017d 2017d NUM dad-10733 998 34 ) ) PUNCT dad-10733 998 35 . . PUNCT dad-10733 999 1 another another DET dad-10733 999 2 challenge challenge NOUN dad-10733 999 3 is be AUX dad-10733 999 4 that that SCONJ dad-10733 999 5 twitter twitter NOUN dad-10733 999 6 conversations conversation NOUN dad-10733 999 7 often often ADV dad-10733 999 8 rely rely VERB dad-10733 999 9 on on ADP dad-10733 999 10 implicit implicit ADJ dad-10733 999 11 context context NOUN dad-10733 999 12 ( ( PUNCT dad-10733 999 13 e.g. e.g. ADV dad-10733 999 14 they they PRON dad-10733 999 15 refer refer VERB dad-10733 999 16 to to ADP dad-10733 999 17 recent recent ADJ dad-10733 999 18 public public ADJ dad-10733 999 19 events event NOUN dad-10733 999 20 outside outside ADP dad-10733 999 21 the the DET dad-10733 999 22 conversation conversation NOUN dad-10733 999 23 ) ) PUNCT dad-10733 999 24 . . PUNCT dad-10733 1000 1 in in ADP dad-10733 1000 2 order order NOUN dad-10733 1000 3 to to PART dad-10733 1000 4 learn learn VERB dad-10733 1000 5 effective effective ADJ dad-10733 1000 6 responses response NOUN dad-10733 1000 7 for for ADP dad-10733 1000 8 such such ADJ dad-10733 1000 9 conversations conversation NOUN dad-10733 1000 10 , , PUNCT dad-10733 1000 11 a a DET dad-10733 1000 12 dialogue dialogue NOUN dad-10733 1000 13 agent agent NOUN dad-10733 1000 14 must must AUX dad-10733 1000 15 infer infer VERB dad-10733 1000 16 the the DET dad-10733 1000 17 news news NOUN dad-10733 1000 18 event event NOUN dad-10733 1000 19 under under ADP dad-10733 1000 20 discussion discussion NOUN dad-10733 1000 21 by by ADP dad-10733 1000 22 referencing reference VERB dad-10733 1000 23 some some DET dad-10733 1000 24 form form NOUN dad-10733 1000 25 of of ADP dad-10733 1000 26 external external ADJ dad-10733 1000 27 knowledge knowledge NOUN dad-10733 1000 28 base base NOUN dad-10733 1000 29 . . PUNCT dad-10733 1001 1 this this PRON dad-10733 1001 2 would would AUX dad-10733 1001 3 appear appear VERB dad-10733 1001 4 to to PART dad-10733 1001 5 be be AUX dad-10733 1001 6 a a DET dad-10733 1001 7 particularly particularly ADV dad-10733 1001 8 difficult difficult ADJ dad-10733 1001 9 task task NOUN dad-10733 1001 10 . . PUNCT dad-10733 1002 1 5.1.2 5.1.2 NUM dad-10733 1002 2 the the DET dad-10733 1002 3 ubuntu ubuntu ADJ dad-10733 1002 4 dialogue dialogue NOUN dad-10733 1002 5 corpus corpus NOUN dad-10733 1002 6 the the DET dad-10733 1002 7 ubuntu ubuntu ADJ dad-10733 1002 8 dialogue dialogue NOUN dad-10733 1002 9 corpus corpus NOUN dad-10733 1002 10 is be AUX dad-10733 1002 11 one one NUM dad-10733 1002 12 of of ADP dad-10733 1002 13 the the DET dad-10733 1002 14 largest large ADJ dad-10733 1002 15 , , PUNCT dad-10733 1002 16 publicly publicly ADV dad-10733 1002 17 available available ADJ dad-10733 1002 18 datasets dataset NOUN dad-10733 1002 19 containing contain VERB dad-10733 1002 20 technical technical ADJ dad-10733 1002 21 support support NOUN dad-10733 1002 22 dialogues dialogue NOUN dad-10733 1002 23 . . PUNCT dad-10733 1003 1 due due ADP dad-10733 1003 2 to to ADP dad-10733 1003 3 the the DET dad-10733 1003 4 commercial commercial ADJ dad-10733 1003 5 importance importance NOUN dad-10733 1003 6 of of ADP dad-10733 1003 7 such such ADJ dad-10733 1003 8 systems system NOUN dad-10733 1003 9 , , PUNCT dad-10733 1003 10 the the DET dad-10733 1003 11 dataset dataset NOUN dad-10733 1003 12 has have AUX dad-10733 1003 13 attracted attract VERB dad-10733 1003 14 significant significant ADJ dad-10733 1003 15 attention.17 attention.17 ADV dad-10733 1003 16 thus thus ADV dad-10733 1003 17 , , PUNCT dad-10733 1003 18 the the DET dad-10733 1003 19 ubuntu ubuntu ADJ dad-10733 1003 20 dialogue dialogue NOUN dad-10733 1003 21 corpus corpus PROPN dad-10733 1003 22 presents present VERB dad-10733 1003 23 opportunities opportunity NOUN dad-10733 1003 24 for for SCONJ dad-10733 1003 25 anyone anyone PRON dad-10733 1003 26 to to PART dad-10733 1003 27 train train VERB dad-10733 1003 28 large large ADJ dad-10733 1003 29 - - PUNCT dad-10733 1003 30 scale scale NOUN dad-10733 1003 31 data data NOUN dad-10733 1003 32 - - PUNCT dad-10733 1003 33 driven drive VERB dad-10733 1003 34 technical technical ADJ dad-10733 1003 35 support support NOUN dad-10733 1003 36 dialogue dialogue NOUN dad-10733 1003 37 systems system NOUN dad-10733 1003 38 . . PUNCT dad-10733 1004 1 despite despite SCONJ dad-10733 1004 2 this this PRON dad-10733 1004 3 , , PUNCT dad-10733 1004 4 there there PRON dad-10733 1004 5 are be VERB dad-10733 1004 6 several several ADJ dad-10733 1004 7 challenges challenge NOUN dad-10733 1004 8 when when SCONJ dad-10733 1004 9 training train VERB dad-10733 1004 10 data data NOUN dad-10733 1004 11 - - PUNCT dad-10733 1004 12 driven drive VERB dad-10733 1004 13 dialogue dialogue NOUN dad-10733 1004 14 models model NOUN dad-10733 1004 15 on on ADP dad-10733 1004 16 the the DET dad-10733 1004 17 ubuntu ubuntu ADJ dad-10733 1004 18 dialogue dialogue NOUN dad-10733 1004 19 corpus corpus NOUN dad-10733 1004 20 due due ADP dad-10733 1004 21 to to ADP dad-10733 1004 22 the the DET dad-10733 1004 23 nature nature NOUN dad-10733 1004 24 of of ADP dad-10733 1004 25 the the DET dad-10733 1004 26 data datum NOUN dad-10733 1004 27 . . PUNCT dad-10733 1005 1 first first ADV dad-10733 1005 2 , , PUNCT dad-10733 1005 3 since since SCONJ dad-10733 1005 4 the the DET dad-10733 1005 5 corpus corpus NOUN dad-10733 1005 6 comes come VERB dad-10733 1005 7 from from ADP dad-10733 1005 8 a a DET dad-10733 1005 9 multiparty multiparty NOUN dad-10733 1005 10 irc irc PROPN dad-10733 1005 11 channel channel NOUN dad-10733 1005 12 , , PUNCT dad-10733 1005 13 it it PRON dad-10733 1005 14 needs need VERB dad-10733 1005 15 to to PART dad-10733 1005 16 be be AUX dad-10733 1005 17 disentangled disentangle VERB dad-10733 1005 18 into into ADP dad-10733 1005 19 separate separate ADJ dad-10733 1005 20 dialogues dialogue NOUN dad-10733 1005 21 . . PUNCT dad-10733 1006 1 this this DET dad-10733 1006 2 notion notion NOUN dad-10733 1006 3 of of ADP dad-10733 1006 4 disentanglement disentanglement NOUN dad-10733 1006 5 in in ADP dad-10733 1006 6 dialogue dialogue NOUN dad-10733 1006 7 corpora corpora PROPN dad-10733 1006 8 — — PUNCT dad-10733 1006 9 that that ADV dad-10733 1006 10 is is ADV dad-10733 1006 11 , , PUNCT dad-10733 1006 12 given give VERB dad-10733 1006 13 a a DET dad-10733 1006 14 multi multi ADJ dad-10733 1006 15 - - ADJ dad-10733 1006 16 party party ADJ dad-10733 1006 17 dialogue dialogue NOUN dad-10733 1006 18 , , PUNCT dad-10733 1006 19 each each DET dad-10733 1006 20 utterance utterance NOUN dad-10733 1006 21 must must AUX dad-10733 1006 22 be be AUX dad-10733 1006 23 attributed attribute VERB dad-10733 1006 24 17 17 NUM dad-10733 1006 25 . . PUNCT dad-10733 1007 1 most most ADJ dad-10733 1007 2 of of ADP dad-10733 1007 3 the the DET dad-10733 1007 4 largest large ADJ dad-10733 1007 5 technical technical ADJ dad-10733 1007 6 support support NOUN dad-10733 1007 7 datasets dataset NOUN dad-10733 1007 8 are be AUX dad-10733 1007 9 based base VERB dad-10733 1007 10 on on ADP dad-10733 1007 11 commercial commercial ADJ dad-10733 1007 12 technical technical ADJ dad-10733 1007 13 support support NOUN dad-10733 1007 14 channels channel NOUN dad-10733 1007 15 , , PUNCT dad-10733 1007 16 which which PRON dad-10733 1007 17 are be AUX dad-10733 1007 18 proprietary proprietary ADJ dad-10733 1007 19 and and CCONJ dad-10733 1007 20 never never ADV dad-10733 1007 21 released release VERB dad-10733 1007 22 to to ADP dad-10733 1007 23 the the DET dad-10733 1007 24 public public NOUN dad-10733 1007 25 for for ADP dad-10733 1007 26 privacy privacy NOUN dad-10733 1007 27 reasons reason NOUN dad-10733 1007 28 . . PUNCT dad-10733 1008 1 33 33 NUM dad-10733 1008 2 serban serban PROPN dad-10733 1008 3 , , PUNCT dad-10733 1008 4 lowe lowe PROPN dad-10733 1008 5 , , PUNCT dad-10733 1008 6 henderson henderson PROPN dad-10733 1008 7 , , PUNCT dad-10733 1008 8 charlin charlin PROPN dad-10733 1008 9 and and CCONJ dad-10733 1008 10 pineau pineau PROPN dad-10733 1008 11 to to ADP dad-10733 1008 12 a a DET dad-10733 1008 13 conversational conversational ADJ dad-10733 1008 14 thread thread NOUN dad-10733 1008 15 — — PUNCT dad-10733 1008 16 has have AUX dad-10733 1008 17 been be AUX dad-10733 1008 18 investigated investigate VERB dad-10733 1008 19 in in ADP dad-10733 1008 20 several several ADJ dad-10733 1008 21 works work NOUN dad-10733 1008 22 elsner elsner NOUN dad-10733 1008 23 and and CCONJ dad-10733 1008 24 charniak charniak PROPN dad-10733 1008 25 ( ( PUNCT dad-10733 1008 26 2010 2010 NUM dad-10733 1008 27 , , PUNCT dad-10733 1008 28 2008 2008 NUM dad-10733 1008 29 ) ) PUNCT dad-10733 1008 30 . . PUNCT dad-10733 1009 1 this this DET dad-10733 1009 2 disentanglement disentanglement NOUN dad-10733 1009 3 process process NOUN dad-10733 1009 4 is be AUX dad-10733 1009 5 noisy noisy ADJ dad-10733 1009 6 , , PUNCT dad-10733 1009 7 and and CCONJ dad-10733 1009 8 errors error NOUN dad-10733 1009 9 inevitably inevitably ADV dad-10733 1009 10 arise arise VERB dad-10733 1009 11 . . PUNCT dad-10733 1010 1 as as ADP dad-10733 1010 2 a a DET dad-10733 1010 3 result result NOUN dad-10733 1010 4 , , PUNCT dad-10733 1010 5 some some DET dad-10733 1010 6 cohesion cohesion NOUN dad-10733 1010 7 can can AUX dad-10733 1010 8 be be AUX dad-10733 1010 9 lost lose VERB dad-10733 1010 10 and and CCONJ dad-10733 1010 11 confusion confusion NOUN dad-10733 1010 12 introduced introduce VERB dad-10733 1010 13 . . PUNCT dad-10733 1011 1 the the DET dad-10733 1011 2 most most ADV dad-10733 1011 3 frequent frequent ADJ dad-10733 1011 4 error error NOUN dad-10733 1011 5 is be AUX dad-10733 1011 6 when when SCONJ dad-10733 1011 7 a a DET dad-10733 1011 8 missing missing ADJ dad-10733 1011 9 utterance utterance NOUN dad-10733 1011 10 in in ADP dad-10733 1011 11 the the DET dad-10733 1011 12 dialogue dialogue NOUN dad-10733 1011 13 is be AUX dad-10733 1011 14 not not PART dad-10733 1011 15 picked pick VERB dad-10733 1011 16 up up ADP dad-10733 1011 17 by by ADP dad-10733 1011 18 the the DET dad-10733 1011 19 extraction extraction NOUN dad-10733 1011 20 procedure procedure NOUN dad-10733 1011 21 ( ( PUNCT dad-10733 1011 22 i.e. i.e. X dad-10733 1011 23 an an DET dad-10733 1011 24 utterance utterance NOUN dad-10733 1011 25 from from ADP dad-10733 1011 26 the the DET dad-10733 1011 27 original original ADJ dad-10733 1011 28 multi multi ADJ dad-10733 1011 29 - - ADJ dad-10733 1011 30 party party ADJ dad-10733 1011 31 chat chat NOUN dad-10733 1011 32 was be AUX dad-10733 1011 33 not not PART dad-10733 1011 34 added add VERB dad-10733 1011 35 to to ADP dad-10733 1011 36 the the DET dad-10733 1011 37 disentangled disentangle VERB dad-10733 1011 38 dialogue dialogue NOUN dad-10733 1011 39 ) ) PUNCT dad-10733 1011 40 . . PUNCT dad-10733 1012 1 as as ADP dad-10733 1012 2 a a DET dad-10733 1012 3 result result NOUN dad-10733 1012 4 , , PUNCT dad-10733 1012 5 for for ADP dad-10733 1012 6 a a DET dad-10733 1012 7 substantial substantial ADJ dad-10733 1012 8 amount amount NOUN dad-10733 1012 9 of of ADP dad-10733 1012 10 conversations conversation NOUN dad-10733 1012 11 , , PUNCT dad-10733 1012 12 it it PRON dad-10733 1012 13 is be AUX dad-10733 1012 14 difficult difficult ADJ dad-10733 1012 15 to to PART dad-10733 1012 16 follow follow VERB dad-10733 1012 17 the the DET dad-10733 1012 18 topic topic NOUN dad-10733 1012 19 . . PUNCT dad-10733 1013 1 in in ADP dad-10733 1013 2 particular particular ADJ dad-10733 1013 3 , , PUNCT dad-10733 1013 4 this this PRON dad-10733 1013 5 means mean VERB dad-10733 1013 6 that that SCONJ dad-10733 1013 7 some some PRON dad-10733 1013 8 of of ADP dad-10733 1013 9 the the DET dad-10733 1013 10 next next ADJ dad-10733 1013 11 utterance utterance NOUN dad-10733 1013 12 classification classification NOUN dad-10733 1013 13 ( ( PUNCT dad-10733 1013 14 nuc nuc NOUN dad-10733 1013 15 ) ) PUNCT dad-10733 1013 16 examples example NOUN dad-10733 1013 17 , , PUNCT dad-10733 1013 18 where where SCONJ dad-10733 1013 19 models model NOUN dad-10733 1013 20 must must AUX dad-10733 1013 21 select select VERB dad-10733 1013 22 the the DET dad-10733 1013 23 correct correct ADJ dad-10733 1013 24 next next ADJ dad-10733 1013 25 response response NOUN dad-10733 1013 26 from from ADP dad-10733 1013 27 a a DET dad-10733 1013 28 list list NOUN dad-10733 1013 29 of of ADP dad-10733 1013 30 candidates candidate NOUN dad-10733 1013 31 , , PUNCT dad-10733 1013 32 are be AUX dad-10733 1013 33 either either ADV dad-10733 1013 34 difficult difficult ADJ dad-10733 1013 35 or or CCONJ dad-10733 1013 36 impossible impossible ADJ dad-10733 1013 37 for for SCONJ dad-10733 1013 38 models model NOUN dad-10733 1013 39 to to PART dad-10733 1013 40 predict predict VERB dad-10733 1013 41 . . PUNCT dad-10733 1014 1 another another DET dad-10733 1014 2 problem problem NOUN dad-10733 1014 3 arises arise VERB dad-10733 1014 4 from from ADP dad-10733 1014 5 the the DET dad-10733 1014 6 lack lack NOUN dad-10733 1014 7 of of ADP dad-10733 1014 8 annotations annotation NOUN dad-10733 1014 9 and and CCONJ dad-10733 1014 10 labels label NOUN dad-10733 1014 11 . . PUNCT dad-10733 1015 1 since since SCONJ dad-10733 1015 2 users user NOUN dad-10733 1015 3 try try VERB dad-10733 1015 4 to to PART dad-10733 1015 5 solve solve VERB dad-10733 1015 6 their their PRON dad-10733 1015 7 technical technical ADJ dad-10733 1015 8 problems problem NOUN dad-10733 1015 9 , , PUNCT dad-10733 1015 10 it it PRON dad-10733 1015 11 is be AUX dad-10733 1015 12 perhaps perhaps ADV dad-10733 1015 13 best good ADJ dad-10733 1015 14 to to PART dad-10733 1015 15 build build VERB dad-10733 1015 16 models model NOUN dad-10733 1015 17 under under ADP dad-10733 1015 18 a a DET dad-10733 1015 19 goal goal NOUN dad-10733 1015 20 - - PUNCT dad-10733 1015 21 driven drive VERB dad-10733 1015 22 dialogue dialogue NOUN dad-10733 1015 23 framework framework NOUN dad-10733 1015 24 , , PUNCT dad-10733 1015 25 where where SCONJ dad-10733 1015 26 a a DET dad-10733 1015 27 dialogue dialogue NOUN dad-10733 1015 28 system system NOUN dad-10733 1015 29 has have VERB dad-10733 1015 30 to to PART dad-10733 1015 31 maximize maximize VERB dad-10733 1015 32 the the DET dad-10733 1015 33 probability probability NOUN dad-10733 1015 34 that that SCONJ dad-10733 1015 35 it it PRON dad-10733 1015 36 will will AUX dad-10733 1015 37 solve solve VERB dad-10733 1015 38 the the DET dad-10733 1015 39 user user NOUN dad-10733 1015 40 ’s ’s PART dad-10733 1015 41 problem problem NOUN dad-10733 1015 42 at at ADP dad-10733 1015 43 the the DET dad-10733 1015 44 end end NOUN dad-10733 1015 45 of of ADP dad-10733 1015 46 the the DET dad-10733 1015 47 conversation conversation NOUN dad-10733 1015 48 . . PUNCT dad-10733 1016 1 however however ADV dad-10733 1016 2 , , PUNCT dad-10733 1016 3 there there PRON dad-10733 1016 4 are be VERB dad-10733 1016 5 no no DET dad-10733 1016 6 reward reward NOUN dad-10733 1016 7 labels label NOUN dad-10733 1016 8 available available ADJ dad-10733 1016 9 . . PUNCT dad-10733 1017 1 thus thus ADV dad-10733 1017 2 , , PUNCT dad-10733 1017 3 it it PRON dad-10733 1017 4 is be AUX dad-10733 1017 5 difficult difficult ADJ dad-10733 1017 6 to to PART dad-10733 1017 7 model model VERB dad-10733 1017 8 the the DET dad-10733 1017 9 dataset dataset NOUN dad-10733 1017 10 in in ADP dad-10733 1017 11 a a DET dad-10733 1017 12 goal goal NOUN dad-10733 1017 13 - - PUNCT dad-10733 1017 14 driven drive VERB dad-10733 1017 15 dialogue dialogue NOUN dad-10733 1017 16 framework framework NOUN dad-10733 1017 17 . . PUNCT dad-10733 1018 1 future future ADJ dad-10733 1018 2 work work NOUN dad-10733 1018 3 may may AUX dad-10733 1018 4 alleviate alleviate VERB dad-10733 1018 5 this this PRON dad-10733 1018 6 by by ADP dad-10733 1018 7 constructing construct VERB dad-10733 1018 8 automatic automatic ADJ dad-10733 1018 9 methods method NOUN dad-10733 1018 10 of of ADP dad-10733 1018 11 determining determine VERB dad-10733 1018 12 whether whether SCONJ dad-10733 1018 13 a a DET dad-10733 1018 14 user user NOUN dad-10733 1018 15 in in ADP dad-10733 1018 16 a a DET dad-10733 1018 17 particular particular ADJ dad-10733 1018 18 conversation conversation NOUN dad-10733 1018 19 solved solve VERB dad-10733 1018 20 their their PRON dad-10733 1018 21 problem problem NOUN dad-10733 1018 22 . . PUNCT dad-10733 1019 1 a a DET dad-10733 1019 2 particular particular ADJ dad-10733 1019 3 challenge challenge NOUN dad-10733 1019 4 of of ADP dad-10733 1019 5 the the DET dad-10733 1019 6 ubuntu ubuntu ADJ dad-10733 1019 7 dialogue dialogue NOUN dad-10733 1019 8 corpus corpus NOUN dad-10733 1019 9 is be AUX dad-10733 1019 10 the the DET dad-10733 1019 11 large large ADJ dad-10733 1019 12 number number NOUN dad-10733 1019 13 of of ADP dad-10733 1019 14 out out ADV dad-10733 1019 15 - - PUNCT dad-10733 1019 16 of of ADP dad-10733 1019 17 - - PUNCT dad-10733 1019 18 vocabulary vocabulary ADJ dad-10733 1019 19 words word NOUN dad-10733 1019 20 , , PUNCT dad-10733 1019 21 including include VERB dad-10733 1019 22 many many ADJ dad-10733 1019 23 technical technical ADJ dad-10733 1019 24 words word NOUN dad-10733 1019 25 related relate VERB dad-10733 1019 26 to to ADP dad-10733 1019 27 the the DET dad-10733 1019 28 ubuntu ubuntu ADJ dad-10733 1019 29 operating operating NOUN dad-10733 1019 30 system system NOUN dad-10733 1019 31 , , PUNCT dad-10733 1019 32 such such ADJ dad-10733 1019 33 as as ADP dad-10733 1019 34 commands command NOUN dad-10733 1019 35 , , PUNCT dad-10733 1019 36 software software NOUN dad-10733 1019 37 packages package NOUN dad-10733 1019 38 , , PUNCT dad-10733 1019 39 websites website NOUN dad-10733 1019 40 , , PUNCT dad-10733 1019 41 etc etc X dad-10733 1019 42 . . X dad-10733 1019 43 since since SCONJ dad-10733 1019 44 these these DET dad-10733 1019 45 words word NOUN dad-10733 1019 46 occur occur VERB dad-10733 1019 47 rarely rarely ADV dad-10733 1019 48 in in ADP dad-10733 1019 49 the the DET dad-10733 1019 50 dataset dataset NOUN dad-10733 1019 51 , , PUNCT dad-10733 1019 52 it it PRON dad-10733 1019 53 is be AUX dad-10733 1019 54 difficult difficult ADJ dad-10733 1019 55 to to PART dad-10733 1019 56 learn learn VERB dad-10733 1019 57 their their PRON dad-10733 1019 58 meaning meaning NOUN dad-10733 1019 59 directly directly ADV dad-10733 1019 60 from from ADP dad-10733 1019 61 the the DET dad-10733 1019 62 dataset dataset NOUN dad-10733 1019 63 — — PUNCT dad-10733 1019 64 for for ADP dad-10733 1019 65 example example NOUN dad-10733 1019 66 , , PUNCT dad-10733 1019 67 it it PRON dad-10733 1019 68 is be AUX dad-10733 1019 69 difficult difficult ADJ dad-10733 1019 70 to to PART dad-10733 1019 71 obtain obtain VERB dad-10733 1019 72 meaningful meaningful ADJ dad-10733 1019 73 distributed distribute VERB dad-10733 1019 74 , , PUNCT dad-10733 1019 75 real real ADV dad-10733 1019 76 - - PUNCT dad-10733 1019 77 valued value VERB dad-10733 1019 78 vector vector NOUN dad-10733 1019 79 representations representation NOUN dad-10733 1019 80 for for ADP dad-10733 1019 81 neural neural ADJ dad-10733 1019 82 network network NOUN dad-10733 1019 83 - - PUNCT dad-10733 1019 84 based base VERB dad-10733 1019 85 dialogue dialogue NOUN dad-10733 1019 86 models model NOUN dad-10733 1019 87 . . PUNCT dad-10733 1020 1 this this PRON dad-10733 1020 2 is be AUX dad-10733 1020 3 further far ADV dad-10733 1020 4 exacerbated exacerbate VERB dad-10733 1020 5 by by ADP dad-10733 1020 6 the the DET dad-10733 1020 7 large large ADJ dad-10733 1020 8 number number NOUN dad-10733 1020 9 of of ADP dad-10733 1020 10 users user NOUN dad-10733 1020 11 who who PRON dad-10733 1020 12 use use VERB dad-10733 1020 13 different different ADJ dad-10733 1020 14 nomenclature nomenclature NOUN dad-10733 1020 15 , , PUNCT dad-10733 1020 16 acronyms acronym NOUN dad-10733 1020 17 , , PUNCT dad-10733 1020 18 and and CCONJ dad-10733 1020 19 speaking speak VERB dad-10733 1020 20 styles style NOUN dad-10733 1020 21 , , PUNCT dad-10733 1020 22 and and CCONJ dad-10733 1020 23 the the DET dad-10733 1020 24 many many ADJ dad-10733 1020 25 typos typo NOUN dad-10733 1020 26 in in ADP dad-10733 1020 27 the the DET dad-10733 1020 28 dataset dataset NOUN dad-10733 1020 29 . . PUNCT dad-10733 1021 1 thus thus ADV dad-10733 1021 2 , , PUNCT dad-10733 1021 3 the the DET dad-10733 1021 4 linguistic linguistic ADJ dad-10733 1021 5 diversity diversity NOUN dad-10733 1021 6 of of ADP dad-10733 1021 7 the the DET dad-10733 1021 8 corpus corpus NOUN dad-10733 1021 9 is be AUX dad-10733 1021 10 large large ADJ dad-10733 1021 11 . . PUNCT dad-10733 1022 1 a a DET dad-10733 1022 2 final final ADJ dad-10733 1022 3 challenge challenge NOUN dad-10733 1022 4 of of ADP dad-10733 1022 5 the the DET dad-10733 1022 6 dataset dataset NOUN dad-10733 1022 7 is be AUX dad-10733 1022 8 the the DET dad-10733 1022 9 necessity necessity NOUN dad-10733 1022 10 for for ADP dad-10733 1022 11 additional additional ADJ dad-10733 1022 12 knowledge knowledge NOUN dad-10733 1022 13 related relate VERB dad-10733 1022 14 to to ADP dad-10733 1022 15 ubuntu ubuntu NOUN dad-10733 1022 16 in in ADP dad-10733 1022 17 order order NOUN dad-10733 1022 18 to to PART dad-10733 1022 19 accurately accurately ADV dad-10733 1022 20 generate generate VERB dad-10733 1022 21 or or CCONJ dad-10733 1022 22 predict predict VERB dad-10733 1022 23 the the DET dad-10733 1022 24 next next ADJ dad-10733 1022 25 response response NOUN dad-10733 1022 26 in in ADP dad-10733 1022 27 a a DET dad-10733 1022 28 conversation conversation NOUN dad-10733 1022 29 . . PUNCT dad-10733 1023 1 we we PRON dad-10733 1023 2 hypothesize hypothesize VERB dad-10733 1023 3 that that SCONJ dad-10733 1023 4 this this DET dad-10733 1023 5 knowledge knowledge NOUN dad-10733 1023 6 is be AUX dad-10733 1023 7 crucial crucial ADJ dad-10733 1023 8 for for SCONJ dad-10733 1023 9 a a DET dad-10733 1023 10 system system NOUN dad-10733 1023 11 trained train VERB dad-10733 1023 12 on on ADP dad-10733 1023 13 the the DET dad-10733 1023 14 ubuntu ubuntu ADJ dad-10733 1023 15 dialogue dialogue NOUN dad-10733 1023 16 corpus corpus NOUN dad-10733 1023 17 to to PART dad-10733 1023 18 be be AUX dad-10733 1023 19 effective effective ADJ dad-10733 1023 20 in in ADP dad-10733 1023 21 practice practice NOUN dad-10733 1023 22 , , PUNCT dad-10733 1023 23 as as ADP dad-10733 1023 24 often often ADV dad-10733 1023 25 solutions solution NOUN dad-10733 1023 26 to to ADP dad-10733 1023 27 technical technical ADJ dad-10733 1023 28 problems problem NOUN dad-10733 1023 29 change change VERB dad-10733 1023 30 over over ADP dad-10733 1023 31 time time NOUN dad-10733 1023 32 as as SCONJ dad-10733 1023 33 new new ADJ dad-10733 1023 34 versions version NOUN dad-10733 1023 35 of of ADP dad-10733 1023 36 the the DET dad-10733 1023 37 operating operating NOUN dad-10733 1023 38 system system NOUN dad-10733 1023 39 become become VERB dad-10733 1023 40 available available ADJ dad-10733 1023 41 . . PUNCT dad-10733 1024 1 thus thus ADV dad-10733 1024 2 , , PUNCT dad-10733 1024 3 an an DET dad-10733 1024 4 effective effective ADJ dad-10733 1024 5 dialogue dialogue NOUN dad-10733 1024 6 system system NOUN dad-10733 1024 7 must must AUX dad-10733 1024 8 learn learn VERB dad-10733 1024 9 to to PART dad-10733 1024 10 combine combine VERB dad-10733 1024 11 up up ADP dad-10733 1024 12 - - PUNCT dad-10733 1024 13 to to ADP dad-10733 1024 14 - - PUNCT dad-10733 1024 15 date date NOUN dad-10733 1024 16 technical technical ADJ dad-10733 1024 17 information information NOUN dad-10733 1024 18 with with ADP dad-10733 1024 19 an an DET dad-10733 1024 20 understanding understanding NOUN dad-10733 1024 21 of of ADP dad-10733 1024 22 natural natural ADJ dad-10733 1024 23 language language NOUN dad-10733 1024 24 dialogue dialogue NOUN dad-10733 1024 25 in in ADP dad-10733 1024 26 order order NOUN dad-10733 1024 27 to to PART dad-10733 1024 28 solve solve VERB dad-10733 1024 29 the the DET dad-10733 1024 30 users user NOUN dad-10733 1024 31 ’ ’ PART dad-10733 1024 32 problems problem NOUN dad-10733 1024 33 . . PUNCT dad-10733 1025 1 we we PRON dad-10733 1025 2 will will AUX dad-10733 1025 3 discuss discuss VERB dad-10733 1025 4 the the DET dad-10733 1025 5 use use NOUN dad-10733 1025 6 of of ADP dad-10733 1025 7 external external ADJ dad-10733 1025 8 knowledge knowledge NOUN dad-10733 1025 9 in in ADP dad-10733 1025 10 more more ADJ dad-10733 1025 11 detail detail NOUN dad-10733 1025 12 in in ADP dad-10733 1025 13 section section NOUN dad-10733 1025 14 5.3 5.3 NUM dad-10733 1025 15 . . PUNCT dad-10733 1026 1 while while SCONJ dad-10733 1026 2 these these DET dad-10733 1026 3 challenges challenge NOUN dad-10733 1026 4 make make VERB dad-10733 1026 5 it it PRON dad-10733 1026 6 difficult difficult ADJ dad-10733 1026 7 to to PART dad-10733 1026 8 build build VERB dad-10733 1026 9 data data NOUN dad-10733 1026 10 - - PUNCT dad-10733 1026 11 driven drive VERB dad-10733 1026 12 dialogue dialogue NOUN dad-10733 1026 13 systems system NOUN dad-10733 1026 14 , , PUNCT dad-10733 1026 15 it it PRON dad-10733 1026 16 also also ADV dad-10733 1026 17 presents present VERB dad-10733 1026 18 an an DET dad-10733 1026 19 important important ADJ dad-10733 1026 20 research research NOUN dad-10733 1026 21 opportunity opportunity NOUN dad-10733 1026 22 . . PUNCT dad-10733 1027 1 current current ADJ dad-10733 1027 2 data data NOUN dad-10733 1027 3 - - PUNCT dad-10733 1027 4 driven drive VERB dad-10733 1027 5 dialogue dialogue NOUN dad-10733 1027 6 systems system NOUN dad-10733 1027 7 perform perform VERB dad-10733 1027 8 rather rather ADV dad-10733 1027 9 poorly poorly ADV dad-10733 1027 10 in in ADP dad-10733 1027 11 terms term NOUN dad-10733 1027 12 of of ADP dad-10733 1027 13 generating generate VERB dad-10733 1027 14 utterances utterance NOUN dad-10733 1027 15 that that PRON dad-10733 1027 16 are be AUX dad-10733 1027 17 coherent coherent ADJ dad-10733 1027 18 and and CCONJ dad-10733 1027 19 on on ADP dad-10733 1027 20 - - PUNCT dad-10733 1027 21 topic topic NOUN dad-10733 1027 22 ( ( PUNCT dad-10733 1027 23 serban serban PROPN dad-10733 1027 24 et et PROPN dad-10733 1027 25 al al PROPN dad-10733 1027 26 . . PROPN dad-10733 1027 27 , , PUNCT dad-10733 1027 28 2017a 2017a NUM dad-10733 1027 29 ) ) PUNCT dad-10733 1027 30 . . PUNCT dad-10733 1028 1 as as ADP dad-10733 1028 2 such such ADJ dad-10733 1028 3 , , PUNCT dad-10733 1028 4 there there PRON dad-10733 1028 5 is be VERB dad-10733 1028 6 significant significant ADJ dad-10733 1028 7 room room NOUN dad-10733 1028 8 for for ADP dad-10733 1028 9 improvement improvement NOUN dad-10733 1028 10 on on ADP dad-10733 1028 11 these these DET dad-10733 1028 12 models model NOUN dad-10733 1028 13 . . PUNCT dad-10733 1029 1 5.2 5.2 NUM dad-10733 1029 2 transfer transfer NOUN dad-10733 1029 3 learning learning NOUN dad-10733 1029 4 between between ADP dad-10733 1029 5 datasets dataset NOUN dad-10733 1029 6 while while SCONJ dad-10733 1029 7 it it PRON dad-10733 1029 8 is be AUX dad-10733 1029 9 not not PART dad-10733 1029 10 always always ADV dad-10733 1029 11 feasible feasible ADJ dad-10733 1029 12 to to PART dad-10733 1029 13 obtain obtain VERB dad-10733 1029 14 large large ADJ dad-10733 1029 15 corpora corpora NOUN dad-10733 1029 16 for for ADP dad-10733 1029 17 every every DET dad-10733 1029 18 new new ADJ dad-10733 1029 19 application application NOUN dad-10733 1029 20 , , PUNCT dad-10733 1029 21 the the DET dad-10733 1029 22 use use NOUN dad-10733 1029 23 of of ADP dad-10733 1029 24 other other ADJ dad-10733 1029 25 related related ADJ dad-10733 1029 26 datasets dataset NOUN dad-10733 1029 27 can can AUX dad-10733 1029 28 effectively effectively ADV dad-10733 1029 29 bootstrap bootstrap VERB dad-10733 1029 30 the the DET dad-10733 1029 31 learning learning NOUN dad-10733 1029 32 process process NOUN dad-10733 1029 33 . . PUNCT dad-10733 1030 1 in in ADP dad-10733 1030 2 several several ADJ dad-10733 1030 3 branches branch NOUN dad-10733 1030 4 of of ADP dad-10733 1030 5 machine machine NOUN dad-10733 1030 6 learning learning NOUN dad-10733 1030 7 , , PUNCT dad-10733 1030 8 and and CCONJ dad-10733 1030 9 in in ADP dad-10733 1030 10 particular particular ADJ dad-10733 1030 11 in in ADP dad-10733 1030 12 deep deep ADJ dad-10733 1030 13 learning learning NOUN dad-10733 1030 14 , , PUNCT dad-10733 1030 15 the the DET dad-10733 1030 16 use use NOUN dad-10733 1030 17 of of ADP dad-10733 1030 18 related related ADJ dad-10733 1030 19 datasets dataset NOUN dad-10733 1030 20 for for ADP dad-10733 1030 21 pre pre ADJ dad-10733 1030 22 - - ADJ dad-10733 1030 23 training training ADJ dad-10733 1030 24 models model NOUN dad-10733 1030 25 is be AUX dad-10733 1030 26 an an DET dad-10733 1030 27 effective effective ADJ dad-10733 1030 28 method method NOUN dad-10733 1030 29 of of ADP dad-10733 1030 30 scaling scale VERB dad-10733 1030 31 up up ADP dad-10733 1030 32 to to ADP dad-10733 1030 33 complex complex ADJ dad-10733 1030 34 environments environment NOUN dad-10733 1030 35 ( ( PUNCT dad-10733 1030 36 erhan erhan ADP dad-10733 1030 37 et et PROPN dad-10733 1030 38 al al PROPN dad-10733 1030 39 . . PROPN dad-10733 1030 40 , , PUNCT dad-10733 1030 41 2010 2010 NUM dad-10733 1030 42 ; ; PUNCT dad-10733 1030 43 kumar kumar PROPN dad-10733 1030 44 et et PROPN dad-10733 1030 45 al al PROPN dad-10733 1030 46 . . PROPN dad-10733 1030 47 , , PUNCT dad-10733 1030 48 2015 2015 NUM dad-10733 1030 49 ) ) PUNCT dad-10733 1030 50 . . PUNCT dad-10733 1031 1 to to PART dad-10733 1031 2 build build VERB dad-10733 1031 3 open open ADJ dad-10733 1031 4 - - PUNCT dad-10733 1031 5 domain domain NOUN dad-10733 1031 6 dialogue dialogue NOUN dad-10733 1031 7 systems system NOUN dad-10733 1031 8 , , PUNCT dad-10733 1031 9 it it PRON dad-10733 1031 10 is be AUX dad-10733 1031 11 arguably arguably ADV dad-10733 1031 12 necessary necessary ADJ dad-10733 1031 13 to to PART dad-10733 1031 14 move move VERB dad-10733 1031 15 beyond beyond ADP dad-10733 1031 16 domainspecific domainspecific ADJ dad-10733 1031 17 datasets dataset NOUN dad-10733 1031 18 . . PUNCT dad-10733 1032 1 instead instead ADV dad-10733 1032 2 , , PUNCT dad-10733 1032 3 like like ADP dad-10733 1032 4 humans human NOUN dad-10733 1032 5 , , PUNCT dad-10733 1032 6 dialogue dialogue NOUN dad-10733 1032 7 systems system NOUN dad-10733 1032 8 may may AUX dad-10733 1032 9 have have VERB dad-10733 1032 10 to to PART dad-10733 1032 11 be be AUX dad-10733 1032 12 trained train VERB dad-10733 1032 13 on on ADP dad-10733 1032 14 multiple multiple ADJ dad-10733 1032 15 data datum NOUN dad-10733 1032 16 sources source NOUN dad-10733 1032 17 for for ADP dad-10733 1032 18 solving solve VERB dad-10733 1032 19 multiple multiple ADJ dad-10733 1032 20 tasks task NOUN dad-10733 1032 21 . . PUNCT dad-10733 1033 1 to to PART dad-10733 1033 2 leverage leverage VERB dad-10733 1033 3 statistical statistical ADJ dad-10733 1033 4 efficiency efficiency NOUN dad-10733 1033 5 , , PUNCT dad-10733 1033 6 it it PRON dad-10733 1033 7 may may AUX dad-10733 1033 8 be be AUX dad-10733 1033 9 necessary necessary ADJ dad-10733 1033 10 to to PART dad-10733 1033 11 first first ADV dad-10733 1033 12 use use VERB dad-10733 1033 13 unsupervised unsupervised ADJ dad-10733 1033 14 learning learning NOUN dad-10733 1033 15 — — PUNCT dad-10733 1033 16 as as SCONJ dad-10733 1033 17 opposed oppose VERB dad-10733 1033 18 to to ADP dad-10733 1033 19 supervised supervised ADJ dad-10733 1033 20 learning learning NOUN dad-10733 1033 21 or or CCONJ dad-10733 1033 22 offline offline ADJ dad-10733 1033 23 reinforcement reinforcement NOUN dad-10733 1033 24 learning learning NOUN dad-10733 1033 25 , , PUNCT dad-10733 1033 26 which which PRON dad-10733 1033 27 typically typically ADV dad-10733 1033 28 only only ADV dad-10733 1033 29 provide provide VERB dad-10733 1033 30 a a DET dad-10733 1033 31 sparse sparse ADJ dad-10733 1033 32 scalar scalar ADJ dad-10733 1033 33 feedback feedback NOUN dad-10733 1033 34 signal signal NOUN dad-10733 1033 35 for for ADP dad-10733 1033 36 each each DET dad-10733 1033 37 phrase phrase NOUN dad-10733 1033 38 or or CCONJ dad-10733 1033 39 sequence sequence NOUN dad-10733 1033 40 of of ADP dad-10733 1033 41 phrases phrase NOUN dad-10733 1033 42 — — PUNCT dad-10733 1033 43 and and CCONJ dad-10733 1033 44 34 34 NUM dad-10733 1033 45 a a DET dad-10733 1033 46 survey survey NOUN dad-10733 1033 47 of of ADP dad-10733 1033 48 available available ADJ dad-10733 1033 49 corpora corpora PROPN dad-10733 1033 50 for for ADP dad-10733 1033 51 building build VERB dad-10733 1033 52 data data NOUN dad-10733 1033 53 - - PUNCT dad-10733 1033 54 driven drive VERB dad-10733 1033 55 dialogue dialogue NOUN dad-10733 1033 56 systems system NOUN dad-10733 1033 57 then then ADV dad-10733 1033 58 fine fine ADJ dad-10733 1033 59 - - PUNCT dad-10733 1033 60 tune tune NOUN dad-10733 1033 61 models model NOUN dad-10733 1033 62 based base VERB dad-10733 1033 63 on on ADP dad-10733 1033 64 human human ADJ dad-10733 1033 65 feedback feedback NOUN dad-10733 1033 66 . . PUNCT dad-10733 1034 1 researchers researcher NOUN dad-10733 1034 2 have have AUX dad-10733 1034 3 already already ADV dad-10733 1034 4 proposed propose VERB dad-10733 1034 5 various various ADJ dad-10733 1034 6 ways way NOUN dad-10733 1034 7 of of ADP dad-10733 1034 8 applying apply VERB dad-10733 1034 9 transfer transfer NOUN dad-10733 1034 10 learning learning NOUN dad-10733 1034 11 to to PART dad-10733 1034 12 build build VERB dad-10733 1034 13 data data NOUN dad-10733 1034 14 - - PUNCT dad-10733 1034 15 driven drive VERB dad-10733 1034 16 dialogue dialogue NOUN dad-10733 1034 17 systems system NOUN dad-10733 1034 18 , , PUNCT dad-10733 1034 19 ranging range VERB dad-10733 1034 20 from from ADP dad-10733 1034 21 learning learn VERB dad-10733 1034 22 separate separate ADJ dad-10733 1034 23 sub sub NOUN dad-10733 1034 24 - - NOUN dad-10733 1034 25 components component NOUN dad-10733 1034 26 of of ADP dad-10733 1034 27 the the DET dad-10733 1034 28 dialogue dialogue NOUN dad-10733 1034 29 system system NOUN dad-10733 1034 30 ( ( PUNCT dad-10733 1034 31 e.g. e.g. ADV dad-10733 1034 32 intent intent NOUN dad-10733 1034 33 and and CCONJ dad-10733 1034 34 dialogue dialogue NOUN dad-10733 1034 35 act act PROPN dad-10733 1034 36 classification classification NOUN dad-10733 1034 37 ) ) PUNCT dad-10733 1034 38 to to ADP dad-10733 1034 39 learning learn VERB dad-10733 1034 40 the the DET dad-10733 1034 41 entire entire ADJ dad-10733 1034 42 dialogue dialogue NOUN dad-10733 1034 43 system system NOUN dad-10733 1034 44 ( ( PUNCT dad-10733 1034 45 e.g. e.g. ADV dad-10733 1034 46 in in ADP dad-10733 1034 47 an an DET dad-10733 1034 48 unsupervised unsupervised ADJ dad-10733 1034 49 or or CCONJ dad-10733 1034 50 reinforcement reinforcement NOUN dad-10733 1034 51 learning learning NOUN dad-10733 1034 52 framework framework NOUN dad-10733 1034 53 ) ) PUNCT dad-10733 1034 54 using use VERB dad-10733 1034 55 transfer transfer NOUN dad-10733 1034 56 learning learning NOUN dad-10733 1034 57 ( ( PUNCT dad-10733 1034 58 fabbrizio fabbrizio NOUN dad-10733 1034 59 et et PROPN dad-10733 1034 60 al al PROPN dad-10733 1034 61 . . PROPN dad-10733 1034 62 , , PUNCT dad-10733 1034 63 2004 2004 NUM dad-10733 1034 64 ; ; PUNCT dad-10733 1034 65 forgues forgue NOUN dad-10733 1034 66 et et PROPN dad-10733 1034 67 al al PROPN dad-10733 1034 68 . . PROPN dad-10733 1034 69 , , PUNCT dad-10733 1034 70 2014 2014 NUM dad-10733 1034 71 ; ; PUNCT dad-10733 1034 72 serban serban NOUN dad-10733 1034 73 and and CCONJ dad-10733 1034 74 pineau pineau PROPN dad-10733 1034 75 , , PUNCT dad-10733 1034 76 2015 2015 NUM dad-10733 1034 77 ; ; PUNCT dad-10733 1034 78 serban serban PROPN dad-10733 1034 79 et et PROPN dad-10733 1034 80 al al PROPN dad-10733 1034 81 . . PROPN dad-10733 1034 82 , , PUNCT dad-10733 1034 83 2016 2016 NUM dad-10733 1034 84 ; ; PUNCT dad-10733 1034 85 lowe lowe PROPN dad-10733 1034 86 et et PROPN dad-10733 1034 87 al al PROPN dad-10733 1034 88 . . PROPN dad-10733 1034 89 , , PUNCT dad-10733 1034 90 2015a 2015a NUM dad-10733 1034 91 ; ; PUNCT dad-10733 1034 92 vandyke vandyke PROPN dad-10733 1034 93 et et PROPN dad-10733 1034 94 al al PROPN dad-10733 1034 95 . . PROPN dad-10733 1034 96 , , PUNCT dad-10733 1034 97 2015 2015 NUM dad-10733 1034 98 ; ; PUNCT dad-10733 1034 99 wen wen PROPN dad-10733 1034 100 et et PROPN dad-10733 1034 101 al al PROPN dad-10733 1034 102 . . PROPN dad-10733 1034 103 , , PUNCT dad-10733 1034 104 2016 2016 NUM dad-10733 1034 105 ; ; PUNCT dad-10733 1034 106 gašić gašić ADV dad-10733 1034 107 et et PROPN dad-10733 1034 108 al al PROPN dad-10733 1034 109 . . PROPN dad-10733 1034 110 , , PUNCT dad-10733 1034 111 2016 2016 NUM dad-10733 1034 112 ; ; PUNCT dad-10733 1034 113 mo mo PROPN dad-10733 1034 114 et et PROPN dad-10733 1034 115 al al PROPN dad-10733 1034 116 . . PROPN dad-10733 1034 117 , , PUNCT dad-10733 1034 118 2016 2016 NUM dad-10733 1034 119 ; ; PUNCT dad-10733 1034 120 genevay genevay NOUN dad-10733 1034 121 and and CCONJ dad-10733 1034 122 laroche laroche PROPN dad-10733 1034 123 , , PUNCT dad-10733 1034 124 2016 2016 NUM dad-10733 1034 125 ; ; PUNCT dad-10733 1034 126 chen chen PROPN dad-10733 1034 127 et et PROPN dad-10733 1034 128 al al PROPN dad-10733 1034 129 . . PROPN dad-10733 1034 130 , , PUNCT dad-10733 1034 131 2016 2016 NUM dad-10733 1034 132 ) ) PUNCT dad-10733 1034 133 5.3 5.3 NUM dad-10733 1034 134 incorporating incorporate VERB dad-10733 1034 135 external external ADJ dad-10733 1034 136 knowledge knowledge NOUN dad-10733 1034 137 another another DET dad-10733 1034 138 interesting interesting ADJ dad-10733 1034 139 research research NOUN dad-10733 1034 140 direction direction NOUN dad-10733 1034 141 is be AUX dad-10733 1034 142 the the DET dad-10733 1034 143 incorporation incorporation NOUN dad-10733 1034 144 of of ADP dad-10733 1034 145 external external ADJ dad-10733 1034 146 knowledge knowledge NOUN dad-10733 1034 147 sources source NOUN dad-10733 1034 148 in in ADP dad-10733 1034 149 order order NOUN dad-10733 1034 150 to to PART dad-10733 1034 151 inform inform VERB dad-10733 1034 152 the the DET dad-10733 1034 153 response response NOUN dad-10733 1034 154 to to PART dad-10733 1034 155 be be AUX dad-10733 1034 156 generated generate VERB dad-10733 1034 157 . . PUNCT dad-10733 1035 1 using use VERB dad-10733 1035 2 external external ADJ dad-10733 1035 3 information information NOUN dad-10733 1035 4 is be AUX dad-10733 1035 5 of of ADP dad-10733 1035 6 great great ADJ dad-10733 1035 7 importance importance NOUN dad-10733 1035 8 to to ADP dad-10733 1035 9 dialogues dialogue NOUN dad-10733 1035 10 systems system NOUN dad-10733 1035 11 , , PUNCT dad-10733 1035 12 particularly particularly ADV dad-10733 1035 13 in in ADP dad-10733 1035 14 the the DET dad-10733 1035 15 goal goal NOUN dad-10733 1035 16 - - PUNCT dad-10733 1035 17 driven drive VERB dad-10733 1035 18 setting setting NOUN dad-10733 1035 19 . . PUNCT dad-10733 1036 1 even even ADV dad-10733 1036 2 non non ADJ dad-10733 1036 3 - - ADJ dad-10733 1036 4 goal goal ADJ dad-10733 1036 5 - - PUNCT dad-10733 1036 6 driven drive VERB dad-10733 1036 7 dialogue dialogue NOUN dad-10733 1036 8 systems system NOUN dad-10733 1036 9 designed design VERB dad-10733 1036 10 to to PART dad-10733 1036 11 simply simply ADV dad-10733 1036 12 entertain entertain VERB dad-10733 1036 13 the the DET dad-10733 1036 14 user user NOUN dad-10733 1036 15 could could AUX dad-10733 1036 16 benefit benefit VERB dad-10733 1036 17 from from ADP dad-10733 1036 18 leveraging leverage VERB dad-10733 1036 19 external external ADJ dad-10733 1036 20 information information NOUN dad-10733 1036 21 , , PUNCT dad-10733 1036 22 such such ADJ dad-10733 1036 23 as as ADP dad-10733 1036 24 current current ADJ dad-10733 1036 25 news news NOUN dad-10733 1036 26 articles article NOUN dad-10733 1036 27 or or CCONJ dad-10733 1036 28 movie movie NOUN dad-10733 1036 29 reviews review NOUN dad-10733 1036 30 , , PUNCT dad-10733 1036 31 in in ADP dad-10733 1036 32 order order NOUN dad-10733 1036 33 to to PART dad-10733 1036 34 better well ADV dad-10733 1036 35 converse converse VERB dad-10733 1036 36 about about ADP dad-10733 1036 37 real real ADJ dad-10733 1036 38 - - PUNCT dad-10733 1036 39 world world NOUN dad-10733 1036 40 events event NOUN dad-10733 1036 41 . . PUNCT dad-10733 1037 1 this this PRON dad-10733 1037 2 may may AUX dad-10733 1037 3 be be AUX dad-10733 1037 4 particularly particularly ADV dad-10733 1037 5 useful useful ADJ dad-10733 1037 6 in in ADP dad-10733 1037 7 data data NOUN dad-10733 1037 8 - - PUNCT dad-10733 1037 9 sparse sparse ADJ dad-10733 1037 10 domains domain NOUN dad-10733 1037 11 , , PUNCT dad-10733 1037 12 when when SCONJ dad-10733 1037 13 there there PRON dad-10733 1037 14 is be VERB dad-10733 1037 15 insufficient insufficient ADJ dad-10733 1037 16 dialogue dialogue NOUN dad-10733 1037 17 training training NOUN dad-10733 1037 18 data datum NOUN dad-10733 1037 19 to to PART dad-10733 1037 20 reliably reliably ADV dad-10733 1037 21 learn learn VERB dad-10733 1037 22 a a DET dad-10733 1037 23 response response NOUN dad-10733 1037 24 that that PRON dad-10733 1037 25 is be AUX dad-10733 1037 26 appropriate appropriate ADJ dad-10733 1037 27 for for SCONJ dad-10733 1037 28 each each DET dad-10733 1037 29 input input NOUN dad-10733 1037 30 utterance utterance ADV dad-10733 1037 31 , , PUNCT dad-10733 1037 32 or or CCONJ dad-10733 1037 33 in in ADP dad-10733 1037 34 domains domain NOUN dad-10733 1037 35 that that PRON dad-10733 1037 36 evolve evolve VERB dad-10733 1037 37 quickly quickly ADV dad-10733 1037 38 over over ADP dad-10733 1037 39 time time NOUN dad-10733 1037 40 . . PUNCT dad-10733 1038 1 5.3.1 5.3.1 NUM dad-10733 1038 2 structured structured ADJ dad-10733 1038 3 external external ADJ dad-10733 1038 4 knowledge knowledge NOUN dad-10733 1038 5 in in ADP dad-10733 1038 6 traditional traditional ADJ dad-10733 1038 7 goal goal NOUN dad-10733 1038 8 - - PUNCT dad-10733 1038 9 driven drive VERB dad-10733 1038 10 dialogue dialogue NOUN dad-10733 1038 11 systems system NOUN dad-10733 1038 12 ( ( PUNCT dad-10733 1038 13 levin levin PROPN dad-10733 1038 14 and and CCONJ dad-10733 1038 15 pieraccini pieraccini NOUN dad-10733 1038 16 , , PUNCT dad-10733 1038 17 1997 1997 NUM dad-10733 1038 18 ) ) PUNCT dad-10733 1038 19 , , PUNCT dad-10733 1038 20 where where SCONJ dad-10733 1038 21 the the DET dad-10733 1038 22 goal goal NOUN dad-10733 1038 23 is be AUX dad-10733 1038 24 to to PART dad-10733 1038 25 provide provide VERB dad-10733 1038 26 information information NOUN dad-10733 1038 27 to to ADP dad-10733 1038 28 the the DET dad-10733 1038 29 user user NOUN dad-10733 1038 30 , , PUNCT dad-10733 1038 31 there there PRON dad-10733 1038 32 is be VERB dad-10733 1038 33 already already ADV dad-10733 1038 34 extensive extensive ADJ dad-10733 1038 35 use use NOUN dad-10733 1038 36 of of ADP dad-10733 1038 37 external external ADJ dad-10733 1038 38 knowledge knowledge NOUN dad-10733 1038 39 sources source NOUN dad-10733 1038 40 . . PUNCT dad-10733 1039 1 for for ADP dad-10733 1039 2 example example NOUN dad-10733 1039 3 , , PUNCT dad-10733 1039 4 in in ADP dad-10733 1039 5 the the DET dad-10733 1039 6 let let NOUN dad-10733 1039 7 ’s ’s NOUN dad-10733 1039 8 go go VERB dad-10733 1039 9 ! ! PUNCT dad-10733 1040 1 dialogue dialogue NOUN dad-10733 1040 2 system system NOUN dad-10733 1040 3 ( ( PUNCT dad-10733 1040 4 raux raux PROPN dad-10733 1040 5 et et PROPN dad-10733 1040 6 al al PROPN dad-10733 1040 7 . . PROPN dad-10733 1040 8 , , PUNCT dad-10733 1040 9 2005 2005 NUM dad-10733 1040 10 ) ) PUNCT dad-10733 1040 11 , , PUNCT dad-10733 1040 12 the the DET dad-10733 1040 13 user user NOUN dad-10733 1040 14 requests request VERB dad-10733 1040 15 information information NOUN dad-10733 1040 16 about about ADP dad-10733 1040 17 various various ADJ dad-10733 1040 18 bus bus NOUN dad-10733 1040 19 arrival arrival NOUN dad-10733 1040 20 and and CCONJ dad-10733 1040 21 departure departure NOUN dad-10733 1040 22 times time NOUN dad-10733 1040 23 . . PUNCT dad-10733 1041 1 thus thus ADV dad-10733 1041 2 , , PUNCT dad-10733 1041 3 a a DET dad-10733 1041 4 critical critical ADJ dad-10733 1041 5 input input NOUN dad-10733 1041 6 to to ADP dad-10733 1041 7 the the DET dad-10733 1041 8 model model NOUN dad-10733 1041 9 is be AUX dad-10733 1041 10 the the DET dad-10733 1041 11 actual actual ADJ dad-10733 1041 12 bus bus NOUN dad-10733 1041 13 schedule schedule NOUN dad-10733 1041 14 , , PUNCT dad-10733 1041 15 which which PRON dad-10733 1041 16 is be AUX dad-10733 1041 17 used use VERB dad-10733 1041 18 in in ADP dad-10733 1041 19 order order NOUN dad-10733 1041 20 to to PART dad-10733 1041 21 generate generate VERB dad-10733 1041 22 the the DET dad-10733 1041 23 system system NOUN dad-10733 1041 24 ’s ’s PART dad-10733 1041 25 utterances utterance NOUN dad-10733 1041 26 . . PUNCT dad-10733 1042 1 another another DET dad-10733 1042 2 example example NOUN dad-10733 1042 3 is be AUX dad-10733 1042 4 the the DET dad-10733 1042 5 dialogue dialogue NOUN dad-10733 1042 6 system system NOUN dad-10733 1042 7 described describe VERB dad-10733 1042 8 by by ADP dad-10733 1042 9 nöth nöth PROPN dad-10733 1042 10 et et PROPN dad-10733 1042 11 al al PROPN dad-10733 1042 12 . . PROPN dad-10733 1043 1 ( ( PUNCT dad-10733 1043 2 2004 2004 NUM dad-10733 1043 3 ) ) PUNCT dad-10733 1043 4 , , PUNCT dad-10733 1043 5 which which PRON dad-10733 1043 6 helps help VERB dad-10733 1043 7 users user NOUN dad-10733 1043 8 find find VERB dad-10733 1043 9 movie movie NOUN dad-10733 1043 10 information information NOUN dad-10733 1043 11 by by ADP dad-10733 1043 12 utilizing utilize VERB dad-10733 1043 13 movie movie NOUN dad-10733 1043 14 show show NOUN dad-10733 1043 15 times time NOUN dad-10733 1043 16 from from ADP dad-10733 1043 17 different different ADJ dad-10733 1043 18 cinemas cinema NOUN dad-10733 1043 19 . . PUNCT dad-10733 1044 1 such such ADJ dad-10733 1044 2 examples example NOUN dad-10733 1044 3 are be AUX dad-10733 1044 4 abundant abundant ADJ dad-10733 1044 5 both both CCONJ dad-10733 1044 6 in in ADP dad-10733 1044 7 the the DET dad-10733 1044 8 literature literature NOUN dad-10733 1044 9 and and CCONJ dad-10733 1044 10 in in ADP dad-10733 1044 11 practice practice NOUN dad-10733 1044 12 . . PUNCT dad-10733 1045 1 although although SCONJ dad-10733 1045 2 these these DET dad-10733 1045 3 models model NOUN dad-10733 1045 4 make make VERB dad-10733 1045 5 use use NOUN dad-10733 1045 6 of of ADP dad-10733 1045 7 external external ADJ dad-10733 1045 8 knowledge knowledge NOUN dad-10733 1045 9 , , PUNCT dad-10733 1045 10 the the DET dad-10733 1045 11 knowledge knowledge NOUN dad-10733 1045 12 sources source NOUN dad-10733 1045 13 in in ADP dad-10733 1045 14 these these DET dad-10733 1045 15 cases case NOUN dad-10733 1045 16 are be AUX dad-10733 1045 17 highly highly ADV dad-10733 1045 18 structured structured ADJ dad-10733 1045 19 and and CCONJ dad-10733 1045 20 are be AUX dad-10733 1045 21 only only ADV dad-10733 1045 22 used use VERB dad-10733 1045 23 to to PART dad-10733 1045 24 place place VERB dad-10733 1045 25 hard hard ADJ dad-10733 1045 26 constraints constraint NOUN dad-10733 1045 27 on on ADP dad-10733 1045 28 the the DET dad-10733 1045 29 possible possible ADJ dad-10733 1045 30 states state NOUN dad-10733 1045 31 of of ADP dad-10733 1045 32 an an DET dad-10733 1045 33 utterance utterance NOUN dad-10733 1045 34 to to PART dad-10733 1045 35 be be AUX dad-10733 1045 36 generated generate VERB dad-10733 1045 37 . . PUNCT dad-10733 1046 1 they they PRON dad-10733 1046 2 are be AUX dad-10733 1046 3 essentially essentially ADV dad-10733 1046 4 contained contain VERB dad-10733 1046 5 in in ADP dad-10733 1046 6 relational relational ADJ dad-10733 1046 7 databases database NOUN dad-10733 1046 8 or or CCONJ dad-10733 1046 9 structured structured ADJ dad-10733 1046 10 ontologies ontology NOUN dad-10733 1046 11 , , PUNCT dad-10733 1046 12 and and CCONJ dad-10733 1046 13 are be AUX dad-10733 1046 14 only only ADV dad-10733 1046 15 used use VERB dad-10733 1046 16 to to PART dad-10733 1046 17 provide provide VERB dad-10733 1046 18 a a DET dad-10733 1046 19 deterministic deterministic ADJ dad-10733 1046 20 mapping mapping NOUN dad-10733 1046 21 from from ADP dad-10733 1046 22 the the DET dad-10733 1046 23 dialogue dialogue NOUN dad-10733 1046 24 states state NOUN dad-10733 1046 25 extracted extract VERB dad-10733 1046 26 from from ADP dad-10733 1046 27 an an DET dad-10733 1046 28 input input NOUN dad-10733 1046 29 user user NOUN dad-10733 1046 30 utterance utterance NOUN dad-10733 1046 31 to to ADP dad-10733 1046 32 the the DET dad-10733 1046 33 dialogue dialogue NOUN dad-10733 1046 34 system system NOUN dad-10733 1046 35 state state NOUN dad-10733 1046 36 or or CCONJ dad-10733 1046 37 the the DET dad-10733 1046 38 generated generate VERB dad-10733 1046 39 response response NOUN dad-10733 1046 40 . . PUNCT dad-10733 1047 1 complementary complementary ADJ dad-10733 1047 2 to to ADP dad-10733 1047 3 domain domain NOUN dad-10733 1047 4 - - PUNCT dad-10733 1047 5 specific specific ADJ dad-10733 1047 6 databases database NOUN dad-10733 1047 7 and and CCONJ dad-10733 1047 8 ontologies ontology NOUN dad-10733 1047 9 are be AUX dad-10733 1047 10 the the DET dad-10733 1047 11 general general ADJ dad-10733 1047 12 natural natural ADJ dad-10733 1047 13 language language NOUN dad-10733 1047 14 processing processing NOUN dad-10733 1047 15 databases database NOUN dad-10733 1047 16 and and CCONJ dad-10733 1047 17 tools tool NOUN dad-10733 1047 18 . . PUNCT dad-10733 1048 1 these these PRON dad-10733 1048 2 include include VERB dad-10733 1048 3 lexical lexical ADJ dad-10733 1048 4 databases database NOUN dad-10733 1048 5 such such ADJ dad-10733 1048 6 as as ADP dad-10733 1048 7 wordnet wordnet NOUN dad-10733 1048 8 ( ( PUNCT dad-10733 1048 9 miller miller PROPN dad-10733 1048 10 , , PUNCT dad-10733 1048 11 1995 1995 NUM dad-10733 1048 12 ) ) PUNCT dad-10733 1048 13 , , PUNCT dad-10733 1048 14 which which PRON dad-10733 1048 15 contains contain VERB dad-10733 1048 16 lexical lexical ADJ dad-10733 1048 17 relationships relationship NOUN dad-10733 1048 18 between between ADP dad-10733 1048 19 words word NOUN dad-10733 1048 20 for for ADP dad-10733 1048 21 over over ADP dad-10733 1048 22 a a DET dad-10733 1048 23 hundred hundred NUM dad-10733 1048 24 thousand thousand NUM dad-10733 1048 25 words word NOUN dad-10733 1048 26 , , PUNCT dad-10733 1048 27 verbnet verbnet NOUN dad-10733 1048 28 ( ( PUNCT dad-10733 1048 29 schuler schuler NOUN dad-10733 1048 30 , , PUNCT dad-10733 1048 31 2005 2005 NUM dad-10733 1048 32 ) ) PUNCT dad-10733 1048 33 which which PRON dad-10733 1048 34 contains contain VERB dad-10733 1048 35 lexical lexical ADJ dad-10733 1048 36 relations relation NOUN dad-10733 1048 37 between between ADP dad-10733 1048 38 verbs verb NOUN dad-10733 1048 39 , , PUNCT dad-10733 1048 40 and and CCONJ dad-10733 1048 41 framenet framenet NOUN dad-10733 1048 42 ( ( PUNCT dad-10733 1048 43 ruppenhofer ruppenhofer NOUN dad-10733 1048 44 et et NOUN dad-10733 1048 45 al al PROPN dad-10733 1048 46 . . PROPN dad-10733 1048 47 , , PUNCT dad-10733 1048 48 2006 2006 NUM dad-10733 1048 49 ) ) PUNCT dad-10733 1048 50 , , PUNCT dad-10733 1048 51 which which PRON dad-10733 1048 52 contains contain VERB dad-10733 1048 53 ’ ' PUNCT dad-10733 1048 54 word word NOUN dad-10733 1048 55 senses sense NOUN dad-10733 1048 56 ’ ' PUNCT dad-10733 1048 57 for for ADP dad-10733 1048 58 over over ADP dad-10733 1048 59 ten ten NUM dad-10733 1048 60 thousand thousand NUM dad-10733 1048 61 words word NOUN dad-10733 1048 62 along along ADP dad-10733 1048 63 with with ADP dad-10733 1048 64 examples example NOUN dad-10733 1048 65 of of ADP dad-10733 1048 66 each each DET dad-10733 1048 67 word word NOUN dad-10733 1048 68 sense sense NOUN dad-10733 1048 69 . . PUNCT dad-10733 1049 1 in in ADP dad-10733 1049 2 addition addition NOUN dad-10733 1049 3 , , PUNCT dad-10733 1049 4 there there PRON dad-10733 1049 5 exist exist VERB dad-10733 1049 6 several several ADJ dad-10733 1049 7 natural natural ADJ dad-10733 1049 8 language language NOUN dad-10733 1049 9 processing processing NOUN dad-10733 1049 10 tools tool NOUN dad-10733 1049 11 such such ADJ dad-10733 1049 12 as as ADP dad-10733 1049 13 part part NOUN dad-10733 1049 14 of of ADP dad-10733 1049 15 speech speech NOUN dad-10733 1049 16 taggers tagger NOUN dad-10733 1049 17 , , PUNCT dad-10733 1049 18 word word NOUN dad-10733 1049 19 category category NOUN dad-10733 1049 20 classifiers classifier NOUN dad-10733 1049 21 , , PUNCT dad-10733 1049 22 word word NOUN dad-10733 1049 23 embedding embed VERB dad-10733 1049 24 models model NOUN dad-10733 1049 25 , , PUNCT dad-10733 1049 26 named name VERB dad-10733 1049 27 entity entity NOUN dad-10733 1049 28 recognition recognition NOUN dad-10733 1049 29 models model NOUN dad-10733 1049 30 , , PUNCT dad-10733 1049 31 coreference coreference NOUN dad-10733 1049 32 resolution resolution NOUN dad-10733 1049 33 models model NOUN dad-10733 1049 34 , , PUNCT dad-10733 1049 35 semantic semantic ADJ dad-10733 1049 36 role role NOUN dad-10733 1049 37 labeling labeling NOUN dad-10733 1049 38 models model NOUN dad-10733 1049 39 , , PUNCT dad-10733 1049 40 semantic semantic ADJ dad-10733 1049 41 similarity similarity NOUN dad-10733 1049 42 models model NOUN dad-10733 1049 43 and and CCONJ dad-10733 1049 44 sentiment sentiment NOUN dad-10733 1049 45 analysis analysis NOUN dad-10733 1049 46 models model NOUN dad-10733 1049 47 ( ( PUNCT dad-10733 1049 48 manning man VERB dad-10733 1049 49 and and CCONJ dad-10733 1049 50 schütze schütze NOUN dad-10733 1049 51 , , PUNCT dad-10733 1049 52 1999 1999 NUM dad-10733 1049 53 ; ; PUNCT dad-10733 1049 54 jurafsky jurafsky PROPN dad-10733 1049 55 and and CCONJ dad-10733 1049 56 martin martin PROPN dad-10733 1049 57 , , PUNCT dad-10733 1049 58 2008 2008 NUM dad-10733 1049 59 ; ; PUNCT dad-10733 1049 60 mikolov mikolov PROPN dad-10733 1049 61 et et PROPN dad-10733 1049 62 al al PROPN dad-10733 1049 63 . . PROPN dad-10733 1049 64 , , PUNCT dad-10733 1049 65 2013 2013 NUM dad-10733 1049 66 ; ; PUNCT dad-10733 1049 67 gurevych gurevych NOUN dad-10733 1049 68 and and CCONJ dad-10733 1049 69 strube strube NOUN dad-10733 1049 70 , , PUNCT dad-10733 1049 71 2004 2004 NUM dad-10733 1049 72 ; ; PUNCT dad-10733 1049 73 lin lin PROPN dad-10733 1049 74 and and CCONJ dad-10733 1049 75 walker walker NOUN dad-10733 1049 76 , , PUNCT dad-10733 1049 77 2011b 2011b NUM dad-10733 1049 78 ) ) PUNCT dad-10733 1049 79 that that PRON dad-10733 1049 80 may may AUX dad-10733 1049 81 be be AUX dad-10733 1049 82 used use VERB dad-10733 1049 83 by by ADP dad-10733 1049 84 the the DET dad-10733 1049 85 natural natural ADJ dad-10733 1049 86 language language NOUN dad-10733 1049 87 understanding understanding NOUN dad-10733 1049 88 component component NOUN dad-10733 1049 89 to to PART dad-10733 1049 90 extract extract VERB dad-10733 1049 91 meaning meaning NOUN dad-10733 1049 92 from from ADP dad-10733 1049 93 human human ADJ dad-10733 1049 94 utterances utterance NOUN dad-10733 1049 95 . . PUNCT dad-10733 1050 1 since since SCONJ dad-10733 1050 2 these these DET dad-10733 1050 3 tools tool NOUN dad-10733 1050 4 are be AUX dad-10733 1050 5 typically typically ADV dad-10733 1050 6 built build VERB dad-10733 1050 7 upon upon SCONJ dad-10733 1050 8 texts text NOUN dad-10733 1050 9 and and CCONJ dad-10733 1050 10 annotations annotation NOUN dad-10733 1050 11 created create VERB dad-10733 1050 12 by by ADP dad-10733 1050 13 humans human NOUN dad-10733 1050 14 , , PUNCT dad-10733 1050 15 using use VERB dad-10733 1050 16 them they PRON dad-10733 1050 17 inside inside ADP dad-10733 1050 18 a a DET dad-10733 1050 19 dialogue dialogue NOUN dad-10733 1050 20 system system NOUN dad-10733 1050 21 can can AUX dad-10733 1050 22 be be AUX dad-10733 1050 23 interpreted interpret VERB dad-10733 1050 24 as as ADP dad-10733 1050 25 a a DET dad-10733 1050 26 form form NOUN dad-10733 1050 27 of of ADP dad-10733 1050 28 structured structured ADJ dad-10733 1050 29 transfer transfer NOUN dad-10733 1050 30 learning learning NOUN dad-10733 1050 31 , , PUNCT dad-10733 1050 32 where where SCONJ dad-10733 1050 33 the the DET dad-10733 1050 34 relationships relationship NOUN dad-10733 1050 35 or or CCONJ dad-10733 1050 36 labels label NOUN dad-10733 1050 37 learned learn VERB dad-10733 1050 38 35 35 NUM dad-10733 1050 39 serban serban PROPN dad-10733 1050 40 , , PUNCT dad-10733 1050 41 lowe lowe PROPN dad-10733 1050 42 , , PUNCT dad-10733 1050 43 henderson henderson PROPN dad-10733 1050 44 , , PUNCT dad-10733 1050 45 charlin charlin PROPN dad-10733 1050 46 and and CCONJ dad-10733 1050 47 pineau pineau PROPN dad-10733 1050 48 from from ADP dad-10733 1050 49 the the DET dad-10733 1050 50 original original ADJ dad-10733 1050 51 natural natural ADJ dad-10733 1050 52 language language NOUN dad-10733 1050 53 processing processing NOUN dad-10733 1050 54 corpus corpu NOUN dad-10733 1050 55 provide provide VERB dad-10733 1050 56 additional additional ADJ dad-10733 1050 57 information information NOUN dad-10733 1050 58 to to ADP dad-10733 1050 59 the the DET dad-10733 1050 60 dialogue dialogue NOUN dad-10733 1050 61 system system NOUN dad-10733 1050 62 and and CCONJ dad-10733 1050 63 improve improve VERB dad-10733 1050 64 generalization generalization NOUN dad-10733 1050 65 of of ADP dad-10733 1050 66 the the DET dad-10733 1050 67 system system NOUN dad-10733 1050 68 . . PUNCT dad-10733 1051 1 5.3.2 5.3.2 NUM dad-10733 1051 2 unstructured unstructured ADJ dad-10733 1051 3 external external ADJ dad-10733 1051 4 knowledge knowledge NOUN dad-10733 1051 5 complementary complementary ADJ dad-10733 1051 6 sources source NOUN dad-10733 1051 7 of of ADP dad-10733 1051 8 information information NOUN dad-10733 1051 9 can can AUX dad-10733 1051 10 be be AUX dad-10733 1051 11 found find VERB dad-10733 1051 12 in in ADP dad-10733 1051 13 unstructured unstructured ADJ dad-10733 1051 14 knowledge knowledge NOUN dad-10733 1051 15 sources source NOUN dad-10733 1051 16 , , PUNCT dad-10733 1051 17 such such ADJ dad-10733 1051 18 as as ADP dad-10733 1051 19 online online ADJ dad-10733 1051 20 encyclopedias encyclopedia NOUN dad-10733 1051 21 ( ( PUNCT dad-10733 1051 22 wikipedia wikipedia PROPN dad-10733 1051 23 ( ( PUNCT dad-10733 1051 24 denoyer denoyer NOUN dad-10733 1051 25 and and CCONJ dad-10733 1051 26 gallinari gallinari PROPN dad-10733 1051 27 , , PUNCT dad-10733 1051 28 2007 2007 NUM dad-10733 1051 29 ) ) PUNCT dad-10733 1051 30 ) ) PUNCT dad-10733 1051 31 as as ADV dad-10733 1051 32 well well ADV dad-10733 1051 33 as as ADP dad-10733 1051 34 domain domain NOUN dad-10733 1051 35 - - PUNCT dad-10733 1051 36 specific specific ADJ dad-10733 1051 37 sources source NOUN dad-10733 1051 38 ( ( PUNCT dad-10733 1051 39 lowe lowe PROPN dad-10733 1051 40 et et PROPN dad-10733 1051 41 al al PROPN dad-10733 1051 42 . . PROPN dad-10733 1051 43 , , PUNCT dad-10733 1051 44 2015b 2015b NUM dad-10733 1051 45 ) ) PUNCT dad-10733 1051 46 . . PUNCT dad-10733 1052 1 it it PRON dad-10733 1052 2 is be AUX dad-10733 1052 3 beyond beyond ADP dad-10733 1052 4 the the DET dad-10733 1052 5 scope scope NOUN dad-10733 1052 6 of of ADP dad-10733 1052 7 this this DET dad-10733 1052 8 paper paper NOUN dad-10733 1052 9 to to PART dad-10733 1052 10 review review VERB dad-10733 1052 11 all all DET dad-10733 1052 12 possible possible ADJ dad-10733 1052 13 ways way NOUN dad-10733 1052 14 that that PRON dad-10733 1052 15 these these DET dad-10733 1052 16 unstructured unstructured ADJ dad-10733 1052 17 knowledge knowledge NOUN dad-10733 1052 18 sources source NOUN dad-10733 1052 19 have have VERB dad-10733 1052 20 or or CCONJ dad-10733 1052 21 could could AUX dad-10733 1052 22 be be AUX dad-10733 1052 23 used use VERB dad-10733 1052 24 in in ADP dad-10733 1052 25 conjunction conjunction NOUN dad-10733 1052 26 with with ADP dad-10733 1052 27 a a DET dad-10733 1052 28 data data NOUN dad-10733 1052 29 - - PUNCT dad-10733 1052 30 driven drive VERB dad-10733 1052 31 dialogue dialogue NOUN dad-10733 1052 32 system system NOUN dad-10733 1052 33 . . PUNCT dad-10733 1053 1 however however ADV dad-10733 1053 2 , , PUNCT dad-10733 1053 3 we we PRON dad-10733 1053 4 note note VERB dad-10733 1053 5 that that SCONJ dad-10733 1053 6 this this PRON dad-10733 1053 7 is be AUX dad-10733 1053 8 likely likely ADJ dad-10733 1053 9 to to PART dad-10733 1053 10 be be AUX dad-10733 1053 11 a a DET dad-10733 1053 12 fruitful fruitful ADJ dad-10733 1053 13 research research NOUN dad-10733 1053 14 area area NOUN dad-10733 1053 15 . . PUNCT dad-10733 1054 1 5.4 5.4 NUM dad-10733 1054 2 personalized personalize VERB dad-10733 1054 3 dialogue dialogue NOUN dad-10733 1054 4 agents agent NOUN dad-10733 1054 5 when when SCONJ dad-10733 1054 6 conversing converse VERB dad-10733 1054 7 , , PUNCT dad-10733 1054 8 humans human NOUN dad-10733 1054 9 often often ADV dad-10733 1054 10 adapt adapt VERB dad-10733 1054 11 to to ADP dad-10733 1054 12 their their PRON dad-10733 1054 13 interlocutor interlocutor NOUN dad-10733 1054 14 to to PART dad-10733 1054 15 facilitate facilitate VERB dad-10733 1054 16 understanding understanding NOUN dad-10733 1054 17 , , PUNCT dad-10733 1054 18 and and CCONJ dad-10733 1054 19 thus thus ADV dad-10733 1054 20 improve improve VERB dad-10733 1054 21 conversational conversational ADJ dad-10733 1054 22 efficiency efficiency NOUN dad-10733 1054 23 and and CCONJ dad-10733 1054 24 satisfaction satisfaction NOUN dad-10733 1054 25 . . PUNCT dad-10733 1055 1 attaining attain VERB dad-10733 1055 2 human human ADJ dad-10733 1055 3 - - PUNCT dad-10733 1055 4 level level NOUN dad-10733 1055 5 performance performance NOUN dad-10733 1055 6 with with ADP dad-10733 1055 7 dialogue dialogue NOUN dad-10733 1055 8 agents agent NOUN dad-10733 1055 9 may may AUX dad-10733 1055 10 well well ADV dad-10733 1055 11 require require VERB dad-10733 1055 12 personalization personalization NOUN dad-10733 1055 13 , , PUNCT dad-10733 1055 14 i.e. i.e. X dad-10733 1055 15 models model NOUN dad-10733 1055 16 that that PRON dad-10733 1055 17 are be AUX dad-10733 1055 18 aware aware ADJ dad-10733 1055 19 and and CCONJ dad-10733 1055 20 capable capable ADJ dad-10733 1055 21 of of ADP dad-10733 1055 22 adapting adapt VERB dad-10733 1055 23 to to ADP dad-10733 1055 24 their their PRON dad-10733 1055 25 interlocutor interlocutor NOUN dad-10733 1055 26 . . PUNCT dad-10733 1056 1 such such ADJ dad-10733 1056 2 capabilities capability NOUN dad-10733 1056 3 could could AUX dad-10733 1056 4 increase increase VERB dad-10733 1056 5 the the DET dad-10733 1056 6 effectiveness effectiveness NOUN dad-10733 1056 7 and and CCONJ dad-10733 1056 8 naturalness naturalness NOUN dad-10733 1056 9 of of ADP dad-10733 1056 10 generated generate VERB dad-10733 1056 11 dialogues dialogue NOUN dad-10733 1056 12 ( ( PUNCT dad-10733 1056 13 lucas lucas PROPN dad-10733 1056 14 et et PROPN dad-10733 1056 15 al al PROPN dad-10733 1056 16 . . PROPN dad-10733 1056 17 , , PUNCT dad-10733 1056 18 2009 2009 NUM dad-10733 1056 19 ; ; PUNCT dad-10733 1056 20 su su PROPN dad-10733 1056 21 et et PROPN dad-10733 1056 22 al al PROPN dad-10733 1056 23 . . PROPN dad-10733 1056 24 , , PUNCT dad-10733 1056 25 2013 2013 NUM dad-10733 1056 26 ) ) PUNCT dad-10733 1056 27 . . PUNCT dad-10733 1057 1 we we PRON dad-10733 1057 2 see see VERB dad-10733 1057 3 personalization personalization NOUN dad-10733 1057 4 of of ADP dad-10733 1057 5 dialogue dialogue NOUN dad-10733 1057 6 systems system NOUN dad-10733 1057 7 as as ADP dad-10733 1057 8 an an DET dad-10733 1057 9 important important ADJ dad-10733 1057 10 task task NOUN dad-10733 1057 11 , , PUNCT dad-10733 1057 12 which which PRON dad-10733 1057 13 so so ADV dad-10733 1057 14 far far ADV dad-10733 1057 15 has have AUX dad-10733 1057 16 not not PART dad-10733 1057 17 received receive VERB dad-10733 1057 18 much much ADJ dad-10733 1057 19 attention attention NOUN dad-10733 1057 20 . . PUNCT dad-10733 1058 1 there there PRON dad-10733 1058 2 has have AUX dad-10733 1058 3 been be AUX dad-10733 1058 4 initial initial ADJ dad-10733 1058 5 efforts effort NOUN dad-10733 1058 6 on on ADP dad-10733 1058 7 userspecific userspecific ADJ dad-10733 1058 8 models model NOUN dad-10733 1058 9 which which PRON dad-10733 1058 10 could could AUX dad-10733 1058 11 be be AUX dad-10733 1058 12 adapted adapt VERB dad-10733 1058 13 to to PART dad-10733 1058 14 work work VERB dad-10733 1058 15 in in ADP dad-10733 1058 16 combination combination NOUN dad-10733 1058 17 with with ADP dad-10733 1058 18 the the DET dad-10733 1058 19 dialogue dialogue NOUN dad-10733 1058 20 models model NOUN dad-10733 1058 21 presented present VERB dad-10733 1058 22 in in ADP dad-10733 1058 23 this this DET dad-10733 1058 24 survey survey NOUN dad-10733 1058 25 ( ( PUNCT dad-10733 1058 26 lucas lucas PROPN dad-10733 1058 27 et et PROPN dad-10733 1058 28 al al PROPN dad-10733 1058 29 . . PROPN dad-10733 1058 30 , , PUNCT dad-10733 1058 31 2009 2009 NUM dad-10733 1058 32 ; ; PUNCT dad-10733 1058 33 lin lin PROPN dad-10733 1058 34 and and CCONJ dad-10733 1058 35 walker walker PROPN dad-10733 1058 36 , , PUNCT dad-10733 1058 37 2011a 2011a NUM dad-10733 1058 38 ; ; PUNCT dad-10733 1058 39 pargellis pargelli NOUN dad-10733 1058 40 et et PROPN dad-10733 1058 41 al al PROPN dad-10733 1058 42 . . PROPN dad-10733 1058 43 , , PUNCT dad-10733 1058 44 2004 2004 NUM dad-10733 1058 45 ) ) PUNCT dad-10733 1058 46 . . PUNCT dad-10733 1059 1 there there PRON dad-10733 1059 2 has have AUX dad-10733 1059 3 also also ADV dad-10733 1059 4 been be AUX dad-10733 1059 5 interesting interesting ADJ dad-10733 1059 6 work work NOUN dad-10733 1059 7 on on ADP dad-10733 1059 8 character character NOUN dad-10733 1059 9 modeling modeling NOUN dad-10733 1059 10 in in ADP dad-10733 1059 11 movies movie NOUN dad-10733 1059 12 ( ( PUNCT dad-10733 1059 13 walker walker PROPN dad-10733 1059 14 et et PROPN dad-10733 1059 15 al al PROPN dad-10733 1059 16 . . PROPN dad-10733 1059 17 , , PUNCT dad-10733 1059 18 2011 2011 NUM dad-10733 1059 19 ; ; PUNCT dad-10733 1059 20 li li PROPN dad-10733 1059 21 et et PROPN dad-10733 1059 22 al al PROPN dad-10733 1059 23 . . PROPN dad-10733 1059 24 , , PUNCT dad-10733 1059 25 2016 2016 NUM dad-10733 1059 26 ; ; PUNCT dad-10733 1059 27 mo mo PROPN dad-10733 1059 28 et et PROPN dad-10733 1059 29 al al PROPN dad-10733 1059 30 . . PROPN dad-10733 1059 31 , , PUNCT dad-10733 1059 32 2016 2016 NUM dad-10733 1059 33 ) ) PUNCT dad-10733 1059 34 . . PUNCT dad-10733 1060 1 there there PRON dad-10733 1060 2 is be VERB dad-10733 1060 3 significant significant ADJ dad-10733 1060 4 potential potential NOUN dad-10733 1060 5 to to PART dad-10733 1060 6 learn learn VERB dad-10733 1060 7 user user NOUN dad-10733 1060 8 models model NOUN dad-10733 1060 9 as as ADP dad-10733 1060 10 part part NOUN dad-10733 1060 11 of of ADP dad-10733 1060 12 dialogue dialogue NOUN dad-10733 1060 13 models model NOUN dad-10733 1060 14 . . PUNCT dad-10733 1061 1 the the DET dad-10733 1061 2 large large ADJ dad-10733 1061 3 datasets dataset NOUN dad-10733 1061 4 presented present VERB dad-10733 1061 5 in in ADP dad-10733 1061 6 this this DET dad-10733 1061 7 paper paper NOUN dad-10733 1061 8 , , PUNCT dad-10733 1061 9 some some PRON dad-10733 1061 10 of of ADP dad-10733 1061 11 which which PRON dad-10733 1061 12 provide provide VERB dad-10733 1061 13 multiple multiple ADJ dad-10733 1061 14 dialogues dialogue NOUN dad-10733 1061 15 per per ADP dad-10733 1061 16 user user NOUN dad-10733 1061 17 , , PUNCT dad-10733 1061 18 may may AUX dad-10733 1061 19 enable enable VERB dad-10733 1061 20 the the DET dad-10733 1061 21 development development NOUN dad-10733 1061 22 of of ADP dad-10733 1061 23 such such ADJ dad-10733 1061 24 models model NOUN dad-10733 1061 25 . . PUNCT dad-10733 1062 1 5.5 5.5 NUM dad-10733 1062 2 evaluation evaluation NOUN dad-10733 1062 3 metrics metric NOUN dad-10733 1062 4 one one NUM dad-10733 1062 5 of of ADP dad-10733 1062 6 the the DET dad-10733 1062 7 most most ADV dad-10733 1062 8 challenging challenging ADJ dad-10733 1062 9 aspects aspect NOUN dad-10733 1062 10 of of ADP dad-10733 1062 11 constructing construct VERB dad-10733 1062 12 dialogue dialogue NOUN dad-10733 1062 13 systems system NOUN dad-10733 1062 14 lies lie VERB dad-10733 1062 15 in in ADP dad-10733 1062 16 their their PRON dad-10733 1062 17 evaluation evaluation NOUN dad-10733 1062 18 . . PUNCT dad-10733 1063 1 while while SCONJ dad-10733 1063 2 the the DET dad-10733 1063 3 end end NOUN dad-10733 1063 4 goal goal NOUN dad-10733 1063 5 is be AUX dad-10733 1063 6 to to PART dad-10733 1063 7 deploy deploy VERB dad-10733 1063 8 the the DET dad-10733 1063 9 dialogue dialogue NOUN dad-10733 1063 10 system system NOUN dad-10733 1063 11 in in ADP dad-10733 1063 12 an an DET dad-10733 1063 13 application application NOUN dad-10733 1063 14 setting setting NOUN dad-10733 1063 15 and and CCONJ dad-10733 1063 16 receive receive VERB dad-10733 1063 17 real real ADJ dad-10733 1063 18 human human ADJ dad-10733 1063 19 feedback feedback NOUN dad-10733 1063 20 , , PUNCT dad-10733 1063 21 getting get VERB dad-10733 1063 22 to to ADP dad-10733 1063 23 this this DET dad-10733 1063 24 stage stage NOUN dad-10733 1063 25 is be AUX dad-10733 1063 26 time time NOUN dad-10733 1063 27 consuming consume VERB dad-10733 1063 28 and and CCONJ dad-10733 1063 29 expensive expensive ADJ dad-10733 1063 30 . . PUNCT dad-10733 1064 1 often often ADV dad-10733 1064 2 it it PRON dad-10733 1064 3 is be AUX dad-10733 1064 4 also also ADV dad-10733 1064 5 necessary necessary ADJ dad-10733 1064 6 to to PART dad-10733 1064 7 optimize optimize VERB dad-10733 1064 8 performance performance NOUN dad-10733 1064 9 on on ADP dad-10733 1064 10 a a DET dad-10733 1064 11 pseudo pseudo NOUN dad-10733 1064 12 - - NOUN dad-10733 1064 13 performance performance NOUN dad-10733 1064 14 metric metric NOUN dad-10733 1064 15 prior prior ADV dad-10733 1064 16 to to ADP dad-10733 1064 17 release release VERB dad-10733 1064 18 . . PUNCT dad-10733 1065 1 this this PRON dad-10733 1065 2 is be AUX dad-10733 1065 3 particularly particularly ADV dad-10733 1065 4 true true ADJ dad-10733 1065 5 if if SCONJ dad-10733 1065 6 a a DET dad-10733 1065 7 dialogue dialogue NOUN dad-10733 1065 8 model model NOUN dad-10733 1065 9 has have VERB dad-10733 1065 10 many many ADJ dad-10733 1065 11 hyper hyper NOUN dad-10733 1065 12 - - NOUN dad-10733 1065 13 parameters parameter NOUN dad-10733 1065 14 to to PART dad-10733 1065 15 be be AUX dad-10733 1065 16 optimized optimize VERB dad-10733 1065 17 — — PUNCT dad-10733 1065 18 it it PRON dad-10733 1065 19 is be AUX dad-10733 1065 20 infeasible infeasible ADJ dad-10733 1065 21 to to PART dad-10733 1065 22 run run VERB dad-10733 1065 23 user user NOUN dad-10733 1065 24 experiments experiment NOUN dad-10733 1065 25 for for ADP dad-10733 1065 26 every every DET dad-10733 1065 27 parameter parameter NOUN dad-10733 1065 28 setting set VERB dad-10733 1065 29 in in ADP dad-10733 1065 30 a a DET dad-10733 1065 31 grid grid NOUN dad-10733 1065 32 search search NOUN dad-10733 1065 33 . . PUNCT dad-10733 1066 1 although although SCONJ dad-10733 1066 2 crowdsourcing crowdsourcing NOUN dad-10733 1066 3 platforms platform NOUN dad-10733 1066 4 , , PUNCT dad-10733 1066 5 such such ADJ dad-10733 1066 6 as as ADP dad-10733 1066 7 amazon amazon PROPN dad-10733 1066 8 mechanical mechanical ADJ dad-10733 1066 9 turk turk PROPN dad-10733 1066 10 , , PUNCT dad-10733 1066 11 can can AUX dad-10733 1066 12 be be AUX dad-10733 1066 13 used use VERB dad-10733 1066 14 for for ADP dad-10733 1066 15 some some DET dad-10733 1066 16 user user NOUN dad-10733 1066 17 testing testing NOUN dad-10733 1066 18 ( ( PUNCT dad-10733 1066 19 jurcıcek jurcıcek PROPN dad-10733 1066 20 et et PROPN dad-10733 1066 21 al al PROPN dad-10733 1066 22 . . PROPN dad-10733 1066 23 , , PUNCT dad-10733 1066 24 2011 2011 NUM dad-10733 1066 25 ) ) PUNCT dad-10733 1066 26 , , PUNCT dad-10733 1066 27 evaluations evaluation NOUN dad-10733 1066 28 using use VERB dad-10733 1066 29 paid pay VERB dad-10733 1066 30 subjects subject NOUN dad-10733 1066 31 can can AUX dad-10733 1066 32 also also ADV dad-10733 1066 33 lead lead VERB dad-10733 1066 34 to to ADP dad-10733 1066 35 biased biased ADJ dad-10733 1066 36 results result NOUN dad-10733 1066 37 ( ( PUNCT dad-10733 1066 38 young young ADJ dad-10733 1066 39 et et PROPN dad-10733 1066 40 al al PROPN dad-10733 1066 41 . . PROPN dad-10733 1066 42 , , PUNCT dad-10733 1066 43 2013 2013 NUM dad-10733 1066 44 ) ) PUNCT dad-10733 1066 45 . . PUNCT dad-10733 1067 1 ideally ideally ADV dad-10733 1067 2 , , PUNCT dad-10733 1067 3 we we PRON dad-10733 1067 4 would would AUX dad-10733 1067 5 have have VERB dad-10733 1067 6 some some DET dad-10733 1067 7 automated automate VERB dad-10733 1067 8 metrics metric NOUN dad-10733 1067 9 for for ADP dad-10733 1067 10 calculating calculate VERB dad-10733 1067 11 a a DET dad-10733 1067 12 score score NOUN dad-10733 1067 13 for for ADP dad-10733 1067 14 each each DET dad-10733 1067 15 model model NOUN dad-10733 1067 16 , , PUNCT dad-10733 1067 17 and and CCONJ dad-10733 1067 18 only only ADV dad-10733 1067 19 involve involve VERB dad-10733 1067 20 human human ADJ dad-10733 1067 21 evaluators evaluator NOUN dad-10733 1067 22 once once SCONJ dad-10733 1067 23 the the DET dad-10733 1067 24 best good ADJ dad-10733 1067 25 model model NOUN dad-10733 1067 26 has have AUX dad-10733 1067 27 been be AUX dad-10733 1067 28 chosen choose VERB dad-10733 1067 29 with with ADP dad-10733 1067 30 reasonable reasonable ADJ dad-10733 1067 31 confidence confidence NOUN dad-10733 1067 32 . . PUNCT dad-10733 1068 1 in in ADP dad-10733 1068 2 non non ADJ dad-10733 1068 3 - - ADJ dad-10733 1068 4 goal goal ADJ dad-10733 1068 5 - - PUNCT dad-10733 1068 6 driven drive VERB dad-10733 1068 7 dialogue dialogue NOUN dad-10733 1068 8 systems system NOUN dad-10733 1068 9 researchers researcher NOUN dad-10733 1068 10 have have AUX dad-10733 1068 11 focused focus VERB dad-10733 1068 12 mainly mainly ADV dad-10733 1068 13 on on ADP dad-10733 1068 14 the the DET dad-10733 1068 15 output output NOUN dad-10733 1068 16 of of ADP dad-10733 1068 17 the the DET dad-10733 1068 18 response response NOUN dad-10733 1068 19 generation generation NOUN dad-10733 1068 20 module module NOUN dad-10733 1068 21 . . PUNCT dad-10733 1069 1 evaluation evaluation NOUN dad-10733 1069 2 of of ADP dad-10733 1069 3 such such ADJ dad-10733 1069 4 non non ADJ dad-10733 1069 5 - - ADJ dad-10733 1069 6 goal goal ADJ dad-10733 1069 7 - - PUNCT dad-10733 1069 8 driven drive VERB dad-10733 1069 9 dialogue dialogue NOUN dad-10733 1069 10 systems system NOUN dad-10733 1069 11 can can AUX dad-10733 1069 12 be be AUX dad-10733 1069 13 traced trace VERB dad-10733 1069 14 back back ADV dad-10733 1069 15 to to ADP dad-10733 1069 16 the the DET dad-10733 1069 17 turing ture VERB dad-10733 1069 18 test test NOUN dad-10733 1069 19 ( ( PUNCT dad-10733 1069 20 turing ture VERB dad-10733 1069 21 , , PUNCT dad-10733 1069 22 1950 1950 NUM dad-10733 1069 23 ) ) PUNCT dad-10733 1069 24 , , PUNCT dad-10733 1069 25 where where SCONJ dad-10733 1069 26 human human ADJ dad-10733 1069 27 judges judge NOUN dad-10733 1069 28 communicate communicate VERB dad-10733 1069 29 with with ADP dad-10733 1069 30 both both DET dad-10733 1069 31 computer computer NOUN dad-10733 1069 32 programs program NOUN dad-10733 1069 33 and and CCONJ dad-10733 1069 34 other other ADJ dad-10733 1069 35 humans human NOUN dad-10733 1069 36 over over ADP dad-10733 1069 37 a a DET dad-10733 1069 38 chat chat NOUN dad-10733 1069 39 terminal terminal NOUN dad-10733 1069 40 without without ADP dad-10733 1069 41 knowing know VERB dad-10733 1069 42 the the DET dad-10733 1069 43 other other ADJ dad-10733 1069 44 party party NOUN dad-10733 1069 45 ’s ’s PART dad-10733 1069 46 true true ADJ dad-10733 1069 47 identity identity NOUN dad-10733 1069 48 . . PUNCT dad-10733 1070 1 the the DET dad-10733 1070 2 judge judge NOUN dad-10733 1070 3 ’s ’s PART dad-10733 1070 4 goal goal NOUN dad-10733 1070 5 is be AUX dad-10733 1070 6 to to PART dad-10733 1070 7 identify identify VERB dad-10733 1070 8 the the DET dad-10733 1070 9 humans human NOUN dad-10733 1070 10 and and CCONJ dad-10733 1070 11 computer computer NOUN dad-10733 1070 12 programs program NOUN dad-10733 1070 13 under under ADP dad-10733 1070 14 the the DET dad-10733 1070 15 assumption assumption NOUN dad-10733 1070 16 that that SCONJ dad-10733 1070 17 a a DET dad-10733 1070 18 program program NOUN dad-10733 1070 19 indistinguishable indistinguishable ADJ dad-10733 1070 20 from from ADP dad-10733 1070 21 a a DET dad-10733 1070 22 real real ADJ dad-10733 1070 23 human human ADJ dad-10733 1070 24 being being NOUN dad-10733 1070 25 must must AUX dad-10733 1070 26 be be AUX dad-10733 1070 27 intelligent intelligent ADJ dad-10733 1070 28 . . PUNCT dad-10733 1071 1 however however ADV dad-10733 1071 2 , , PUNCT dad-10733 1071 3 this this DET dad-10733 1071 4 setup setup NOUN dad-10733 1071 5 has have AUX dad-10733 1071 6 been be AUX dad-10733 1071 7 criticized criticize VERB dad-10733 1071 8 extensively extensively ADV dad-10733 1071 9 with with ADP dad-10733 1071 10 numerous numerous ADJ dad-10733 1071 11 researchers researcher NOUN dad-10733 1071 12 proposing propose VERB dad-10733 1071 13 alternative alternative ADJ dad-10733 1071 14 evaluation evaluation NOUN dad-10733 1071 15 procedures procedure NOUN dad-10733 1071 16 ( ( PUNCT dad-10733 1071 17 cohen cohen NOUN dad-10733 1071 18 , , PUNCT dad-10733 1071 19 2005 2005 NUM dad-10733 1071 20 ) ) PUNCT dad-10733 1071 21 . . PUNCT dad-10733 1072 1 more more ADV dad-10733 1072 2 recently recently ADV dad-10733 1072 3 , , PUNCT dad-10733 1072 4 researchers researcher NOUN dad-10733 1072 5 have have AUX dad-10733 1072 6 turned turn VERB dad-10733 1072 7 to to ADP dad-10733 1072 8 analyzing analyze VERB dad-10733 1072 9 the the DET dad-10733 1072 10 collected collect VERB dad-10733 1072 11 dialogues dialogue NOUN dad-10733 1072 12 produced produce VERB dad-10733 1072 13 after after SCONJ dad-10733 1072 14 they they PRON dad-10733 1072 15 are be AUX dad-10733 1072 16 36 36 NUM dad-10733 1072 17 a a DET dad-10733 1072 18 survey survey NOUN dad-10733 1072 19 of of ADP dad-10733 1072 20 available available ADJ dad-10733 1072 21 corpora corpora PROPN dad-10733 1072 22 for for ADP dad-10733 1072 23 building build VERB dad-10733 1072 24 data data NOUN dad-10733 1072 25 - - PUNCT dad-10733 1072 26 driven drive VERB dad-10733 1072 27 dialogue dialogue NOUN dad-10733 1072 28 systems system NOUN dad-10733 1072 29 finished finish VERB dad-10733 1072 30 ( ( PUNCT dad-10733 1072 31 galley galley NOUN dad-10733 1072 32 et et PROPN dad-10733 1072 33 al al PROPN dad-10733 1072 34 . . PROPN dad-10733 1072 35 , , PUNCT dad-10733 1072 36 2015 2015 NUM dad-10733 1072 37 ; ; PUNCT dad-10733 1072 38 pietquin pietquin NOUN dad-10733 1072 39 and and CCONJ dad-10733 1072 40 hastie hastie PROPN dad-10733 1072 41 , , PUNCT dad-10733 1072 42 2013 2013 NUM dad-10733 1072 43 ; ; PUNCT dad-10733 1072 44 shawar shawar NOUN dad-10733 1072 45 and and CCONJ dad-10733 1072 46 atwell atwell PROPN dad-10733 1072 47 , , PUNCT dad-10733 1072 48 2007a 2007a NUM dad-10733 1072 49 ; ; PUNCT dad-10733 1072 50 schatzmann schatzmann PROPN dad-10733 1072 51 et et PROPN dad-10733 1072 52 al al PROPN dad-10733 1072 53 . . PROPN dad-10733 1072 54 , , PUNCT dad-10733 1072 55 2005 2005 NUM dad-10733 1072 56 ) ) PUNCT dad-10733 1072 57 . . PUNCT dad-10733 1073 1 even even ADV dad-10733 1073 2 when when SCONJ dad-10733 1073 3 human human ADJ dad-10733 1073 4 evaluators evaluator NOUN dad-10733 1073 5 are be AUX dad-10733 1073 6 available available ADJ dad-10733 1073 7 , , PUNCT dad-10733 1073 8 it it PRON dad-10733 1073 9 is be AUX dad-10733 1073 10 often often ADV dad-10733 1073 11 difficult difficult ADJ dad-10733 1073 12 to to PART dad-10733 1073 13 choose choose VERB dad-10733 1073 14 a a DET dad-10733 1073 15 set set NOUN dad-10733 1073 16 of of ADP dad-10733 1073 17 informative informative ADJ dad-10733 1073 18 and and CCONJ dad-10733 1073 19 consistent consistent ADJ dad-10733 1073 20 criteria criterion NOUN dad-10733 1073 21 that that PRON dad-10733 1073 22 can can AUX dad-10733 1073 23 be be AUX dad-10733 1073 24 used use VERB dad-10733 1073 25 to to PART dad-10733 1073 26 judge judge VERB dad-10733 1073 27 an an DET dad-10733 1073 28 utterance utterance NOUN dad-10733 1073 29 generated generate VERB dad-10733 1073 30 by by ADP dad-10733 1073 31 a a DET dad-10733 1073 32 dialogue dialogue NOUN dad-10733 1073 33 system system NOUN dad-10733 1073 34 . . PUNCT dad-10733 1074 1 for for ADP dad-10733 1074 2 example example NOUN dad-10733 1074 3 , , PUNCT dad-10733 1074 4 one one PRON dad-10733 1074 5 might might AUX dad-10733 1074 6 ask ask VERB dad-10733 1074 7 the the DET dad-10733 1074 8 evaluator evaluator NOUN dad-10733 1074 9 to to PART dad-10733 1074 10 rate rate VERB dad-10733 1074 11 the the DET dad-10733 1074 12 f f NOUN dad-10733 1074 13 on on ADP dad-10733 1074 14 vague vague ADJ dad-10733 1074 15 notions notion NOUN dad-10733 1074 16 such such ADJ dad-10733 1074 17 as as ADP dad-10733 1074 18 ‘ ' PUNCT dad-10733 1074 19 appropriateness appropriateness NOUN dad-10733 1074 20 ’ ' PUNCT dad-10733 1074 21 and and CCONJ dad-10733 1074 22 ‘ ' PUNCT dad-10733 1074 23 naturalness naturalness X dad-10733 1074 24 ’ ' PUNCT dad-10733 1074 25 , , PUNCT dad-10733 1074 26 or or CCONJ dad-10733 1074 27 to to PART dad-10733 1074 28 try try VERB dad-10733 1074 29 to to PART dad-10733 1074 30 differentiate differentiate VERB dad-10733 1074 31 between between ADP dad-10733 1074 32 utterances utterance NOUN dad-10733 1074 33 generated generate VERB dad-10733 1074 34 by by ADP dad-10733 1074 35 the the DET dad-10733 1074 36 system system NOUN dad-10733 1074 37 and and CCONJ dad-10733 1074 38 those those PRON dad-10733 1074 39 generated generate VERB dad-10733 1074 40 by by ADP dad-10733 1074 41 actual actual ADJ dad-10733 1074 42 humans human NOUN dad-10733 1074 43 ( ( PUNCT dad-10733 1074 44 vinyals vinyal NOUN dad-10733 1074 45 and and CCONJ dad-10733 1074 46 le le NOUN dad-10733 1074 47 , , PUNCT dad-10733 1074 48 2015 2015 NUM dad-10733 1074 49 ) ) PUNCT dad-10733 1074 50 . . PUNCT dad-10733 1075 1 schatzmann schatzmann PROPN dad-10733 1075 2 et et PROPN dad-10733 1075 3 al al PROPN dad-10733 1075 4 . . PUNCT dad-10733 1076 1 ( ( PUNCT dad-10733 1076 2 2005 2005 NUM dad-10733 1076 3 ) ) PUNCT dad-10733 1076 4 suggest suggest VERB dad-10733 1076 5 two two NUM dad-10733 1076 6 aspects aspect NOUN dad-10733 1076 7 that that PRON dad-10733 1076 8 need need VERB dad-10733 1076 9 to to PART dad-10733 1076 10 be be AUX dad-10733 1076 11 evaluated evaluate VERB dad-10733 1076 12 for for ADP dad-10733 1076 13 all all DET dad-10733 1076 14 response response NOUN dad-10733 1076 15 generation generation NOUN dad-10733 1076 16 systems system NOUN dad-10733 1076 17 ( ( PUNCT dad-10733 1076 18 as as ADV dad-10733 1076 19 well well ADV dad-10733 1076 20 as as ADP dad-10733 1076 21 user user NOUN dad-10733 1076 22 simulation simulation NOUN dad-10733 1076 23 models model NOUN dad-10733 1076 24 ): ): PUNCT dad-10733 1076 25 1 1 X dad-10733 1076 26 ) ) PUNCT dad-10733 1076 27 if if SCONJ dad-10733 1076 28 the the DET dad-10733 1076 29 model model NOUN dad-10733 1076 30 can can AUX dad-10733 1076 31 generate generate VERB dad-10733 1076 32 human human ADJ dad-10733 1076 33 - - PUNCT dad-10733 1076 34 like like ADJ dad-10733 1076 35 output output NOUN dad-10733 1076 36 , , PUNCT dad-10733 1076 37 and and CCONJ dad-10733 1076 38 2 2 X dad-10733 1076 39 ) ) PUNCT dad-10733 1076 40 if if SCONJ dad-10733 1076 41 the the DET dad-10733 1076 42 model model NOUN dad-10733 1076 43 can can AUX dad-10733 1076 44 reproduce reproduce VERB dad-10733 1076 45 the the DET dad-10733 1076 46 variety variety NOUN dad-10733 1076 47 of of ADP dad-10733 1076 48 user user NOUN dad-10733 1076 49 behaviour behaviour NOUN dad-10733 1076 50 found find VERB dad-10733 1076 51 in in ADP dad-10733 1076 52 corpus corpus NOUN dad-10733 1076 53 . . PUNCT dad-10733 1077 1 but but CCONJ dad-10733 1077 2 we we PRON dad-10733 1077 3 lack lack VERB dad-10733 1077 4 a a DET dad-10733 1077 5 definitive definitive ADJ dad-10733 1077 6 framework framework NOUN dad-10733 1077 7 for for ADP dad-10733 1077 8 such such ADJ dad-10733 1077 9 evaluations evaluation NOUN dad-10733 1077 10 . . PUNCT dad-10733 1078 1 we we PRON dad-10733 1078 2 complete complete VERB dad-10733 1078 3 this this DET dad-10733 1078 4 discussion discussion NOUN dad-10733 1078 5 by by ADP dad-10733 1078 6 summarizing summarize VERB dad-10733 1078 7 different different ADJ dad-10733 1078 8 approaches approach NOUN dad-10733 1078 9 to to ADP dad-10733 1078 10 the the DET dad-10733 1078 11 automatic automatic ADJ dad-10733 1078 12 evaluation evaluation NOUN dad-10733 1078 13 problem problem NOUN dad-10733 1078 14 as as SCONJ dad-10733 1078 15 they they PRON dad-10733 1078 16 relate relate VERB dad-10733 1078 17 to to ADP dad-10733 1078 18 these these DET dad-10733 1078 19 objectives objective NOUN dad-10733 1078 20 . . PUNCT dad-10733 1079 1 5.5.1 5.5.1 NUM dad-10733 1079 2 automatic automatic ADJ dad-10733 1079 3 evaluation evaluation NOUN dad-10733 1079 4 metrics metric NOUN dad-10733 1079 5 for for ADP dad-10733 1079 6 goal goal NOUN dad-10733 1079 7 - - PUNCT dad-10733 1079 8 driven drive VERB dad-10733 1079 9 dialogue dialogue NOUN dad-10733 1079 10 systems system NOUN dad-10733 1079 11 user user NOUN dad-10733 1079 12 evaluation evaluation NOUN dad-10733 1079 13 of of ADP dad-10733 1079 14 goal goal NOUN dad-10733 1079 15 - - PUNCT dad-10733 1079 16 driven drive VERB dad-10733 1079 17 dialogue dialogue NOUN dad-10733 1079 18 systems system NOUN dad-10733 1079 19 typically typically ADV dad-10733 1079 20 focuses focus VERB dad-10733 1079 21 on on ADP dad-10733 1079 22 goal goal NOUN dad-10733 1079 23 - - PUNCT dad-10733 1079 24 related relate VERB dad-10733 1079 25 performance performance NOUN dad-10733 1079 26 criteria criterion NOUN dad-10733 1079 27 , , PUNCT dad-10733 1079 28 such such ADJ dad-10733 1079 29 as as ADP dad-10733 1079 30 goal goal NOUN dad-10733 1079 31 completion completion NOUN dad-10733 1079 32 rate rate NOUN dad-10733 1079 33 , , PUNCT dad-10733 1079 34 dialogue dialogue NOUN dad-10733 1079 35 length length NOUN dad-10733 1079 36 , , PUNCT dad-10733 1079 37 and and CCONJ dad-10733 1079 38 user user NOUN dad-10733 1079 39 satisfaction satisfaction NOUN dad-10733 1079 40 ( ( PUNCT dad-10733 1079 41 walker walker PROPN dad-10733 1079 42 et et PROPN dad-10733 1079 43 al al PROPN dad-10733 1079 44 . . PROPN dad-10733 1079 45 , , PUNCT dad-10733 1079 46 1997 1997 NUM dad-10733 1079 47 ; ; PUNCT dad-10733 1079 48 schatzmann schatzmann PROPN dad-10733 1079 49 et et PROPN dad-10733 1079 50 al al PROPN dad-10733 1079 51 . . PROPN dad-10733 1079 52 , , PUNCT dad-10733 1079 53 2005 2005 NUM dad-10733 1079 54 ) ) PUNCT dad-10733 1079 55 . . PUNCT dad-10733 1080 1 these these PRON dad-10733 1080 2 were be AUX dad-10733 1080 3 originally originally ADV dad-10733 1080 4 evaluated evaluate VERB dad-10733 1080 5 by by ADP dad-10733 1080 6 human human ADJ dad-10733 1080 7 users user NOUN dad-10733 1080 8 interacting interact VERB dad-10733 1080 9 with with ADP dad-10733 1080 10 the the DET dad-10733 1080 11 dialogue dialogue NOUN dad-10733 1080 12 system system NOUN dad-10733 1080 13 . . PUNCT dad-10733 1081 1 recently recently ADV dad-10733 1081 2 , , PUNCT dad-10733 1081 3 researchers researcher NOUN dad-10733 1081 4 have have AUX dad-10733 1081 5 also also ADV dad-10733 1081 6 begun begin VERB dad-10733 1081 7 to to PART dad-10733 1081 8 use use VERB dad-10733 1081 9 third third ADJ dad-10733 1081 10 - - PUNCT dad-10733 1081 11 party party NOUN dad-10733 1081 12 annotators annotator NOUN dad-10733 1081 13 for for ADP dad-10733 1081 14 evaluating evaluate VERB dad-10733 1081 15 recorded recorded ADJ dad-10733 1081 16 dialogues dialogue NOUN dad-10733 1081 17 ( ( PUNCT dad-10733 1081 18 yang yang PROPN dad-10733 1081 19 et et PROPN dad-10733 1081 20 al al PROPN dad-10733 1081 21 . . PROPN dad-10733 1081 22 , , PUNCT dad-10733 1081 23 2010 2010 NUM dad-10733 1081 24 ) ) PUNCT dad-10733 1081 25 . . PUNCT dad-10733 1082 1 due due ADP dad-10733 1082 2 to to ADP dad-10733 1082 3 their their PRON dad-10733 1082 4 simplicity simplicity NOUN dad-10733 1082 5 , , PUNCT dad-10733 1082 6 the the DET dad-10733 1082 7 vast vast ADJ dad-10733 1082 8 majority majority NOUN dad-10733 1082 9 of of ADP dad-10733 1082 10 hand hand NOUN dad-10733 1082 11 - - PUNCT dad-10733 1082 12 crafted craft VERB dad-10733 1082 13 task task NOUN dad-10733 1082 14 - - PUNCT dad-10733 1082 15 oriented orient VERB dad-10733 1082 16 dialogue dialogue NOUN dad-10733 1082 17 systems system NOUN dad-10733 1082 18 have have AUX dad-10733 1082 19 been be AUX dad-10733 1082 20 solely solely ADV dad-10733 1082 21 evaluated evaluate VERB dad-10733 1082 22 in in ADP dad-10733 1082 23 this this DET dad-10733 1082 24 way way NOUN dad-10733 1082 25 . . PUNCT dad-10733 1083 1 however however ADV dad-10733 1083 2 , , PUNCT dad-10733 1083 3 when when SCONJ dad-10733 1083 4 using use VERB dad-10733 1083 5 machine machine NOUN dad-10733 1083 6 learning learn VERB dad-10733 1083 7 algorithms algorithm NOUN dad-10733 1083 8 to to PART dad-10733 1083 9 train train VERB dad-10733 1083 10 on on ADP dad-10733 1083 11 large large ADJ dad-10733 1083 12 - - PUNCT dad-10733 1083 13 scale scale NOUN dad-10733 1083 14 corpora corpus NOUN dad-10733 1083 15 , , PUNCT dad-10733 1083 16 optimization optimization NOUN dad-10733 1083 17 criteria criterion NOUN dad-10733 1083 18 are be AUX dad-10733 1083 19 required require VERB dad-10733 1083 20 . . PUNCT dad-10733 1084 1 the the DET dad-10733 1084 2 challenge challenge NOUN dad-10733 1084 3 with with ADP dad-10733 1084 4 evaluating evaluate VERB dad-10733 1084 5 goal goal NOUN dad-10733 1084 6 - - PUNCT dad-10733 1084 7 driven drive VERB dad-10733 1084 8 dialogue dialogue NOUN dad-10733 1084 9 systems system NOUN dad-10733 1084 10 without without ADP dad-10733 1084 11 human human ADJ dad-10733 1084 12 intervention intervention NOUN dad-10733 1084 13 is be AUX dad-10733 1084 14 that that SCONJ dad-10733 1084 15 the the DET dad-10733 1084 16 process process NOUN dad-10733 1084 17 necessarily necessarily ADV dad-10733 1084 18 requires require VERB dad-10733 1084 19 multiple multiple ADJ dad-10733 1084 20 steps step NOUN dad-10733 1084 21 — — PUNCT dad-10733 1084 22 it it PRON dad-10733 1084 23 is be AUX dad-10733 1084 24 difficult difficult ADJ dad-10733 1084 25 to to PART dad-10733 1084 26 determine determine VERB dad-10733 1084 27 if if SCONJ dad-10733 1084 28 a a DET dad-10733 1084 29 task task NOUN dad-10733 1084 30 has have AUX dad-10733 1084 31 been be AUX dad-10733 1084 32 solved solve VERB dad-10733 1084 33 from from ADP dad-10733 1084 34 a a DET dad-10733 1084 35 single single ADJ dad-10733 1084 36 utterance utterance ADJ dad-10733 1084 37 - - PUNCT dad-10733 1084 38 response response NOUN dad-10733 1084 39 pair pair NOUN dad-10733 1084 40 from from ADP dad-10733 1084 41 a a DET dad-10733 1084 42 conversation conversation NOUN dad-10733 1084 43 . . PUNCT dad-10733 1085 1 thus thus ADV dad-10733 1085 2 , , PUNCT dad-10733 1085 3 synthetic synthetic ADJ dad-10733 1085 4 data datum NOUN dad-10733 1085 5 is be AUX dad-10733 1085 6 often often ADV dad-10733 1085 7 generated generate VERB dad-10733 1085 8 by by ADP dad-10733 1085 9 a a DET dad-10733 1085 10 user user NOUN dad-10733 1085 11 simulator simulator NOUN dad-10733 1085 12 ( ( PUNCT dad-10733 1085 13 eckert eckert PROPN dad-10733 1085 14 et et PROPN dad-10733 1085 15 al al PROPN dad-10733 1085 16 . . PROPN dad-10733 1085 17 , , PUNCT dad-10733 1085 18 1997 1997 NUM dad-10733 1085 19 ; ; PUNCT dad-10733 1085 20 schatzmann schatzmann PROPN dad-10733 1085 21 et et PROPN dad-10733 1085 22 al al PROPN dad-10733 1085 23 . . PROPN dad-10733 1085 24 , , PUNCT dad-10733 1085 25 2007 2007 NUM dad-10733 1085 26 ; ; PUNCT dad-10733 1085 27 jung jung PROPN dad-10733 1085 28 et et PROPN dad-10733 1085 29 al al PROPN dad-10733 1085 30 . . PROPN dad-10733 1085 31 , , PUNCT dad-10733 1085 32 2009 2009 NUM dad-10733 1085 33 ; ; PUNCT dad-10733 1085 34 georgila georgila NOUN dad-10733 1085 35 et et PROPN dad-10733 1085 36 al al PROPN dad-10733 1085 37 . . PROPN dad-10733 1085 38 , , PUNCT dad-10733 1085 39 2006 2006 NUM dad-10733 1085 40 ; ; PUNCT dad-10733 1085 41 pietquin pietquin NOUN dad-10733 1085 42 and and CCONJ dad-10733 1085 43 hastie hastie PROPN dad-10733 1085 44 , , PUNCT dad-10733 1085 45 2013 2013 NUM dad-10733 1085 46 ) ) PUNCT dad-10733 1085 47 . . PUNCT dad-10733 1086 1 given give VERB dad-10733 1086 2 a a DET dad-10733 1086 3 sufficiently sufficiently ADV dad-10733 1086 4 accurate accurate ADJ dad-10733 1086 5 user user NOUN dad-10733 1086 6 simulation simulation PROPN dad-10733 1086 7 model model PROPN dad-10733 1086 8 , , PUNCT dad-10733 1086 9 an an DET dad-10733 1086 10 interaction interaction NOUN dad-10733 1086 11 between between ADP dad-10733 1086 12 the the DET dad-10733 1086 13 dialogue dialogue NOUN dad-10733 1086 14 system system NOUN dad-10733 1086 15 and and CCONJ dad-10733 1086 16 the the DET dad-10733 1086 17 user user NOUN dad-10733 1086 18 can can AUX dad-10733 1086 19 be be AUX dad-10733 1086 20 simulated simulate VERB dad-10733 1086 21 from from ADP dad-10733 1086 22 which which PRON dad-10733 1086 23 it it PRON dad-10733 1086 24 is be AUX dad-10733 1086 25 possible possible ADJ dad-10733 1086 26 to to PART dad-10733 1086 27 deduce deduce VERB dad-10733 1086 28 the the DET dad-10733 1086 29 desired desire VERB dad-10733 1086 30 metrics metric NOUN dad-10733 1086 31 , , PUNCT dad-10733 1086 32 such such ADJ dad-10733 1086 33 as as ADP dad-10733 1086 34 goal goal NOUN dad-10733 1086 35 completion completion NOUN dad-10733 1086 36 rate rate NOUN dad-10733 1086 37 . . PUNCT dad-10733 1087 1 significant significant ADJ dad-10733 1087 2 effort effort NOUN dad-10733 1087 3 has have AUX dad-10733 1087 4 been be AUX dad-10733 1087 5 made make VERB dad-10733 1087 6 to to PART dad-10733 1087 7 render render VERB dad-10733 1087 8 the the DET dad-10733 1087 9 simulated simulate VERB dad-10733 1087 10 data datum NOUN dad-10733 1087 11 as as ADV dad-10733 1087 12 realistic realistic ADJ dad-10733 1087 13 as as ADP dad-10733 1087 14 possible possible ADJ dad-10733 1087 15 , , PUNCT dad-10733 1087 16 by by ADP dad-10733 1087 17 modeling model VERB dad-10733 1087 18 user user NOUN dad-10733 1087 19 intentions intention NOUN dad-10733 1087 20 . . PUNCT dad-10733 1088 1 evaluation evaluation NOUN dad-10733 1088 2 of of ADP dad-10733 1088 3 such such ADJ dad-10733 1088 4 simulation simulation NOUN dad-10733 1088 5 methods method NOUN dad-10733 1088 6 has have AUX dad-10733 1088 7 already already ADV dad-10733 1088 8 been be AUX dad-10733 1088 9 conducted conduct VERB dad-10733 1088 10 ( ( PUNCT dad-10733 1088 11 schatzmann schatzmann X dad-10733 1088 12 et et PROPN dad-10733 1088 13 al al PROPN dad-10733 1088 14 . . PROPN dad-10733 1088 15 , , PUNCT dad-10733 1088 16 2005 2005 NUM dad-10733 1088 17 ) ) PUNCT dad-10733 1088 18 . . PUNCT dad-10733 1089 1 however however ADV dad-10733 1089 2 , , PUNCT dad-10733 1089 3 generating generate VERB dad-10733 1089 4 realistic realistic ADJ dad-10733 1089 5 user user NOUN dad-10733 1089 6 simulation simulation NOUN dad-10733 1089 7 models model NOUN dad-10733 1089 8 remains remain VERB dad-10733 1089 9 an an DET dad-10733 1089 10 open open ADJ dad-10733 1089 11 problem problem NOUN dad-10733 1089 12 . . PUNCT dad-10733 1090 1 5.5.2 5.5.2 NUM dad-10733 1090 2 automatic automatic ADJ dad-10733 1090 3 evaluation evaluation NOUN dad-10733 1090 4 metrics metric NOUN dad-10733 1090 5 for for ADP dad-10733 1090 6 non non ADJ dad-10733 1090 7 - - ADJ dad-10733 1090 8 goal goal ADJ dad-10733 1090 9 - - PUNCT dad-10733 1090 10 driven drive VERB dad-10733 1090 11 dialogue dialogue NOUN dad-10733 1090 12 systems system NOUN dad-10733 1090 13 evaluation evaluation NOUN dad-10733 1090 14 of of ADP dad-10733 1090 15 non non ADJ dad-10733 1090 16 - - ADJ dad-10733 1090 17 goal goal ADJ dad-10733 1090 18 - - PUNCT dad-10733 1090 19 driven drive VERB dad-10733 1090 20 dialogue dialogue NOUN dad-10733 1090 21 systems system NOUN dad-10733 1090 22 , , PUNCT dad-10733 1090 23 whether whether SCONJ dad-10733 1090 24 by by ADP dad-10733 1090 25 automatic automatic ADJ dad-10733 1090 26 means mean NOUN dad-10733 1090 27 or or CCONJ dad-10733 1090 28 user user NOUN dad-10733 1090 29 studies study NOUN dad-10733 1090 30 , , PUNCT dad-10733 1090 31 remains remain VERB dad-10733 1090 32 a a DET dad-10733 1090 33 difficult difficult ADJ dad-10733 1090 34 challenge challenge NOUN dad-10733 1090 35 . . PUNCT dad-10733 1091 1 word word NOUN dad-10733 1091 2 overlap overlap NOUN dad-10733 1091 3 metrics metric NOUN dad-10733 1091 4 . . PUNCT dad-10733 1092 1 one one NUM dad-10733 1092 2 approach approach NOUN dad-10733 1092 3 is be AUX dad-10733 1092 4 to to PART dad-10733 1092 5 borrow borrow VERB dad-10733 1092 6 evaluation evaluation NOUN dad-10733 1092 7 metrics metric NOUN dad-10733 1092 8 from from ADP dad-10733 1092 9 other other ADJ dad-10733 1092 10 nlp nlp NOUN dad-10733 1092 11 tasks task NOUN dad-10733 1092 12 such such ADJ dad-10733 1092 13 as as ADP dad-10733 1092 14 machine machine NOUN dad-10733 1092 15 translation translation NOUN dad-10733 1092 16 , , PUNCT dad-10733 1092 17 which which PRON dad-10733 1092 18 uses use VERB dad-10733 1092 19 bleu bleu NOUN dad-10733 1092 20 ( ( PUNCT dad-10733 1092 21 papineni papineni NOUN dad-10733 1092 22 et et PROPN dad-10733 1092 23 al al PROPN dad-10733 1092 24 . . PROPN dad-10733 1092 25 , , PUNCT dad-10733 1092 26 2002 2002 NUM dad-10733 1092 27 ) ) PUNCT dad-10733 1092 28 and and CCONJ dad-10733 1092 29 meteor meteor NOUN dad-10733 1092 30 ( ( PUNCT dad-10733 1092 31 banerjee banerjee PROPN dad-10733 1092 32 and and CCONJ dad-10733 1092 33 lavie lavie PROPN dad-10733 1092 34 , , PUNCT dad-10733 1092 35 2005 2005 NUM dad-10733 1092 36 ) ) PUNCT dad-10733 1092 37 scores score NOUN dad-10733 1092 38 . . PUNCT dad-10733 1093 1 these these DET dad-10733 1093 2 metrics metric NOUN dad-10733 1093 3 have have AUX dad-10733 1093 4 been be AUX dad-10733 1093 5 used use VERB dad-10733 1093 6 to to PART dad-10733 1093 7 compare compare VERB dad-10733 1093 8 responses response NOUN dad-10733 1093 9 generated generate VERB dad-10733 1093 10 by by ADP dad-10733 1093 11 a a DET dad-10733 1093 12 learned learn VERB dad-10733 1093 13 dialogue dialogue NOUN dad-10733 1093 14 strategy strategy NOUN dad-10733 1093 15 to to ADP dad-10733 1093 16 the the DET dad-10733 1093 17 actual actual ADJ dad-10733 1093 18 next next ADJ dad-10733 1093 19 utterance utterance NOUN dad-10733 1093 20 in in ADP dad-10733 1093 21 the the DET dad-10733 1093 22 conversation conversation NOUN dad-10733 1093 23 , , PUNCT dad-10733 1093 24 conditioned condition VERB dad-10733 1093 25 on on ADP dad-10733 1093 26 a a DET dad-10733 1093 27 dialogue dialogue NOUN dad-10733 1093 28 context context NOUN dad-10733 1093 29 ( ( PUNCT dad-10733 1093 30 sordoni sordoni NOUN dad-10733 1093 31 et et PROPN dad-10733 1093 32 al al PROPN dad-10733 1093 33 . . PROPN dad-10733 1093 34 , , PUNCT dad-10733 1093 35 2015 2015 NUM dad-10733 1093 36 ) ) PUNCT dad-10733 1093 37 . . PUNCT dad-10733 1094 1 however however ADV dad-10733 1094 2 , , PUNCT dad-10733 1094 3 bleu bleu NOUN dad-10733 1094 4 scores score NOUN dad-10733 1094 5 have have AUX dad-10733 1094 6 been be AUX dad-10733 1094 7 shown show VERB dad-10733 1094 8 not not PART dad-10733 1094 9 to to PART dad-10733 1094 10 correlate correlate VERB dad-10733 1094 11 with with ADP dad-10733 1094 12 human human ADJ dad-10733 1094 13 judgment judgment NOUN dad-10733 1094 14 for for ADP dad-10733 1094 15 assessing assess VERB dad-10733 1094 16 dialogue dialogue NOUN dad-10733 1094 17 response response NOUN dad-10733 1094 18 generation generation NOUN dad-10733 1094 19 ( ( PUNCT dad-10733 1094 20 liu liu PROPN dad-10733 1094 21 et et PROPN dad-10733 1094 22 al al PROPN dad-10733 1094 23 . . PROPN dad-10733 1094 24 , , PUNCT dad-10733 1094 25 2016 2016 NUM dad-10733 1094 26 ) ) PUNCT dad-10733 1094 27 . . PUNCT dad-10733 1095 1 there there PRON dad-10733 1095 2 are be VERB dad-10733 1095 3 several several ADJ dad-10733 1095 4 issues issue NOUN dad-10733 1095 5 to to PART dad-10733 1095 6 consider consider VERB dad-10733 1095 7 : : PUNCT dad-10733 1095 8 given give VERB dad-10733 1095 9 the the DET dad-10733 1095 10 context context NOUN dad-10733 1095 11 of of ADP dad-10733 1095 12 a a DET dad-10733 1095 13 conversation conversation NOUN dad-10733 1095 14 , , PUNCT dad-10733 1095 15 there there PRON dad-10733 1095 16 often often ADV dad-10733 1095 17 exists exist VERB dad-10733 1095 18 a a DET dad-10733 1095 19 large large ADJ dad-10733 1095 20 number number NOUN dad-10733 1095 21 of of ADP dad-10733 1095 22 possible possible ADJ dad-10733 1095 23 responses response NOUN dad-10733 1095 24 that that SCONJ dad-10733 1095 25 ‘ ' PUNCT dad-10733 1095 26 fit fit NOUN dad-10733 1095 27 ’ ' PUNCT dad-10733 1095 28 into into ADP dad-10733 1095 29 the the DET dad-10733 1095 30 dialogue dialogue NOUN dad-10733 1095 31 . . PUNCT dad-10733 1096 1 thus thus ADV dad-10733 1096 2 , , PUNCT dad-10733 1096 3 the the DET dad-10733 1096 4 response response NOUN dad-10733 1096 5 generated generate VERB dad-10733 1096 6 by by ADP dad-10733 1096 7 a a DET dad-10733 1096 8 dialogue dialogue NOUN dad-10733 1096 9 system system NOUN dad-10733 1096 10 could could AUX dad-10733 1096 11 be be AUX dad-10733 1096 12 entirely entirely ADV dad-10733 1096 13 reasonable reasonable ADJ dad-10733 1096 14 , , PUNCT dad-10733 1096 15 yet yet CCONJ dad-10733 1096 16 it it PRON dad-10733 1096 17 may may AUX dad-10733 1096 18 have have VERB dad-10733 1096 19 no no DET dad-10733 1096 20 words word NOUN dad-10733 1096 21 in in ADP dad-10733 1096 22 common common ADJ dad-10733 1096 23 with with ADP dad-10733 1096 24 the the DET dad-10733 1096 25 actual actual ADJ dad-10733 1096 26 next next ADJ dad-10733 1096 27 utterance utterance NOUN dad-10733 1096 28 . . PUNCT dad-10733 1097 1 in in ADP dad-10733 1097 2 this this DET dad-10733 1097 3 case case NOUN dad-10733 1097 4 , , PUNCT dad-10733 1097 5 the the DET dad-10733 1097 6 bleu bleu NOUN dad-10733 1097 7 37 37 NUM dad-10733 1097 8 serban serban PROPN dad-10733 1097 9 , , PUNCT dad-10733 1097 10 lowe lowe PROPN dad-10733 1097 11 , , PUNCT dad-10733 1097 12 henderson henderson PROPN dad-10733 1097 13 , , PUNCT dad-10733 1097 14 charlin charlin PROPN dad-10733 1097 15 and and CCONJ dad-10733 1097 16 pineau pineau PROPN dad-10733 1097 17 score score NOUN dad-10733 1097 18 would would AUX dad-10733 1097 19 be be AUX dad-10733 1097 20 very very ADV dad-10733 1097 21 low low ADJ dad-10733 1097 22 , , PUNCT dad-10733 1097 23 but but CCONJ dad-10733 1097 24 would would AUX dad-10733 1097 25 not not PART dad-10733 1097 26 accurately accurately ADV dad-10733 1097 27 reflect reflect VERB dad-10733 1097 28 the the DET dad-10733 1097 29 strength strength NOUN dad-10733 1097 30 of of ADP dad-10733 1097 31 the the DET dad-10733 1097 32 model model NOUN dad-10733 1097 33 . . PUNCT dad-10733 1098 1 indeed indeed ADV dad-10733 1098 2 , , PUNCT dad-10733 1098 3 even even ADV dad-10733 1098 4 humans human NOUN dad-10733 1098 5 who who PRON dad-10733 1098 6 are be AUX dad-10733 1098 7 tasked task VERB dad-10733 1098 8 with with ADP dad-10733 1098 9 predicting predict VERB dad-10733 1098 10 the the DET dad-10733 1098 11 next next ADJ dad-10733 1098 12 utterance utterance NOUN dad-10733 1098 13 of of ADP dad-10733 1098 14 a a DET dad-10733 1098 15 conversation conversation NOUN dad-10733 1098 16 achieve achieve VERB dad-10733 1098 17 relatively relatively ADV dad-10733 1098 18 low low ADJ dad-10733 1098 19 bleu bleu NOUN dad-10733 1098 20 scores score NOUN dad-10733 1098 21 ( ( PUNCT dad-10733 1098 22 sordoni sordoni NOUN dad-10733 1098 23 et et PROPN dad-10733 1098 24 al al PROPN dad-10733 1098 25 . . PROPN dad-10733 1098 26 , , PUNCT dad-10733 1098 27 2015 2015 NUM dad-10733 1098 28 ) ) PUNCT dad-10733 1098 29 . . PUNCT dad-10733 1099 1 although although SCONJ dad-10733 1099 2 the the DET dad-10733 1099 3 meteor meteor NOUN dad-10733 1099 4 metric metric NOUN dad-10733 1099 5 takes take VERB dad-10733 1099 6 into into ADP dad-10733 1099 7 account account NOUN dad-10733 1099 8 synonyms synonym NOUN dad-10733 1099 9 and and CCONJ dad-10733 1099 10 morphological morphological ADJ dad-10733 1099 11 variants variant NOUN dad-10733 1099 12 of of ADP dad-10733 1099 13 words word NOUN dad-10733 1099 14 in in ADP dad-10733 1099 15 the the DET dad-10733 1099 16 candidate candidate NOUN dad-10733 1099 17 response response NOUN dad-10733 1099 18 , , PUNCT dad-10733 1099 19 it it PRON dad-10733 1099 20 still still ADV dad-10733 1099 21 suffers suffer VERB dad-10733 1099 22 from from ADP dad-10733 1099 23 the the DET dad-10733 1099 24 aforementioned aforementioned ADJ dad-10733 1099 25 problems problem NOUN dad-10733 1099 26 . . PUNCT dad-10733 1100 1 in in ADP dad-10733 1100 2 a a DET dad-10733 1100 3 sense sense NOUN dad-10733 1100 4 , , PUNCT dad-10733 1100 5 these these DET dad-10733 1100 6 measurements measurement NOUN dad-10733 1100 7 only only ADV dad-10733 1100 8 satisfy satisfy VERB dad-10733 1100 9 one one NUM dad-10733 1100 10 direction direction NOUN dad-10733 1100 11 of of ADP dad-10733 1100 12 schatzmann schatzmann NOUN dad-10733 1100 13 ’s ’s PART dad-10733 1100 14 criteria criterion NOUN dad-10733 1100 15 ( ( PUNCT dad-10733 1100 16 schatzmann schatzmann X dad-10733 1100 17 et et PROPN dad-10733 1100 18 al al PROPN dad-10733 1100 19 . . PROPN dad-10733 1100 20 , , PUNCT dad-10733 1100 21 2005 2005 NUM dad-10733 1100 22 ): ): PUNCT dad-10733 1100 23 high high ADJ dad-10733 1100 24 bleu bleu NOUN dad-10733 1100 25 and and CCONJ dad-10733 1100 26 meteor meteor NOUN dad-10733 1100 27 scores score NOUN dad-10733 1100 28 imply imply VERB dad-10733 1100 29 that that SCONJ dad-10733 1100 30 the the DET dad-10733 1100 31 model model NOUN dad-10733 1100 32 is be AUX dad-10733 1100 33 generating generate VERB dad-10733 1100 34 human human ADJ dad-10733 1100 35 - - PUNCT dad-10733 1100 36 like like ADJ dad-10733 1100 37 output output NOUN dad-10733 1100 38 , , PUNCT dad-10733 1100 39 but but CCONJ dad-10733 1100 40 the the DET dad-10733 1100 41 model model NOUN dad-10733 1100 42 may may AUX dad-10733 1100 43 still still ADV dad-10733 1100 44 not not PART dad-10733 1100 45 reproduce reproduce VERB dad-10733 1100 46 the the DET dad-10733 1100 47 variety variety NOUN dad-10733 1100 48 of of ADP dad-10733 1100 49 user user NOUN dad-10733 1100 50 behaviour behaviour NOUN dad-10733 1100 51 found find VERB dad-10733 1100 52 in in ADP dad-10733 1100 53 corpus corpus NOUN dad-10733 1100 54 . . PUNCT dad-10733 1101 1 furthermore furthermore ADV dad-10733 1101 2 , , PUNCT dad-10733 1101 3 such such ADJ dad-10733 1101 4 metrics metric NOUN dad-10733 1101 5 will will AUX dad-10733 1101 6 only only ADV dad-10733 1101 7 accurately accurately ADV dad-10733 1101 8 reflect reflect VERB dad-10733 1101 9 the the DET dad-10733 1101 10 performance performance NOUN dad-10733 1101 11 of of ADP dad-10733 1101 12 the the DET dad-10733 1101 13 dialogue dialogue NOUN dad-10733 1101 14 system system NOUN dad-10733 1101 15 if if SCONJ dad-10733 1101 16 given give VERB dad-10733 1101 17 a a DET dad-10733 1101 18 large large ADJ dad-10733 1101 19 number number NOUN dad-10733 1101 20 of of ADP dad-10733 1101 21 candidate candidate NOUN dad-10733 1101 22 responses response NOUN dad-10733 1101 23 for for ADP dad-10733 1101 24 each each DET dad-10733 1101 25 given give VERB dad-10733 1101 26 context context NOUN dad-10733 1101 27 . . PUNCT dad-10733 1102 1 next next ADJ dad-10733 1102 2 utterance utterance NOUN dad-10733 1102 3 classification classification NOUN dad-10733 1102 4 . . PUNCT dad-10733 1103 1 alternatively alternatively ADV dad-10733 1103 2 , , PUNCT dad-10733 1103 3 one one PRON dad-10733 1103 4 can can AUX dad-10733 1103 5 narrow narrow VERB dad-10733 1103 6 the the DET dad-10733 1103 7 number number NOUN dad-10733 1103 8 of of ADP dad-10733 1103 9 possible possible ADJ dad-10733 1103 10 responses response NOUN dad-10733 1103 11 to to ADP dad-10733 1103 12 a a DET dad-10733 1103 13 small small ADJ dad-10733 1103 14 , , PUNCT dad-10733 1103 15 pre pre ADJ dad-10733 1103 16 - - ADJ dad-10733 1103 17 defined define VERB dad-10733 1103 18 list list NOUN dad-10733 1103 19 , , PUNCT dad-10733 1103 20 and and CCONJ dad-10733 1103 21 ask ask VERB dad-10733 1103 22 the the DET dad-10733 1103 23 model model NOUN dad-10733 1103 24 to to PART dad-10733 1103 25 select select VERB dad-10733 1103 26 the the DET dad-10733 1103 27 most most ADV dad-10733 1103 28 appropriate appropriate ADJ dad-10733 1103 29 response response NOUN dad-10733 1103 30 from from ADP dad-10733 1103 31 this this DET dad-10733 1103 32 list list NOUN dad-10733 1103 33 . . PUNCT dad-10733 1104 1 the the DET dad-10733 1104 2 list list NOUN dad-10733 1104 3 includes include VERB dad-10733 1104 4 the the DET dad-10733 1104 5 actual actual ADJ dad-10733 1104 6 next next ADJ dad-10733 1104 7 response response NOUN dad-10733 1104 8 of of ADP dad-10733 1104 9 the the DET dad-10733 1104 10 conversation conversation NOUN dad-10733 1104 11 ( ( PUNCT dad-10733 1104 12 the the DET dad-10733 1104 13 desired desire VERB dad-10733 1104 14 prediction prediction NOUN dad-10733 1104 15 ) ) PUNCT dad-10733 1104 16 , , PUNCT dad-10733 1104 17 and and CCONJ dad-10733 1104 18 the the DET dad-10733 1104 19 other other ADJ dad-10733 1104 20 entries entry NOUN dad-10733 1104 21 ( ( PUNCT dad-10733 1104 22 false false ADJ dad-10733 1104 23 positives positive NOUN dad-10733 1104 24 ) ) PUNCT dad-10733 1104 25 are be AUX dad-10733 1104 26 sampled sample VERB dad-10733 1104 27 from from ADP dad-10733 1104 28 elsewhere elsewhere ADV dad-10733 1104 29 in in ADP dad-10733 1104 30 the the DET dad-10733 1104 31 corpus corpus NOUN dad-10733 1104 32 ( ( PUNCT dad-10733 1104 33 lowe lowe PROPN dad-10733 1104 34 et et PROPN dad-10733 1104 35 al al PROPN dad-10733 1104 36 . . PROPN dad-10733 1104 37 , , PUNCT dad-10733 1104 38 2016 2016 NUM dad-10733 1104 39 , , PUNCT dad-10733 1104 40 2015a 2015a NUM dad-10733 1104 41 ) ) PUNCT dad-10733 1104 42 . . PUNCT dad-10733 1105 1 this this DET dad-10733 1105 2 next next ADJ dad-10733 1105 3 utterance utterance NOUN dad-10733 1105 4 classification classification NOUN dad-10733 1105 5 ( ( PUNCT dad-10733 1105 6 nuc nuc NOUN dad-10733 1105 7 ) ) PUNCT dad-10733 1105 8 task task NOUN dad-10733 1105 9 is be AUX dad-10733 1105 10 derived derive VERB dad-10733 1105 11 from from ADP dad-10733 1105 12 recall recall NOUN dad-10733 1105 13 and and CCONJ dad-10733 1105 14 precision precision NOUN dad-10733 1105 15 metrics metric NOUN dad-10733 1105 16 typical typical ADJ dad-10733 1105 17 of of ADP dad-10733 1105 18 information information NOUN dad-10733 1105 19 - - PUNCT dad-10733 1105 20 retrieval retrieval NOUN dad-10733 1105 21 - - PUNCT dad-10733 1105 22 based base VERB dad-10733 1105 23 approaches approach NOUN dad-10733 1105 24 . . PUNCT dad-10733 1106 1 there there PRON dad-10733 1106 2 are be VERB dad-10733 1106 3 several several ADJ dad-10733 1106 4 attractive attractive ADJ dad-10733 1106 5 properties property NOUN dad-10733 1106 6 of of ADP dad-10733 1106 7 this this DET dad-10733 1106 8 task task NOUN dad-10733 1106 9 : : PUNCT dad-10733 1106 10 it it PRON dad-10733 1106 11 is be AUX dad-10733 1106 12 easy easy ADJ dad-10733 1106 13 to to PART dad-10733 1106 14 interpret interpret VERB dad-10733 1106 15 , , PUNCT dad-10733 1106 16 and and CCONJ dad-10733 1106 17 its its PRON dad-10733 1106 18 difficulty difficulty NOUN dad-10733 1106 19 can can AUX dad-10733 1106 20 be be AUX dad-10733 1106 21 adjusted adjust VERB dad-10733 1106 22 by by ADP dad-10733 1106 23 changing change VERB dad-10733 1106 24 the the DET dad-10733 1106 25 number number NOUN dad-10733 1106 26 of of ADP dad-10733 1106 27 false false ADJ dad-10733 1106 28 responses response NOUN dad-10733 1106 29 . . PUNCT dad-10733 1107 1 however however ADV dad-10733 1107 2 , , PUNCT dad-10733 1107 3 there there PRON dad-10733 1107 4 are be VERB dad-10733 1107 5 drawbacks drawback NOUN dad-10733 1107 6 . . PUNCT dad-10733 1108 1 since since SCONJ dad-10733 1108 2 the the DET dad-10733 1108 3 other other ADJ dad-10733 1108 4 candidate candidate NOUN dad-10733 1108 5 answers answer NOUN dad-10733 1108 6 are be AUX dad-10733 1108 7 sampled sample VERB dad-10733 1108 8 from from ADP dad-10733 1108 9 elsewhere elsewhere ADV dad-10733 1108 10 in in ADP dad-10733 1108 11 the the DET dad-10733 1108 12 corpus corpus NOUN dad-10733 1108 13 , , PUNCT dad-10733 1108 14 there there PRON dad-10733 1108 15 is be VERB dad-10733 1108 16 a a DET dad-10733 1108 17 chance chance NOUN dad-10733 1108 18 that that SCONJ dad-10733 1108 19 these these PRON dad-10733 1108 20 also also ADV dad-10733 1108 21 represent represent VERB dad-10733 1108 22 reasonable reasonable ADJ dad-10733 1108 23 responses response NOUN dad-10733 1108 24 given give VERB dad-10733 1108 25 the the DET dad-10733 1108 26 context context NOUN dad-10733 1108 27 . . PUNCT dad-10733 1109 1 this this PRON dad-10733 1109 2 can can AUX dad-10733 1109 3 be be AUX dad-10733 1109 4 alleviated alleviate VERB dad-10733 1109 5 to to ADP dad-10733 1109 6 some some DET dad-10733 1109 7 extent extent NOUN dad-10733 1109 8 by by ADP dad-10733 1109 9 reporting report VERB dad-10733 1109 10 recall@k recall@k NOUN dad-10733 1109 11 measures measure NOUN dad-10733 1109 12 , , PUNCT dad-10733 1109 13 i.e. i.e. X dad-10733 1109 14 whether whether SCONJ dad-10733 1109 15 the the DET dad-10733 1109 16 correct correct ADJ dad-10733 1109 17 response response NOUN dad-10733 1109 18 is be AUX dad-10733 1109 19 found find VERB dad-10733 1109 20 in in ADP dad-10733 1109 21 the the DET dad-10733 1109 22 k k PROPN dad-10733 1109 23 responses response NOUN dad-10733 1109 24 with with ADP dad-10733 1109 25 the the DET dad-10733 1109 26 highest high ADJ dad-10733 1109 27 rankings ranking NOUN dad-10733 1109 28 according accord VERB dad-10733 1109 29 to to ADP dad-10733 1109 30 the the DET dad-10733 1109 31 model model NOUN dad-10733 1109 32 . . PUNCT dad-10733 1110 1 although although SCONJ dad-10733 1110 2 current current ADJ dad-10733 1110 3 models model NOUN dad-10733 1110 4 evaluated evaluate VERB dad-10733 1110 5 using use VERB dad-10733 1110 6 nuc nuc PROPN dad-10733 1110 7 are be AUX dad-10733 1110 8 trained train VERB dad-10733 1110 9 explicitly explicitly ADV dad-10733 1110 10 to to PART dad-10733 1110 11 maximize maximize VERB dad-10733 1110 12 the the DET dad-10733 1110 13 performance performance NOUN dad-10733 1110 14 on on ADP dad-10733 1110 15 a a DET dad-10733 1110 16 related relate VERB dad-10733 1110 17 metric metric NOUN dad-10733 1110 18 ( ( PUNCT dad-10733 1110 19 cross cross NOUN dad-10733 1110 20 - - NOUN dad-10733 1110 21 entropy entropy NOUN dad-10733 1110 22 between between ADP dad-10733 1110 23 context context NOUN dad-10733 1110 24 - - PUNCT dad-10733 1110 25 response response NOUN dad-10733 1110 26 pairs pair NOUN dad-10733 1110 27 ( ( PUNCT dad-10733 1110 28 lowe lowe PROPN dad-10733 1110 29 et et PROPN dad-10733 1110 30 al al PROPN dad-10733 1110 31 . . PROPN dad-10733 1110 32 , , PUNCT dad-10733 1110 33 2015a 2015a NUM dad-10733 1110 34 ; ; PUNCT dad-10733 1110 35 kadlec kadlec PROPN dad-10733 1110 36 et et PROPN dad-10733 1110 37 al al PROPN dad-10733 1110 38 . . PROPN dad-10733 1110 39 , , PUNCT dad-10733 1110 40 2015 2015 NUM dad-10733 1110 41 ) ) PUNCT dad-10733 1110 42 ) ) PUNCT dad-10733 1110 43 , , PUNCT dad-10733 1110 44 precision precision NOUN dad-10733 1110 45 and and CCONJ dad-10733 1110 46 recall recall NOUN dad-10733 1110 47 could could AUX dad-10733 1110 48 also also ADV dad-10733 1110 49 be be AUX dad-10733 1110 50 used use VERB dad-10733 1110 51 to to PART dad-10733 1110 52 evaluate evaluate VERB dad-10733 1110 53 a a DET dad-10733 1110 54 probabilistic probabilistic ADJ dad-10733 1110 55 generative generative ADJ dad-10733 1110 56 model model NOUN dad-10733 1110 57 trained train VERB dad-10733 1110 58 to to PART dad-10733 1110 59 outputs outputs VERB dad-10733 1110 60 full full ADJ dad-10733 1110 61 utterances utterance NOUN dad-10733 1110 62 . . PUNCT dad-10733 1111 1 word word NOUN dad-10733 1111 2 perplexity perplexity NOUN dad-10733 1111 3 . . PUNCT dad-10733 1112 1 another another DET dad-10733 1112 2 metric metric NOUN dad-10733 1112 3 proposed propose VERB dad-10733 1112 4 to to PART dad-10733 1112 5 evaluate evaluate VERB dad-10733 1112 6 probabilistic probabilistic ADJ dad-10733 1112 7 language language NOUN dad-10733 1112 8 models model NOUN dad-10733 1112 9 ( ( PUNCT dad-10733 1112 10 bengio bengio NOUN dad-10733 1112 11 et et PROPN dad-10733 1112 12 al al PROPN dad-10733 1112 13 . . PROPN dad-10733 1112 14 , , PUNCT dad-10733 1112 15 2003 2003 NUM dad-10733 1112 16 ; ; PUNCT dad-10733 1112 17 mikolov mikolov PROPN dad-10733 1112 18 et et PROPN dad-10733 1112 19 al al PROPN dad-10733 1112 20 . . PROPN dad-10733 1112 21 , , PUNCT dad-10733 1112 22 2010 2010 NUM dad-10733 1112 23 ) ) PUNCT dad-10733 1112 24 that that PRON dad-10733 1112 25 has have AUX dad-10733 1112 26 seen see VERB dad-10733 1112 27 significant significant ADJ dad-10733 1112 28 recent recent ADJ dad-10733 1112 29 use use NOUN dad-10733 1112 30 for for ADP dad-10733 1112 31 evaluating evaluate VERB dad-10733 1112 32 end end NOUN dad-10733 1112 33 - - PUNCT dad-10733 1112 34 to to ADP dad-10733 1112 35 - - PUNCT dad-10733 1112 36 end end NOUN dad-10733 1112 37 dialogue dialogue NOUN dad-10733 1112 38 systems system NOUN dad-10733 1112 39 is be AUX dad-10733 1112 40 word word NOUN dad-10733 1112 41 perplexity perplexity NOUN dad-10733 1112 42 ( ( PUNCT dad-10733 1112 43 pietquin pietquin NOUN dad-10733 1112 44 and and CCONJ dad-10733 1112 45 hastie hastie PROPN dad-10733 1112 46 , , PUNCT dad-10733 1112 47 2013 2013 NUM dad-10733 1112 48 ; ; PUNCT dad-10733 1113 1 serban serban PROPN dad-10733 1113 2 et et PROPN dad-10733 1113 3 al al PROPN dad-10733 1113 4 . . PROPN dad-10733 1113 5 , , PUNCT dad-10733 1113 6 2016 2016 NUM dad-10733 1113 7 ) ) PUNCT dad-10733 1113 8 . . PUNCT dad-10733 1114 1 perplexity perplexity NOUN dad-10733 1114 2 explicitly explicitly ADV dad-10733 1114 3 measures measure VERB dad-10733 1114 4 the the DET dad-10733 1114 5 probability probability NOUN dad-10733 1114 6 that that SCONJ dad-10733 1114 7 the the DET dad-10733 1114 8 model model NOUN dad-10733 1114 9 will will AUX dad-10733 1114 10 generate generate VERB dad-10733 1114 11 the the DET dad-10733 1114 12 ground ground NOUN dad-10733 1114 13 truth truth NOUN dad-10733 1114 14 next next ADP dad-10733 1114 15 utterance utterance NOUN dad-10733 1114 16 given give VERB dad-10733 1114 17 some some DET dad-10733 1114 18 context context NOUN dad-10733 1114 19 of of ADP dad-10733 1114 20 the the DET dad-10733 1114 21 conversation conversation NOUN dad-10733 1114 22 . . PUNCT dad-10733 1115 1 this this PRON dad-10733 1115 2 is be AUX dad-10733 1115 3 particularly particularly ADV dad-10733 1115 4 appealing appeal VERB dad-10733 1115 5 for for ADP dad-10733 1115 6 dialogue dialogue NOUN dad-10733 1115 7 , , PUNCT dad-10733 1115 8 as as SCONJ dad-10733 1115 9 the the DET dad-10733 1115 10 distribution distribution NOUN dad-10733 1115 11 over over ADP dad-10733 1115 12 words word NOUN dad-10733 1115 13 in in ADP dad-10733 1115 14 the the DET dad-10733 1115 15 next next ADJ dad-10733 1115 16 utterance utterance NOUN dad-10733 1115 17 can can AUX dad-10733 1115 18 be be AUX dad-10733 1115 19 highly highly ADV dad-10733 1115 20 multi multi ADJ dad-10733 1115 21 - - ADJ dad-10733 1115 22 modal modal ADJ dad-10733 1115 23 ( ( PUNCT dad-10733 1115 24 i.e. i.e. X dad-10733 1115 25 many many ADJ dad-10733 1115 26 possible possible ADJ dad-10733 1115 27 responses response NOUN dad-10733 1115 28 ) ) PUNCT dad-10733 1115 29 . . PUNCT dad-10733 1116 1 a a DET dad-10733 1116 2 re re NOUN dad-10733 1116 3 - - ADJ dad-10733 1116 4 weighted weighted ADJ dad-10733 1116 5 perplexity perplexity NOUN dad-10733 1116 6 metric metric NOUN dad-10733 1116 7 has have AUX dad-10733 1116 8 also also ADV dad-10733 1116 9 been be AUX dad-10733 1116 10 proposed propose VERB dad-10733 1116 11 where where SCONJ dad-10733 1116 12 stop stop VERB dad-10733 1116 13 words word NOUN dad-10733 1116 14 , , PUNCT dad-10733 1116 15 punctuation punctuation NOUN dad-10733 1116 16 , , PUNCT dad-10733 1116 17 and and CCONJ dad-10733 1116 18 end end NOUN dad-10733 1116 19 - - PUNCT dad-10733 1116 20 of of ADP dad-10733 1116 21 - - PUNCT dad-10733 1116 22 utterance utterance NOUN dad-10733 1116 23 tokens token NOUN dad-10733 1116 24 are be AUX dad-10733 1116 25 ignored ignore VERB dad-10733 1116 26 to to PART dad-10733 1116 27 focus focus VERB dad-10733 1116 28 on on ADP dad-10733 1116 29 the the DET dad-10733 1116 30 semantic semantic ADJ dad-10733 1116 31 content content NOUN dad-10733 1116 32 of of ADP dad-10733 1116 33 the the DET dad-10733 1116 34 phrase phrase NOUN dad-10733 1116 35 ( ( PUNCT dad-10733 1116 36 serban serban PROPN dad-10733 1116 37 et et PROPN dad-10733 1116 38 al al PROPN dad-10733 1116 39 . . PROPN dad-10733 1116 40 , , PUNCT dad-10733 1116 41 2016 2016 NUM dad-10733 1116 42 ) ) PUNCT dad-10733 1116 43 . . PUNCT dad-10733 1117 1 both both PRON dad-10733 1117 2 word word NOUN dad-10733 1117 3 perplexity perplexity NOUN dad-10733 1117 4 , , PUNCT dad-10733 1117 5 as as ADV dad-10733 1117 6 well well ADV dad-10733 1117 7 as as ADP dad-10733 1117 8 utterance utterance ADJ dad-10733 1117 9 - - PUNCT dad-10733 1117 10 level level NOUN dad-10733 1117 11 recall recall NOUN dad-10733 1117 12 and and CCONJ dad-10733 1117 13 precision precision NOUN dad-10733 1117 14 outlined outline VERB dad-10733 1117 15 above above ADV dad-10733 1117 16 , , PUNCT dad-10733 1117 17 satisfy satisfy PROPN dad-10733 1117 18 schatzmann schatzmann PROPN dad-10733 1117 19 ’s ’s PART dad-10733 1117 20 evaluation evaluation NOUN dad-10733 1117 21 criteria criterion NOUN dad-10733 1117 22 , , PUNCT dad-10733 1117 23 since since SCONJ dad-10733 1117 24 scoring score VERB dad-10733 1117 25 high high ADJ dad-10733 1117 26 on on ADP dad-10733 1117 27 these these PRON dad-10733 1117 28 would would AUX dad-10733 1117 29 require require VERB dad-10733 1117 30 the the DET dad-10733 1117 31 model model NOUN dad-10733 1117 32 to to PART dad-10733 1117 33 produce produce VERB dad-10733 1117 34 human human ADJ dad-10733 1117 35 - - PUNCT dad-10733 1117 36 like like ADJ dad-10733 1117 37 output output NOUN dad-10733 1117 38 and and CCONJ dad-10733 1117 39 to to PART dad-10733 1117 40 reproduce reproduce VERB dad-10733 1117 41 most most ADJ dad-10733 1117 42 types type NOUN dad-10733 1117 43 of of ADP dad-10733 1117 44 conversations conversation NOUN dad-10733 1117 45 in in ADP dad-10733 1117 46 the the DET dad-10733 1117 47 corpus corpus NOUN dad-10733 1117 48 . . PUNCT dad-10733 1118 1 response response NOUN dad-10733 1118 2 diversity diversity NOUN dad-10733 1118 3 . . PUNCT dad-10733 1119 1 recent recent ADJ dad-10733 1119 2 non non ADJ dad-10733 1119 3 - - ADJ dad-10733 1119 4 goal goal ADJ dad-10733 1119 5 - - PUNCT dad-10733 1119 6 driven drive VERB dad-10733 1119 7 dialogue dialogue NOUN dad-10733 1119 8 systems system NOUN dad-10733 1119 9 based base VERB dad-10733 1119 10 on on ADP dad-10733 1119 11 neural neural ADJ dad-10733 1119 12 networks network NOUN dad-10733 1119 13 have have AUX dad-10733 1119 14 had have VERB dad-10733 1119 15 problems problem NOUN dad-10733 1119 16 generating generate VERB dad-10733 1119 17 diverse diverse ADJ dad-10733 1119 18 responses response NOUN dad-10733 1119 19 ( ( PUNCT dad-10733 1119 20 serban serban PROPN dad-10733 1119 21 et et PROPN dad-10733 1119 22 al al PROPN dad-10733 1119 23 . . PROPN dad-10733 1119 24 , , PUNCT dad-10733 1119 25 2016 2016 NUM dad-10733 1119 26 ) ) PUNCT dad-10733 1119 27 . . PUNCT dad-10733 1120 1 ( ( PUNCT dad-10733 1120 2 li li PROPN dad-10733 1120 3 et et PROPN dad-10733 1120 4 al al PROPN dad-10733 1120 5 . . PROPN dad-10733 1120 6 , , PUNCT dad-10733 1120 7 2015 2015 NUM dad-10733 1120 8 ) ) PUNCT dad-10733 1120 9 recently recently ADV dad-10733 1120 10 introduced introduce VERB dad-10733 1120 11 two two NUM dad-10733 1120 12 new new ADJ dad-10733 1120 13 metrics metric NOUN dad-10733 1120 14 , , PUNCT dad-10733 1120 15 distinct-1 distinct-1 NUM dad-10733 1120 16 and and CCONJ dad-10733 1120 17 distinct-2 distinct-2 PROPN dad-10733 1120 18 , , PUNCT dad-10733 1120 19 which which PRON dad-10733 1120 20 respectively respectively ADV dad-10733 1120 21 measure measure VERB dad-10733 1120 22 the the DET dad-10733 1120 23 number number NOUN dad-10733 1120 24 of of ADP dad-10733 1120 25 distinct distinct ADJ dad-10733 1120 26 unigrams unigram NOUN dad-10733 1120 27 and and CCONJ dad-10733 1120 28 bigrams bigram NOUN dad-10733 1120 29 of of ADP dad-10733 1120 30 the the DET dad-10733 1120 31 generated generate VERB dad-10733 1120 32 responses response NOUN dad-10733 1120 33 . . PUNCT dad-10733 1121 1 although although SCONJ dad-10733 1121 2 these these PRON dad-10733 1121 3 fail fail VERB dad-10733 1121 4 to to PART dad-10733 1121 5 satisfy satisfy VERB dad-10733 1121 6 either either PRON dad-10733 1121 7 of of ADP dad-10733 1121 8 schatzmann schatzmann NOUN dad-10733 1121 9 ’s ’s PART dad-10733 1121 10 criteria criterion NOUN dad-10733 1121 11 , , PUNCT dad-10733 1121 12 they they PRON dad-10733 1121 13 may may AUX dad-10733 1121 14 still still ADV dad-10733 1121 15 be be AUX dad-10733 1121 16 useful useful ADJ dad-10733 1121 17 in in ADP dad-10733 1121 18 combination combination NOUN dad-10733 1121 19 with with ADP dad-10733 1121 20 other other ADJ dad-10733 1121 21 metrics metric NOUN dad-10733 1121 22 , , PUNCT dad-10733 1121 23 such such ADJ dad-10733 1121 24 as as ADP dad-10733 1121 25 bleu bleu NOUN dad-10733 1121 26 , , PUNCT dad-10733 1121 27 nuc nuc NOUN dad-10733 1121 28 or or CCONJ dad-10733 1121 29 word word NOUN dad-10733 1121 30 perplexity perplexity NOUN dad-10733 1121 31 . . PUNCT dad-10733 1122 1 38 38 NUM dad-10733 1122 2 a a DET dad-10733 1122 3 survey survey NOUN dad-10733 1122 4 of of ADP dad-10733 1122 5 available available ADJ dad-10733 1122 6 corpora corpora PROPN dad-10733 1122 7 for for ADP dad-10733 1122 8 building build VERB dad-10733 1122 9 data data NOUN dad-10733 1122 10 - - PUNCT dad-10733 1122 11 driven drive VERB dad-10733 1122 12 dialogue dialogue NOUN dad-10733 1122 13 systems system NOUN dad-10733 1122 14 6 6 NUM dad-10733 1122 15 . . PUNCT dad-10733 1122 16 conclusion conclusion NOUN dad-10733 1122 17 this this DET dad-10733 1122 18 paper paper NOUN dad-10733 1122 19 provides provide VERB dad-10733 1122 20 an an DET dad-10733 1122 21 extensive extensive ADJ dad-10733 1122 22 survey survey NOUN dad-10733 1122 23 of of ADP dad-10733 1122 24 currently currently ADV dad-10733 1122 25 available available ADJ dad-10733 1122 26 datasets dataset NOUN dad-10733 1122 27 suitable suitable ADJ dad-10733 1122 28 for for ADP dad-10733 1122 29 research research NOUN dad-10733 1122 30 , , PUNCT dad-10733 1122 31 development development NOUN dad-10733 1122 32 , , PUNCT dad-10733 1122 33 and and CCONJ dad-10733 1122 34 evaluation evaluation NOUN dad-10733 1122 35 of of ADP dad-10733 1122 36 data data NOUN dad-10733 1122 37 - - PUNCT dad-10733 1122 38 driven drive VERB dad-10733 1122 39 dialogue dialogue NOUN dad-10733 1122 40 systems system NOUN dad-10733 1122 41 . . PUNCT dad-10733 1123 1 we we PRON dad-10733 1123 2 categorize categorize VERB dad-10733 1123 3 these these DET dad-10733 1123 4 corpora corpora NOUN dad-10733 1123 5 along along ADP dad-10733 1123 6 several several ADJ dad-10733 1123 7 dimensions dimension NOUN dad-10733 1123 8 depending depend VERB dad-10733 1123 9 on on ADP dad-10733 1123 10 whether whether SCONJ dad-10733 1123 11 the the DET dad-10733 1123 12 dataset dataset NOUN dad-10733 1123 13 is be AUX dad-10733 1123 14 written write VERB dad-10733 1123 15 or or CCONJ dad-10733 1123 16 spoken speak VERB dad-10733 1123 17 , , PUNCT dad-10733 1123 18 between between ADP dad-10733 1123 19 human human ADJ dad-10733 1123 20 interlocutors interlocutor NOUN dad-10733 1123 21 or or CCONJ dad-10733 1123 22 human human ADJ dad-10733 1123 23 - - PUNCT dad-10733 1123 24 machine machine NOUN dad-10733 1123 25 conversations conversation NOUN dad-10733 1123 26 , , PUNCT dad-10733 1123 27 and and CCONJ dad-10733 1123 28 constrained constrain VERB dad-10733 1123 29 in in ADP dad-10733 1123 30 topic topic NOUN dad-10733 1123 31 or or CCONJ dad-10733 1123 32 more more ADV dad-10733 1123 33 free free ADJ dad-10733 1123 34 - - PUNCT dad-10733 1123 35 form form NOUN dad-10733 1123 36 . . PUNCT dad-10733 1124 1 we we PRON dad-10733 1124 2 collect collect VERB dad-10733 1124 3 statistics statistic NOUN dad-10733 1124 4 for for ADP dad-10733 1124 5 these these DET dad-10733 1124 6 datasets dataset NOUN dad-10733 1124 7 and and CCONJ dad-10733 1124 8 present present VERB dad-10733 1124 9 them they PRON dad-10733 1124 10 in in ADP dad-10733 1124 11 tables table NOUN dad-10733 1124 12 in in ADP dad-10733 1124 13 section section NOUN dad-10733 1124 14 4 4 NUM dad-10733 1124 15 , , PUNCT dad-10733 1124 16 and and CCONJ dad-10733 1124 17 provide provide VERB dad-10733 1124 18 an an DET dad-10733 1124 19 open open ADJ dad-10733 1124 20 - - PUNCT dad-10733 1124 21 source source NOUN dad-10733 1124 22 github github NOUN dad-10733 1124 23 repository repository NOUN dad-10733 1124 24 where where SCONJ dad-10733 1124 25 these these DET dad-10733 1124 26 datasets dataset NOUN dad-10733 1124 27 can can AUX dad-10733 1124 28 be be AUX dad-10733 1124 29 viewed view VERB dad-10733 1124 30 and and CCONJ dad-10733 1124 31 pull pull NOUN dad-10733 1124 32 requests request NOUN dad-10733 1124 33 can can AUX dad-10733 1124 34 be be AUX dad-10733 1124 35 made make VERB dad-10733 1124 36 to to PART dad-10733 1124 37 add add VERB dad-10733 1124 38 new new ADJ dad-10733 1124 39 datasets dataset NOUN dad-10733 1124 40 : : PUNCT dad-10733 1124 41 https://github.com/breakend/dialogdatasets https://github.com/breakend/dialogdatasets PROPN dad-10733 1124 42 . . PUNCT dad-10733 1125 1 there there PRON dad-10733 1125 2 is be VERB dad-10733 1125 3 broad broad ADJ dad-10733 1125 4 coverage coverage NOUN dad-10733 1125 5 of of ADP dad-10733 1125 6 existing exist VERB dad-10733 1125 7 datasets dataset NOUN dad-10733 1125 8 along along ADP dad-10733 1125 9 most most ADJ dad-10733 1125 10 of of ADP dad-10733 1125 11 the the DET dad-10733 1125 12 dimensions dimension NOUN dad-10733 1125 13 we we PRON dad-10733 1125 14 consider consider VERB dad-10733 1125 15 . . PUNCT dad-10733 1126 1 however however ADV dad-10733 1126 2 , , PUNCT dad-10733 1126 3 the the DET dad-10733 1126 4 vast vast ADJ dad-10733 1126 5 majority majority NOUN dad-10733 1126 6 of of ADP dad-10733 1126 7 the the DET dad-10733 1126 8 available available ADJ dad-10733 1126 9 datasets dataset NOUN dad-10733 1126 10 contain contain VERB dad-10733 1126 11 at at ADP dad-10733 1126 12 most most ADJ dad-10733 1126 13 thousands thousand NOUN dad-10733 1126 14 of of ADP dad-10733 1126 15 dialogues dialogue NOUN dad-10733 1126 16 . . PUNCT dad-10733 1127 1 this this PRON dad-10733 1127 2 presents present VERB dad-10733 1127 3 some some DET dad-10733 1127 4 challenges challenge NOUN dad-10733 1127 5 to to ADP dad-10733 1127 6 the the DET dad-10733 1127 7 training training NOUN dad-10733 1127 8 of of ADP dad-10733 1127 9 large large ADJ dad-10733 1127 10 - - PUNCT dad-10733 1127 11 scale scale NOUN dad-10733 1127 12 end end NOUN dad-10733 1127 13 - - PUNCT dad-10733 1127 14 to to ADP dad-10733 1127 15 - - PUNCT dad-10733 1127 16 end end NOUN dad-10733 1127 17 models model NOUN dad-10733 1127 18 , , PUNCT dad-10733 1127 19 such such ADJ dad-10733 1127 20 as as ADP dad-10733 1127 21 neural neural ADJ dad-10733 1127 22 networks network NOUN dad-10733 1127 23 , , PUNCT dad-10733 1127 24 on on ADP dad-10733 1127 25 general general ADJ dad-10733 1127 26 purpose purpose NOUN dad-10733 1127 27 domains domain NOUN dad-10733 1127 28 . . PUNCT dad-10733 1128 1 neural neural ADJ dad-10733 1128 2 networks network NOUN dad-10733 1128 3 can can AUX dad-10733 1128 4 be be AUX dad-10733 1128 5 applied apply VERB dad-10733 1128 6 to to ADP dad-10733 1128 7 narrow narrow ADJ dad-10733 1128 8 domains domain NOUN dad-10733 1128 9 , , PUNCT dad-10733 1128 10 such such ADJ dad-10733 1128 11 as as ADP dad-10733 1128 12 restaurant restaurant NOUN dad-10733 1128 13 recommendation recommendation NOUN dad-10733 1128 14 , , PUNCT dad-10733 1128 15 with with ADP dad-10733 1128 16 relatively relatively ADV dad-10733 1128 17 little little ADJ dad-10733 1128 18 data datum NOUN dad-10733 1128 19 ( ( PUNCT dad-10733 1128 20 wen wen NOUN dad-10733 1128 21 et et PROPN dad-10733 1128 22 al al PROPN dad-10733 1128 23 . . PROPN dad-10733 1128 24 , , PUNCT dad-10733 1128 25 2017 2017 NUM dad-10733 1128 26 ) ) PUNCT dad-10733 1128 27 . . PUNCT dad-10733 1129 1 however however ADV dad-10733 1129 2 , , PUNCT dad-10733 1129 3 as as ADP dad-10733 1129 4 the the DET dad-10733 1129 5 nature nature NOUN dad-10733 1129 6 of of ADP dad-10733 1129 7 interactions interaction NOUN dad-10733 1129 8 becomes become VERB dad-10733 1129 9 more more ADV dad-10733 1129 10 open open ADJ dad-10733 1129 11 and and CCONJ dad-10733 1129 12 the the DET dad-10733 1129 13 number number NOUN dad-10733 1129 14 of of ADP dad-10733 1129 15 topics topic NOUN dad-10733 1129 16 grows grow VERB dad-10733 1129 17 , , PUNCT dad-10733 1129 18 the the DET dad-10733 1129 19 sample sample NOUN dad-10733 1129 20 complexity complexity NOUN dad-10733 1129 21 and and CCONJ dad-10733 1129 22 with with ADP dad-10733 1129 23 it it PRON dad-10733 1129 24 the the DET dad-10733 1129 25 required require VERB dad-10733 1129 26 dataset dataset NOUN dad-10733 1129 27 size size NOUN dad-10733 1129 28 increases increase NOUN dad-10733 1129 29 . . PUNCT dad-10733 1130 1 to to PART dad-10733 1130 2 obtain obtain VERB dad-10733 1130 3 reasonable reasonable ADJ dad-10733 1130 4 results result NOUN dad-10733 1130 5 in in ADP dad-10733 1130 6 such such DET dad-10733 1130 7 a a DET dad-10733 1130 8 setting setting NOUN dad-10733 1130 9 , , PUNCT dad-10733 1130 10 neural neural ADJ dad-10733 1130 11 network network NOUN dad-10733 1130 12 practitioners practitioner NOUN dad-10733 1130 13 have have AUX dad-10733 1130 14 resorted resort VERB dad-10733 1130 15 to to ADP dad-10733 1130 16 training train VERB dad-10733 1130 17 neural neural ADJ dad-10733 1130 18 network network NOUN dad-10733 1130 19 models model NOUN dad-10733 1130 20 on on ADP dad-10733 1130 21 datasets dataset NOUN dad-10733 1130 22 with with ADP dad-10733 1130 23 hundreds hundred NOUN dad-10733 1130 24 of of ADP dad-10733 1130 25 thousands thousand NOUN dad-10733 1130 26 to to PART dad-10733 1130 27 millions million NOUN dad-10733 1130 28 of of ADP dad-10733 1130 29 dialogues dialogue NOUN dad-10733 1130 30 : : PUNCT dad-10733 1130 31 the the DET dad-10733 1130 32 twitter twitter NOUN dad-10733 1130 33 corpus corpus NOUN dad-10733 1130 34 ( ( PUNCT dad-10733 1130 35 ritter ritter PROPN dad-10733 1130 36 et et PROPN dad-10733 1130 37 al al PROPN dad-10733 1130 38 . . PROPN dad-10733 1130 39 , , PUNCT dad-10733 1130 40 2010 2010 NUM dad-10733 1130 41 ; ; PUNCT dad-10733 1130 42 sordoni sordoni VERB dad-10733 1130 43 et et PROPN dad-10733 1130 44 al al PROPN dad-10733 1130 45 . . PROPN dad-10733 1130 46 , , PUNCT dad-10733 1130 47 2015 2015 NUM dad-10733 1130 48 ) ) PUNCT dad-10733 1130 49 , , PUNCT dad-10733 1130 50 reddit reddit NOUN dad-10733 1130 51 , , PUNCT dad-10733 1130 52 the the DET dad-10733 1130 53 ubuntu ubuntu ADJ dad-10733 1130 54 dialogue dialogue NOUN dad-10733 1130 55 corpus corpus PROPN dad-10733 1130 56 ( ( PUNCT dad-10733 1130 57 lowe lowe PROPN dad-10733 1130 58 et et PROPN dad-10733 1130 59 al al PROPN dad-10733 1130 60 . . PROPN dad-10733 1130 61 , , PUNCT dad-10733 1130 62 2015a 2015a NUM dad-10733 1130 63 ) ) PUNCT dad-10733 1130 64 , , PUNCT dad-10733 1130 65 and and CCONJ dad-10733 1130 66 various various ADJ dad-10733 1130 67 movie movie NOUN dad-10733 1130 68 subtitle subtitle NOUN dad-10733 1130 69 datasets dataset NOUN dad-10733 1130 70 such such ADJ dad-10733 1130 71 as as ADP dad-10733 1130 72 subtle subtle ADJ dad-10733 1130 73 , , PUNCT dad-10733 1130 74 opensubtitles opensubtitle NOUN dad-10733 1130 75 , , PUNCT dad-10733 1130 76 movie movie NOUN dad-10733 1130 77 - - PUNCT dad-10733 1130 78 dic dic NOUN dad-10733 1130 79 , , PUNCT dad-10733 1130 80 and and CCONJ dad-10733 1130 81 the the DET dad-10733 1130 82 movie movie NOUN dad-10733 1130 83 dialogue dialogue NOUN dad-10733 1130 84 dataset dataset NOUN dad-10733 1130 85 ( ( PUNCT dad-10733 1130 86 ameixa ameixa NOUN dad-10733 1130 87 and and CCONJ dad-10733 1130 88 coheur coheur ADV dad-10733 1130 89 , , PUNCT dad-10733 1130 90 2013 2013 NUM dad-10733 1130 91 ; ; PUNCT dad-10733 1130 92 tiedemann tiedemann NOUN dad-10733 1130 93 , , PUNCT dad-10733 1130 94 2012 2012 NUM dad-10733 1130 95 ; ; PUNCT dad-10733 1130 96 banchs banch NOUN dad-10733 1130 97 , , PUNCT dad-10733 1130 98 2012 2012 NUM dad-10733 1130 99 ; ; PUNCT dad-10733 1130 100 dodge dodge VERB dad-10733 1130 101 et et PROPN dad-10733 1130 102 al al PROPN dad-10733 1130 103 . . PROPN dad-10733 1130 104 , , PUNCT dad-10733 1130 105 2015 2015 NUM dad-10733 1130 106 ) ) PUNCT dad-10733 1130 107 . . PUNCT dad-10733 1131 1 while while SCONJ dad-10733 1131 2 the the DET dad-10733 1131 3 conversation conversation ADJ dad-10733 1131 4 topics topic NOUN dad-10733 1131 5 in in ADP dad-10733 1131 6 these these DET dad-10733 1131 7 datasets dataset NOUN dad-10733 1131 8 often often ADV dad-10733 1131 9 vary vary VERB dad-10733 1131 10 considerably considerably ADV dad-10733 1131 11 , , PUNCT dad-10733 1131 12 the the DET dad-10733 1131 13 nature nature NOUN dad-10733 1131 14 of of ADP dad-10733 1131 15 the the DET dad-10733 1131 16 datasets dataset NOUN dad-10733 1131 17 themselves themselves PRON dad-10733 1131 18 are be AUX dad-10733 1131 19 fairly fairly ADV dad-10733 1131 20 fixed fix VERB dad-10733 1131 21 in in ADP dad-10733 1131 22 the the DET dad-10733 1131 23 form form NOUN dad-10733 1131 24 of of ADP dad-10733 1131 25 informal informal ADJ dad-10733 1131 26 written write VERB dad-10733 1131 27 dialogues dialogue NOUN dad-10733 1131 28 between between ADP dad-10733 1131 29 humans human NOUN dad-10733 1131 30 . . PUNCT dad-10733 1132 1 this this PRON dad-10733 1132 2 is be AUX dad-10733 1132 3 the the DET dad-10733 1132 4 case case NOUN dad-10733 1132 5 for for ADP dad-10733 1132 6 movie movie NOUN dad-10733 1132 7 scripts script NOUN dad-10733 1132 8 , , PUNCT dad-10733 1132 9 forum forum NOUN dad-10733 1132 10 posts post NOUN dad-10733 1132 11 , , PUNCT dad-10733 1132 12 and and CCONJ dad-10733 1132 13 micro micro ADJ dad-10733 1132 14 - - ADJ dad-10733 1132 15 blogging blogging ADJ dad-10733 1132 16 platforms platform NOUN dad-10733 1132 17 . . PUNCT dad-10733 1133 1 learning learn VERB dad-10733 1133 2 only only ADV dad-10733 1133 3 from from ADP dad-10733 1133 4 these these DET dad-10733 1133 5 sources source NOUN dad-10733 1133 6 will will AUX dad-10733 1133 7 bias bias VERB dad-10733 1133 8 dialogue dialogue NOUN dad-10733 1133 9 systems system NOUN dad-10733 1133 10 towards towards ADP dad-10733 1133 11 certain certain ADJ dad-10733 1133 12 kinds kind NOUN dad-10733 1133 13 of of ADP dad-10733 1133 14 interactions interaction NOUN dad-10733 1133 15 and and CCONJ dad-10733 1133 16 behaviours behaviour NOUN dad-10733 1133 17 ; ; PUNCT dad-10733 1133 18 for for ADP dad-10733 1133 19 example example NOUN dad-10733 1133 20 , , PUNCT dad-10733 1133 21 written write VERB dad-10733 1133 22 corpora corpora PROPN dad-10733 1133 23 usually usually ADV dad-10733 1133 24 have have VERB dad-10733 1133 25 a a DET dad-10733 1133 26 specific specific ADJ dad-10733 1133 27 turn turn NOUN dad-10733 1133 28 - - PUNCT dad-10733 1133 29 taking take VERB dad-10733 1133 30 structure structure NOUN dad-10733 1133 31 that that PRON dad-10733 1133 32 is be AUX dad-10733 1133 33 different different ADJ dad-10733 1133 34 from from ADP dad-10733 1133 35 spoken spoken ADJ dad-10733 1133 36 conversation conversation NOUN dad-10733 1133 37 , , PUNCT dad-10733 1133 38 and and CCONJ dad-10733 1133 39 they they PRON dad-10733 1133 40 may may AUX dad-10733 1133 41 encode encode VERB dad-10733 1133 42 biases bias NOUN dad-10733 1133 43 against against ADP dad-10733 1133 44 certain certain ADJ dad-10733 1133 45 groups group NOUN dad-10733 1133 46 or or CCONJ dad-10733 1133 47 populations population NOUN dad-10733 1133 48 ( ( PUNCT dad-10733 1133 49 henderson henderson PROPN dad-10733 1133 50 et et PROPN dad-10733 1133 51 al al PROPN dad-10733 1133 52 . . PROPN dad-10733 1133 53 , , PUNCT dad-10733 1133 54 2017 2017 NUM dad-10733 1133 55 ) ) PUNCT dad-10733 1133 56 . . PUNCT dad-10733 1134 1 if if SCONJ dad-10733 1134 2 we we PRON dad-10733 1134 3 want want VERB dad-10733 1134 4 dialogue dialogue NOUN dad-10733 1134 5 systems system NOUN dad-10733 1134 6 to to PART dad-10733 1134 7 speak speak VERB dad-10733 1134 8 in in ADP dad-10733 1134 9 a a DET dad-10733 1134 10 more more ADV dad-10733 1134 11 natural natural ADJ dad-10733 1134 12 way way NOUN dad-10733 1134 13 , , PUNCT dad-10733 1134 14 similar similar ADJ dad-10733 1134 15 to to PART dad-10733 1134 16 spoken speak VERB dad-10733 1134 17 human human ADJ dad-10733 1134 18 - - PUNCT dad-10733 1134 19 human human ADJ dad-10733 1134 20 conversation conversation NOUN dad-10733 1134 21 , , PUNCT dad-10733 1134 22 emphasis emphasis NOUN dad-10733 1134 23 should should AUX dad-10733 1134 24 be be AUX dad-10733 1134 25 placed place VERB dad-10733 1134 26 on on ADP dad-10733 1134 27 collecting collect VERB dad-10733 1134 28 large large ADJ dad-10733 1134 29 - - PUNCT dad-10733 1134 30 scale scale NOUN dad-10733 1134 31 spoken spoken ADJ dad-10733 1134 32 dialogue dialogue NOUN dad-10733 1134 33 corpora corpora VERB dad-10733 1134 34 to to PART dad-10733 1134 35 train train VERB dad-10733 1134 36 the the DET dad-10733 1134 37 next next ADJ dad-10733 1134 38 generation generation NOUN dad-10733 1134 39 of of ADP dad-10733 1134 40 dialogue dialogue NOUN dad-10733 1134 41 systems system NOUN dad-10733 1134 42 . . PUNCT dad-10733 1135 1 there there PRON dad-10733 1135 2 is be VERB dad-10733 1135 3 also also ADV dad-10733 1135 4 a a DET dad-10733 1135 5 lack lack NOUN dad-10733 1135 6 of of ADP dad-10733 1135 7 large large ADJ dad-10733 1135 8 - - PUNCT dad-10733 1135 9 scale scale NOUN dad-10733 1135 10 multi multi ADJ dad-10733 1135 11 - - ADJ dad-10733 1135 12 modal modal ADJ dad-10733 1135 13 datasets dataset NOUN dad-10733 1135 14 , , PUNCT dad-10733 1135 15 which which PRON dad-10733 1135 16 may may AUX dad-10733 1135 17 be be AUX dad-10733 1135 18 crucial crucial ADJ dad-10733 1135 19 towards towards ADP dad-10733 1135 20 grounding ground VERB dad-10733 1135 21 the the DET dad-10733 1135 22 language language NOUN dad-10733 1135 23 learned learn VERB dad-10733 1135 24 by by ADP dad-10733 1135 25 our our PRON dad-10733 1135 26 dialogue dialogue NOUN dad-10733 1135 27 agents agent NOUN dad-10733 1135 28 in in ADP dad-10733 1135 29 human human ADJ dad-10733 1135 30 - - PUNCT dad-10733 1135 31 like like ADJ dad-10733 1135 32 experience experience NOUN dad-10733 1135 33 . . PUNCT dad-10733 1136 1 we we PRON dad-10733 1136 2 outline outline VERB dad-10733 1136 3 different different ADJ dad-10733 1136 4 approaches approach NOUN dad-10733 1136 5 for for ADP dad-10733 1136 6 overcoming overcome VERB dad-10733 1136 7 the the DET dad-10733 1136 8 dearth dearth NOUN dad-10733 1136 9 of of ADP dad-10733 1136 10 very very ADV dad-10733 1136 11 large large ADJ dad-10733 1136 12 dialogue dialogue NOUN dad-10733 1136 13 datasets dataset NOUN dad-10733 1136 14 . . PUNCT dad-10733 1137 1 transfer transfer NOUN dad-10733 1137 2 learning learning NOUN dad-10733 1137 3 appears appear VERB dad-10733 1137 4 to to PART dad-10733 1137 5 be be AUX dad-10733 1137 6 a a DET dad-10733 1137 7 particularly particularly ADV dad-10733 1137 8 promising promising ADJ dad-10733 1137 9 avenue avenue NOUN dad-10733 1137 10 for for ADP dad-10733 1137 11 future future ADJ dad-10733 1137 12 dialogue dialogue NOUN dad-10733 1137 13 research research NOUN dad-10733 1137 14 . . PUNCT dad-10733 1138 1 while while SCONJ dad-10733 1138 2 many many ADJ dad-10733 1138 3 individual individual ADJ dad-10733 1138 4 datasets dataset NOUN dad-10733 1138 5 presented present VERB dad-10733 1138 6 in in ADP dad-10733 1138 7 section section NOUN dad-10733 1138 8 4 4 NUM dad-10733 1138 9 are be AUX dad-10733 1138 10 only only ADV dad-10733 1138 11 thousands thousand NOUN dad-10733 1138 12 of of ADP dad-10733 1138 13 dialogues dialogue NOUN dad-10733 1138 14 , , PUNCT dad-10733 1138 15 summed sum VERB dad-10733 1138 16 together together ADV dad-10733 1138 17 they they PRON dad-10733 1138 18 represent represent VERB dad-10733 1138 19 a a DET dad-10733 1138 20 significant significant ADJ dad-10733 1138 21 resource resource NOUN dad-10733 1138 22 covering cover VERB dad-10733 1138 23 a a DET dad-10733 1138 24 wide wide ADJ dad-10733 1138 25 range range NOUN dad-10733 1138 26 of of ADP dad-10733 1138 27 topics topic NOUN dad-10733 1138 28 . . PUNCT dad-10733 1139 1 it it PRON dad-10733 1139 2 would would AUX dad-10733 1139 3 seem seem VERB dad-10733 1139 4 highly highly ADV dad-10733 1139 5 advantageous advantageous ADJ dad-10733 1139 6 if if SCONJ dad-10733 1139 7 methods method NOUN dad-10733 1139 8 are be AUX dad-10733 1139 9 developed develop VERB dad-10733 1139 10 that that PRON dad-10733 1139 11 enable enable ADJ dad-10733 1139 12 dialogue dialogue NOUN dad-10733 1139 13 systems system NOUN dad-10733 1139 14 to to PART dad-10733 1139 15 learn learn VERB dad-10733 1139 16 across across ADP dad-10733 1139 17 all all PRON dad-10733 1139 18 of of ADP dad-10733 1139 19 these these DET dad-10733 1139 20 resources resource NOUN dad-10733 1139 21 . . PUNCT dad-10733 1140 1 there there PRON dad-10733 1140 2 is be VERB dad-10733 1140 3 also also ADV dad-10733 1140 4 conceivable conceivable ADJ dad-10733 1140 5 transfer transfer NOUN dad-10733 1140 6 that that PRON dad-10733 1140 7 could could AUX dad-10733 1140 8 be be AUX dad-10733 1140 9 gained gain VERB dad-10733 1140 10 through through ADP dad-10733 1140 11 learning learn VERB dad-10733 1140 12 on on ADP dad-10733 1140 13 non non ADJ dad-10733 1140 14 - - ADJ dad-10733 1140 15 dialogue dialogue ADJ dad-10733 1140 16 text text NOUN dad-10733 1140 17 corpora corpora NOUN dad-10733 1140 18 , , PUNCT dad-10733 1140 19 such such ADJ dad-10733 1140 20 as as ADP dad-10733 1140 21 wikipedia wikipedia PROPN dad-10733 1140 22 . . PUNCT dad-10733 1141 1 we we PRON dad-10733 1141 2 further far ADV dad-10733 1141 3 discuss discuss VERB dad-10733 1141 4 research research NOUN dad-10733 1141 5 directions direction NOUN dad-10733 1141 6 for for ADP dad-10733 1141 7 building build VERB dad-10733 1141 8 data data NOUN dad-10733 1141 9 - - PUNCT dad-10733 1141 10 driven drive VERB dad-10733 1141 11 dialogue dialogue NOUN dad-10733 1141 12 systems system NOUN dad-10733 1141 13 , , PUNCT dad-10733 1141 14 including include VERB dad-10733 1141 15 incorporating incorporate VERB dad-10733 1141 16 external external ADJ dad-10733 1141 17 knowledge knowledge NOUN dad-10733 1141 18 and and CCONJ dad-10733 1141 19 personalizing personalize VERB dad-10733 1141 20 dialogue dialogue NOUN dad-10733 1141 21 agents agent NOUN dad-10733 1141 22 . . PUNCT dad-10733 1142 1 we we PRON dad-10733 1142 2 discuss discuss VERB dad-10733 1142 3 several several ADJ dad-10733 1142 4 challenges challenge NOUN dad-10733 1142 5 associated associate VERB dad-10733 1142 6 with with ADP dad-10733 1142 7 training train VERB dad-10733 1142 8 large large ADJ dad-10733 1142 9 - - PUNCT dad-10733 1142 10 scale scale NOUN dad-10733 1142 11 dialogue dialogue NOUN dad-10733 1142 12 models model NOUN dad-10733 1142 13 on on ADP dad-10733 1142 14 two two NUM dad-10733 1142 15 popular popular ADJ dad-10733 1142 16 dialogue dialogue NOUN dad-10733 1142 17 corpora corpus NOUN dad-10733 1142 18 : : PUNCT dad-10733 1142 19 the the DET dad-10733 1142 20 twitter twitter NOUN dad-10733 1142 21 corpus corpus NOUN dad-10733 1142 22 and and CCONJ dad-10733 1142 23 the the DET dad-10733 1142 24 ubuntu ubuntu ADJ dad-10733 1142 25 dialogue dialogue NOUN dad-10733 1142 26 corpus corpus PROPN dad-10733 1142 27 , , PUNCT dad-10733 1142 28 based base VERB dad-10733 1142 29 on on ADP dad-10733 1142 30 our our PRON dad-10733 1142 31 own own ADJ dad-10733 1142 32 experience experience NOUN dad-10733 1142 33 . . PUNCT dad-10733 1143 1 finally finally ADV dad-10733 1143 2 , , PUNCT dad-10733 1143 3 we we PRON dad-10733 1143 4 discuss discuss VERB dad-10733 1143 5 automatic automatic ADJ dad-10733 1143 6 evaluation evaluation NOUN dad-10733 1143 7 metrics metric NOUN dad-10733 1143 8 used use VERB dad-10733 1143 9 to to PART dad-10733 1143 10 train train VERB dad-10733 1143 11 data data NOUN dad-10733 1143 12 - - PUNCT dad-10733 1143 13 driven drive VERB dad-10733 1143 14 dialogue dialogue NOUN dad-10733 1143 15 systems system NOUN dad-10733 1143 16 on on ADP dad-10733 1143 17 the the DET dad-10733 1143 18 datasets dataset NOUN dad-10733 1143 19 previously previously ADV dad-10733 1143 20 mentioned mention VERB dad-10733 1143 21 . . PUNCT dad-10733 1144 1 having have VERB dad-10733 1144 2 an an DET dad-10733 1144 3 automatic automatic ADJ dad-10733 1144 4 metric metric NOUN dad-10733 1144 5 that that PRON dad-10733 1144 6 correlates correlate VERB dad-10733 1144 7 highly highly ADV dad-10733 1144 8 with with ADP dad-10733 1144 9 human human ADJ dad-10733 1144 10 judgment judgment NOUN dad-10733 1144 11 of of ADP dad-10733 1144 12 dialogue dialogue NOUN dad-10733 1144 13 quality quality NOUN dad-10733 1144 14 is be AUX dad-10733 1144 15 very very ADV dad-10733 1144 16 important important ADJ dad-10733 1144 17 . . PUNCT dad-10733 1145 1 even even ADV dad-10733 1145 2 with with ADP dad-10733 1145 3 significant significant ADJ dad-10733 1145 4 dialogue dialogue NOUN dad-10733 1145 5 data datum NOUN dad-10733 1145 6 , , PUNCT dad-10733 1145 7 poor poor ADJ dad-10733 1145 8 evaluation evaluation NOUN dad-10733 1145 9 metrics metric NOUN dad-10733 1145 10 mean mean VERB dad-10733 1145 11 that that SCONJ dad-10733 1145 12 it it PRON dad-10733 1145 13 is be AUX dad-10733 1145 14 difficult difficult ADJ dad-10733 1145 15 to to PART dad-10733 1145 16 compare compare VERB dad-10733 1145 17 the the DET dad-10733 1145 18 quality quality NOUN dad-10733 1145 19 of of ADP dad-10733 1145 20 dialogue dialogue NOUN dad-10733 1145 21 systems system NOUN dad-10733 1145 22 trained train VERB dad-10733 1145 23 on on ADP dad-10733 1145 24 these these DET dad-10733 1145 25 datasets dataset NOUN dad-10733 1145 26 , , PUNCT dad-10733 1145 27 39 39 NUM dad-10733 1145 28 serban serban PROPN dad-10733 1145 29 , , PUNCT dad-10733 1145 30 lowe lowe PROPN dad-10733 1145 31 , , PUNCT dad-10733 1145 32 henderson henderson PROPN dad-10733 1145 33 , , PUNCT dad-10733 1145 34 charlin charlin PROPN dad-10733 1145 35 and and CCONJ dad-10733 1145 36 pineau pineau PROPN dad-10733 1145 37 and and CCONJ dad-10733 1145 38 progress progress NOUN dad-10733 1145 39 as as SCONJ dad-10733 1145 40 a a DET dad-10733 1145 41 field field NOUN dad-10733 1145 42 becomes become VERB dad-10733 1145 43 difficult difficult ADJ dad-10733 1145 44 . . PUNCT dad-10733 1146 1 at at ADP dad-10733 1146 2 present present ADJ dad-10733 1146 3 , , PUNCT dad-10733 1146 4 there there PRON dad-10733 1146 5 exists exist VERB dad-10733 1146 6 no no DET dad-10733 1146 7 silver silver ADJ dad-10733 1146 8 bullet bullet NOUN dad-10733 1146 9 for for ADP dad-10733 1146 10 automatic automatic ADJ dad-10733 1146 11 evaluation evaluation NOUN dad-10733 1146 12 , , PUNCT dad-10733 1146 13 implying imply VERB dad-10733 1146 14 that that SCONJ dad-10733 1146 15 a a DET dad-10733 1146 16 set set NOUN dad-10733 1146 17 of of ADP dad-10733 1146 18 diverse diverse ADJ dad-10733 1146 19 metrics metric NOUN dad-10733 1146 20 be be AUX dad-10733 1146 21 used use VERB dad-10733 1146 22 together together ADV dad-10733 1146 23 to to PART dad-10733 1146 24 obtain obtain VERB dad-10733 1146 25 an an DET dad-10733 1146 26 accurate accurate ADJ dad-10733 1146 27 measure measure NOUN dad-10733 1146 28 of of ADP dad-10733 1146 29 performance performance NOUN dad-10733 1146 30 . . PUNCT dad-10733 1147 1 the the DET dad-10733 1147 2 final final ADJ dad-10733 1147 3 arbiter arbiter NOUN dad-10733 1147 4 is be AUX dad-10733 1147 5 , , PUNCT dad-10733 1147 6 of of ADP dad-10733 1147 7 course course NOUN dad-10733 1147 8 , , PUNCT dad-10733 1147 9 human human ADJ dad-10733 1147 10 judgments judgment NOUN dad-10733 1147 11 . . PUNCT dad-10733 1148 1 however however ADV dad-10733 1148 2 , , PUNCT dad-10733 1148 3 these these PRON dad-10733 1148 4 can can AUX dad-10733 1148 5 be be AUX dad-10733 1148 6 expensive expensive ADJ dad-10733 1148 7 to to PART dad-10733 1148 8 obtain obtain VERB dad-10733 1148 9 on on ADP dad-10733 1148 10 a a DET dad-10733 1148 11 large large ADJ dad-10733 1148 12 scale scale NOUN dad-10733 1148 13 , , PUNCT dad-10733 1148 14 in in ADP dad-10733 1148 15 particular particular ADJ dad-10733 1148 16 for for ADP dad-10733 1148 17 publicly publicly ADV dad-10733 1148 18 - - PUNCT dad-10733 1148 19 funded fund VERB dad-10733 1148 20 research research NOUN dad-10733 1148 21 laboratories laboratory NOUN dad-10733 1148 22 . . PUNCT dad-10733 1149 1 as as ADP dad-10733 1149 2 a a DET dad-10733 1149 3 dialogue dialogue NOUN dad-10733 1149 4 community community NOUN dad-10733 1149 5 , , PUNCT dad-10733 1149 6 we we PRON dad-10733 1149 7 should should AUX dad-10733 1149 8 strive strive VERB dad-10733 1149 9 towards towards ADP dad-10733 1149 10 releasing release VERB dad-10733 1149 11 more more ADV dad-10733 1149 12 large large ADJ dad-10733 1149 13 - - PUNCT dad-10733 1149 14 scale scale NOUN dad-10733 1149 15 dialogue dialogue NOUN dad-10733 1149 16 datasets dataset NOUN dad-10733 1149 17 and and CCONJ dad-10733 1149 18 producing produce VERB dad-10733 1149 19 standardized standardized ADJ dad-10733 1149 20 evaluation evaluation NOUN dad-10733 1149 21 metrics metric NOUN dad-10733 1149 22 , , PUNCT dad-10733 1149 23 to to PART dad-10733 1149 24 make make VERB dad-10733 1149 25 dialogue dialogue NOUN dad-10733 1149 26 research research NOUN dad-10733 1149 27 as as ADP dad-10733 1149 28 inclusive inclusive ADJ dad-10733 1149 29 as as ADP dad-10733 1149 30 possible possible ADJ dad-10733 1149 31 for for ADP dad-10733 1149 32 all all PRON dad-10733 1149 33 who who PRON dad-10733 1149 34 work work VERB dad-10733 1149 35 in in ADP dad-10733 1149 36 the the DET dad-10733 1149 37 field field NOUN dad-10733 1149 38 . . PUNCT dad-10733 1150 1 acknowledgements acknowledgement NOUN dad-10733 1150 2 the the DET dad-10733 1150 3 authors author NOUN dad-10733 1150 4 gratefully gratefully ADV dad-10733 1150 5 acknowledge acknowledge VERB dad-10733 1150 6 financial financial ADJ dad-10733 1150 7 support support NOUN dad-10733 1150 8 by by ADP dad-10733 1150 9 the the DET dad-10733 1150 10 samsung samsung PROPN dad-10733 1150 11 advanced advanced PROPN dad-10733 1150 12 institute institute PROPN dad-10733 1150 13 of of ADP dad-10733 1150 14 technology technology NOUN dad-10733 1150 15 ( ( PUNCT dad-10733 1150 16 sait sait PROPN dad-10733 1150 17 ) ) PUNCT dad-10733 1150 18 , , PUNCT dad-10733 1150 19 the the DET dad-10733 1150 20 natural natural ADJ dad-10733 1150 21 sciences science NOUN dad-10733 1150 22 and and CCONJ dad-10733 1150 23 engineering engineering NOUN dad-10733 1150 24 research research NOUN dad-10733 1150 25 council council PROPN dad-10733 1150 26 of of ADP dad-10733 1150 27 canada canada PROPN dad-10733 1150 28 ( ( PUNCT dad-10733 1150 29 nserc nserc PROPN dad-10733 1150 30 ) ) PUNCT dad-10733 1150 31 , , PUNCT dad-10733 1150 32 the the DET dad-10733 1150 33 canada canada PROPN dad-10733 1150 34 research research NOUN dad-10733 1150 35 chairs chair NOUN dad-10733 1150 36 , , PUNCT dad-10733 1150 37 the the DET dad-10733 1150 38 canadian canadian PROPN dad-10733 1150 39 institute institute NOUN dad-10733 1150 40 for for ADP dad-10733 1150 41 advanced advanced ADJ dad-10733 1150 42 research research NOUN dad-10733 1150 43 ( ( PUNCT dad-10733 1150 44 cifar cifar ADV dad-10733 1150 45 ) ) PUNCT dad-10733 1150 46 and and CCONJ dad-10733 1150 47 compute compute PROPN dad-10733 1150 48 canada canada PROPN dad-10733 1150 49 . . PUNCT dad-10733 1151 1 the the DET dad-10733 1151 2 second second ADJ dad-10733 1151 3 author author NOUN dad-10733 1151 4 is be AUX dad-10733 1151 5 funded fund VERB dad-10733 1151 6 by by ADP dad-10733 1151 7 a a DET dad-10733 1151 8 vanier vanier NOUN dad-10733 1151 9 graduate graduate NOUN dad-10733 1151 10 scholarship scholarship NOUN dad-10733 1151 11 . . PUNCT dad-10733 1152 1 early early ADJ dad-10733 1152 2 versions version NOUN dad-10733 1152 3 of of ADP dad-10733 1152 4 the the DET dad-10733 1152 5 manuscript manuscript NOUN dad-10733 1152 6 benefited benefit VERB dad-10733 1152 7 greatly greatly ADV dad-10733 1152 8 from from ADP dad-10733 1152 9 the the DET dad-10733 1152 10 proofreading proofreading NOUN dad-10733 1152 11 of of ADP dad-10733 1152 12 melanie melanie PROPN dad-10733 1152 13 lyman lyman PROPN dad-10733 1152 14 - - PUNCT dad-10733 1152 15 abramovitch abramovitch NOUN dad-10733 1152 16 , , PUNCT dad-10733 1152 17 and and CCONJ dad-10733 1152 18 later later ADJ dad-10733 1152 19 versions version NOUN dad-10733 1152 20 were be AUX dad-10733 1152 21 extensively extensively ADV dad-10733 1152 22 revised revise VERB dad-10733 1152 23 by by ADP dad-10733 1152 24 genevieve genevieve NOUN dad-10733 1152 25 fried fry VERB dad-10733 1152 26 and and CCONJ dad-10733 1152 27 nicolas nicolas PROPN dad-10733 1152 28 angelard angelard PROPN dad-10733 1152 29 - - PUNCT dad-10733 1152 30 gontier gontier NOUN dad-10733 1152 31 . . PUNCT dad-10733 1153 1 the the DET dad-10733 1153 2 authors author NOUN dad-10733 1153 3 also also ADV dad-10733 1153 4 thank thank VERB dad-10733 1153 5 nissan nissan PROPN dad-10733 1153 6 pow pow PROPN dad-10733 1153 7 , , PUNCT dad-10733 1153 8 michael michael PROPN dad-10733 1153 9 noseworthy noseworthy PROPN dad-10733 1153 10 , , PUNCT dad-10733 1153 11 chia chia PROPN dad-10733 1153 12 - - PUNCT dad-10733 1153 13 wei wei PROPN dad-10733 1153 14 liu liu PROPN dad-10733 1153 15 , , PUNCT dad-10733 1153 16 gabriel gabriel PROPN dad-10733 1153 17 forgues forgues PROPN dad-10733 1153 18 , , PUNCT dad-10733 1153 19 alessandro alessandro PROPN dad-10733 1153 20 sordoni sordoni PROPN dad-10733 1153 21 , , PUNCT dad-10733 1153 22 yoshua yoshua PROPN dad-10733 1153 23 bengio bengio PROPN dad-10733 1153 24 and and CCONJ dad-10733 1153 25 aaron aaron PROPN dad-10733 1153 26 courville courville NOUN dad-10733 1153 27 for for ADP dad-10733 1153 28 helpful helpful ADJ dad-10733 1153 29 discussions discussion NOUN dad-10733 1153 30 . . PUNCT dad-10733 1154 1 references reference NOUN dad-10733 1154 2 c. c. PROPN dad-10733 1154 3 khatri khatri PROPN dad-10733 1154 4 a. a. PROPN dad-10733 1154 5 venkatesh venkatesh PROPN dad-10733 1154 6 r. r. PROPN dad-10733 1154 7 gabriel gabriel PROPN dad-10733 1154 8 q. q. PROPN dad-10733 1154 9 li li PROPN dad-10733 1154 10 j. j. PROPN dad-10733 1154 11 nunn nunn PROPN dad-10733 1154 12 b. b. PROPN dad-10733 1154 13 hedayatnia hedayatnia PROPN dad-10733 1154 14 m. m. NOUN dad-10733 1154 15 heng heng PROPN dad-10733 1154 16 a. a. PROPN dad-10733 1154 17 nagar nagar PROPN dad-10733 1154 18 e. e. PROPN dad-10733 1154 19 king king PROPN dad-10733 1154 20 k. k. PROPN dad-10733 1154 21 bland bland PROPN dad-10733 1154 22 a. a. NOUN dad-10733 1154 23 wartick wartick PROPN dad-10733 1154 24 y. y. PROPN dad-10733 1154 25 pan pan PROPN dad-10733 1154 26 h. h. PROPN dad-10733 1154 27 song song PROPN dad-10733 1154 28 s. s. PROPN dad-10733 1154 29 jayadevan jayadevan PROPN dad-10733 1154 30 g. g. PROPN dad-10733 1154 31 hwang hwang PROPN dad-10733 1154 32 a. a. PROPN dad-10733 1154 33 pettigrue pettigrue PROPN dad-10733 1154 34 a. a. PROPN dad-10733 1154 35 ram ram PROPN dad-10733 1154 36 , , PUNCT dad-10733 1154 37 r. r. PROPN dad-10733 1154 38 prasad prasad PROPN dad-10733 1154 39 . . PUNCT dad-10733 1155 1 conversational conversational ADJ dad-10733 1155 2 ai ai NOUN dad-10733 1155 3 : : PUNCT dad-10733 1155 4 the the DET dad-10733 1155 5 science science NOUN dad-10733 1155 6 behind behind ADP dad-10733 1155 7 the the DET dad-10733 1155 8 alexa alexa NOUN dad-10733 1155 9 prize prize NOUN dad-10733 1155 10 . . PUNCT dad-10733 1156 1 in in ADP dad-10733 1156 2 alexa alexa PROPN dad-10733 1156 3 prize prize PROPN dad-10733 1156 4 proceedings proceeding NOUN dad-10733 1156 5 , , PUNCT dad-10733 1156 6 2017 2017 NUM dad-10733 1156 7 . . PUNCT dad-10733 1157 1 b. b. PROPN dad-10733 1157 2 aarts aarts PROPN dad-10733 1157 3 and and CCONJ dad-10733 1157 4 s. s. PROPN dad-10733 1157 5 a. a. PROPN dad-10733 1157 6 wallis wallis PROPN dad-10733 1157 7 . . PUNCT dad-10733 1158 1 the the DET dad-10733 1158 2 diachronic diachronic ADJ dad-10733 1158 3 corpus corpus NOUN dad-10733 1158 4 of of ADP dad-10733 1158 5 present present ADJ dad-10733 1158 6 - - PUNCT dad-10733 1158 7 day day NOUN dad-10733 1158 8 spoken spoken ADJ dad-10733 1158 9 english english PROPN dad-10733 1158 10 ( ( PUNCT dad-10733 1158 11 dcpse dcpse NOUN dad-10733 1158 12 ) ) PUNCT dad-10733 1158 13 , , PUNCT dad-10733 1158 14 2006 2006 NUM dad-10733 1158 15 . . PUNCT dad-10733 1159 1 r. r. PROPN dad-10733 1159 2 abbott abbott PROPN dad-10733 1159 3 , , PUNCT dad-10733 1159 4 b. b. PROPN dad-10733 1159 5 ecker ecker PROPN dad-10733 1159 6 , , PUNCT dad-10733 1159 7 p. p. PROPN dad-10733 1159 8 anand anand PROPN dad-10733 1159 9 , , PUNCT dad-10733 1159 10 and and CCONJ dad-10733 1159 11 m. m. PROPN dad-10733 1159 12 walker walker PROPN dad-10733 1159 13 . . PUNCT dad-10733 1159 14 internet internet NOUN dad-10733 1159 15 argument argument NOUN dad-10733 1159 16 corpus corpus NOUN dad-10733 1159 17 2.0 2.0 NUM dad-10733 1159 18 : : PUNCT dad-10733 1159 19 an an DET dad-10733 1159 20 sql sql NOUN dad-10733 1159 21 schema schema NOUN dad-10733 1159 22 for for ADP dad-10733 1159 23 dialogic dialogic ADJ dad-10733 1159 24 social social ADJ dad-10733 1159 25 media medium NOUN dad-10733 1159 26 and and CCONJ dad-10733 1159 27 the the DET dad-10733 1159 28 corpora corpora NOUN dad-10733 1159 29 to to PART dad-10733 1159 30 go go VERB dad-10733 1159 31 with with ADP dad-10733 1159 32 it it PRON dad-10733 1159 33 . . PUNCT dad-10733 1160 1 in in ADP dad-10733 1160 2 language language NOUN dad-10733 1160 3 resources resource NOUN dad-10733 1160 4 and and CCONJ dad-10733 1160 5 evaluation evaluation NOUN dad-10733 1160 6 conference conference NOUN dad-10733 1160 7 , , PUNCT dad-10733 1160 8 lrec2016 lrec2016 PROPN dad-10733 1160 9 , , PUNCT dad-10733 1160 10 2016 2016 NUM dad-10733 1160 11 . . PUNCT dad-10733 1161 1 s. s. PROPN dad-10733 1161 2 afantenos afantenos PROPN dad-10733 1161 3 , , PUNCT dad-10733 1161 4 n. n. PROPN dad-10733 1161 5 asher asher PROPN dad-10733 1161 6 , , PUNCT dad-10733 1161 7 f. f. PROPN dad-10733 1161 8 benamara benamara PROPN dad-10733 1161 9 , , PUNCT dad-10733 1161 10 a. a. PROPN dad-10733 1161 11 cadilhac cadilhac PROPN dad-10733 1161 12 , , PUNCT dad-10733 1161 13 cédric cédric PROPN dad-10733 1161 14 dégremont dégremont PROPN dad-10733 1161 15 , , PUNCT dad-10733 1161 16 p. p. NOUN dad-10733 1161 17 denis denis PROPN dad-10733 1161 18 , , PUNCT dad-10733 1161 19 m. m. NOUN dad-10733 1161 20 guhe guhe PROPN dad-10733 1161 21 , , PUNCT dad-10733 1161 22 s. s. PROPN dad-10733 1161 23 keizer keizer PROPN dad-10733 1161 24 , , PUNCT dad-10733 1161 25 a. a. NOUN dad-10733 1161 26 lascarides lascarides PROPN dad-10733 1161 27 , , PUNCT dad-10733 1161 28 o. o. NOUN dad-10733 1161 29 lemon lemon PROPN dad-10733 1161 30 , , PUNCT dad-10733 1161 31 et et PROPN dad-10733 1161 32 al al PROPN dad-10733 1161 33 . . PUNCT dad-10733 1162 1 developing develop VERB dad-10733 1162 2 a a DET dad-10733 1162 3 corpus corpus NOUN dad-10733 1162 4 of of ADP dad-10733 1162 5 strategic strategic ADJ dad-10733 1162 6 conversation conversation NOUN dad-10733 1162 7 in in ADP dad-10733 1162 8 the the DET dad-10733 1162 9 settlers settler NOUN dad-10733 1162 10 of of ADP dad-10733 1162 11 catan catan PROPN dad-10733 1162 12 . . PUNCT dad-10733 1163 1 in in ADP dad-10733 1163 2 seinedial seinedial ADJ dad-10733 1163 3 2012 2012 NUM dad-10733 1163 4 - - PUNCT dad-10733 1163 5 the the DET dad-10733 1163 6 16th 16th ADJ dad-10733 1163 7 workshop workshop NOUN dad-10733 1163 8 on on ADP dad-10733 1163 9 the the DET dad-10733 1163 10 semantics semantic NOUN dad-10733 1163 11 and and CCONJ dad-10733 1163 12 pragmatics pragmatic NOUN dad-10733 1163 13 of of ADP dad-10733 1163 14 dialogue dialogue NOUN dad-10733 1163 15 , , PUNCT dad-10733 1163 16 2012 2012 NUM dad-10733 1163 17 . . PUNCT dad-10733 1164 1 h. h. PROPN dad-10733 1164 2 ai ai PROPN dad-10733 1164 3 , , PUNCT dad-10733 1164 4 a. a. NOUN dad-10733 1164 5 raux raux PROPN dad-10733 1164 6 , , PUNCT dad-10733 1164 7 d. d. PROPN dad-10733 1164 8 bohus bohus PROPN dad-10733 1164 9 , , PUNCT dad-10733 1164 10 m. m. NOUN dad-10733 1164 11 eskenazi eskenazi NOUN dad-10733 1164 12 , , PUNCT dad-10733 1164 13 and and CCONJ dad-10733 1164 14 d. d. PROPN dad-10733 1164 15 j. j. PROPN dad-10733 1164 16 litman litman PROPN dad-10733 1164 17 . . PUNCT dad-10733 1165 1 comparing compare VERB dad-10733 1165 2 spoken spoken ADJ dad-10733 1165 3 dialog dialog NOUN dad-10733 1165 4 corpora corpora NOUN dad-10733 1165 5 collected collect VERB dad-10733 1165 6 with with ADP dad-10733 1165 7 recruited recruit VERB dad-10733 1165 8 subjects subject NOUN dad-10733 1165 9 versus versus ADP dad-10733 1165 10 real real ADJ dad-10733 1165 11 users user NOUN dad-10733 1165 12 . . PUNCT dad-10733 1166 1 in in ADP dad-10733 1166 2 special special ADJ dad-10733 1166 3 interest interest NOUN dad-10733 1166 4 group group NOUN dad-10733 1166 5 on on ADP dad-10733 1166 6 discourse discourse NOUN dad-10733 1166 7 and and CCONJ dad-10733 1166 8 dialogue dialogue NOUN dad-10733 1166 9 ( ( PUNCT dad-10733 1166 10 sigdial sigdial ADJ dad-10733 1166 11 ) ) PUNCT dad-10733 1166 12 , , PUNCT dad-10733 1166 13 2007 2007 NUM dad-10733 1166 14 . . PUNCT dad-10733 1167 1 r. r. PROPN dad-10733 1167 2 akker akker PROPN dad-10733 1167 3 and and CCONJ dad-10733 1167 4 d. d. PROPN dad-10733 1167 5 traum traum PROPN dad-10733 1167 6 . . PUNCT dad-10733 1168 1 a a DET dad-10733 1168 2 comparison comparison NOUN dad-10733 1168 3 of of ADP dad-10733 1168 4 addressee addressee ADJ dad-10733 1168 5 detection detection NOUN dad-10733 1168 6 methods method NOUN dad-10733 1168 7 for for ADP dad-10733 1168 8 multiparty multiparty ADJ dad-10733 1168 9 conversations conversation NOUN dad-10733 1168 10 . . PUNCT dad-10733 1169 1 in in ADP dad-10733 1169 2 workshop workshop NOUN dad-10733 1169 3 on on ADP dad-10733 1169 4 the the DET dad-10733 1169 5 semantics semantic NOUN dad-10733 1169 6 and and CCONJ dad-10733 1169 7 pragmatics pragmatic NOUN dad-10733 1169 8 of of ADP dad-10733 1169 9 dialogue dialogue NOUN dad-10733 1169 10 , , PUNCT dad-10733 1169 11 2009 2009 NUM dad-10733 1169 12 . . PUNCT dad-10733 1170 1 y. y. PROPN dad-10733 1170 2 al al PROPN dad-10733 1170 3 - - PUNCT dad-10733 1170 4 onaizan onaizan PROPN dad-10733 1170 5 , , PUNCT dad-10733 1170 6 u. u. PROPN dad-10733 1170 7 germann germann PROPN dad-10733 1170 8 , , PUNCT dad-10733 1170 9 u. u. PROPN dad-10733 1170 10 hermjakob hermjakob PROPN dad-10733 1170 11 , , PUNCT dad-10733 1170 12 k. k. PROPN dad-10733 1170 13 knight knight PROPN dad-10733 1170 14 , , PUNCT dad-10733 1170 15 p. p. PROPN dad-10733 1170 16 koehn koehn PROPN dad-10733 1170 17 , , PUNCT dad-10733 1170 18 d. d. PROPN dad-10733 1170 19 m. m. NOUN dad-10733 1170 20 , , PUNCT dad-10733 1170 21 and and CCONJ dad-10733 1170 22 k. k. PROPN dad-10733 1170 23 yamada yamada PROPN dad-10733 1170 24 . . PUNCT dad-10733 1171 1 translating translate VERB dad-10733 1171 2 with with ADP dad-10733 1171 3 scarce scarce ADJ dad-10733 1171 4 resources resource NOUN dad-10733 1171 5 . . PUNCT dad-10733 1172 1 in in ADP dad-10733 1172 2 aaai aaai PROPN dad-10733 1172 3 , , PUNCT dad-10733 1172 4 2000 2000 NUM dad-10733 1172 5 . . PUNCT dad-10733 1173 1 j. j. PROPN dad-10733 1173 2 alexandersson alexandersson PROPN dad-10733 1173 3 , , PUNCT dad-10733 1173 4 r. r. PROPN dad-10733 1173 5 engel engel PROPN dad-10733 1173 6 , , PUNCT dad-10733 1173 7 m. m. PROPN dad-10733 1173 8 kipp kipp PROPN dad-10733 1173 9 , , PUNCT dad-10733 1173 10 s. s. PROPN dad-10733 1173 11 koch koch PROPN dad-10733 1173 12 , , PUNCT dad-10733 1173 13 u. u. PROPN dad-10733 1173 14 küssner küssner PROPN dad-10733 1173 15 , , PUNCT dad-10733 1173 16 n. n. NOUN dad-10733 1173 17 reithinger reithinger NOUN dad-10733 1173 18 , , PUNCT dad-10733 1173 19 and and CCONJ dad-10733 1173 20 m. m. NOUN dad-10733 1173 21 stede stede NOUN dad-10733 1173 22 . . PUNCT dad-10733 1174 1 modeling model VERB dad-10733 1174 2 negotiation negotiation NOUN dad-10733 1174 3 dialogs dialog NOUN dad-10733 1174 4 . . PUNCT dad-10733 1175 1 in in ADP dad-10733 1175 2 verbmobil verbmobil NOUN dad-10733 1175 3 : : PUNCT dad-10733 1175 4 foundations foundation NOUN dad-10733 1175 5 of of ADP dad-10733 1175 6 speech speech NOUN dad-10733 1175 7 - - PUNCT dad-10733 1175 8 to to ADP dad-10733 1175 9 - - PUNCT dad-10733 1175 10 speech speech NOUN dad-10733 1175 11 translation translation NOUN dad-10733 1175 12 , , PUNCT dad-10733 1175 13 pages page NOUN dad-10733 1175 14 441–451 441–451 NUM dad-10733 1175 15 . . PUNCT dad-10733 1175 16 springer springer NOUN dad-10733 1175 17 , , PUNCT dad-10733 1175 18 2000 2000 NUM dad-10733 1175 19 . . PUNCT dad-10733 1176 1 d. d. PROPN dad-10733 1176 2 ameixa ameixa PROPN dad-10733 1176 3 and and CCONJ dad-10733 1176 4 l. l. PROPN dad-10733 1176 5 coheur coheur PROPN dad-10733 1176 6 . . PUNCT dad-10733 1177 1 from from ADP dad-10733 1177 2 subtitles subtitle NOUN dad-10733 1177 3 to to ADP dad-10733 1177 4 human human ADJ dad-10733 1177 5 interactions interaction NOUN dad-10733 1177 6 : : PUNCT dad-10733 1177 7 introducing introduce VERB dad-10733 1177 8 the the DET dad-10733 1177 9 subtle subtle ADJ dad-10733 1177 10 corpus corpus NOUN dad-10733 1177 11 . . PUNCT dad-10733 1178 1 technical technical ADJ dad-10733 1178 2 report report PROPN dad-10733 1178 3 , , PUNCT dad-10733 1178 4 tech tech PROPN dad-10733 1178 5 . . PUNCT dad-10733 1179 1 rep rep PROPN dad-10733 1179 2 . . PROPN dad-10733 1179 3 , , PUNCT dad-10733 1179 4 2013 2013 NUM dad-10733 1179 5 . . PUNCT dad-10733 1180 1 a. a. PROPN dad-10733 1180 2 h. h. PROPN dad-10733 1180 3 anderson anderson PROPN dad-10733 1180 4 , , PUNCT dad-10733 1180 5 m. m. PROPN dad-10733 1180 6 bader bader PROPN dad-10733 1180 7 , , PUNCT dad-10733 1180 8 e. e. PROPN dad-10733 1180 9 g. g. PROPN dad-10733 1180 10 bard bard PROPN dad-10733 1180 11 , , PUNCT dad-10733 1180 12 e. e. PROPN dad-10733 1180 13 boyle boyle PROPN dad-10733 1180 14 , , PUNCT dad-10733 1180 15 g. g. PROPN dad-10733 1180 16 doherty doherty PROPN dad-10733 1180 17 , , PUNCT dad-10733 1180 18 s. s. PROPN dad-10733 1180 19 garrod garrod PROPN dad-10733 1180 20 , , PUNCT dad-10733 1180 21 s. s. PROPN dad-10733 1180 22 isard isard PROPN dad-10733 1180 23 , , PUNCT dad-10733 1180 24 j. j. PROPN dad-10733 1180 25 kowtko kowtko PROPN dad-10733 1180 26 , , PUNCT dad-10733 1180 27 j. j. PROPN dad-10733 1180 28 mcallister mcallister PROPN dad-10733 1180 29 , , PUNCT dad-10733 1180 30 j. j. PROPN dad-10733 1180 31 miller miller PROPN dad-10733 1180 32 , , PUNCT dad-10733 1180 33 et et PROPN dad-10733 1180 34 al al PROPN dad-10733 1180 35 . . PUNCT dad-10733 1181 1 the the DET dad-10733 1181 2 hcrc hcrc PROPN dad-10733 1181 3 map map PROPN dad-10733 1181 4 task task PROPN dad-10733 1181 5 corpus corpus PROPN dad-10733 1181 6 . . PUNCT dad-10733 1182 1 language language NOUN dad-10733 1182 2 and and CCONJ dad-10733 1182 3 speech speech NOUN dad-10733 1182 4 , , PUNCT dad-10733 1182 5 34(4):351–366 34(4):351–366 PROPN dad-10733 1182 6 , , PUNCT dad-10733 1182 7 1991 1991 NUM dad-10733 1182 8 . . PUNCT dad-10733 1183 1 j. j. PROPN dad-10733 1183 2 andreas andreas PROPN dad-10733 1183 3 , , PUNCT dad-10733 1183 4 s. s. PROPN dad-10733 1183 5 rosenthal rosenthal PROPN dad-10733 1183 6 , , PUNCT dad-10733 1183 7 and and CCONJ dad-10733 1183 8 k. k. PROPN dad-10733 1183 9 mckeown mckeown PROPN dad-10733 1183 10 . . PUNCT dad-10733 1184 1 annotating annotate VERB dad-10733 1184 2 agreement agreement NOUN dad-10733 1184 3 and and CCONJ dad-10733 1184 4 disagreement disagreement NOUN dad-10733 1184 5 in in ADP dad-10733 1184 6 threaded threaded ADJ dad-10733 1184 7 discussion discussion NOUN dad-10733 1184 8 . . PUNCT dad-10733 1185 1 in in ADP dad-10733 1185 2 lrec lrec PROPN dad-10733 1185 3 , , PUNCT dad-10733 1185 4 pages page NOUN dad-10733 1185 5 818–822 818–822 NUM dad-10733 1185 6 , , PUNCT dad-10733 1185 7 2012 2012 NUM dad-10733 1185 8 . . PUNCT dad-10733 1186 1 l. l. PROPN dad-10733 1186 2 e. e. PROPN dad-10733 1186 3 asri asri PROPN dad-10733 1186 4 , , PUNCT dad-10733 1186 5 j. j. PROPN dad-10733 1186 6 he he PROPN dad-10733 1186 7 , , PUNCT dad-10733 1186 8 and and CCONJ dad-10733 1186 9 k. k. PROPN dad-10733 1186 10 suleman suleman PROPN dad-10733 1186 11 . . PUNCT dad-10733 1187 1 a a DET dad-10733 1187 2 sequence sequence NOUN dad-10733 1187 3 - - PUNCT dad-10733 1187 4 to to ADP dad-10733 1187 5 - - PUNCT dad-10733 1187 6 sequence sequence NOUN dad-10733 1187 7 model model NOUN dad-10733 1187 8 for for ADP dad-10733 1187 9 user user NOUN dad-10733 1187 10 simulation simulation NOUN dad-10733 1187 11 in in ADP dad-10733 1187 12 spoken spoken ADJ dad-10733 1187 13 dialogue dialogue NOUN dad-10733 1187 14 systems system NOUN dad-10733 1187 15 . . PUNCT dad-10733 1188 1 arxiv arxiv PROPN dad-10733 1188 2 preprint preprint VERB dad-10733 1188 3 arxiv:1607.00070 arxiv:1607.00070 ADV dad-10733 1188 4 , , PUNCT dad-10733 1188 5 2016 2016 NUM dad-10733 1188 6 . . PUNCT dad-10733 1189 1 a. a. PROPN dad-10733 1189 2 j. j. PROPN dad-10733 1189 3 aubrey aubrey PROPN dad-10733 1189 4 , , PUNCT dad-10733 1189 5 d. d. PROPN dad-10733 1189 6 marshall marshall PROPN dad-10733 1189 7 , , PUNCT dad-10733 1189 8 p. p. PROPN dad-10733 1189 9 l. l. PROPN dad-10733 1189 10 rosin rosin PROPN dad-10733 1189 11 , , PUNCT dad-10733 1189 12 j. j. PROPN dad-10733 1189 13 vandeventer vandeventer PROPN dad-10733 1189 14 , , PUNCT dad-10733 1189 15 d. d. PROPN dad-10733 1189 16 w. w. PROPN dad-10733 1189 17 cunningham cunningham PROPN dad-10733 1189 18 , , PUNCT dad-10733 1189 19 and and CCONJ dad-10733 1189 20 c. c. PROPN dad-10733 1189 21 wallraven wallraven PROPN dad-10733 1189 22 . . PUNCT dad-10733 1190 1 cardiff cardiff ADJ dad-10733 1190 2 conversation conversation NOUN dad-10733 1190 3 database database NOUN dad-10733 1190 4 ( ( PUNCT dad-10733 1190 5 ccdb ccdb NOUN dad-10733 1190 6 ): ): PUNCT dad-10733 1190 7 a a DET dad-10733 1190 8 database database NOUN dad-10733 1190 9 of of ADP dad-10733 1190 10 natural natural ADJ dad-10733 1190 11 dyadic dyadic ADJ dad-10733 1190 12 conversations conversation NOUN dad-10733 1190 13 . . PUNCT dad-10733 1191 1 in in ADP dad-10733 1191 2 computer computer NOUN dad-10733 1191 3 vision vision NOUN dad-10733 1191 4 and and CCONJ dad-10733 1191 5 pattern pattern NOUN dad-10733 1191 6 recognition recognition NOUN dad-10733 1191 7 workshops workshop NOUN dad-10733 1191 8 ( ( PUNCT dad-10733 1191 9 cvprw cvprw ADJ dad-10733 1191 10 ) ) PUNCT dad-10733 1191 11 , , PUNCT dad-10733 1191 12 ieee ieee NOUN dad-10733 1191 13 conference conference NOUN dad-10733 1191 14 on on ADP dad-10733 1191 15 , , PUNCT dad-10733 1191 16 pages page NOUN dad-10733 1191 17 277–282 277–282 NUM dad-10733 1191 18 , , PUNCT dad-10733 1191 19 2013 2013 NUM dad-10733 1191 20 . . PUNCT dad-10733 1192 1 h. h. PROPN dad-10733 1192 2 aust aust PROPN dad-10733 1192 3 , , PUNCT dad-10733 1192 4 m. m. NOUN dad-10733 1192 5 oerder oerder PROPN dad-10733 1192 6 , , PUNCT dad-10733 1192 7 f. f. PROPN dad-10733 1192 8 seide seide PROPN dad-10733 1192 9 , , PUNCT dad-10733 1192 10 and and CCONJ dad-10733 1192 11 v. v. ADP dad-10733 1192 12 steinbiss steinbiss PROPN dad-10733 1192 13 . . PUNCT dad-10733 1193 1 the the DET dad-10733 1193 2 philips philips PROPN dad-10733 1193 3 automatic automatic ADJ dad-10733 1193 4 train train NOUN dad-10733 1193 5 timetable timetable NOUN dad-10733 1193 6 information information NOUN dad-10733 1193 7 system system NOUN dad-10733 1193 8 . . PUNCT dad-10733 1194 1 speech speech NOUN dad-10733 1194 2 communication communication NOUN dad-10733 1194 3 , , PUNCT dad-10733 1194 4 17(3):249–262 17(3):249–262 NUM dad-10733 1194 5 , , PUNCT dad-10733 1194 6 1995 1995 NUM dad-10733 1194 7 . . PUNCT dad-10733 1195 1 40 40 NUM dad-10733 1195 2 a a DET dad-10733 1195 3 survey survey NOUN dad-10733 1195 4 of of ADP dad-10733 1195 5 available available ADJ dad-10733 1195 6 corpora corpora PROPN dad-10733 1195 7 for for ADP dad-10733 1195 8 building build VERB dad-10733 1195 9 data data NOUN dad-10733 1195 10 - - PUNCT dad-10733 1195 11 driven drive VERB dad-10733 1195 12 dialogue dialogue NOUN dad-10733 1195 13 systems systems PROPN dad-10733 1195 14 r. r. PROPN dad-10733 1195 15 e. e. PROPN dad-10733 1195 16 banchs banchs PROPN dad-10733 1195 17 . . PUNCT dad-10733 1196 1 movie movie NOUN dad-10733 1196 2 - - PUNCT dad-10733 1196 3 dic dic NOUN dad-10733 1196 4 : : PUNCT dad-10733 1196 5 a a DET dad-10733 1196 6 movie movie NOUN dad-10733 1196 7 dialogue dialogue NOUN dad-10733 1196 8 corpus corpus NOUN dad-10733 1196 9 for for ADP dad-10733 1196 10 research research NOUN dad-10733 1196 11 and and CCONJ dad-10733 1196 12 development development NOUN dad-10733 1196 13 . . PUNCT dad-10733 1197 1 in in ADP dad-10733 1197 2 association association NOUN dad-10733 1197 3 for for ADP dad-10733 1197 4 computational computational ADJ dad-10733 1197 5 linguistics linguistic NOUN dad-10733 1197 6 : : PUNCT dad-10733 1197 7 short short ADJ dad-10733 1197 8 papers paper NOUN dad-10733 1197 9 , , PUNCT dad-10733 1197 10 2012 2012 NUM dad-10733 1197 11 . . PUNCT dad-10733 1198 1 r. r. PROPN dad-10733 1198 2 e. e. PROPN dad-10733 1198 3 banchs banchs PROPN dad-10733 1198 4 and and CCONJ dad-10733 1198 5 h. h. PROPN dad-10733 1198 6 li li PROPN dad-10733 1198 7 . . PROPN dad-10733 1198 8 iris iris PROPN dad-10733 1198 9 : : PUNCT dad-10733 1198 10 a a DET dad-10733 1198 11 chat chat NOUN dad-10733 1198 12 - - PUNCT dad-10733 1198 13 oriented orient VERB dad-10733 1198 14 dialogue dialogue NOUN dad-10733 1198 15 system system NOUN dad-10733 1198 16 based base VERB dad-10733 1198 17 on on ADP dad-10733 1198 18 the the DET dad-10733 1198 19 vector vector NOUN dad-10733 1198 20 space space NOUN dad-10733 1198 21 model model NOUN dad-10733 1198 22 . . PUNCT dad-10733 1199 1 in in ADP dad-10733 1199 2 association association NOUN dad-10733 1199 3 for for ADP dad-10733 1199 4 computational computational ADJ dad-10733 1199 5 linguistics linguistic NOUN dad-10733 1199 6 , , PUNCT dad-10733 1199 7 system system NOUN dad-10733 1199 8 demonstrations demonstration NOUN dad-10733 1199 9 , , PUNCT dad-10733 1199 10 2012 2012 NUM dad-10733 1199 11 . . PUNCT dad-10733 1200 1 s. s. PROPN dad-10733 1200 2 banerjee banerjee PROPN dad-10733 1200 3 and and CCONJ dad-10733 1200 4 a. a. PROPN dad-10733 1200 5 lavie lavie PROPN dad-10733 1200 6 . . PUNCT dad-10733 1201 1 meteor meteor NOUN dad-10733 1201 2 : : PUNCT dad-10733 1201 3 an an DET dad-10733 1201 4 automatic automatic ADJ dad-10733 1201 5 metric metric NOUN dad-10733 1201 6 for for ADP dad-10733 1201 7 mt mt PROPN dad-10733 1201 8 evaluation evaluation NOUN dad-10733 1201 9 with with ADP dad-10733 1201 10 improved improved ADJ dad-10733 1201 11 correlation correlation NOUN dad-10733 1201 12 with with ADP dad-10733 1201 13 human human ADJ dad-10733 1201 14 judgments judgment NOUN dad-10733 1201 15 . . PUNCT dad-10733 1202 1 in in ADP dad-10733 1202 2 association association NOUN dad-10733 1202 3 for for ADP dad-10733 1202 4 computational computational ADJ dad-10733 1202 5 linguistics linguistic NOUN dad-10733 1202 6 , , PUNCT dad-10733 1202 7 workshop workshop NOUN dad-10733 1202 8 on on ADP dad-10733 1202 9 intrinsic intrinsic ADJ dad-10733 1202 10 and and CCONJ dad-10733 1202 11 extrinsic extrinsic ADJ dad-10733 1202 12 evaluation evaluation NOUN dad-10733 1202 13 measures measure NOUN dad-10733 1202 14 for for ADP dad-10733 1202 15 machine machine NOUN dad-10733 1202 16 translation translation NOUN dad-10733 1202 17 and/or and/or CCONJ dad-10733 1202 18 summarization summarization NOUN dad-10733 1202 19 , , PUNCT dad-10733 1202 20 2005 2005 NUM dad-10733 1202 21 . . PUNCT dad-10733 1203 1 m. m. PROPN dad-10733 1203 2 barlow barlow PROPN dad-10733 1203 3 . . PUNCT dad-10733 1204 1 corpus corpus PROPN dad-10733 1204 2 of of ADP dad-10733 1204 3 spoken spoken ADJ dad-10733 1204 4 , , PUNCT dad-10733 1204 5 professional professional ADJ dad-10733 1204 6 american american PROPN dad-10733 1204 7 - - PUNCT dad-10733 1204 8 english english PROPN dad-10733 1204 9 , , PUNCT dad-10733 1204 10 2000 2000 NUM dad-10733 1204 11 . . PUNCT dad-10733 1205 1 j. j. PROPN dad-10733 1205 2 beare beare PROPN dad-10733 1205 3 and and CCONJ dad-10733 1205 4 b. b. PROPN dad-10733 1205 5 scott scott PROPN dad-10733 1205 6 . . PUNCT dad-10733 1206 1 the the DET dad-10733 1206 2 spoken spoken ADJ dad-10733 1206 3 corpus corpus NOUN dad-10733 1206 4 of of ADP dad-10733 1206 5 the the DET dad-10733 1206 6 survey survey NOUN dad-10733 1206 7 of of ADP dad-10733 1206 8 english english ADJ dad-10733 1206 9 dialects dialect NOUN dad-10733 1206 10 : : PUNCT dad-10733 1206 11 language language NOUN dad-10733 1206 12 variation variation NOUN dad-10733 1206 13 and and CCONJ dad-10733 1206 14 oral oral ADJ dad-10733 1206 15 history history NOUN dad-10733 1206 16 . . PUNCT dad-10733 1207 1 in in ADP dad-10733 1207 2 proceedings proceeding NOUN dad-10733 1207 3 of of ADP dad-10733 1207 4 allc allc ADV dad-10733 1207 5 / / SYM dad-10733 1207 6 ach ach PROPN dad-10733 1207 7 , , PUNCT dad-10733 1207 8 1999 1999 NUM dad-10733 1207 9 . . PUNCT dad-10733 1208 1 y. y. PROPN dad-10733 1208 2 bengio bengio PROPN dad-10733 1208 3 , , PUNCT dad-10733 1208 4 r. r. PROPN dad-10733 1208 5 ducharme ducharme PROPN dad-10733 1208 6 , , PUNCT dad-10733 1208 7 p. p. PROPN dad-10733 1208 8 vincent vincent PROPN dad-10733 1208 9 , , PUNCT dad-10733 1208 10 and and CCONJ dad-10733 1208 11 c. c. PROPN dad-10733 1208 12 janvin janvin PROPN dad-10733 1208 13 . . PUNCT dad-10733 1209 1 a a DET dad-10733 1209 2 neural neural ADJ dad-10733 1209 3 probabilistic probabilistic ADJ dad-10733 1209 4 language language NOUN dad-10733 1209 5 model model NOUN dad-10733 1209 6 . . PUNCT dad-10733 1210 1 the the DET dad-10733 1210 2 journal journal NOUN dad-10733 1210 3 of of ADP dad-10733 1210 4 machine machine NOUN dad-10733 1210 5 learning learn VERB dad-10733 1210 6 research research NOUN dad-10733 1210 7 , , PUNCT dad-10733 1210 8 3:1137–1155 3:1137–1155 NUM dad-10733 1210 9 , , PUNCT dad-10733 1210 10 2003 2003 NUM dad-10733 1210 11 . . PUNCT dad-10733 1211 1 y. y. PROPN dad-10733 1211 2 bengio bengio PROPN dad-10733 1211 3 , , PUNCT dad-10733 1211 4 i. i. PROPN dad-10733 1211 5 goodfellow goodfellow PROPN dad-10733 1211 6 , , PUNCT dad-10733 1211 7 and and CCONJ dad-10733 1211 8 a. a. NOUN dad-10733 1211 9 courville courville NOUN dad-10733 1211 10 . . PUNCT dad-10733 1212 1 deep deep ADJ dad-10733 1212 2 learning learning NOUN dad-10733 1212 3 . . PUNCT dad-10733 1213 1 an an DET dad-10733 1213 2 mit mit NOUN dad-10733 1213 3 press press NOUN dad-10733 1213 4 book book NOUN dad-10733 1213 5 in in ADP dad-10733 1213 6 preparation preparation NOUN dad-10733 1213 7 . . PUNCT dad-10733 1214 1 draft draft NOUN dad-10733 1214 2 chapters chapter NOUN dad-10733 1214 3 available available ADJ dad-10733 1214 4 at at ADP dad-10733 1214 5 http://www http://www PROPN dad-10733 1214 6 . . PUNCT dad-10733 1214 7 iro iro PROPN dad-10733 1214 8 . . PUNCT dad-10733 1215 1 umontreal umontreal PROPN dad-10733 1215 2 . . PUNCT dad-10733 1216 1 ca/ ca/ ADJ dad-10733 1216 2 bengioy bengioy NOUN dad-10733 1216 3 / / SYM dad-10733 1216 4 dlbook dlbook NOUN dad-10733 1216 5 , , PUNCT dad-10733 1216 6 2014 2014 NUM dad-10733 1216 7 . . PUNCT dad-10733 1217 1 c. c. PROPN dad-10733 1217 2 bennett bennett PROPN dad-10733 1217 3 and and CCONJ dad-10733 1217 4 a. a. NOUN dad-10733 1217 5 i i PRON dad-10733 1217 6 rudnicky rudnicky PROPN dad-10733 1217 7 . . PUNCT dad-10733 1218 1 the the DET dad-10733 1218 2 carnegie carnegie PROPN dad-10733 1218 3 mellon mellon PROPN dad-10733 1218 4 communicator communicator PROPN dad-10733 1218 5 corpus corpus PROPN dad-10733 1218 6 , , PUNCT dad-10733 1218 7 2002 2002 NUM dad-10733 1218 8 . . PUNCT dad-10733 1219 1 d. d. PROPN dad-10733 1219 2 biber biber PROPN dad-10733 1219 3 and and CCONJ dad-10733 1219 4 e. e. PROPN dad-10733 1219 5 finegan finegan PROPN dad-10733 1219 6 . . PUNCT dad-10733 1220 1 an an DET dad-10733 1220 2 initial initial ADJ dad-10733 1220 3 typology typology NOUN dad-10733 1220 4 of of ADP dad-10733 1220 5 english english ADJ dad-10733 1220 6 text text NOUN dad-10733 1220 7 types type NOUN dad-10733 1220 8 . . PUNCT dad-10733 1221 1 corpus corpus PROPN dad-10733 1221 2 linguistics linguistics PROPN dad-10733 1221 3 ii ii PROPN dad-10733 1221 4 : : PUNCT dad-10733 1221 5 new new ADJ dad-10733 1221 6 studies study NOUN dad-10733 1221 7 in in ADP dad-10733 1221 8 the the DET dad-10733 1221 9 analysis analysis NOUN dad-10733 1221 10 and and CCONJ dad-10733 1221 11 exploitation exploitation NOUN dad-10733 1221 12 of of ADP dad-10733 1221 13 computer computer NOUN dad-10733 1221 14 corpora corpus NOUN dad-10733 1221 15 , , PUNCT dad-10733 1221 16 pages page NOUN dad-10733 1221 17 19–46 19–46 NUM dad-10733 1221 18 , , PUNCT dad-10733 1221 19 1986 1986 NUM dad-10733 1221 20 . . PUNCT dad-10733 1222 1 d. d. PROPN dad-10733 1222 2 biber biber PROPN dad-10733 1222 3 and and CCONJ dad-10733 1222 4 e. e. PROPN dad-10733 1222 5 finegan finegan PROPN dad-10733 1222 6 . . PUNCT dad-10733 1223 1 diachronic diachronic ADJ dad-10733 1223 2 relations relation NOUN dad-10733 1223 3 among among ADP dad-10733 1223 4 speech speech NOUN dad-10733 1223 5 - - PUNCT dad-10733 1223 6 based base VERB dad-10733 1223 7 and and CCONJ dad-10733 1223 8 written write VERB dad-10733 1223 9 registers register NOUN dad-10733 1223 10 in in ADP dad-10733 1223 11 english english PROPN dad-10733 1223 12 . . PUNCT dad-10733 1224 1 variation variation NOUN dad-10733 1224 2 in in ADP dad-10733 1224 3 english english PROPN dad-10733 1224 4 : : PUNCT dad-10733 1224 5 multi multi ADJ dad-10733 1224 6 - - ADJ dad-10733 1224 7 dimensional dimensional ADJ dad-10733 1224 8 studies study NOUN dad-10733 1224 9 , , PUNCT dad-10733 1224 10 pages page NOUN dad-10733 1224 11 66–83 66–83 NUM dad-10733 1224 12 , , PUNCT dad-10733 1224 13 2001 2001 NUM dad-10733 1224 14 . . PUNCT dad-10733 1225 1 d. d. PROPN dad-10733 1225 2 bohus bohus PROPN dad-10733 1225 3 and and CCONJ dad-10733 1225 4 a. a. NOUN dad-10733 1225 5 i i PRON dad-10733 1225 6 rudnicky rudnicky PROPN dad-10733 1225 7 . . PUNCT dad-10733 1226 1 sorry sorry ADJ dad-10733 1226 2 , , PUNCT dad-10733 1226 3 i i PRON dad-10733 1226 4 did do AUX dad-10733 1226 5 nt not PART dad-10733 1226 6 catch catch VERB dad-10733 1226 7 that that PRON dad-10733 1226 8 ! ! PUNCT dad-10733 1227 1 in in ADP dad-10733 1227 2 recent recent ADJ dad-10733 1227 3 trends trend NOUN dad-10733 1227 4 in in ADP dad-10733 1227 5 discourse discourse NOUN dad-10733 1227 6 and and CCONJ dad-10733 1227 7 dialogue dialogue NOUN dad-10733 1227 8 , , PUNCT dad-10733 1227 9 pages page NOUN dad-10733 1227 10 123–154 123–154 NUM dad-10733 1227 11 . . PUNCT dad-10733 1228 1 springer springer NOUN dad-10733 1228 2 , , PUNCT dad-10733 1228 3 2008 2008 NUM dad-10733 1228 4 . . PUNCT dad-10733 1229 1 s. s. PROPN dad-10733 1229 2 e. e. PROPN dad-10733 1229 3 brennan brennan PROPN dad-10733 1229 4 , , PUNCT dad-10733 1229 5 k. k. PROPN dad-10733 1229 6 s. s. PROPN dad-10733 1229 7 schuhmann schuhmann PROPN dad-10733 1229 8 , , PUNCT dad-10733 1229 9 and and CCONJ dad-10733 1229 10 k. k. PROPN dad-10733 1229 11 m. m. PROPN dad-10733 1229 12 batres batres PROPN dad-10733 1229 13 . . PUNCT dad-10733 1230 1 entrainment entrainment NOUN dad-10733 1230 2 on on ADP dad-10733 1230 3 the the DET dad-10733 1230 4 move move NOUN dad-10733 1230 5 and and CCONJ dad-10733 1230 6 in in ADP dad-10733 1230 7 the the DET dad-10733 1230 8 lab lab NOUN dad-10733 1230 9 : : PUNCT dad-10733 1230 10 the the DET dad-10733 1230 11 walking walk VERB dad-10733 1230 12 around around ADP dad-10733 1230 13 corpus corpus NOUN dad-10733 1230 14 . . PUNCT dad-10733 1231 1 in in ADP dad-10733 1231 2 conference conference NOUN dad-10733 1231 3 of of ADP dad-10733 1231 4 the the DET dad-10733 1231 5 cognitive cognitive ADJ dad-10733 1231 6 science science NOUN dad-10733 1231 7 society society NOUN dad-10733 1231 8 , , PUNCT dad-10733 1231 9 2013 2013 NUM dad-10733 1231 10 . . PUNCT dad-10733 1232 1 g. g. PROPN dad-10733 1232 2 brown brown PROPN dad-10733 1232 3 , , PUNCT dad-10733 1232 4 a. a. PROPN dad-10733 1232 5 anderson anderson PROPN dad-10733 1232 6 , , PUNCT dad-10733 1232 7 r. r. PROPN dad-10733 1232 8 shillcock shillcock PROPN dad-10733 1232 9 , , PUNCT dad-10733 1232 10 and and CCONJ dad-10733 1232 11 g. g. PROPN dad-10733 1232 12 yule yule PROPN dad-10733 1232 13 . . PUNCT dad-10733 1233 1 teaching teach VERB dad-10733 1233 2 talk talk NOUN dad-10733 1233 3 . . PUNCT dad-10733 1234 1 cambridge cambridge PROPN dad-10733 1234 2 : : PUNCT dad-10733 1234 3 cup cup PROPN dad-10733 1234 4 , , PUNCT dad-10733 1234 5 1984 1984 NUM dad-10733 1234 6 . . PUNCT dad-10733 1235 1 s. s. PROPN dad-10733 1235 2 burger burger PROPN dad-10733 1235 3 , , PUNCT dad-10733 1235 4 k. k. PROPN dad-10733 1235 5 weilhammer weilhammer PROPN dad-10733 1235 6 , , PUNCT dad-10733 1235 7 f. f. PROPN dad-10733 1235 8 schiel schiel PROPN dad-10733 1235 9 , , PUNCT dad-10733 1235 10 and and CCONJ dad-10733 1235 11 h. h. PROPN dad-10733 1235 12 g. g. PROPN dad-10733 1235 13 tillmann tillmann PROPN dad-10733 1235 14 . . PUNCT dad-10733 1236 1 verbmobil verbmobil PROPN dad-10733 1236 2 data datum NOUN dad-10733 1236 3 collection collection NOUN dad-10733 1236 4 and and CCONJ dad-10733 1236 5 annotation annotation NOUN dad-10733 1236 6 . . PUNCT dad-10733 1237 1 in in ADP dad-10733 1237 2 verbmobil verbmobil NOUN dad-10733 1237 3 : : PUNCT dad-10733 1237 4 foundations foundation NOUN dad-10733 1237 5 of of ADP dad-10733 1237 6 speech speech NOUN dad-10733 1237 7 - - PUNCT dad-10733 1237 8 to to ADP dad-10733 1237 9 - - PUNCT dad-10733 1237 10 speech speech NOUN dad-10733 1237 11 translation translation NOUN dad-10733 1237 12 , , PUNCT dad-10733 1237 13 pages page NOUN dad-10733 1237 14 537–549 537–549 NUM dad-10733 1237 15 . . PUNCT dad-10733 1237 16 springer springer NOUN dad-10733 1237 17 , , PUNCT dad-10733 1237 18 2000 2000 NUM dad-10733 1237 19 . . PUNCT dad-10733 1238 1 j. j. PROPN dad-10733 1238 2 e. e. PROPN dad-10733 1238 3 cahn cahn PROPN dad-10733 1238 4 and and CCONJ dad-10733 1238 5 s. s. PROPN dad-10733 1238 6 e. e. PROPN dad-10733 1238 7 brennan brennan PROPN dad-10733 1238 8 . . PUNCT dad-10733 1239 1 a a DET dad-10733 1239 2 psychological psychological ADJ dad-10733 1239 3 model model NOUN dad-10733 1239 4 of of ADP dad-10733 1239 5 grounding grounding NOUN dad-10733 1239 6 and and CCONJ dad-10733 1239 7 repair repair VERB dad-10733 1239 8 in in ADP dad-10733 1239 9 dialog dialog NOUN dad-10733 1239 10 . . PUNCT dad-10733 1240 1 in in ADP dad-10733 1240 2 aaai aaai PROPN dad-10733 1240 3 symposium symposium NOUN dad-10733 1240 4 on on ADP dad-10733 1240 5 psychological psychological ADJ dad-10733 1240 6 models model NOUN dad-10733 1240 7 of of ADP dad-10733 1240 8 communication communication NOUN dad-10733 1240 9 in in ADP dad-10733 1240 10 collaborative collaborative ADJ dad-10733 1240 11 systems system NOUN dad-10733 1240 12 , , PUNCT dad-10733 1240 13 1999 1999 NUM dad-10733 1240 14 . . PUNCT dad-10733 1241 1 a. a. NOUN dad-10733 1241 2 canavan canavan PROPN dad-10733 1241 3 and and CCONJ dad-10733 1241 4 g. g. PROPN dad-10733 1241 5 zipperlen zipperlen PROPN dad-10733 1241 6 . . PUNCT dad-10733 1242 1 callfriend callfriend PROPN dad-10733 1242 2 american american PROPN dad-10733 1242 3 english english PROPN dad-10733 1242 4 - - PUNCT dad-10733 1242 5 non non ADJ dad-10733 1242 6 - - ADJ dad-10733 1242 7 southern southern ADJ dad-10733 1242 8 dialect dialect NOUN dad-10733 1242 9 . . PUNCT dad-10733 1243 1 linguistic linguistic ADJ dad-10733 1243 2 data datum NOUN dad-10733 1243 3 consortium consortium NOUN dad-10733 1243 4 , , PUNCT dad-10733 1243 5 10:1 10:1 NUM dad-10733 1243 6 , , PUNCT dad-10733 1243 7 1996 1996 NUM dad-10733 1243 8 . . PUNCT dad-10733 1244 1 a. a. NOUN dad-10733 1244 2 canavan canavan PROPN dad-10733 1244 3 , , PUNCT dad-10733 1244 4 d. d. PROPN dad-10733 1244 5 graff graff PROPN dad-10733 1244 6 , , PUNCT dad-10733 1244 7 and and CCONJ dad-10733 1244 8 g. g. PROPN dad-10733 1244 9 zipperlen zipperlen PROPN dad-10733 1244 10 . . PUNCT dad-10733 1245 1 callhome callhome PROPN dad-10733 1245 2 american american PROPN dad-10733 1245 3 english english PROPN dad-10733 1245 4 speech speech NOUN dad-10733 1245 5 . . PUNCT dad-10733 1246 1 linguistic linguistic ADJ dad-10733 1246 2 data datum NOUN dad-10733 1246 3 consortium consortium NOUN dad-10733 1246 4 , , PUNCT dad-10733 1246 5 1997 1997 NUM dad-10733 1246 6 . . PUNCT dad-10733 1247 1 s. s. PROPN dad-10733 1247 2 k. k. PROPN dad-10733 1247 3 card card PROPN dad-10733 1247 4 , , PUNCT dad-10733 1247 5 t. t. PROPN dad-10733 1247 6 p. p. PROPN dad-10733 1247 7 moran moran PROPN dad-10733 1247 8 , , PUNCT dad-10733 1247 9 and and CCONJ dad-10733 1247 10 a. a. PROPN dad-10733 1247 11 newell newell PROPN dad-10733 1247 12 . . PUNCT dad-10733 1248 1 the the DET dad-10733 1248 2 psychology psychology NOUN dad-10733 1248 3 of of ADP dad-10733 1248 4 human human ADJ dad-10733 1248 5 - - PUNCT dad-10733 1248 6 computer computer NOUN dad-10733 1248 7 interaction interaction NOUN dad-10733 1248 8 . . PUNCT dad-10733 1249 1 l. l. PROPN dad-10733 1249 2 erlbaum erlbaum PROPN dad-10733 1249 3 associates associates PROPN dad-10733 1249 4 inc inc PROPN dad-10733 1249 5 . . PROPN dad-10733 1249 6 , , PUNCT dad-10733 1249 7 hillsdale hillsdale PROPN dad-10733 1249 8 , , PUNCT dad-10733 1249 9 nj nj PROPN dad-10733 1249 10 , , PUNCT dad-10733 1249 11 usa usa PROPN dad-10733 1249 12 , , PUNCT dad-10733 1249 13 1983 1983 NUM dad-10733 1249 14 . . PUNCT dad-10733 1250 1 isbn isbn PROPN dad-10733 1250 2 0898592437 0898592437 NUM dad-10733 1250 3 . . PUNCT dad-10733 1251 1 r. r. PROPN dad-10733 1251 2 carter carter PROPN dad-10733 1251 3 . . PUNCT dad-10733 1252 1 orders order NOUN dad-10733 1252 2 of of ADP dad-10733 1252 3 reality reality NOUN dad-10733 1252 4 : : PUNCT dad-10733 1252 5 cancode cancode NOUN dad-10733 1252 6 , , PUNCT dad-10733 1252 7 communication communication NOUN dad-10733 1252 8 , , PUNCT dad-10733 1252 9 and and CCONJ dad-10733 1252 10 culture culture NOUN dad-10733 1252 11 . . PUNCT dad-10733 1253 1 elt elt PROPN dad-10733 1253 2 journal journal NOUN dad-10733 1253 3 , , PUNCT dad-10733 1253 4 52(1):43–56 52(1):43–56 NUM dad-10733 1253 5 , , PUNCT dad-10733 1253 6 1998 1998 NUM dad-10733 1253 7 . . PUNCT dad-10733 1254 1 r. r. PROPN dad-10733 1254 2 carter carter PROPN dad-10733 1254 3 and and CCONJ dad-10733 1254 4 m. m. PROPN dad-10733 1254 5 mccarthy mccarthy PROPN dad-10733 1254 6 . . PUNCT dad-10733 1255 1 cambridge cambridge NOUN dad-10733 1255 2 grammar grammar NOUN dad-10733 1255 3 of of ADP dad-10733 1255 4 english english PROPN dad-10733 1255 5 : : PUNCT dad-10733 1255 6 a a DET dad-10733 1255 7 comprehensive comprehensive ADJ dad-10733 1255 8 guide guide NOUN dad-10733 1255 9 ; ; PUNCT dad-10733 1255 10 spoken speak VERB dad-10733 1255 11 and and CCONJ dad-10733 1255 12 written write VERB dad-10733 1255 13 english english ADJ dad-10733 1255 14 grammar grammar NOUN dad-10733 1255 15 and and CCONJ dad-10733 1255 16 usage usage NOUN dad-10733 1255 17 . . PUNCT dad-10733 1256 1 ernst ernst PROPN dad-10733 1256 2 klett klett PROPN dad-10733 1256 3 sprachen sprachen PROPN dad-10733 1256 4 , , PUNCT dad-10733 1256 5 2006 2006 NUM dad-10733 1256 6 . . PUNCT dad-10733 1257 1 t. t. PROPN dad-10733 1257 2 l. l. PROPN dad-10733 1257 3 chartrand chartrand PROPN dad-10733 1257 4 and and CCONJ dad-10733 1257 5 j. j. PROPN dad-10733 1257 6 a. a. PROPN dad-10733 1257 7 bargh bargh PROPN dad-10733 1257 8 . . PUNCT dad-10733 1258 1 the the DET dad-10733 1258 2 chameleon chameleon NOUN dad-10733 1258 3 effect effect NOUN dad-10733 1258 4 : : PUNCT dad-10733 1258 5 the the DET dad-10733 1258 6 perception perception NOUN dad-10733 1258 7 – – PUNCT dad-10733 1258 8 behavior behavior NOUN dad-10733 1258 9 link link NOUN dad-10733 1258 10 and and CCONJ dad-10733 1258 11 social social ADJ dad-10733 1258 12 interaction interaction NOUN dad-10733 1258 13 . . PUNCT dad-10733 1259 1 journal journal NOUN dad-10733 1259 2 of of ADP dad-10733 1259 3 personality personality NOUN dad-10733 1259 4 and and CCONJ dad-10733 1259 5 social social ADJ dad-10733 1259 6 psychology psychology NOUN dad-10733 1259 7 , , PUNCT dad-10733 1259 8 76(6):893 76(6):893 PROPN dad-10733 1259 9 , , PUNCT dad-10733 1259 10 1999 1999 NUM dad-10733 1259 11 . . PUNCT dad-10733 1260 1 t. t. PROPN dad-10733 1260 2 chen chen PROPN dad-10733 1260 3 and and CCONJ dad-10733 1260 4 m. m. PROPN dad-10733 1260 5 kan kan PROPN dad-10733 1260 6 . . PUNCT dad-10733 1261 1 creating create VERB dad-10733 1261 2 a a DET dad-10733 1261 3 live live ADJ dad-10733 1261 4 , , PUNCT dad-10733 1261 5 public public ADJ dad-10733 1261 6 short short ADJ dad-10733 1261 7 message message NOUN dad-10733 1261 8 service service NOUN dad-10733 1261 9 corpus corpus NOUN dad-10733 1261 10 : : PUNCT dad-10733 1261 11 the the DET dad-10733 1261 12 nus nus PROPN dad-10733 1261 13 sms sms PROPN dad-10733 1261 14 corpus corpus PROPN dad-10733 1261 15 . . PUNCT dad-10733 1262 1 language language NOUN dad-10733 1262 2 resources resource NOUN dad-10733 1262 3 and and CCONJ dad-10733 1262 4 evaluation evaluation NOUN dad-10733 1262 5 , , PUNCT dad-10733 1262 6 47(2):299–335 47(2):299–335 PROPN dad-10733 1262 7 , , PUNCT dad-10733 1262 8 2013 2013 NUM dad-10733 1262 9 . . PUNCT dad-10733 1263 1 y.-n y.-n PROPN dad-10733 1263 2 . . PUNCT dad-10733 1264 1 chen chen PROPN dad-10733 1264 2 , , PUNCT dad-10733 1264 3 d. d. PROPN dad-10733 1264 4 hakkani hakkani PROPN dad-10733 1264 5 - - PUNCT dad-10733 1264 6 tür tür NOUN dad-10733 1264 7 , , PUNCT dad-10733 1264 8 and and CCONJ dad-10733 1264 9 x. x. NOUN dad-10733 1264 10 he he PRON dad-10733 1264 11 . . PUNCT dad-10733 1265 1 zero zero NUM dad-10733 1265 2 - - PUNCT dad-10733 1265 3 shot shot NOUN dad-10733 1265 4 learning learning NOUN dad-10733 1265 5 of of ADP dad-10733 1265 6 intent intent ADJ dad-10733 1265 7 embeddings embedding NOUN dad-10733 1265 8 for for ADP dad-10733 1265 9 expansion expansion NOUN dad-10733 1265 10 by by ADP dad-10733 1265 11 convolutional convolutional ADJ dad-10733 1265 12 deep deep ADJ dad-10733 1265 13 structured structured ADJ dad-10733 1265 14 semantic semantic ADJ dad-10733 1265 15 models model NOUN dad-10733 1265 16 . . PUNCT dad-10733 1266 1 in in ADP dad-10733 1266 2 acoustics acoustic NOUN dad-10733 1266 3 , , PUNCT dad-10733 1266 4 speech speech NOUN dad-10733 1266 5 and and CCONJ dad-10733 1266 6 signal signal NOUN dad-10733 1266 7 processing processing NOUN dad-10733 1266 8 ( ( PUNCT dad-10733 1266 9 icassp icassp PROPN dad-10733 1266 10 ) ) PUNCT dad-10733 1266 11 , , PUNCT dad-10733 1266 12 2016 2016 NUM dad-10733 1266 13 ieee ieee PROPN dad-10733 1266 14 international international ADJ dad-10733 1266 15 conference conference NOUN dad-10733 1266 16 on on ADP dad-10733 1266 17 , , PUNCT dad-10733 1266 18 pages page NOUN dad-10733 1266 19 6045–6049 6045–6049 NUM dad-10733 1266 20 . . PUNCT dad-10733 1267 1 ieee ieee NOUN dad-10733 1267 2 , , PUNCT dad-10733 1267 3 2016 2016 NUM dad-10733 1267 4 . . PUNCT dad-10733 1268 1 g. g. PROPN dad-10733 1268 2 churcher churcher PROPN dad-10733 1268 3 , , PUNCT dad-10733 1268 4 e. e. PROPN dad-10733 1268 5 s. s. PROPN dad-10733 1268 6 atwell atwell PROPN dad-10733 1268 7 , , PUNCT dad-10733 1268 8 and and CCONJ dad-10733 1268 9 c. c. PROPN dad-10733 1268 10 souter souter PROPN dad-10733 1268 11 . . PUNCT dad-10733 1269 1 dialogue dialogue NOUN dad-10733 1269 2 management management NOUN dad-10733 1269 3 systems system NOUN dad-10733 1269 4 : : PUNCT dad-10733 1269 5 a a DET dad-10733 1269 6 survey survey NOUN dad-10733 1269 7 and and CCONJ dad-10733 1269 8 overview overview NOUN dad-10733 1269 9 . . PUNCT dad-10733 1270 1 university university NOUN dad-10733 1270 2 of of ADP dad-10733 1270 3 leeds leed NOUN dad-10733 1270 4 , , PUNCT dad-10733 1270 5 school school NOUN dad-10733 1270 6 of of ADP dad-10733 1270 7 computing compute VERB dad-10733 1270 8 research research NOUN dad-10733 1270 9 report report NOUN dad-10733 1270 10 1997.06 1997.06 NUM dad-10733 1270 11 , , PUNCT dad-10733 1270 12 1997 1997 NUM dad-10733 1270 13 . . PUNCT dad-10733 1271 1 p. p. PROPN dad-10733 1271 2 r. r. PROPN dad-10733 1271 3 cohen cohen PROPN dad-10733 1271 4 . . PUNCT dad-10733 1272 1 if if SCONJ dad-10733 1272 2 not not PART dad-10733 1272 3 turing ture VERB dad-10733 1272 4 ’s ’s PART dad-10733 1272 5 test test NOUN dad-10733 1272 6 , , PUNCT dad-10733 1272 7 then then ADV dad-10733 1272 8 what what PRON dad-10733 1272 9 ? ? PUNCT dad-10733 1273 1 ai ai VERB dad-10733 1273 2 magazine magazine NOUN dad-10733 1273 3 , , PUNCT dad-10733 1273 4 26(4):61 26(4):61 NUM dad-10733 1273 5 , , PUNCT dad-10733 1273 6 2005 2005 NUM dad-10733 1273 7 . . PUNCT dad-10733 1274 1 k. k. PROPN dad-10733 1274 2 m. m. PROPN dad-10733 1274 3 colby colby PROPN dad-10733 1274 4 . . PUNCT dad-10733 1275 1 modeling model VERB dad-10733 1275 2 a a DET dad-10733 1275 3 paranoid paranoid ADJ dad-10733 1275 4 mind mind NOUN dad-10733 1275 5 . . PUNCT dad-10733 1276 1 behavioral behavioral ADJ dad-10733 1276 2 and and CCONJ dad-10733 1276 3 brain brain NOUN dad-10733 1276 4 sciences science NOUN dad-10733 1276 5 , , PUNCT dad-10733 1276 6 4:515–534 4:515–534 NUM dad-10733 1276 7 , , PUNCT dad-10733 1276 8 1981 1981 NUM dad-10733 1276 9 . . PUNCT dad-10733 1277 1 r. r. PROPN dad-10733 1277 2 m. m. PROPN dad-10733 1277 3 cooper cooper PROPN dad-10733 1277 4 . . PUNCT dad-10733 1278 1 the the DET dad-10733 1278 2 control control NOUN dad-10733 1278 3 of of ADP dad-10733 1278 4 eye eye NOUN dad-10733 1278 5 fixation fixation NOUN dad-10733 1278 6 by by ADP dad-10733 1278 7 the the DET dad-10733 1278 8 meaning meaning NOUN dad-10733 1278 9 of of ADP dad-10733 1278 10 spoken spoken ADJ dad-10733 1278 11 language language NOUN dad-10733 1278 12 : : PUNCT dad-10733 1278 13 a a DET dad-10733 1278 14 new new ADJ dad-10733 1278 15 methodology methodology NOUN dad-10733 1278 16 for for ADP dad-10733 1278 17 the the DET dad-10733 1278 18 real real ADJ dad-10733 1278 19 - - PUNCT dad-10733 1278 20 time time NOUN dad-10733 1278 21 investigation investigation NOUN dad-10733 1278 22 of of ADP dad-10733 1278 23 speech speech NOUN dad-10733 1278 24 perception perception NOUN dad-10733 1278 25 , , PUNCT dad-10733 1278 26 memory memory NOUN dad-10733 1278 27 , , PUNCT dad-10733 1278 28 and and CCONJ dad-10733 1278 29 language language NOUN dad-10733 1278 30 processing processing NOUN dad-10733 1278 31 . . PUNCT dad-10733 1279 1 cognitive cognitive ADJ dad-10733 1279 2 psychology psychology NOUN dad-10733 1279 3 , , PUNCT dad-10733 1279 4 6(1):84–107 6(1):84–107 NUM dad-10733 1279 5 , , PUNCT dad-10733 1279 6 1974 1974 NUM dad-10733 1279 7 . . PUNCT dad-10733 1280 1 n. n. PROPN dad-10733 1280 2 cristianini cristianini PROPN dad-10733 1280 3 and and CCONJ dad-10733 1280 4 j. j. PROPN dad-10733 1280 5 shawe shawe PROPN dad-10733 1280 6 - - PUNCT dad-10733 1280 7 taylor taylor PROPN dad-10733 1280 8 . . PUNCT dad-10733 1281 1 an an DET dad-10733 1281 2 introduction introduction NOUN dad-10733 1281 3 to to PART dad-10733 1281 4 support support VERB dad-10733 1281 5 vector vector NOUN dad-10733 1281 6 machines machine NOUN dad-10733 1281 7 : : PUNCT dad-10733 1281 8 and and CCONJ dad-10733 1281 9 other other ADJ dad-10733 1281 10 kernel kernel NOUN dad-10733 1281 11 - - PUNCT dad-10733 1281 12 based base VERB dad-10733 1281 13 learning learning NOUN dad-10733 1281 14 methods method NOUN dad-10733 1281 15 . . PUNCT dad-10733 1282 1 cambridge cambridge PROPN dad-10733 1282 2 university university PROPN dad-10733 1282 3 press press NOUN dad-10733 1282 4 , , PUNCT dad-10733 1282 5 2000 2000 NUM dad-10733 1282 6 . . PUNCT dad-10733 1283 1 h. h. PROPN dad-10733 1283 2 cuayáhuitl cuayáhuitl PROPN dad-10733 1283 3 , , PUNCT dad-10733 1283 4 s. s. PROPN dad-10733 1283 5 keizer keizer PROPN dad-10733 1283 6 , , PUNCT dad-10733 1283 7 and and CCONJ dad-10733 1283 8 o. o. PROPN dad-10733 1283 9 lemon lemon NOUN dad-10733 1283 10 . . PUNCT dad-10733 1284 1 strategic strategic ADJ dad-10733 1284 2 dialogue dialogue NOUN dad-10733 1284 3 management management NOUN dad-10733 1284 4 via via ADP dad-10733 1284 5 deep deep ADJ dad-10733 1284 6 reinforcement reinforcement NOUN dad-10733 1284 7 learning learning NOUN dad-10733 1284 8 . . PUNCT dad-10733 1285 1 arxiv arxiv PROPN dad-10733 1285 2 preprint preprint PROPN dad-10733 1285 3 arxiv:1511.08099 arxiv:1511.08099 NUM dad-10733 1285 4 , , PUNCT dad-10733 1285 5 2015 2015 NUM dad-10733 1285 6 . . PUNCT dad-10733 1286 1 c. c. PROPN dad-10733 1286 2 danescu danescu PROPN dad-10733 1286 3 - - PUNCT dad-10733 1286 4 niculescu niculescu NOUN dad-10733 1286 5 - - PUNCT dad-10733 1286 6 mizil mizil NOUN dad-10733 1286 7 and and CCONJ dad-10733 1286 8 l. l. PROPN dad-10733 1286 9 lee lee PROPN dad-10733 1286 10 . . PUNCT dad-10733 1287 1 chameleons chameleon NOUN dad-10733 1287 2 in in ADP dad-10733 1287 3 imagined imagined ADJ dad-10733 1287 4 conversations conversation NOUN dad-10733 1287 5 : : PUNCT dad-10733 1287 6 a a DET dad-10733 1287 7 new new ADJ dad-10733 1287 8 approach approach NOUN dad-10733 1287 9 to to ADP dad-10733 1287 10 understanding understand VERB dad-10733 1287 11 coordination coordination NOUN dad-10733 1287 12 of of ADP dad-10733 1287 13 linguistic linguistic ADJ dad-10733 1287 14 style style NOUN dad-10733 1287 15 in in ADP dad-10733 1287 16 dialogs dialog NOUN dad-10733 1287 17 . . PUNCT dad-10733 1288 1 in in ADP dad-10733 1288 2 association association NOUN dad-10733 1288 3 for for ADP dad-10733 1288 4 computational computational ADJ dad-10733 1288 5 linguistics linguistic NOUN dad-10733 1288 6 , , PUNCT dad-10733 1288 7 workshop workshop NOUN dad-10733 1288 8 on on ADP dad-10733 1288 9 cognitive cognitive ADJ dad-10733 1288 10 modeling modeling NOUN dad-10733 1288 11 and and CCONJ dad-10733 1288 12 computational computational ADJ dad-10733 1288 13 linguistics linguistic NOUN dad-10733 1288 14 , , PUNCT dad-10733 1288 15 2011 2011 NUM dad-10733 1288 16 . . PUNCT dad-10733 1289 1 41 41 NUM dad-10733 1289 2 serban serban PROPN dad-10733 1289 3 , , PUNCT dad-10733 1289 4 lowe lowe PROPN dad-10733 1289 5 , , PUNCT dad-10733 1289 6 henderson henderson PROPN dad-10733 1289 7 , , PUNCT dad-10733 1289 8 charlin charlin PROPN dad-10733 1289 9 and and CCONJ dad-10733 1289 10 pineau pineau PROPN dad-10733 1289 11 l. l. PROPN dad-10733 1289 12 daubigney daubigney PROPN dad-10733 1289 13 , , PUNCT dad-10733 1289 14 m. m. NOUN dad-10733 1289 15 geist geist PROPN dad-10733 1289 16 , , PUNCT dad-10733 1289 17 s. s. PROPN dad-10733 1289 18 chandramohan chandramohan PROPN dad-10733 1289 19 , , PUNCT dad-10733 1289 20 and and CCONJ dad-10733 1289 21 o. o. PROPN dad-10733 1289 22 pietquin pietquin PROPN dad-10733 1289 23 . . PUNCT dad-10733 1290 1 a a DET dad-10733 1290 2 comprehensive comprehensive ADJ dad-10733 1290 3 reinforcement reinforcement NOUN dad-10733 1290 4 learning learning NOUN dad-10733 1290 5 framework framework NOUN dad-10733 1290 6 for for ADP dad-10733 1290 7 dialogue dialogue NOUN dad-10733 1290 8 management management NOUN dad-10733 1290 9 optimization optimization NOUN dad-10733 1290 10 . . PUNCT dad-10733 1291 1 ieee ieee PROPN dad-10733 1291 2 journal journal PROPN dad-10733 1291 3 of of ADP dad-10733 1291 4 selected select VERB dad-10733 1291 5 topics topic NOUN dad-10733 1291 6 in in ADP dad-10733 1291 7 signal signal ADJ dad-10733 1291 8 processing processing NOUN dad-10733 1291 9 , , PUNCT dad-10733 1291 10 6(8):891–902 6(8):891–902 NOUN dad-10733 1291 11 , , PUNCT dad-10733 1291 12 2012 2012 NUM dad-10733 1291 13 . . PUNCT dad-10733 1292 1 m. m. NOUN dad-10733 1292 2 davies davy NOUN dad-10733 1292 3 . . PUNCT dad-10733 1293 1 comparing compare VERB dad-10733 1293 2 the the DET dad-10733 1293 3 corpus corpus NOUN dad-10733 1293 4 of of ADP dad-10733 1293 5 american american ADJ dad-10733 1293 6 soap soap NOUN dad-10733 1293 7 operas opera NOUN dad-10733 1293 8 , , PUNCT dad-10733 1293 9 coca coca NOUN dad-10733 1293 10 , , PUNCT dad-10733 1293 11 and and CCONJ dad-10733 1293 12 the the DET dad-10733 1293 13 bnc bnc NOUN dad-10733 1293 14 , , PUNCT dad-10733 1293 15 2012a 2012a NUM dad-10733 1293 16 . . PUNCT dad-10733 1294 1 m. m. NOUN dad-10733 1294 2 davies davy NOUN dad-10733 1294 3 . . PUNCT dad-10733 1295 1 corpus corpu NOUN dad-10733 1295 2 of of ADP dad-10733 1295 3 american american ADJ dad-10733 1295 4 soap soap NOUN dad-10733 1295 5 operas opera NOUN dad-10733 1295 6 , , PUNCT dad-10733 1295 7 2012b 2012b NUM dad-10733 1295 8 . . PUNCT dad-10733 1296 1 i. i. PROPN dad-10733 1296 2 de de PROPN dad-10733 1296 3 kok kok PROPN dad-10733 1296 4 , , PUNCT dad-10733 1296 5 d. d. PROPN dad-10733 1296 6 heylen heylen PROPN dad-10733 1296 7 , , PUNCT dad-10733 1296 8 and and CCONJ dad-10733 1296 9 l. l. PROPN dad-10733 1296 10 morency morency PROPN dad-10733 1296 11 . . PUNCT dad-10733 1297 1 speaker speaker NOUN dad-10733 1297 2 - - PUNCT dad-10733 1297 3 adaptive adaptive ADJ dad-10733 1297 4 multimodal multimodal NOUN dad-10733 1297 5 prediction prediction NOUN dad-10733 1297 6 model model NOUN dad-10733 1297 7 for for ADP dad-10733 1297 8 listener listener NOUN dad-10733 1297 9 responses response NOUN dad-10733 1297 10 . . PUNCT dad-10733 1298 1 in in ADP dad-10733 1298 2 proceedings proceeding NOUN dad-10733 1298 3 of of ADP dad-10733 1298 4 the the DET dad-10733 1298 5 15th 15th ADJ dad-10733 1298 6 acm acm NOUN dad-10733 1298 7 on on ADP dad-10733 1298 8 international international ADJ dad-10733 1298 9 conference conference NOUN dad-10733 1298 10 on on ADP dad-10733 1298 11 multimodal multimodal NOUN dad-10733 1298 12 interaction interaction NOUN dad-10733 1298 13 , , PUNCT dad-10733 1298 14 2013 2013 NUM dad-10733 1298 15 . . PUNCT dad-10733 1299 1 l. l. PROPN dad-10733 1299 2 deng deng PROPN dad-10733 1299 3 and and CCONJ dad-10733 1299 4 x. x. PROPN dad-10733 1299 5 li li PROPN dad-10733 1299 6 . . PROPN dad-10733 1299 7 machine machine NOUN dad-10733 1299 8 learning learning NOUN dad-10733 1299 9 paradigms paradigm VERB dad-10733 1299 10 for for ADP dad-10733 1299 11 speech speech NOUN dad-10733 1299 12 recognition recognition NOUN dad-10733 1299 13 : : PUNCT dad-10733 1299 14 an an DET dad-10733 1299 15 overview overview NOUN dad-10733 1299 16 . . PUNCT dad-10733 1300 1 audio audio NOUN dad-10733 1300 2 , , PUNCT dad-10733 1300 3 speech speech NOUN dad-10733 1300 4 , , PUNCT dad-10733 1300 5 and and CCONJ dad-10733 1300 6 language language NOUN dad-10733 1300 7 processing processing NOUN dad-10733 1300 8 , , PUNCT dad-10733 1300 9 ieee ieee NOUN dad-10733 1300 10 transactions transaction NOUN dad-10733 1300 11 on on ADP dad-10733 1300 12 , , PUNCT dad-10733 1300 13 21(5):1060–1089 21(5):1060–1089 PROPN dad-10733 1300 14 , , PUNCT dad-10733 1300 15 2013 2013 NUM dad-10733 1300 16 . . PUNCT dad-10733 1301 1 l. l. PROPN dad-10733 1301 2 denoyer denoyer PROPN dad-10733 1301 3 and and CCONJ dad-10733 1301 4 p. p. PROPN dad-10733 1301 5 gallinari gallinari PROPN dad-10733 1301 6 . . PUNCT dad-10733 1302 1 the the DET dad-10733 1302 2 wikipedia wikipedia PROPN dad-10733 1302 3 xml xml PROPN dad-10733 1302 4 corpus corpus NOUN dad-10733 1302 5 . . PUNCT dad-10733 1303 1 in in ADP dad-10733 1303 2 comparative comparative ADJ dad-10733 1303 3 evaluation evaluation NOUN dad-10733 1303 4 of of ADP dad-10733 1303 5 xml xml NOUN dad-10733 1303 6 information information NOUN dad-10733 1303 7 retrieval retrieval NOUN dad-10733 1303 8 systems system NOUN dad-10733 1303 9 , , PUNCT dad-10733 1303 10 pages page NOUN dad-10733 1303 11 12–19 12–19 PROPN dad-10733 1303 12 . . PUNCT dad-10733 1303 13 springer springer NOUN dad-10733 1303 14 , , PUNCT dad-10733 1303 15 2007 2007 NUM dad-10733 1303 16 . . PUNCT dad-10733 1304 1 b. b. PROPN dad-10733 1304 2 dhingra dhingra PROPN dad-10733 1304 3 , , PUNCT dad-10733 1304 4 z. z. PROPN dad-10733 1304 5 zhou zhou PROPN dad-10733 1304 6 , , PUNCT dad-10733 1304 7 d. d. PROPN dad-10733 1304 8 fitzpatrick fitzpatrick PROPN dad-10733 1304 9 , , PUNCT dad-10733 1304 10 m. m. NOUN dad-10733 1304 11 muehl muehl PROPN dad-10733 1304 12 , , PUNCT dad-10733 1304 13 and and CCONJ dad-10733 1304 14 w. w. PROPN dad-10733 1304 15 cohen cohen PROPN dad-10733 1304 16 . . PUNCT dad-10733 1305 1 tweet2vec tweet2vec PROPN dad-10733 1305 2 : : PUNCT dad-10733 1306 1 character character NOUN dad-10733 1306 2 - - PUNCT dad-10733 1306 3 based base VERB dad-10733 1306 4 distributed distribute VERB dad-10733 1306 5 representations representation NOUN dad-10733 1306 6 for for ADP dad-10733 1306 7 social social ADJ dad-10733 1306 8 media medium NOUN dad-10733 1306 9 . . PUNCT dad-10733 1307 1 arxiv arxiv PROPN dad-10733 1307 2 preprint preprint PROPN dad-10733 1307 3 arxiv:1605.03481 arxiv:1605.03481 PROPN dad-10733 1307 4 , , PUNCT dad-10733 1307 5 2016 2016 NUM dad-10733 1307 6 . . PUNCT dad-10733 1308 1 a. a. PROPN dad-10733 1308 2 djalali djalali PROPN dad-10733 1308 3 , , PUNCT dad-10733 1308 4 s. s. PROPN dad-10733 1308 5 lauer lauer PROPN dad-10733 1308 6 , , PUNCT dad-10733 1308 7 and and CCONJ dad-10733 1308 8 c. c. PROPN dad-10733 1308 9 potts potts PROPN dad-10733 1308 10 . . PUNCT dad-10733 1309 1 corpus corpus NOUN dad-10733 1309 2 evidence evidence NOUN dad-10733 1309 3 for for ADP dad-10733 1309 4 preference preference NOUN dad-10733 1309 5 - - PUNCT dad-10733 1309 6 driven drive VERB dad-10733 1309 7 interpretation interpretation NOUN dad-10733 1309 8 . . PUNCT dad-10733 1310 1 in in ADP dad-10733 1310 2 logic logic NOUN dad-10733 1310 3 , , PUNCT dad-10733 1310 4 language language NOUN dad-10733 1310 5 and and CCONJ dad-10733 1310 6 meaning meaning NOUN dad-10733 1310 7 , , PUNCT dad-10733 1310 8 pages page NOUN dad-10733 1310 9 150–159 150–159 NUM dad-10733 1310 10 . . PUNCT dad-10733 1310 11 springer springer NOUN dad-10733 1310 12 , , PUNCT dad-10733 1310 13 2012 2012 NUM dad-10733 1310 14 . . PUNCT dad-10733 1311 1 j. j. PROPN dad-10733 1311 2 dodge dodge PROPN dad-10733 1311 3 , , PUNCT dad-10733 1311 4 a. a. NOUN dad-10733 1311 5 gane gane NOUN dad-10733 1311 6 , , PUNCT dad-10733 1311 7 x. x. PROPN dad-10733 1311 8 zhang zhang PROPN dad-10733 1311 9 , , PUNCT dad-10733 1311 10 a. a. PROPN dad-10733 1311 11 bordes bordes PROPN dad-10733 1311 12 , , PUNCT dad-10733 1311 13 s. s. PROPN dad-10733 1311 14 chopra chopra PROPN dad-10733 1311 15 , , PUNCT dad-10733 1311 16 a. a. PROPN dad-10733 1311 17 miller miller PROPN dad-10733 1311 18 , , PUNCT dad-10733 1311 19 a. a. PROPN dad-10733 1311 20 szlam szlam PROPN dad-10733 1311 21 , , PUNCT dad-10733 1311 22 and and CCONJ dad-10733 1311 23 j. j. PROPN dad-10733 1311 24 weston weston PROPN dad-10733 1311 25 . . PUNCT dad-10733 1312 1 evaluating evaluate VERB dad-10733 1312 2 prerequisite prerequisite NOUN dad-10733 1312 3 qualities quality NOUN dad-10733 1312 4 for for ADP dad-10733 1312 5 learning learn VERB dad-10733 1312 6 end end NOUN dad-10733 1312 7 - - PUNCT dad-10733 1312 8 to to ADP dad-10733 1312 9 - - PUNCT dad-10733 1312 10 end end NOUN dad-10733 1312 11 dialog dialog NOUN dad-10733 1312 12 systems system NOUN dad-10733 1312 13 . . PUNCT dad-10733 1313 1 arxiv arxiv PROPN dad-10733 1313 2 preprint preprint VERB dad-10733 1313 3 arxiv:1511.06931 arxiv:1511.06931 NUM dad-10733 1313 4 , , PUNCT dad-10733 1313 5 2015 2015 NUM dad-10733 1313 6 . . PUNCT dad-10733 1314 1 s. s. PROPN dad-10733 1314 2 dose dose PROPN dad-10733 1314 3 . . PUNCT dad-10733 1315 1 flipping flip VERB dad-10733 1315 2 the the DET dad-10733 1315 3 script script NOUN dad-10733 1315 4 : : PUNCT dad-10733 1315 5 a a DET dad-10733 1315 6 corpus corpus NOUN dad-10733 1315 7 of of ADP dad-10733 1315 8 american american PROPN dad-10733 1315 9 television television PROPN dad-10733 1315 10 series series PROPN dad-10733 1315 11 ( ( PUNCT dad-10733 1315 12 cats cat NOUN dad-10733 1315 13 ) ) PUNCT dad-10733 1315 14 for for ADP dad-10733 1315 15 corpus corpus NOUN dad-10733 1315 16 - - PUNCT dad-10733 1315 17 based base VERB dad-10733 1315 18 language language NOUN dad-10733 1315 19 learning learning NOUN dad-10733 1315 20 and and CCONJ dad-10733 1315 21 teaching teaching NOUN dad-10733 1315 22 . . PUNCT dad-10733 1316 1 corpus corpus NOUN dad-10733 1316 2 linguistics linguistic NOUN dad-10733 1316 3 and and CCONJ dad-10733 1316 4 variation variation NOUN dad-10733 1316 5 in in ADP dad-10733 1316 6 english english PROPN dad-10733 1316 7 : : PUNCT dad-10733 1316 8 focus focus VERB dad-10733 1316 9 on on ADP dad-10733 1316 10 non non ADJ dad-10733 1316 11 - - ADJ dad-10733 1316 12 native native ADJ dad-10733 1316 13 englishes english NOUN dad-10733 1316 14 , , PUNCT dad-10733 1316 15 2013 2013 NUM dad-10733 1316 16 . . PUNCT dad-10733 1317 1 e. e. PROPN dad-10733 1317 2 douglas douglas PROPN dad-10733 1317 3 - - PROPN dad-10733 1317 4 cowie cowie PROPN dad-10733 1317 5 , , PUNCT dad-10733 1317 6 r. r. PROPN dad-10733 1317 7 cowie cowie PROPN dad-10733 1317 8 , , PUNCT dad-10733 1317 9 i. i. PROPN dad-10733 1317 10 sneddon sneddon PROPN dad-10733 1317 11 , , PUNCT dad-10733 1317 12 c. c. PROPN dad-10733 1317 13 cox cox PROPN dad-10733 1317 14 , , PUNCT dad-10733 1317 15 o. o. PROPN dad-10733 1317 16 lowry lowry PROPN dad-10733 1317 17 , , PUNCT dad-10733 1317 18 m. m. NOUN dad-10733 1317 19 mcrorie mcrorie PROPN dad-10733 1317 20 , , PUNCT dad-10733 1317 21 j. j. PROPN dad-10733 1317 22 martin martin PROPN dad-10733 1317 23 , , PUNCT dad-10733 1317 24 l. l. PROPN dad-10733 1317 25 devillers devillers PROPN dad-10733 1317 26 , , PUNCT dad-10733 1317 27 s. s. PROPN dad-10733 1317 28 abrilian abrilian PROPN dad-10733 1317 29 , , PUNCT dad-10733 1317 30 a. a. NOUN dad-10733 1317 31 batliner batliner NOUN dad-10733 1317 32 , , PUNCT dad-10733 1317 33 et et PROPN dad-10733 1317 34 al al PROPN dad-10733 1317 35 . . PUNCT dad-10733 1318 1 the the DET dad-10733 1318 2 humaine humaine PROPN dad-10733 1318 3 database database NOUN dad-10733 1318 4 : : PUNCT dad-10733 1318 5 addressing address VERB dad-10733 1318 6 the the DET dad-10733 1318 7 collection collection NOUN dad-10733 1318 8 and and CCONJ dad-10733 1318 9 annotation annotation NOUN dad-10733 1318 10 of of ADP dad-10733 1318 11 naturalistic naturalistic ADJ dad-10733 1318 12 and and CCONJ dad-10733 1318 13 induced induce VERB dad-10733 1318 14 emotional emotional ADJ dad-10733 1318 15 data datum NOUN dad-10733 1318 16 . . PUNCT dad-10733 1319 1 in in ADP dad-10733 1319 2 affective affective ADJ dad-10733 1319 3 computing computing NOUN dad-10733 1319 4 and and CCONJ dad-10733 1319 5 intelligent intelligent ADJ dad-10733 1319 6 interaction interaction NOUN dad-10733 1319 7 , , PUNCT dad-10733 1319 8 pages page NOUN dad-10733 1319 9 488–500 488–500 NUM dad-10733 1319 10 . . PUNCT dad-10733 1319 11 springer springer NOUN dad-10733 1319 12 , , PUNCT dad-10733 1319 13 2007 2007 NUM dad-10733 1319 14 . . PUNCT dad-10733 1320 1 w. w. PROPN dad-10733 1320 2 eckert eckert PROPN dad-10733 1320 3 , , PUNCT dad-10733 1320 4 e. e. PROPN dad-10733 1320 5 levin levin PROPN dad-10733 1320 6 , , PUNCT dad-10733 1320 7 and and CCONJ dad-10733 1320 8 r. r. PROPN dad-10733 1320 9 pieraccini pieraccini PROPN dad-10733 1320 10 . . PUNCT dad-10733 1321 1 user user NOUN dad-10733 1321 2 modeling modeling NOUN dad-10733 1321 3 for for ADP dad-10733 1321 4 spoken spoken ADJ dad-10733 1321 5 dialogue dialogue NOUN dad-10733 1321 6 system system NOUN dad-10733 1321 7 evaluation evaluation NOUN dad-10733 1321 8 . . PUNCT dad-10733 1322 1 in in ADP dad-10733 1322 2 automatic automatic ADJ dad-10733 1322 3 speech speech NOUN dad-10733 1322 4 recognition recognition NOUN dad-10733 1322 5 and and CCONJ dad-10733 1322 6 understanding understanding NOUN dad-10733 1322 7 , , PUNCT dad-10733 1322 8 1997 1997 NUM dad-10733 1322 9 . . PUNCT dad-10733 1323 1 proceedings proceeding NOUN dad-10733 1323 2 . . PUNCT dad-10733 1324 1 , , PUNCT dad-10733 1324 2 1997 1997 NUM dad-10733 1324 3 ieee ieee NOUN dad-10733 1324 4 workshop workshop NOUN dad-10733 1324 5 on on ADP dad-10733 1324 6 , , PUNCT dad-10733 1324 7 pages page NOUN dad-10733 1324 8 80–87 80–87 NUM dad-10733 1324 9 , , PUNCT dad-10733 1324 10 1997 1997 NUM dad-10733 1324 11 . . PUNCT dad-10733 1325 1 l. l. PROPN dad-10733 1325 2 el el PROPN dad-10733 1325 3 asri asri PROPN dad-10733 1325 4 , , PUNCT dad-10733 1325 5 h. h. PROPN dad-10733 1325 6 schulz schulz PROPN dad-10733 1325 7 , , PUNCT dad-10733 1325 8 s. s. PROPN dad-10733 1325 9 sharma sharma PROPN dad-10733 1325 10 , , PUNCT dad-10733 1325 11 j. j. PROPN dad-10733 1325 12 zumer zumer PROPN dad-10733 1325 13 , , PUNCT dad-10733 1325 14 j. j. PROPN dad-10733 1325 15 harris harris PROPN dad-10733 1325 16 , , PUNCT dad-10733 1325 17 e. e. PROPN dad-10733 1325 18 fine fine PROPN dad-10733 1325 19 , , PUNCT dad-10733 1325 20 r. r. PROPN dad-10733 1325 21 mehrotra mehrotra PROPN dad-10733 1325 22 , , PUNCT dad-10733 1325 23 and and CCONJ dad-10733 1325 24 k. k. PROPN dad-10733 1325 25 suleman suleman PROPN dad-10733 1325 26 . . PUNCT dad-10733 1326 1 frames frame NOUN dad-10733 1326 2 : : PUNCT dad-10733 1326 3 acorpus acorpus PROPN dad-10733 1326 4 for for ADP dad-10733 1326 5 adding add VERB dad-10733 1326 6 memory memory NOUN dad-10733 1326 7 to to ADP dad-10733 1326 8 goal goal NOUN dad-10733 1326 9 - - PUNCT dad-10733 1326 10 oriented orient VERB dad-10733 1326 11 dialogue dialogue NOUN dad-10733 1326 12 systems system NOUN dad-10733 1326 13 . . PUNCT dad-10733 1327 1 preprint preprint NOUN dad-10733 1327 2 on on ADP dad-10733 1327 3 webpage webpage NOUN dad-10733 1327 4 at at ADP dad-10733 1327 5 http://www.maluuba.com/ http://www.maluuba.com/ ADJ dad-10733 1327 6 publications/ publications/ NUM dad-10733 1327 7 , , PUNCT dad-10733 1327 8 2017 2017 NUM dad-10733 1327 9 . . PUNCT dad-10733 1328 1 m. m. NOUN dad-10733 1328 2 elsner elsner NOUN dad-10733 1328 3 and and CCONJ dad-10733 1328 4 e. e. PROPN dad-10733 1328 5 charniak charniak PROPN dad-10733 1328 6 . . PUNCT dad-10733 1329 1 you you PRON dad-10733 1329 2 talking talk VERB dad-10733 1329 3 to to ADP dad-10733 1329 4 me i PRON dad-10733 1329 5 ? ? PUNCT dad-10733 1330 1 a a DET dad-10733 1330 2 corpus corpus NOUN dad-10733 1330 3 and and CCONJ dad-10733 1330 4 algorithm algorithm NOUN dad-10733 1330 5 for for ADP dad-10733 1330 6 conversation conversation NOUN dad-10733 1330 7 disentanglement disentanglement NOUN dad-10733 1330 8 . . PUNCT dad-10733 1331 1 in in ADP dad-10733 1331 2 association association NOUN dad-10733 1331 3 for for ADP dad-10733 1331 4 computational computational ADJ dad-10733 1331 5 linguistics linguistic NOUN dad-10733 1331 6 ( ( PUNCT dad-10733 1331 7 acl acl PROPN dad-10733 1331 8 ) ) PUNCT dad-10733 1331 9 , , PUNCT dad-10733 1331 10 2008 2008 NUM dad-10733 1331 11 . . PUNCT dad-10733 1332 1 m. m. NOUN dad-10733 1332 2 elsner elsner NOUN dad-10733 1332 3 and and CCONJ dad-10733 1332 4 e. e. PROPN dad-10733 1332 5 charniak charniak PROPN dad-10733 1332 6 . . PUNCT dad-10733 1333 1 disentangling disentangle VERB dad-10733 1333 2 chat chat PROPN dad-10733 1333 3 . . PUNCT dad-10733 1334 1 computational computational ADJ dad-10733 1334 2 linguistics linguistic NOUN dad-10733 1334 3 , , PUNCT dad-10733 1334 4 36(3):389–409 36(3):389–409 PROPN dad-10733 1334 5 , , PUNCT dad-10733 1334 6 2010 2010 NUM dad-10733 1334 7 . . PUNCT dad-10733 1335 1 d. d. PROPN dad-10733 1335 2 erhan erhan PROPN dad-10733 1335 3 , , PUNCT dad-10733 1335 4 y. y. PROPN dad-10733 1335 5 bengio bengio PROPN dad-10733 1335 6 , , PUNCT dad-10733 1335 7 a. a. NOUN dad-10733 1335 8 courville courville NOUN dad-10733 1335 9 , , PUNCT dad-10733 1335 10 pierre pierre NOUN dad-10733 1335 11 - - PUNCT dad-10733 1335 12 a. a. NOUN dad-10733 1335 13 manzagol manzagol NOUN dad-10733 1335 14 , , PUNCT dad-10733 1335 15 and and CCONJ dad-10733 1335 16 p. p. PROPN dad-10733 1335 17 vincent vincent PROPN dad-10733 1335 18 . . PUNCT dad-10733 1336 1 why why SCONJ dad-10733 1336 2 does do AUX dad-10733 1336 3 unsupervised unsupervise VERB dad-10733 1336 4 pre pre ADJ dad-10733 1336 5 - - ADJ dad-10733 1336 6 training training ADJ dad-10733 1336 7 help help NOUN dad-10733 1336 8 deep deep ADJ dad-10733 1336 9 learning learning NOUN dad-10733 1336 10 ? ? PUNCT dad-10733 1337 1 journal journal NOUN dad-10733 1337 2 of of ADP dad-10733 1337 3 machine machine NOUN dad-10733 1337 4 learning learn VERB dad-10733 1337 5 research research NOUN dad-10733 1337 6 , , PUNCT dad-10733 1337 7 11 11 NUM dad-10733 1337 8 , , PUNCT dad-10733 1337 9 2010 2010 NUM dad-10733 1337 10 . . PUNCT dad-10733 1338 1 g. g. PROPN dad-10733 1338 2 di di PROPN dad-10733 1338 3 fabbrizio fabbrizio PROPN dad-10733 1338 4 , , PUNCT dad-10733 1338 5 g. g. PROPN dad-10733 1338 6 tur tur PROPN dad-10733 1338 7 , , PUNCT dad-10733 1338 8 and and CCONJ dad-10733 1338 9 d. d. PROPN dad-10733 1338 10 hakkani hakkani PROPN dad-10733 1338 11 - - PUNCT dad-10733 1338 12 tr tr VERB dad-10733 1338 13 . . NOUN dad-10733 1338 14 bootstrapping bootstrappe VERB dad-10733 1338 15 spoken speak VERB dad-10733 1338 16 dialog dialog NOUN dad-10733 1338 17 systems system NOUN dad-10733 1338 18 with with ADP dad-10733 1338 19 data datum NOUN dad-10733 1338 20 reuse reuse NOUN dad-10733 1338 21 . . PUNCT dad-10733 1339 1 in in ADP dad-10733 1339 2 special special ADJ dad-10733 1339 3 interest interest NOUN dad-10733 1339 4 group group NOUN dad-10733 1339 5 on on ADP dad-10733 1339 6 discourse discourse NOUN dad-10733 1339 7 and and CCONJ dad-10733 1339 8 dialogue dialogue NOUN dad-10733 1339 9 ( ( PUNCT dad-10733 1339 10 sigdial sigdial ADJ dad-10733 1339 11 ) ) PUNCT dad-10733 1339 12 , , PUNCT dad-10733 1339 13 2004 2004 NUM dad-10733 1339 14 . . PUNCT dad-10733 1340 1 m. m. PROPN dad-10733 1340 2 fatemi fatemi PROPN dad-10733 1340 3 , , PUNCT dad-10733 1340 4 l. l. PROPN dad-10733 1340 5 e. e. PROPN dad-10733 1340 6 asri asri PROPN dad-10733 1340 7 , , PUNCT dad-10733 1340 8 h. h. PROPN dad-10733 1340 9 schulz schulz PROPN dad-10733 1340 10 , , PUNCT dad-10733 1340 11 j. j. PROPN dad-10733 1340 12 he he PROPN dad-10733 1340 13 , , PUNCT dad-10733 1340 14 and and CCONJ dad-10733 1340 15 k. k. PROPN dad-10733 1340 16 suleman suleman PROPN dad-10733 1340 17 . . PUNCT dad-10733 1341 1 policy policy NOUN dad-10733 1341 2 networks network NOUN dad-10733 1341 3 with with ADP dad-10733 1341 4 two two NUM dad-10733 1341 5 - - PUNCT dad-10733 1341 6 stage stage NOUN dad-10733 1341 7 training training NOUN dad-10733 1341 8 for for ADP dad-10733 1341 9 dialogue dialogue NOUN dad-10733 1341 10 systems system NOUN dad-10733 1341 11 . . PUNCT dad-10733 1342 1 in in ADP dad-10733 1342 2 special special ADJ dad-10733 1342 3 interest interest NOUN dad-10733 1342 4 group group NOUN dad-10733 1342 5 on on ADP dad-10733 1342 6 discourse discourse NOUN dad-10733 1342 7 and and CCONJ dad-10733 1342 8 dialogue dialogue NOUN dad-10733 1342 9 ( ( PUNCT dad-10733 1342 10 sigdial sigdial ADJ dad-10733 1342 11 ) ) PUNCT dad-10733 1342 12 , , PUNCT dad-10733 1342 13 2016 2016 NUM dad-10733 1342 14 . . PUNCT dad-10733 1343 1 maryam maryam PROPN dad-10733 1343 2 fazel fazel PROPN dad-10733 1343 3 - - PUNCT dad-10733 1343 4 zarandi zarandi PROPN dad-10733 1343 5 , , PUNCT dad-10733 1343 6 shang shang PROPN dad-10733 1343 7 - - PUNCT dad-10733 1343 8 wen wen PROPN dad-10733 1343 9 li li PROPN dad-10733 1343 10 , , PUNCT dad-10733 1343 11 jin jin PROPN dad-10733 1343 12 cao cao PROPN dad-10733 1343 13 , , PUNCT dad-10733 1343 14 jared jared PROPN dad-10733 1343 15 casale casale PROPN dad-10733 1343 16 , , PUNCT dad-10733 1343 17 peter peter PROPN dad-10733 1343 18 henderson henderson PROPN dad-10733 1343 19 , , PUNCT dad-10733 1343 20 david david PROPN dad-10733 1343 21 whitney whitney PROPN dad-10733 1343 22 , , PUNCT dad-10733 1343 23 and and CCONJ dad-10733 1343 24 alborz alborz ADJ dad-10733 1343 25 geramifard geramifard NOUN dad-10733 1343 26 . . PUNCT dad-10733 1344 1 learning learn VERB dad-10733 1344 2 robust robust ADJ dad-10733 1344 3 dialog dialog NOUN dad-10733 1344 4 policies policy NOUN dad-10733 1344 5 in in ADP dad-10733 1344 6 noisy noisy ADJ dad-10733 1344 7 environments environment NOUN dad-10733 1344 8 . . PUNCT dad-10733 1345 1 neural neural ADJ dad-10733 1345 2 information information NOUN dad-10733 1345 3 processing processing NOUN dad-10733 1345 4 systems system NOUN dad-10733 1345 5 ( ( PUNCT dad-10733 1345 6 nips nip NOUN dad-10733 1345 7 ) ) PUNCT dad-10733 1345 8 , , PUNCT dad-10733 1345 9 conversational conversational ADJ dad-10733 1345 10 ai ai NOUN dad-10733 1345 11 workshop workshop NOUN dad-10733 1345 12 , , PUNCT dad-10733 1345 13 2017 2017 NUM dad-10733 1345 14 . . PUNCT dad-10733 1346 1 d. d. PROPN dad-10733 1346 2 fisher fisher PROPN dad-10733 1346 3 , , PUNCT dad-10733 1346 4 m. m. NOUN dad-10733 1346 5 smith smith PROPN dad-10733 1346 6 , , PUNCT dad-10733 1346 7 and and CCONJ dad-10733 1346 8 h. h. PROPN dad-10733 1346 9 t t PROPN dad-10733 1346 10 welser welser NOUN dad-10733 1346 11 . . PUNCT dad-10733 1347 1 you you PRON dad-10733 1347 2 are be AUX dad-10733 1347 3 who who PRON dad-10733 1347 4 you you PRON dad-10733 1347 5 talk talk VERB dad-10733 1347 6 to to ADP dad-10733 1347 7 : : PUNCT dad-10733 1347 8 detecting detect VERB dad-10733 1347 9 roles role NOUN dad-10733 1347 10 in in ADP dad-10733 1347 11 usenet usenet NOUN dad-10733 1347 12 newsgroups newsgroup NOUN dad-10733 1347 13 . . PUNCT dad-10733 1348 1 in in ADP dad-10733 1348 2 hawaii hawaii PROPN dad-10733 1348 3 international international ADJ dad-10733 1348 4 conference conference NOUN dad-10733 1348 5 on on ADP dad-10733 1348 6 system system NOUN dad-10733 1348 7 sciences science NOUN dad-10733 1348 8 ( ( PUNCT dad-10733 1348 9 hicss’06 hicss’06 PROPN dad-10733 1348 10 ) ) PUNCT dad-10733 1348 11 , , PUNCT dad-10733 1348 12 volume volume NOUN dad-10733 1348 13 3 3 NUM dad-10733 1348 14 , , PUNCT dad-10733 1348 15 pages page NOUN dad-10733 1348 16 59b–59b 59b–59b NUM dad-10733 1348 17 , , PUNCT dad-10733 1348 18 2006 2006 NUM dad-10733 1348 19 . . PUNCT dad-10733 1349 1 p. p. NOUN dad-10733 1349 2 forchini forchini PROPN dad-10733 1349 3 . . PUNCT dad-10733 1350 1 spontaneity spontaneity PROPN dad-10733 1350 2 reloaded reload VERB dad-10733 1350 3 : : PUNCT dad-10733 1350 4 american american ADJ dad-10733 1350 5 face face NOUN dad-10733 1350 6 - - PUNCT dad-10733 1350 7 to to ADP dad-10733 1350 8 - - PUNCT dad-10733 1350 9 face face NOUN dad-10733 1350 10 and and CCONJ dad-10733 1350 11 movie movie NOUN dad-10733 1350 12 conversation conversation NOUN dad-10733 1350 13 compared compare VERB dad-10733 1350 14 . . PUNCT dad-10733 1351 1 in in ADP dad-10733 1351 2 corpus corpus PROPN dad-10733 1351 3 linguistics linguistic NOUN dad-10733 1351 4 , , PUNCT dad-10733 1351 5 2009 2009 NUM dad-10733 1351 6 . . PUNCT dad-10733 1352 1 p. p. NOUN dad-10733 1352 2 forchini forchini PROPN dad-10733 1352 3 . . PUNCT dad-10733 1353 1 movie movie NOUN dad-10733 1353 2 language language NOUN dad-10733 1353 3 revisited revisit VERB dad-10733 1353 4 . . PUNCT dad-10733 1354 1 evidence evidence NOUN dad-10733 1354 2 from from ADP dad-10733 1354 3 multi multi ADJ dad-10733 1354 4 - - ADJ dad-10733 1354 5 dimensional dimensional ADJ dad-10733 1354 6 analysis analysis NOUN dad-10733 1354 7 and and CCONJ dad-10733 1354 8 corpora corpus NOUN dad-10733 1354 9 . . PUNCT dad-10733 1355 1 peter peter PROPN dad-10733 1355 2 lang lang PROPN dad-10733 1355 3 , , PUNCT dad-10733 1355 4 2012 2012 NUM dad-10733 1355 5 . . PUNCT dad-10733 1356 1 g. g. PROPN dad-10733 1356 2 forgues forgues PROPN dad-10733 1356 3 , , PUNCT dad-10733 1356 4 j. j. PROPN dad-10733 1356 5 pineau pineau PROPN dad-10733 1356 6 , , PUNCT dad-10733 1356 7 j. j. PROPN dad-10733 1356 8 larchevêque larchevêque PROPN dad-10733 1356 9 , , PUNCT dad-10733 1356 10 and and CCONJ dad-10733 1356 11 r. r. PROPN dad-10733 1356 12 tremblay tremblay PROPN dad-10733 1356 13 . . PUNCT dad-10733 1357 1 bootstrapping bootstrappe VERB dad-10733 1357 2 dialog dialog NOUN dad-10733 1357 3 systems system NOUN dad-10733 1357 4 with with ADP dad-10733 1357 5 word word NOUN dad-10733 1357 6 embeddings embedding NOUN dad-10733 1357 7 . . PUNCT dad-10733 1358 1 in in ADP dad-10733 1358 2 workshop workshop NOUN dad-10733 1358 3 on on ADP dad-10733 1358 4 modern modern ADJ dad-10733 1358 5 machine machine NOUN dad-10733 1358 6 learning learning NOUN dad-10733 1358 7 and and CCONJ dad-10733 1358 8 natural natural ADJ dad-10733 1358 9 language language NOUN dad-10733 1358 10 processing processing NOUN dad-10733 1358 11 , , PUNCT dad-10733 1358 12 neural neural ADJ dad-10733 1358 13 information information NOUN dad-10733 1358 14 processing processing NOUN dad-10733 1358 15 systems system NOUN dad-10733 1358 16 ( ( PUNCT dad-10733 1358 17 nips nip NOUN dad-10733 1358 18 ) ) PUNCT dad-10733 1358 19 , , PUNCT dad-10733 1358 20 2014 2014 NUM dad-10733 1358 21 . . PUNCT dad-10733 1359 1 e. e. PROPN dad-10733 1359 2 n. n. PROPN dad-10733 1359 3 forsyth forsyth PROPN dad-10733 1359 4 and and CCONJ dad-10733 1359 5 c. c. PROPN dad-10733 1359 6 h. h. PROPN dad-10733 1359 7 martell martell PROPN dad-10733 1359 8 . . PUNCT dad-10733 1360 1 lexical lexical ADJ dad-10733 1360 2 and and CCONJ dad-10733 1360 3 discourse discourse VERB dad-10733 1360 4 analysis analysis NOUN dad-10733 1360 5 of of ADP dad-10733 1360 6 online online ADJ dad-10733 1360 7 chat chat NOUN dad-10733 1360 8 dialog dialog NOUN dad-10733 1360 9 . . PUNCT dad-10733 1361 1 in in ADP dad-10733 1361 2 international international ADJ dad-10733 1361 3 conference conference NOUN dad-10733 1361 4 on on ADP dad-10733 1361 5 semantic semantic ADJ dad-10733 1361 6 computing computing NOUN dad-10733 1361 7 ( ( PUNCT dad-10733 1361 8 icsc icsc PROPN dad-10733 1361 9 ) ) PUNCT dad-10733 1361 10 . . PUNCT dad-10733 1362 1 , , PUNCT dad-10733 1362 2 pages page NOUN dad-10733 1362 3 19–26 19–26 NUM dad-10733 1362 4 , , PUNCT dad-10733 1362 5 2007 2007 NUM dad-10733 1362 6 . . PUNCT dad-10733 1363 1 m. m. NOUN dad-10733 1363 2 galley galley NOUN dad-10733 1363 3 , , PUNCT dad-10733 1363 4 c. c. PROPN dad-10733 1363 5 brockett brockett PROPN dad-10733 1363 6 , , PUNCT dad-10733 1363 7 a. a. PROPN dad-10733 1363 8 sordoni sordoni PROPN dad-10733 1363 9 , , PUNCT dad-10733 1363 10 y. y. PROPN dad-10733 1363 11 ji ji PROPN dad-10733 1363 12 , , PUNCT dad-10733 1363 13 m. m. NOUN dad-10733 1363 14 auli auli PROPN dad-10733 1363 15 , , PUNCT dad-10733 1363 16 c. c. PROPN dad-10733 1363 17 quirk quirk PROPN dad-10733 1363 18 , , PUNCT dad-10733 1363 19 m. m. PROPN dad-10733 1363 20 mitchell mitchell PROPN dad-10733 1363 21 , , PUNCT dad-10733 1363 22 j. j. PROPN dad-10733 1363 23 gao gao PROPN dad-10733 1363 24 , , PUNCT dad-10733 1363 25 and and CCONJ dad-10733 1363 26 b. b. PROPN dad-10733 1363 27 dolan dolan PROPN dad-10733 1363 28 . . PUNCT dad-10733 1364 1 deltableu deltableu PROPN dad-10733 1364 2 : : PUNCT dad-10733 1364 3 a a DET dad-10733 1364 4 discriminative discriminative NOUN dad-10733 1364 5 metric metric ADJ dad-10733 1364 6 for for ADP dad-10733 1364 7 generation generation NOUN dad-10733 1364 8 tasks task NOUN dad-10733 1364 9 with with ADP dad-10733 1364 10 intrinsically intrinsically ADV dad-10733 1364 11 diverse diverse ADJ dad-10733 1364 12 targets target NOUN dad-10733 1364 13 . . PUNCT dad-10733 1365 1 in in ADP dad-10733 1365 2 association association NOUN dad-10733 1365 3 for for ADP dad-10733 1365 4 computational computational ADJ dad-10733 1365 5 linguistics linguistic NOUN dad-10733 1365 6 and and CCONJ dad-10733 1365 7 international international ADJ dad-10733 1365 8 joint joint ADJ dad-10733 1365 9 conference conference NOUN dad-10733 1365 10 on on ADP dad-10733 1365 11 natural natural ADJ dad-10733 1365 12 language language NOUN dad-10733 1365 13 processing processing NOUN dad-10733 1365 14 of of ADP dad-10733 1365 15 the the DET dad-10733 1365 16 asian asian PROPN dad-10733 1365 17 federation federation PROPN dad-10733 1365 18 of of ADP dad-10733 1365 19 natural natural ADJ dad-10733 1365 20 language language NOUN dad-10733 1365 21 processing processing NOUN dad-10733 1365 22 , , PUNCT dad-10733 1365 23 pages page NOUN dad-10733 1365 24 445–450 445–450 NUM dad-10733 1365 25 , , PUNCT dad-10733 1365 26 2015 2015 NUM dad-10733 1365 27 . . PUNCT dad-10733 1366 1 m. m. NOUN dad-10733 1366 2 gašić gašić PROPN dad-10733 1366 3 , , PUNCT dad-10733 1366 4 f. f. PROPN dad-10733 1366 5 jurčı́ček jurčı́ček PROPN dad-10733 1366 6 , , PUNCT dad-10733 1366 7 s. s. PROPN dad-10733 1366 8 keizer keizer PROPN dad-10733 1366 9 , , PUNCT dad-10733 1366 10 f. f. PROPN dad-10733 1366 11 mairesse mairesse PROPN dad-10733 1366 12 , , PUNCT dad-10733 1366 13 b. b. PROPN dad-10733 1366 14 thomson thomson PROPN dad-10733 1366 15 , , PUNCT dad-10733 1366 16 k. k. PROPN dad-10733 1366 17 yu yu PROPN dad-10733 1366 18 , , PUNCT dad-10733 1366 19 and and CCONJ dad-10733 1366 20 s. s. PROPN dad-10733 1366 21 young young PROPN dad-10733 1366 22 . . PUNCT dad-10733 1367 1 gaussian gaussian ADJ dad-10733 1367 2 processes process NOUN dad-10733 1367 3 for for ADP dad-10733 1367 4 fast fast ADJ dad-10733 1367 5 policy policy NOUN dad-10733 1367 6 optimisation optimisation NOUN dad-10733 1367 7 of of ADP dad-10733 1367 8 pomdp pomdp NOUN dad-10733 1367 9 - - PUNCT dad-10733 1367 10 based base VERB dad-10733 1367 11 dialogue dialogue NOUN dad-10733 1367 12 managers manager NOUN dad-10733 1367 13 . . PUNCT dad-10733 1368 1 in in ADP dad-10733 1368 2 special special ADJ dad-10733 1368 3 interest interest NOUN dad-10733 1368 4 group group NOUN dad-10733 1368 5 on on ADP dad-10733 1368 6 discourse discourse NOUN dad-10733 1368 7 and and CCONJ dad-10733 1368 8 dialogue dialogue NOUN dad-10733 1368 9 ( ( PUNCT dad-10733 1368 10 sigdial sigdial ADJ dad-10733 1368 11 ) ) PUNCT dad-10733 1368 12 . . PUNCT dad-10733 1369 1 acl acl PROPN dad-10733 1369 2 , , PUNCT dad-10733 1369 3 2010 2010 NUM dad-10733 1369 4 . . PUNCT dad-10733 1370 1 42 42 NUM dad-10733 1370 2 http://www.maluuba.com/publications/ http://www.maluuba.com/publications/ NOUN dad-10733 1370 3 http://www.maluuba.com/publications/ http://www.maluuba.com/publications/ ADP dad-10733 1370 4 a a DET dad-10733 1370 5 survey survey NOUN dad-10733 1370 6 of of ADP dad-10733 1370 7 available available ADJ dad-10733 1370 8 corpora corpora PROPN dad-10733 1370 9 for for ADP dad-10733 1370 10 building build VERB dad-10733 1370 11 data data NOUN dad-10733 1370 12 - - PUNCT dad-10733 1370 13 driven drive VERB dad-10733 1370 14 dialogue dialogue NOUN dad-10733 1370 15 systems systems PROPN dad-10733 1370 16 m. m. NOUN dad-10733 1370 17 gašić gašić PROPN dad-10733 1370 18 , , PUNCT dad-10733 1370 19 f. f. PROPN dad-10733 1370 20 jurčı́ček jurčı́ček PROPN dad-10733 1370 21 , , PUNCT dad-10733 1370 22 b. b. PROPN dad-10733 1370 23 thomson thomson PROPN dad-10733 1370 24 , , PUNCT dad-10733 1370 25 k. k. PROPN dad-10733 1370 26 yu yu PROPN dad-10733 1370 27 , , PUNCT dad-10733 1370 28 and and CCONJ dad-10733 1370 29 s. s. PROPN dad-10733 1370 30 young young PROPN dad-10733 1370 31 . . PUNCT dad-10733 1371 1 on on ADP dad-10733 1371 2 - - PUNCT dad-10733 1371 3 line line NOUN dad-10733 1371 4 policy policy NOUN dad-10733 1371 5 optimisation optimisation NOUN dad-10733 1371 6 of of ADP dad-10733 1371 7 spoken spoken ADJ dad-10733 1371 8 dialogue dialogue NOUN dad-10733 1371 9 systems system NOUN dad-10733 1371 10 via via ADP dad-10733 1371 11 live live ADJ dad-10733 1371 12 interaction interaction NOUN dad-10733 1371 13 with with ADP dad-10733 1371 14 human human ADJ dad-10733 1371 15 subjects subject NOUN dad-10733 1371 16 . . PUNCT dad-10733 1372 1 in in ADP dad-10733 1372 2 ieee ieee NOUN dad-10733 1372 3 workshop workshop NOUN dad-10733 1372 4 on on ADP dad-10733 1372 5 automatic automatic ADJ dad-10733 1372 6 speech speech NOUN dad-10733 1372 7 recognition recognition NOUN dad-10733 1372 8 and and CCONJ dad-10733 1372 9 understanding understanding NOUN dad-10733 1372 10 ( ( PUNCT dad-10733 1372 11 asru asru PROPN dad-10733 1372 12 ) ) PUNCT dad-10733 1372 13 , , PUNCT dad-10733 1372 14 pages page NOUN dad-10733 1372 15 312–317 312–317 NUM dad-10733 1372 16 . . PUNCT dad-10733 1373 1 ieee ieee PROPN dad-10733 1373 2 , , PUNCT dad-10733 1373 3 2011 2011 NUM dad-10733 1373 4 . . PUNCT dad-10733 1374 1 m. m. NOUN dad-10733 1374 2 gašić gašić PROPN dad-10733 1374 3 , , PUNCT dad-10733 1374 4 m. m. PROPN dad-10733 1374 5 henderson henderson PROPN dad-10733 1374 6 , , PUNCT dad-10733 1374 7 b. b. PROPN dad-10733 1374 8 thomson thomson PROPN dad-10733 1374 9 , , PUNCT dad-10733 1374 10 p. p. PROPN dad-10733 1374 11 tsiakoulis tsiakoulis PROPN dad-10733 1374 12 , , PUNCT dad-10733 1374 13 and and CCONJ dad-10733 1374 14 s. s. PROPN dad-10733 1374 15 young young PROPN dad-10733 1374 16 . . PUNCT dad-10733 1375 1 policy policy NOUN dad-10733 1375 2 optimisation optimisation NOUN dad-10733 1375 3 of of ADP dad-10733 1375 4 pomdp pomdp NOUN dad-10733 1375 5 - - PUNCT dad-10733 1375 6 based base VERB dad-10733 1375 7 dialogue dialogue NOUN dad-10733 1375 8 systems system NOUN dad-10733 1375 9 without without ADP dad-10733 1375 10 state state NOUN dad-10733 1375 11 space space NOUN dad-10733 1375 12 compression compression NOUN dad-10733 1375 13 . . PUNCT dad-10733 1376 1 in in ADP dad-10733 1376 2 spoken spoken ADJ dad-10733 1376 3 language language NOUN dad-10733 1376 4 technology technology NOUN dad-10733 1376 5 workshop workshop NOUN dad-10733 1376 6 ( ( PUNCT dad-10733 1376 7 slt slt PROPN dad-10733 1376 8 ) ) PUNCT dad-10733 1376 9 , , PUNCT dad-10733 1376 10 2012 2012 NUM dad-10733 1376 11 ieee ieee NOUN dad-10733 1376 12 , , PUNCT dad-10733 1376 13 pages page NOUN dad-10733 1376 14 31–36 31–36 NUM dad-10733 1376 15 . . PUNCT dad-10733 1376 16 ieee ieee PROPN dad-10733 1376 17 , , PUNCT dad-10733 1376 18 2012 2012 NUM dad-10733 1376 19 . . PUNCT dad-10733 1376 20 m. m. NOUN dad-10733 1376 21 gasic gasic PROPN dad-10733 1376 22 , , PUNCT dad-10733 1376 23 c. c. PROPN dad-10733 1376 24 breslin breslin PROPN dad-10733 1376 25 , , PUNCT dad-10733 1376 26 m. m. PROPN dad-10733 1376 27 henderson henderson PROPN dad-10733 1376 28 , , PUNCT dad-10733 1376 29 d. d. PROPN dad-10733 1376 30 kim kim PROPN dad-10733 1376 31 , , PUNCT dad-10733 1376 32 m. m. NOUN dad-10733 1376 33 szummer szummer PROPN dad-10733 1376 34 , , PUNCT dad-10733 1376 35 b. b. PROPN dad-10733 1376 36 thomson thomson PROPN dad-10733 1376 37 , , PUNCT dad-10733 1376 38 p. p. PROPN dad-10733 1376 39 tsiakoulis tsiakoulis PROPN dad-10733 1376 40 , , PUNCT dad-10733 1376 41 and and CCONJ dad-10733 1376 42 s. s. PROPN dad-10733 1376 43 young young PROPN dad-10733 1376 44 . . PUNCT dad-10733 1377 1 on on ADP dad-10733 1377 2 - - PUNCT dad-10733 1377 3 line line NOUN dad-10733 1377 4 policy policy NOUN dad-10733 1377 5 optimisation optimisation NOUN dad-10733 1377 6 of of ADP dad-10733 1377 7 bayesian bayesian NOUN dad-10733 1377 8 spoken speak VERB dad-10733 1377 9 dialogue dialogue NOUN dad-10733 1377 10 systems system NOUN dad-10733 1377 11 via via ADP dad-10733 1377 12 human human ADJ dad-10733 1377 13 interaction interaction NOUN dad-10733 1377 14 . . PUNCT dad-10733 1378 1 in in ADP dad-10733 1378 2 ieee ieee PROPN dad-10733 1378 3 international international ADJ dad-10733 1378 4 conference conference NOUN dad-10733 1378 5 on on ADP dad-10733 1378 6 acoustics acoustic NOUN dad-10733 1378 7 , , PUNCT dad-10733 1378 8 speech speech NOUN dad-10733 1378 9 and and CCONJ dad-10733 1378 10 signal signal NOUN dad-10733 1378 11 processing processing NOUN dad-10733 1378 12 , , PUNCT dad-10733 1378 13 pages page NOUN dad-10733 1378 14 8367–8371 8367–8371 NUM dad-10733 1378 15 , , PUNCT dad-10733 1378 16 2013 2013 NUM dad-10733 1378 17 . . PUNCT dad-10733 1379 1 m. m. NOUN dad-10733 1379 2 gašić gašić PROPN dad-10733 1379 3 , , PUNCT dad-10733 1379 4 n. n. PROPN dad-10733 1379 5 mrkšić mrkšić PROPN dad-10733 1379 6 , , PUNCT dad-10733 1379 7 l. l. PROPN dad-10733 1379 8 m. m. PROPN dad-10733 1379 9 rojas rojas PROPN dad-10733 1379 10 - - PUNCT dad-10733 1379 11 barahona barahona PROPN dad-10733 1379 12 , , PUNCT dad-10733 1379 13 p.-h p.-h NOUN dad-10733 1379 14 . . PUNCT dad-10733 1380 1 su su PROPN dad-10733 1380 2 , , PUNCT dad-10733 1380 3 s. s. PROPN dad-10733 1380 4 ultes ultes PROPN dad-10733 1380 5 , , PUNCT dad-10733 1380 6 d. d. PROPN dad-10733 1380 7 vandyke vandyke PROPN dad-10733 1380 8 , , PUNCT dad-10733 1380 9 t.-h t.-h PROPN dad-10733 1380 10 . . PUNCT dad-10733 1381 1 wen wen PROPN dad-10733 1381 2 , , PUNCT dad-10733 1381 3 and and CCONJ dad-10733 1381 4 s. s. PROPN dad-10733 1381 5 young young PROPN dad-10733 1381 6 . . PUNCT dad-10733 1382 1 dialogue dialogue NOUN dad-10733 1382 2 manager manager NOUN dad-10733 1382 3 domain domain NOUN dad-10733 1382 4 adaptation adaptation NOUN dad-10733 1382 5 using use VERB dad-10733 1382 6 gaussian gaussian ADJ dad-10733 1382 7 process process NOUN dad-10733 1382 8 reinforcement reinforcement NOUN dad-10733 1382 9 learning learning NOUN dad-10733 1382 10 . . PUNCT dad-10733 1383 1 computer computer NOUN dad-10733 1383 2 speech speech NOUN dad-10733 1383 3 & & CCONJ dad-10733 1383 4 language language NOUN dad-10733 1383 5 , , PUNCT dad-10733 1383 6 2016 2016 NUM dad-10733 1383 7 . . PUNCT dad-10733 1384 1 a. a. NOUN dad-10733 1384 2 genevay genevay NOUN dad-10733 1384 3 and and CCONJ dad-10733 1384 4 r. r. PROPN dad-10733 1384 5 laroche laroche PROPN dad-10733 1384 6 . . PUNCT dad-10733 1385 1 transfer transfer NOUN dad-10733 1385 2 learning learning NOUN dad-10733 1385 3 for for ADP dad-10733 1385 4 user user NOUN dad-10733 1385 5 adaptation adaptation NOUN dad-10733 1385 6 in in ADP dad-10733 1385 7 spoken spoken ADJ dad-10733 1385 8 dialogue dialogue NOUN dad-10733 1385 9 systems system NOUN dad-10733 1385 10 . . PUNCT dad-10733 1386 1 in in ADP dad-10733 1386 2 international international ADJ dad-10733 1386 3 conference conference NOUN dad-10733 1386 4 on on ADP dad-10733 1386 5 autonomous autonomous ADJ dad-10733 1386 6 agents agent NOUN dad-10733 1386 7 & & CCONJ dad-10733 1386 8 multiagent multiagent PROPN dad-10733 1386 9 systems system NOUN dad-10733 1386 10 , , PUNCT dad-10733 1386 11 pages page NOUN dad-10733 1386 12 975–983 975–983 NUM dad-10733 1386 13 . . PUNCT dad-10733 1387 1 international international ADJ dad-10733 1387 2 foundation foundation PROPN dad-10733 1387 3 for for ADP dad-10733 1387 4 autonomous autonomous ADJ dad-10733 1387 5 agents agent NOUN dad-10733 1387 6 and and CCONJ dad-10733 1387 7 multiagent multiagent NOUN dad-10733 1387 8 systems system NOUN dad-10733 1387 9 , , PUNCT dad-10733 1387 10 2016 2016 NUM dad-10733 1387 11 . . PUNCT dad-10733 1388 1 k. k. PROPN dad-10733 1388 2 georgila georgila PROPN dad-10733 1388 3 , , PUNCT dad-10733 1388 4 j. j. PROPN dad-10733 1388 5 henderson henderson PROPN dad-10733 1388 6 , , PUNCT dad-10733 1388 7 and and CCONJ dad-10733 1388 8 o. o. PROPN dad-10733 1388 9 lemon lemon NOUN dad-10733 1388 10 . . PUNCT dad-10733 1389 1 user user NOUN dad-10733 1389 2 simulation simulation NOUN dad-10733 1389 3 for for ADP dad-10733 1389 4 spoken spoken ADJ dad-10733 1389 5 dialogue dialogue NOUN dad-10733 1389 6 systems system NOUN dad-10733 1389 7 : : PUNCT dad-10733 1389 8 learning learning NOUN dad-10733 1389 9 and and CCONJ dad-10733 1389 10 evaluation evaluation NOUN dad-10733 1389 11 . . PUNCT dad-10733 1390 1 in in ADP dad-10733 1390 2 interspeech interspeech NOUN dad-10733 1390 3 , , PUNCT dad-10733 1390 4 2006 2006 NUM dad-10733 1390 5 . . PUNCT dad-10733 1391 1 k. k. PROPN dad-10733 1391 2 georgila georgila PROPN dad-10733 1391 3 , , PUNCT dad-10733 1391 4 m. m. NOUN dad-10733 1391 5 wolters wolters PROPN dad-10733 1391 6 , , PUNCT dad-10733 1391 7 j. j. PROPN dad-10733 1391 8 d. d. PROPN dad-10733 1391 9 moore moore PROPN dad-10733 1391 10 , , PUNCT dad-10733 1391 11 and and CCONJ dad-10733 1391 12 r. r. PROPN dad-10733 1391 13 h. h. PROPN dad-10733 1391 14 logie logie PROPN dad-10733 1391 15 . . PUNCT dad-10733 1392 1 the the DET dad-10733 1392 2 match match NOUN dad-10733 1392 3 corpus corpus PROPN dad-10733 1392 4 : : PUNCT dad-10733 1392 5 a a DET dad-10733 1392 6 corpus corpus NOUN dad-10733 1392 7 of of ADP dad-10733 1392 8 older old ADJ dad-10733 1392 9 and and CCONJ dad-10733 1392 10 younger young ADJ dad-10733 1392 11 users user NOUN dad-10733 1392 12 interactions interaction NOUN dad-10733 1392 13 with with ADP dad-10733 1392 14 spoken spoken ADJ dad-10733 1392 15 dialogue dialogue NOUN dad-10733 1392 16 systems system NOUN dad-10733 1392 17 . . PUNCT dad-10733 1393 1 language language NOUN dad-10733 1393 2 resources resource NOUN dad-10733 1393 3 and and CCONJ dad-10733 1393 4 evaluation evaluation NOUN dad-10733 1393 5 , , PUNCT dad-10733 1393 6 44(3):221–261 44(3):221–261 NUM dad-10733 1393 7 , , PUNCT dad-10733 1393 8 2010 2010 NUM dad-10733 1393 9 . . PUNCT dad-10733 1394 1 j. j. PROPN dad-10733 1394 2 gibson gibson PROPN dad-10733 1394 3 and and CCONJ dad-10733 1394 4 a. a. PROPN dad-10733 1394 5 d. d. PROPN dad-10733 1394 6 pick pick PROPN dad-10733 1394 7 . . PUNCT dad-10733 1395 1 perception perception NOUN dad-10733 1395 2 of of ADP dad-10733 1395 3 another another DET dad-10733 1395 4 person person NOUN dad-10733 1395 5 ’s ’s PART dad-10733 1395 6 looking look VERB dad-10733 1395 7 behavior behavior NOUN dad-10733 1395 8 . . PUNCT dad-10733 1396 1 the the DET dad-10733 1396 2 american american PROPN dad-10733 1396 3 journal journal PROPN dad-10733 1396 4 of of ADP dad-10733 1396 5 psychology psychology NOUN dad-10733 1396 6 , , PUNCT dad-10733 1396 7 76(3 76(3 PROPN dad-10733 1396 8 ): ): PUNCT dad-10733 1396 9 386–394 386–394 NUM dad-10733 1396 10 , , PUNCT dad-10733 1396 11 1963 1963 NUM dad-10733 1396 12 . . PUNCT dad-10733 1397 1 j. j. PROPN dad-10733 1397 2 j j PROPN dad-10733 1397 3 godfrey godfrey PROPN dad-10733 1397 4 , , PUNCT dad-10733 1397 5 e. e. PROPN dad-10733 1397 6 c c PROPN dad-10733 1397 7 holliman holliman PROPN dad-10733 1397 8 , , PUNCT dad-10733 1397 9 and and CCONJ dad-10733 1397 10 j j PROPN dad-10733 1397 11 mcdaniel mcdaniel PROPN dad-10733 1397 12 . . PROPN dad-10733 1397 13 switchboard switchboard PROPN dad-10733 1397 14 : : PUNCT dad-10733 1397 15 telephone telephone NOUN dad-10733 1397 16 speech speech NOUN dad-10733 1397 17 corpus corpus NOUN dad-10733 1397 18 for for ADP dad-10733 1397 19 research research NOUN dad-10733 1397 20 and and CCONJ dad-10733 1397 21 development development NOUN dad-10733 1397 22 . . PUNCT dad-10733 1398 1 in in ADP dad-10733 1398 2 international international ADJ dad-10733 1398 3 conference conference NOUN dad-10733 1398 4 on on ADP dad-10733 1398 5 acoustics acoustic NOUN dad-10733 1398 6 , , PUNCT dad-10733 1398 7 speech speech NOUN dad-10733 1398 8 , , PUNCT dad-10733 1398 9 and and CCONJ dad-10733 1398 10 signal signal NOUN dad-10733 1398 11 processing processing NOUN dad-10733 1398 12 ( ( PUNCT dad-10733 1398 13 icassp-92 icassp-92 PROPN dad-10733 1398 14 ) ) PUNCT dad-10733 1398 15 , , PUNCT dad-10733 1398 16 1992 1992 NUM dad-10733 1398 17 . . PUNCT dad-10733 1399 1 i. i. PROPN dad-10733 1399 2 goodfellow goodfellow PROPN dad-10733 1399 3 , , PUNCT dad-10733 1399 4 a. a. NOUN dad-10733 1399 5 courville courville NOUN dad-10733 1399 6 , , PUNCT dad-10733 1399 7 and and CCONJ dad-10733 1399 8 y. y. PROPN dad-10733 1399 9 bengio bengio PROPN dad-10733 1399 10 . . PUNCT dad-10733 1400 1 deep deep ADJ dad-10733 1400 2 learning learning NOUN dad-10733 1400 3 . . PUNCT dad-10733 1401 1 book book NOUN dad-10733 1401 2 in in ADP dad-10733 1401 3 preparation preparation NOUN dad-10733 1401 4 for for ADP dad-10733 1401 5 mit mit PROPN dad-10733 1401 6 press press NOUN dad-10733 1401 7 , , PUNCT dad-10733 1401 8 2015 2015 NUM dad-10733 1401 9 . . PUNCT dad-10733 1402 1 url url PROPN dad-10733 1402 2 http http NOUN dad-10733 1402 3 : : PUNCT dad-10733 1402 4 //goodfeli.github.io //goodfeli.github.io SYM dad-10733 1402 5 / / SYM dad-10733 1402 6 dlbook/. dlbook/. PROPN dad-10733 1402 7 c. c. PROPN dad-10733 1402 8 goodwin goodwin PROPN dad-10733 1402 9 . . PUNCT dad-10733 1403 1 conversational conversational ADJ dad-10733 1403 2 organization organization NOUN dad-10733 1403 3 : : PUNCT dad-10733 1403 4 interaction interaction NOUN dad-10733 1403 5 between between ADP dad-10733 1403 6 speakers speaker NOUN dad-10733 1403 7 and and CCONJ dad-10733 1403 8 hearers hearer NOUN dad-10733 1403 9 . . PUNCT dad-10733 1404 1 new new PROPN dad-10733 1404 2 york york PROPN dad-10733 1404 3 : : PUNCT dad-10733 1404 4 academic academic ADJ dad-10733 1404 5 press press NOUN dad-10733 1404 6 , , PUNCT dad-10733 1404 7 1981 1981 NUM dad-10733 1404 8 . . PUNCT dad-10733 1405 1 a. a. PROPN dad-10733 1405 2 l. l. PROPN dad-10733 1405 3 gorin gorin PROPN dad-10733 1405 4 , , PUNCT dad-10733 1405 5 g. g. PROPN dad-10733 1405 6 riccardi riccardi PROPN dad-10733 1405 7 , , PUNCT dad-10733 1405 8 and and CCONJ dad-10733 1405 9 j. j. PROPN dad-10733 1405 10 h. h. PROPN dad-10733 1405 11 wright wright PROPN dad-10733 1405 12 . . PUNCT dad-10733 1406 1 how how SCONJ dad-10733 1406 2 may may AUX dad-10733 1406 3 i i PRON dad-10733 1406 4 help help VERB dad-10733 1406 5 you you PRON dad-10733 1406 6 ? ? PUNCT dad-10733 1407 1 speech speech NOUN dad-10733 1407 2 communication communication NOUN dad-10733 1407 3 , , PUNCT dad-10733 1407 4 23(1):113–127 23(1):113–127 PROPN dad-10733 1407 5 , , PUNCT dad-10733 1407 6 1997 1997 NUM dad-10733 1407 7 . . PUNCT dad-10733 1408 1 a. a. NOUN dad-10733 1408 2 graves graves PROPN dad-10733 1408 3 . . PUNCT dad-10733 1409 1 sequence sequence NOUN dad-10733 1409 2 transduction transduction NOUN dad-10733 1409 3 with with ADP dad-10733 1409 4 recurrent recurrent ADJ dad-10733 1409 5 neural neural ADJ dad-10733 1409 6 networks network NOUN dad-10733 1409 7 . . PUNCT dad-10733 1410 1 in in ADP dad-10733 1410 2 international international ADJ dad-10733 1410 3 conference conference NOUN dad-10733 1410 4 on on ADP dad-10733 1410 5 machine machine NOUN dad-10733 1410 6 learning learning NOUN dad-10733 1410 7 ( ( PUNCT dad-10733 1410 8 icml icml PROPN dad-10733 1410 9 ) ) PUNCT dad-10733 1410 10 , , PUNCT dad-10733 1410 11 representation representation NOUN dad-10733 1410 12 learning learn VERB dad-10733 1410 13 workshop workshop NOUN dad-10733 1410 14 , , PUNCT dad-10733 1410 15 2012 2012 NUM dad-10733 1410 16 . . PUNCT dad-10733 1411 1 s. s. PROPN dad-10733 1411 2 greenbaum greenbaum PROPN dad-10733 1411 3 . . PUNCT dad-10733 1412 1 comparing compare VERB dad-10733 1412 2 english english PROPN dad-10733 1412 3 worldwide worldwide ADV dad-10733 1412 4 : : PUNCT dad-10733 1412 5 the the DET dad-10733 1412 6 international international ADJ dad-10733 1412 7 corpus corpus NOUN dad-10733 1412 8 of of ADP dad-10733 1412 9 english english PROPN dad-10733 1412 10 . . PUNCT dad-10733 1413 1 clarendon clarendon PROPN dad-10733 1413 2 press press PROPN dad-10733 1413 3 , , PUNCT dad-10733 1413 4 1996 1996 NUM dad-10733 1413 5 . . PUNCT dad-10733 1414 1 s. s. PROPN dad-10733 1414 2 greenbaum greenbaum PROPN dad-10733 1414 3 and and CCONJ dad-10733 1414 4 g g PROPN dad-10733 1414 5 nelson nelson PROPN dad-10733 1414 6 . . PUNCT dad-10733 1415 1 the the DET dad-10733 1415 2 international international ADJ dad-10733 1415 3 corpus corpus NOUN dad-10733 1415 4 of of ADP dad-10733 1415 5 english english PROPN dad-10733 1415 6 ( ( PUNCT dad-10733 1415 7 ice ice NOUN dad-10733 1415 8 ) ) PUNCT dad-10733 1415 9 project project NOUN dad-10733 1415 10 . . PUNCT dad-10733 1416 1 world world NOUN dad-10733 1416 2 englishes english NOUN dad-10733 1416 3 , , PUNCT dad-10733 1416 4 15(1):3–15 15(1):3–15 NUM dad-10733 1416 5 , , PUNCT dad-10733 1416 6 1996 1996 NUM dad-10733 1416 7 . . PUNCT dad-10733 1417 1 c. c. PROPN dad-10733 1417 2 gülçehre gülçehre PROPN dad-10733 1417 3 , , PUNCT dad-10733 1417 4 o. o. PROPN dad-10733 1417 5 firat firat PROPN dad-10733 1417 6 , , PUNCT dad-10733 1417 7 k. k. PROPN dad-10733 1417 8 xu xu PROPN dad-10733 1417 9 , , PUNCT dad-10733 1418 1 k. k. PROPN dad-10733 1418 2 cho cho PROPN dad-10733 1418 3 , , PUNCT dad-10733 1418 4 l. l. PROPN dad-10733 1418 5 barrault barrault PROPN dad-10733 1418 6 , , PUNCT dad-10733 1418 7 h. h. PROPN dad-10733 1418 8 lin lin PROPN dad-10733 1418 9 , , PUNCT dad-10733 1418 10 f. f. PROPN dad-10733 1418 11 bougares bougares PROPN dad-10733 1418 12 , , PUNCT dad-10733 1418 13 h. h. PROPN dad-10733 1418 14 schwenk schwenk PROPN dad-10733 1418 15 , , PUNCT dad-10733 1418 16 and and CCONJ dad-10733 1418 17 y. y. PROPN dad-10733 1418 18 bengio bengio PROPN dad-10733 1418 19 . . PUNCT dad-10733 1419 1 on on ADP dad-10733 1419 2 using use VERB dad-10733 1419 3 monolingual monolingual ADJ dad-10733 1419 4 corpora corpora PROPN dad-10733 1419 5 in in ADP dad-10733 1419 6 neural neural ADJ dad-10733 1419 7 machine machine NOUN dad-10733 1419 8 translation translation NOUN dad-10733 1419 9 . . PUNCT dad-10733 1420 1 corr corr PROPN dad-10733 1420 2 , , PUNCT dad-10733 1420 3 abs/1503.03535 abs/1503.03535 PROPN dad-10733 1420 4 , , PUNCT dad-10733 1420 5 2015 2015 NUM dad-10733 1420 6 . . PUNCT dad-10733 1421 1 i. i. NOUN dad-10733 1421 2 gurevych gurevych PROPN dad-10733 1421 3 and and CCONJ dad-10733 1421 4 m. m. NOUN dad-10733 1421 5 strube strube NOUN dad-10733 1421 6 . . PUNCT dad-10733 1422 1 semantic semantic ADJ dad-10733 1422 2 similarity similarity NOUN dad-10733 1422 3 applied apply VERB dad-10733 1422 4 to to ADP dad-10733 1422 5 spoken spoken ADJ dad-10733 1422 6 dialogue dialogue NOUN dad-10733 1422 7 summarization summarization NOUN dad-10733 1422 8 . . PUNCT dad-10733 1423 1 in in ADP dad-10733 1423 2 international international ADJ dad-10733 1423 3 conference conference NOUN dad-10733 1423 4 on on ADP dad-10733 1423 5 computational computational ADJ dad-10733 1423 6 linguistics linguistic NOUN dad-10733 1423 7 ( ( PUNCT dad-10733 1423 8 coling cole VERB dad-10733 1423 9 ) ) PUNCT dad-10733 1423 10 , , PUNCT dad-10733 1423 11 2004 2004 NUM dad-10733 1423 12 . . PUNCT dad-10733 1424 1 v. v. ADP dad-10733 1424 2 haslerud haslerud PROPN dad-10733 1424 3 and and CCONJ dad-10733 1424 4 a. a. NOUN dad-10733 1424 5 stenström stenström PROPN dad-10733 1424 6 . . PUNCT dad-10733 1425 1 the the DET dad-10733 1425 2 bergen bergen PROPN dad-10733 1425 3 corpus corpus PROPN dad-10733 1425 4 of of ADP dad-10733 1425 5 london london PROPN dad-10733 1425 6 teenager teenager NOUN dad-10733 1425 7 language language NOUN dad-10733 1425 8 ( ( PUNCT dad-10733 1425 9 colt colt NOUN dad-10733 1425 10 ) ) PUNCT dad-10733 1425 11 . . PUNCT dad-10733 1426 1 spoken speak VERB dad-10733 1426 2 english english PROPN dad-10733 1426 3 on on ADP dad-10733 1426 4 computer computer NOUN dad-10733 1426 5 . . PUNCT dad-10733 1427 1 transcription transcription NOUN dad-10733 1427 2 , , PUNCT dad-10733 1427 3 mark mark NOUN dad-10733 1427 4 - - PUNCT dad-10733 1427 5 up up NOUN dad-10733 1427 6 and and CCONJ dad-10733 1427 7 application application NOUN dad-10733 1427 8 . . PUNCT dad-10733 1428 1 london london PROPN dad-10733 1428 2 : : PUNCT dad-10733 1428 3 longman longman NOUN dad-10733 1428 4 , , PUNCT dad-10733 1428 5 pages page NOUN dad-10733 1428 6 235–242 235–242 NUM dad-10733 1428 7 , , PUNCT dad-10733 1428 8 1995 1995 NUM dad-10733 1428 9 . . PUNCT dad-10733 1429 1 p. p. NOUN dad-10733 1429 2 a. a. NOUN dad-10733 1429 3 heeman heeman PROPN dad-10733 1429 4 and and CCONJ dad-10733 1429 5 j. j. PROPN dad-10733 1429 6 f. f. PROPN dad-10733 1429 7 allen allen PROPN dad-10733 1429 8 . . PUNCT dad-10733 1430 1 the the DET dad-10733 1430 2 trains train NOUN dad-10733 1430 3 93 93 NUM dad-10733 1430 4 dialogues dialogue NOUN dad-10733 1430 5 . . PUNCT dad-10733 1431 1 technical technical ADJ dad-10733 1431 2 report report PROPN dad-10733 1431 3 , , PUNCT dad-10733 1431 4 dtic dtic ADJ dad-10733 1431 5 document document NOUN dad-10733 1431 6 , , PUNCT dad-10733 1431 7 1995 1995 NUM dad-10733 1431 8 . . PUNCT dad-10733 1432 1 c. c. PROPN dad-10733 1432 2 t. t. PROPN dad-10733 1432 3 hemphill hemphill PROPN dad-10733 1432 4 , , PUNCT dad-10733 1432 5 j. j. PROPN dad-10733 1432 6 j. j. PROPN dad-10733 1432 7 godfrey godfrey PROPN dad-10733 1432 8 , , PUNCT dad-10733 1432 9 and and CCONJ dad-10733 1432 10 g. g. PROPN dad-10733 1432 11 r. r. PROPN dad-10733 1432 12 doddington doddington PROPN dad-10733 1432 13 . . PUNCT dad-10733 1433 1 the the DET dad-10733 1433 2 atis atis ADJ dad-10733 1433 3 spoken speak VERB dad-10733 1433 4 language language NOUN dad-10733 1433 5 systems system NOUN dad-10733 1433 6 pilot pilot NOUN dad-10733 1433 7 corpus corpus NOUN dad-10733 1433 8 . . PUNCT dad-10733 1434 1 in in ADP dad-10733 1434 2 darpa darpa PROPN dad-10733 1434 3 speech speech NOUN dad-10733 1434 4 and and CCONJ dad-10733 1434 5 natural natural ADJ dad-10733 1434 6 language language NOUN dad-10733 1434 7 workshop workshop NOUN dad-10733 1434 8 , , PUNCT dad-10733 1434 9 pages page NOUN dad-10733 1434 10 96–101 96–101 PROPN dad-10733 1434 11 , , PUNCT dad-10733 1434 12 1990 1990 NUM dad-10733 1434 13 . . PUNCT dad-10733 1435 1 m. m. PROPN dad-10733 1435 2 henderson henderson PROPN dad-10733 1435 3 , , PUNCT dad-10733 1435 4 b. b. PROPN dad-10733 1435 5 thomson thomson PROPN dad-10733 1435 6 , , PUNCT dad-10733 1435 7 and and CCONJ dad-10733 1435 8 s. s. PROPN dad-10733 1435 9 young young PROPN dad-10733 1435 10 . . PUNCT dad-10733 1436 1 deep deep ADJ dad-10733 1436 2 neural neural ADJ dad-10733 1436 3 network network NOUN dad-10733 1436 4 approach approach NOUN dad-10733 1436 5 for for ADP dad-10733 1436 6 the the DET dad-10733 1436 7 dialog dialog NOUN dad-10733 1436 8 state state NOUN dad-10733 1436 9 tracking tracking NOUN dad-10733 1436 10 challenge challenge NOUN dad-10733 1436 11 . . PUNCT dad-10733 1437 1 in in ADP dad-10733 1437 2 special special ADJ dad-10733 1437 3 interest interest NOUN dad-10733 1437 4 group group NOUN dad-10733 1437 5 on on ADP dad-10733 1437 6 discourse discourse NOUN dad-10733 1437 7 and and CCONJ dad-10733 1437 8 dialogue dialogue NOUN dad-10733 1437 9 ( ( PUNCT dad-10733 1437 10 sigdial sigdial ADJ dad-10733 1437 11 ) ) PUNCT dad-10733 1437 12 , , PUNCT dad-10733 1437 13 2013 2013 NUM dad-10733 1437 14 . . PUNCT dad-10733 1438 1 m. m. PROPN dad-10733 1438 2 henderson henderson PROPN dad-10733 1438 3 , , PUNCT dad-10733 1438 4 b. b. PROPN dad-10733 1438 5 thomson thomson PROPN dad-10733 1438 6 , , PUNCT dad-10733 1438 7 and and CCONJ dad-10733 1438 8 j. j. PROPN dad-10733 1438 9 williams williams PROPN dad-10733 1438 10 . . PUNCT dad-10733 1439 1 dialog dialog PROPN dad-10733 1439 2 state state NOUN dad-10733 1439 3 tracking tracking NOUN dad-10733 1439 4 challenge challenge NOUN dad-10733 1439 5 2 2 NUM dad-10733 1439 6 & & CCONJ dad-10733 1439 7 3 3 NUM dad-10733 1439 8 , , PUNCT dad-10733 1439 9 2014a 2014a NUM dad-10733 1439 10 . . PUNCT dad-10733 1440 1 m. m. PROPN dad-10733 1440 2 henderson henderson PROPN dad-10733 1440 3 , , PUNCT dad-10733 1440 4 b. b. PROPN dad-10733 1440 5 thomson thomson PROPN dad-10733 1440 6 , , PUNCT dad-10733 1440 7 and and CCONJ dad-10733 1440 8 j. j. PROPN dad-10733 1440 9 williams williams PROPN dad-10733 1440 10 . . PUNCT dad-10733 1441 1 the the DET dad-10733 1441 2 second second ADJ dad-10733 1441 3 dialog dialog NOUN dad-10733 1441 4 state state NOUN dad-10733 1441 5 tracking tracking NOUN dad-10733 1441 6 challenge challenge NOUN dad-10733 1441 7 . . PUNCT dad-10733 1442 1 in in ADP dad-10733 1442 2 special special ADJ dad-10733 1442 3 interest interest NOUN dad-10733 1442 4 group group NOUN dad-10733 1442 5 on on ADP dad-10733 1442 6 discourse discourse NOUN dad-10733 1442 7 and and CCONJ dad-10733 1442 8 dialogue dialogue NOUN dad-10733 1442 9 ( ( PUNCT dad-10733 1442 10 sigdial sigdial ADJ dad-10733 1442 11 ) ) PUNCT dad-10733 1442 12 , , PUNCT dad-10733 1442 13 2014b 2014b NUM dad-10733 1442 14 . . PUNCT dad-10733 1442 15 m. m. PROPN dad-10733 1442 16 henderson henderson PROPN dad-10733 1442 17 , , PUNCT dad-10733 1442 18 b. b. PROPN dad-10733 1442 19 thomson thomson PROPN dad-10733 1442 20 , , PUNCT dad-10733 1442 21 and and CCONJ dad-10733 1442 22 s. s. PROPN dad-10733 1442 23 young young PROPN dad-10733 1442 24 . . PUNCT dad-10733 1443 1 word word NOUN dad-10733 1443 2 - - PUNCT dad-10733 1443 3 based base VERB dad-10733 1443 4 dialog dialog NOUN dad-10733 1443 5 state state NOUN dad-10733 1443 6 tracking tracking NOUN dad-10733 1443 7 with with ADP dad-10733 1443 8 recurrent recurrent ADJ dad-10733 1443 9 neural neural ADJ dad-10733 1443 10 networks network NOUN dad-10733 1443 11 . . PUNCT dad-10733 1444 1 in in ADP dad-10733 1444 2 special special ADJ dad-10733 1444 3 interest interest NOUN dad-10733 1444 4 group group NOUN dad-10733 1444 5 on on ADP dad-10733 1444 6 discourse discourse NOUN dad-10733 1444 7 and and CCONJ dad-10733 1444 8 dialogue dialogue NOUN dad-10733 1444 9 ( ( PUNCT dad-10733 1444 10 sigdial sigdial ADJ dad-10733 1444 11 ) ) PUNCT dad-10733 1444 12 , , PUNCT dad-10733 1444 13 2014c 2014c NUM dad-10733 1444 14 . . PUNCT dad-10733 1445 1 p. p. PROPN dad-10733 1445 2 henderson henderson PROPN dad-10733 1445 3 , , PUNCT dad-10733 1445 4 k. k. PROPN dad-10733 1445 5 sinha sinha PROPN dad-10733 1445 6 , , PUNCT dad-10733 1445 7 n. n. PROPN dad-10733 1445 8 angelard angelard NOUN dad-10733 1445 9 - - PUNCT dad-10733 1445 10 gontier gontier NOUN dad-10733 1445 11 , , PUNCT dad-10733 1445 12 n. n. PROPN dad-10733 1445 13 r. r. PROPN dad-10733 1445 14 ke ke PROPN dad-10733 1445 15 , , PUNCT dad-10733 1445 16 g. g. PROPN dad-10733 1445 17 fried fried PROPN dad-10733 1445 18 , , PUNCT dad-10733 1445 19 r. r. PROPN dad-10733 1445 20 lowe lowe PROPN dad-10733 1445 21 , , PUNCT dad-10733 1445 22 and and CCONJ dad-10733 1445 23 j. j. PROPN dad-10733 1445 24 pineau pineau PROPN dad-10733 1445 25 . . PUNCT dad-10733 1446 1 ethical ethical ADJ dad-10733 1446 2 challenges challenge NOUN dad-10733 1446 3 in in ADP dad-10733 1446 4 datadriven datadriven ADJ dad-10733 1446 5 dialogue dialogue NOUN dad-10733 1446 6 systems system NOUN dad-10733 1446 7 . . PUNCT dad-10733 1447 1 arxiv arxiv PROPN dad-10733 1447 2 preprint preprint VERB dad-10733 1447 3 arxiv:1711.09050 arxiv:1711.09050 PROPN dad-10733 1447 4 , , PUNCT dad-10733 1447 5 2017 2017 NUM dad-10733 1447 6 . . PUNCT dad-10733 1448 1 g. g. PROPN dad-10733 1448 2 hinton hinton PROPN dad-10733 1448 3 , , PUNCT dad-10733 1448 4 l. l. PROPN dad-10733 1448 5 deng deng PROPN dad-10733 1448 6 , , PUNCT dad-10733 1448 7 d. d. PROPN dad-10733 1448 8 yu yu PROPN dad-10733 1448 9 , , PUNCT dad-10733 1448 10 g. g. PROPN dad-10733 1448 11 e. e. PROPN dad-10733 1448 12 dahl dahl PROPN dad-10733 1448 13 , , PUNCT dad-10733 1448 14 a. a. PROPN dad-10733 1448 15 mohamed mohamed PROPN dad-10733 1448 16 , , PUNCT dad-10733 1448 17 n. n. PROPN dad-10733 1448 18 jaitly jaitly ADV dad-10733 1448 19 , , PUNCT dad-10733 1448 20 a. a. PROPN dad-10733 1448 21 senior senior NOUN dad-10733 1448 22 , , PUNCT dad-10733 1448 23 v. v. PROPN dad-10733 1448 24 vanhoucke vanhoucke PROPN dad-10733 1448 25 , , PUNCT dad-10733 1448 26 p. p. NOUN dad-10733 1448 27 nguyen nguyen NOUN dad-10733 1448 28 , , PUNCT dad-10733 1448 29 t.a t.a PROPN dad-10733 1448 30 n. n. PROPN dad-10733 1448 31 sainath sainath PROPN dad-10733 1448 32 , , PUNCT dad-10733 1448 33 et et PROPN dad-10733 1448 34 al al PROPN dad-10733 1448 35 . . PUNCT dad-10733 1449 1 deep deep ADJ dad-10733 1449 2 neural neural ADJ dad-10733 1449 3 networks network NOUN dad-10733 1449 4 for for ADP dad-10733 1449 5 acoustic acoustic ADJ dad-10733 1449 6 modeling modeling NOUN dad-10733 1449 7 in in ADP dad-10733 1449 8 speech speech NOUN dad-10733 1449 9 recognition recognition NOUN dad-10733 1449 10 : : PUNCT dad-10733 1449 11 the the DET dad-10733 1449 12 shared share VERB dad-10733 1449 13 views view NOUN dad-10733 1449 14 of of ADP dad-10733 1449 15 four four NUM dad-10733 1449 16 research research NOUN dad-10733 1449 17 groups group NOUN dad-10733 1449 18 . . PUNCT dad-10733 1450 1 signal signal NOUN dad-10733 1450 2 processing processing NOUN dad-10733 1450 3 magazine magazine NOUN dad-10733 1450 4 , , PUNCT dad-10733 1450 5 ieee ieee NOUN dad-10733 1450 6 , , PUNCT dad-10733 1450 7 29(6):82–97 29(6):82–97 NUM dad-10733 1450 8 , , PUNCT dad-10733 1450 9 2012 2012 NUM dad-10733 1450 10 . . PUNCT dad-10733 1451 1 t. t. PROPN dad-10733 1451 2 hiraoka hiraoka PROPN dad-10733 1451 3 , , PUNCT dad-10733 1451 4 g. g. PROPN dad-10733 1451 5 neubig neubig PROPN dad-10733 1451 6 , , PUNCT dad-10733 1451 7 k. k. PROPN dad-10733 1451 8 yoshino yoshino PROPN dad-10733 1451 9 , , PUNCT dad-10733 1451 10 t. t. PROPN dad-10733 1451 11 toda toda PROPN dad-10733 1451 12 , , PUNCT dad-10733 1451 13 and and CCONJ dad-10733 1451 14 s. s. PROPN dad-10733 1451 15 nakamura nakamura PROPN dad-10733 1451 16 . . PUNCT dad-10733 1452 1 active active ADJ dad-10733 1452 2 learning learning NOUN dad-10733 1452 3 for for ADP dad-10733 1452 4 example example NOUN dad-10733 1452 5 - - PUNCT dad-10733 1452 6 based base VERB dad-10733 1452 7 dialog dialog NOUN dad-10733 1452 8 systems system NOUN dad-10733 1452 9 . . PUNCT dad-10733 1453 1 in in ADP dad-10733 1453 2 proc proc PROPN dad-10733 1453 3 intl intl PROPN dad-10733 1453 4 workshop workshop NOUN dad-10733 1453 5 on on ADP dad-10733 1453 6 spoken spoken ADJ dad-10733 1453 7 dialog dialog NOUN dad-10733 1453 8 systems system NOUN dad-10733 1453 9 , , PUNCT dad-10733 1453 10 saariselka saariselka PROPN dad-10733 1453 11 , , PUNCT dad-10733 1453 12 finland finland PROPN dad-10733 1453 13 , , PUNCT dad-10733 1453 14 2016 2016 NUM dad-10733 1453 15 . . PUNCT dad-10733 1454 1 43 43 NUM dad-10733 1454 2 http://goodfeli.github.io/dlbook/ http://goodfeli.github.io/dlbook/ NOUN dad-10733 1454 3 http://goodfeli.github.io/dlbook/ http://goodfeli.github.io/dlbook/ PROPN dad-10733 1454 4 serban serban PROPN dad-10733 1454 5 , , PUNCT dad-10733 1454 6 lowe lowe PROPN dad-10733 1454 7 , , PUNCT dad-10733 1454 8 henderson henderson PROPN dad-10733 1454 9 , , PUNCT dad-10733 1454 10 charlin charlin PROPN dad-10733 1454 11 and and CCONJ dad-10733 1454 12 pineau pineau PROPN dad-10733 1454 13 h. h. PROPN dad-10733 1454 14 hung hung PROPN dad-10733 1454 15 and and CCONJ dad-10733 1454 16 g. g. PROPN dad-10733 1454 17 chittaranjan chittaranjan PROPN dad-10733 1454 18 . . PUNCT dad-10733 1455 1 the the DET dad-10733 1455 2 idiap idiap PROPN dad-10733 1455 3 wolf wolf PROPN dad-10733 1455 4 corpus corpus PROPN dad-10733 1455 5 : : PUNCT dad-10733 1455 6 exploring explore VERB dad-10733 1455 7 group group NOUN dad-10733 1455 8 behaviour behaviour NOUN dad-10733 1455 9 in in ADP dad-10733 1455 10 a a DET dad-10733 1455 11 competitive competitive ADJ dad-10733 1455 12 role role NOUN dad-10733 1455 13 - - PUNCT dad-10733 1455 14 playing playing NOUN dad-10733 1455 15 game game NOUN dad-10733 1455 16 . . PUNCT dad-10733 1456 1 in in ADP dad-10733 1456 2 international international ADJ dad-10733 1456 3 conference conference NOUN dad-10733 1456 4 on on ADP dad-10733 1456 5 multimedia multimedia NOUN dad-10733 1456 6 , , PUNCT dad-10733 1456 7 pages page NOUN dad-10733 1456 8 879–882 879–882 NUM dad-10733 1456 9 , , PUNCT dad-10733 1456 10 2010 2010 NUM dad-10733 1456 11 . . PUNCT dad-10733 1457 1 j. j. PROPN dad-10733 1457 2 l. l. PROPN dad-10733 1457 3 hutchens hutchens PROPN dad-10733 1457 4 and and CCONJ dad-10733 1457 5 m. m. PROPN dad-10733 1457 6 d. d. PROPN dad-10733 1457 7 alder alder PROPN dad-10733 1457 8 . . PUNCT dad-10733 1458 1 introducing introduce VERB dad-10733 1458 2 megahal megahal NOUN dad-10733 1458 3 . . PUNCT dad-10733 1459 1 in in ADP dad-10733 1459 2 joint joint ADJ dad-10733 1459 3 conferences conference NOUN dad-10733 1459 4 on on ADP dad-10733 1459 5 new new ADJ dad-10733 1459 6 methods method NOUN dad-10733 1459 7 in in ADP dad-10733 1459 8 language language NOUN dad-10733 1459 9 processing processing NOUN dad-10733 1459 10 and and CCONJ dad-10733 1459 11 computational computational ADJ dad-10733 1459 12 natural natural ADJ dad-10733 1459 13 language language NOUN dad-10733 1459 14 learning learning NOUN dad-10733 1459 15 , , PUNCT dad-10733 1459 16 1998 1998 NUM dad-10733 1459 17 . . PUNCT dad-10733 1460 1 j. j. PROPN dad-10733 1460 2 l. l. PROPN dad-10733 1460 3 part part PROPN dad-10733 1460 4 i. i. PROPN dad-10733 1460 5 shalyminov shalyminov PROPN dad-10733 1460 6 x. x. PROPN dad-10733 1461 1 xu xu PROPN dad-10733 1461 2 y. y. PROPN dad-10733 1461 3 yu yu PROPN dad-10733 1462 1 o. o. PROPN dad-10733 1462 2 duek duek PROPN dad-10733 1462 3 v. v. ADP dad-10733 1462 4 rieser rieser PROPN dad-10733 1462 5 o. o. PROPN dad-10733 1462 6 lemon lemon PROPN dad-10733 1462 7 i. i. PROPN dad-10733 1462 8 papaioannou papaioannou PROPN dad-10733 1462 9 , , PUNCT dad-10733 1462 10 a. a. PROPN dad-10733 1462 11 c. c. PROPN dad-10733 1462 12 curry curry PROPN dad-10733 1462 13 . . PUNCT dad-10733 1463 1 alana alana PROPN dad-10733 1463 2 : : PUNCT dad-10733 1463 3 social social ADJ dad-10733 1463 4 dialogue dialogue NOUN dad-10733 1463 5 using use VERB dad-10733 1463 6 an an DET dad-10733 1463 7 ensemble ensemble ADJ dad-10733 1463 8 model model NOUN dad-10733 1463 9 and and CCONJ dad-10733 1463 10 a a DET dad-10733 1463 11 ranker ranker NOUN dad-10733 1463 12 trained train VERB dad-10733 1463 13 on on ADP dad-10733 1463 14 user user NOUN dad-10733 1463 15 feedback feedback NOUN dad-10733 1463 16 . . PUNCT dad-10733 1464 1 in in ADP dad-10733 1464 2 alexa alexa PROPN dad-10733 1464 3 prize prize PROPN dad-10733 1464 4 proceedings proceeding NOUN dad-10733 1464 5 , , PUNCT dad-10733 1464 6 2017 2017 NUM dad-10733 1464 7 . . PUNCT dad-10733 1465 1 a. a. NOUN dad-10733 1465 2 jonsson jonsson PROPN dad-10733 1465 3 and and CCONJ dad-10733 1465 4 n. n. PROPN dad-10733 1465 5 dahlback dahlback PROPN dad-10733 1465 6 . . PUNCT dad-10733 1466 1 talking talk VERB dad-10733 1466 2 to to ADP dad-10733 1466 3 a a DET dad-10733 1466 4 computer computer NOUN dad-10733 1466 5 is be AUX dad-10733 1466 6 not not PART dad-10733 1466 7 like like ADP dad-10733 1466 8 talking talk VERB dad-10733 1466 9 to to ADP dad-10733 1466 10 your your PRON dad-10733 1466 11 best good ADJ dad-10733 1466 12 friend friend NOUN dad-10733 1466 13 . . PUNCT dad-10733 1467 1 in in ADP dad-10733 1467 2 scandinavian scandinavian ADJ dad-10733 1467 3 conference conference NOUN dad-10733 1467 4 on on ADP dad-10733 1467 5 artificial artificial ADJ dad-10733 1467 6 intelligence intelligence NOUN dad-10733 1467 7 , , PUNCT dad-10733 1467 8 1988 1988 NUM dad-10733 1467 9 . . PUNCT dad-10733 1468 1 s. s. PROPN dad-10733 1468 2 jung jung PROPN dad-10733 1468 3 , , PUNCT dad-10733 1468 4 c. c. PROPN dad-10733 1468 5 lee lee PROPN dad-10733 1468 6 , , PUNCT dad-10733 1468 7 k. k. PROPN dad-10733 1468 8 kim kim PROPN dad-10733 1468 9 , , PUNCT dad-10733 1468 10 m. m. PROPN dad-10733 1468 11 jeong jeong PROPN dad-10733 1468 12 , , PUNCT dad-10733 1468 13 and and CCONJ dad-10733 1468 14 g. g. PROPN dad-10733 1468 15 g. g. PROPN dad-10733 1468 16 lee lee PROPN dad-10733 1468 17 . . PROPN dad-10733 1469 1 data data PROPN dad-10733 1469 2 - - PUNCT dad-10733 1469 3 driven drive VERB dad-10733 1469 4 user user NOUN dad-10733 1469 5 simulation simulation NOUN dad-10733 1469 6 for for ADP dad-10733 1469 7 automated automate VERB dad-10733 1469 8 evaluation evaluation NOUN dad-10733 1469 9 of of ADP dad-10733 1469 10 spoken spoken ADJ dad-10733 1469 11 dialog dialog NOUN dad-10733 1469 12 systems system NOUN dad-10733 1469 13 . . PUNCT dad-10733 1470 1 computer computer NOUN dad-10733 1470 2 speech speech NOUN dad-10733 1470 3 & & CCONJ dad-10733 1470 4 language language NOUN dad-10733 1470 5 , , PUNCT dad-10733 1470 6 23(4):479–509 23(4):479–509 PROPN dad-10733 1470 7 , , PUNCT dad-10733 1470 8 2009 2009 NUM dad-10733 1470 9 . . PUNCT dad-10733 1471 1 d. d. PROPN dad-10733 1471 2 jurafsky jurafsky PROPN dad-10733 1471 3 and and CCONJ dad-10733 1471 4 j. j. PROPN dad-10733 1471 5 h. h. PROPN dad-10733 1471 6 martin martin PROPN dad-10733 1471 7 . . PUNCT dad-10733 1472 1 speech speech NOUN dad-10733 1472 2 and and CCONJ dad-10733 1472 3 language language NOUN dad-10733 1472 4 processing processing NOUN dad-10733 1472 5 , , PUNCT dad-10733 1472 6 2nd 2nd PROPN dad-10733 1472 7 edition edition NOUN dad-10733 1472 8 . . PUNCT dad-10733 1473 1 prentice prentice PROPN dad-10733 1473 2 hall hall PROPN dad-10733 1473 3 , , PUNCT dad-10733 1473 4 2008 2008 NUM dad-10733 1473 5 . . PUNCT dad-10733 1474 1 f. f. PROPN dad-10733 1474 2 jurcıcek jurcıcek PROPN dad-10733 1474 3 , , PUNCT dad-10733 1474 4 s. s. PROPN dad-10733 1474 5 keizer keizer PROPN dad-10733 1474 6 , , PUNCT dad-10733 1474 7 m. m. NOUN dad-10733 1474 8 gašic gašic PROPN dad-10733 1474 9 , , PUNCT dad-10733 1474 10 f. f. PROPN dad-10733 1474 11 mairesse mairesse PROPN dad-10733 1474 12 , , PUNCT dad-10733 1474 13 b. b. PROPN dad-10733 1474 14 thomson thomson PROPN dad-10733 1474 15 , , PUNCT dad-10733 1474 16 k. k. PROPN dad-10733 1474 17 yu yu PROPN dad-10733 1474 18 , , PUNCT dad-10733 1474 19 and and CCONJ dad-10733 1474 20 s. s. PROPN dad-10733 1474 21 young young PROPN dad-10733 1474 22 . . PUNCT dad-10733 1475 1 real real ADJ dad-10733 1475 2 user user NOUN dad-10733 1475 3 evaluation evaluation NOUN dad-10733 1475 4 of of ADP dad-10733 1475 5 spoken spoken ADJ dad-10733 1475 6 dialogue dialogue NOUN dad-10733 1475 7 systems system NOUN dad-10733 1475 8 using use VERB dad-10733 1475 9 amazon amazon PROPN dad-10733 1475 10 mechanical mechanical ADJ dad-10733 1475 11 turk turk PROPN dad-10733 1475 12 . . PUNCT dad-10733 1476 1 in in ADP dad-10733 1476 2 interspeech interspeech NOUN dad-10733 1476 3 , , PUNCT dad-10733 1476 4 volume volume NOUN dad-10733 1476 5 11 11 NUM dad-10733 1476 6 , , PUNCT dad-10733 1476 7 2011 2011 NUM dad-10733 1476 8 . . PUNCT dad-10733 1477 1 r. r. PROPN dad-10733 1477 2 kadlec kadlec PROPN dad-10733 1477 3 , , PUNCT dad-10733 1477 4 m. m. NOUN dad-10733 1477 5 schmid schmid PROPN dad-10733 1477 6 , , PUNCT dad-10733 1477 7 and and CCONJ dad-10733 1477 8 j. j. PROPN dad-10733 1477 9 kleindienst kleindienst PROPN dad-10733 1477 10 . . PUNCT dad-10733 1477 11 improved improve VERB dad-10733 1477 12 deep deep ADJ dad-10733 1477 13 learning learn VERB dad-10733 1477 14 baselines baseline NOUN dad-10733 1477 15 for for ADP dad-10733 1477 16 ubuntu ubuntu ADJ dad-10733 1477 17 corpus corpus NOUN dad-10733 1477 18 dialogs dialog NOUN dad-10733 1477 19 . . PUNCT dad-10733 1478 1 neural neural ADJ dad-10733 1478 2 information information NOUN dad-10733 1478 3 processing processing NOUN dad-10733 1478 4 systems system NOUN dad-10733 1478 5 workshop workshop NOUN dad-10733 1478 6 on on ADP dad-10733 1478 7 machine machine NOUN dad-10733 1478 8 learning learn VERB dad-10733 1478 9 for for ADP dad-10733 1478 10 spoken spoken ADJ dad-10733 1478 11 language language NOUN dad-10733 1478 12 understanding understanding NOUN dad-10733 1478 13 , , PUNCT dad-10733 1478 14 2015 2015 NUM dad-10733 1478 15 . . PUNCT dad-10733 1479 1 s. s. PROPN dad-10733 1479 2 kim kim PROPN dad-10733 1479 3 , , PUNCT dad-10733 1479 4 l. l. PROPN dad-10733 1479 5 f. f. PROPN dad-10733 1479 6 dharo dharo PROPN dad-10733 1479 7 , , PUNCT dad-10733 1479 8 r. r. PROPN dad-10733 1479 9 e. e. PROPN dad-10733 1479 10 banchs banchs PROPN dad-10733 1479 11 , , PUNCT dad-10733 1479 12 j. j. PROPN dad-10733 1479 13 williams williams PROPN dad-10733 1479 14 , , PUNCT dad-10733 1479 15 and and CCONJ dad-10733 1479 16 m. m. PROPN dad-10733 1479 17 henderson henderson PROPN dad-10733 1479 18 . . PUNCT dad-10733 1480 1 dialog dialog PROPN dad-10733 1480 2 state state NOUN dad-10733 1480 3 tracking tracking NOUN dad-10733 1480 4 challenge challenge NOUN dad-10733 1480 5 4 4 NUM dad-10733 1480 6 , , PUNCT dad-10733 1480 7 2015 2015 NUM dad-10733 1480 8 . . PUNCT dad-10733 1481 1 s. s. PROPN dad-10733 1481 2 kim kim PROPN dad-10733 1481 3 , , PUNCT dad-10733 1481 4 l. l. PROPN dad-10733 1481 5 f. f. PROPN dad-10733 1481 6 dharo dharo PROPN dad-10733 1481 7 , , PUNCT dad-10733 1481 8 r. r. PROPN dad-10733 1481 9 e. e. PROPN dad-10733 1481 10 banchs banchs PROPN dad-10733 1481 11 , , PUNCT dad-10733 1481 12 j. j. PROPN dad-10733 1481 13 d. d. PROPN dad-10733 1481 14 williams williams PROPN dad-10733 1481 15 , , PUNCT dad-10733 1481 16 m. m. PROPN dad-10733 1481 17 henderson henderson PROPN dad-10733 1481 18 , , PUNCT dad-10733 1481 19 and and CCONJ dad-10733 1481 20 k. k. PROPN dad-10733 1481 21 yoshino yoshino PROPN dad-10733 1481 22 . . PUNCT dad-10733 1482 1 the the DET dad-10733 1482 2 fifth fifth ADJ dad-10733 1482 3 dialog dialog NOUN dad-10733 1482 4 state state NOUN dad-10733 1482 5 tracking tracking NOUN dad-10733 1482 6 challenge challenge NOUN dad-10733 1482 7 . . PUNCT dad-10733 1483 1 in in ADP dad-10733 1483 2 ieee ieee NOUN dad-10733 1483 3 spoken speak VERB dad-10733 1483 4 language language NOUN dad-10733 1483 5 technology technology NOUN dad-10733 1483 6 workshop workshop NOUN dad-10733 1483 7 ( ( PUNCT dad-10733 1483 8 slt slt PROPN dad-10733 1483 9 ) ) PUNCT dad-10733 1483 10 , , PUNCT dad-10733 1483 11 2016 2016 NUM dad-10733 1483 12 . . PUNCT dad-10733 1484 1 v. v. ADP dad-10733 1484 2 konovalov konovalov PROPN dad-10733 1484 3 , , PUNCT dad-10733 1484 4 o. o. PROPN dad-10733 1484 5 melamud melamud PROPN dad-10733 1484 6 , , PUNCT dad-10733 1484 7 r. r. PROPN dad-10733 1484 8 artstein artstein PROPN dad-10733 1484 9 , , PUNCT dad-10733 1484 10 and and CCONJ dad-10733 1484 11 i. i. PROPN dad-10733 1484 12 dagan dagan PROPN dad-10733 1484 13 . . PUNCT dad-10733 1485 1 collecting collect VERB dad-10733 1485 2 better well ADJ dad-10733 1485 3 training training NOUN dad-10733 1485 4 data datum NOUN dad-10733 1485 5 using use VERB dad-10733 1485 6 biased biased ADJ dad-10733 1485 7 agent agent NOUN dad-10733 1485 8 policies policy NOUN dad-10733 1485 9 in in ADP dad-10733 1485 10 negotiation negotiation NOUN dad-10733 1485 11 dialogues dialogue NOUN dad-10733 1485 12 . . PUNCT dad-10733 1486 1 in in ADP dad-10733 1486 2 wochat wochat PRON dad-10733 1486 3 : : PUNCT dad-10733 1486 4 workshop workshop NOUN dad-10733 1486 5 on on ADP dad-10733 1486 6 chatbots chatbot NOUN dad-10733 1486 7 and and CCONJ dad-10733 1486 8 conversational conversational ADJ dad-10733 1486 9 agent agent NOUN dad-10733 1486 10 technologies technology NOUN dad-10733 1486 11 , , PUNCT dad-10733 1486 12 2016 2016 NUM dad-10733 1486 13 . . PUNCT dad-10733 1487 1 j. j. PROPN dad-10733 1487 2 a a PROPN dad-10733 1487 3 konstan konstan PROPN dad-10733 1487 4 , , PUNCT dad-10733 1487 5 b. b. PROPN dad-10733 1487 6 n. n. PROPN dad-10733 1487 7 miller miller PROPN dad-10733 1487 8 , , PUNCT dad-10733 1487 9 d. d. PROPN dad-10733 1487 10 maltz maltz PROPN dad-10733 1487 11 , , PUNCT dad-10733 1487 12 j. j. PROPN dad-10733 1487 13 l. l. PROPN dad-10733 1487 14 herlocker herlocker PROPN dad-10733 1487 15 , , PUNCT dad-10733 1487 16 l. l. PROPN dad-10733 1487 17 r. r. PROPN dad-10733 1487 18 gordon gordon PROPN dad-10733 1487 19 , , PUNCT dad-10733 1487 20 and and CCONJ dad-10733 1487 21 j. j. PROPN dad-10733 1487 22 riedl riedl PROPN dad-10733 1487 23 . . PUNCT dad-10733 1488 1 grouplens grouplen NOUN dad-10733 1488 2 : : PUNCT dad-10733 1488 3 applying apply VERB dad-10733 1488 4 collaborative collaborative ADJ dad-10733 1488 5 filtering filtering NOUN dad-10733 1488 6 to to ADP dad-10733 1488 7 usenet usenet NOUN dad-10733 1488 8 news news NOUN dad-10733 1488 9 . . PUNCT dad-10733 1489 1 communications communication NOUN dad-10733 1489 2 of of ADP dad-10733 1489 3 the the DET dad-10733 1489 4 acm acm NOUN dad-10733 1489 5 , , PUNCT dad-10733 1489 6 40(3):77–87 40(3):77–87 NUM dad-10733 1489 7 , , PUNCT dad-10733 1489 8 1997 1997 NUM dad-10733 1489 9 . . PUNCT dad-10733 1490 1 a. a. PROPN dad-10733 1490 2 kumar kumar PROPN dad-10733 1490 3 , , PUNCT dad-10733 1490 4 o. o. PROPN dad-10733 1490 5 irsoy irsoy PROPN dad-10733 1490 6 , , PUNCT dad-10733 1490 7 j. j. PROPN dad-10733 1490 8 su su PROPN dad-10733 1490 9 , , PUNCT dad-10733 1490 10 j. j. PROPN dad-10733 1490 11 bradbury bradbury PROPN dad-10733 1490 12 , , PUNCT dad-10733 1490 13 r. r. PROPN dad-10733 1490 14 english english PROPN dad-10733 1490 15 , , PUNCT dad-10733 1490 16 b. b. PROPN dad-10733 1490 17 pierce pierce PROPN dad-10733 1490 18 , , PUNCT dad-10733 1490 19 p. p. PROPN dad-10733 1490 20 ondruska ondruska NOUN dad-10733 1490 21 , , PUNCT dad-10733 1490 22 i. i. NOUN dad-10733 1490 23 gulrajani gulrajani NOUN dad-10733 1490 24 , , PUNCT dad-10733 1490 25 and and CCONJ dad-10733 1490 26 r. r. PROPN dad-10733 1490 27 socher socher PROPN dad-10733 1490 28 . . PUNCT dad-10733 1491 1 ask ask VERB dad-10733 1491 2 me i PRON dad-10733 1491 3 anything anything PRON dad-10733 1491 4 : : PUNCT dad-10733 1491 5 dynamic dynamic ADJ dad-10733 1491 6 memory memory NOUN dad-10733 1491 7 networks network NOUN dad-10733 1491 8 for for ADP dad-10733 1491 9 natural natural ADJ dad-10733 1491 10 language language NOUN dad-10733 1491 11 processing processing NOUN dad-10733 1491 12 . . PUNCT dad-10733 1492 1 neural neural ADJ dad-10733 1492 2 information information NOUN dad-10733 1492 3 processing processing NOUN dad-10733 1492 4 systems system NOUN dad-10733 1492 5 ( ( PUNCT dad-10733 1492 6 nips nip NOUN dad-10733 1492 7 ) ) PUNCT dad-10733 1492 8 , , PUNCT dad-10733 1492 9 2015 2015 NUM dad-10733 1492 10 . . PUNCT dad-10733 1493 1 m. m. NOUN dad-10733 1493 2 kytö kytö PROPN dad-10733 1493 3 and and CCONJ dad-10733 1493 4 t. t. PROPN dad-10733 1493 5 walker walker PROPN dad-10733 1493 6 . . PUNCT dad-10733 1494 1 guide guide VERB dad-10733 1494 2 to to ADP dad-10733 1494 3 a a DET dad-10733 1494 4 corpus corpus NOUN dad-10733 1494 5 of of ADP dad-10733 1494 6 english english ADJ dad-10733 1494 7 dialogues dialogue NOUN dad-10733 1494 8 1560 1560 NUM dad-10733 1494 9 - - SYM dad-10733 1494 10 1760 1760 NUM dad-10733 1494 11 . . PUNCT dad-10733 1495 1 acta acta PROPN dad-10733 1495 2 universitatis universitatis PROPN dad-10733 1495 3 upsaliensis upsaliensis NOUN dad-10733 1495 4 , , PUNCT dad-10733 1495 5 2006 2006 NUM dad-10733 1495 6 . . PUNCT dad-10733 1496 1 i. i. PROPN dad-10733 1496 2 langkilde langkilde PROPN dad-10733 1496 3 and and CCONJ dad-10733 1496 4 k. k. PROPN dad-10733 1496 5 knight knight PROPN dad-10733 1496 6 . . PUNCT dad-10733 1497 1 generation generation NOUN dad-10733 1497 2 that that PRON dad-10733 1497 3 exploits exploit VERB dad-10733 1497 4 corpus corpus NOUN dad-10733 1497 5 - - PUNCT dad-10733 1497 6 based base VERB dad-10733 1497 7 statistical statistical ADJ dad-10733 1497 8 knowledge knowledge NOUN dad-10733 1497 9 . . PUNCT dad-10733 1498 1 in in ADP dad-10733 1498 2 association association NOUN dad-10733 1498 3 for for ADP dad-10733 1498 4 computational computational ADJ dad-10733 1498 5 linguistics linguistic NOUN dad-10733 1498 6 and and CCONJ dad-10733 1498 7 international international ADJ dad-10733 1498 8 conference conference NOUN dad-10733 1498 9 on on ADP dad-10733 1498 10 computational computational ADJ dad-10733 1498 11 linguistics linguistic NOUN dad-10733 1498 12 , , PUNCT dad-10733 1498 13 volume volume NOUN dad-10733 1498 14 1 1 NUM dad-10733 1498 15 , , PUNCT dad-10733 1498 16 pages page NOUN dad-10733 1498 17 704–710 704–710 NUM dad-10733 1498 18 . . PUNCT dad-10733 1499 1 acl acl PROPN dad-10733 1499 2 , , PUNCT dad-10733 1499 3 1998 1998 NUM dad-10733 1499 4 . . PUNCT dad-10733 1500 1 c.-j c.-j PROPN dad-10733 1500 2 . . PUNCT dad-10733 1501 1 lee lee PROPN dad-10733 1501 2 , , PUNCT dad-10733 1501 3 s.-k s.-k PROPN dad-10733 1501 4 . . PUNCT dad-10733 1502 1 jung jung PROPN dad-10733 1502 2 , , PUNCT dad-10733 1502 3 k.-d k.-d PROPN dad-10733 1502 4 . . PUNCT dad-10733 1503 1 kim kim PROPN dad-10733 1503 2 , , PUNCT dad-10733 1503 3 d.-h d.-h PROPN dad-10733 1503 4 . . PUNCT dad-10733 1504 1 lee lee PROPN dad-10733 1504 2 , , PUNCT dad-10733 1504 3 and and CCONJ dad-10733 1504 4 g. g. PROPN dad-10733 1504 5 g. g. PROPN dad-10733 1504 6 lee lee PROPN dad-10733 1504 7 . . PUNCT dad-10733 1505 1 recent recent ADJ dad-10733 1505 2 approaches approach NOUN dad-10733 1505 3 to to ADP dad-10733 1505 4 dialog dialog NOUN dad-10733 1505 5 management management NOUN dad-10733 1505 6 for for ADP dad-10733 1505 7 spoken spoken ADJ dad-10733 1505 8 dialog dialog NOUN dad-10733 1505 9 systems system NOUN dad-10733 1505 10 . . PUNCT dad-10733 1506 1 journal journal NOUN dad-10733 1506 2 of of ADP dad-10733 1506 3 computing compute VERB dad-10733 1506 4 science science NOUN dad-10733 1506 5 and and CCONJ dad-10733 1506 6 engineering engineering NOUN dad-10733 1506 7 , , PUNCT dad-10733 1506 8 4(1):1–22 4(1):1–22 NUM dad-10733 1506 9 , , PUNCT dad-10733 1506 10 2010 2010 NUM dad-10733 1506 11 . . PUNCT dad-10733 1507 1 g. g. NOUN dad-10733 1507 2 leech leech NOUN dad-10733 1507 3 . . PUNCT dad-10733 1508 1 100 100 NUM dad-10733 1508 2 million million NUM dad-10733 1508 3 words word NOUN dad-10733 1508 4 of of ADP dad-10733 1508 5 english english PROPN dad-10733 1508 6 : : PUNCT dad-10733 1508 7 the the DET dad-10733 1508 8 british british PROPN dad-10733 1508 9 national national PROPN dad-10733 1508 10 corpus corpus PROPN dad-10733 1508 11 ( ( PUNCT dad-10733 1508 12 bnc bnc NOUN dad-10733 1508 13 ) ) PUNCT dad-10733 1508 14 . . PUNCT dad-10733 1509 1 language language NOUN dad-10733 1509 2 research research NOUN dad-10733 1509 3 , , PUNCT dad-10733 1509 4 28(1):1–13 28(1):1–13 NUM dad-10733 1509 5 , , PUNCT dad-10733 1509 6 1992 1992 NUM dad-10733 1509 7 . . PUNCT dad-10733 1510 1 o. o. PROPN dad-10733 1510 2 lemon lemon PROPN dad-10733 1510 3 . . PUNCT dad-10733 1511 1 adaptive adaptive ADJ dad-10733 1511 2 natural natural ADJ dad-10733 1511 3 language language NOUN dad-10733 1511 4 generation generation NOUN dad-10733 1511 5 in in ADP dad-10733 1511 6 dialogue dialogue NOUN dad-10733 1511 7 using use VERB dad-10733 1511 8 reinforcement reinforcement NOUN dad-10733 1511 9 learning learning NOUN dad-10733 1511 10 . . PUNCT dad-10733 1512 1 in in ADP dad-10733 1512 2 workshop workshop NOUN dad-10733 1512 3 on on ADP dad-10733 1512 4 the the DET dad-10733 1512 5 semantics semantic NOUN dad-10733 1512 6 and and CCONJ dad-10733 1512 7 pragmatics pragmatic NOUN dad-10733 1512 8 of of ADP dad-10733 1512 9 dialogue dialogue NOUN dad-10733 1512 10 ( ( PUNCT dad-10733 1512 11 semdial semdial PROPN dad-10733 1512 12 ) ) PUNCT dad-10733 1512 13 , , PUNCT dad-10733 1512 14 volume volume NOUN dad-10733 1512 15 8 8 NUM dad-10733 1512 16 , , PUNCT dad-10733 1512 17 pages page NOUN dad-10733 1512 18 149–156 149–156 NUM dad-10733 1512 19 , , PUNCT dad-10733 1512 20 2008 2008 NUM dad-10733 1512 21 . . PUNCT dad-10733 1513 1 e. e. PROPN dad-10733 1513 2 levin levin PROPN dad-10733 1513 3 and and CCONJ dad-10733 1513 4 r. r. PROPN dad-10733 1513 5 pieraccini pieraccini PROPN dad-10733 1513 6 . . PUNCT dad-10733 1514 1 a a DET dad-10733 1514 2 stochastic stochastic ADJ dad-10733 1514 3 model model NOUN dad-10733 1514 4 of of ADP dad-10733 1514 5 computer computer NOUN dad-10733 1514 6 - - PUNCT dad-10733 1514 7 human human NOUN dad-10733 1514 8 interaction interaction NOUN dad-10733 1514 9 for for ADP dad-10733 1514 10 learning learn VERB dad-10733 1514 11 dialogue dialogue NOUN dad-10733 1514 12 strategies strategy NOUN dad-10733 1514 13 . . PUNCT dad-10733 1515 1 in in ADP dad-10733 1515 2 eurospeech eurospeech NOUN dad-10733 1515 3 , , PUNCT dad-10733 1515 4 volume volume NOUN dad-10733 1515 5 97 97 NUM dad-10733 1515 6 , , PUNCT dad-10733 1515 7 pages page NOUN dad-10733 1515 8 1883–1886 1883–1886 NUM dad-10733 1515 9 , , PUNCT dad-10733 1515 10 1997 1997 NUM dad-10733 1515 11 . . PUNCT dad-10733 1516 1 e. e. PROPN dad-10733 1516 2 levin levin PROPN dad-10733 1516 3 , , PUNCT dad-10733 1516 4 r. r. PROPN dad-10733 1516 5 pieraccini pieraccini PROPN dad-10733 1516 6 , , PUNCT dad-10733 1516 7 and and CCONJ dad-10733 1516 8 w. w. PROPN dad-10733 1516 9 eckert eckert PROPN dad-10733 1516 10 . . PUNCT dad-10733 1517 1 learning learn VERB dad-10733 1517 2 dialogue dialogue NOUN dad-10733 1517 3 strategies strategy NOUN dad-10733 1517 4 within within ADP dad-10733 1517 5 the the DET dad-10733 1517 6 markov markov NOUN dad-10733 1517 7 decision decision NOUN dad-10733 1517 8 process process NOUN dad-10733 1517 9 framework framework NOUN dad-10733 1517 10 . . PUNCT dad-10733 1518 1 in in ADP dad-10733 1518 2 automatic automatic ADJ dad-10733 1518 3 speech speech NOUN dad-10733 1518 4 recognition recognition NOUN dad-10733 1518 5 and and CCONJ dad-10733 1518 6 understanding understanding NOUN dad-10733 1518 7 , , PUNCT dad-10733 1518 8 1997 1997 NUM dad-10733 1518 9 . . PUNCT dad-10733 1519 1 proceedings proceeding NOUN dad-10733 1519 2 . . PUNCT dad-10733 1520 1 , , PUNCT dad-10733 1520 2 1997 1997 NUM dad-10733 1520 3 ieee ieee NOUN dad-10733 1520 4 workshop workshop NOUN dad-10733 1520 5 on on ADP dad-10733 1520 6 , , PUNCT dad-10733 1520 7 pages page NOUN dad-10733 1520 8 72–79 72–79 ADV dad-10733 1520 9 . . PUNCT dad-10733 1521 1 ieee ieee NOUN dad-10733 1521 2 , , PUNCT dad-10733 1521 3 1997 1997 NUM dad-10733 1521 4 . . PUNCT dad-10733 1522 1 j. j. PROPN dad-10733 1522 2 li li PROPN dad-10733 1522 3 , , PUNCT dad-10733 1522 4 m. m. NOUN dad-10733 1522 5 galley galley NOUN dad-10733 1522 6 , , PUNCT dad-10733 1522 7 c. c. PROPN dad-10733 1522 8 brockett brockett PROPN dad-10733 1522 9 , , PUNCT dad-10733 1522 10 j. j. PROPN dad-10733 1522 11 gao gao PROPN dad-10733 1522 12 , , PUNCT dad-10733 1522 13 and and CCONJ dad-10733 1522 14 b. b. PROPN dad-10733 1522 15 dolan dolan PROPN dad-10733 1522 16 . . PUNCT dad-10733 1523 1 a a DET dad-10733 1523 2 diversity diversity NOUN dad-10733 1523 3 - - PUNCT dad-10733 1523 4 promoting promote VERB dad-10733 1523 5 objective objective ADJ dad-10733 1523 6 function function NOUN dad-10733 1523 7 for for ADP dad-10733 1523 8 neural neural ADJ dad-10733 1523 9 conversation conversation NOUN dad-10733 1523 10 models model NOUN dad-10733 1523 11 . . PUNCT dad-10733 1524 1 arxiv arxiv PROPN dad-10733 1524 2 preprint preprint PROPN dad-10733 1524 3 arxiv:1510.03055 arxiv:1510.03055 PROPN dad-10733 1524 4 , , PUNCT dad-10733 1524 5 2015 2015 NUM dad-10733 1524 6 . . PUNCT dad-10733 1525 1 j. j. PROPN dad-10733 1525 2 li li PROPN dad-10733 1525 3 , , PUNCT dad-10733 1525 4 m. m. NOUN dad-10733 1525 5 galley galley NOUN dad-10733 1525 6 , , PUNCT dad-10733 1525 7 c. c. PROPN dad-10733 1525 8 brockett brockett PROPN dad-10733 1525 9 , , PUNCT dad-10733 1525 10 j. j. PROPN dad-10733 1525 11 gao gao PROPN dad-10733 1525 12 , , PUNCT dad-10733 1525 13 and and CCONJ dad-10733 1525 14 bill bill PROPN dad-10733 1525 15 d. d. PROPN dad-10733 1525 16 a a DET dad-10733 1525 17 persona persona NOUN dad-10733 1525 18 - - PUNCT dad-10733 1525 19 based base VERB dad-10733 1525 20 neural neural ADJ dad-10733 1525 21 conversation conversation NOUN dad-10733 1525 22 model model NOUN dad-10733 1525 23 . . PUNCT dad-10733 1526 1 in in ADP dad-10733 1526 2 association association NOUN dad-10733 1526 3 for for ADP dad-10733 1526 4 computational computational ADJ dad-10733 1526 5 linguistics linguistic NOUN dad-10733 1526 6 , , PUNCT dad-10733 1526 7 pages page NOUN dad-10733 1526 8 994–1003 994–1003 NUM dad-10733 1526 9 , , PUNCT dad-10733 1526 10 2016 2016 NUM dad-10733 1526 11 . . PUNCT dad-10733 1527 1 y. y. PROPN dad-10733 1527 2 li li PROPN dad-10733 1527 3 , , PUNCT dad-10733 1527 4 h. h. PROPN dad-10733 1527 5 su su PROPN dad-10733 1527 6 , , PUNCT dad-10733 1527 7 x. x. PROPN dad-10733 1527 8 shen shen PROPN dad-10733 1527 9 , , PUNCT dad-10733 1527 10 w. w. PROPN dad-10733 1527 11 li li PROPN dad-10733 1527 12 , , PUNCT dad-10733 1527 13 z. z. PROPN dad-10733 1527 14 cao cao PROPN dad-10733 1527 15 , , PUNCT dad-10733 1527 16 and and CCONJ dad-10733 1527 17 s. s. PROPN dad-10733 1527 18 niu niu PROPN dad-10733 1527 19 . . PUNCT dad-10733 1528 1 dailydialog dailydialog PROPN dad-10733 1528 2 : : PUNCT dad-10733 1528 3 a a DET dad-10733 1528 4 manually manually ADV dad-10733 1528 5 labelled label VERB dad-10733 1528 6 multi multi ADJ dad-10733 1528 7 - - ADJ dad-10733 1528 8 turn turn ADJ dad-10733 1528 9 dialogue dialogue NOUN dad-10733 1528 10 dataset dataset NOUN dad-10733 1528 11 . . PUNCT dad-10733 1529 1 arxiv arxiv PROPN dad-10733 1529 2 preprint preprint NOUN dad-10733 1529 3 arxiv:1710.03957 arxiv:1710.03957 NOUN dad-10733 1529 4 , , PUNCT dad-10733 1529 5 2017 2017 NUM dad-10733 1529 6 . . PUNCT dad-10733 1530 1 g. g. PROPN dad-10733 1530 2 lin lin PROPN dad-10733 1530 3 and and CCONJ dad-10733 1530 4 m. m. PROPN dad-10733 1530 5 walker walker PROPN dad-10733 1530 6 . . PUNCT dad-10733 1531 1 all all DET dad-10733 1531 2 the the DET dad-10733 1531 3 world world NOUN dad-10733 1531 4 ’s ’ VERB dad-10733 1531 5 a a DET dad-10733 1531 6 stage stage NOUN dad-10733 1531 7 : : PUNCT dad-10733 1531 8 learning learn VERB dad-10733 1531 9 character character NOUN dad-10733 1531 10 models model NOUN dad-10733 1531 11 from from ADP dad-10733 1531 12 film film NOUN dad-10733 1531 13 . . PUNCT dad-10733 1532 1 in in ADP dad-10733 1532 2 aaai aaai PROPN dad-10733 1532 3 conference conference NOUN dad-10733 1532 4 on on ADP dad-10733 1532 5 artificial artificial ADJ dad-10733 1532 6 intelligence intelligence NOUN dad-10733 1532 7 and and CCONJ dad-10733 1532 8 interactive interactive ADJ dad-10733 1532 9 digital digital ADJ dad-10733 1532 10 entertainment entertainment NOUN dad-10733 1532 11 , , PUNCT dad-10733 1532 12 2011a 2011a NUM dad-10733 1532 13 . . PUNCT dad-10733 1533 1 g. g. PROPN dad-10733 1533 2 i. i. PROPN dad-10733 1533 3 lin lin PROPN dad-10733 1533 4 and and CCONJ dad-10733 1533 5 m. m. PROPN dad-10733 1533 6 a. a. PROPN dad-10733 1533 7 walker walker PROPN dad-10733 1533 8 . . PUNCT dad-10733 1534 1 all all DET dad-10733 1534 2 the the DET dad-10733 1534 3 world world NOUN dad-10733 1534 4 ’s ’ VERB dad-10733 1534 5 a a DET dad-10733 1534 6 stage stage NOUN dad-10733 1534 7 : : PUNCT dad-10733 1534 8 learning learn VERB dad-10733 1534 9 character character NOUN dad-10733 1534 10 models model NOUN dad-10733 1534 11 from from ADP dad-10733 1534 12 film film NOUN dad-10733 1534 13 . . PUNCT dad-10733 1535 1 in in ADP dad-10733 1535 2 aiide aiide NOUN dad-10733 1535 3 , , PUNCT dad-10733 1535 4 2011b 2011b NUM dad-10733 1535 5 . . PUNCT dad-10733 1536 1 b. b. PROPN dad-10733 1536 2 liu liu PROPN dad-10733 1536 3 and and CCONJ dad-10733 1536 4 i. i. PROPN dad-10733 1536 5 lane lane PROPN dad-10733 1536 6 . . PUNCT dad-10733 1537 1 multi multi ADJ dad-10733 1537 2 - - ADJ dad-10733 1537 3 domain domain ADJ dad-10733 1537 4 adversarial adversarial ADJ dad-10733 1537 5 learning learning NOUN dad-10733 1537 6 for for ADP dad-10733 1537 7 slot slot NOUN dad-10733 1537 8 filling filling NOUN dad-10733 1537 9 in in ADP dad-10733 1537 10 spoken spoken ADJ dad-10733 1537 11 language language NOUN dad-10733 1537 12 understanding understanding NOUN dad-10733 1537 13 . . PUNCT dad-10733 1538 1 neural neural ADJ dad-10733 1538 2 information information NOUN dad-10733 1538 3 processing processing NOUN dad-10733 1538 4 systems system NOUN dad-10733 1538 5 ( ( PUNCT dad-10733 1538 6 nips nip NOUN dad-10733 1538 7 ) ) PUNCT dad-10733 1538 8 , , PUNCT dad-10733 1538 9 conversational conversational ADJ dad-10733 1538 10 ai ai NOUN dad-10733 1538 11 workshop workshop NOUN dad-10733 1538 12 , , PUNCT dad-10733 1538 13 2017 2017 NUM dad-10733 1538 14 . . PUNCT dad-10733 1539 1 c.-w c.-w PROPN dad-10733 1539 2 . . PUNCT dad-10733 1540 1 liu liu PROPN dad-10733 1540 2 , , PUNCT dad-10733 1540 3 r. r. PROPN dad-10733 1540 4 lowe lowe PROPN dad-10733 1540 5 , , PUNCT dad-10733 1540 6 i. i. PROPN dad-10733 1540 7 serban serban PROPN dad-10733 1540 8 , , PUNCT dad-10733 1540 9 m. m. NOUN dad-10733 1540 10 noseworthy noseworthy PROPN dad-10733 1540 11 , , PUNCT dad-10733 1540 12 l. l. PROPN dad-10733 1540 13 charlin charlin PROPN dad-10733 1540 14 , , PUNCT dad-10733 1540 15 and and CCONJ dad-10733 1540 16 j. j. PROPN dad-10733 1540 17 pineau pineau PROPN dad-10733 1540 18 . . PUNCT dad-10733 1541 1 how how SCONJ dad-10733 1541 2 not not PART dad-10733 1541 3 to to PART dad-10733 1541 4 evaluate evaluate VERB dad-10733 1541 5 your your PRON dad-10733 1541 6 dialogue dialogue NOUN dad-10733 1541 7 system system NOUN dad-10733 1541 8 : : PUNCT dad-10733 1541 9 an an DET dad-10733 1541 10 empirical empirical ADJ dad-10733 1541 11 study study NOUN dad-10733 1541 12 of of ADP dad-10733 1541 13 unsupervised unsupervised ADJ dad-10733 1541 14 evaluation evaluation NOUN dad-10733 1541 15 metrics metric NOUN dad-10733 1541 16 for for ADP dad-10733 1541 17 dialogue dialogue NOUN dad-10733 1541 18 response response NOUN dad-10733 1541 19 generation generation NOUN dad-10733 1541 20 . . PUNCT dad-10733 1542 1 in in ADP dad-10733 1542 2 conference conference NOUN dad-10733 1542 3 on on ADP dad-10733 1542 4 empirical empirical ADJ dad-10733 1542 5 methods method NOUN dad-10733 1542 6 in in ADP dad-10733 1542 7 natural natural ADJ dad-10733 1542 8 language language NOUN dad-10733 1542 9 processing processing NOUN dad-10733 1542 10 ( ( PUNCT dad-10733 1542 11 emnlp emnlp ADJ dad-10733 1542 12 ) ) PUNCT dad-10733 1542 13 , , PUNCT dad-10733 1542 14 pages page NOUN dad-10733 1542 15 2122–2132 2122–2132 NUM dad-10733 1542 16 , , PUNCT dad-10733 1542 17 2016 2016 NUM dad-10733 1542 18 . . PUNCT dad-10733 1543 1 c. c. PROPN dad-10733 1543 2 lord lord PROPN dad-10733 1543 3 and and CCONJ dad-10733 1543 4 m. m. PROPN dad-10733 1543 5 haith haith PROPN dad-10733 1543 6 . . PUNCT dad-10733 1544 1 the the DET dad-10733 1544 2 perception perception NOUN dad-10733 1544 3 of of ADP dad-10733 1544 4 eye eye NOUN dad-10733 1544 5 contact contact NOUN dad-10733 1544 6 . . PUNCT dad-10733 1545 1 attention attention NOUN dad-10733 1545 2 , , PUNCT dad-10733 1545 3 perception perception NOUN dad-10733 1545 4 , , PUNCT dad-10733 1545 5 & & CCONJ dad-10733 1545 6 psychophysics psychophysic NOUN dad-10733 1545 7 , , PUNCT dad-10733 1545 8 16(3):413–416 16(3):413–416 NUM dad-10733 1545 9 , , PUNCT dad-10733 1545 10 1974 1974 NUM dad-10733 1545 11 . . PUNCT dad-10733 1546 1 r. r. PROPN dad-10733 1546 2 lowe lowe PROPN dad-10733 1546 3 , , PUNCT dad-10733 1546 4 n. n. PROPN dad-10733 1546 5 pow pow PROPN dad-10733 1546 6 , , PUNCT dad-10733 1546 7 i. i. PROPN dad-10733 1546 8 serban serban PROPN dad-10733 1546 9 , , PUNCT dad-10733 1546 10 and and CCONJ dad-10733 1546 11 j. j. PROPN dad-10733 1546 12 pineau pineau PROPN dad-10733 1546 13 . . PUNCT dad-10733 1547 1 the the DET dad-10733 1547 2 ubuntu ubuntu ADJ dad-10733 1547 3 dialogue dialogue NOUN dad-10733 1547 4 corpus corpus PROPN dad-10733 1547 5 : : PUNCT dad-10733 1547 6 a a DET dad-10733 1547 7 large large ADJ dad-10733 1547 8 dataset dataset NOUN dad-10733 1547 9 for for ADP dad-10733 1547 10 research research NOUN dad-10733 1547 11 in in ADP dad-10733 1547 12 unstructured unstructured ADJ dad-10733 1547 13 multi multi ADJ dad-10733 1547 14 - - ADJ dad-10733 1547 15 turn turn ADJ dad-10733 1547 16 dialogue dialogue NOUN dad-10733 1547 17 systems system NOUN dad-10733 1547 18 . . PUNCT dad-10733 1548 1 in in ADP dad-10733 1548 2 special special ADJ dad-10733 1548 3 interest interest NOUN dad-10733 1548 4 group group NOUN dad-10733 1548 5 on on ADP dad-10733 1548 6 discourse discourse NOUN dad-10733 1548 7 and and CCONJ dad-10733 1548 8 dialogue dialogue NOUN dad-10733 1548 9 ( ( PUNCT dad-10733 1548 10 sigdial sigdial ADJ dad-10733 1548 11 ) ) PUNCT dad-10733 1548 12 , , PUNCT dad-10733 1548 13 2015a 2015a NUM dad-10733 1548 14 . . PUNCT dad-10733 1549 1 44 44 NUM dad-10733 1549 2 a a DET dad-10733 1549 3 survey survey NOUN dad-10733 1549 4 of of ADP dad-10733 1549 5 available available ADJ dad-10733 1549 6 corpora corpora PROPN dad-10733 1549 7 for for ADP dad-10733 1549 8 building build VERB dad-10733 1549 9 data data NOUN dad-10733 1549 10 - - PUNCT dad-10733 1549 11 driven drive VERB dad-10733 1549 12 dialogue dialogue NOUN dad-10733 1549 13 systems systems PROPN dad-10733 1549 14 r. r. PROPN dad-10733 1549 15 lowe lowe PROPN dad-10733 1549 16 , , PUNCT dad-10733 1549 17 n. n. PROPN dad-10733 1549 18 pow pow PROPN dad-10733 1549 19 , , PUNCT dad-10733 1549 20 i. i. PROPN dad-10733 1549 21 v. v. PROPN dad-10733 1549 22 serban serban PROPN dad-10733 1549 23 , , PUNCT dad-10733 1549 24 l. l. PROPN dad-10733 1549 25 charlin charlin PROPN dad-10733 1549 26 , , PUNCT dad-10733 1549 27 and and CCONJ dad-10733 1549 28 j. j. PROPN dad-10733 1549 29 pineau pineau PROPN dad-10733 1549 30 . . PUNCT dad-10733 1550 1 incorporating incorporate VERB dad-10733 1550 2 unstructured unstructured ADJ dad-10733 1550 3 textual textual ADJ dad-10733 1550 4 knowledge knowledge NOUN dad-10733 1550 5 sources source NOUN dad-10733 1550 6 into into ADP dad-10733 1550 7 neural neural ADJ dad-10733 1550 8 dialogue dialogue NOUN dad-10733 1550 9 systems system NOUN dad-10733 1550 10 . . PUNCT dad-10733 1551 1 neural neural ADJ dad-10733 1551 2 information information NOUN dad-10733 1551 3 processing processing NOUN dad-10733 1551 4 systems system NOUN dad-10733 1551 5 workshop workshop NOUN dad-10733 1551 6 on on ADP dad-10733 1551 7 machine machine NOUN dad-10733 1551 8 learning learn VERB dad-10733 1551 9 for for ADP dad-10733 1551 10 spoken spoken ADJ dad-10733 1551 11 language language NOUN dad-10733 1551 12 understanding understanding NOUN dad-10733 1551 13 , , PUNCT dad-10733 1551 14 2015b 2015b NUM dad-10733 1551 15 . . PUNCT dad-10733 1552 1 r. r. PROPN dad-10733 1552 2 lowe lowe PROPN dad-10733 1552 3 , , PUNCT dad-10733 1552 4 i. i. PROPN dad-10733 1552 5 v. v. PROPN dad-10733 1552 6 serban serban PROPN dad-10733 1552 7 , , PUNCT dad-10733 1552 8 m. m. NOUN dad-10733 1552 9 noseworthy noseworthy PROPN dad-10733 1552 10 , , PUNCT dad-10733 1552 11 l. l. PROPN dad-10733 1552 12 charlin charlin PROPN dad-10733 1552 13 , , PUNCT dad-10733 1552 14 and and CCONJ dad-10733 1552 15 j. j. PROPN dad-10733 1552 16 pineau pineau PROPN dad-10733 1552 17 . . PUNCT dad-10733 1553 1 on on ADP dad-10733 1553 2 the the DET dad-10733 1553 3 evaluation evaluation NOUN dad-10733 1553 4 of of ADP dad-10733 1553 5 dialogue dialogue NOUN dad-10733 1553 6 systems system NOUN dad-10733 1553 7 with with ADP dad-10733 1553 8 next next ADJ dad-10733 1553 9 utterance utterance NOUN dad-10733 1553 10 classification classification NOUN dad-10733 1553 11 . . PUNCT dad-10733 1554 1 in in ADP dad-10733 1554 2 special special ADJ dad-10733 1554 3 interest interest NOUN dad-10733 1554 4 group group NOUN dad-10733 1554 5 on on ADP dad-10733 1554 6 discourse discourse NOUN dad-10733 1554 7 and and CCONJ dad-10733 1554 8 dialogue dialogue NOUN dad-10733 1554 9 ( ( PUNCT dad-10733 1554 10 sigdial sigdial ADJ dad-10733 1554 11 ) ) PUNCT dad-10733 1554 12 , , PUNCT dad-10733 1554 13 2016 2016 NUM dad-10733 1554 14 . . PUNCT dad-10733 1555 1 j. j. PROPN dad-10733 1555 2 m. m. PROPN dad-10733 1555 3 lucas lucas PROPN dad-10733 1555 4 , , PUNCT dad-10733 1555 5 f. f. PROPN dad-10733 1555 6 fernndez fernndez PROPN dad-10733 1555 7 , , PUNCT dad-10733 1555 8 j. j. PROPN dad-10733 1555 9 salazar salazar PROPN dad-10733 1555 10 , , PUNCT dad-10733 1555 11 j. j. PROPN dad-10733 1555 12 ferreiros ferreiros PROPN dad-10733 1555 13 , , PUNCT dad-10733 1555 14 and and CCONJ dad-10733 1555 15 r. r. PROPN dad-10733 1555 16 san san PROPN dad-10733 1555 17 segundo segundo PROPN dad-10733 1555 18 . . PUNCT dad-10733 1556 1 managing manage VERB dad-10733 1556 2 speaker speaker NOUN dad-10733 1556 3 identity identity NOUN dad-10733 1556 4 and and CCONJ dad-10733 1556 5 user user NOUN dad-10733 1556 6 profiles profile NOUN dad-10733 1556 7 in in ADP dad-10733 1556 8 a a DET dad-10733 1556 9 spoken spoken ADJ dad-10733 1556 10 dialogue dialogue NOUN dad-10733 1556 11 system system NOUN dad-10733 1556 12 . . PUNCT dad-10733 1557 1 in in ADP dad-10733 1557 2 procesamiento procesamiento PROPN dad-10733 1557 3 del del PROPN dad-10733 1557 4 lenguaje lenguaje NOUN dad-10733 1557 5 natural natural ADJ dad-10733 1557 6 , , PUNCT dad-10733 1557 7 number number NOUN dad-10733 1557 8 43 43 NUM dad-10733 1557 9 in in ADP dad-10733 1557 10 1 1 NUM dad-10733 1557 11 , , PUNCT dad-10733 1557 12 pages page NOUN dad-10733 1557 13 77–84 77–84 NOUN dad-10733 1557 14 , , PUNCT dad-10733 1557 15 2009 2009 NUM dad-10733 1557 16 . . PUNCT dad-10733 1558 1 b. b. PROPN dad-10733 1558 2 macwhinney macwhinney PROPN dad-10733 1558 3 and and CCONJ dad-10733 1558 4 c. c. PROPN dad-10733 1558 5 snow snow PROPN dad-10733 1558 6 . . PUNCT dad-10733 1559 1 the the DET dad-10733 1559 2 child child NOUN dad-10733 1559 3 language language NOUN dad-10733 1559 4 data datum NOUN dad-10733 1559 5 exchange exchange NOUN dad-10733 1559 6 system system NOUN dad-10733 1559 7 . . PUNCT dad-10733 1560 1 journal journal PROPN dad-10733 1560 2 of of ADP dad-10733 1560 3 child child NOUN dad-10733 1560 4 language language NOUN dad-10733 1560 5 , , PUNCT dad-10733 1560 6 12(02):271–295 12(02):271–295 NUM dad-10733 1560 7 , , PUNCT dad-10733 1560 8 1985 1985 NUM dad-10733 1560 9 . . PUNCT dad-10733 1561 1 f. f. PROPN dad-10733 1561 2 mairesse mairesse PROPN dad-10733 1561 3 and and CCONJ dad-10733 1561 4 s. s. PROPN dad-10733 1561 5 young young PROPN dad-10733 1561 6 . . PUNCT dad-10733 1562 1 stochastic stochastic ADJ dad-10733 1562 2 language language NOUN dad-10733 1562 3 generation generation NOUN dad-10733 1562 4 in in ADP dad-10733 1562 5 dialogue dialogue NOUN dad-10733 1562 6 using use VERB dad-10733 1562 7 factored factor VERB dad-10733 1562 8 language language NOUN dad-10733 1562 9 models model NOUN dad-10733 1562 10 . . PUNCT dad-10733 1563 1 computational computational ADJ dad-10733 1563 2 linguistics linguistic NOUN dad-10733 1563 3 , , PUNCT dad-10733 1563 4 2014 2014 NUM dad-10733 1563 5 . . PUNCT dad-10733 1564 1 f. f. PROPN dad-10733 1564 2 mairesse mairesse PROPN dad-10733 1564 3 , , PUNCT dad-10733 1564 4 m. m. NOUN dad-10733 1564 5 gašić gašić PROPN dad-10733 1564 6 , , PUNCT dad-10733 1564 7 f. f. PROPN dad-10733 1564 8 jurčı́ček jurčı́ček PROPN dad-10733 1564 9 , , PUNCT dad-10733 1564 10 s. s. PROPN dad-10733 1564 11 keizer keizer PROPN dad-10733 1564 12 , , PUNCT dad-10733 1564 13 b. b. PROPN dad-10733 1564 14 thomson thomson PROPN dad-10733 1564 15 , , PUNCT dad-10733 1564 16 k. k. PROPN dad-10733 1564 17 yu yu PROPN dad-10733 1564 18 , , PUNCT dad-10733 1564 19 and and CCONJ dad-10733 1564 20 s. s. PROPN dad-10733 1564 21 young young PROPN dad-10733 1564 22 . . PUNCT dad-10733 1565 1 phrase phrase NOUN dad-10733 1565 2 - - PUNCT dad-10733 1565 3 based base VERB dad-10733 1565 4 statistical statistical ADJ dad-10733 1565 5 language language NOUN dad-10733 1565 6 generation generation NOUN dad-10733 1565 7 using use VERB dad-10733 1565 8 graphical graphical ADJ dad-10733 1565 9 models model NOUN dad-10733 1565 10 and and CCONJ dad-10733 1565 11 active active ADJ dad-10733 1565 12 learning learning NOUN dad-10733 1565 13 . . PUNCT dad-10733 1566 1 in in ADP dad-10733 1566 2 the the DET dad-10733 1566 3 association association NOUN dad-10733 1566 4 for for ADP dad-10733 1566 5 computational computational ADJ dad-10733 1566 6 linguistics linguistic NOUN dad-10733 1566 7 , , PUNCT dad-10733 1566 8 pages page NOUN dad-10733 1566 9 1552 1552 NUM dad-10733 1566 10 – – PUNCT dad-10733 1566 11 1561 1561 NUM dad-10733 1566 12 . . PUNCT dad-10733 1567 1 acl acl PROPN dad-10733 1567 2 , , PUNCT dad-10733 1567 3 2010 2010 NUM dad-10733 1567 4 . . PUNCT dad-10733 1568 1 c. c. PROPN dad-10733 1568 2 d. d. PROPN dad-10733 1568 3 manning manning PROPN dad-10733 1568 4 and and CCONJ dad-10733 1568 5 h. h. PROPN dad-10733 1568 6 schütze schütze PROPN dad-10733 1568 7 . . PUNCT dad-10733 1569 1 foundations foundation NOUN dad-10733 1569 2 of of ADP dad-10733 1569 3 statistical statistical ADJ dad-10733 1569 4 natural natural ADJ dad-10733 1569 5 language language NOUN dad-10733 1569 6 processing processing NOUN dad-10733 1569 7 . . PUNCT dad-10733 1570 1 mit mit PROPN dad-10733 1570 2 press press PROPN dad-10733 1570 3 , , PUNCT dad-10733 1570 4 1999 1999 NUM dad-10733 1570 5 . . PUNCT dad-10733 1571 1 m. m. PROPN dad-10733 1571 2 mccarthy mccarthy PROPN dad-10733 1571 3 . . PUNCT dad-10733 1572 1 spoken speak VERB dad-10733 1572 2 language language NOUN dad-10733 1572 3 and and CCONJ dad-10733 1572 4 applied applied ADJ dad-10733 1572 5 linguistics linguistic NOUN dad-10733 1572 6 . . PUNCT dad-10733 1573 1 ernst ernst PROPN dad-10733 1573 2 klett klett PROPN dad-10733 1573 3 sprachen sprachen PROPN dad-10733 1573 4 , , PUNCT dad-10733 1573 5 1998 1998 NUM dad-10733 1573 6 . . PUNCT dad-10733 1574 1 s. s. PROPN dad-10733 1574 2 mcglashan mcglashan PROPN dad-10733 1574 3 , , PUNCT dad-10733 1574 4 n. n. PROPN dad-10733 1574 5 fraser fraser PROPN dad-10733 1574 6 , , PUNCT dad-10733 1574 7 n. n. PROPN dad-10733 1574 8 gilbert gilbert PROPN dad-10733 1574 9 , , PUNCT dad-10733 1574 10 e. e. PROPN dad-10733 1574 11 bilange bilange PROPN dad-10733 1574 12 , , PUNCT dad-10733 1574 13 p. p. PROPN dad-10733 1574 14 heisterkamp heisterkamp PROPN dad-10733 1574 15 , , PUNCT dad-10733 1574 16 and and CCONJ dad-10733 1574 17 n. n. VERB dad-10733 1574 18 you you PRON dad-10733 1574 19 d. d. PROPN dad-10733 1574 20 dialogue dialogue PROPN dad-10733 1574 21 management management NOUN dad-10733 1574 22 for for ADP dad-10733 1574 23 telephone telephone NOUN dad-10733 1574 24 information information NOUN dad-10733 1574 25 systems system NOUN dad-10733 1574 26 . . PUNCT dad-10733 1575 1 in in ADP dad-10733 1575 2 conference conference NOUN dad-10733 1575 3 on on ADP dad-10733 1575 4 applied apply VERB dad-10733 1575 5 natural natural ADJ dad-10733 1575 6 language language NOUN dad-10733 1575 7 processing processing NOUN dad-10733 1575 8 , , PUNCT dad-10733 1575 9 pages page NOUN dad-10733 1575 10 245–246 245–246 NUM dad-10733 1575 11 . . PUNCT dad-10733 1576 1 acl acl PROPN dad-10733 1576 2 , , PUNCT dad-10733 1576 3 1992 1992 NUM dad-10733 1576 4 . . PUNCT dad-10733 1577 1 g. g. PROPN dad-10733 1577 2 mckeown mckeown PROPN dad-10733 1577 3 , , PUNCT dad-10733 1577 4 m. m. NOUN dad-10733 1577 5 f f PROPN dad-10733 1577 6 valstar valstar PROPN dad-10733 1577 7 , , PUNCT dad-10733 1577 8 r. r. PROPN dad-10733 1577 9 cowie cowie PROPN dad-10733 1577 10 , , PUNCT dad-10733 1577 11 and and CCONJ dad-10733 1577 12 m. m. NOUN dad-10733 1577 13 pantic pantic PROPN dad-10733 1577 14 . . PUNCT dad-10733 1578 1 the the DET dad-10733 1578 2 semaine semaine PROPN dad-10733 1578 3 corpus corpus PROPN dad-10733 1578 4 of of ADP dad-10733 1578 5 emotionally emotionally ADV dad-10733 1578 6 coloured coloured ADJ dad-10733 1578 7 character character NOUN dad-10733 1578 8 interactions interaction NOUN dad-10733 1578 9 . . PUNCT dad-10733 1579 1 in in ADP dad-10733 1579 2 multimedia multimedia NOUN dad-10733 1579 3 and and CCONJ dad-10733 1579 4 expo expo NOUN dad-10733 1579 5 ( ( PUNCT dad-10733 1579 6 icme icme PROPN dad-10733 1579 7 ) ) PUNCT dad-10733 1579 8 , , PUNCT dad-10733 1579 9 2010 2010 NUM dad-10733 1579 10 ieee ieee PROPN dad-10733 1579 11 international international ADJ dad-10733 1579 12 conference conference NOUN dad-10733 1579 13 on on ADP dad-10733 1579 14 , , PUNCT dad-10733 1579 15 pages page NOUN dad-10733 1579 16 1079–1084 1079–1084 NUM dad-10733 1579 17 , , PUNCT dad-10733 1579 18 2010 2010 NUM dad-10733 1579 19 . . PUNCT dad-10733 1580 1 g. g. PROPN dad-10733 1580 2 mesnil mesnil PROPN dad-10733 1580 3 , , PUNCT dad-10733 1580 4 x. x. NOUN dad-10733 1581 1 he he PRON dad-10733 1581 2 , , PUNCT dad-10733 1581 3 l. l. PROPN dad-10733 1581 4 deng deng PROPN dad-10733 1581 5 , , PUNCT dad-10733 1581 6 and and CCONJ dad-10733 1581 7 y. y. PROPN dad-10733 1581 8 bengio bengio PROPN dad-10733 1581 9 . . PUNCT dad-10733 1582 1 investigation investigation NOUN dad-10733 1582 2 of of ADP dad-10733 1582 3 recurrent recurrent ADJ dad-10733 1582 4 - - PUNCT dad-10733 1582 5 neural neural ADJ dad-10733 1582 6 - - PUNCT dad-10733 1582 7 network network NOUN dad-10733 1582 8 architectures architecture NOUN dad-10733 1582 9 and and CCONJ dad-10733 1582 10 learning learn VERB dad-10733 1582 11 methods method NOUN dad-10733 1582 12 for for ADP dad-10733 1582 13 spoken spoken ADJ dad-10733 1582 14 language language NOUN dad-10733 1582 15 understanding understanding NOUN dad-10733 1582 16 . . PUNCT dad-10733 1583 1 in in ADP dad-10733 1583 2 interspeech interspeech NOUN dad-10733 1583 3 , , PUNCT dad-10733 1583 4 pages page NOUN dad-10733 1583 5 3771–3775 3771–3775 NUM dad-10733 1583 6 , , PUNCT dad-10733 1583 7 2013 2013 NUM dad-10733 1583 8 . . PUNCT dad-10733 1584 1 t. t. PROPN dad-10733 1584 2 mikolov mikolov PROPN dad-10733 1584 3 , , PUNCT dad-10733 1584 4 m. m. NOUN dad-10733 1584 5 karafiát karafiát PROPN dad-10733 1584 6 , , PUNCT dad-10733 1584 7 l. l. PROPN dad-10733 1584 8 burget burget PROPN dad-10733 1584 9 , , PUNCT dad-10733 1584 10 j. j. PROPN dad-10733 1584 11 cernockỳ cernockỳ PROPN dad-10733 1584 12 , , PUNCT dad-10733 1584 13 and and CCONJ dad-10733 1584 14 sanjeev sanjeev PROPN dad-10733 1584 15 khudanpur khudanpur PROPN dad-10733 1584 16 . . PUNCT dad-10733 1585 1 recurrent recurrent ADJ dad-10733 1585 2 neural neural ADJ dad-10733 1585 3 network network NOUN dad-10733 1585 4 based base VERB dad-10733 1585 5 language language NOUN dad-10733 1585 6 model model NOUN dad-10733 1585 7 . . PUNCT dad-10733 1586 1 in in ADP dad-10733 1586 2 interspeech interspeech NOUN dad-10733 1586 3 , , PUNCT dad-10733 1586 4 pages page NOUN dad-10733 1586 5 1045–1048 1045–1048 NUM dad-10733 1586 6 , , PUNCT dad-10733 1586 7 2010 2010 NUM dad-10733 1586 8 . . PUNCT dad-10733 1587 1 t. t. PROPN dad-10733 1587 2 mikolov mikolov PROPN dad-10733 1587 3 , , PUNCT dad-10733 1587 4 i. i. PROPN dad-10733 1587 5 sutskever sutskever PROPN dad-10733 1587 6 , , PUNCT dad-10733 1587 7 k. k. PROPN dad-10733 1587 8 chen chen PROPN dad-10733 1587 9 , , PUNCT dad-10733 1587 10 g. g. PROPN dad-10733 1587 11 s. s. PROPN dad-10733 1587 12 corrado corrado PROPN dad-10733 1587 13 , , PUNCT dad-10733 1587 14 and and CCONJ dad-10733 1587 15 j. j. PROPN dad-10733 1587 16 dean dean PROPN dad-10733 1587 17 . . PUNCT dad-10733 1588 1 distributed distribute VERB dad-10733 1588 2 representations representation NOUN dad-10733 1588 3 of of ADP dad-10733 1588 4 words word NOUN dad-10733 1588 5 and and CCONJ dad-10733 1588 6 phrases phrase NOUN dad-10733 1588 7 and and CCONJ dad-10733 1588 8 their their PRON dad-10733 1588 9 compositionality compositionality NOUN dad-10733 1588 10 . . PUNCT dad-10733 1589 1 in in ADP dad-10733 1589 2 neural neural ADJ dad-10733 1589 3 information information NOUN dad-10733 1589 4 processing processing NOUN dad-10733 1589 5 systems system NOUN dad-10733 1589 6 , , PUNCT dad-10733 1589 7 pages page NOUN dad-10733 1589 8 3111–3119 3111–3119 NUM dad-10733 1589 9 , , PUNCT dad-10733 1589 10 2013 2013 NUM dad-10733 1589 11 . . PUNCT dad-10733 1590 1 g. g. PROPN dad-10733 1590 2 a. a. PROPN dad-10733 1590 3 miller miller PROPN dad-10733 1590 4 . . PUNCT dad-10733 1591 1 wordnet wordnet NOUN dad-10733 1591 2 : : PUNCT dad-10733 1591 3 a a DET dad-10733 1591 4 lexical lexical ADJ dad-10733 1591 5 database database NOUN dad-10733 1591 6 for for ADP dad-10733 1591 7 english english PROPN dad-10733 1591 8 . . PUNCT dad-10733 1592 1 communications communication NOUN dad-10733 1592 2 of of ADP dad-10733 1592 3 the the DET dad-10733 1592 4 acm acm PROPN dad-10733 1592 5 , , PUNCT dad-10733 1592 6 38(11):39–41 38(11):39–41 NUM dad-10733 1592 7 , , PUNCT dad-10733 1592 8 1995 1995 NUM dad-10733 1592 9 . . PUNCT dad-10733 1593 1 s. s. PROPN dad-10733 1593 2 miller miller PROPN dad-10733 1593 3 , , PUNCT dad-10733 1593 4 d. d. PROPN dad-10733 1593 5 stallard stallard PROPN dad-10733 1593 6 , , PUNCT dad-10733 1593 7 r. r. PROPN dad-10733 1593 8 bobrow bobrow VERB dad-10733 1593 9 , , PUNCT dad-10733 1593 10 and and CCONJ dad-10733 1593 11 r. r. PROPN dad-10733 1593 12 schwartz schwartz PROPN dad-10733 1593 13 . . PUNCT dad-10733 1594 1 a a DET dad-10733 1594 2 fully fully ADV dad-10733 1594 3 statistical statistical ADJ dad-10733 1594 4 approach approach NOUN dad-10733 1594 5 to to ADP dad-10733 1594 6 natural natural ADJ dad-10733 1594 7 language language NOUN dad-10733 1594 8 interfaces interface NOUN dad-10733 1594 9 . . PUNCT dad-10733 1595 1 in in ADP dad-10733 1595 2 association association NOUN dad-10733 1595 3 for for ADP dad-10733 1595 4 computational computational ADJ dad-10733 1595 5 linguistics linguistic NOUN dad-10733 1595 6 , , PUNCT dad-10733 1595 7 pages page NOUN dad-10733 1595 8 55–61 55–61 NUM dad-10733 1595 9 , , PUNCT dad-10733 1595 10 1996 1996 NUM dad-10733 1595 11 . . PUNCT dad-10733 1596 1 k. k. PROPN dad-10733 1596 2 mo mo PROPN dad-10733 1596 3 , , PUNCT dad-10733 1596 4 s. s. PROPN dad-10733 1596 5 li li PROPN dad-10733 1596 6 , , PUNCT dad-10733 1596 7 y. y. PROPN dad-10733 1596 8 zhang zhang PROPN dad-10733 1596 9 , , PUNCT dad-10733 1596 10 j. j. PROPN dad-10733 1596 11 li li PROPN dad-10733 1596 12 , , PUNCT dad-10733 1596 13 and and CCONJ dad-10733 1596 14 q. q. PROPN dad-10733 1596 15 yang yang PROPN dad-10733 1596 16 . . PUNCT dad-10733 1597 1 personalizing personalize VERB dad-10733 1597 2 a a DET dad-10733 1597 3 dialogue dialogue NOUN dad-10733 1597 4 system system NOUN dad-10733 1597 5 with with ADP dad-10733 1597 6 transfer transfer NOUN dad-10733 1597 7 learning learning NOUN dad-10733 1597 8 . . PUNCT dad-10733 1598 1 arxiv arxiv PROPN dad-10733 1598 2 preprint preprint PROPN dad-10733 1598 3 arxiv:1610.02891 arxiv:1610.02891 PROPN dad-10733 1598 4 , , PUNCT dad-10733 1598 5 2016 2016 NUM dad-10733 1598 6 . . PUNCT dad-10733 1599 1 s. s. PROPN dad-10733 1599 2 mohan mohan PROPN dad-10733 1599 3 and and CCONJ dad-10733 1599 4 j. j. PROPN dad-10733 1599 5 laird laird PROPN dad-10733 1599 6 . . PUNCT dad-10733 1600 1 learning learn VERB dad-10733 1600 2 goal goal NOUN dad-10733 1600 3 - - PUNCT dad-10733 1600 4 oriented orient VERB dad-10733 1600 5 hierarchical hierarchical ADJ dad-10733 1600 6 tasks task NOUN dad-10733 1600 7 from from ADP dad-10733 1600 8 situated situated ADJ dad-10733 1600 9 interactive interactive ADJ dad-10733 1600 10 instruction instruction NOUN dad-10733 1600 11 . . PUNCT dad-10733 1601 1 in in ADP dad-10733 1601 2 aaai aaai PROPN dad-10733 1601 3 , , PUNCT dad-10733 1601 4 2014 2014 NUM dad-10733 1601 5 . . PUNCT dad-10733 1602 1 t. t. PROPN dad-10733 1602 2 nguyen nguyen PROPN dad-10733 1602 3 , , PUNCT dad-10733 1602 4 m. m. PROPN dad-10733 1602 5 rosenberg rosenberg PROPN dad-10733 1602 6 , , PUNCT dad-10733 1602 7 x. x. PROPN dad-10733 1602 8 song song PROPN dad-10733 1602 9 , , PUNCT dad-10733 1602 10 j. j. PROPN dad-10733 1602 11 gao gao PROPN dad-10733 1602 12 , , PUNCT dad-10733 1602 13 s. s. PROPN dad-10733 1602 14 tiwary tiwary PROPN dad-10733 1602 15 , , PUNCT dad-10733 1602 16 r. r. PROPN dad-10733 1602 17 majumder majumder PROPN dad-10733 1602 18 , , PUNCT dad-10733 1602 19 and and CCONJ dad-10733 1602 20 l. l. PROPN dad-10733 1602 21 deng deng PROPN dad-10733 1602 22 . . PUNCT dad-10733 1603 1 ms ms PROPN dad-10733 1603 2 marco marco PROPN dad-10733 1603 3 : : PUNCT dad-10733 1603 4 a a DET dad-10733 1603 5 human human ADJ dad-10733 1603 6 generated generate VERB dad-10733 1603 7 machine machine NOUN dad-10733 1603 8 reading reading NOUN dad-10733 1603 9 comprehension comprehension NOUN dad-10733 1603 10 dataset dataset NOUN dad-10733 1603 11 . . PUNCT dad-10733 1604 1 arxiv arxiv PROPN dad-10733 1604 2 preprint preprint VERB dad-10733 1604 3 arxiv:1611.09268 arxiv:1611.09268 PROPN dad-10733 1604 4 , , PUNCT dad-10733 1604 5 2016 2016 NUM dad-10733 1604 6 . . PUNCT dad-10733 1605 1 l l PROPN dad-10733 1605 2 nio nio PROPN dad-10733 1605 3 , , PUNCT dad-10733 1605 4 s. s. PROPN dad-10733 1605 5 sakti sakti PROPN dad-10733 1605 6 , , PUNCT dad-10733 1605 7 g. g. PROPN dad-10733 1605 8 neubig neubig PROPN dad-10733 1605 9 , , PUNCT dad-10733 1605 10 t. t. PROPN dad-10733 1605 11 toda toda PROPN dad-10733 1605 12 , , PUNCT dad-10733 1605 13 and and CCONJ dad-10733 1605 14 s. s. PROPN dad-10733 1605 15 nakamura nakamura PROPN dad-10733 1605 16 . . PUNCT dad-10733 1606 1 conversation conversation PROPN dad-10733 1606 2 dialog dialog PROPN dad-10733 1606 3 corpora corpora PROPN dad-10733 1606 4 from from ADP dad-10733 1606 5 television television NOUN dad-10733 1606 6 and and CCONJ dad-10733 1606 7 movie movie NOUN dad-10733 1606 8 scripts script NOUN dad-10733 1606 9 . . PUNCT dad-10733 1607 1 in in ADP dad-10733 1607 2 17th 17th ADJ dad-10733 1607 3 oriental oriental ADJ dad-10733 1607 4 chapter chapter NOUN dad-10733 1607 5 of of ADP dad-10733 1607 6 the the DET dad-10733 1607 7 international international ADJ dad-10733 1607 8 committee committee NOUN dad-10733 1607 9 for for ADP dad-10733 1607 10 the the DET dad-10733 1607 11 co co NOUN dad-10733 1607 12 - - NOUN dad-10733 1607 13 ordination ordination NOUN dad-10733 1607 14 and and CCONJ dad-10733 1607 15 standardization standardization NOUN dad-10733 1607 16 of of ADP dad-10733 1607 17 speech speech NOUN dad-10733 1607 18 databases database NOUN dad-10733 1607 19 and and CCONJ dad-10733 1607 20 assessment assessment NOUN dad-10733 1607 21 techniques technique NOUN dad-10733 1607 22 ( ( PUNCT dad-10733 1607 23 cocosda cocosda NOUN dad-10733 1607 24 ) ) PUNCT dad-10733 1607 25 , , PUNCT dad-10733 1607 26 pages page NOUN dad-10733 1607 27 1–4 1–4 NUM dad-10733 1607 28 , , PUNCT dad-10733 1607 29 2014 2014 NUM dad-10733 1607 30 . . PUNCT dad-10733 1608 1 e. e. PROPN dad-10733 1608 2 nöth nöth PROPN dad-10733 1608 3 , , PUNCT dad-10733 1608 4 a. a. NOUN dad-10733 1608 5 horndasch horndasch PROPN dad-10733 1608 6 , , PUNCT dad-10733 1608 7 f. f. PROPN dad-10733 1608 8 gallwitz gallwitz PROPN dad-10733 1608 9 , , PUNCT dad-10733 1608 10 and and CCONJ dad-10733 1608 11 j. j. PROPN dad-10733 1608 12 haas haas PROPN dad-10733 1608 13 . . PUNCT dad-10733 1609 1 experiences experience NOUN dad-10733 1609 2 with with ADP dad-10733 1609 3 commercial commercial ADJ dad-10733 1609 4 telephone telephone NOUN dad-10733 1609 5 - - PUNCT dad-10733 1609 6 based base VERB dad-10733 1609 7 dialogue dialogue NOUN dad-10733 1609 8 systems system NOUN dad-10733 1609 9 . . PUNCT dad-10733 1610 1 it it PRON dad-10733 1610 2 – – PUNCT dad-10733 1610 3 information information NOUN dad-10733 1610 4 technology technology NOUN dad-10733 1610 5 ( ( PUNCT dad-10733 1610 6 vormals vormal NOUN dad-10733 1610 7 it+ it+ NOUN dad-10733 1610 8 ti ti NOUN dad-10733 1610 9 ) ) PUNCT dad-10733 1610 10 , , PUNCT dad-10733 1610 11 46(6/2004):315–321 46(6/2004):315–321 NUM dad-10733 1610 12 , , PUNCT dad-10733 1610 13 2004 2004 NUM dad-10733 1610 14 . . PUNCT dad-10733 1611 1 c. c. PROPN dad-10733 1611 2 oertel oertel PROPN dad-10733 1611 3 , , PUNCT dad-10733 1611 4 f. f. PROPN dad-10733 1611 5 cummins cummins PROPN dad-10733 1611 6 , , PUNCT dad-10733 1611 7 j. j. PROPN dad-10733 1611 8 edlund edlund PROPN dad-10733 1611 9 , , PUNCT dad-10733 1611 10 p. p. PROPN dad-10733 1611 11 wagner wagner PROPN dad-10733 1611 12 , , PUNCT dad-10733 1611 13 and and CCONJ dad-10733 1611 14 n. n. PROPN dad-10733 1611 15 campbell campbell PROPN dad-10733 1611 16 . . PUNCT dad-10733 1612 1 d64 d64 PROPN dad-10733 1612 2 : : PUNCT dad-10733 1612 3 a a DET dad-10733 1612 4 corpus corpus NOUN dad-10733 1612 5 of of ADP dad-10733 1612 6 richly richly ADV dad-10733 1612 7 recorded record VERB dad-10733 1612 8 conversational conversational ADJ dad-10733 1612 9 interaction interaction NOUN dad-10733 1612 10 . . PUNCT dad-10733 1613 1 journal journal NOUN dad-10733 1613 2 on on ADP dad-10733 1613 3 multimodal multimodal NOUN dad-10733 1613 4 user user NOUN dad-10733 1613 5 interfaces interface NOUN dad-10733 1613 6 , , PUNCT dad-10733 1613 7 7(1 7(1 PROPN dad-10733 1613 8 - - SYM dad-10733 1613 9 2):19–28 2):19–28 NUM dad-10733 1613 10 , , PUNCT dad-10733 1613 11 2013 2013 NUM dad-10733 1613 12 . . PUNCT dad-10733 1614 1 a. a. PROPN dad-10733 1614 2 h. h. PROPN dad-10733 1615 1 oh oh INTJ dad-10733 1615 2 and and CCONJ dad-10733 1615 3 a. a. NOUN dad-10733 1615 4 i. i. PROPN dad-10733 1615 5 rudnicky rudnicky PROPN dad-10733 1615 6 . . PUNCT dad-10733 1616 1 stochastic stochastic ADJ dad-10733 1616 2 language language NOUN dad-10733 1616 3 generation generation NOUN dad-10733 1616 4 for for ADP dad-10733 1616 5 spoken spoken ADJ dad-10733 1616 6 dialogue dialogue NOUN dad-10733 1616 7 systems system NOUN dad-10733 1616 8 . . PUNCT dad-10733 1617 1 in in ADP dad-10733 1617 2 anlp anlp PROPN dad-10733 1617 3 / / SYM dad-10733 1617 4 naacl naacl PROPN dad-10733 1617 5 workshop workshop NOUN dad-10733 1617 6 on on ADP dad-10733 1617 7 conversational conversational ADJ dad-10733 1617 8 systems system NOUN dad-10733 1617 9 , , PUNCT dad-10733 1617 10 volume volume NOUN dad-10733 1617 11 3 3 NUM dad-10733 1617 12 , , PUNCT dad-10733 1617 13 pages page NOUN dad-10733 1617 14 27–32 27–32 NUM dad-10733 1617 15 . . PUNCT dad-10733 1618 1 acl acl PROPN dad-10733 1618 2 , , PUNCT dad-10733 1618 3 2000 2000 NUM dad-10733 1618 4 . . PUNCT dad-10733 1619 1 t. t. PROPN dad-10733 1619 2 paek paek PROPN dad-10733 1619 3 . . PUNCT dad-10733 1620 1 reinforcement reinforcement NOUN dad-10733 1620 2 learning learning NOUN dad-10733 1620 3 for for ADP dad-10733 1620 4 spoken spoken ADJ dad-10733 1620 5 dialogue dialogue NOUN dad-10733 1620 6 systems system NOUN dad-10733 1620 7 : : PUNCT dad-10733 1620 8 comparing compare VERB dad-10733 1620 9 strengths strength NOUN dad-10733 1620 10 and and CCONJ dad-10733 1620 11 weaknesses weakness NOUN dad-10733 1620 12 for for ADP dad-10733 1620 13 practical practical ADJ dad-10733 1620 14 deployment deployment NOUN dad-10733 1620 15 . . PUNCT dad-10733 1621 1 in in ADP dad-10733 1621 2 proc proc PROPN dad-10733 1621 3 . . PUNCT dad-10733 1622 1 dialog dialog NOUN dad-10733 1622 2 - - PUNCT dad-10733 1622 3 on on ADP dad-10733 1622 4 - - PUNCT dad-10733 1622 5 dialog dialog NOUN dad-10733 1622 6 workshop workshop NOUN dad-10733 1622 7 , , PUNCT dad-10733 1622 8 interspeech interspeech NOUN dad-10733 1622 9 , , PUNCT dad-10733 1622 10 2006 2006 NUM dad-10733 1622 11 . . PUNCT dad-10733 1623 1 k. k. PROPN dad-10733 1623 2 papineni papineni PROPN dad-10733 1623 3 , , PUNCT dad-10733 1623 4 s. s. PROPN dad-10733 1623 5 roukos roukos PROPN dad-10733 1623 6 , , PUNCT dad-10733 1623 7 t t NOUN dad-10733 1623 8 ward ward NOUN dad-10733 1623 9 , , PUNCT dad-10733 1623 10 and and CCONJ dad-10733 1623 11 w w PROPN dad-10733 1623 12 zhu zhu PROPN dad-10733 1623 13 . . PUNCT dad-10733 1624 1 bleu bleu PROPN dad-10733 1624 2 : : PUNCT dad-10733 1624 3 a a DET dad-10733 1624 4 method method NOUN dad-10733 1624 5 for for ADP dad-10733 1624 6 automatic automatic ADJ dad-10733 1624 7 evaluation evaluation NOUN dad-10733 1624 8 of of ADP dad-10733 1624 9 machine machine NOUN dad-10733 1624 10 translation translation NOUN dad-10733 1624 11 . . PUNCT dad-10733 1625 1 in in ADP dad-10733 1625 2 association association NOUN dad-10733 1625 3 for for ADP dad-10733 1625 4 computational computational ADJ dad-10733 1625 5 linguistics linguistic NOUN dad-10733 1625 6 , , PUNCT dad-10733 1625 7 2002 2002 NUM dad-10733 1625 8 . . PUNCT dad-10733 1626 1 g. g. PROPN dad-10733 1626 2 parent parent PROPN dad-10733 1626 3 and and CCONJ dad-10733 1626 4 m. m. NOUN dad-10733 1626 5 eskenazi eskenazi NOUN dad-10733 1626 6 . . PUNCT dad-10733 1627 1 toward toward ADP dad-10733 1627 2 better well ADJ dad-10733 1627 3 crowdsourced crowdsourced ADJ dad-10733 1627 4 transcription transcription NOUN dad-10733 1627 5 : : PUNCT dad-10733 1627 6 transcription transcription NOUN dad-10733 1627 7 of of ADP dad-10733 1627 8 a a DET dad-10733 1627 9 year year NOUN dad-10733 1627 10 of of ADP dad-10733 1627 11 the the DET dad-10733 1627 12 let let VERB dad-10733 1627 13 ’s ’s NOUN dad-10733 1627 14 go go VERB dad-10733 1627 15 bus bus NOUN dad-10733 1627 16 information information NOUN dad-10733 1627 17 system system NOUN dad-10733 1627 18 data datum NOUN dad-10733 1627 19 . . PUNCT dad-10733 1628 1 in in ADP dad-10733 1628 2 spoken spoken ADJ dad-10733 1628 3 language language NOUN dad-10733 1628 4 technology technology NOUN dad-10733 1628 5 workshop workshop NOUN dad-10733 1628 6 ( ( PUNCT dad-10733 1628 7 slt slt PROPN dad-10733 1628 8 ) ) PUNCT dad-10733 1628 9 , , PUNCT dad-10733 1628 10 2010 2010 NUM dad-10733 1628 11 ieee ieee NOUN dad-10733 1628 12 , , PUNCT dad-10733 1628 13 pages page NOUN dad-10733 1628 14 312–317 312–317 NUM dad-10733 1628 15 . . PUNCT dad-10733 1628 16 ieee ieee PROPN dad-10733 1628 17 , , PUNCT dad-10733 1628 18 2010 2010 NUM dad-10733 1628 19 . . PUNCT dad-10733 1628 20 a. a. PROPN dad-10733 1628 21 n. n. PROPN dad-10733 1628 22 pargellis pargellis PROPN dad-10733 1628 23 , , PUNCT dad-10733 1628 24 h h PROPN dad-10733 1628 25 - - PUNCT dad-10733 1628 26 k. k. PROPN dad-10733 1628 27 j. j. PROPN dad-10733 1628 28 kuo kuo PROPN dad-10733 1628 29 , , PUNCT dad-10733 1628 30 and and CCONJ dad-10733 1628 31 c. c. PROPN dad-10733 1628 32 lee lee PROPN dad-10733 1628 33 . . PUNCT dad-10733 1629 1 an an DET dad-10733 1629 2 automatic automatic ADJ dad-10733 1629 3 dialogue dialogue NOUN dad-10733 1629 4 generation generation NOUN dad-10733 1629 5 platform platform NOUN dad-10733 1629 6 for for ADP dad-10733 1629 7 personalized personalized ADJ dad-10733 1629 8 dialogue dialogue NOUN dad-10733 1629 9 applications application NOUN dad-10733 1629 10 . . PUNCT dad-10733 1630 1 speech speech NOUN dad-10733 1630 2 communication communication NOUN dad-10733 1630 3 , , PUNCT dad-10733 1630 4 42(3 42(3 NOUN dad-10733 1630 5 - - PUNCT dad-10733 1630 6 4):329–351 4):329–351 NOUN dad-10733 1630 7 , , PUNCT dad-10733 1630 8 2004 2004 NUM dad-10733 1630 9 . . PUNCT dad-10733 1631 1 doi doi NOUN dad-10733 1631 2 : : PUNCT dad-10733 1631 3 10.1016 10.1016 NUM dad-10733 1631 4 / / SYM dad-10733 1631 5 j.specom.2003.10.003 j.specom.2003.10.003 PROPN dad-10733 1631 6 . . PROPN dad-10733 1631 7 r. r. PROPN dad-10733 1631 8 passonneau passonneau PROPN dad-10733 1631 9 and and CCONJ dad-10733 1631 10 e. e. PROPN dad-10733 1631 11 sachar sachar PROPN dad-10733 1631 12 . . PROPN dad-10733 1631 13 loqui loqui PROPN dad-10733 1631 14 human human ADJ dad-10733 1631 15 - - PUNCT dad-10733 1631 16 human human ADJ dad-10733 1631 17 dialogue dialogue NOUN dad-10733 1631 18 corpus corpus NOUN dad-10733 1631 19 ( ( PUNCT dad-10733 1631 20 transcriptions transcription NOUN dad-10733 1631 21 and and CCONJ dad-10733 1631 22 annotations annotation NOUN dad-10733 1631 23 ) ) PUNCT dad-10733 1631 24 , , PUNCT dad-10733 1631 25 2014 2014 NUM dad-10733 1631 26 . . PUNCT dad-10733 1632 1 b. b. PROPN dad-10733 1632 2 peng peng PROPN dad-10733 1632 3 , , PUNCT dad-10733 1632 4 x. x. PROPN dad-10733 1632 5 li li PROPN dad-10733 1632 6 , , PUNCT dad-10733 1632 7 l. l. PROPN dad-10733 1632 8 li li PROPN dad-10733 1632 9 , , PUNCT dad-10733 1632 10 j. j. PROPN dad-10733 1632 11 gao gao PROPN dad-10733 1632 12 , , PUNCT dad-10733 1632 13 a. a. NOUN dad-10733 1632 14 celikyilmaz celikyilmaz NOUN dad-10733 1632 15 , , PUNCT dad-10733 1632 16 s. s. PROPN dad-10733 1632 17 lee lee PROPN dad-10733 1632 18 , , PUNCT dad-10733 1632 19 and and CCONJ dad-10733 1632 20 k.-f k.-f PROPN dad-10733 1632 21 . . PUNCT dad-10733 1633 1 wong wong PROPN dad-10733 1633 2 . . PUNCT dad-10733 1634 1 composite composite ADJ dad-10733 1634 2 task task NOUN dad-10733 1634 3 - - PUNCT dad-10733 1634 4 completion completion NOUN dad-10733 1634 5 dialogue dialogue NOUN dad-10733 1634 6 policy policy NOUN dad-10733 1634 7 learning learning NOUN dad-10733 1634 8 via via ADP dad-10733 1634 9 hierarchical hierarchical ADJ dad-10733 1634 10 deep deep ADJ dad-10733 1634 11 reinforcement reinforcement NOUN dad-10733 1634 12 learning learning NOUN dad-10733 1634 13 . . PUNCT dad-10733 1635 1 in in ADP dad-10733 1635 2 conference conference NOUN dad-10733 1635 3 on on ADP dad-10733 1635 4 empirical empirical ADJ dad-10733 1635 5 methods method NOUN dad-10733 1635 6 in in ADP dad-10733 1635 7 natural natural ADJ dad-10733 1635 8 language language NOUN dad-10733 1635 9 processing processing NOUN dad-10733 1635 10 ( ( PUNCT dad-10733 1635 11 emnlp emnlp ADJ dad-10733 1635 12 ) ) PUNCT dad-10733 1635 13 , , PUNCT dad-10733 1635 14 pages page NOUN dad-10733 1635 15 2221–2230 2221–2230 NUM dad-10733 1635 16 , , PUNCT dad-10733 1635 17 2017 2017 NUM dad-10733 1635 18 . . PUNCT dad-10733 1636 1 45 45 NUM dad-10733 1636 2 serban serban PROPN dad-10733 1636 3 , , PUNCT dad-10733 1636 4 lowe lowe PROPN dad-10733 1636 5 , , PUNCT dad-10733 1636 6 henderson henderson PROPN dad-10733 1636 7 , , PUNCT dad-10733 1636 8 charlin charlin PROPN dad-10733 1636 9 and and CCONJ dad-10733 1636 10 pineau pineau PROPN dad-10733 1636 11 d. d. PROPN dad-10733 1636 12 perez perez PROPN dad-10733 1636 13 - - PUNCT dad-10733 1636 14 marin marin PROPN dad-10733 1636 15 and and CCONJ dad-10733 1636 16 i. i. PROPN dad-10733 1636 17 pascual pascual PROPN dad-10733 1636 18 - - PUNCT dad-10733 1636 19 nieto nieto PROPN dad-10733 1636 20 . . PUNCT dad-10733 1636 21 conversational conversational ADJ dad-10733 1636 22 agents agent NOUN dad-10733 1636 23 and and CCONJ dad-10733 1636 24 natural natural ADJ dad-10733 1636 25 language language NOUN dad-10733 1636 26 interaction interaction NOUN dad-10733 1636 27 : : PUNCT dad-10733 1636 28 techniques technique NOUN dad-10733 1636 29 and and CCONJ dad-10733 1636 30 effective effective ADJ dad-10733 1636 31 practices practice NOUN dad-10733 1636 32 . . PUNCT dad-10733 1637 1 igi igi PROPN dad-10733 1637 2 global global PROPN dad-10733 1637 3 , , PUNCT dad-10733 1637 4 2011 2011 NUM dad-10733 1637 5 . . PUNCT dad-10733 1638 1 s. s. PROPN dad-10733 1638 2 petrik petrik PROPN dad-10733 1638 3 . . PUNCT dad-10733 1639 1 wizard wizard ADJ dad-10733 1639 2 of of ADP dad-10733 1639 3 oz oz NOUN dad-10733 1639 4 experiments experiment NOUN dad-10733 1639 5 on on ADP dad-10733 1639 6 speech speech NOUN dad-10733 1639 7 dialogue dialogue NOUN dad-10733 1639 8 systems system NOUN dad-10733 1639 9 . . PUNCT dad-10733 1640 1 phd phd NOUN dad-10733 1640 2 thesis thesis NOUN dad-10733 1640 3 , , PUNCT dad-10733 1640 4 technischen technischen NOUN dad-10733 1640 5 universitat universitat PROPN dad-10733 1640 6 graz graz PROPN dad-10733 1640 7 , , PUNCT dad-10733 1640 8 2004 2004 NUM dad-10733 1640 9 . . PUNCT dad-10733 1641 1 r. r. PROPN dad-10733 1641 2 pieraccini pieraccini PROPN dad-10733 1641 3 , , PUNCT dad-10733 1641 4 d. d. PROPN dad-10733 1641 5 suendermann suendermann PROPN dad-10733 1641 6 , , PUNCT dad-10733 1641 7 k. k. PROPN dad-10733 1641 8 dayanidhi dayanidhi PROPN dad-10733 1641 9 , , PUNCT dad-10733 1641 10 and and CCONJ dad-10733 1641 11 j. j. PROPN dad-10733 1641 12 liscombe liscombe PROPN dad-10733 1641 13 . . PUNCT dad-10733 1642 1 are be AUX dad-10733 1642 2 we we PRON dad-10733 1642 3 there there ADV dad-10733 1642 4 yet yet ADV dad-10733 1642 5 ? ? PUNCT dad-10733 1643 1 research research NOUN dad-10733 1643 2 in in ADP dad-10733 1643 3 commercial commercial ADJ dad-10733 1643 4 spoken speak VERB dad-10733 1643 5 dialog dialog NOUN dad-10733 1643 6 systems system NOUN dad-10733 1643 7 . . PUNCT dad-10733 1644 1 in in ADP dad-10733 1644 2 text text NOUN dad-10733 1644 3 , , PUNCT dad-10733 1644 4 speech speech NOUN dad-10733 1644 5 and and CCONJ dad-10733 1644 6 dialogue dialogue NOUN dad-10733 1644 7 , , PUNCT dad-10733 1644 8 pages page NOUN dad-10733 1644 9 3–13 3–13 NUM dad-10733 1644 10 , , PUNCT dad-10733 1644 11 2009 2009 NUM dad-10733 1644 12 . . PUNCT dad-10733 1645 1 o. o. PROPN dad-10733 1645 2 pietquin pietquin PROPN dad-10733 1645 3 and and CCONJ dad-10733 1645 4 h. h. PROPN dad-10733 1645 5 hastie hastie PROPN dad-10733 1645 6 . . PUNCT dad-10733 1646 1 a a DET dad-10733 1646 2 survey survey NOUN dad-10733 1646 3 on on ADP dad-10733 1646 4 metrics metric NOUN dad-10733 1646 5 for for ADP dad-10733 1646 6 the the DET dad-10733 1646 7 evaluation evaluation NOUN dad-10733 1646 8 of of ADP dad-10733 1646 9 user user NOUN dad-10733 1646 10 simulations simulation NOUN dad-10733 1646 11 . . PUNCT dad-10733 1647 1 the the DET dad-10733 1647 2 knowledge knowledge PROPN dad-10733 1647 3 engineering engineering PROPN dad-10733 1647 4 review review PROPN dad-10733 1647 5 , , PUNCT dad-10733 1647 6 28(01):59–73 28(01):59–73 NUM dad-10733 1647 7 , , PUNCT dad-10733 1647 8 2013 2013 NUM dad-10733 1647 9 . . PUNCT dad-10733 1648 1 o. o. PROPN dad-10733 1648 2 pietquin pietquin PROPN dad-10733 1648 3 , , PUNCT dad-10733 1648 4 m. m. NOUN dad-10733 1648 5 geist geist PROPN dad-10733 1648 6 , , PUNCT dad-10733 1648 7 s. s. PROPN dad-10733 1648 8 chandramohan chandramohan PROPN dad-10733 1648 9 , , PUNCT dad-10733 1648 10 and and CCONJ dad-10733 1648 11 h. h. PROPN dad-10733 1648 12 frezza frezza PROPN dad-10733 1648 13 - - PUNCT dad-10733 1648 14 buet buet PROPN dad-10733 1648 15 . . PUNCT dad-10733 1649 1 sample sample NOUN dad-10733 1649 2 - - PUNCT dad-10733 1649 3 efficient efficient ADJ dad-10733 1649 4 batch batch NOUN dad-10733 1649 5 reinforcement reinforcement NOUN dad-10733 1649 6 learning learning NOUN dad-10733 1649 7 for for ADP dad-10733 1649 8 dialogue dialogue NOUN dad-10733 1649 9 management management NOUN dad-10733 1649 10 optimization optimization NOUN dad-10733 1649 11 . . PUNCT dad-10733 1650 1 acm acm PROPN dad-10733 1650 2 transactions transaction NOUN dad-10733 1650 3 on on ADP dad-10733 1650 4 speech speech NOUN dad-10733 1650 5 and and CCONJ dad-10733 1650 6 language language NOUN dad-10733 1650 7 processing processing NOUN dad-10733 1650 8 ( ( PUNCT dad-10733 1650 9 tslp tslp PROPN dad-10733 1650 10 ) ) PUNCT dad-10733 1650 11 , , PUNCT dad-10733 1650 12 7(3):7 7(3):7 NOUN dad-10733 1650 13 , , PUNCT dad-10733 1650 14 2011 2011 NUM dad-10733 1650 15 . . PUNCT dad-10733 1651 1 b. b. PROPN dad-10733 1651 2 piot piot PROPN dad-10733 1651 3 , , PUNCT dad-10733 1651 4 m. m. NOUN dad-10733 1651 5 geist geist PROPN dad-10733 1651 6 , , PUNCT dad-10733 1651 7 and and CCONJ dad-10733 1651 8 o. o. PROPN dad-10733 1651 9 pietquin pietquin PROPN dad-10733 1651 10 . . PUNCT dad-10733 1652 1 imitation imitation NOUN dad-10733 1652 2 learning learn VERB dad-10733 1652 3 applied apply VERB dad-10733 1652 4 to to ADP dad-10733 1652 5 embodied embody VERB dad-10733 1652 6 conversational conversational ADJ dad-10733 1652 7 agents agent NOUN dad-10733 1652 8 . . PUNCT dad-10733 1653 1 in in ADP dad-10733 1653 2 4th 4th ADJ dad-10733 1653 3 workshop workshop NOUN dad-10733 1653 4 on on ADP dad-10733 1653 5 machine machine NOUN dad-10733 1653 6 learning learning NOUN dad-10733 1653 7 for for ADP dad-10733 1653 8 interactive interactive ADJ dad-10733 1653 9 systems system NOUN dad-10733 1653 10 ( ( PUNCT dad-10733 1653 11 mlis mlis PROPN dad-10733 1653 12 2015 2015 NUM dad-10733 1653 13 ) ) PUNCT dad-10733 1653 14 , , PUNCT dad-10733 1653 15 volume volume NOUN dad-10733 1653 16 43 43 NUM dad-10733 1653 17 , , PUNCT dad-10733 1653 18 2015 2015 NUM dad-10733 1653 19 . . PUNCT dad-10733 1654 1 c. c. PROPN dad-10733 1654 2 potts potts PROPN dad-10733 1654 3 . . PUNCT dad-10733 1655 1 goal goal NOUN dad-10733 1655 2 - - PUNCT dad-10733 1655 3 driven drive VERB dad-10733 1655 4 answers answer NOUN dad-10733 1655 5 in in ADP dad-10733 1655 6 the the DET dad-10733 1655 7 cards card NOUN dad-10733 1655 8 dialogue dialogue NOUN dad-10733 1655 9 corpus corpus PROPN dad-10733 1655 10 . . PUNCT dad-10733 1656 1 in in ADP dad-10733 1656 2 west west PROPN dad-10733 1656 3 coast coast PROPN dad-10733 1656 4 conference conference PROPN dad-10733 1656 5 on on ADP dad-10733 1656 6 formal formal ADJ dad-10733 1656 7 linguistics linguistic NOUN dad-10733 1656 8 , , PUNCT dad-10733 1656 9 pages page NOUN dad-10733 1656 10 1–20 1–20 PROPN dad-10733 1656 11 , , PUNCT dad-10733 1656 12 2012 2012 NUM dad-10733 1656 13 . . PUNCT dad-10733 1657 1 a. a. PROPN dad-10733 1657 2 ratnaparkhi ratnaparkhi PROPN dad-10733 1657 3 . . PUNCT dad-10733 1658 1 trainable trainable ADJ dad-10733 1658 2 approaches approach NOUN dad-10733 1658 3 to to ADP dad-10733 1658 4 surface surface VERB dad-10733 1658 5 natural natural ADJ dad-10733 1658 6 language language NOUN dad-10733 1658 7 generation generation NOUN dad-10733 1658 8 and and CCONJ dad-10733 1658 9 their their PRON dad-10733 1658 10 application application NOUN dad-10733 1658 11 to to ADP dad-10733 1658 12 conversational conversational ADJ dad-10733 1658 13 dialog dialog NOUN dad-10733 1658 14 systems system NOUN dad-10733 1658 15 . . PUNCT dad-10733 1659 1 computer computer NOUN dad-10733 1659 2 speech speech NOUN dad-10733 1659 3 & & CCONJ dad-10733 1659 4 language language PROPN dad-10733 1659 5 , , PUNCT dad-10733 1659 6 16(3):435–455 16(3):435–455 NUM dad-10733 1659 7 , , PUNCT dad-10733 1659 8 2002 2002 NUM dad-10733 1659 9 . . PUNCT dad-10733 1660 1 a. a. PROPN dad-10733 1660 2 raux raux PROPN dad-10733 1660 3 , , PUNCT dad-10733 1660 4 b. b. PROPN dad-10733 1660 5 langner langner PROPN dad-10733 1660 6 , , PUNCT dad-10733 1660 7 d. d. PROPN dad-10733 1660 8 bohus bohus PROPN dad-10733 1660 9 , , PUNCT dad-10733 1660 10 a. a. PROPN dad-10733 1660 11 w. w. PROPN dad-10733 1660 12 black black PROPN dad-10733 1660 13 , , PUNCT dad-10733 1660 14 and and CCONJ dad-10733 1660 15 m. m. NOUN dad-10733 1660 16 eskenazi eskenazi PROPN dad-10733 1660 17 . . PUNCT dad-10733 1661 1 lets lets AUX dad-10733 1661 2 go go VERB dad-10733 1661 3 public public ADJ dad-10733 1661 4 ! ! PUNCT dad-10733 1662 1 taking take VERB dad-10733 1662 2 a a DET dad-10733 1662 3 spoken spoken ADJ dad-10733 1662 4 dialog dialog NOUN dad-10733 1662 5 system system NOUN dad-10733 1662 6 to to ADP dad-10733 1662 7 the the DET dad-10733 1662 8 real real ADJ dad-10733 1662 9 world world NOUN dad-10733 1662 10 . . PUNCT dad-10733 1663 1 in in ADP dad-10733 1663 2 interspeech interspeech NOUN dad-10733 1663 3 , , PUNCT dad-10733 1663 4 2005 2005 NUM dad-10733 1663 5 . . PUNCT dad-10733 1664 1 n. n. NOUN dad-10733 1664 2 reithinger reithinger PROPN dad-10733 1664 3 and and CCONJ dad-10733 1664 4 m. m. PROPN dad-10733 1664 5 klesen klesen PROPN dad-10733 1664 6 . . PUNCT dad-10733 1665 1 dialogue dialogue PROPN dad-10733 1665 2 act act VERB dad-10733 1665 3 classification classification NOUN dad-10733 1665 4 using use VERB dad-10733 1665 5 language language NOUN dad-10733 1665 6 models model NOUN dad-10733 1665 7 . . PUNCT dad-10733 1666 1 in in ADP dad-10733 1666 2 eurospeech eurospeech NOUN dad-10733 1666 3 , , PUNCT dad-10733 1666 4 1997 1997 NUM dad-10733 1666 5 . . PUNCT dad-10733 1667 1 h. h. PROPN dad-10733 1667 2 ren ren PROPN dad-10733 1667 3 , , PUNCT dad-10733 1667 4 w. w. PROPN dad-10733 1667 5 xu xu PROPN dad-10733 1667 6 , , PUNCT dad-10733 1667 7 y. y. PROPN dad-10733 1667 8 zhang zhang PROPN dad-10733 1667 9 , , PUNCT dad-10733 1667 10 and and CCONJ dad-10733 1667 11 y. y. PROPN dad-10733 1667 12 yan yan PROPN dad-10733 1667 13 . . PUNCT dad-10733 1668 1 dialog dialog PROPN dad-10733 1668 2 state state NOUN dad-10733 1668 3 tracking tracking NOUN dad-10733 1668 4 using use VERB dad-10733 1668 5 conditional conditional ADJ dad-10733 1668 6 random random ADJ dad-10733 1668 7 fields field NOUN dad-10733 1668 8 . . PUNCT dad-10733 1669 1 in in ADP dad-10733 1669 2 special special ADJ dad-10733 1669 3 interest interest NOUN dad-10733 1669 4 group group NOUN dad-10733 1669 5 on on ADP dad-10733 1669 6 discourse discourse NOUN dad-10733 1669 7 and and CCONJ dad-10733 1669 8 dialogue dialogue NOUN dad-10733 1669 9 ( ( PUNCT dad-10733 1669 10 sigdial sigdial ADJ dad-10733 1669 11 ) ) PUNCT dad-10733 1669 12 , , PUNCT dad-10733 1669 13 2013 2013 NUM dad-10733 1669 14 . . PUNCT dad-10733 1670 1 s. s. PROPN dad-10733 1670 2 renals renals PROPN dad-10733 1670 3 , , PUNCT dad-10733 1670 4 t. t. PROPN dad-10733 1670 5 hain hain PROPN dad-10733 1670 6 , , PUNCT dad-10733 1670 7 and and CCONJ dad-10733 1670 8 h. h. PROPN dad-10733 1670 9 bourlard bourlard PROPN dad-10733 1670 10 . . PUNCT dad-10733 1671 1 recognition recognition NOUN dad-10733 1671 2 and and CCONJ dad-10733 1671 3 understanding understanding NOUN dad-10733 1671 4 of of ADP dad-10733 1671 5 meetings meeting NOUN dad-10733 1671 6 the the DET dad-10733 1671 7 ami ami NOUN dad-10733 1671 8 and and CCONJ dad-10733 1671 9 amida amida PROPN dad-10733 1671 10 projects project NOUN dad-10733 1671 11 . . PUNCT dad-10733 1672 1 in in ADP dad-10733 1672 2 ieee ieee NOUN dad-10733 1672 3 workshop workshop NOUN dad-10733 1672 4 on on ADP dad-10733 1672 5 automatic automatic ADJ dad-10733 1672 6 speech speech NOUN dad-10733 1672 7 recognition recognition NOUN dad-10733 1672 8 & & CCONJ dad-10733 1672 9 understanding understanding PROPN dad-10733 1672 10 ( ( PUNCT dad-10733 1672 11 asru asru PROPN dad-10733 1672 12 ) ) PUNCT dad-10733 1672 13 , , PUNCT dad-10733 1672 14 2007 2007 NUM dad-10733 1672 15 . . PUNCT dad-10733 1673 1 r. r. PROPN dad-10733 1673 2 reppen reppen VERB dad-10733 1673 3 and and CCONJ dad-10733 1673 4 n. n. PROPN dad-10733 1673 5 ide ide NOUN dad-10733 1673 6 . . PUNCT dad-10733 1674 1 the the DET dad-10733 1674 2 american american PROPN dad-10733 1674 3 national national PROPN dad-10733 1674 4 corpus corpus PROPN dad-10733 1674 5 overall overall ADJ dad-10733 1674 6 goals goal NOUN dad-10733 1674 7 and and CCONJ dad-10733 1674 8 the the DET dad-10733 1674 9 first first ADJ dad-10733 1674 10 release release NOUN dad-10733 1674 11 . . PUNCT dad-10733 1675 1 journal journal NOUN dad-10733 1675 2 of of ADP dad-10733 1675 3 english english PROPN dad-10733 1675 4 linguistics linguistic NOUN dad-10733 1675 5 , , PUNCT dad-10733 1675 6 32(2):105–113 32(2):105–113 NUM dad-10733 1675 7 , , PUNCT dad-10733 1675 8 2004 2004 NUM dad-10733 1675 9 . . PUNCT dad-10733 1676 1 j. j. PROPN dad-10733 1676 2 rickel rickel PROPN dad-10733 1676 3 and and CCONJ dad-10733 1676 4 w. w. PROPN dad-10733 1676 5 l. l. PROPN dad-10733 1676 6 johnson johnson PROPN dad-10733 1676 7 . . PUNCT dad-10733 1677 1 animated animate VERB dad-10733 1677 2 agents agent NOUN dad-10733 1677 3 for for ADP dad-10733 1677 4 procedural procedural ADJ dad-10733 1677 5 training training NOUN dad-10733 1677 6 in in ADP dad-10733 1677 7 virtual virtual ADJ dad-10733 1677 8 reality reality NOUN dad-10733 1677 9 : : PUNCT dad-10733 1677 10 perception perception NOUN dad-10733 1677 11 , , PUNCT dad-10733 1677 12 cognition cognition NOUN dad-10733 1677 13 , , PUNCT dad-10733 1677 14 and and CCONJ dad-10733 1677 15 motor motor NOUN dad-10733 1677 16 control control NOUN dad-10733 1677 17 . . PUNCT dad-10733 1678 1 applied apply VERB dad-10733 1678 2 artificial artificial ADJ dad-10733 1678 3 intelligence intelligence NOUN dad-10733 1678 4 , , PUNCT dad-10733 1678 5 13(4 13(4 NOUN dad-10733 1678 6 - - SYM dad-10733 1678 7 5):343–382 5):343–382 NUM dad-10733 1678 8 , , PUNCT dad-10733 1678 9 1999 1999 NUM dad-10733 1678 10 . . PUNCT dad-10733 1679 1 v. v. ADP dad-10733 1679 2 rieser rieser NOUN dad-10733 1679 3 and and CCONJ dad-10733 1679 4 o. o. PROPN dad-10733 1679 5 lemon lemon NOUN dad-10733 1679 6 . . PUNCT dad-10733 1680 1 natural natural ADJ dad-10733 1680 2 language language NOUN dad-10733 1680 3 generation generation NOUN dad-10733 1680 4 as as ADP dad-10733 1680 5 planning plan VERB dad-10733 1680 6 under under ADP dad-10733 1680 7 uncertainty uncertainty NOUN dad-10733 1680 8 for for ADP dad-10733 1680 9 spoken spoken ADJ dad-10733 1680 10 dialogue dialogue NOUN dad-10733 1680 11 systems system NOUN dad-10733 1680 12 . . PUNCT dad-10733 1681 1 in in ADP dad-10733 1681 2 empirical empirical ADJ dad-10733 1681 3 methods method NOUN dad-10733 1681 4 in in ADP dad-10733 1681 5 natural natural ADJ dad-10733 1681 6 language language NOUN dad-10733 1681 7 generation generation NOUN dad-10733 1681 8 , , PUNCT dad-10733 1681 9 pages page NOUN dad-10733 1681 10 105–120 105–120 NUM dad-10733 1681 11 . . PUNCT dad-10733 1681 12 springer springer NOUN dad-10733 1681 13 , , PUNCT dad-10733 1681 14 2010 2010 NUM dad-10733 1681 15 . . PUNCT dad-10733 1682 1 verena verena PROPN dad-10733 1682 2 rieser rieser PROPN dad-10733 1682 3 and and CCONJ dad-10733 1682 4 oliver oliver PROPN dad-10733 1682 5 lemon lemon PROPN dad-10733 1682 6 . . PUNCT dad-10733 1683 1 reinforcement reinforcement NOUN dad-10733 1683 2 learning learning NOUN dad-10733 1683 3 for for ADP dad-10733 1683 4 adaptive adaptive ADJ dad-10733 1683 5 dialogue dialogue NOUN dad-10733 1683 6 systems system NOUN dad-10733 1683 7 : : PUNCT dad-10733 1683 8 a a DET dad-10733 1683 9 data data NOUN dad-10733 1683 10 - - PUNCT dad-10733 1683 11 driven drive VERB dad-10733 1683 12 methodology methodology NOUN dad-10733 1683 13 for for ADP dad-10733 1683 14 dialogue dialogue NOUN dad-10733 1683 15 management management NOUN dad-10733 1683 16 and and CCONJ dad-10733 1683 17 natural natural ADJ dad-10733 1683 18 language language NOUN dad-10733 1683 19 generation generation NOUN dad-10733 1683 20 . . PUNCT dad-10733 1684 1 springer springer NOUN dad-10733 1684 2 science science PROPN dad-10733 1684 3 & & CCONJ dad-10733 1684 4 business business NOUN dad-10733 1684 5 media medium NOUN dad-10733 1684 6 , , PUNCT dad-10733 1684 7 2011 2011 NUM dad-10733 1684 8 . . PUNCT dad-10733 1685 1 a. a. NOUN dad-10733 1685 2 ritter ritter PROPN dad-10733 1685 3 , , PUNCT dad-10733 1685 4 c. c. PROPN dad-10733 1685 5 cherry cherry PROPN dad-10733 1685 6 , , PUNCT dad-10733 1685 7 and and CCONJ dad-10733 1685 8 b. b. PROPN dad-10733 1685 9 dolan dolan PROPN dad-10733 1685 10 . . PUNCT dad-10733 1686 1 unsupervised unsupervised ADJ dad-10733 1686 2 modeling modeling NOUN dad-10733 1686 3 of of ADP dad-10733 1686 4 twitter twitter NOUN dad-10733 1686 5 conversations conversation NOUN dad-10733 1686 6 . . PUNCT dad-10733 1687 1 in in ADP dad-10733 1687 2 north north ADJ dad-10733 1687 3 american american ADJ dad-10733 1687 4 chapter chapter NOUN dad-10733 1687 5 of of ADP dad-10733 1687 6 the the DET dad-10733 1687 7 association association NOUN dad-10733 1687 8 for for ADP dad-10733 1687 9 computational computational ADJ dad-10733 1687 10 linguistics linguistic NOUN dad-10733 1687 11 ( ( PUNCT dad-10733 1687 12 naacl naacl PROPN dad-10733 1687 13 2010 2010 NUM dad-10733 1687 14 ) ) PUNCT dad-10733 1687 15 , , PUNCT dad-10733 1687 16 2010 2010 NUM dad-10733 1687 17 . . PUNCT dad-10733 1688 1 a. a. NOUN dad-10733 1688 2 ritter ritter PROPN dad-10733 1688 3 , , PUNCT dad-10733 1688 4 c. c. PROPN dad-10733 1688 5 cherry cherry PROPN dad-10733 1688 6 , , PUNCT dad-10733 1688 7 and and CCONJ dad-10733 1688 8 w. w. PROPN dad-10733 1688 9 b. b. PROPN dad-10733 1688 10 dolan dolan PROPN dad-10733 1688 11 . . PUNCT dad-10733 1689 1 data data NOUN dad-10733 1689 2 - - PUNCT dad-10733 1689 3 driven drive VERB dad-10733 1689 4 response response NOUN dad-10733 1689 5 generation generation NOUN dad-10733 1689 6 in in ADP dad-10733 1689 7 social social ADJ dad-10733 1689 8 media medium NOUN dad-10733 1689 9 . . PUNCT dad-10733 1690 1 in in ADP dad-10733 1690 2 conference conference NOUN dad-10733 1690 3 on on ADP dad-10733 1690 4 empirical empirical ADJ dad-10733 1690 5 methods method NOUN dad-10733 1690 6 in in ADP dad-10733 1690 7 natural natural ADJ dad-10733 1690 8 language language NOUN dad-10733 1690 9 processing processing NOUN dad-10733 1690 10 ( ( PUNCT dad-10733 1690 11 emnlp emnlp ADJ dad-10733 1690 12 ) ) PUNCT dad-10733 1690 13 , , PUNCT dad-10733 1690 14 2011 2011 NUM dad-10733 1690 15 . . PUNCT dad-10733 1691 1 s. s. PROPN dad-10733 1691 2 rosenthal rosenthal PROPN dad-10733 1691 3 and and CCONJ dad-10733 1691 4 k. k. PROPN dad-10733 1691 5 mckeown mckeown PROPN dad-10733 1691 6 . . PUNCT dad-10733 1692 1 i i PRON dad-10733 1692 2 could could AUX dad-10733 1692 3 nt not PART dad-10733 1692 4 agree agree VERB dad-10733 1692 5 more more ADJ dad-10733 1692 6 : : PUNCT dad-10733 1692 7 the the DET dad-10733 1692 8 role role NOUN dad-10733 1692 9 of of ADP dad-10733 1692 10 conversational conversational ADJ dad-10733 1692 11 structure structure NOUN dad-10733 1692 12 in in ADP dad-10733 1692 13 agreement agreement NOUN dad-10733 1692 14 and and CCONJ dad-10733 1692 15 disagreement disagreement ADJ dad-10733 1692 16 detection detection NOUN dad-10733 1692 17 in in ADP dad-10733 1692 18 online online ADJ dad-10733 1692 19 discussions discussion NOUN dad-10733 1692 20 . . PUNCT dad-10733 1693 1 in in ADP dad-10733 1693 2 special special ADJ dad-10733 1693 3 interest interest NOUN dad-10733 1693 4 group group NOUN dad-10733 1693 5 on on ADP dad-10733 1693 6 discourse discourse NOUN dad-10733 1693 7 and and CCONJ dad-10733 1693 8 dialogue dialogue NOUN dad-10733 1693 9 ( ( PUNCT dad-10733 1693 10 sigdial sigdial ADJ dad-10733 1693 11 ) ) PUNCT dad-10733 1693 12 , , PUNCT dad-10733 1693 13 2015 2015 NUM dad-10733 1693 14 . . PUNCT dad-10733 1694 1 s. s. PROPN dad-10733 1694 2 rosset rosset PROPN dad-10733 1694 3 and and CCONJ dad-10733 1694 4 s. s. PROPN dad-10733 1694 5 petel petel PROPN dad-10733 1694 6 . . PUNCT dad-10733 1695 1 the the DET dad-10733 1695 2 ritel ritel PROPN dad-10733 1695 3 corpus corpus PROPN dad-10733 1695 4 - - PUNCT dad-10733 1695 5 an an DET dad-10733 1695 6 annotated annotate VERB dad-10733 1695 7 human human NOUN dad-10733 1695 8 - - PUNCT dad-10733 1695 9 machine machine NOUN dad-10733 1695 10 open open ADJ dad-10733 1695 11 - - PUNCT dad-10733 1695 12 domain domain NOUN dad-10733 1695 13 question question NOUN dad-10733 1695 14 answering answer VERB dad-10733 1695 15 spoken spoken ADJ dad-10733 1695 16 dialog dialog NOUN dad-10733 1695 17 corpus corpus NOUN dad-10733 1695 18 . . PUNCT dad-10733 1696 1 in in ADP dad-10733 1696 2 the the DET dad-10733 1696 3 international international ADJ dad-10733 1696 4 conference conference NOUN dad-10733 1696 5 on on ADP dad-10733 1696 6 language language NOUN dad-10733 1696 7 resources resource NOUN dad-10733 1696 8 and and CCONJ dad-10733 1696 9 evaluation evaluation NOUN dad-10733 1696 10 ( ( PUNCT dad-10733 1696 11 lrec lrec PROPN dad-10733 1696 12 ) ) PUNCT dad-10733 1696 13 , , PUNCT dad-10733 1696 14 2006 2006 NUM dad-10733 1696 15 . . PUNCT dad-10733 1697 1 a. a. PROPN dad-10733 1697 2 roy roy PROPN dad-10733 1697 3 , , PUNCT dad-10733 1697 4 c. c. PROPN dad-10733 1697 5 guinaudeau guinaudeau PROPN dad-10733 1697 6 , , PUNCT dad-10733 1697 7 h. h. PROPN dad-10733 1697 8 bredin bredin PROPN dad-10733 1697 9 , , PUNCT dad-10733 1697 10 and and CCONJ dad-10733 1697 11 c. c. PROPN dad-10733 1697 12 barras barras PROPN dad-10733 1697 13 . . PUNCT dad-10733 1698 1 tvd tvd PROPN dad-10733 1698 2 : : PUNCT dad-10733 1698 3 a a DET dad-10733 1698 4 reproducible reproducible ADJ dad-10733 1698 5 and and CCONJ dad-10733 1698 6 multiply multiply ADV dad-10733 1698 7 aligned aligned ADJ dad-10733 1698 8 tv tv NOUN dad-10733 1698 9 series series NOUN dad-10733 1698 10 dataset dataset PROPN dad-10733 1698 11 . . PUNCT dad-10733 1699 1 in in ADP dad-10733 1699 2 the the DET dad-10733 1699 3 international international ADJ dad-10733 1699 4 conference conference NOUN dad-10733 1699 5 on on ADP dad-10733 1699 6 language language NOUN dad-10733 1699 7 resources resource NOUN dad-10733 1699 8 and and CCONJ dad-10733 1699 9 evaluation evaluation NOUN dad-10733 1699 10 ( ( PUNCT dad-10733 1699 11 lrec lrec PROPN dad-10733 1699 12 ) ) PUNCT dad-10733 1699 13 , , PUNCT dad-10733 1699 14 volume volume NOUN dad-10733 1699 15 2 2 NUM dad-10733 1699 16 , , PUNCT dad-10733 1699 17 2014 2014 NUM dad-10733 1699 18 . . PUNCT dad-10733 1700 1 j. j. PROPN dad-10733 1700 2 ruppenhofer ruppenhofer PROPN dad-10733 1700 3 , , PUNCT dad-10733 1700 4 m. m. NOUN dad-10733 1700 5 ellsworth ellsworth PROPN dad-10733 1700 6 , , PUNCT dad-10733 1700 7 m. m. PROPN dad-10733 1700 8 r.l r.l PROPN dad-10733 1700 9 . . PROPN dad-10733 1700 10 petruck petruck PROPN dad-10733 1700 11 , , PUNCT dad-10733 1700 12 c. c. PROPN dad-10733 1700 13 r. r. PROPN dad-10733 1700 14 johnson johnson PROPN dad-10733 1700 15 , , PUNCT dad-10733 1700 16 and and CCONJ dad-10733 1700 17 j. j. PROPN dad-10733 1700 18 scheffczyk scheffczyk PROPN dad-10733 1700 19 . . PUNCT dad-10733 1701 1 framenet framenet PROPN dad-10733 1701 2 ii ii PROPN dad-10733 1701 3 : : PUNCT dad-10733 1701 4 extended extend VERB dad-10733 1701 5 theory theory NOUN dad-10733 1701 6 and and CCONJ dad-10733 1701 7 practice practice NOUN dad-10733 1701 8 . . PUNCT dad-10733 1702 1 international international ADJ dad-10733 1702 2 computer computer PROPN dad-10733 1702 3 science science PROPN dad-10733 1702 4 institute institute PROPN dad-10733 1702 5 , , PUNCT dad-10733 1702 6 2006 2006 NUM dad-10733 1702 7 . . PUNCT dad-10733 1703 1 distributed distribute VERB dad-10733 1703 2 with with ADP dad-10733 1703 3 the the DET dad-10733 1703 4 framenet framenet NOUN dad-10733 1703 5 data data NOUN dad-10733 1703 6 . . PUNCT dad-10733 1704 1 j. j. PROPN dad-10733 1704 2 schatzmann schatzmann PROPN dad-10733 1704 3 and and CCONJ dad-10733 1704 4 s. s. PROPN dad-10733 1704 5 young young PROPN dad-10733 1704 6 . . PUNCT dad-10733 1705 1 the the DET dad-10733 1705 2 hidden hide VERB dad-10733 1705 3 agenda agenda NOUN dad-10733 1705 4 user user NOUN dad-10733 1705 5 simulation simulation PROPN dad-10733 1705 6 model model PROPN dad-10733 1705 7 . . PUNCT dad-10733 1706 1 ieee ieee NOUN dad-10733 1706 2 transactions transaction NOUN dad-10733 1706 3 on on ADP dad-10733 1706 4 audio audio NOUN dad-10733 1706 5 , , PUNCT dad-10733 1706 6 speech speech NOUN dad-10733 1706 7 , , PUNCT dad-10733 1706 8 and and CCONJ dad-10733 1706 9 language language NOUN dad-10733 1706 10 processing processing NOUN dad-10733 1706 11 , , PUNCT dad-10733 1706 12 17(4):733–747 17(4):733–747 PROPN dad-10733 1706 13 , , PUNCT dad-10733 1706 14 2009 2009 NUM dad-10733 1706 15 . . PUNCT dad-10733 1707 1 j. j. PROPN dad-10733 1707 2 schatzmann schatzmann PROPN dad-10733 1707 3 , , PUNCT dad-10733 1707 4 k. k. PROPN dad-10733 1707 5 georgila georgila PROPN dad-10733 1707 6 , , PUNCT dad-10733 1707 7 and and CCONJ dad-10733 1707 8 s. s. PROPN dad-10733 1707 9 young young PROPN dad-10733 1707 10 . . PUNCT dad-10733 1708 1 quantitative quantitative ADJ dad-10733 1708 2 evaluation evaluation NOUN dad-10733 1708 3 of of ADP dad-10733 1708 4 user user NOUN dad-10733 1708 5 simulation simulation NOUN dad-10733 1708 6 techniques technique NOUN dad-10733 1708 7 for for ADP dad-10733 1708 8 spoken spoken ADJ dad-10733 1708 9 dialogue dialogue NOUN dad-10733 1708 10 systems system NOUN dad-10733 1708 11 . . PUNCT dad-10733 1709 1 in in ADP dad-10733 1709 2 special special ADJ dad-10733 1709 3 interest interest NOUN dad-10733 1709 4 group group NOUN dad-10733 1709 5 on on ADP dad-10733 1709 6 discourse discourse NOUN dad-10733 1709 7 and and CCONJ dad-10733 1709 8 dialogue dialogue NOUN dad-10733 1709 9 ( ( PUNCT dad-10733 1709 10 sigdial sigdial ADJ dad-10733 1709 11 ) ) PUNCT dad-10733 1709 12 , , PUNCT dad-10733 1709 13 2005 2005 NUM dad-10733 1709 14 . . PUNCT dad-10733 1710 1 j. j. PROPN dad-10733 1710 2 schatzmann schatzmann PROPN dad-10733 1710 3 , , PUNCT dad-10733 1710 4 b. b. PROPN dad-10733 1710 5 thomson thomson PROPN dad-10733 1710 6 , , PUNCT dad-10733 1710 7 k. k. PROPN dad-10733 1710 8 weilhammer weilhammer PROPN dad-10733 1710 9 , , PUNCT dad-10733 1710 10 . . PUNCT dad-10733 1711 1 ye ye NOUN dad-10733 1711 2 , , PUNCT dad-10733 1711 3 and and CCONJ dad-10733 1711 4 s. s. PROPN dad-10733 1711 5 young young PROPN dad-10733 1711 6 . . PUNCT dad-10733 1712 1 agenda agenda NOUN dad-10733 1712 2 - - PUNCT dad-10733 1712 3 based base VERB dad-10733 1712 4 user user NOUN dad-10733 1712 5 simulation simulation NOUN dad-10733 1712 6 for for ADP dad-10733 1712 7 bootstrapping bootstrappe VERB dad-10733 1712 8 a a DET dad-10733 1712 9 pomdp pomdp NOUN dad-10733 1712 10 dialogue dialogue NOUN dad-10733 1712 11 system system NOUN dad-10733 1712 12 . . PUNCT dad-10733 1713 1 in in ADP dad-10733 1713 2 human human ADJ dad-10733 1713 3 language language NOUN dad-10733 1713 4 technologies technology NOUN dad-10733 1713 5 2007 2007 NUM dad-10733 1713 6 : : PUNCT dad-10733 1713 7 the the DET dad-10733 1713 8 conference conference NOUN dad-10733 1713 9 of of ADP dad-10733 1713 10 the the DET dad-10733 1713 11 north north ADJ dad-10733 1713 12 american american ADJ dad-10733 1713 13 chapter chapter NOUN dad-10733 1713 14 of of ADP dad-10733 1713 15 the the DET dad-10733 1713 16 association association NOUN dad-10733 1713 17 for for ADP dad-10733 1713 18 computational computational ADJ dad-10733 1713 19 linguistics linguistic NOUN dad-10733 1713 20 ; ; PUNCT dad-10733 1713 21 companion companion NOUN dad-10733 1713 22 volume volume NOUN dad-10733 1713 23 , , PUNCT dad-10733 1713 24 short short ADJ dad-10733 1713 25 papers paper NOUN dad-10733 1713 26 , , PUNCT dad-10733 1713 27 pages page NOUN dad-10733 1713 28 149–152 149–152 NUM dad-10733 1713 29 , , PUNCT dad-10733 1713 30 2007 2007 NUM dad-10733 1713 31 . . PUNCT dad-10733 1714 1 k. k. PROPN dad-10733 1714 2 scheffler scheffler PROPN dad-10733 1714 3 and and CCONJ dad-10733 1714 4 s. s. PROPN dad-10733 1714 5 young young PROPN dad-10733 1714 6 . . PUNCT dad-10733 1715 1 automatic automatic ADJ dad-10733 1715 2 learning learning NOUN dad-10733 1715 3 of of ADP dad-10733 1715 4 dialogue dialogue NOUN dad-10733 1715 5 strategy strategy NOUN dad-10733 1715 6 using use VERB dad-10733 1715 7 dialogue dialogue NOUN dad-10733 1715 8 simulation simulation NOUN dad-10733 1715 9 and and CCONJ dad-10733 1715 10 reinforcement reinforcement NOUN dad-10733 1715 11 learning learning NOUN dad-10733 1715 12 . . PUNCT dad-10733 1716 1 in in ADP dad-10733 1716 2 international international ADJ dad-10733 1716 3 conference conference NOUN dad-10733 1716 4 on on ADP dad-10733 1716 5 human human ADJ dad-10733 1716 6 language language NOUN dad-10733 1716 7 technology technology NOUN dad-10733 1716 8 research research NOUN dad-10733 1716 9 , , PUNCT dad-10733 1716 10 pages page NOUN dad-10733 1716 11 12–19 12–19 PROPN dad-10733 1716 12 . . PUNCT dad-10733 1717 1 morgan morgan PROPN dad-10733 1717 2 kaufmann kaufmann PROPN dad-10733 1717 3 publishers publishers PROPN dad-10733 1717 4 inc inc PROPN dad-10733 1717 5 . . PROPN dad-10733 1717 6 , , PUNCT dad-10733 1717 7 2002 2002 NUM dad-10733 1717 8 . . PUNCT dad-10733 1718 1 j. j. PROPN dad-10733 1718 2 n. n. PROPN dad-10733 1718 3 schrading schrading PROPN dad-10733 1718 4 . . PUNCT dad-10733 1719 1 analyzing analyze VERB dad-10733 1719 2 domestic domestic ADJ dad-10733 1719 3 abuse abuse NOUN dad-10733 1719 4 using use VERB dad-10733 1719 5 natural natural ADJ dad-10733 1719 6 language language NOUN dad-10733 1719 7 processing processing NOUN dad-10733 1719 8 on on ADP dad-10733 1719 9 social social ADJ dad-10733 1719 10 media medium NOUN dad-10733 1719 11 data datum NOUN dad-10733 1719 12 . . PUNCT dad-10733 1720 1 master master NOUN dad-10733 1720 2 ’s ’s PART dad-10733 1720 3 thesis thesis NOUN dad-10733 1720 4 , , PUNCT dad-10733 1720 5 rochester rochester PROPN dad-10733 1720 6 institute institute PROPN dad-10733 1720 7 of of ADP dad-10733 1720 8 technology technology PROPN dad-10733 1720 9 , , PUNCT dad-10733 1720 10 2015 2015 NUM dad-10733 1720 11 . . PUNCT dad-10733 1721 1 http://scholarworks.rit.edu/theses http://scholarworks.rit.edu/these NOUN dad-10733 1721 2 . . PUNCT dad-10733 1722 1 46 46 NUM dad-10733 1722 2 http://scholarworks.rit.edu/theses http://scholarworks.rit.edu/these NOUN dad-10733 1722 3 a a DET dad-10733 1722 4 survey survey NOUN dad-10733 1722 5 of of ADP dad-10733 1722 6 available available ADJ dad-10733 1722 7 corpora corpora PROPN dad-10733 1722 8 for for ADP dad-10733 1722 9 building build VERB dad-10733 1722 10 data data NOUN dad-10733 1722 11 - - PUNCT dad-10733 1722 12 driven drive VERB dad-10733 1722 13 dialogue dialogue NOUN dad-10733 1722 14 systems system NOUN dad-10733 1722 15 n. n. PROPN dad-10733 1722 16 schrading schrading NOUN dad-10733 1722 17 , , PUNCT dad-10733 1722 18 c. c. PROPN dad-10733 1722 19 o. o. PROPN dad-10733 1722 20 alm alm PROPN dad-10733 1722 21 , , PUNCT dad-10733 1722 22 r. r. PROPN dad-10733 1722 23 ptucha ptucha PROPN dad-10733 1722 24 , , PUNCT dad-10733 1722 25 and and CCONJ dad-10733 1722 26 c. c. PROPN dad-10733 1722 27 m. m. PROPN dad-10733 1722 28 homan homan PROPN dad-10733 1722 29 . . PUNCT dad-10733 1723 1 an an DET dad-10733 1723 2 analysis analysis NOUN dad-10733 1723 3 of of ADP dad-10733 1723 4 domestic domestic ADJ dad-10733 1723 5 a.se a.se ADJ dad-10733 1723 6 discourse discourse NOUN dad-10733 1723 7 on on ADP dad-10733 1723 8 reddit reddit NOUN dad-10733 1723 9 . . PUNCT dad-10733 1724 1 in in ADP dad-10733 1724 2 conference conference NOUN dad-10733 1724 3 on on ADP dad-10733 1724 4 empirical empirical ADJ dad-10733 1724 5 methods method NOUN dad-10733 1724 6 in in ADP dad-10733 1724 7 natural natural ADJ dad-10733 1724 8 language language NOUN dad-10733 1724 9 processing processing NOUN dad-10733 1724 10 ( ( PUNCT dad-10733 1724 11 emnlp emnlp ADJ dad-10733 1724 12 ) ) PUNCT dad-10733 1724 13 , , PUNCT dad-10733 1724 14 2015 2015 NUM dad-10733 1724 15 . . PUNCT dad-10733 1725 1 k. k. PROPN dad-10733 1725 2 k. k. PROPN dad-10733 1725 3 schuler schuler PROPN dad-10733 1725 4 . . PUNCT dad-10733 1726 1 verbnet verbnet NOUN dad-10733 1726 2 : : PUNCT dad-10733 1726 3 a a DET dad-10733 1726 4 broad broad ADJ dad-10733 1726 5 - - PUNCT dad-10733 1726 6 coverage coverage NOUN dad-10733 1726 7 , , PUNCT dad-10733 1726 8 comprehensive comprehensive ADJ dad-10733 1726 9 verb verb PROPN dad-10733 1726 10 lexicon lexicon PROPN dad-10733 1726 11 . . PUNCT dad-10733 1727 1 phd phd NOUN dad-10733 1727 2 thesis thesis PROPN dad-10733 1727 3 , , PUNCT dad-10733 1727 4 university university NOUN dad-10733 1727 5 of of ADP dad-10733 1727 6 pennsylvania pennsylvania PROPN dad-10733 1727 7 , , PUNCT dad-10733 1727 8 2005 2005 NUM dad-10733 1727 9 . . PUNCT dad-10733 1728 1 paper paper NOUN dad-10733 1728 2 aai3179808 aai3179808 NOUN dad-10733 1728 3 . . PUNCT dad-10733 1729 1 i. i. PROPN dad-10733 1729 2 v. v. PROPN dad-10733 1729 3 serban serban PROPN dad-10733 1729 4 and and CCONJ dad-10733 1729 5 j. j. PROPN dad-10733 1729 6 pineau pineau PROPN dad-10733 1729 7 . . PUNCT dad-10733 1730 1 text text NOUN dad-10733 1730 2 - - PUNCT dad-10733 1730 3 based base VERB dad-10733 1730 4 speaker speaker NOUN dad-10733 1730 5 identification identification NOUN dad-10733 1730 6 for for ADP dad-10733 1730 7 multi multi ADJ dad-10733 1730 8 - - ADJ dad-10733 1730 9 participant participant ADJ dad-10733 1730 10 open open ADJ dad-10733 1730 11 - - PUNCT dad-10733 1730 12 domain domain NOUN dad-10733 1730 13 dialogue dialogue NOUN dad-10733 1730 14 systems system NOUN dad-10733 1730 15 . . PUNCT dad-10733 1731 1 neural neural ADJ dad-10733 1731 2 information information NOUN dad-10733 1731 3 processing processing NOUN dad-10733 1731 4 systems system NOUN dad-10733 1731 5 workshop workshop NOUN dad-10733 1731 6 on on ADP dad-10733 1731 7 machine machine NOUN dad-10733 1731 8 learning learn VERB dad-10733 1731 9 for for ADP dad-10733 1731 10 spoken spoken ADJ dad-10733 1731 11 language language NOUN dad-10733 1731 12 understanding understanding NOUN dad-10733 1731 13 , , PUNCT dad-10733 1731 14 2015 2015 NUM dad-10733 1731 15 . . PUNCT dad-10733 1732 1 i. i. PROPN dad-10733 1732 2 v. v. PROPN dad-10733 1732 3 serban serban PROPN dad-10733 1732 4 , , PUNCT dad-10733 1732 5 r. r. PROPN dad-10733 1732 6 lowe lowe PROPN dad-10733 1732 7 , , PUNCT dad-10733 1732 8 l. l. PROPN dad-10733 1732 9 charlin charlin PROPN dad-10733 1732 10 , , PUNCT dad-10733 1732 11 and and CCONJ dad-10733 1732 12 j. j. PROPN dad-10733 1732 13 pineau pineau PROPN dad-10733 1732 14 . . PUNCT dad-10733 1733 1 generative generative ADJ dad-10733 1733 2 deep deep ADJ dad-10733 1733 3 neural neural ADJ dad-10733 1733 4 networks network NOUN dad-10733 1733 5 for for ADP dad-10733 1733 6 dialogue dialogue NOUN dad-10733 1733 7 : : PUNCT dad-10733 1733 8 a a DET dad-10733 1733 9 short short ADJ dad-10733 1733 10 review review NOUN dad-10733 1733 11 . . PUNCT dad-10733 1734 1 in in ADP dad-10733 1734 2 neural neural ADJ dad-10733 1734 3 information information NOUN dad-10733 1734 4 processing processing NOUN dad-10733 1734 5 systems system NOUN dad-10733 1734 6 ( ( PUNCT dad-10733 1734 7 nips nip NOUN dad-10733 1734 8 ) ) PUNCT dad-10733 1734 9 , , PUNCT dad-10733 1734 10 let let VERB dad-10733 1734 11 ’s ’s PRON dad-10733 1734 12 discuss discuss VERB dad-10733 1734 13 : : PUNCT dad-10733 1734 14 learning learn VERB dad-10733 1734 15 methods method NOUN dad-10733 1734 16 for for ADP dad-10733 1734 17 dialogue dialogue NOUN dad-10733 1734 18 workshop workshop NOUN dad-10733 1734 19 , , PUNCT dad-10733 1734 20 2016 2016 NUM dad-10733 1734 21 . . PUNCT dad-10733 1735 1 i. i. PROPN dad-10733 1735 2 v. v. PROPN dad-10733 1735 3 serban serban PROPN dad-10733 1735 4 , , PUNCT dad-10733 1735 5 a. a. PROPN dad-10733 1735 6 sordoni sordoni PROPN dad-10733 1735 7 , , PUNCT dad-10733 1735 8 y. y. PROPN dad-10733 1735 9 bengio bengio PROPN dad-10733 1735 10 , , PUNCT dad-10733 1735 11 a. a. NOUN dad-10733 1735 12 courville courville NOUN dad-10733 1735 13 , , PUNCT dad-10733 1735 14 and and CCONJ dad-10733 1735 15 j. j. PROPN dad-10733 1735 16 pineau pineau PROPN dad-10733 1735 17 . . PUNCT dad-10733 1736 1 building build VERB dad-10733 1736 2 end end NOUN dad-10733 1736 3 - - PUNCT dad-10733 1736 4 to to ADP dad-10733 1736 5 - - PUNCT dad-10733 1736 6 end end NOUN dad-10733 1736 7 dialogue dialogue NOUN dad-10733 1736 8 systems system NOUN dad-10733 1736 9 using use VERB dad-10733 1736 10 generative generative ADJ dad-10733 1736 11 hierarchical hierarchical ADJ dad-10733 1736 12 neural neural ADJ dad-10733 1736 13 networks network NOUN dad-10733 1736 14 . . PUNCT dad-10733 1737 1 in in ADP dad-10733 1737 2 aaai aaai PROPN dad-10733 1737 3 , , PUNCT dad-10733 1737 4 2016 2016 NUM dad-10733 1737 5 . . PUNCT dad-10733 1738 1 in in ADP dad-10733 1738 2 press press NOUN dad-10733 1738 3 . . PUNCT dad-10733 1739 1 i. i. PROPN dad-10733 1739 2 v. v. PROPN dad-10733 1739 3 serban serban PROPN dad-10733 1739 4 , , PUNCT dad-10733 1739 5 t. t. PROPN dad-10733 1739 6 klinger klinger PROPN dad-10733 1739 7 , , PUNCT dad-10733 1739 8 g. g. PROPN dad-10733 1739 9 tesauro tesauro PROPN dad-10733 1739 10 , , PUNCT dad-10733 1739 11 k. k. PROPN dad-10733 1739 12 talamadupula talamadupula PROPN dad-10733 1739 13 , , PUNCT dad-10733 1739 14 b. b. PROPN dad-10733 1739 15 zhou zhou PROPN dad-10733 1739 16 , , PUNCT dad-10733 1739 17 y. y. PROPN dad-10733 1739 18 bengio bengio PROPN dad-10733 1739 19 , , PUNCT dad-10733 1739 20 and and CCONJ dad-10733 1739 21 a. a. NOUN dad-10733 1739 22 courville courville NOUN dad-10733 1739 23 . . PUNCT dad-10733 1740 1 multiresolution multiresolution NOUN dad-10733 1740 2 recurrent recurrent ADJ dad-10733 1740 3 neural neural ADJ dad-10733 1740 4 networks network NOUN dad-10733 1740 5 : : PUNCT dad-10733 1740 6 an an DET dad-10733 1740 7 application application NOUN dad-10733 1740 8 to to ADP dad-10733 1740 9 dialogue dialogue NOUN dad-10733 1740 10 response response NOUN dad-10733 1740 11 generation generation NOUN dad-10733 1740 12 . . PUNCT dad-10733 1741 1 in in ADP dad-10733 1741 2 aaai aaai PROPN dad-10733 1741 3 conference conference PROPN dad-10733 1741 4 , , PUNCT dad-10733 1741 5 2017a 2017a NUM dad-10733 1741 6 . . PUNCT dad-10733 1742 1 i. i. PROPN dad-10733 1742 2 v. v. PROPN dad-10733 1742 3 serban serban PROPN dad-10733 1742 4 , , PUNCT dad-10733 1742 5 c. c. PROPN dad-10733 1742 6 sankar sankar PROPN dad-10733 1742 7 , , PUNCT dad-10733 1742 8 m. m. NOUN dad-10733 1742 9 germain germain PROPN dad-10733 1742 10 , , PUNCT dad-10733 1742 11 s. s. PROPN dad-10733 1742 12 zhang zhang PROPN dad-10733 1742 13 , , PUNCT dad-10733 1742 14 z. z. PROPN dad-10733 1742 15 lin lin PROPN dad-10733 1742 16 , , PUNCT dad-10733 1742 17 s. s. PROPN dad-10733 1742 18 subramanian subramanian PROPN dad-10733 1742 19 , , PUNCT dad-10733 1742 20 t. t. PROPN dad-10733 1742 21 kim kim PROPN dad-10733 1742 22 , , PUNCT dad-10733 1742 23 m. m. NOUN dad-10733 1742 24 pieper pieper PROPN dad-10733 1742 25 , , PUNCT dad-10733 1742 26 s. s. PROPN dad-10733 1742 27 chandar chandar PROPN dad-10733 1742 28 , , PUNCT dad-10733 1742 29 n. n. PROPN dad-10733 1742 30 r. r. PROPN dad-10733 1742 31 ke ke PROPN dad-10733 1742 32 , , PUNCT dad-10733 1742 33 et et PROPN dad-10733 1742 34 al al PROPN dad-10733 1742 35 . . PUNCT dad-10733 1743 1 a a DET dad-10733 1743 2 deep deep ADJ dad-10733 1743 3 reinforcement reinforcement NOUN dad-10733 1743 4 learning learn VERB dad-10733 1743 5 chatbot chatbot NOUN dad-10733 1743 6 . . PUNCT dad-10733 1744 1 arxiv arxiv PROPN dad-10733 1744 2 preprint preprint PROPN dad-10733 1744 3 arxiv:1709.02349 arxiv:1709.02349 PROPN dad-10733 1744 4 , , PUNCT dad-10733 1744 5 2017b 2017b NUM dad-10733 1744 6 . . PUNCT dad-10733 1745 1 i. i. PROPN dad-10733 1745 2 v v PROPN dad-10733 1745 3 serban serban PROPN dad-10733 1745 4 , , PUNCT dad-10733 1745 5 c. c. PROPN dad-10733 1745 6 sankar sankar PROPN dad-10733 1745 7 , , PUNCT dad-10733 1745 8 s. s. PROPN dad-10733 1745 9 zhang zhang PROPN dad-10733 1745 10 , , PUNCT dad-10733 1745 11 z. z. PROPN dad-10733 1745 12 lin lin PROPN dad-10733 1745 13 , , PUNCT dad-10733 1745 14 s. s. PROPN dad-10733 1745 15 subramanian subramanian PROPN dad-10733 1745 16 , , PUNCT dad-10733 1745 17 t. t. PROPN dad-10733 1745 18 kim kim PROPN dad-10733 1745 19 , , PUNCT dad-10733 1745 20 s. s. PROPN dad-10733 1745 21 chandar chandar PROPN dad-10733 1745 22 , , PUNCT dad-10733 1745 23 n. n. PROPN dad-10733 1745 24 r. r. PROPN dad-10733 1745 25 ke ke PROPN dad-10733 1745 26 , , PUNCT dad-10733 1745 27 et et PROPN dad-10733 1745 28 al al PROPN dad-10733 1745 29 . . PUNCT dad-10733 1746 1 the the DET dad-10733 1746 2 octopus octopus NOUN dad-10733 1746 3 approach approach NOUN dad-10733 1746 4 to to ADP dad-10733 1746 5 the the DET dad-10733 1746 6 alexa alexa NOUN dad-10733 1746 7 competition competition NOUN dad-10733 1746 8 : : PUNCT dad-10733 1746 9 a a DET dad-10733 1746 10 deep deep ADJ dad-10733 1746 11 ensemble ensemble ADJ dad-10733 1746 12 - - PUNCT dad-10733 1746 13 based base VERB dad-10733 1746 14 socialbot socialbot NOUN dad-10733 1746 15 . . PUNCT dad-10733 1747 1 in in ADP dad-10733 1747 2 alexa alexa PROPN dad-10733 1747 3 prize prize PROPN dad-10733 1747 4 proceedings proceeding NOUN dad-10733 1747 5 , , PUNCT dad-10733 1747 6 2017c 2017c NUM dad-10733 1747 7 . . PUNCT dad-10733 1747 8 i. i. PROPN dad-10733 1747 9 v. v. PROPN dad-10733 1747 10 serban serban PROPN dad-10733 1747 11 , , PUNCT dad-10733 1747 12 a. a. PROPN dad-10733 1747 13 sordoni sordoni PROPN dad-10733 1747 14 , , PUNCT dad-10733 1747 15 r. r. PROPN dad-10733 1747 16 lowe lowe PROPN dad-10733 1747 17 , , PUNCT dad-10733 1747 18 l. l. PROPN dad-10733 1747 19 charlin charlin PROPN dad-10733 1747 20 , , PUNCT dad-10733 1747 21 j. j. PROPN dad-10733 1747 22 pineau pineau PROPN dad-10733 1747 23 , , PUNCT dad-10733 1747 24 a. a. NOUN dad-10733 1747 25 courville courville NOUN dad-10733 1747 26 , , PUNCT dad-10733 1747 27 and and CCONJ dad-10733 1747 28 y. y. PROPN dad-10733 1747 29 bengio bengio PROPN dad-10733 1747 30 . . PUNCT dad-10733 1748 1 a a DET dad-10733 1748 2 hierarchical hierarchical ADJ dad-10733 1748 3 latent latent NOUN dad-10733 1748 4 variable variable ADJ dad-10733 1748 5 encoder encoder NOUN dad-10733 1748 6 - - PUNCT dad-10733 1748 7 decoder decoder NOUN dad-10733 1748 8 model model NOUN dad-10733 1748 9 for for ADP dad-10733 1748 10 generating generate VERB dad-10733 1748 11 dialogues dialogue NOUN dad-10733 1748 12 . . PUNCT dad-10733 1749 1 in in ADP dad-10733 1749 2 aaai aaai PROPN dad-10733 1749 3 conference conference NOUN dad-10733 1749 4 , , PUNCT dad-10733 1749 5 2017d 2017d NUM dad-10733 1749 6 . . PUNCT dad-10733 1750 1 s. s. PROPN dad-10733 1750 2 shaikh shaikh PROPN dad-10733 1750 3 , , PUNCT dad-10733 1750 4 t. t. PROPN dad-10733 1750 5 strzalkowski strzalkowski PROPN dad-10733 1750 6 , , PUNCT dad-10733 1750 7 g. g. PROPN dad-10733 1750 8 a. a. PROPN dad-10733 1750 9 broadwell broadwell PROPN dad-10733 1750 10 , , PUNCT dad-10733 1750 11 j. j. PROPN dad-10733 1750 12 stromer stromer PROPN dad-10733 1750 13 - - PUNCT dad-10733 1750 14 galley galley NOUN dad-10733 1750 15 , , PUNCT dad-10733 1750 16 s. s. PROPN dad-10733 1750 17 m. m. PROPN dad-10733 1750 18 taylor taylor PROPN dad-10733 1750 19 , , PUNCT dad-10733 1750 20 and and CCONJ dad-10733 1750 21 n. n. PROPN dad-10733 1750 22 webb webb PROPN dad-10733 1750 23 . . PUNCT dad-10733 1751 1 mpc mpc PROPN dad-10733 1751 2 : : PUNCT dad-10733 1751 3 a a DET dad-10733 1751 4 multi multi ADJ dad-10733 1751 5 - - ADJ dad-10733 1751 6 party party ADJ dad-10733 1751 7 chat chat NOUN dad-10733 1751 8 corpus corpus NOUN dad-10733 1751 9 for for ADP dad-10733 1751 10 modeling model VERB dad-10733 1751 11 social social ADJ dad-10733 1751 12 phenomena phenomenon NOUN dad-10733 1751 13 in in ADP dad-10733 1751 14 discourse discourse NOUN dad-10733 1751 15 . . PUNCT dad-10733 1752 1 in in ADP dad-10733 1752 2 the the DET dad-10733 1752 3 international international ADJ dad-10733 1752 4 conference conference NOUN dad-10733 1752 5 on on ADP dad-10733 1752 6 language language NOUN dad-10733 1752 7 resources resource NOUN dad-10733 1752 8 and and CCONJ dad-10733 1752 9 evaluation evaluation NOUN dad-10733 1752 10 ( ( PUNCT dad-10733 1752 11 lrec lrec PROPN dad-10733 1752 12 ) ) PUNCT dad-10733 1752 13 , , PUNCT dad-10733 1752 14 2010 2010 NUM dad-10733 1752 15 . . PUNCT dad-10733 1753 1 l. l. PROPN dad-10733 1753 2 shang shang PROPN dad-10733 1753 3 , , PUNCT dad-10733 1753 4 z. z. PROPN dad-10733 1753 5 lu lu PROPN dad-10733 1753 6 , , PUNCT dad-10733 1753 7 and and CCONJ dad-10733 1753 8 h. h. PROPN dad-10733 1753 9 li li PROPN dad-10733 1753 10 . . PROPN dad-10733 1753 11 neural neural ADJ dad-10733 1753 12 responding respond VERB dad-10733 1753 13 machine machine NOUN dad-10733 1753 14 for for ADP dad-10733 1753 15 short short ADJ dad-10733 1753 16 - - PUNCT dad-10733 1753 17 text text NOUN dad-10733 1753 18 conversation conversation NOUN dad-10733 1753 19 . . PUNCT dad-10733 1754 1 arxiv arxiv PROPN dad-10733 1754 2 preprint preprint PROPN dad-10733 1754 3 arxiv:1503.02364 arxiv:1503.02364 NOUN dad-10733 1754 4 , , PUNCT dad-10733 1754 5 2015 2015 NUM dad-10733 1754 6 . . PUNCT dad-10733 1755 1 c. c. PROPN dad-10733 1755 2 shaoul shaoul PROPN dad-10733 1755 3 and and CCONJ dad-10733 1755 4 c. c. PROPN dad-10733 1755 5 westbury westbury PROPN dad-10733 1755 6 . . PUNCT dad-10733 1756 1 a a DET dad-10733 1756 2 usenet usenet NOUN dad-10733 1756 3 corpus corpus NOUN dad-10733 1756 4 ( ( PUNCT dad-10733 1756 5 2005 2005 NUM dad-10733 1756 6 - - SYM dad-10733 1756 7 2009 2009 NUM dad-10733 1756 8 ) ) PUNCT dad-10733 1756 9 , , PUNCT dad-10733 1756 10 2009 2009 NUM dad-10733 1756 11 . . PUNCT dad-10733 1757 1 s. s. PROPN dad-10733 1757 2 sharma sharma PROPN dad-10733 1757 3 , , PUNCT dad-10733 1757 4 j. j. PROPN dad-10733 1757 5 he he PROPN dad-10733 1757 6 , , PUNCT dad-10733 1757 7 k. k. PROPN dad-10733 1757 8 suleman suleman PROPN dad-10733 1757 9 , , PUNCT dad-10733 1757 10 h. h. PROPN dad-10733 1757 11 schulz schulz PROPN dad-10733 1757 12 , , PUNCT dad-10733 1757 13 and and CCONJ dad-10733 1757 14 p. p. PROPN dad-10733 1757 15 bachman bachman PROPN dad-10733 1757 16 . . PUNCT dad-10733 1757 17 natural natural ADJ dad-10733 1757 18 language language NOUN dad-10733 1757 19 generation generation NOUN dad-10733 1757 20 in in ADP dad-10733 1757 21 dialogue dialogue NOUN dad-10733 1757 22 using use VERB dad-10733 1757 23 lexicalized lexicalize VERB dad-10733 1757 24 and and CCONJ dad-10733 1757 25 delexicalized delexicalize VERB dad-10733 1757 26 data datum NOUN dad-10733 1757 27 . . PUNCT dad-10733 1758 1 arxiv arxiv PROPN dad-10733 1758 2 preprint preprint NOUN dad-10733 1758 3 arxiv:1606.03632 arxiv:1606.03632 ADJ dad-10733 1758 4 , , PUNCT dad-10733 1758 5 2016 2016 NUM dad-10733 1758 6 . . PUNCT dad-10733 1759 1 b. b. PROPN dad-10733 1759 2 a. a. PROPN dad-10733 1759 3 shawar shawar PROPN dad-10733 1759 4 and and CCONJ dad-10733 1759 5 e. e. PROPN dad-10733 1759 6 atwell atwell PROPN dad-10733 1759 7 . . PUNCT dad-10733 1760 1 different different ADJ dad-10733 1760 2 measurements measurement NOUN dad-10733 1760 3 metrics metric NOUN dad-10733 1760 4 to to PART dad-10733 1760 5 evaluate evaluate VERB dad-10733 1760 6 a a DET dad-10733 1760 7 chatbot chatbot NOUN dad-10733 1760 8 system system NOUN dad-10733 1760 9 . . PUNCT dad-10733 1761 1 in in ADP dad-10733 1761 2 workshop workshop NOUN dad-10733 1761 3 on on ADP dad-10733 1761 4 bridging bridge VERB dad-10733 1761 5 the the DET dad-10733 1761 6 gap gap NOUN dad-10733 1761 7 : : PUNCT dad-10733 1761 8 academic academic ADJ dad-10733 1761 9 and and CCONJ dad-10733 1761 10 industrial industrial ADJ dad-10733 1761 11 research research NOUN dad-10733 1761 12 in in ADP dad-10733 1761 13 dialog dialog NOUN dad-10733 1761 14 technologies technology NOUN dad-10733 1761 15 , , PUNCT dad-10733 1761 16 pages page NOUN dad-10733 1761 17 89–96 89–96 NUM dad-10733 1761 18 , , PUNCT dad-10733 1761 19 2007a 2007a NUM dad-10733 1761 20 . . PUNCT dad-10733 1761 21 b. b. PROPN dad-10733 1761 22 a. a. PROPN dad-10733 1761 23 shawar shawar PROPN dad-10733 1761 24 and and CCONJ dad-10733 1761 25 eric eric PROPN dad-10733 1761 26 atwell atwell PROPN dad-10733 1761 27 . . PUNCT dad-10733 1762 1 chatbots chatbot NOUN dad-10733 1762 2 : : PUNCT dad-10733 1762 3 are be AUX dad-10733 1762 4 they they PRON dad-10733 1762 5 really really ADV dad-10733 1762 6 useful useful ADJ dad-10733 1762 7 ? ? PUNCT dad-10733 1763 1 in in ADP dad-10733 1763 2 ldv ldv PROPN dad-10733 1763 3 forum forum PROPN dad-10733 1763 4 , , PUNCT dad-10733 1763 5 volume volume NOUN dad-10733 1763 6 22 22 NUM dad-10733 1763 7 , , PUNCT dad-10733 1763 8 pages page NOUN dad-10733 1763 9 29–49 29–49 NUM dad-10733 1763 10 , , PUNCT dad-10733 1763 11 2007b 2007b NUM dad-10733 1763 12 . . PUNCT dad-10733 1764 1 e. e. PROPN dad-10733 1764 2 shriberg shriberg PROPN dad-10733 1764 3 , , PUNCT dad-10733 1764 4 r. r. PROPN dad-10733 1764 5 dhillon dhillon PROPN dad-10733 1764 6 , , PUNCT dad-10733 1764 7 s. s. PROPN dad-10733 1764 8 bhagat bhagat PROPN dad-10733 1764 9 , , PUNCT dad-10733 1764 10 j. j. PROPN dad-10733 1764 11 ang ang PROPN dad-10733 1764 12 , , PUNCT dad-10733 1764 13 and and CCONJ dad-10733 1764 14 h. h. PROPN dad-10733 1764 15 carvey carvey PROPN dad-10733 1764 16 . . PUNCT dad-10733 1765 1 the the DET dad-10733 1765 2 icsi icsi ADJ dad-10733 1765 3 meeting meeting NOUN dad-10733 1765 4 recorder recorder NOUN dad-10733 1765 5 dialog dialog PROPN dad-10733 1765 6 act act PROPN dad-10733 1765 7 ( ( PUNCT dad-10733 1765 8 mrda mrda NOUN dad-10733 1765 9 ) ) PUNCT dad-10733 1765 10 corpus corpus NOUN dad-10733 1765 11 . . PUNCT dad-10733 1766 1 technical technical ADJ dad-10733 1766 2 report report PROPN dad-10733 1766 3 , , PUNCT dad-10733 1766 4 dtic dtic ADJ dad-10733 1766 5 document document NOUN dad-10733 1766 6 , , PUNCT dad-10733 1766 7 2004 2004 NUM dad-10733 1766 8 . . PUNCT dad-10733 1767 1 a. a. PROPN dad-10733 1767 2 simpson simpson PROPN dad-10733 1767 3 and and CCONJ dad-10733 1767 4 n. n. PROPN dad-10733 1767 5 m m PROPN dad-10733 1767 6 eraser eraser NOUN dad-10733 1767 7 . . PUNCT dad-10733 1768 1 black black ADJ dad-10733 1768 2 box box PROPN dad-10733 1768 3 and and CCONJ dad-10733 1768 4 glass glass NOUN dad-10733 1768 5 box box NOUN dad-10733 1768 6 evaluation evaluation NOUN dad-10733 1768 7 of of ADP dad-10733 1768 8 the the DET dad-10733 1768 9 sundial sundial ADJ dad-10733 1768 10 system system NOUN dad-10733 1768 11 . . PUNCT dad-10733 1769 1 in in ADP dad-10733 1769 2 european european ADJ dad-10733 1769 3 conference conference NOUN dad-10733 1769 4 on on ADP dad-10733 1769 5 speech speech NOUN dad-10733 1769 6 communication communication NOUN dad-10733 1769 7 and and CCONJ dad-10733 1769 8 technology technology NOUN dad-10733 1769 9 , , PUNCT dad-10733 1769 10 1993 1993 NUM dad-10733 1769 11 . . PUNCT dad-10733 1770 1 s. s. PROPN dad-10733 1770 2 singh singh PROPN dad-10733 1770 3 , , PUNCT dad-10733 1770 4 d. d. PROPN dad-10733 1770 5 litman litman PROPN dad-10733 1770 6 , , PUNCT dad-10733 1770 7 m. m. NOUN dad-10733 1770 8 kearns kearn NOUN dad-10733 1770 9 , , PUNCT dad-10733 1770 10 and and CCONJ dad-10733 1770 11 m. m. PROPN dad-10733 1770 12 walker walker PROPN dad-10733 1770 13 . . PUNCT dad-10733 1771 1 optimizing optimize VERB dad-10733 1771 2 dialogue dialogue NOUN dad-10733 1771 3 management management NOUN dad-10733 1771 4 with with ADP dad-10733 1771 5 reinforcement reinforcement NOUN dad-10733 1771 6 learning learning NOUN dad-10733 1771 7 : : PUNCT dad-10733 1771 8 experiments experiment NOUN dad-10733 1771 9 with with ADP dad-10733 1771 10 the the DET dad-10733 1771 11 njfun njfun NOUN dad-10733 1771 12 system system NOUN dad-10733 1771 13 . . PUNCT dad-10733 1772 1 journal journal NOUN dad-10733 1772 2 of of ADP dad-10733 1772 3 artificial artificial ADJ dad-10733 1772 4 intelligence intelligence NOUN dad-10733 1772 5 research research NOUN dad-10733 1772 6 , , PUNCT dad-10733 1772 7 pages page NOUN dad-10733 1772 8 105–133 105–133 NUM dad-10733 1772 9 , , PUNCT dad-10733 1772 10 2002 2002 NUM dad-10733 1772 11 . . PUNCT dad-10733 1773 1 s. s. PROPN dad-10733 1773 2 p. p. PROPN dad-10733 1773 3 singh singh PROPN dad-10733 1773 4 , , PUNCT dad-10733 1773 5 m. m. PROPN dad-10733 1773 6 j. j. PROPN dad-10733 1773 7 kearns kearns PROPN dad-10733 1773 8 , , PUNCT dad-10733 1773 9 d. d. PROPN dad-10733 1773 10 j. j. PROPN dad-10733 1773 11 litman litman PROPN dad-10733 1773 12 , , PUNCT dad-10733 1773 13 and and CCONJ dad-10733 1773 14 m. m. PROPN dad-10733 1773 15 a. a. PROPN dad-10733 1773 16 walker walker PROPN dad-10733 1773 17 . . PUNCT dad-10733 1774 1 reinforcement reinforcement NOUN dad-10733 1774 2 learning learning NOUN dad-10733 1774 3 for for ADP dad-10733 1774 4 spoken spoken ADJ dad-10733 1774 5 dialogue dialogue NOUN dad-10733 1774 6 systems system NOUN dad-10733 1774 7 . . PUNCT dad-10733 1775 1 in in ADP dad-10733 1775 2 neural neural ADJ dad-10733 1775 3 information information NOUN dad-10733 1775 4 processing processing NOUN dad-10733 1775 5 systems system NOUN dad-10733 1775 6 , , PUNCT dad-10733 1775 7 1999 1999 NUM dad-10733 1775 8 . . PUNCT dad-10733 1776 1 a. a. PROPN dad-10733 1776 2 sordoni sordoni PROPN dad-10733 1776 3 , , PUNCT dad-10733 1776 4 m. m. NOUN dad-10733 1776 5 galley galley NOUN dad-10733 1776 6 , , PUNCT dad-10733 1776 7 m. m. NOUN dad-10733 1776 8 auli auli PROPN dad-10733 1776 9 , , PUNCT dad-10733 1776 10 c. c. PROPN dad-10733 1776 11 brockett brockett PROPN dad-10733 1776 12 , , PUNCT dad-10733 1776 13 y. y. PROPN dad-10733 1776 14 ji ji PROPN dad-10733 1776 15 , , PUNCT dad-10733 1776 16 m. m. PROPN dad-10733 1776 17 mitchell mitchell PROPN dad-10733 1776 18 , , PUNCT dad-10733 1776 19 j. j. PROPN dad-10733 1776 20 nie nie PROPN dad-10733 1776 21 , , PUNCT dad-10733 1776 22 j. j. PROPN dad-10733 1776 23 gao gao PROPN dad-10733 1776 24 , , PUNCT dad-10733 1776 25 and and CCONJ dad-10733 1776 26 b. b. PROPN dad-10733 1776 27 dolan dolan PROPN dad-10733 1776 28 . . PUNCT dad-10733 1777 1 a a DET dad-10733 1777 2 neural neural ADJ dad-10733 1777 3 network network NOUN dad-10733 1777 4 approach approach NOUN dad-10733 1777 5 to to ADP dad-10733 1777 6 context context NOUN dad-10733 1777 7 - - PUNCT dad-10733 1777 8 sensitive sensitive ADJ dad-10733 1777 9 generation generation NOUN dad-10733 1777 10 of of ADP dad-10733 1777 11 conversational conversational ADJ dad-10733 1777 12 responses response NOUN dad-10733 1777 13 . . PUNCT dad-10733 1778 1 in in ADP dad-10733 1778 2 conference conference NOUN dad-10733 1778 3 of of ADP dad-10733 1778 4 the the DET dad-10733 1778 5 north north ADJ dad-10733 1778 6 american american ADJ dad-10733 1778 7 chapter chapter NOUN dad-10733 1778 8 of of ADP dad-10733 1778 9 the the DET dad-10733 1778 10 association association NOUN dad-10733 1778 11 for for ADP dad-10733 1778 12 computational computational ADJ dad-10733 1778 13 linguistics linguistic NOUN dad-10733 1778 14 ( ( PUNCT dad-10733 1778 15 naacl naacl PROPN dad-10733 1778 16 - - PUNCT dad-10733 1778 17 hlt hlt PROPN dad-10733 1778 18 2015 2015 NUM dad-10733 1778 19 ) ) PUNCT dad-10733 1778 20 , , PUNCT dad-10733 1778 21 2015 2015 NUM dad-10733 1778 22 . . PUNCT dad-10733 1778 23 a. a. NOUN dad-10733 1778 24 stenström stenström PROPN dad-10733 1778 25 , , PUNCT dad-10733 1778 26 g. g. PROPN dad-10733 1778 27 andersen andersen PROPN dad-10733 1778 28 , , PUNCT dad-10733 1778 29 and and CCONJ dad-10733 1778 30 i. i. PROPN dad-10733 1778 31 k. k. PROPN dad-10733 1778 32 hasund hasund PROPN dad-10733 1778 33 . . PUNCT dad-10733 1779 1 trends trend NOUN dad-10733 1779 2 in in ADP dad-10733 1779 3 teenage teenage ADJ dad-10733 1779 4 talk talk NOUN dad-10733 1779 5 : : PUNCT dad-10733 1779 6 corpus corpus NOUN dad-10733 1779 7 compilation compilation NOUN dad-10733 1779 8 , , PUNCT dad-10733 1779 9 analysis analysis NOUN dad-10733 1779 10 and and CCONJ dad-10733 1779 11 findings finding NOUN dad-10733 1779 12 , , PUNCT dad-10733 1779 13 volume volume NOUN dad-10733 1779 14 8 8 NUM dad-10733 1779 15 . . PUNCT dad-10733 1780 1 j. j. PROPN dad-10733 1780 2 benjamins benjamins PROPN dad-10733 1780 3 , , PUNCT dad-10733 1780 4 2002 2002 NUM dad-10733 1780 5 . . PUNCT dad-10733 1781 1 a. a. NOUN dad-10733 1781 2 stent stent PROPN dad-10733 1781 3 , , PUNCT dad-10733 1781 4 r. r. PROPN dad-10733 1781 5 prasad prasad PROPN dad-10733 1781 6 , , PUNCT dad-10733 1781 7 and and CCONJ dad-10733 1781 8 m. m. PROPN dad-10733 1781 9 walker walker PROPN dad-10733 1781 10 . . PUNCT dad-10733 1782 1 trainable trainable ADJ dad-10733 1782 2 sentence sentence NOUN dad-10733 1782 3 planning planning NOUN dad-10733 1782 4 for for ADP dad-10733 1782 5 complex complex ADJ dad-10733 1782 6 information information NOUN dad-10733 1782 7 presentation presentation NOUN dad-10733 1782 8 in in ADP dad-10733 1782 9 spoken spoken ADJ dad-10733 1782 10 dialog dialog NOUN dad-10733 1782 11 systems system NOUN dad-10733 1782 12 . . PUNCT dad-10733 1783 1 in in ADP dad-10733 1783 2 association association NOUN dad-10733 1783 3 for for ADP dad-10733 1783 4 computational computational ADJ dad-10733 1783 5 linguistics linguistic NOUN dad-10733 1783 6 , , PUNCT dad-10733 1783 7 page page NOUN dad-10733 1783 8 79 79 NUM dad-10733 1783 9 . . PUNCT dad-10733 1784 1 acl acl PROPN dad-10733 1784 2 , , PUNCT dad-10733 1784 3 2004 2004 NUM dad-10733 1784 4 . . PUNCT dad-10733 1785 1 a. a. NOUN dad-10733 1785 2 stolcke stolcke PROPN dad-10733 1785 3 , , PUNCT dad-10733 1785 4 k. k. PROPN dad-10733 1785 5 ries ries PROPN dad-10733 1785 6 , , PUNCT dad-10733 1785 7 n. n. NOUN dad-10733 1785 8 coccaro coccaro NOUN dad-10733 1785 9 , , PUNCT dad-10733 1785 10 e. e. PROPN dad-10733 1785 11 shriberg shriberg PROPN dad-10733 1785 12 , , PUNCT dad-10733 1785 13 r. r. PROPN dad-10733 1785 14 bates bates PROPN dad-10733 1785 15 , , PUNCT dad-10733 1785 16 d. d. PROPN dad-10733 1785 17 jurafsky jurafsky PROPN dad-10733 1785 18 , , PUNCT dad-10733 1785 19 p. p. PROPN dad-10733 1785 20 taylor taylor PROPN dad-10733 1785 21 , , PUNCT dad-10733 1785 22 r. r. PROPN dad-10733 1785 23 martin martin PROPN dad-10733 1785 24 , , PUNCT dad-10733 1785 25 c. c. PROPN dad-10733 1785 26 van van PROPN dad-10733 1785 27 ess ess PROPN dad-10733 1785 28 - - PUNCT dad-10733 1785 29 dykema dykema ADJ dad-10733 1785 30 , , PUNCT dad-10733 1785 31 and and CCONJ dad-10733 1785 32 m. m. NOUN dad-10733 1785 33 meteer meteer NOUN dad-10733 1785 34 . . PUNCT dad-10733 1786 1 dialogue dialogue NOUN dad-10733 1786 2 act act VERB dad-10733 1786 3 modeling modeling NOUN dad-10733 1786 4 for for ADP dad-10733 1786 5 automatic automatic ADJ dad-10733 1786 6 tagging tagging NOUN dad-10733 1786 7 and and CCONJ dad-10733 1786 8 recognition recognition NOUN dad-10733 1786 9 of of ADP dad-10733 1786 10 conversational conversational ADJ dad-10733 1786 11 speech speech NOUN dad-10733 1786 12 . . PUNCT dad-10733 1787 1 computational computational ADJ dad-10733 1787 2 linguistics linguistic NOUN dad-10733 1787 3 , , PUNCT dad-10733 1787 4 26(3):339–373 26(3):339–373 PROPN dad-10733 1787 5 , , PUNCT dad-10733 1787 6 2000 2000 NUM dad-10733 1787 7 . . PUNCT dad-10733 1788 1 p.-h p.-h NOUN dad-10733 1788 2 . . PUNCT dad-10733 1789 1 su su PROPN dad-10733 1789 2 , , PUNCT dad-10733 1789 3 y.-b y.-b PROPN dad-10733 1789 4 . . PUNCT dad-10733 1790 1 wang wang PROPN dad-10733 1790 2 , , PUNCT dad-10733 1790 3 t.-h t.-h PROPN dad-10733 1790 4 . . PUNCT dad-10733 1791 1 yu yu PROPN dad-10733 1791 2 , , PUNCT dad-10733 1791 3 and and CCONJ dad-10733 1791 4 l.-s l.-s PROPN dad-10733 1791 5 . . PUNCT dad-10733 1792 1 lee lee PROPN dad-10733 1792 2 . . PUNCT dad-10733 1793 1 a a DET dad-10733 1793 2 dialogue dialogue NOUN dad-10733 1793 3 game game NOUN dad-10733 1793 4 framework framework NOUN dad-10733 1793 5 with with ADP dad-10733 1793 6 personalized personalized ADJ dad-10733 1793 7 training training NOUN dad-10733 1793 8 using use VERB dad-10733 1793 9 reinforcement reinforcement NOUN dad-10733 1793 10 learning learning NOUN dad-10733 1793 11 for for ADP dad-10733 1793 12 computer computer NOUN dad-10733 1793 13 - - PUNCT dad-10733 1793 14 assisted assist VERB dad-10733 1793 15 language language NOUN dad-10733 1793 16 learning learning NOUN dad-10733 1793 17 . . PUNCT dad-10733 1794 1 in in ADP dad-10733 1794 2 2013 2013 NUM dad-10733 1794 3 ieee ieee NOUN dad-10733 1794 4 international international ADJ dad-10733 1794 5 conference conference NOUN dad-10733 1794 6 on on ADP dad-10733 1794 7 acoustics acoustic NOUN dad-10733 1794 8 , , PUNCT dad-10733 1794 9 speech speech NOUN dad-10733 1794 10 and and CCONJ dad-10733 1794 11 signal signal NOUN dad-10733 1794 12 processing processing NOUN dad-10733 1794 13 , , PUNCT dad-10733 1794 14 pages page NOUN dad-10733 1794 15 8213–8217 8213–8217 NUM dad-10733 1794 16 . . PUNCT dad-10733 1795 1 ieee ieee NOUN dad-10733 1795 2 , , PUNCT dad-10733 1795 3 2013 2013 NUM dad-10733 1795 4 . . PUNCT dad-10733 1796 1 p.-h p.-h NOUN dad-10733 1796 2 . . PUNCT dad-10733 1797 1 su su PROPN dad-10733 1797 2 , , PUNCT dad-10733 1797 3 d. d. PROPN dad-10733 1797 4 vandyke vandyke PROPN dad-10733 1797 5 , , PUNCT dad-10733 1797 6 m. m. NOUN dad-10733 1797 7 gasic gasic PROPN dad-10733 1797 8 , , PUNCT dad-10733 1797 9 d. d. PROPN dad-10733 1797 10 kim kim PROPN dad-10733 1797 11 , , PUNCT dad-10733 1797 12 n. n. PROPN dad-10733 1797 13 mrksic mrksic NOUN dad-10733 1797 14 , , PUNCT dad-10733 1797 15 t.-h t.-h NOUN dad-10733 1797 16 . . PUNCT dad-10733 1798 1 wen wen PROPN dad-10733 1798 2 , , PUNCT dad-10733 1798 3 and and CCONJ dad-10733 1798 4 s. s. PROPN dad-10733 1798 5 young young PROPN dad-10733 1798 6 . . PUNCT dad-10733 1799 1 learning learn VERB dad-10733 1799 2 from from ADP dad-10733 1799 3 real real ADJ dad-10733 1799 4 users user NOUN dad-10733 1799 5 : : PUNCT dad-10733 1799 6 rating rating NOUN dad-10733 1799 7 dialogue dialogue NOUN dad-10733 1799 8 success success NOUN dad-10733 1799 9 with with ADP dad-10733 1799 10 neural neural ADJ dad-10733 1799 11 networks network NOUN dad-10733 1799 12 for for ADP dad-10733 1799 13 reinforcement reinforcement NOUN dad-10733 1799 14 learning learning NOUN dad-10733 1799 15 in in ADP dad-10733 1799 16 spoken spoken ADJ dad-10733 1799 17 dialogue dialogue NOUN dad-10733 1799 18 systems system NOUN dad-10733 1799 19 . . PUNCT dad-10733 1800 1 in in ADP dad-10733 1800 2 interspeech interspeech NOUN dad-10733 1800 3 , , PUNCT dad-10733 1800 4 2015 2015 NUM dad-10733 1800 5 . . PUNCT dad-10733 1801 1 p.-h p.-h NOUN dad-10733 1801 2 . . PUNCT dad-10733 1802 1 su su PROPN dad-10733 1802 2 , , PUNCT dad-10733 1802 3 m. m. NOUN dad-10733 1802 4 gasic gasic PROPN dad-10733 1802 5 , , PUNCT dad-10733 1802 6 n. n. PROPN dad-10733 1802 7 mrksic mrksic NOUN dad-10733 1802 8 , , PUNCT dad-10733 1802 9 l. l. PROPN dad-10733 1802 10 rojas rojas PROPN dad-10733 1802 11 - - PUNCT dad-10733 1802 12 barahona barahona PROPN dad-10733 1802 13 , , PUNCT dad-10733 1802 14 s. s. PROPN dad-10733 1802 15 ultes ultes PROPN dad-10733 1802 16 , , PUNCT dad-10733 1802 17 d. d. PROPN dad-10733 1802 18 vandyke vandyke PROPN dad-10733 1802 19 , , PUNCT dad-10733 1802 20 t.-h t.-h PROPN dad-10733 1802 21 . . PUNCT dad-10733 1803 1 wen wen PROPN dad-10733 1803 2 , , PUNCT dad-10733 1803 3 and and CCONJ dad-10733 1803 4 s. s. PROPN dad-10733 1803 5 young young PROPN dad-10733 1803 6 . . PUNCT dad-10733 1804 1 continuously continuously ADV dad-10733 1804 2 learning learn VERB dad-10733 1804 3 neural neural ADJ dad-10733 1804 4 dialogue dialogue NOUN dad-10733 1804 5 management management NOUN dad-10733 1804 6 . . PUNCT dad-10733 1805 1 arxiv arxiv PROPN dad-10733 1805 2 preprint preprint PROPN dad-10733 1805 3 arxiv:1606.02689 arxiv:1606.02689 PROPN dad-10733 1805 4 , , PUNCT dad-10733 1805 5 2016 2016 NUM dad-10733 1805 6 . . PUNCT dad-10733 1806 1 47 47 NUM dad-10733 1806 2 serban serban PROPN dad-10733 1806 3 , , PUNCT dad-10733 1806 4 lowe lowe PROPN dad-10733 1806 5 , , PUNCT dad-10733 1806 6 henderson henderson PROPN dad-10733 1806 7 , , PUNCT dad-10733 1806 8 charlin charlin PROPN dad-10733 1806 9 and and CCONJ dad-10733 1806 10 pineau pineau PROPN dad-10733 1806 11 x. x. PROPN dad-10733 1806 12 sun sun PROPN dad-10733 1806 13 , , PUNCT dad-10733 1806 14 j. j. PROPN dad-10733 1806 15 lichtenauer lichtenauer PROPN dad-10733 1806 16 , , PUNCT dad-10733 1806 17 m. m. NOUN dad-10733 1806 18 valstar valstar PROPN dad-10733 1806 19 , , PUNCT dad-10733 1806 20 a. a. NOUN dad-10733 1806 21 nijholt nijholt PROPN dad-10733 1806 22 , , PUNCT dad-10733 1806 23 and and CCONJ dad-10733 1806 24 m. m. NOUN dad-10733 1806 25 pantic pantic PROPN dad-10733 1806 26 . . PUNCT dad-10733 1807 1 a a DET dad-10733 1807 2 multimodal multimodal ADJ dad-10733 1807 3 database database NOUN dad-10733 1807 4 for for ADP dad-10733 1807 5 mimicry mimicry ADJ dad-10733 1807 6 analysis analysis NOUN dad-10733 1807 7 . . PUNCT dad-10733 1808 1 in in ADP dad-10733 1808 2 affective affective ADJ dad-10733 1808 3 computing computing NOUN dad-10733 1808 4 and and CCONJ dad-10733 1808 5 intelligent intelligent ADJ dad-10733 1808 6 interaction interaction NOUN dad-10733 1808 7 , , PUNCT dad-10733 1808 8 pages page NOUN dad-10733 1808 9 367–376 367–376 PROPN dad-10733 1808 10 . . PUNCT dad-10733 1808 11 springer springer NOUN dad-10733 1808 12 , , PUNCT dad-10733 1808 13 2011 2011 NUM dad-10733 1808 14 . . PUNCT dad-10733 1809 1 j. j. PROPN dad-10733 1809 2 svartvik svartvik PROPN dad-10733 1809 3 . . PUNCT dad-10733 1810 1 the the DET dad-10733 1810 2 london london PROPN dad-10733 1810 3 - - PUNCT dad-10733 1810 4 lund lund PROPN dad-10733 1810 5 corpus corpus PROPN dad-10733 1810 6 of of ADP dad-10733 1810 7 spoken spoken ADJ dad-10733 1810 8 english english PROPN dad-10733 1810 9 : : PUNCT dad-10733 1810 10 description description NOUN dad-10733 1810 11 and and CCONJ dad-10733 1810 12 research research NOUN dad-10733 1810 13 . . PUNCT dad-10733 1811 1 number number NOUN dad-10733 1811 2 82 82 NUM dad-10733 1811 3 in in ADP dad-10733 1811 4 1 1 NUM dad-10733 1811 5 . . PUNCT dad-10733 1811 6 lund lund PROPN dad-10733 1811 7 university university PROPN dad-10733 1811 8 press press NOUN dad-10733 1811 9 , , PUNCT dad-10733 1811 10 1990 1990 NUM dad-10733 1811 11 . . PUNCT dad-10733 1812 1 b. b. PROPN dad-10733 1812 2 thomson thomson PROPN dad-10733 1812 3 and and CCONJ dad-10733 1812 4 s. s. PROPN dad-10733 1812 5 young young PROPN dad-10733 1812 6 . . PUNCT dad-10733 1813 1 bayesian bayesian NOUN dad-10733 1813 2 update update NOUN dad-10733 1813 3 of of ADP dad-10733 1813 4 dialogue dialogue NOUN dad-10733 1813 5 state state NOUN dad-10733 1813 6 : : PUNCT dad-10733 1813 7 a a DET dad-10733 1813 8 pomdp pomdp NOUN dad-10733 1813 9 framework framework NOUN dad-10733 1813 10 for for ADP dad-10733 1813 11 spoken spoken ADJ dad-10733 1813 12 dialogue dialogue NOUN dad-10733 1813 13 systems system NOUN dad-10733 1813 14 . . PUNCT dad-10733 1814 1 computer computer NOUN dad-10733 1814 2 speech speech NOUN dad-10733 1814 3 & & CCONJ dad-10733 1814 4 language language NOUN dad-10733 1814 5 , , PUNCT dad-10733 1814 6 24(4):562–588 24(4):562–588 PROPN dad-10733 1814 7 , , PUNCT dad-10733 1814 8 2010 2010 NUM dad-10733 1814 9 . . PUNCT dad-10733 1815 1 j. j. PROPN dad-10733 1815 2 tiedemann tiedemann PROPN dad-10733 1815 3 . . PUNCT dad-10733 1816 1 parallel parallel ADJ dad-10733 1816 2 data datum NOUN dad-10733 1816 3 , , PUNCT dad-10733 1816 4 tools tool NOUN dad-10733 1816 5 and and CCONJ dad-10733 1816 6 interfaces interface NOUN dad-10733 1816 7 in in ADP dad-10733 1816 8 opus opus PROPN dad-10733 1816 9 . . PUNCT dad-10733 1817 1 in in ADP dad-10733 1817 2 the the DET dad-10733 1817 3 international international ADJ dad-10733 1817 4 conference conference NOUN dad-10733 1817 5 on on ADP dad-10733 1817 6 language language NOUN dad-10733 1817 7 resources resource NOUN dad-10733 1817 8 and and CCONJ dad-10733 1817 9 evaluation evaluation NOUN dad-10733 1817 10 ( ( PUNCT dad-10733 1817 11 lrec lrec PROPN dad-10733 1817 12 ) ) PUNCT dad-10733 1817 13 , , PUNCT dad-10733 1817 14 2012 2012 NUM dad-10733 1817 15 . . PUNCT dad-10733 1818 1 d. d. PROPN dad-10733 1818 2 traum traum PROPN dad-10733 1818 3 and and CCONJ dad-10733 1818 4 j. j. PROPN dad-10733 1818 5 rickel rickel PROPN dad-10733 1818 6 . . PUNCT dad-10733 1819 1 embodied embody VERB dad-10733 1819 2 agents agent NOUN dad-10733 1819 3 for for ADP dad-10733 1819 4 multi multi ADJ dad-10733 1819 5 - - ADJ dad-10733 1819 6 party party ADJ dad-10733 1819 7 dialogue dialogue NOUN dad-10733 1819 8 in in ADP dad-10733 1819 9 immersive immersive ADJ dad-10733 1819 10 virtual virtual ADJ dad-10733 1819 11 worlds world NOUN dad-10733 1819 12 . . PUNCT dad-10733 1820 1 in in ADP dad-10733 1820 2 international international ADJ dad-10733 1820 3 joint joint ADJ dad-10733 1820 4 conference conference NOUN dad-10733 1820 5 on on ADP dad-10733 1820 6 autonomous autonomous ADJ dad-10733 1820 7 agents agent NOUN dad-10733 1820 8 and and CCONJ dad-10733 1820 9 multiagent multiagent NOUN dad-10733 1820 10 systems system NOUN dad-10733 1820 11 : : PUNCT dad-10733 1820 12 part part NOUN dad-10733 1820 13 2 2 NUM dad-10733 1820 14 , , PUNCT dad-10733 1820 15 pages page NOUN dad-10733 1820 16 766–773 766–773 NUM dad-10733 1820 17 . . PUNCT dad-10733 1820 18 acm acm PROPN dad-10733 1820 19 , , PUNCT dad-10733 1820 20 2002 2002 NUM dad-10733 1820 21 . . PUNCT dad-10733 1821 1 g. g. PROPN dad-10733 1821 2 tur tur PROPN dad-10733 1821 3 and and CCONJ dad-10733 1821 4 l. l. PROPN dad-10733 1821 5 deng deng PROPN dad-10733 1821 6 . . PROPN dad-10733 1821 7 intent intent PROPN dad-10733 1821 8 determination determination NOUN dad-10733 1821 9 and and CCONJ dad-10733 1821 10 spoken speak VERB dad-10733 1821 11 utterance utterance NOUN dad-10733 1821 12 classification classification NOUN dad-10733 1821 13 , , PUNCT dad-10733 1821 14 chapter chapter NOUN dad-10733 1821 15 4 4 NUM dad-10733 1821 16 , , PUNCT dad-10733 1821 17 pages page NOUN dad-10733 1821 18 81–104 81–104 PROPN dad-10733 1821 19 . . PUNCT dad-10733 1822 1 wiley wiley PROPN dad-10733 1822 2 , , PUNCT dad-10733 1822 3 january january PROPN dad-10733 1822 4 2011 2011 NUM dad-10733 1822 5 . . PUNCT dad-10733 1823 1 a. a. NOUN dad-10733 1823 2 m. m. NOUN dad-10733 1823 3 turing ture VERB dad-10733 1823 4 . . PUNCT dad-10733 1824 1 computing compute VERB dad-10733 1824 2 machinery machinery NOUN dad-10733 1824 3 and and CCONJ dad-10733 1824 4 intelligence intelligence NOUN dad-10733 1824 5 . . PUNCT dad-10733 1825 1 mind mind NOUN dad-10733 1825 2 , , PUNCT dad-10733 1825 3 pages page NOUN dad-10733 1825 4 433–460 433–460 NUM dad-10733 1825 5 , , PUNCT dad-10733 1825 6 1950 1950 NUM dad-10733 1825 7 . . PUNCT dad-10733 1826 1 d. d. PROPN dad-10733 1826 2 c c PROPN dad-10733 1826 3 uthus uthus PROPN dad-10733 1826 4 and and CCONJ dad-10733 1826 5 d. d. PROPN dad-10733 1826 6 w w PROPN dad-10733 1826 7 aha aha INTJ dad-10733 1826 8 . . PUNCT dad-10733 1827 1 the the DET dad-10733 1827 2 ubuntu ubuntu ADJ dad-10733 1827 3 chat chat NOUN dad-10733 1827 4 corpus corpu NOUN dad-10733 1827 5 for for ADP dad-10733 1827 6 multiparticipant multiparticipant NOUN dad-10733 1827 7 chat chat NOUN dad-10733 1827 8 analysis analysis NOUN dad-10733 1827 9 . . PUNCT dad-10733 1828 1 in in ADP dad-10733 1828 2 aaai aaai PROPN dad-10733 1828 3 spring spring NOUN dad-10733 1828 4 symposium symposium NOUN dad-10733 1828 5 : : PUNCT dad-10733 1828 6 analyzing analyze VERB dad-10733 1828 7 microtext microtext NOUN dad-10733 1828 8 , , PUNCT dad-10733 1828 9 2013 2013 NUM dad-10733 1828 10 . . PUNCT dad-10733 1829 1 j. j. PROPN dad-10733 1829 2 vandeventer vandeventer PROPN dad-10733 1829 3 , , PUNCT dad-10733 1829 4 a. a. PROPN dad-10733 1829 5 j. j. PROPN dad-10733 1829 6 aubrey aubrey PROPN dad-10733 1829 7 , , PUNCT dad-10733 1829 8 p. p. PROPN dad-10733 1829 9 l. l. PROPN dad-10733 1829 10 rosin rosin PROPN dad-10733 1829 11 , , PUNCT dad-10733 1829 12 and and CCONJ dad-10733 1829 13 d. d. PROPN dad-10733 1829 14 marshall marshall PROPN dad-10733 1829 15 . . PROPN dad-10733 1830 1 4d 4d PROPN dad-10733 1830 2 cardiff cardiff ADJ dad-10733 1830 3 conversation conversation NOUN dad-10733 1830 4 database database NOUN dad-10733 1830 5 ( ( PUNCT dad-10733 1830 6 4d 4d NUM dad-10733 1830 7 ccdb ccdb NOUN dad-10733 1830 8 ): ): PUNCT dad-10733 1830 9 a a DET dad-10733 1830 10 4d 4d NUM dad-10733 1830 11 database database NOUN dad-10733 1830 12 of of ADP dad-10733 1830 13 natural natural ADJ dad-10733 1830 14 , , PUNCT dad-10733 1830 15 dyadic dyadic ADJ dad-10733 1830 16 conversations conversation NOUN dad-10733 1830 17 . . PUNCT dad-10733 1831 1 in in ADP dad-10733 1831 2 joint joint ADJ dad-10733 1831 3 conference conference NOUN dad-10733 1831 4 on on ADP dad-10733 1831 5 facial facial ADJ dad-10733 1831 6 analysis analysis NOUN dad-10733 1831 7 , , PUNCT dad-10733 1831 8 animation animation NOUN dad-10733 1831 9 and and CCONJ dad-10733 1831 10 auditory auditory ADJ dad-10733 1831 11 - - PUNCT dad-10733 1831 12 visual visual ADJ dad-10733 1831 13 speech speech NOUN dad-10733 1831 14 processing processing NOUN dad-10733 1831 15 ( ( PUNCT dad-10733 1831 16 faavsp faavsp NOUN dad-10733 1831 17 2015 2015 NUM dad-10733 1831 18 ) ) PUNCT dad-10733 1831 19 , , PUNCT dad-10733 1831 20 2015 2015 NUM dad-10733 1831 21 . . PUNCT dad-10733 1832 1 d. d. PROPN dad-10733 1832 2 vandyke vandyke PROPN dad-10733 1832 3 , , PUNCT dad-10733 1832 4 p.-h p.-h PROPN dad-10733 1832 5 . . PUNCT dad-10733 1833 1 su su PROPN dad-10733 1833 2 , , PUNCT dad-10733 1833 3 m. m. NOUN dad-10733 1833 4 gasic gasic PROPN dad-10733 1833 5 , , PUNCT dad-10733 1833 6 n. n. PROPN dad-10733 1833 7 mrksic mrksic NOUN dad-10733 1833 8 , , PUNCT dad-10733 1833 9 t.-h t.-h NOUN dad-10733 1833 10 . . PUNCT dad-10733 1834 1 wen wen PROPN dad-10733 1834 2 , , PUNCT dad-10733 1834 3 and and CCONJ dad-10733 1834 4 s. s. PROPN dad-10733 1834 5 young young PROPN dad-10733 1834 6 . . PUNCT dad-10733 1835 1 multi multi ADJ dad-10733 1835 2 - - ADJ dad-10733 1835 3 domain domain ADJ dad-10733 1835 4 dialogue dialogue NOUN dad-10733 1835 5 success success NOUN dad-10733 1835 6 classifiers classifier NOUN dad-10733 1835 7 for for ADP dad-10733 1835 8 policy policy NOUN dad-10733 1835 9 training training NOUN dad-10733 1835 10 . . PUNCT dad-10733 1836 1 in in ADP dad-10733 1836 2 automatic automatic ADJ dad-10733 1836 3 speech speech NOUN dad-10733 1836 4 recognition recognition NOUN dad-10733 1836 5 and and CCONJ dad-10733 1836 6 understanding understanding NOUN dad-10733 1836 7 ( ( PUNCT dad-10733 1836 8 asru asru PROPN dad-10733 1836 9 ) ) PUNCT dad-10733 1836 10 , , PUNCT dad-10733 1836 11 2015 2015 NUM dad-10733 1836 12 ieee ieee NOUN dad-10733 1836 13 workshop workshop NOUN dad-10733 1836 14 on on ADP dad-10733 1836 15 , , PUNCT dad-10733 1836 16 pages page NOUN dad-10733 1836 17 763 763 NUM dad-10733 1836 18 – – PUNCT dad-10733 1836 19 770 770 NUM dad-10733 1836 20 . . X dad-10733 1836 21 ieee ieee NOUN dad-10733 1836 22 , , PUNCT dad-10733 1836 23 2015 2015 NUM dad-10733 1836 24 . . PUNCT dad-10733 1837 1 o. o. NOUN dad-10733 1837 2 vinyals vinyal NOUN dad-10733 1837 3 and and CCONJ dad-10733 1837 4 q. q. PROPN dad-10733 1837 5 le le PROPN dad-10733 1837 6 . . PUNCT dad-10733 1838 1 a a DET dad-10733 1838 2 neural neural ADJ dad-10733 1838 3 conversational conversational ADJ dad-10733 1838 4 model model NOUN dad-10733 1838 5 . . PUNCT dad-10733 1839 1 arxiv arxiv PROPN dad-10733 1839 2 preprint preprint VERB dad-10733 1839 3 arxiv:1506.05869 arxiv:1506.05869 PROPN dad-10733 1839 4 , , PUNCT dad-10733 1839 5 2015 2015 NUM dad-10733 1839 6 . . PUNCT dad-10733 1840 1 m. m. NOUN dad-10733 1840 2 a. a. PROPN dad-10733 1840 3 walker walker PROPN dad-10733 1840 4 , , PUNCT dad-10733 1840 5 d. d. PROPN dad-10733 1840 6 j. j. PROPN dad-10733 1840 7 litman litman PROPN dad-10733 1840 8 , , PUNCT dad-10733 1840 9 c. c. PROPN dad-10733 1840 10 a. a. PROPN dad-10733 1840 11 kamm kamm PROPN dad-10733 1840 12 , , PUNCT dad-10733 1840 13 and and CCONJ dad-10733 1840 14 a. a. NOUN dad-10733 1840 15 abella abella PROPN dad-10733 1840 16 . . PUNCT dad-10733 1841 1 paradise paradise PROPN dad-10733 1841 2 : : PUNCT dad-10733 1841 3 a a DET dad-10733 1841 4 framework framework NOUN dad-10733 1841 5 for for ADP dad-10733 1841 6 evaluating evaluate VERB dad-10733 1841 7 spoken spoken ADJ dad-10733 1841 8 dialogue dialogue NOUN dad-10733 1841 9 agents agent NOUN dad-10733 1841 10 . . PUNCT dad-10733 1842 1 in in ADP dad-10733 1842 2 european european ADJ dad-10733 1842 3 chapter chapter NOUN dad-10733 1842 4 of of ADP dad-10733 1842 5 the the DET dad-10733 1842 6 association association NOUN dad-10733 1842 7 for for ADP dad-10733 1842 8 computational computational ADJ dad-10733 1842 9 linguistics linguistic NOUN dad-10733 1842 10 ( ( PUNCT dad-10733 1842 11 eacl eacl PROPN dad-10733 1842 12 ) ) PUNCT dad-10733 1842 13 , , PUNCT dad-10733 1842 14 pages page NOUN dad-10733 1842 15 271–280 271–280 NUM dad-10733 1842 16 , , PUNCT dad-10733 1842 17 1997 1997 NUM dad-10733 1842 18 . . PUNCT dad-10733 1843 1 m. m. NOUN dad-10733 1843 2 a. a. PROPN dad-10733 1843 3 walker walker PROPN dad-10733 1843 4 , , PUNCT dad-10733 1843 5 o. o. PROPN dad-10733 1843 6 c. c. PROPN dad-10733 1843 7 rambow rambow PROPN dad-10733 1843 8 , , PUNCT dad-10733 1843 9 and and CCONJ dad-10733 1843 10 m. m. NOUN dad-10733 1843 11 rogati rogati PROPN dad-10733 1843 12 . . PUNCT dad-10733 1844 1 training train VERB dad-10733 1844 2 a a DET dad-10733 1844 3 sentence sentence NOUN dad-10733 1844 4 planner planner NOUN dad-10733 1844 5 for for ADP dad-10733 1844 6 spoken spoken ADJ dad-10733 1844 7 dialogue dialogue NOUN dad-10733 1844 8 using use VERB dad-10733 1844 9 boosting boost VERB dad-10733 1844 10 . . PUNCT dad-10733 1845 1 computer computer NOUN dad-10733 1845 2 speech speech NOUN dad-10733 1845 3 & & CCONJ dad-10733 1845 4 language language NOUN dad-10733 1845 5 , , PUNCT dad-10733 1845 6 16(3):409–433 16(3):409–433 PROPN dad-10733 1845 7 , , PUNCT dad-10733 1845 8 2002 2002 NUM dad-10733 1845 9 . . PUNCT dad-10733 1846 1 m. m. NOUN dad-10733 1846 2 a. a. PROPN dad-10733 1846 3 walker walker PROPN dad-10733 1846 4 , , PUNCT dad-10733 1846 5 r. r. PROPN dad-10733 1846 6 grant grant PROPN dad-10733 1846 7 , , PUNCT dad-10733 1846 8 j. j. PROPN dad-10733 1846 9 sawyer sawyer PROPN dad-10733 1846 10 , , PUNCT dad-10733 1846 11 g. g. PROPN dad-10733 1846 12 i. i. PROPN dad-10733 1846 13 lin lin PROPN dad-10733 1846 14 , , PUNCT dad-10733 1846 15 n. n. NOUN dad-10733 1846 16 wardrip wardrip NOUN dad-10733 1846 17 - - PUNCT dad-10733 1846 18 fruin fruin NOUN dad-10733 1846 19 , , PUNCT dad-10733 1846 20 and and CCONJ dad-10733 1846 21 m. m. PROPN dad-10733 1846 22 buell buell PROPN dad-10733 1846 23 . . PUNCT dad-10733 1847 1 perceived perceive VERB dad-10733 1847 2 or or CCONJ dad-10733 1847 3 not not PART dad-10733 1847 4 perceived perceive VERB dad-10733 1847 5 : : PUNCT dad-10733 1847 6 film film NOUN dad-10733 1847 7 character character NOUN dad-10733 1847 8 models model NOUN dad-10733 1847 9 for for ADP dad-10733 1847 10 expressive expressive ADJ dad-10733 1847 11 nlg nlg NOUN dad-10733 1847 12 . . PUNCT dad-10733 1848 1 in in ADP dad-10733 1848 2 icids icid NOUN dad-10733 1848 3 , , PUNCT dad-10733 1848 4 pages page NOUN dad-10733 1848 5 109–121 109–121 NUM dad-10733 1848 6 , , PUNCT dad-10733 1848 7 2011 2011 NUM dad-10733 1848 8 . . PUNCT dad-10733 1849 1 m. m. NOUN dad-10733 1849 2 a a DET dad-10733 1849 3 walker walker NOUN dad-10733 1849 4 , , PUNCT dad-10733 1849 5 g. g. PROPN dad-10733 1849 6 i. i. PROPN dad-10733 1849 7 lin lin PROPN dad-10733 1849 8 , , PUNCT dad-10733 1849 9 and and CCONJ dad-10733 1849 10 j. j. PROPN dad-10733 1849 11 sawyer sawyer PROPN dad-10733 1849 12 . . PUNCT dad-10733 1850 1 an an DET dad-10733 1850 2 annotated annotate VERB dad-10733 1850 3 corpus corpus NOUN dad-10733 1850 4 of of ADP dad-10733 1850 5 film film NOUN dad-10733 1850 6 dialogue dialogue NOUN dad-10733 1850 7 for for ADP dad-10733 1850 8 learning learn VERB dad-10733 1850 9 and and CCONJ dad-10733 1850 10 characterizing characterize VERB dad-10733 1850 11 character character NOUN dad-10733 1850 12 style style NOUN dad-10733 1850 13 . . PUNCT dad-10733 1851 1 in in ADP dad-10733 1851 2 the the DET dad-10733 1851 3 international international ADJ dad-10733 1851 4 conference conference NOUN dad-10733 1851 5 on on ADP dad-10733 1851 6 language language NOUN dad-10733 1851 7 resources resource NOUN dad-10733 1851 8 and and CCONJ dad-10733 1851 9 evaluation evaluation NOUN dad-10733 1851 10 ( ( PUNCT dad-10733 1851 11 lrec lrec PROPN dad-10733 1851 12 ) ) PUNCT dad-10733 1851 13 , , PUNCT dad-10733 1851 14 pages page NOUN dad-10733 1851 15 1373–1378 1373–1378 NUM dad-10733 1851 16 , , PUNCT dad-10733 1851 17 2012a 2012a NUM dad-10733 1851 18 . . PUNCT dad-10733 1852 1 m. m. NOUN dad-10733 1852 2 a a DET dad-10733 1852 3 walker walker NOUN dad-10733 1852 4 , , PUNCT dad-10733 1852 5 j. j. PROPN dad-10733 1852 6 e. e. PROPN dad-10733 1852 7 f. f. PROPN dad-10733 1852 8 tree tree PROPN dad-10733 1852 9 , , PUNCT dad-10733 1852 10 p. p. PROPN dad-10733 1852 11 anand anand PROPN dad-10733 1852 12 , , PUNCT dad-10733 1852 13 r. r. PROPN dad-10733 1852 14 abbott abbott PROPN dad-10733 1852 15 , , PUNCT dad-10733 1852 16 and and CCONJ dad-10733 1852 17 j. j. PROPN dad-10733 1852 18 king king PROPN dad-10733 1852 19 . . PUNCT dad-10733 1853 1 a a DET dad-10733 1853 2 corpus corpus NOUN dad-10733 1853 3 for for ADP dad-10733 1853 4 research research NOUN dad-10733 1853 5 on on ADP dad-10733 1853 6 deliberation deliberation NOUN dad-10733 1853 7 and and CCONJ dad-10733 1853 8 debate debate NOUN dad-10733 1853 9 . . PUNCT dad-10733 1854 1 in in ADP dad-10733 1854 2 the the DET dad-10733 1854 3 international international ADJ dad-10733 1854 4 conference conference NOUN dad-10733 1854 5 on on ADP dad-10733 1854 6 language language NOUN dad-10733 1854 7 resources resource NOUN dad-10733 1854 8 and and CCONJ dad-10733 1854 9 evaluation evaluation NOUN dad-10733 1854 10 ( ( PUNCT dad-10733 1854 11 lrec lrec PROPN dad-10733 1854 12 ) ) PUNCT dad-10733 1854 13 , , PUNCT dad-10733 1854 14 pages page NOUN dad-10733 1854 15 812–817 812–817 NUM dad-10733 1854 16 , , PUNCT dad-10733 1854 17 2012b 2012b NUM dad-10733 1854 18 . . PUNCT dad-10733 1855 1 r. r. PROPN dad-10733 1855 2 s. s. PROPN dad-10733 1855 3 wallace wallace PROPN dad-10733 1855 4 . . PUNCT dad-10733 1856 1 the the DET dad-10733 1856 2 anatomy anatomy NOUN dad-10733 1856 3 of of ADP dad-10733 1856 4 alice alice PROPN dad-10733 1856 5 . . PUNCT dad-10733 1857 1 parsing parse VERB dad-10733 1857 2 the the DET dad-10733 1857 3 turing ture VERB dad-10733 1857 4 test test NOUN dad-10733 1857 5 , , PUNCT dad-10733 1857 6 pages page VERB dad-10733 1857 7 181–210 181–210 NUM dad-10733 1857 8 , , PUNCT dad-10733 1857 9 2009 2009 NUM dad-10733 1857 10 . . PUNCT dad-10733 1858 1 ye ye PROPN dad-10733 1858 2 - - PUNCT dad-10733 1858 3 yi yi PROPN dad-10733 1858 4 wang wang PROPN dad-10733 1858 5 , , PUNCT dad-10733 1858 6 li li PROPN dad-10733 1858 7 deng deng PROPN dad-10733 1858 8 , , PUNCT dad-10733 1858 9 and and CCONJ dad-10733 1858 10 alex alex PROPN dad-10733 1858 11 acero acero PROPN dad-10733 1858 12 . . PUNCT dad-10733 1859 1 spoken speak VERB dad-10733 1859 2 language language NOUN dad-10733 1859 3 understanding understanding NOUN dad-10733 1859 4 . . PUNCT dad-10733 1860 1 ieee ieee NOUN dad-10733 1860 2 signal signal NOUN dad-10733 1860 3 processing processing NOUN dad-10733 1860 4 magazine magazine NOUN dad-10733 1860 5 , , PUNCT dad-10733 1860 6 22(5 22(5 NOUN dad-10733 1860 7 ): ): PUNCT dad-10733 1860 8 16–31 16–31 NUM dad-10733 1860 9 , , PUNCT dad-10733 1860 10 2005 2005 NUM dad-10733 1860 11 . . PUNCT dad-10733 1861 1 z. z. PROPN dad-10733 1861 2 wang wang PROPN dad-10733 1861 3 and and CCONJ dad-10733 1861 4 o. o. PROPN dad-10733 1861 5 lemon lemon PROPN dad-10733 1861 6 . . PUNCT dad-10733 1862 1 a a DET dad-10733 1862 2 simple simple ADJ dad-10733 1862 3 and and CCONJ dad-10733 1862 4 generic generic ADJ dad-10733 1862 5 belief belief NOUN dad-10733 1862 6 tracking tracking NOUN dad-10733 1862 7 mechanism mechanism NOUN dad-10733 1862 8 for for ADP dad-10733 1862 9 the the DET dad-10733 1862 10 dialog dialog NOUN dad-10733 1862 11 state state NOUN dad-10733 1862 12 tracking tracking NOUN dad-10733 1862 13 challenge challenge NOUN dad-10733 1862 14 : : PUNCT dad-10733 1862 15 on on ADP dad-10733 1862 16 the the DET dad-10733 1862 17 believability believability NOUN dad-10733 1862 18 of of ADP dad-10733 1862 19 observed observed ADJ dad-10733 1862 20 information information NOUN dad-10733 1862 21 . . PUNCT dad-10733 1863 1 in in ADP dad-10733 1863 2 special special ADJ dad-10733 1863 3 interest interest NOUN dad-10733 1863 4 group group NOUN dad-10733 1863 5 on on ADP dad-10733 1863 6 discourse discourse NOUN dad-10733 1863 7 and and CCONJ dad-10733 1863 8 dialogue dialogue NOUN dad-10733 1863 9 ( ( PUNCT dad-10733 1863 10 sigdial sigdial ADJ dad-10733 1863 11 ) ) PUNCT dad-10733 1863 12 , , PUNCT dad-10733 1863 13 2013 2013 NUM dad-10733 1863 14 . . PUNCT dad-10733 1864 1 s. s. PROPN dad-10733 1864 2 webb webb PROPN dad-10733 1864 3 . . PUNCT dad-10733 1865 1 a a DET dad-10733 1865 2 corpus corpus NOUN dad-10733 1865 3 driven drive VERB dad-10733 1865 4 study study NOUN dad-10733 1865 5 of of ADP dad-10733 1865 6 the the DET dad-10733 1865 7 potential potential NOUN dad-10733 1865 8 for for ADP dad-10733 1865 9 vocabulary vocabulary ADJ dad-10733 1865 10 learning learn VERB dad-10733 1865 11 through through ADP dad-10733 1865 12 watching watch VERB dad-10733 1865 13 movies movie NOUN dad-10733 1865 14 . . PUNCT dad-10733 1866 1 international international ADJ dad-10733 1866 2 journal journal PROPN dad-10733 1866 3 of of ADP dad-10733 1866 4 corpus corpus PROPN dad-10733 1866 5 linguistics linguistic NOUN dad-10733 1866 6 , , PUNCT dad-10733 1866 7 15(4):497–519 15(4):497–519 NUM dad-10733 1866 8 , , PUNCT dad-10733 1866 9 2010 2010 NUM dad-10733 1866 10 . . PUNCT dad-10733 1867 1 j. j. PROPN dad-10733 1867 2 weizenbaum weizenbaum PROPN dad-10733 1867 3 . . PUNCT dad-10733 1867 4 elizaa elizaa PROPN dad-10733 1867 5 computer computer NOUN dad-10733 1867 6 program program NOUN dad-10733 1867 7 for for ADP dad-10733 1867 8 the the DET dad-10733 1867 9 study study NOUN dad-10733 1867 10 of of ADP dad-10733 1867 11 natural natural ADJ dad-10733 1867 12 language language NOUN dad-10733 1867 13 communication communication NOUN dad-10733 1867 14 between between ADP dad-10733 1867 15 man man NOUN dad-10733 1867 16 and and CCONJ dad-10733 1867 17 machine machine NOUN dad-10733 1867 18 . . PUNCT dad-10733 1868 1 communications communication NOUN dad-10733 1868 2 of of ADP dad-10733 1868 3 the the DET dad-10733 1868 4 acm acm PROPN dad-10733 1868 5 , , PUNCT dad-10733 1868 6 9(1):36–45 9(1):36–45 NUM dad-10733 1868 7 , , PUNCT dad-10733 1868 8 1966 1966 NUM dad-10733 1868 9 . . PUNCT dad-10733 1869 1 t. t. PROPN dad-10733 1869 2 wen wen PROPN dad-10733 1869 3 , , PUNCT dad-10733 1869 4 m. m. NOUN dad-10733 1869 5 gašic gašic PROPN dad-10733 1869 6 , , PUNCT dad-10733 1869 7 d. d. PROPN dad-10733 1869 8 kim kim PROPN dad-10733 1869 9 , , PUNCT dad-10733 1869 10 n. n. PROPN dad-10733 1869 11 mrkšic mrkšic PROPN dad-10733 1869 12 , , PUNCT dad-10733 1869 13 p. p. PROPN dad-10733 1869 14 su su PROPN dad-10733 1869 15 , , PUNCT dad-10733 1869 16 d. d. PROPN dad-10733 1869 17 vandyke vandyke PROPN dad-10733 1869 18 , , PUNCT dad-10733 1869 19 and and CCONJ dad-10733 1869 20 s. s. PROPN dad-10733 1869 21 young young PROPN dad-10733 1869 22 . . PUNCT dad-10733 1870 1 stochastic stochastic ADJ dad-10733 1870 2 language language NOUN dad-10733 1870 3 generation generation NOUN dad-10733 1870 4 in in ADP dad-10733 1870 5 dialogue dialogue NOUN dad-10733 1870 6 using use VERB dad-10733 1870 7 recurrent recurrent ADJ dad-10733 1870 8 neural neural ADJ dad-10733 1870 9 networks network NOUN dad-10733 1870 10 with with ADP dad-10733 1870 11 convolutional convolutional ADJ dad-10733 1870 12 sentence sentence NOUN dad-10733 1870 13 reranking reranking NOUN dad-10733 1870 14 . . PUNCT dad-10733 1871 1 special special ADJ dad-10733 1871 2 interest interest NOUN dad-10733 1871 3 group group NOUN dad-10733 1871 4 on on ADP dad-10733 1871 5 discourse discourse NOUN dad-10733 1871 6 and and CCONJ dad-10733 1871 7 dialogue dialogue NOUN dad-10733 1871 8 ( ( PUNCT dad-10733 1871 9 sigdial sigdial ADJ dad-10733 1871 10 ) ) PUNCT dad-10733 1871 11 , , PUNCT dad-10733 1871 12 2015a 2015a NUM dad-10733 1871 13 . . PUNCT dad-10733 1872 1 t.-h t.-h NOUN dad-10733 1872 2 . . PUNCT dad-10733 1873 1 wen wen PROPN dad-10733 1873 2 , , PUNCT dad-10733 1873 3 m. m. NOUN dad-10733 1873 4 gasic gasic PROPN dad-10733 1873 5 , , PUNCT dad-10733 1873 6 n. n. PROPN dad-10733 1873 7 mrksic mrksic NOUN dad-10733 1873 8 , , PUNCT dad-10733 1873 9 p.-h p.-h PROPN dad-10733 1873 10 . . PUNCT dad-10733 1874 1 su su PROPN dad-10733 1874 2 , , PUNCT dad-10733 1874 3 d. d. PROPN dad-10733 1874 4 vandyke vandyke PROPN dad-10733 1874 5 , , PUNCT dad-10733 1874 6 and and CCONJ dad-10733 1874 7 s. s. PROPN dad-10733 1874 8 young young PROPN dad-10733 1874 9 . . PUNCT dad-10733 1874 10 semantically semantically ADV dad-10733 1874 11 conditioned condition VERB dad-10733 1874 12 lstm lstm NOUN dad-10733 1874 13 - - PUNCT dad-10733 1874 14 based base VERB dad-10733 1874 15 natural natural ADJ dad-10733 1874 16 language language NOUN dad-10733 1874 17 generation generation NOUN dad-10733 1874 18 for for ADP dad-10733 1874 19 spoken spoken ADJ dad-10733 1874 20 dialogue dialogue NOUN dad-10733 1874 21 systems system NOUN dad-10733 1874 22 . . PUNCT dad-10733 1875 1 in in ADP dad-10733 1875 2 conference conference NOUN dad-10733 1875 3 on on ADP dad-10733 1875 4 empirical empirical ADJ dad-10733 1875 5 methods method NOUN dad-10733 1875 6 in in ADP dad-10733 1875 7 natural natural ADJ dad-10733 1875 8 language language NOUN dad-10733 1875 9 processing processing NOUN dad-10733 1875 10 ( ( PUNCT dad-10733 1875 11 emnlp emnlp ADJ dad-10733 1875 12 ) ) PUNCT dad-10733 1875 13 , , PUNCT dad-10733 1875 14 2015b 2015b NUM dad-10733 1875 15 . . PUNCT dad-10733 1876 1 t.-h t.-h NOUN dad-10733 1876 2 . . PUNCT dad-10733 1877 1 wen wen PROPN dad-10733 1877 2 , , PUNCT dad-10733 1877 3 m. m. NOUN dad-10733 1877 4 gasic gasic PROPN dad-10733 1877 5 , , PUNCT dad-10733 1877 6 n. n. PROPN dad-10733 1877 7 mrksic mrksic NOUN dad-10733 1877 8 , , PUNCT dad-10733 1877 9 l. l. PROPN dad-10733 1877 10 m. m. PROPN dad-10733 1877 11 rojas rojas PROPN dad-10733 1877 12 - - PUNCT dad-10733 1877 13 barahona barahona PROPN dad-10733 1877 14 , , PUNCT dad-10733 1877 15 p.-h p.-h NOUN dad-10733 1877 16 . . PUNCT dad-10733 1878 1 su su PROPN dad-10733 1878 2 , , PUNCT dad-10733 1878 3 d. d. PROPN dad-10733 1878 4 vandyke vandyke PROPN dad-10733 1878 5 , , PUNCT dad-10733 1878 6 and and CCONJ dad-10733 1878 7 s. s. PROPN dad-10733 1878 8 young young PROPN dad-10733 1878 9 . . PUNCT dad-10733 1879 1 multi multi ADJ dad-10733 1879 2 - - ADJ dad-10733 1879 3 domain domain ADJ dad-10733 1879 4 neural neural ADJ dad-10733 1879 5 network network NOUN dad-10733 1879 6 language language NOUN dad-10733 1879 7 generation generation NOUN dad-10733 1879 8 for for ADP dad-10733 1879 9 spoken spoken ADJ dad-10733 1879 10 dialogue dialogue NOUN dad-10733 1879 11 systems system NOUN dad-10733 1879 12 . . PUNCT dad-10733 1880 1 in in ADP dad-10733 1880 2 conference conference NOUN dad-10733 1880 3 of of ADP dad-10733 1880 4 the the DET dad-10733 1880 5 north north ADJ dad-10733 1880 6 american american ADJ dad-10733 1880 7 chapter chapter NOUN dad-10733 1880 8 of of ADP dad-10733 1880 9 the the DET dad-10733 1880 10 association association NOUN dad-10733 1880 11 for for ADP dad-10733 1880 12 computational computational ADJ dad-10733 1880 13 linguistics linguistic NOUN dad-10733 1880 14 ( ( PUNCT dad-10733 1880 15 naacl naacl PROPN dad-10733 1880 16 - - PUNCT dad-10733 1880 17 hlt hlt PROPN dad-10733 1880 18 2016 2016 NUM dad-10733 1880 19 ) ) PUNCT dad-10733 1880 20 , , PUNCT dad-10733 1880 21 2016 2016 NUM dad-10733 1880 22 . . PUNCT dad-10733 1881 1 t.-h t.-h NOUN dad-10733 1881 2 . . PUNCT dad-10733 1882 1 wen wen PROPN dad-10733 1882 2 , , PUNCT dad-10733 1882 3 m. m. NOUN dad-10733 1882 4 gasic gasic PROPN dad-10733 1882 5 , , PUNCT dad-10733 1882 6 n. n. PROPN dad-10733 1882 7 mrksic mrksic NOUN dad-10733 1882 8 , , PUNCT dad-10733 1882 9 l. l. PROPN dad-10733 1882 10 m. m. PROPN dad-10733 1882 11 rojas rojas PROPN dad-10733 1882 12 - - PUNCT dad-10733 1882 13 barahona barahona PROPN dad-10733 1882 14 , , PUNCT dad-10733 1882 15 p.-h p.-h NOUN dad-10733 1882 16 . . PUNCT dad-10733 1883 1 su su PROPN dad-10733 1883 2 , , PUNCT dad-10733 1883 3 s. s. PROPN dad-10733 1883 4 ultes ultes PROPN dad-10733 1883 5 , , PUNCT dad-10733 1883 6 d. d. PROPN dad-10733 1883 7 vandyke vandyke PROPN dad-10733 1883 8 , , PUNCT dad-10733 1883 9 and and CCONJ dad-10733 1883 10 s. s. PROPN dad-10733 1883 11 young young PROPN dad-10733 1883 12 . . PUNCT dad-10733 1884 1 a a DET dad-10733 1884 2 networkbased networkbased ADJ dad-10733 1884 3 end end NOUN dad-10733 1884 4 - - PUNCT dad-10733 1884 5 to to ADP dad-10733 1884 6 - - PUNCT dad-10733 1884 7 end end NOUN dad-10733 1884 8 trainable trainable ADJ dad-10733 1884 9 task task NOUN dad-10733 1884 10 - - PUNCT dad-10733 1884 11 oriented orient VERB dad-10733 1884 12 dialogue dialogue NOUN dad-10733 1884 13 system system NOUN dad-10733 1884 14 . . PUNCT dad-10733 1885 1 in in ADP dad-10733 1885 2 european european ADJ dad-10733 1885 3 chapter chapter NOUN dad-10733 1885 4 of of ADP dad-10733 1885 5 the the DET dad-10733 1885 6 association association NOUN dad-10733 1885 7 for for ADP dad-10733 1885 8 computational computational ADJ dad-10733 1885 9 linguistics linguistic NOUN dad-10733 1885 10 ( ( PUNCT dad-10733 1885 11 eacl eacl PROPN dad-10733 1885 12 ) ) PUNCT dad-10733 1885 13 , , PUNCT dad-10733 1885 14 2017 2017 NUM dad-10733 1885 15 . . PUNCT dad-10733 1886 1 j. j. PROPN dad-10733 1886 2 weston weston PROPN dad-10733 1886 3 . . PUNCT dad-10733 1887 1 dialog dialog NOUN dad-10733 1887 2 - - PUNCT dad-10733 1887 3 based base VERB dad-10733 1887 4 language language NOUN dad-10733 1887 5 learning learning NOUN dad-10733 1887 6 . . PUNCT dad-10733 1888 1 arxiv arxiv PROPN dad-10733 1888 2 preprint preprint VERB dad-10733 1888 3 arxiv:1604.06045 arxiv:1604.06045 NOUN dad-10733 1888 4 , , PUNCT dad-10733 1888 5 2016 2016 NUM dad-10733 1888 6 . . PUNCT dad-10733 1889 1 48 48 NUM dad-10733 1889 2 a a DET dad-10733 1889 3 survey survey NOUN dad-10733 1889 4 of of ADP dad-10733 1889 5 available available ADJ dad-10733 1889 6 corpora corpora PROPN dad-10733 1889 7 for for ADP dad-10733 1889 8 building build VERB dad-10733 1889 9 data data NOUN dad-10733 1889 10 - - PUNCT dad-10733 1889 11 driven drive VERB dad-10733 1889 12 dialogue dialogue NOUN dad-10733 1889 13 systems systems PROPN dad-10733 1889 14 j. j. PROPN dad-10733 1889 15 williams williams PROPN dad-10733 1889 16 , , PUNCT dad-10733 1889 17 a. a. PROPN dad-10733 1889 18 raux raux PROPN dad-10733 1889 19 , , PUNCT dad-10733 1889 20 d. d. PROPN dad-10733 1889 21 ramachandran ramachandran PROPN dad-10733 1889 22 , , PUNCT dad-10733 1889 23 and and CCONJ dad-10733 1889 24 a. a. NOUN dad-10733 1889 25 black black NOUN dad-10733 1889 26 . . PUNCT dad-10733 1890 1 the the DET dad-10733 1890 2 dialog dialog NOUN dad-10733 1890 3 state state NOUN dad-10733 1890 4 tracking tracking NOUN dad-10733 1890 5 challenge challenge NOUN dad-10733 1890 6 . . PUNCT dad-10733 1891 1 in in ADP dad-10733 1891 2 special special ADJ dad-10733 1891 3 interest interest NOUN dad-10733 1891 4 group group NOUN dad-10733 1891 5 on on ADP dad-10733 1891 6 discourse discourse NOUN dad-10733 1891 7 and and CCONJ dad-10733 1891 8 dialogue dialogue NOUN dad-10733 1891 9 ( ( PUNCT dad-10733 1891 10 sigdial sigdial ADJ dad-10733 1891 11 ) ) PUNCT dad-10733 1891 12 , , PUNCT dad-10733 1891 13 2013 2013 NUM dad-10733 1891 14 . . PUNCT dad-10733 1892 1 j. j. PROPN dad-10733 1892 2 d. d. PROPN dad-10733 1892 3 williams williams PROPN dad-10733 1892 4 and and CCONJ dad-10733 1892 5 s. s. PROPN dad-10733 1892 6 young young PROPN dad-10733 1892 7 . . PUNCT dad-10733 1893 1 partially partially ADV dad-10733 1893 2 observable observable ADJ dad-10733 1893 3 markov markov NOUN dad-10733 1893 4 decision decision NOUN dad-10733 1893 5 processes process NOUN dad-10733 1893 6 for for ADP dad-10733 1893 7 spoken spoken ADJ dad-10733 1893 8 dialog dialog NOUN dad-10733 1893 9 systems system NOUN dad-10733 1893 10 . . PUNCT dad-10733 1894 1 computer computer NOUN dad-10733 1894 2 speech speech NOUN dad-10733 1894 3 & & CCONJ dad-10733 1894 4 language language NOUN dad-10733 1894 5 , , PUNCT dad-10733 1894 6 21(2):393–422 21(2):393–422 NUM dad-10733 1894 7 , , PUNCT dad-10733 1894 8 2007 2007 NUM dad-10733 1894 9 . . PUNCT dad-10733 1895 1 j. j. PROPN dad-10733 1895 2 d. d. PROPN dad-10733 1895 3 williams williams PROPN dad-10733 1895 4 and and CCONJ dad-10733 1895 5 g. g. PROPN dad-10733 1895 6 zweig zweig PROPN dad-10733 1895 7 . . PROPN dad-10733 1895 8 end end PROPN dad-10733 1895 9 - - PUNCT dad-10733 1895 10 to to ADP dad-10733 1895 11 - - PUNCT dad-10733 1895 12 end end VERB dad-10733 1895 13 lstm lstm NOUN dad-10733 1895 14 - - PUNCT dad-10733 1895 15 based base VERB dad-10733 1895 16 dialog dialog NOUN dad-10733 1895 17 control control NOUN dad-10733 1895 18 optimized optimize VERB dad-10733 1895 19 with with ADP dad-10733 1895 20 supervised supervised ADJ dad-10733 1895 21 and and CCONJ dad-10733 1895 22 reinforcement reinforcement NOUN dad-10733 1895 23 learning learning NOUN dad-10733 1895 24 . . PUNCT dad-10733 1896 1 arxiv arxiv PROPN dad-10733 1896 2 preprint preprint PROPN dad-10733 1896 3 arxiv:1606.01269 arxiv:1606.01269 PROPN dad-10733 1896 4 , , PUNCT dad-10733 1896 5 2016 2016 NUM dad-10733 1896 6 . . PUNCT dad-10733 1897 1 m. m. PROPN dad-10733 1897 2 wolska wolska PROPN dad-10733 1897 3 , , PUNCT dad-10733 1897 4 q. q. PROPN dad-10733 1897 5 b. b. PROPN dad-10733 1897 6 vo vo PROPN dad-10733 1897 7 , , PUNCT dad-10733 1897 8 d. d. PROPN dad-10733 1897 9 tsovaltzi tsovaltzi PROPN dad-10733 1897 10 , , PUNCT dad-10733 1897 11 i. i. PROPN dad-10733 1897 12 kruijff kruijff PROPN dad-10733 1897 13 - - PUNCT dad-10733 1897 14 korbayová korbayová NOUN dad-10733 1897 15 , , PUNCT dad-10733 1897 16 e. e. PROPN dad-10733 1897 17 karagjosova karagjosova PROPN dad-10733 1897 18 , , PUNCT dad-10733 1897 19 h. h. PROPN dad-10733 1897 20 horacek horacek PROPN dad-10733 1897 21 , , PUNCT dad-10733 1897 22 a. a. NOUN dad-10733 1897 23 fiedler fiedler PROPN dad-10733 1897 24 , , PUNCT dad-10733 1897 25 and and CCONJ dad-10733 1897 26 c. c. PROPN dad-10733 1897 27 benzmüller benzmüller PROPN dad-10733 1897 28 . . PUNCT dad-10733 1898 1 an an DET dad-10733 1898 2 annotated annotate VERB dad-10733 1898 3 corpus corpus NOUN dad-10733 1898 4 of of ADP dad-10733 1898 5 tutorial tutorial NOUN dad-10733 1898 6 dialogs dialog NOUN dad-10733 1898 7 on on ADP dad-10733 1898 8 mathematical mathematical ADJ dad-10733 1898 9 theorem theorem ADJ dad-10733 1898 10 proving proving NOUN dad-10733 1898 11 . . PUNCT dad-10733 1899 1 in in ADP dad-10733 1899 2 the the DET dad-10733 1899 3 international international ADJ dad-10733 1899 4 conference conference NOUN dad-10733 1899 5 on on ADP dad-10733 1899 6 language language NOUN dad-10733 1899 7 resources resource NOUN dad-10733 1899 8 and and CCONJ dad-10733 1899 9 evaluation evaluation NOUN dad-10733 1899 10 ( ( PUNCT dad-10733 1899 11 lrec lrec PROPN dad-10733 1899 12 ) ) PUNCT dad-10733 1899 13 , , PUNCT dad-10733 1899 14 2004 2004 NUM dad-10733 1899 15 . . PUNCT dad-10733 1900 1 b. b. PROPN dad-10733 1900 2 wrede wrede PROPN dad-10733 1900 3 and and CCONJ dad-10733 1900 4 e. e. PROPN dad-10733 1900 5 shriberg shriberg PROPN dad-10733 1900 6 . . PUNCT dad-10733 1901 1 relationship relationship NOUN dad-10733 1901 2 between between ADP dad-10733 1901 3 dialogue dialogue NOUN dad-10733 1901 4 acts act NOUN dad-10733 1901 5 and and CCONJ dad-10733 1901 6 hot hot ADJ dad-10733 1901 7 spots spot NOUN dad-10733 1901 8 in in ADP dad-10733 1901 9 meetings meeting NOUN dad-10733 1901 10 . . PUNCT dad-10733 1902 1 in in ADP dad-10733 1902 2 automatic automatic ADJ dad-10733 1902 3 speech speech NOUN dad-10733 1902 4 recognition recognition NOUN dad-10733 1902 5 and and CCONJ dad-10733 1902 6 understanding understanding NOUN dad-10733 1902 7 , , PUNCT dad-10733 1902 8 2003 2003 NUM dad-10733 1902 9 . . PUNCT dad-10733 1903 1 asru’03 asru’03 NOUN dad-10733 1903 2 . . PUNCT dad-10733 1904 1 2003 2003 NUM dad-10733 1904 2 ieee ieee NOUN dad-10733 1904 3 workshop workshop NOUN dad-10733 1904 4 on on ADP dad-10733 1904 5 , , PUNCT dad-10733 1904 6 pages page NOUN dad-10733 1904 7 180–185 180–185 NUM dad-10733 1904 8 . . PUNCT dad-10733 1905 1 ieee ieee PROPN dad-10733 1905 2 , , PUNCT dad-10733 1905 3 2003 2003 NUM dad-10733 1905 4 . . PUNCT dad-10733 1906 1 x. x. PROPN dad-10733 1906 2 yang yang PROPN dad-10733 1906 3 , , PUNCT dad-10733 1906 4 y.-n y.-n PROPN dad-10733 1906 5 . . PUNCT dad-10733 1907 1 chen chen PROPN dad-10733 1907 2 , , PUNCT dad-10733 1907 3 d. d. PROPN dad-10733 1907 4 hakkani hakkani PROPN dad-10733 1907 5 - - PUNCT dad-10733 1907 6 tür tür NOUN dad-10733 1907 7 , , PUNCT dad-10733 1907 8 p. p. NOUN dad-10733 1907 9 crook crook NOUN dad-10733 1907 10 , , PUNCT dad-10733 1907 11 x. x. PROPN dad-10733 1907 12 li li PROPN dad-10733 1907 13 , , PUNCT dad-10733 1907 14 j. j. PROPN dad-10733 1907 15 gao gao PROPN dad-10733 1907 16 , , PUNCT dad-10733 1907 17 and and CCONJ dad-10733 1907 18 l. l. PROPN dad-10733 1907 19 deng deng PROPN dad-10733 1907 20 . . PROPN dad-10733 1907 21 end end PROPN dad-10733 1907 22 - - PUNCT dad-10733 1907 23 to to ADP dad-10733 1907 24 - - PUNCT dad-10733 1907 25 end end NOUN dad-10733 1907 26 joint joint ADJ dad-10733 1907 27 learning learning NOUN dad-10733 1907 28 of of ADP dad-10733 1907 29 natural natural ADJ dad-10733 1907 30 language language NOUN dad-10733 1907 31 understanding understanding NOUN dad-10733 1907 32 and and CCONJ dad-10733 1907 33 dialogue dialogue NOUN dad-10733 1907 34 manager manager NOUN dad-10733 1907 35 . . PUNCT dad-10733 1908 1 in in ADP dad-10733 1908 2 acoustics acoustic NOUN dad-10733 1908 3 , , PUNCT dad-10733 1908 4 speech speech NOUN dad-10733 1908 5 and and CCONJ dad-10733 1908 6 signal signal NOUN dad-10733 1908 7 processing processing NOUN dad-10733 1908 8 ( ( PUNCT dad-10733 1908 9 icassp icassp PROPN dad-10733 1908 10 ) ) PUNCT dad-10733 1908 11 , , PUNCT dad-10733 1908 12 2017 2017 NUM dad-10733 1908 13 ieee ieee NOUN dad-10733 1908 14 international international ADJ dad-10733 1908 15 conference conference NOUN dad-10733 1908 16 on on ADP dad-10733 1908 17 , , PUNCT dad-10733 1908 18 pages page NOUN dad-10733 1908 19 5690–5694 5690–5694 NUM dad-10733 1908 20 . . PUNCT dad-10733 1908 21 ieee ieee PROPN dad-10733 1908 22 , , PUNCT dad-10733 1908 23 2017 2017 NUM dad-10733 1908 24 . . PUNCT dad-10733 1909 1 y. y. PROPN dad-10733 1909 2 yang yang PROPN dad-10733 1909 3 , , PUNCT dad-10733 1909 4 w. w. PROPN dad-10733 1909 5 yih yih PROPN dad-10733 1909 6 , , PUNCT dad-10733 1909 7 and and CCONJ dad-10733 1909 8 c. c. PROPN dad-10733 1909 9 meek meek PROPN dad-10733 1909 10 . . PUNCT dad-10733 1910 1 wikiqa wikiqa PROPN dad-10733 1910 2 : : PUNCT dad-10733 1910 3 a a DET dad-10733 1910 4 challenge challenge NOUN dad-10733 1910 5 dataset dataset VERB dad-10733 1910 6 for for ADP dad-10733 1910 7 open open ADJ dad-10733 1910 8 - - PUNCT dad-10733 1910 9 domain domain NOUN dad-10733 1910 10 question question NOUN dad-10733 1910 11 answering answering NOUN dad-10733 1910 12 . . PUNCT dad-10733 1911 1 in in ADP dad-10733 1911 2 conference conference NOUN dad-10733 1911 3 on on ADP dad-10733 1911 4 empirical empirical ADJ dad-10733 1911 5 methods method NOUN dad-10733 1911 6 in in ADP dad-10733 1911 7 natural natural ADJ dad-10733 1911 8 language language NOUN dad-10733 1911 9 processing processing NOUN dad-10733 1911 10 ( ( PUNCT dad-10733 1911 11 emnlp emnlp ADJ dad-10733 1911 12 ) ) PUNCT dad-10733 1911 13 , , PUNCT dad-10733 1911 14 pages page NOUN dad-10733 1911 15 2013–2018 2013–2018 NUM dad-10733 1911 16 , , PUNCT dad-10733 1911 17 2015 2015 NUM dad-10733 1911 18 . . PUNCT dad-10733 1912 1 z. z. PROPN dad-10733 1912 2 yang yang PROPN dad-10733 1912 3 , , PUNCT dad-10733 1912 4 b. b. PROPN dad-10733 1912 5 li li PROPN dad-10733 1912 6 , , PUNCT dad-10733 1912 7 y. y. PROPN dad-10733 1912 8 zhu zhu PROPN dad-10733 1912 9 , , PUNCT dad-10733 1912 10 i. i. PROPN dad-10733 1912 11 king king PROPN dad-10733 1912 12 , , PUNCT dad-10733 1912 13 g. g. PROPN dad-10733 1912 14 levow levow PROPN dad-10733 1912 15 , , PUNCT dad-10733 1912 16 and and CCONJ dad-10733 1912 17 h. h. PROPN dad-10733 1912 18 meng meng PROPN dad-10733 1912 19 . . PUNCT dad-10733 1913 1 collection collection NOUN dad-10733 1913 2 of of ADP dad-10733 1913 3 user user NOUN dad-10733 1913 4 judgments judgment NOUN dad-10733 1913 5 on on ADP dad-10733 1913 6 spoken spoken ADJ dad-10733 1913 7 dialog dialog NOUN dad-10733 1913 8 system system NOUN dad-10733 1913 9 with with ADP dad-10733 1913 10 crowdsourcing crowdsourcing NOUN dad-10733 1913 11 . . PUNCT dad-10733 1914 1 in in ADP dad-10733 1914 2 spoken spoken ADJ dad-10733 1914 3 language language NOUN dad-10733 1914 4 technology technology NOUN dad-10733 1914 5 workshop workshop NOUN dad-10733 1914 6 ( ( PUNCT dad-10733 1914 7 slt slt PROPN dad-10733 1914 8 ) ) PUNCT dad-10733 1914 9 , , PUNCT dad-10733 1914 10 2010 2010 NUM dad-10733 1914 11 ieee ieee NOUN dad-10733 1914 12 , , PUNCT dad-10733 1914 13 pages page NOUN dad-10733 1914 14 277–282 277–282 NUM dad-10733 1914 15 , , PUNCT dad-10733 1914 16 2010 2010 NUM dad-10733 1914 17 . . PUNCT dad-10733 1915 1 s. s. PROPN dad-10733 1915 2 young young PROPN dad-10733 1915 3 , , PUNCT dad-10733 1915 4 m. m. NOUN dad-10733 1915 5 gasic gasic PROPN dad-10733 1915 6 , , PUNCT dad-10733 1915 7 b. b. PROPN dad-10733 1915 8 thomson thomson PROPN dad-10733 1915 9 , , PUNCT dad-10733 1915 10 and and CCONJ dad-10733 1915 11 j. j. PROPN dad-10733 1915 12 d. d. PROPN dad-10733 1915 13 williams williams PROPN dad-10733 1915 14 . . PUNCT dad-10733 1916 1 pomdp pomdp NOUN dad-10733 1916 2 - - PUNCT dad-10733 1916 3 based base VERB dad-10733 1916 4 statistical statistical ADJ dad-10733 1916 5 spoken spoken ADJ dad-10733 1916 6 dialog dialog NOUN dad-10733 1916 7 systems system NOUN dad-10733 1916 8 : : PUNCT dad-10733 1916 9 a a DET dad-10733 1916 10 review review NOUN dad-10733 1916 11 . . PUNCT dad-10733 1917 1 ieee ieee PROPN dad-10733 1917 2 , , PUNCT dad-10733 1917 3 101(5):1160–1179 101(5):1160–1179 PROPN dad-10733 1917 4 , , PUNCT dad-10733 1917 5 2013 2013 NUM dad-10733 1917 6 . . PUNCT dad-10733 1918 1 s. s. PROPN dad-10733 1918 2 j. j. PROPN dad-10733 1918 3 young young PROPN dad-10733 1918 4 . . PUNCT dad-10733 1919 1 probabilistic probabilistic ADJ dad-10733 1919 2 methods method NOUN dad-10733 1919 3 in in ADP dad-10733 1919 4 spoken spoken ADJ dad-10733 1919 5 – – PUNCT dad-10733 1919 6 dialogue dialogue NOUN dad-10733 1919 7 systems system NOUN dad-10733 1919 8 . . PUNCT dad-10733 1920 1 philosophical philosophical ADJ dad-10733 1920 2 transactions transaction NOUN dad-10733 1920 3 of of ADP dad-10733 1920 4 the the DET dad-10733 1920 5 royal royal ADJ dad-10733 1920 6 society society NOUN dad-10733 1920 7 of of ADP dad-10733 1920 8 london london PROPN dad-10733 1920 9 . . PUNCT dad-10733 1921 1 series series PROPN dad-10733 1921 2 a a PRON dad-10733 1921 3 : : PUNCT dad-10733 1921 4 mathematical mathematical ADJ dad-10733 1921 5 , , PUNCT dad-10733 1921 6 physical physical ADJ dad-10733 1921 7 and and CCONJ dad-10733 1921 8 engineering engineering NOUN dad-10733 1921 9 sciences science NOUN dad-10733 1921 10 , , PUNCT dad-10733 1921 11 358(1769 358(1769 NUM dad-10733 1921 12 ) ) PUNCT dad-10733 1921 13 , , PUNCT dad-10733 1921 14 2000 2000 NUM dad-10733 1921 15 . . PUNCT dad-10733 1922 1 j. j. PROPN dad-10733 1922 2 zhang zhang PROPN dad-10733 1922 3 , , PUNCT dad-10733 1922 4 r. r. PROPN dad-10733 1922 5 kumar kumar PROPN dad-10733 1922 6 , , PUNCT dad-10733 1922 7 s. s. PROPN dad-10733 1922 8 ravi ravi PROPN dad-10733 1922 9 , , PUNCT dad-10733 1922 10 and and CCONJ dad-10733 1922 11 c. c. PROPN dad-10733 1922 12 danescu danescu PROPN dad-10733 1922 13 - - PUNCT dad-10733 1922 14 niculescu niculescu NOUN dad-10733 1922 15 - - PUNCT dad-10733 1922 16 mizil mizil NOUN dad-10733 1922 17 . . PUNCT dad-10733 1923 1 conversational conversational ADJ dad-10733 1923 2 flow flow NOUN dad-10733 1923 3 in in ADP dad-10733 1923 4 oxford oxford ADJ dad-10733 1923 5 - - PUNCT dad-10733 1923 6 style style NOUN dad-10733 1923 7 debates debate NOUN dad-10733 1923 8 . . PUNCT dad-10733 1924 1 in in ADP dad-10733 1924 2 conference conference NOUN dad-10733 1924 3 of of ADP dad-10733 1924 4 the the DET dad-10733 1924 5 north north ADJ dad-10733 1924 6 american american ADJ dad-10733 1924 7 chapter chapter NOUN dad-10733 1924 8 of of ADP dad-10733 1924 9 the the DET dad-10733 1924 10 association association NOUN dad-10733 1924 11 for for ADP dad-10733 1924 12 computational computational ADJ dad-10733 1924 13 linguistics linguistic NOUN dad-10733 1924 14 ( ( PUNCT dad-10733 1924 15 naacl naacl PROPN dad-10733 1924 16 - - PUNCT dad-10733 1924 17 hlt hlt PROPN dad-10733 1924 18 2016 2016 NUM dad-10733 1924 19 ) ) PUNCT dad-10733 1924 20 , , PUNCT dad-10733 1924 21 2016 2016 NUM dad-10733 1924 22 . . PUNCT dad-10733 1924 23 49 49 NUM dad-10733 1924 24 introduction introduction NOUN dad-10733 1924 25 characteristics characteristic NOUN dad-10733 1924 26 of of ADP dad-10733 1924 27 data data NOUN dad-10733 1924 28 - - PUNCT dad-10733 1924 29 driven drive VERB dad-10733 1924 30 dialogue dialogue NOUN dad-10733 1924 31 systems system NOUN dad-10733 1924 32 an an DET dad-10733 1924 33 overview overview NOUN dad-10733 1924 34 of of ADP dad-10733 1924 35 dialogue dialogue NOUN dad-10733 1924 36 systems system NOUN dad-10733 1924 37 tasks task NOUN dad-10733 1924 38 and and CCONJ dad-10733 1924 39 objectives objective NOUN dad-10733 1924 40 learning learn VERB dad-10733 1924 41 dialogue dialogue NOUN dad-10733 1924 42 system system NOUN dad-10733 1924 43 components component NOUN dad-10733 1924 44 natural natural ADJ dad-10733 1924 45 language language NOUN dad-10733 1924 46 understanding understand VERB dad-10733 1924 47 dialogue dialogue NOUN dad-10733 1924 48 management management NOUN dad-10733 1924 49 natural natural ADJ dad-10733 1924 50 language language NOUN dad-10733 1924 51 generator generator NOUN dad-10733 1924 52 end end NOUN dad-10733 1924 53 - - PUNCT dad-10733 1924 54 to to ADP dad-10733 1924 55 - - PUNCT dad-10733 1924 56 end end NOUN dad-10733 1924 57 dialogue dialogue NOUN dad-10733 1924 58 systems system NOUN dad-10733 1924 59 dialogue dialogue NOUN dad-10733 1924 60 interaction interaction NOUN dad-10733 1924 61 types type NOUN dad-10733 1924 62 & & CCONJ dad-10733 1924 63 aspects aspect NOUN dad-10733 1924 64 written write VERB dad-10733 1924 65 , , PUNCT dad-10733 1924 66 spoken spoken ADJ dad-10733 1924 67 & & CCONJ dad-10733 1924 68 multi multi ADJ dad-10733 1924 69 - - ADJ dad-10733 1924 70 modal modal ADJ dad-10733 1924 71 corpora corpora NOUN dad-10733 1924 72 human human NOUN dad-10733 1924 73 - - PUNCT dad-10733 1924 74 human human NOUN dad-10733 1924 75 vs. vs. ADP dad-10733 1924 76 human human NOUN dad-10733 1924 77 - - PUNCT dad-10733 1924 78 machine machine NOUN dad-10733 1924 79 corpora corpora NOUN dad-10733 1924 80 spontaneous spontaneous ADJ dad-10733 1924 81 vs. vs. ADP dad-10733 1924 82 constrained constrain VERB dad-10733 1924 83 corpora corpora PROPN dad-10733 1924 84 topic topic NOUN dad-10733 1924 85 - - PUNCT dad-10733 1924 86 oriented orient VERB dad-10733 1924 87 & & CCONJ dad-10733 1924 88 goal goal NOUN dad-10733 1924 89 - - PUNCT dad-10733 1924 90 driven drive VERB dad-10733 1924 91 datasets dataset NOUN dad-10733 1924 92 scripted script VERB dad-10733 1924 93 corpora corpora PROPN dad-10733 1924 94 or or CCONJ dad-10733 1924 95 corpora corpora VERB dad-10733 1924 96 from from ADP dad-10733 1924 97 fiction fiction NOUN dad-10733 1924 98 corpus corpus NOUN dad-10733 1924 99 size size NOUN dad-10733 1924 100 available available ADJ dad-10733 1924 101 dialogue dialogue NOUN dad-10733 1924 102 datasets dataset VERB dad-10733 1924 103 human human NOUN dad-10733 1924 104 - - PUNCT dad-10733 1924 105 machine machine NOUN dad-10733 1924 106 corpora corpora NOUN dad-10733 1924 107 restaurant restaurant NOUN dad-10733 1924 108 and and CCONJ dad-10733 1924 109 travel travel NOUN dad-10733 1924 110 information information NOUN dad-10733 1924 111 open open ADJ dad-10733 1924 112 - - PUNCT dad-10733 1924 113 domain domain NOUN dad-10733 1924 114 knowledge knowledge NOUN dad-10733 1924 115 retrieval retrieval VERB dad-10733 1924 116 other other ADJ dad-10733 1924 117 human human ADJ dad-10733 1924 118 - - PUNCT dad-10733 1924 119 human human NOUN dad-10733 1924 120 spoken spoken ADJ dad-10733 1924 121 corpora corpora PROPN dad-10733 1924 122 spontaneous spontaneous ADJ dad-10733 1924 123 spoken spoken ADJ dad-10733 1924 124 corpora corpora PROPN dad-10733 1924 125 constrained constrain VERB dad-10733 1924 126 spoken spoken ADJ dad-10733 1924 127 corpora corpora PROPN dad-10733 1924 128 scripted script VERB dad-10733 1924 129 corpora corpora PROPN dad-10733 1924 130 human human NOUN dad-10733 1924 131 - - PUNCT dad-10733 1924 132 human human NOUN dad-10733 1924 133 written written NOUN dad-10733 1924 134 corpora corpora VERB dad-10733 1924 135 spontaneous spontaneous ADJ dad-10733 1924 136 written written NOUN dad-10733 1924 137 corpora corpora PROPN dad-10733 1924 138 constrained constrain VERB dad-10733 1924 139 written write VERB dad-10733 1924 140 corpora corpora NOUN dad-10733 1924 141 discussion discussion NOUN dad-10733 1924 142 challenges challenge NOUN dad-10733 1924 143 of of ADP dad-10733 1924 144 learning learn VERB dad-10733 1924 145 from from ADP dad-10733 1924 146 large large ADJ dad-10733 1924 147 datasets dataset NOUN dad-10733 1924 148 the the DET dad-10733 1924 149 twitter twitter NOUN dad-10733 1924 150 corpus corpus NOUN dad-10733 1924 151 the the DET dad-10733 1924 152 ubuntu ubuntu ADJ dad-10733 1924 153 dialogue dialogue NOUN dad-10733 1924 154 corpus corpus NOUN dad-10733 1924 155 transfer transfer NOUN dad-10733 1924 156 learning learning NOUN dad-10733 1924 157 between between ADP dad-10733 1924 158 datasets dataset NOUN dad-10733 1924 159 incorporating incorporate VERB dad-10733 1924 160 external external ADJ dad-10733 1924 161 knowledge knowledge NOUN dad-10733 1924 162 structured structure VERB dad-10733 1924 163 external external ADJ dad-10733 1924 164 knowledge knowledge NOUN dad-10733 1924 165 unstructured unstructure VERB dad-10733 1924 166 external external ADJ dad-10733 1924 167 knowledge knowledge NOUN dad-10733 1924 168 personalized personalize VERB dad-10733 1924 169 dialogue dialogue NOUN dad-10733 1924 170 agents agent NOUN dad-10733 1924 171 evaluation evaluation NOUN dad-10733 1924 172 metrics metric NOUN dad-10733 1924 173 automatic automatic ADJ dad-10733 1924 174 evaluation evaluation NOUN dad-10733 1924 175 metrics metric NOUN dad-10733 1924 176 for for ADP dad-10733 1924 177 goal goal NOUN dad-10733 1924 178 - - PUNCT dad-10733 1924 179 driven drive VERB dad-10733 1924 180 dialogue dialogue NOUN dad-10733 1924 181 systems system NOUN dad-10733 1924 182 automatic automatic ADJ dad-10733 1924 183 evaluation evaluation NOUN dad-10733 1924 184 metrics metric NOUN dad-10733 1924 185 for for ADP dad-10733 1924 186 non non ADJ dad-10733 1924 187 - - ADJ dad-10733 1924 188 goal goal ADJ dad-10733 1924 189 - - PUNCT dad-10733 1924 190 driven drive VERB dad-10733 1924 191 dialogue dialogue NOUN dad-10733 1924 192 systems system NOUN dad-10733 1924 193 conclusion conclusion NOUN