id sid tid token lemma pos bracis-33590 1 1 inranker inranker NOUN bracis-33590 1 2 : : PUNCT bracis-33590 1 3 distilled distil VERB bracis-33590 1 4 rankers ranker NOUN bracis-33590 1 5 for for ADP bracis-33590 1 6     SPACE bracis-33590 1 7 zero zero NUM bracis-33590 1 8 - - PUNCT bracis-33590 1 9 shot shot NOUN bracis-33590 1 10 information information NOUN bracis-33590 1 11 retrieval retrieval NOUN bracis-33590 1 12 | | CCONJ bracis-33590 1 13 springer springer NOUN bracis-33590 1 14 nature nature PROPN bracis-33590 1 15 link link PROPN bracis-33590 1 16 ( ( PUNCT bracis-33590 1 17 formerly formerly ADV bracis-33590 1 18 springerlink springerlink NOUN bracis-33590 1 19 ) ) PUNCT bracis-33590 1 20 skip skip VERB bracis-33590 1 21 to to ADP bracis-33590 1 22 main main ADJ bracis-33590 1 23 content content NOUN bracis-33590 1 24 advertisement advertisement NOUN bracis-33590 1 25 log log NOUN bracis-33590 1 26 in in ADP bracis-33590 1 27 menu menu NOUN bracis-33590 1 28 find find VERB bracis-33590 1 29 a a DET bracis-33590 1 30 journal journal NOUN bracis-33590 1 31 publish publish VERB bracis-33590 1 32 with with ADP bracis-33590 1 33 us we PRON bracis-33590 1 34 track track VERB bracis-33590 1 35 your your PRON bracis-33590 1 36 research research NOUN bracis-33590 1 37 search search NOUN bracis-33590 1 38 cart cart NOUN bracis-33590 1 39 home home NOUN bracis-33590 1 40 intelligent intelligent ADJ bracis-33590 1 41 systems system NOUN bracis-33590 1 42 conference conference NOUN bracis-33590 1 43 paper paper NOUN bracis-33590 1 44 inranker inranker NOUN bracis-33590 1 45 : : PUNCT bracis-33590 1 46 distilled distil VERB bracis-33590 1 47 rankers ranker NOUN bracis-33590 1 48 for for ADP bracis-33590 1 49     SPACE bracis-33590 1 50 zero zero NUM bracis-33590 1 51 - - PUNCT bracis-33590 1 52 shot shot NOUN bracis-33590 1 53 information information NOUN bracis-33590 1 54 retrieval retrieval NOUN bracis-33590 1 55 conference conference NOUN bracis-33590 1 56 paper paper NOUN bracis-33590 1 57 first first ADV bracis-33590 1 58 online online ADV bracis-33590 1 59 : : PUNCT bracis-33590 1 60 30 30 NUM bracis-33590 1 61 january january NOUN bracis-33590 1 62 2025 2025 NUM bracis-33590 1 63 pp pp ADP bracis-33590 1 64 140–154 140–154 NUM bracis-33590 1 65 cite cite VERB bracis-33590 1 66 this this DET bracis-33590 1 67 conference conference NOUN bracis-33590 1 68 paper paper NOUN bracis-33590 1 69 access access NOUN bracis-33590 1 70 provided provide VERB bracis-33590 1 71 by by ADP bracis-33590 1 72 university university PROPN bracis-33590 1 73 of of ADP bracis-33590 1 74 notre notre PROPN bracis-33590 1 75 dame dame PROPN bracis-33590 1 76 hesburgh hesburgh PROPN bracis-33590 1 77 library library PROPN bracis-33590 1 78 download download PROPN bracis-33590 1 79 book book NOUN bracis-33590 1 80 pdf pdf PROPN bracis-33590 1 81 download download NOUN bracis-33590 1 82 book book NOUN bracis-33590 1 83 epub epub PROPN bracis-33590 1 84 intelligent intelligent ADJ bracis-33590 1 85 systems system NOUN bracis-33590 1 86 ( ( PUNCT bracis-33590 1 87 bracis bracis NOUN bracis-33590 1 88 2024 2024 NUM bracis-33590 1 89 ) ) PUNCT bracis-33590 1 90 inranker inranker NOUN bracis-33590 1 91 : : PUNCT bracis-33590 1 92 distilled distil VERB bracis-33590 1 93 rankers ranker NOUN bracis-33590 1 94 for for ADP bracis-33590 1 95     SPACE bracis-33590 1 96 zero zero NUM bracis-33590 1 97 - - PUNCT bracis-33590 1 98 shot shoot VERB bracis-33590 1 99 information information NOUN bracis-33590 1 100 retrieval retrieval NOUN bracis-33590 1 101 download download NOUN bracis-33590 1 102 book book NOUN bracis-33590 1 103 pdf pdf PROPN bracis-33590 1 104 download download NOUN bracis-33590 1 105 book book PROPN bracis-33590 1 106 epub epub PROPN bracis-33590 1 107 thiago thiago PROPN bracis-33590 1 108 soares soares PROPN bracis-33590 1 109 laitz laitz PROPN bracis-33590 1 110     SPACE bracis-33590 1 111 orcid orcid NOUN bracis-33590 1 112 : : PUNCT bracis-33590 1 113 orcid.org/0000-0001-7205-20949,10 orcid.org/0000-0001-7205-20949,10 PROPN bracis-33590 1 114 , , PUNCT bracis-33590 1 115 konstantinos konstantinos PROPN bracis-33590 1 116 papakostas papakostas PROPN bracis-33590 1 117     SPACE bracis-33590 1 118 orcid orcid NOUN bracis-33590 1 119 : : PUNCT bracis-33590 1 120 orcid.org/0000-0002-2096-293111 orcid.org/0000-0002-2096-293111 ADJ bracis-33590 1 121 , , PUNCT bracis-33590 1 122 roberto roberto PROPN bracis-33590 1 123 lotufo lotufo PROPN bracis-33590 1 124     SPACE bracis-33590 1 125 orcid orcid PROPN bracis-33590 1 126 : : PUNCT bracis-33590 1 127 orcid.org/0000-0002-5652-08529,12 orcid.org/0000-0002-5652-08529,12 PROPN bracis-33590 1 128 & & CCONJ bracis-33590 1 129 … … PUNCT bracis-33590 1 130 rodrigo rodrigo PROPN bracis-33590 1 131 nogueira nogueira PROPN bracis-33590 1 132     SPACE bracis-33590 1 133 orcid orcid PROPN bracis-33590 1 134 : : PUNCT bracis-33590 1 135 orcid.org/0000-0002-2600-60359,10,11 orcid.org/0000-0002-2600-60359,10,11 NOUN bracis-33590 1 136     SPACE bracis-33590 1 137 show show VERB bracis-33590 1 138 authors author NOUN bracis-33590 1 139 part part NOUN bracis-33590 1 140 of of ADP bracis-33590 1 141 the the DET bracis-33590 1 142 book book NOUN bracis-33590 1 143 series series NOUN bracis-33590 1 144 : : PUNCT bracis-33590 1 145 lecture lecture NOUN bracis-33590 1 146 notes note NOUN bracis-33590 1 147 in in ADP bracis-33590 1 148 computer computer NOUN bracis-33590 1 149 science science NOUN bracis-33590 1 150 ( ( PUNCT bracis-33590 1 151 ( ( PUNCT bracis-33590 1 152 lnai lnai ADJ bracis-33590 1 153 , , PUNCT bracis-33590 1 154 volume volume NOUN bracis-33590 1 155 15413 15413 NUM bracis-33590 1 156 ) ) PUNCT bracis-33590 1 157 ) ) PUNCT bracis-33590 1 158 included include VERB bracis-33590 1 159 in in ADP bracis-33590 1 160 the the DET bracis-33590 1 161 following follow VERB bracis-33590 1 162 conference conference NOUN bracis-33590 1 163 series series NOUN bracis-33590 1 164 : : PUNCT bracis-33590 1 165 brazilian brazilian ADJ bracis-33590 1 166 conference conference NOUN bracis-33590 1 167 on on ADP bracis-33590 1 168 intelligent intelligent ADJ bracis-33590 1 169 systems system NOUN bracis-33590 1 170 406 406 NUM bracis-33590 1 171 accesses access NOUN bracis-33590 1 172 2 2 NUM bracis-33590 1 173 citations citation NOUN bracis-33590 1 174 abstract abstract ADJ bracis-33590 1 175 despite despite SCONJ bracis-33590 1 176 multi multi ADJ bracis-33590 1 177 - - ADJ bracis-33590 1 178 billion billion NUM bracis-33590 1 179 parameter parameter NOUN bracis-33590 1 180 neural neural ADJ bracis-33590 1 181 rankers ranker NOUN bracis-33590 1 182 being be AUX bracis-33590 1 183 common common ADJ bracis-33590 1 184 components component NOUN bracis-33590 1 185 of of ADP bracis-33590 1 186 state state NOUN bracis-33590 1 187 - - PUNCT bracis-33590 1 188 of of ADP bracis-33590 1 189 - - PUNCT bracis-33590 1 190 the the DET bracis-33590 1 191 - - PUNCT bracis-33590 1 192 art art NOUN bracis-33590 1 193 information information NOUN bracis-33590 1 194 retrieval retrieval NOUN bracis-33590 1 195 pipelines pipeline NOUN bracis-33590 1 196 , , PUNCT bracis-33590 1 197 they they PRON bracis-33590 1 198 are be AUX bracis-33590 1 199 rarely rarely ADV bracis-33590 1 200 used use VERB bracis-33590 1 201 in in ADP bracis-33590 1 202 production production NOUN bracis-33590 1 203 due due ADP bracis-33590 1 204 to to ADP bracis-33590 1 205 the the DET bracis-33590 1 206 enormous enormous ADJ bracis-33590 1 207 amount amount NOUN bracis-33590 1 208 of of ADP bracis-33590 1 209 compute compute NOUN bracis-33590 1 210 required require VERB bracis-33590 1 211 for for ADP bracis-33590 1 212 inference inference NOUN bracis-33590 1 213 . . PUNCT bracis-33590 2 1 in in ADP bracis-33590 2 2 this this DET bracis-33590 2 3 work work NOUN bracis-33590 2 4 , , PUNCT bracis-33590 2 5 we we PRON bracis-33590 2 6 propose propose VERB bracis-33590 2 7 a a DET bracis-33590 2 8 method method NOUN bracis-33590 2 9 for for ADP bracis-33590 2 10 distilling distil VERB bracis-33590 2 11 large large ADJ bracis-33590 2 12 rankers ranker NOUN bracis-33590 2 13 into into ADP bracis-33590 2 14 their their PRON bracis-33590 2 15 smaller small ADJ bracis-33590 2 16 versions version NOUN bracis-33590 2 17 focusing focus VERB bracis-33590 2 18 on on ADP bracis-33590 2 19 out out ADP bracis-33590 2 20 - - PUNCT bracis-33590 2 21 of of ADP bracis-33590 2 22 - - PUNCT bracis-33590 2 23 domain domain NOUN bracis-33590 2 24 effectiveness effectiveness NOUN bracis-33590 2 25 . . PUNCT bracis-33590 3 1 we we PRON bracis-33590 3 2 introduce introduce VERB bracis-33590 3 3 inranker inranker NOUN bracis-33590 3 4 , , PUNCT bracis-33590 3 5 a a DET bracis-33590 3 6 version version NOUN bracis-33590 3 7 of of ADP bracis-33590 3 8 monot5 monot5 NOUN bracis-33590 4 1 [ [ X bracis-33590 4 2 25 25 NUM bracis-33590 4 3 ] ] PUNCT bracis-33590 4 4 distilled distil VERB bracis-33590 4 5 from from ADP bracis-33590 4 6 monot5 monot5 NOUN bracis-33590 4 7 - - PUNCT bracis-33590 4 8 3b 3b NOUN bracis-33590 4 9 with with ADP bracis-33590 4 10 increased increase VERB bracis-33590 4 11 effectiveness effectiveness NOUN bracis-33590 4 12 on on ADP bracis-33590 4 13 out out ADV bracis-33590 4 14 - - PUNCT bracis-33590 4 15 of of ADP bracis-33590 4 16 - - PUNCT bracis-33590 4 17 domain domain NOUN bracis-33590 4 18 scenarios scenario NOUN bracis-33590 4 19 . . PUNCT bracis-33590 5 1 our our PRON bracis-33590 5 2 key key ADJ bracis-33590 5 3 insight insight NOUN bracis-33590 5 4 is be AUX bracis-33590 5 5 to to PART bracis-33590 5 6 use use VERB bracis-33590 5 7 language language NOUN bracis-33590 5 8 models model NOUN bracis-33590 5 9 and and CCONJ bracis-33590 5 10 rerankers reranker NOUN bracis-33590 5 11 to to PART bracis-33590 5 12 generate generate VERB bracis-33590 5 13 as as ADV bracis-33590 5 14 much much ADJ bracis-33590 5 15 as as ADP bracis-33590 5 16 possible possible ADJ bracis-33590 5 17 synthetic synthetic NOUN bracis-33590 5 18 “ " PUNCT bracis-33590 5 19 in in ADP bracis-33590 5 20 - - PUNCT bracis-33590 5 21 domain domain NOUN bracis-33590 5 22 ” " PUNCT bracis-33590 5 23 training training NOUN bracis-33590 5 24 data datum NOUN bracis-33590 5 25 , , PUNCT bracis-33590 5 26 i.e. i.e. X bracis-33590 5 27 , , PUNCT bracis-33590 5 28 data datum NOUN bracis-33590 5 29 that that PRON bracis-33590 5 30 closely closely ADV bracis-33590 5 31 resembles resemble VERB bracis-33590 5 32 the the DET bracis-33590 5 33 data datum NOUN bracis-33590 5 34 that that PRON bracis-33590 5 35 will will AUX bracis-33590 5 36 be be AUX bracis-33590 5 37 seen see VERB bracis-33590 5 38 at at ADP bracis-33590 5 39 retrieval retrieval NOUN bracis-33590 5 40 time time NOUN bracis-33590 5 41 . . PUNCT bracis-33590 6 1 the the DET bracis-33590 6 2 pipeline pipeline NOUN bracis-33590 6 3 consists consist VERB bracis-33590 6 4 of of ADP bracis-33590 6 5 two two NUM bracis-33590 6 6 distillation distillation NOUN bracis-33590 6 7 phases phase NOUN bracis-33590 6 8 that that PRON bracis-33590 6 9 do do AUX bracis-33590 6 10 not not PART bracis-33590 6 11 require require VERB bracis-33590 6 12 additional additional ADJ bracis-33590 6 13 user user NOUN bracis-33590 6 14 queries query NOUN bracis-33590 6 15 or or CCONJ bracis-33590 6 16 manual manual ADJ bracis-33590 6 17 annotations annotation NOUN bracis-33590 6 18 : : PUNCT bracis-33590 6 19 ( ( PUNCT bracis-33590 6 20 1 1 X bracis-33590 6 21 ) ) PUNCT bracis-33590 6 22 training training NOUN bracis-33590 6 23 on on ADP bracis-33590 6 24 existing exist VERB bracis-33590 6 25 supervised supervised ADJ bracis-33590 6 26 soft soft ADJ bracis-33590 6 27 teacher teacher NOUN bracis-33590 6 28 labels label NOUN bracis-33590 6 29 , , PUNCT bracis-33590 6 30 and and CCONJ bracis-33590 6 31 ( ( PUNCT bracis-33590 6 32 2 2 X bracis-33590 6 33 ) ) PUNCT bracis-33590 6 34 training training NOUN bracis-33590 6 35 on on ADP bracis-33590 6 36 teacher teacher NOUN bracis-33590 6 37 soft soft ADJ bracis-33590 6 38 labels label NOUN bracis-33590 6 39 for for ADP bracis-33590 6 40 synthetic synthetic ADJ bracis-33590 6 41 queries query NOUN bracis-33590 6 42 generated generate VERB bracis-33590 6 43 using use VERB bracis-33590 6 44 a a DET bracis-33590 6 45 large large ADJ bracis-33590 6 46 language language NOUN bracis-33590 6 47 model model NOUN bracis-33590 6 48 . . PUNCT bracis-33590 7 1 consequently consequently ADV bracis-33590 7 2 , , PUNCT bracis-33590 7 3 models model NOUN bracis-33590 7 4 like like ADP bracis-33590 7 5 monot5 monot5 NOUN bracis-33590 7 6 - - PUNCT bracis-33590 7 7 60 60 NUM bracis-33590 7 8 m m NOUN bracis-33590 7 9 and and CCONJ bracis-33590 7 10 monot5 monot5 PROPN bracis-33590 7 11 - - PUNCT bracis-33590 7 12 220 220 NUM bracis-33590 7 13 m m VERB bracis-33590 7 14 improved improve VERB bracis-33590 7 15 their their PRON bracis-33590 7 16 effectiveness effectiveness NOUN bracis-33590 7 17 by by ADP bracis-33590 7 18 using use VERB bracis-33590 7 19 the the DET bracis-33590 7 20 teacher teacher NOUN bracis-33590 7 21 ’s ’s PART bracis-33590 7 22 knowledge knowledge NOUN bracis-33590 7 23 , , PUNCT bracis-33590 7 24 despite despite SCONJ bracis-33590 7 25 being be AUX bracis-33590 7 26 50x 50x NUM bracis-33590 7 27 and and CCONJ bracis-33590 7 28 13x 13x NUM bracis-33590 7 29 smaller small ADJ bracis-33590 7 30 , , PUNCT bracis-33590 7 31 respectively respectively ADV bracis-33590 7 32 . . PUNCT bracis-33590 8 1 furthermore furthermore ADV bracis-33590 8 2 , , PUNCT bracis-33590 8 3 we we PRON bracis-33590 8 4 show show VERB bracis-33590 8 5 that that SCONJ bracis-33590 8 6 it it PRON bracis-33590 8 7 is be AUX bracis-33590 8 8 possible possible ADJ bracis-33590 8 9 to to PART bracis-33590 8 10 transfer transfer VERB bracis-33590 8 11 knowledge knowledge NOUN bracis-33590 8 12 from from ADP bracis-33590 8 13 english english ADJ bracis-33590 8 14 models model NOUN bracis-33590 8 15 to to ADP bracis-33590 8 16 portuguese portuguese ADJ bracis-33590 8 17 fine fine ADV bracis-33590 8 18 - - PUNCT bracis-33590 8 19 tuned tune VERB bracis-33590 8 20 models model NOUN bracis-33590 8 21 . . PUNCT bracis-33590 9 1 models model NOUN bracis-33590 9 2 and and CCONJ bracis-33590 9 3 code code NOUN bracis-33590 9 4 are be AUX bracis-33590 9 5 available available ADJ bracis-33590 9 6 at at ADP bracis-33590 9 7 https://github.com/unicamp-dl/inranker https://github.com/unicamp-dl/inranker PROPN bracis-33590 9 8 . . PUNCT bracis-33590 9 9 access access NOUN bracis-33590 9 10 provided provide VERB bracis-33590 9 11 by by ADP bracis-33590 9 12 university university PROPN bracis-33590 9 13 of of ADP bracis-33590 9 14 notre notre PROPN bracis-33590 9 15 dame dame PROPN bracis-33590 9 16 hesburgh hesburgh PROPN bracis-33590 9 17 library library PROPN bracis-33590 9 18 . . PUNCT bracis-33590 10 1 download download PROPN bracis-33590 10 2 conference conference NOUN bracis-33590 10 3 paper paper NOUN bracis-33590 10 4 pdf pdf NOUN bracis-33590 10 5 similar similar ADJ bracis-33590 10 6 content content NOUN bracis-33590 10 7 being be AUX bracis-33590 10 8 viewed view VERB bracis-33590 10 9 by by ADP bracis-33590 10 10 others other NOUN bracis-33590 10 11 efficient efficient ADJ bracis-33590 10 12 knowledge knowledge NOUN bracis-33590 10 13 distillation distillation NOUN bracis-33590 10 14 : : PUNCT bracis-33590 10 15 empowering empower VERB bracis-33590 10 16 small small ADJ bracis-33590 10 17 language language NOUN bracis-33590 10 18 models model NOUN bracis-33590 10 19 with with ADP bracis-33590 10 20     SPACE bracis-33590 10 21 teacher teacher NOUN bracis-33590 10 22 model model NOUN bracis-33590 10 23 insights insight NOUN bracis-33590 10 24 chapter chapter NOUN bracis-33590 10 25 © © ADP bracis-33590 10 26 2024 2024 NUM bracis-33590 10 27 multi multi ADJ bracis-33590 10 28 - - ADJ bracis-33590 10 29 task task ADJ bracis-33590 10 30 feature feature NOUN bracis-33590 10 31 self self NOUN bracis-33590 10 32 - - PUNCT bracis-33590 10 33 distillation distillation NOUN bracis-33590 10 34 for for ADP bracis-33590 10 35     SPACE bracis-33590 10 36 semi semi ADJ bracis-33590 10 37 - - ADJ bracis-33590 10 38 supervised supervised ADJ bracis-33590 10 39 machine machine NOUN bracis-33590 10 40 translation translation NOUN bracis-33590 10 41 chapter chapter NOUN bracis-33590 10 42 © © PROPN bracis-33590 10 43 2024 2024 NUM bracis-33590 10 44 metadistiller metadistiller NOUN bracis-33590 10 45 : : PUNCT bracis-33590 10 46 network network NOUN bracis-33590 10 47 self self NOUN bracis-33590 10 48 - - PUNCT bracis-33590 10 49 boosting boost VERB bracis-33590 10 50 via via ADP bracis-33590 10 51 meta meta ADV bracis-33590 10 52 - - PUNCT bracis-33590 10 53 learned learn VERB bracis-33590 10 54 top top ADJ bracis-33590 10 55 - - PUNCT bracis-33590 10 56 down down ADP bracis-33590 10 57 distillation distillation NOUN bracis-33590 10 58 chapter chapter NOUN bracis-33590 10 59 © © NOUN bracis-33590 10 60 2020 2020 NUM bracis-33590 10 61 1 1 NUM bracis-33590 10 62 introduction introduction NOUN bracis-33590 10 63 it it PRON bracis-33590 10 64 is be AUX bracis-33590 10 65 well well ADV bracis-33590 10 66 known know VERB bracis-33590 10 67 that that SCONJ bracis-33590 10 68 the the DET bracis-33590 10 69 effectiveness effectiveness NOUN bracis-33590 10 70 of of ADP bracis-33590 10 71 ir ir PROPN bracis-33590 10 72 pipelines pipeline NOUN bracis-33590 10 73 increases increase VERB bracis-33590 10 74 with with ADP bracis-33590 10 75 larger large ADJ bracis-33590 10 76 models model NOUN bracis-33590 10 77     SPACE bracis-33590 11 1 [ [ X bracis-33590 11 2 2 2 NUM bracis-33590 11 3 , , PUNCT bracis-33590 11 4 22 22 NUM bracis-33590 11 5 , , PUNCT bracis-33590 11 6 24 24 NUM bracis-33590 11 7 , , PUNCT bracis-33590 11 8 25 25 NUM bracis-33590 11 9 , , PUNCT bracis-33590 11 10 28 28 NUM bracis-33590 11 11 ] ] PUNCT bracis-33590 11 12 . . PUNCT bracis-33590 12 1 for for ADP bracis-33590 12 2 instance instance NOUN bracis-33590 12 3 , , PUNCT bracis-33590 12 4 multi multi ADJ bracis-33590 12 5 - - ADJ bracis-33590 12 6 billion billion NUM bracis-33590 12 7 parameter parameter NOUN bracis-33590 12 8 rankers ranker NOUN bracis-33590 12 9 and and CCONJ bracis-33590 12 10 dense dense ADJ bracis-33590 12 11 models model NOUN bracis-33590 12 12 achieve achieve VERB bracis-33590 12 13 top top ADJ bracis-33590 12 14 positions position NOUN bracis-33590 12 15 on on ADP bracis-33590 12 16 leaderboards leaderboard NOUN bracis-33590 12 17 of of ADP bracis-33590 12 18 ir ir PROPN bracis-33590 12 19 benchmarks benchmark NOUN bracis-33590 12 20 and and CCONJ bracis-33590 12 21 competitions competition NOUN bracis-33590 12 22     SPACE bracis-33590 13 1 [ [ X bracis-33590 13 2 10,11,12 10,11,12 NUM bracis-33590 13 3 ] ] PUNCT bracis-33590 13 4 . . PUNCT bracis-33590 14 1 these these DET bracis-33590 14 2 large large ADJ bracis-33590 14 3 models model NOUN bracis-33590 14 4 leverage leverage VERB bracis-33590 14 5 increased increase VERB bracis-33590 14 6 representation representation NOUN bracis-33590 14 7 capacity capacity NOUN bracis-33590 14 8 , , PUNCT bracis-33590 14 9 enabling enable VERB bracis-33590 14 10 them they PRON bracis-33590 14 11 to to PART bracis-33590 14 12 encode encode VERB bracis-33590 14 13 features feature NOUN bracis-33590 14 14 that that PRON bracis-33590 14 15 might might AUX bracis-33590 14 16 elude elude VERB bracis-33590 14 17 smaller small ADJ bracis-33590 14 18 models model NOUN bracis-33590 14 19 . . PUNCT bracis-33590 15 1 however however ADV bracis-33590 15 2 , , PUNCT bracis-33590 15 3 deploying deploy VERB bracis-33590 15 4 these these DET bracis-33590 15 5 large large ADJ bracis-33590 15 6 models model NOUN bracis-33590 15 7 is be AUX bracis-33590 15 8 not not PART bracis-33590 15 9 without without ADP bracis-33590 15 10 its its PRON bracis-33590 15 11 challenges challenge NOUN bracis-33590 15 12 . . PUNCT bracis-33590 16 1 the the DET bracis-33590 16 2 computational computational ADJ bracis-33590 16 3 costs cost NOUN bracis-33590 16 4 are be AUX bracis-33590 16 5 substantial substantial ADJ bracis-33590 16 6 , , PUNCT bracis-33590 16 7 often often ADV bracis-33590 16 8 requiring require VERB bracis-33590 16 9 specialized specialized ADJ bracis-33590 16 10 hardware hardware NOUN bracis-33590 16 11 such such ADJ bracis-33590 16 12 as as ADP bracis-33590 16 13 gpus gpu NOUN bracis-33590 16 14 or or CCONJ bracis-33590 16 15 tpus tpus NOUN bracis-33590 16 16 to to PART bracis-33590 16 17 operate operate VERB bracis-33590 16 18 in in ADP bracis-33590 16 19 latency latency NOUN bracis-33590 16 20 - - PUNCT bracis-33590 16 21 critical critical ADJ bracis-33590 16 22 applications application NOUN bracis-33590 16 23 . . PUNCT bracis-33590 17 1 the the DET bracis-33590 17 2 high high ADJ bracis-33590 17 3 cost cost NOUN bracis-33590 17 4 is be AUX bracis-33590 17 5 directly directly ADV bracis-33590 17 6 related relate VERB bracis-33590 17 7 to to ADP bracis-33590 17 8 the the DET bracis-33590 17 9 large large ADJ bracis-33590 17 10 number number NOUN bracis-33590 17 11 of of ADP bracis-33590 17 12 parameters parameter NOUN bracis-33590 17 13 that that SCONJ bracis-33590 17 14 these these DET bracis-33590 17 15 models model NOUN bracis-33590 17 16 contain contain VERB bracis-33590 17 17 , , PUNCT bracis-33590 17 18 as as SCONJ bracis-33590 17 19 they they PRON bracis-33590 17 20 require require VERB bracis-33590 17 21 hardware hardware NOUN bracis-33590 17 22 with with ADP bracis-33590 17 23 high high ADJ bracis-33590 17 24 memory memory NOUN bracis-33590 17 25 and and CCONJ bracis-33590 17 26 compute compute NOUN bracis-33590 17 27 capacity capacity NOUN bracis-33590 17 28 and and CCONJ bracis-33590 17 29 because because SCONJ bracis-33590 17 30 the the DET bracis-33590 17 31 latency latency NOUN bracis-33590 17 32 scales scale VERB bracis-33590 17 33 almost almost ADV bracis-33590 17 34 linearly linearly ADV bracis-33590 17 35 with with ADP bracis-33590 17 36 the the DET bracis-33590 17 37 number number NOUN bracis-33590 17 38 of of ADP bracis-33590 17 39 parameters parameter NOUN bracis-33590 17 40 . . PUNCT bracis-33590 18 1 in in ADP bracis-33590 18 2 a a DET bracis-33590 18 3 production production NOUN bracis-33590 18 4 environment environment NOUN bracis-33590 18 5 , , PUNCT bracis-33590 18 6 this this PRON bracis-33590 18 7 means mean VERB bracis-33590 18 8 higher high ADJ bracis-33590 18 9 operating operating NOUN bracis-33590 18 10 costs cost NOUN bracis-33590 18 11 and and CCONJ bracis-33590 18 12 reduced reduced ADJ bracis-33590 18 13 scalability scalability NOUN bracis-33590 18 14 . . PUNCT bracis-33590 19 1 to to PART bracis-33590 19 2 address address VERB bracis-33590 19 3 these these DET bracis-33590 19 4 challenges challenge NOUN bracis-33590 19 5 , , PUNCT bracis-33590 19 6 there there PRON bracis-33590 19 7 have have AUX bracis-33590 19 8 been be AUX bracis-33590 19 9 efforts effort NOUN bracis-33590 19 10 to to PART bracis-33590 19 11 create create VERB bracis-33590 19 12 more more ADV bracis-33590 19 13 efficient efficient ADJ bracis-33590 19 14 models model NOUN bracis-33590 19 15 without without ADP bracis-33590 19 16 significantly significantly ADV bracis-33590 19 17 reducing reduce VERB bracis-33590 19 18 effectiveness effectiveness NOUN bracis-33590 19 19 . . PUNCT bracis-33590 20 1 one one NUM bracis-33590 20 2 such such ADJ bracis-33590 20 3 approach approach NOUN bracis-33590 20 4 is be AUX bracis-33590 20 5 model model NOUN bracis-33590 20 6 distillation distillation NOUN bracis-33590 20 7     SPACE bracis-33590 21 1 [ [ X bracis-33590 21 2 17 17 NUM bracis-33590 21 3 ] ] PUNCT bracis-33590 21 4 . . PUNCT bracis-33590 21 5 distilled distil VERB bracis-33590 21 6 models model NOUN bracis-33590 21 7 , , PUNCT bracis-33590 21 8 such such ADJ bracis-33590 21 9 as as ADP bracis-33590 21 10 minilm minilm NOUN bracis-33590 21 11     SPACE bracis-33590 21 12 [ [ X bracis-33590 21 13 32 32 NUM bracis-33590 21 14 ] ] PUNCT bracis-33590 21 15 , , PUNCT bracis-33590 21 16 use use VERB bracis-33590 21 17 a a DET bracis-33590 21 18 teacher teacher NOUN bracis-33590 21 19 or or CCONJ bracis-33590 21 20 an an DET bracis-33590 21 21 ensemble ensemble NOUN bracis-33590 21 22 of of ADP bracis-33590 21 23 larger large ADJ bracis-33590 21 24 models model NOUN bracis-33590 21 25 to to PART bracis-33590 21 26 transfer transfer VERB bracis-33590 21 27 knowledge knowledge NOUN bracis-33590 21 28 to to ADP bracis-33590 21 29 a a DET bracis-33590 21 30 smaller small ADJ bracis-33590 21 31 student student NOUN bracis-33590 21 32 model model NOUN bracis-33590 21 33 . . PUNCT bracis-33590 22 1 rosa rosa PROPN bracis-33590 22 2 et et PROPN bracis-33590 22 3 al al PROPN bracis-33590 22 4 . . PUNCT bracis-33590 23 1 [ [ X bracis-33590 23 2 30 30 NUM bracis-33590 23 3 ] ] PUNCT bracis-33590 23 4 show show VERB bracis-33590 23 5 that that DET bracis-33590 23 6 minilm minilm NOUN bracis-33590 23 7 surpassed surpass VERB bracis-33590 23 8 the the DET bracis-33590 23 9 zero zero NUM bracis-33590 23 10 - - PUNCT bracis-33590 23 11 shot shot NOUN bracis-33590 23 12 effectiveness effectiveness NOUN bracis-33590 23 13 of of ADP bracis-33590 23 14 monot5 monot5 NOUN bracis-33590 23 15 - - PUNCT bracis-33590 23 16 base base NOUN bracis-33590 23 17 , , PUNCT bracis-33590 23 18 which which PRON bracis-33590 23 19 is be AUX bracis-33590 23 20 a a DET bracis-33590 23 21 seq2seq seq2seq NOUN bracis-33590 23 22 model model NOUN bracis-33590 23 23 trained train VERB bracis-33590 23 24 for for ADP bracis-33590 23 25 binary binary ADJ bracis-33590 23 26 classification classification NOUN bracis-33590 23 27 , , PUNCT bracis-33590 23 28 in in ADP bracis-33590 23 29 ir ir PROPN bracis-33590 23 30 tasks task NOUN bracis-33590 23 31 despite despite SCONJ bracis-33590 23 32 being be AUX bracis-33590 23 33 an an DET bracis-33590 23 34 order order NOUN bracis-33590 23 35 of of ADP bracis-33590 23 36 magnitude magnitude NOUN bracis-33590 23 37 smaller small ADJ bracis-33590 23 38 in in ADP bracis-33590 23 39 size size NOUN bracis-33590 23 40 . . PUNCT bracis-33590 24 1 this this PRON bracis-33590 24 2 has have AUX bracis-33590 24 3 shown show VERB bracis-33590 24 4 that that SCONJ bracis-33590 24 5 knowledge knowledge NOUN bracis-33590 24 6 transfer transfer NOUN bracis-33590 24 7 via via ADP bracis-33590 24 8 model model NOUN bracis-33590 24 9 distillation distillation NOUN bracis-33590 24 10 is be AUX bracis-33590 24 11 not not PART bracis-33590 24 12 only only ADV bracis-33590 24 13 feasible feasible ADJ bracis-33590 24 14 but but CCONJ bracis-33590 24 15 also also ADV bracis-33590 24 16 effective effective ADJ bracis-33590 24 17 . . PUNCT bracis-33590 25 1 however however ADV bracis-33590 25 2 , , PUNCT bracis-33590 25 3 most most ADJ bracis-33590 25 4 distillation distillation NOUN bracis-33590 25 5 techniques technique NOUN bracis-33590 25 6 have have AUX bracis-33590 25 7 been be AUX bracis-33590 25 8 geared gear VERB bracis-33590 25 9 towards towards ADP bracis-33590 25 10 optimizing optimize VERB bracis-33590 25 11 effectiveness effectiveness NOUN bracis-33590 25 12 on on ADP bracis-33590 25 13 specific specific ADJ bracis-33590 25 14 benchmark benchmark NOUN bracis-33590 25 15 tasks task NOUN bracis-33590 25 16 and and CCONJ bracis-33590 25 17 do do AUX bracis-33590 25 18 not not PART bracis-33590 25 19 focus focus VERB bracis-33590 25 20 on on ADP bracis-33590 25 21 out out ADP bracis-33590 25 22 - - PUNCT bracis-33590 25 23 of of ADP bracis-33590 25 24 - - PUNCT bracis-33590 25 25 domain domain NOUN bracis-33590 25 26 effectiveness effectiveness NOUN bracis-33590 25 27 . . PUNCT bracis-33590 26 1 rosa rosa PROPN bracis-33590 26 2 et et PROPN bracis-33590 26 3 al al PROPN bracis-33590 26 4 . . PROPN bracis-33590 26 5 also also ADV bracis-33590 26 6 show show VERB bracis-33590 26 7 that that SCONJ bracis-33590 26 8 while while SCONJ bracis-33590 26 9 smaller small ADJ bracis-33590 26 10 models model NOUN bracis-33590 26 11 are be AUX bracis-33590 26 12 capable capable ADJ bracis-33590 26 13 of of ADP bracis-33590 26 14 achieving achieve VERB bracis-33590 26 15 high high ADJ bracis-33590 26 16 in in ADP bracis-33590 26 17 - - PUNCT bracis-33590 26 18 domain domain NOUN bracis-33590 26 19 results result NOUN bracis-33590 26 20 , , PUNCT bracis-33590 26 21 similar similar ADJ bracis-33590 26 22 to to ADP bracis-33590 26 23 their their PRON bracis-33590 26 24 larger large ADJ bracis-33590 26 25 counterparts counterpart NOUN bracis-33590 26 26 , , PUNCT bracis-33590 26 27 the the DET bracis-33590 26 28 disparity disparity NOUN bracis-33590 26 29 in in ADP bracis-33590 26 30 effectiveness effectiveness NOUN bracis-33590 26 31 becomes become VERB bracis-33590 26 32 evident evident ADJ bracis-33590 26 33 in in ADP bracis-33590 26 34 out out ADP bracis-33590 26 35 - - PUNCT bracis-33590 26 36 of of ADP bracis-33590 26 37 - - PUNCT bracis-33590 26 38 domain domain NOUN bracis-33590 26 39 scenarios scenario NOUN bracis-33590 26 40 . . PUNCT bracis-33590 27 1 as as SCONJ bracis-33590 27 2 the the DET bracis-33590 27 3 concept concept NOUN bracis-33590 27 4 of of ADP bracis-33590 27 5 out out ADV bracis-33590 27 6 - - PUNCT bracis-33590 27 7 of of ADP bracis-33590 27 8 - - PUNCT bracis-33590 27 9 domain domain NOUN bracis-33590 27 10 is be AUX bracis-33590 27 11 subjective subjective ADJ bracis-33590 27 12 , , PUNCT bracis-33590 27 13 we we PRON bracis-33590 27 14 define define VERB bracis-33590 27 15 it it PRON bracis-33590 27 16 as as ADP bracis-33590 27 17 a a DET bracis-33590 27 18 test test NOUN bracis-33590 27 19 distribution distribution NOUN bracis-33590 27 20 that that PRON bracis-33590 27 21 is be AUX bracis-33590 27 22 significantly significantly ADV bracis-33590 27 23 different different ADJ bracis-33590 27 24 from from ADP bracis-33590 27 25 the the DET bracis-33590 27 26 training training NOUN bracis-33590 27 27 distribution distribution NOUN bracis-33590 27 28 . . PUNCT bracis-33590 28 1 a a DET bracis-33590 28 2 straighforward straighforward ADJ bracis-33590 28 3 example example NOUN bracis-33590 28 4 of of ADP bracis-33590 28 5 a a DET bracis-33590 28 6 out out ADV bracis-33590 28 7 - - PUNCT bracis-33590 28 8 of of ADP bracis-33590 28 9 - - PUNCT bracis-33590 28 10 domain domain NOUN bracis-33590 28 11 scenario scenario NOUN bracis-33590 28 12 is be AUX bracis-33590 28 13 when when SCONJ bracis-33590 28 14 a a DET bracis-33590 28 15 model model NOUN bracis-33590 28 16 is be AUX bracis-33590 28 17 trained train VERB bracis-33590 28 18 on on ADP bracis-33590 28 19 chemistry chemistry NOUN bracis-33590 28 20 - - PUNCT bracis-33590 28 21 related relate VERB bracis-33590 28 22 data datum NOUN bracis-33590 28 23 and and CCONJ bracis-33590 28 24 tested test VERB bracis-33590 28 25 on on ADP bracis-33590 28 26 legal legal ADJ bracis-33590 28 27 data datum NOUN bracis-33590 28 28 . . PUNCT bracis-33590 29 1 however however ADV bracis-33590 29 2 , , PUNCT bracis-33590 29 3 we we PRON bracis-33590 29 4 recognize recognize VERB bracis-33590 29 5 that that SCONJ bracis-33590 29 6 this this DET bracis-33590 29 7 distinction distinction NOUN bracis-33590 29 8 blurs blur VERB bracis-33590 29 9 in in ADP bracis-33590 29 10 many many ADJ bracis-33590 29 11 scenarios scenario NOUN bracis-33590 29 12 . . PUNCT bracis-33590 30 1 fig fig NOUN bracis-33590 30 2 . . PUNCT bracis-33590 31 1 1 1 NUM bracis-33590 31 2 . . X bracis-33590 31 3 effectiveness effectiveness NOUN bracis-33590 31 4 on on ADP bracis-33590 31 5 the the DET bracis-33590 31 6 beir beir PROPN bracis-33590 31 7 benchmark benchmark NOUN bracis-33590 31 8     SPACE bracis-33590 32 1 [ [ X bracis-33590 32 2 31 31 NUM bracis-33590 32 3 ] ] PUNCT bracis-33590 32 4 . . PUNCT bracis-33590 33 1 all all DET bracis-33590 33 2 models model NOUN bracis-33590 33 3 are be AUX bracis-33590 33 4 based base VERB bracis-33590 33 5 on on ADP bracis-33590 33 6 monot5 monot5 PROPN bracis-33590 33 7     SPACE bracis-33590 34 1 [ [ X bracis-33590 34 2 25 25 NUM bracis-33590 34 3 ] ] PUNCT bracis-33590 34 4 , , PUNCT bracis-33590 34 5 applying apply VERB bracis-33590 34 6 different different ADJ bracis-33590 34 7 fine fine ADJ bracis-33590 34 8 - - PUNCT bracis-33590 34 9 tuning tune VERB bracis-33590 34 10 methods method NOUN bracis-33590 34 11 . . PUNCT bracis-33590 35 1 full full ADJ bracis-33590 35 2 size size NOUN bracis-33590 35 3 image image NOUN bracis-33590 35 4 usually usually ADV bracis-33590 35 5 , , PUNCT bracis-33590 35 6 training train VERB bracis-33590 35 7 a a DET bracis-33590 35 8 retrieval retrieval NOUN bracis-33590 35 9 model model NOUN bracis-33590 35 10 requires require VERB bracis-33590 35 11 human human NOUN bracis-33590 35 12 - - PUNCT bracis-33590 35 13 annotated annotate VERB bracis-33590 35 14 hard hard ADJ bracis-33590 35 15 labels label NOUN bracis-33590 35 16 informing inform VERB bracis-33590 35 17 which which DET bracis-33590 35 18 passage passage NOUN bracis-33590 35 19 is be AUX bracis-33590 35 20 relevant relevant ADJ bracis-33590 35 21 for for ADP bracis-33590 35 22 each each DET bracis-33590 35 23 query query NOUN bracis-33590 35 24 . . PUNCT bracis-33590 36 1 however however ADV bracis-33590 36 2 , , PUNCT bracis-33590 36 3 with with ADP bracis-33590 36 4 the the DET bracis-33590 36 5 advance advance NOUN bracis-33590 36 6 of of ADP bracis-33590 36 7 large large ADJ bracis-33590 36 8 language language NOUN bracis-33590 36 9 models model NOUN bracis-33590 36 10 ( ( PUNCT bracis-33590 36 11 llms llm NOUN bracis-33590 36 12 ) ) PUNCT bracis-33590 36 13 , , PUNCT bracis-33590 36 14 it it PRON bracis-33590 36 15 has have AUX bracis-33590 36 16 become become VERB bracis-33590 36 17 possible possible ADJ bracis-33590 36 18 to to PART bracis-33590 36 19 generate generate VERB bracis-33590 36 20 synthetic synthetic ADJ bracis-33590 36 21 queries query NOUN bracis-33590 36 22 for for ADP bracis-33590 36 23 passages passage NOUN bracis-33590 36 24 , , PUNCT bracis-33590 36 25 providing provide VERB bracis-33590 36 26 a a DET bracis-33590 36 27 feasible feasible ADJ bracis-33590 36 28 approach approach NOUN bracis-33590 36 29 for for ADP bracis-33590 36 30 data datum NOUN bracis-33590 36 31 augmentation augmentation NOUN bracis-33590 36 32     SPACE bracis-33590 37 1 [ [ X bracis-33590 37 2 1 1 NUM bracis-33590 37 3 , , PUNCT bracis-33590 37 4 2 2 NUM bracis-33590 37 5 , , PUNCT bracis-33590 37 6 4 4 NUM bracis-33590 37 7 , , PUNCT bracis-33590 37 8 19 19 NUM bracis-33590 37 9 , , PUNCT bracis-33590 37 10 26 26 NUM bracis-33590 37 11 ] ] PUNCT bracis-33590 37 12 . . PUNCT bracis-33590 38 1 our our PRON bracis-33590 38 2 work work NOUN bracis-33590 38 3 introduces introduce VERB bracis-33590 38 4 a a DET bracis-33590 38 5 method method NOUN bracis-33590 38 6 for for ADP bracis-33590 38 7 the the DET bracis-33590 38 8 generation generation NOUN bracis-33590 38 9 of of ADP bracis-33590 38 10 synthetic synthetic ADJ bracis-33590 38 11 data datum NOUN bracis-33590 38 12 specifically specifically ADV bracis-33590 38 13 designed design VERB bracis-33590 38 14 for for ADP bracis-33590 38 15 distilling distil VERB bracis-33590 38 16 rankers ranker NOUN bracis-33590 38 17 that that PRON bracis-33590 38 18 increases increase VERB bracis-33590 38 19 their their PRON bracis-33590 38 20 out out ADP bracis-33590 38 21 - - PUNCT bracis-33590 38 22 of of ADP bracis-33590 38 23 - - PUNCT bracis-33590 38 24 domain domain NOUN bracis-33590 38 25 effectiveness effectiveness NOUN bracis-33590 38 26 . . PUNCT bracis-33590 39 1 we we PRON bracis-33590 39 2 present present VERB bracis-33590 39 3 inranker inranker NOUN bracis-33590 39 4 , , PUNCT bracis-33590 39 5 a a DET bracis-33590 39 6 distilled distil VERB bracis-33590 39 7 model model NOUN bracis-33590 39 8 derived derive VERB bracis-33590 39 9 from from ADP bracis-33590 39 10 monot5 monot5 NOUN bracis-33590 39 11 - - PUNCT bracis-33590 39 12 3b 3b NOUN bracis-33590 39 13     SPACE bracis-33590 40 1 [ [ X bracis-33590 40 2 25 25 NUM bracis-33590 40 3 ] ] PUNCT bracis-33590 40 4 , , PUNCT bracis-33590 40 5 that that PRON bracis-33590 40 6 uses use VERB bracis-33590 40 7 the the DET bracis-33590 40 8 predictions prediction NOUN bracis-33590 40 9 of of ADP bracis-33590 40 10 the the DET bracis-33590 40 11 teacher teacher NOUN bracis-33590 40 12 directly directly ADV bracis-33590 40 13 with with ADP bracis-33590 40 14 both both CCONJ bracis-33590 40 15 synthetic synthetic NOUN bracis-33590 40 16 , , PUNCT bracis-33590 40 17 generated generate VERB bracis-33590 40 18 from from ADP bracis-33590 40 19 an an DET bracis-33590 40 20 out out ADV bracis-33590 40 21 - - PUNCT bracis-33590 40 22 of of ADP bracis-33590 40 23 - - PUNCT bracis-33590 40 24 domain domain NOUN bracis-33590 40 25 corpus corpus NOUN bracis-33590 40 26 , , PUNCT bracis-33590 40 27 and and CCONJ bracis-33590 40 28 real real ADJ bracis-33590 40 29 query query NOUN bracis-33590 40 30 - - PUNCT bracis-33590 40 31 document document NOUN bracis-33590 40 32 pairs pair NOUN bracis-33590 40 33 . . PUNCT bracis-33590 41 1 effectively effectively ADV bracis-33590 41 2 , , PUNCT bracis-33590 41 3 this this DET bracis-33590 41 4 approach approach NOUN bracis-33590 41 5 converts convert VERB bracis-33590 41 6 any any DET bracis-33590 41 7 corpus corpus NOUN bracis-33590 41 8 to to PART bracis-33590 41 9 be be AUX bracis-33590 41 10 in in ADP bracis-33590 41 11 - - PUNCT bracis-33590 41 12 domain domain NOUN bracis-33590 41 13 , , PUNCT bracis-33590 41 14 since since SCONJ bracis-33590 41 15 the the DET bracis-33590 41 16 model model NOUN bracis-33590 41 17 will will AUX bracis-33590 41 18 be be AUX bracis-33590 41 19 trained train VERB bracis-33590 41 20 using use VERB bracis-33590 41 21 queries query NOUN bracis-33590 41 22 from from ADP bracis-33590 41 23 the the DET bracis-33590 41 24 target target NOUN bracis-33590 41 25 domain domain NOUN bracis-33590 41 26 . . PUNCT bracis-33590 42 1 as as ADP bracis-33590 42 2 a a DET bracis-33590 42 3 result result NOUN bracis-33590 42 4 , , PUNCT bracis-33590 42 5 this this DET bracis-33590 42 6 approach approach NOUN bracis-33590 42 7 leads lead VERB bracis-33590 42 8 to to ADP bracis-33590 42 9 reduced reduced ADJ bracis-33590 42 10 model model NOUN bracis-33590 42 11 sizes size NOUN bracis-33590 42 12 while while SCONJ bracis-33590 42 13 maintaining maintain VERB bracis-33590 42 14 improved improve VERB bracis-33590 42 15 out out ADP bracis-33590 42 16 - - PUNCT bracis-33590 42 17 of of ADP bracis-33590 42 18 - - PUNCT bracis-33590 42 19 domain domain NOUN bracis-33590 42 20 effectiveness effectiveness NOUN bracis-33590 42 21 as as SCONJ bracis-33590 42 22 presented present VERB bracis-33590 42 23 in in ADP bracis-33590 42 24 fig fig NOUN bracis-33590 42 25 . . PUNCT bracis-33590 42 26     SPACE bracis-33590 43 1 1 1 X bracis-33590 43 2 . . PUNCT bracis-33590 44 1 the the DET bracis-33590 44 2 methodology methodology NOUN bracis-33590 44 3 , , PUNCT bracis-33590 44 4 results result NOUN bracis-33590 44 5 , , PUNCT bracis-33590 44 6 and and CCONJ bracis-33590 44 7 ablation ablation NOUN bracis-33590 44 8 experiments experiment NOUN bracis-33590 44 9 are be AUX bracis-33590 44 10 presented present VERB bracis-33590 44 11 in in ADP bracis-33590 44 12 detail detail NOUN bracis-33590 44 13 in in ADP bracis-33590 44 14 the the DET bracis-33590 44 15 following follow VERB bracis-33590 44 16 sections section NOUN bracis-33590 44 17 . . PUNCT bracis-33590 45 1 fig fig NOUN bracis-33590 45 2 . . PUNCT bracis-33590 46 1 2 2 X bracis-33590 46 2 . . X bracis-33590 46 3 pipeline pipeline NOUN bracis-33590 46 4 for for ADP bracis-33590 46 5 generating generate VERB bracis-33590 46 6 the the DET bracis-33590 46 7 synthetic synthetic ADJ bracis-33590 46 8 triples triple NOUN bracis-33590 46 9 < < NOUN bracis-33590 46 10 query query NOUN bracis-33590 46 11 , , PUNCT bracis-33590 46 12 passage passage NOUN bracis-33590 46 13 , , PUNCT bracis-33590 46 14 soft soft ADJ bracis-33590 46 15 label label NOUN bracis-33590 46 16 > > X bracis-33590 46 17 for for ADP bracis-33590 46 18 the the DET bracis-33590 46 19 inranker inranker PROPN bracis-33590 46 20 model model NOUN bracis-33590 46 21 . . PUNCT bracis-33590 47 1 full full ADJ bracis-33590 47 2 size size NOUN bracis-33590 47 3 image image NOUN bracis-33590 47 4 2 2 NUM bracis-33590 47 5 related relate VERB bracis-33590 47 6 work work NOUN bracis-33590 47 7 the the DET bracis-33590 47 8 research research NOUN bracis-33590 47 9 community community NOUN bracis-33590 47 10 has have AUX bracis-33590 47 11 been be AUX bracis-33590 47 12 using use VERB bracis-33590 47 13 llms llm NOUN bracis-33590 47 14 in in ADP bracis-33590 47 15 a a DET bracis-33590 47 16 variety variety NOUN bracis-33590 47 17 of of ADP bracis-33590 47 18 tasks task NOUN bracis-33590 47 19 aimed aim VERB bracis-33590 47 20 at at ADP bracis-33590 47 21 increasing increase VERB bracis-33590 47 22 the the DET bracis-33590 47 23 availability availability NOUN bracis-33590 47 24 of of ADP bracis-33590 47 25 data datum NOUN bracis-33590 47 26 and and CCONJ bracis-33590 47 27 improving improve VERB bracis-33590 47 28 the the DET bracis-33590 47 29 effectiveness effectiveness NOUN bracis-33590 47 30 of of ADP bracis-33590 47 31 existing exist VERB bracis-33590 47 32 systems system NOUN bracis-33590 47 33 . . PUNCT bracis-33590 48 1 magister magister NOUN bracis-33590 48 2 et et PROPN bracis-33590 48 3 al al PROPN bracis-33590 48 4 . . PUNCT bracis-33590 49 1 [ [ X bracis-33590 49 2 20 20 NUM bracis-33590 49 3 ] ] PUNCT bracis-33590 49 4 employed employ VERB bracis-33590 49 5 synthetic synthetic ADJ bracis-33590 49 6 text text NOUN bracis-33590 49 7 generated generate VERB bracis-33590 49 8 by by ADP bracis-33590 49 9 palm palm NOUN bracis-33590 49 10 540b 540b PROPN bracis-33590 49 11     SPACE bracis-33590 50 1 [ [ X bracis-33590 50 2 8 8 NUM bracis-33590 50 3 ] ] PUNCT bracis-33590 50 4 and and CCONJ bracis-33590 50 5 gpt-3 gpt-3 NUM bracis-33590 50 6 175b 175b NOUN bracis-33590 50 7     SPACE bracis-33590 51 1 [ [ X bracis-33590 51 2 5 5 NUM bracis-33590 51 3 ] ] PUNCT bracis-33590 51 4 to to PART bracis-33590 51 5 transfer transfer VERB bracis-33590 51 6 knowledge knowledge NOUN bracis-33590 51 7 to to ADP bracis-33590 51 8 smaller small ADJ bracis-33590 51 9 models model NOUN bracis-33590 51 10 such such ADJ bracis-33590 51 11 as as ADP bracis-33590 51 12 t5 t5 PROPN bracis-33590 51 13 . . PUNCT bracis-33590 52 1 fu fu PROPN bracis-33590 52 2 et et PROPN bracis-33590 52 3 al al PROPN bracis-33590 52 4 . . PUNCT bracis-33590 53 1 [ [ X bracis-33590 53 2 15 15 NUM bracis-33590 53 3 ] ] PUNCT bracis-33590 53 4 successfully successfully ADV bracis-33590 53 5 specialized specialized ADJ bracis-33590 53 6 student student NOUN bracis-33590 53 7 models model NOUN bracis-33590 53 8 in in ADP bracis-33590 53 9 multi multi ADJ bracis-33590 53 10 - - ADJ bracis-33590 53 11 step step ADJ bracis-33590 53 12 reasoning reasoning NOUN bracis-33590 53 13 using use VERB bracis-33590 53 14 flant5 flant5 NOUN bracis-33590 53 15     SPACE bracis-33590 54 1 [ [ X bracis-33590 54 2 9 9 NUM bracis-33590 54 3 ] ] PUNCT bracis-33590 54 4 and and CCONJ bracis-33590 54 5 code code NOUN bracis-33590 54 6 - - PUNCT bracis-33590 54 7 davinci-002 davinci-002 NOUN bracis-33590 54 8 as as ADP bracis-33590 54 9 teachers teacher NOUN bracis-33590 54 10 . . PUNCT bracis-33590 55 1 however however ADV bracis-33590 55 2 , , PUNCT bracis-33590 55 3 all all DET bracis-33590 55 4 these these DET bracis-33590 55 5 works work NOUN bracis-33590 55 6 rely rely VERB bracis-33590 55 7 on on ADP bracis-33590 55 8 training train VERB bracis-33590 55 9 the the DET bracis-33590 55 10 student student NOUN bracis-33590 55 11 models model NOUN bracis-33590 55 12 using use VERB bracis-33590 55 13 synthetic synthetic ADJ bracis-33590 55 14 text text NOUN bracis-33590 55 15 rather rather ADV bracis-33590 55 16 than than ADP bracis-33590 55 17 directly directly ADV bracis-33590 55 18 using use VERB bracis-33590 55 19 the the DET bracis-33590 55 20 soft soft ADJ bracis-33590 55 21 labels label NOUN bracis-33590 55 22 . . PUNCT bracis-33590 56 1 furthermore furthermore ADV bracis-33590 56 2 , , PUNCT bracis-33590 56 3 muhamed muhamed PROPN bracis-33590 56 4 et et PROPN bracis-33590 56 5 al al PROPN bracis-33590 56 6 . . PUNCT bracis-33590 57 1 [ [ X bracis-33590 57 2 21 21 NUM bracis-33590 57 3 ] ] X bracis-33590 57 4 distilled distil VERB bracis-33590 57 5 cross cross ADJ bracis-33590 57 6 - - ADJ bracis-33590 57 7 attention attention ADJ bracis-33590 57 8 scores score NOUN bracis-33590 57 9 of of ADP bracis-33590 57 10 a a DET bracis-33590 57 11 language language NOUN bracis-33590 57 12 model model NOUN bracis-33590 57 13 for for ADP bracis-33590 57 14 click click VERB bracis-33590 57 15 - - PUNCT bracis-33590 57 16 through through ADP bracis-33590 57 17 - - PUNCT bracis-33590 57 18 rate rate NOUN bracis-33590 57 19 prediction prediction NOUN bracis-33590 57 20 , , PUNCT bracis-33590 57 21 achieving achieve VERB bracis-33590 57 22 better well ADJ bracis-33590 57 23 results result NOUN bracis-33590 57 24 when when SCONJ bracis-33590 57 25 exposed expose VERB bracis-33590 57 26 to to ADP bracis-33590 57 27 contextual contextual ADJ bracis-33590 57 28 features feature NOUN bracis-33590 57 29 such such ADJ bracis-33590 57 30 as as ADP bracis-33590 57 31 tabular tabular PROPN bracis-33590 57 32 data datum NOUN bracis-33590 57 33 . . PUNCT bracis-33590 58 1 wang wang PROPN bracis-33590 58 2 et et PROPN bracis-33590 58 3 al al PROPN bracis-33590 58 4 . . PUNCT bracis-33590 59 1 [ [ X bracis-33590 59 2 32 32 NUM bracis-33590 59 3 ] ] PUNCT bracis-33590 59 4 distilled distil VERB bracis-33590 59 5 the the DET bracis-33590 59 6 self self NOUN bracis-33590 59 7 - - PUNCT bracis-33590 59 8 attention attention NOUN bracis-33590 59 9 module module NOUN bracis-33590 59 10 , , PUNCT bracis-33590 59 11 which which PRON bracis-33590 59 12 is be AUX bracis-33590 59 13 a a DET bracis-33590 59 14 crucial crucial ADJ bracis-33590 59 15 part part NOUN bracis-33590 59 16 of of ADP bracis-33590 59 17 transformers transformer NOUN bracis-33590 59 18 , , PUNCT bracis-33590 59 19 and and CCONJ bracis-33590 59 20 successfully successfully ADV bracis-33590 59 21 transferred transfer VERB bracis-33590 59 22 knowledge knowledge NOUN bracis-33590 59 23 to to ADP bracis-33590 59 24 a a DET bracis-33590 59 25 variety variety NOUN bracis-33590 59 26 of of ADP bracis-33590 59 27 tasks task NOUN bracis-33590 59 28 . . PUNCT bracis-33590 60 1 previous previous ADJ bracis-33590 60 2 studies study NOUN bracis-33590 60 3 have have AUX bracis-33590 60 4 also also ADV bracis-33590 60 5 explored explore VERB bracis-33590 60 6 training training NOUN bracis-33590 60 7 a a DET bracis-33590 60 8 student student NOUN bracis-33590 60 9 from from ADP bracis-33590 60 10 soft soft ADJ bracis-33590 60 11 labels label NOUN bracis-33590 60 12 produced produce VERB bracis-33590 60 13 by by ADP bracis-33590 60 14 a a DET bracis-33590 60 15 teacher teacher NOUN bracis-33590 60 16 : : PUNCT bracis-33590 60 17 hofstätter hofstätter NOUN bracis-33590 60 18 et et PROPN bracis-33590 60 19 al al PROPN bracis-33590 60 20 . . PUNCT bracis-33590 61 1 [ [ X bracis-33590 61 2 18 18 NUM bracis-33590 61 3 ] ] PUNCT bracis-33590 61 4 proposed propose VERB bracis-33590 61 5 a a DET bracis-33590 61 6 cross cross ADJ bracis-33590 61 7 - - ADJ bracis-33590 61 8 architecture architecture ADJ bracis-33590 61 9 knowledge knowledge NOUN bracis-33590 61 10 distillation distillation NOUN bracis-33590 61 11 approach approach NOUN bracis-33590 61 12 using use VERB bracis-33590 61 13 the the DET bracis-33590 61 14 marginmse marginmse ADJ bracis-33590 61 15 loss loss NOUN bracis-33590 61 16 . . PUNCT bracis-33590 62 1 similarly similarly ADV bracis-33590 62 2 , , PUNCT bracis-33590 62 3 formal formal ADJ bracis-33590 62 4 et et PROPN bracis-33590 62 5 al al PROPN bracis-33590 62 6 . . PUNCT bracis-33590 63 1 [ [ X bracis-33590 63 2 14 14 NUM bracis-33590 63 3 ] ] PUNCT bracis-33590 63 4 used use VERB bracis-33590 63 5 the the DET bracis-33590 63 6 marginmse marginmse ADJ bracis-33590 63 7 loss loss NOUN bracis-33590 63 8 to to PART bracis-33590 63 9 distill distill VERB bracis-33590 63 10 knowledge knowledge NOUN bracis-33590 63 11 to to PART bracis-33590 63 12 sparse sparse VERB bracis-33590 63 13 neural neural ADJ bracis-33590 63 14 models model NOUN bracis-33590 63 15 . . PUNCT bracis-33590 64 1 finally finally ADV bracis-33590 64 2 , , PUNCT bracis-33590 64 3 hashemi hashemi PROPN bracis-33590 64 4 et et PROPN bracis-33590 64 5 al al PROPN bracis-33590 64 6 . . PUNCT bracis-33590 65 1 [ [ X bracis-33590 65 2 16 16 NUM bracis-33590 65 3 ] ] PUNCT bracis-33590 65 4 proposed propose VERB bracis-33590 65 5 a a DET bracis-33590 65 6 method method NOUN bracis-33590 65 7 for for ADP bracis-33590 65 8 generating generate VERB bracis-33590 65 9 synthetic synthetic ADJ bracis-33590 65 10 data datum NOUN bracis-33590 65 11 for for ADP bracis-33590 65 12 domain domain NOUN bracis-33590 65 13 adaptation adaptation NOUN bracis-33590 65 14 of of ADP bracis-33590 65 15 dense dense ADJ bracis-33590 65 16 passage passage NOUN bracis-33590 65 17 retrievers retriever NOUN bracis-33590 65 18 . . PUNCT bracis-33590 66 1 this this DET bracis-33590 66 2 approach approach NOUN bracis-33590 66 3 involves involve VERB bracis-33590 66 4 creating create VERB bracis-33590 66 5 new new ADJ bracis-33590 66 6 queries query NOUN bracis-33590 66 7 and and CCONJ bracis-33590 66 8 a a DET bracis-33590 66 9 target target NOUN bracis-33590 66 10 collection collection NOUN bracis-33590 66 11 , , PUNCT bracis-33590 66 12 along along ADP bracis-33590 66 13 with with ADP bracis-33590 66 14 pseudo pseudo NOUN bracis-33590 66 15 - - NOUN bracis-33590 66 16 labels label NOUN bracis-33590 66 17 extracted extract VERB bracis-33590 66 18 using use VERB bracis-33590 66 19 a a DET bracis-33590 66 20 bert bert NOUN bracis-33590 66 21 cross cross NOUN bracis-33590 66 22 - - NOUN bracis-33590 66 23 encoder encoder NOUN bracis-33590 66 24 . . PUNCT bracis-33590 67 1 however however ADV bracis-33590 67 2 , , PUNCT bracis-33590 67 3 they they PRON bracis-33590 67 4 did do AUX bracis-33590 67 5 not not PART bracis-33590 67 6 evaluate evaluate VERB bracis-33590 67 7 the the DET bracis-33590 67 8 model model NOUN bracis-33590 67 9 ’s ’s PART bracis-33590 67 10 effectiveness effectiveness NOUN bracis-33590 67 11 on on ADP bracis-33590 67 12 datasets dataset NOUN bracis-33590 67 13 to to PART bracis-33590 67 14 which which PRON bracis-33590 67 15 it it PRON bracis-33590 67 16 was be AUX bracis-33590 67 17 not not PART bracis-33590 67 18 domain domain NOUN bracis-33590 67 19 - - PUNCT bracis-33590 67 20 adapted adapt VERB bracis-33590 67 21 . . PUNCT bracis-33590 68 1 the the DET bracis-33590 68 2 existing exist VERB bracis-33590 68 3 research research NOUN bracis-33590 68 4 has have AUX bracis-33590 68 5 mainly mainly ADV bracis-33590 68 6 focused focus VERB bracis-33590 68 7 on on ADP bracis-33590 68 8 in in ADP bracis-33590 68 9 - - PUNCT bracis-33590 68 10 domain domain NOUN bracis-33590 68 11 evaluation evaluation NOUN bracis-33590 68 12 , , PUNCT bracis-33590 68 13 where where SCONJ bracis-33590 68 14 the the DET bracis-33590 68 15 goal goal NOUN bracis-33590 68 16 has have AUX bracis-33590 68 17 been be AUX bracis-33590 68 18 to to PART bracis-33590 68 19 increase increase VERB bracis-33590 68 20 the the DET bracis-33590 68 21 effectiveness effectiveness NOUN bracis-33590 68 22 of of ADP bracis-33590 68 23 the the DET bracis-33590 68 24 student student NOUN bracis-33590 68 25 model model NOUN bracis-33590 68 26 on on ADP bracis-33590 68 27 test test NOUN bracis-33590 68 28 datasets dataset NOUN bracis-33590 68 29 whose whose DET bracis-33590 68 30 domain domain NOUN bracis-33590 68 31 is be AUX bracis-33590 68 32 similar similar ADJ bracis-33590 68 33 to to ADP bracis-33590 68 34 the the DET bracis-33590 68 35 datasets dataset NOUN bracis-33590 68 36 it it PRON bracis-33590 68 37 was be AUX bracis-33590 68 38 trained train VERB bracis-33590 68 39 on on ADP bracis-33590 68 40 . . PUNCT bracis-33590 69 1 our our PRON bracis-33590 69 2 study study NOUN bracis-33590 69 3 also also ADV bracis-33590 69 4 focuses focus VERB bracis-33590 69 5 on on ADP bracis-33590 69 6 the the DET bracis-33590 69 7 robustness robustness NOUN bracis-33590 69 8 of of ADP bracis-33590 69 9 the the DET bracis-33590 69 10 student student NOUN bracis-33590 69 11 and and CCONJ bracis-33590 69 12 its its PRON bracis-33590 69 13 ability ability NOUN bracis-33590 69 14 to to PART bracis-33590 69 15 perform perform VERB bracis-33590 69 16 well well ADV bracis-33590 69 17 even even ADV bracis-33590 69 18 in in ADP bracis-33590 69 19 out out ADP bracis-33590 69 20 - - PUNCT bracis-33590 69 21 of of ADP bracis-33590 69 22 - - PUNCT bracis-33590 69 23 domain domain NOUN bracis-33590 69 24 scenarios scenario NOUN bracis-33590 69 25 , , PUNCT bracis-33590 69 26 similar similar ADJ bracis-33590 69 27 to to ADP bracis-33590 69 28 the the DET bracis-33590 69 29 abilities ability NOUN bracis-33590 69 30 of of ADP bracis-33590 69 31 the the DET bracis-33590 69 32 larger large ADJ bracis-33590 69 33 teacher teacher NOUN bracis-33590 69 34 model model NOUN bracis-33590 69 35 . . PUNCT bracis-33590 70 1 3 3 NUM bracis-33590 70 2 methodology methodology NOUN bracis-33590 70 3 our our PRON bracis-33590 70 4 proposed propose VERB bracis-33590 70 5 method method NOUN bracis-33590 70 6 consists consist VERB bracis-33590 70 7 of of ADP bracis-33590 70 8 two two NUM bracis-33590 70 9 key key ADJ bracis-33590 70 10 phases phase NOUN bracis-33590 70 11 of of ADP bracis-33590 70 12 distillation distillation NOUN bracis-33590 70 13 , , PUNCT bracis-33590 70 14 each each PRON bracis-33590 70 15 designed design VERB bracis-33590 70 16 with with ADP bracis-33590 70 17 specific specific ADJ bracis-33590 70 18 objectives objective NOUN bracis-33590 70 19 to to PART bracis-33590 70 20 maximize maximize VERB bracis-33590 70 21 the the DET bracis-33590 70 22 model model NOUN bracis-33590 70 23 ’s ’s PART bracis-33590 70 24 zero zero NUM bracis-33590 70 25 - - PUNCT bracis-33590 70 26 shot shot NOUN bracis-33590 70 27 effectiveness effectiveness NOUN bracis-33590 70 28 . . PUNCT bracis-33590 71 1 the the DET bracis-33590 71 2 first first ADJ bracis-33590 71 3 phase phase NOUN bracis-33590 71 4 uses use VERB bracis-33590 71 5 real real ADJ bracis-33590 71 6 - - PUNCT bracis-33590 71 7 world world NOUN bracis-33590 71 8 data datum NOUN bracis-33590 71 9 to to PART bracis-33590 71 10 familiarize familiarize VERB bracis-33590 71 11 the the DET bracis-33590 71 12 student student NOUN bracis-33590 71 13 model model NOUN bracis-33590 71 14 with with ADP bracis-33590 71 15 the the DET bracis-33590 71 16 ranking ranking ADJ bracis-33590 71 17 task task NOUN bracis-33590 71 18 , , PUNCT bracis-33590 71 19 while while SCONJ bracis-33590 71 20 the the DET bracis-33590 71 21 second second ADJ bracis-33590 71 22 phase phase NOUN bracis-33590 71 23 uses use VERB bracis-33590 71 24 synthetic synthetic ADJ bracis-33590 71 25 data datum NOUN bracis-33590 71 26 designed design VERB bracis-33590 71 27 to to PART bracis-33590 71 28 improve improve VERB bracis-33590 71 29 zero zero NUM bracis-33590 71 30 - - PUNCT bracis-33590 71 31 shot shot NOUN bracis-33590 71 32 generalization generalization NOUN bracis-33590 71 33 and and CCONJ bracis-33590 71 34 improve improve VERB bracis-33590 71 35 the the DET bracis-33590 71 36 model model NOUN bracis-33590 71 37 ’s ’s PART bracis-33590 71 38 effectiveness effectiveness NOUN bracis-33590 71 39 on on ADP bracis-33590 71 40 a a DET bracis-33590 71 41 specific specific ADJ bracis-33590 71 42 dataset dataset NOUN bracis-33590 71 43 . . PUNCT bracis-33590 72 1 the the DET bracis-33590 72 2 dataset dataset NOUN bracis-33590 72 3 used use VERB bracis-33590 72 4 to to PART bracis-33590 72 5 distill distill VERB bracis-33590 72 6 inranker inranker NOUN bracis-33590 72 7 consists consist VERB bracis-33590 72 8 of of ADP bracis-33590 72 9 { { PUNCT bracis-33590 72 10 query query NOUN bracis-33590 72 11 , , PUNCT bracis-33590 72 12 passage passage NOUN bracis-33590 72 13 , , PUNCT bracis-33590 72 14 logits logit NOUN bracis-33590 72 15 } } PUNCT bracis-33590 72 16 triplets triplet NOUN bracis-33590 72 17 , , PUNCT bracis-33590 72 18 where where SCONJ bracis-33590 72 19 the the DET bracis-33590 72 20 logits logit NOUN bracis-33590 72 21 ( ( PUNCT bracis-33590 72 22 soft soft ADJ bracis-33590 72 23 labels label NOUN bracis-33590 72 24 ) ) PUNCT bracis-33590 72 25 originate originate VERB bracis-33590 72 26 from from ADP bracis-33590 72 27 a a DET bracis-33590 72 28 teacher teacher NOUN bracis-33590 72 29 model model NOUN bracis-33590 72 30 that that PRON bracis-33590 72 31 has have AUX bracis-33590 72 32 been be AUX bracis-33590 72 33 trained train VERB bracis-33590 72 34 for for ADP bracis-33590 72 35 the the DET bracis-33590 72 36 relevance relevance NOUN bracis-33590 72 37 task task NOUN bracis-33590 72 38 . . PUNCT bracis-33590 73 1 for for ADP bracis-33590 73 2 the the DET bracis-33590 73 3 first first ADJ bracis-33590 73 4 stage stage NOUN bracis-33590 73 5 , , PUNCT bracis-33590 73 6 we we PRON bracis-33590 73 7 chose choose VERB bracis-33590 73 8 to to PART bracis-33590 73 9 use use VERB bracis-33590 73 10 query query NOUN bracis-33590 73 11 - - PUNCT bracis-33590 73 12 document document NOUN bracis-33590 73 13 pairs pair NOUN bracis-33590 73 14 from from ADP bracis-33590 73 15 the the DET bracis-33590 73 16 ms ms PROPN bracis-33590 73 17 marco marco PROPN bracis-33590 73 18     SPACE bracis-33590 74 1 [ [ X bracis-33590 74 2 23 23 NUM bracis-33590 74 3 ] ] PUNCT bracis-33590 74 4 dataset dataset NOUN bracis-33590 74 5 , , PUNCT bracis-33590 74 6 given give VERB bracis-33590 74 7 their their PRON bracis-33590 74 8 variety variety NOUN bracis-33590 74 9 , , PUNCT bracis-33590 74 10 the the DET bracis-33590 74 11 large large ADJ bracis-33590 74 12 number number NOUN bracis-33590 74 13 of of ADP bracis-33590 74 14 annotated annotated ADJ bracis-33590 74 15 pairs pair NOUN bracis-33590 74 16 , , PUNCT bracis-33590 74 17 and and CCONJ bracis-33590 74 18 its its PRON bracis-33590 74 19 demonstrated demonstrate VERB bracis-33590 74 20 effectiveness effectiveness NOUN bracis-33590 74 21 in in ADP bracis-33590 74 22 enhancing enhance VERB bracis-33590 74 23 retrieval retrieval NOUN bracis-33590 74 24 effectiveness effectiveness NOUN bracis-33590 74 25     SPACE bracis-33590 75 1 [ [ X bracis-33590 75 2 29 29 NUM bracis-33590 75 3 ] ] PUNCT bracis-33590 75 4 . . PUNCT bracis-33590 76 1 next next ADV bracis-33590 76 2 , , PUNCT bracis-33590 76 3 we we PRON bracis-33590 76 4 source source VERB bracis-33590 76 5 the the DET bracis-33590 76 6 synthetic synthetic ADJ bracis-33590 76 7 queries query NOUN bracis-33590 76 8 from from ADP bracis-33590 76 9 inpars inpar NOUN bracis-33590 76 10     SPACE bracis-33590 77 1 [ [ X bracis-33590 77 2 2 2 NUM bracis-33590 77 3 ] ] PUNCT bracis-33590 77 4 , , PUNCT bracis-33590 77 5 which which PRON bracis-33590 77 6 used use VERB bracis-33590 77 7 an an DET bracis-33590 77 8 llm llm NOUN bracis-33590 77 9 to to PART bracis-33590 77 10 generate generate VERB bracis-33590 77 11 queries query NOUN bracis-33590 77 12 for for ADP bracis-33590 77 13 the the DET bracis-33590 77 14 datasets dataset NOUN bracis-33590 77 15 in in ADP bracis-33590 77 16 beir beir PROPN bracis-33590 77 17 in in ADP bracis-33590 77 18 a a DET bracis-33590 77 19 few few ADJ bracis-33590 77 20 - - PUNCT bracis-33590 77 21 shot shot NOUN bracis-33590 77 22 manner manner NOUN bracis-33590 77 23 . . PUNCT bracis-33590 78 1 distilling distil VERB bracis-33590 78 2 rerankers reranker NOUN bracis-33590 78 3 involves involve VERB bracis-33590 78 4 using use VERB bracis-33590 78 5 the the DET bracis-33590 78 6 mean mean ADJ bracis-33590 78 7 squared square VERB bracis-33590 78 8 error error NOUN bracis-33590 78 9 ( ( PUNCT bracis-33590 78 10 mse mse NOUN bracis-33590 78 11 ) ) PUNCT bracis-33590 78 12 loss loss NOUN bracis-33590 78 13 to to PART bracis-33590 78 14 match match VERB bracis-33590 78 15 the the DET bracis-33590 78 16 logits logit NOUN bracis-33590 78 17 of of ADP bracis-33590 78 18 the the DET bracis-33590 78 19 teacher teacher NOUN bracis-33590 78 20 and and CCONJ bracis-33590 78 21 the the DET bracis-33590 78 22 student student NOUN bracis-33590 78 23 , , PUNCT bracis-33590 78 24 as as ADP bracis-33590 78 25 part part NOUN bracis-33590 78 26 of of ADP bracis-33590 78 27 a a DET bracis-33590 78 28 two two NUM bracis-33590 78 29 - - PUNCT bracis-33590 78 30 phase phase NOUN bracis-33590 78 31 pipeline pipeline NOUN bracis-33590 78 32 illustrated illustrate VERB bracis-33590 78 33 in in ADP bracis-33590 78 34 fig fig NOUN bracis-33590 78 35 . . PUNCT bracis-33590 78 36     SPACE bracis-33590 79 1 2 2 X bracis-33590 79 2 . . PUNCT bracis-33590 79 3 the the DET bracis-33590 79 4 first first ADJ bracis-33590 79 5 phase phase NOUN bracis-33590 79 6 consists consist VERB bracis-33590 79 7 of of ADP bracis-33590 79 8 two two NUM bracis-33590 79 9 steps step NOUN bracis-33590 79 10 : : PUNCT bracis-33590 79 11 ( ( PUNCT bracis-33590 79 12 1 1 X bracis-33590 79 13 ) ) PUNCT bracis-33590 79 14 generating generate VERB bracis-33590 79 15 the the DET bracis-33590 79 16 teacher teacher NOUN bracis-33590 79 17 logits logit NOUN bracis-33590 79 18 given give VERB bracis-33590 79 19 a a DET bracis-33590 79 20 query query NOUN bracis-33590 79 21 and and CCONJ bracis-33590 79 22 either either CCONJ bracis-33590 79 23 a a DET bracis-33590 79 24 positive positive ADJ bracis-33590 79 25 ( ( PUNCT bracis-33590 79 26 relevant relevant ADJ bracis-33590 79 27 ) ) PUNCT bracis-33590 79 28 or or CCONJ bracis-33590 79 29 a a DET bracis-33590 79 30 negative negative ADJ bracis-33590 79 31 ( ( PUNCT bracis-33590 79 32 non non ADJ bracis-33590 79 33 - - ADJ bracis-33590 79 34 relevant relevant ADJ bracis-33590 79 35 ) ) PUNCT bracis-33590 79 36 passage passage NOUN bracis-33590 79 37 , , PUNCT bracis-33590 79 38 where where SCONJ bracis-33590 79 39 the the DET bracis-33590 79 40 negatives negative NOUN bracis-33590 79 41 are be AUX bracis-33590 79 42 randomly randomly ADV bracis-33590 79 43 sampled sample VERB bracis-33590 79 44 using use VERB bracis-33590 79 45 bm25 bm25 PROPN bracis-33590 79 46 on on ADP bracis-33590 79 47 the the DET bracis-33590 79 48 top-\(k=1000\ top-\(k=1000\ PROPN bracis-33590 79 49 ) ) PUNCT bracis-33590 79 50 candidates candidate NOUN bracis-33590 79 51 , , PUNCT bracis-33590 79 52 and and CCONJ bracis-33590 79 53 the the DET bracis-33590 79 54 positives positive NOUN bracis-33590 79 55 are be AUX bracis-33590 79 56 sampled sample VERB bracis-33590 79 57 from from ADP bracis-33590 79 58 the the DET bracis-33590 79 59 human human NOUN bracis-33590 79 60 - - PUNCT bracis-33590 79 61 annotated annotate VERB bracis-33590 79 62 pairs pair NOUN bracis-33590 79 63 ; ; PUNCT bracis-33590 79 64 and and CCONJ bracis-33590 79 65 ( ( PUNCT bracis-33590 79 66 2 2 X bracis-33590 79 67 ) ) PUNCT bracis-33590 79 68 training training NOUN bracis-33590 79 69 inranker inranker NOUN bracis-33590 79 70 given give VERB bracis-33590 79 71 the the DET bracis-33590 79 72 queries query NOUN bracis-33590 79 73 and and CCONJ bracis-33590 79 74 passages passage NOUN bracis-33590 79 75 as as ADP bracis-33590 79 76 input input NOUN bracis-33590 79 77 using use VERB bracis-33590 79 78 the the DET bracis-33590 79 79 mse mse NOUN bracis-33590 79 80 loss loss NOUN bracis-33590 79 81 to to PART bracis-33590 79 82 match match VERB bracis-33590 79 83 the the DET bracis-33590 79 84 student student NOUN bracis-33590 79 85 logits logit NOUN bracis-33590 79 86 to to ADP bracis-33590 79 87 those those PRON bracis-33590 79 88 of of ADP bracis-33590 79 89 the the DET bracis-33590 79 90 teacher teacher NOUN bracis-33590 79 91 , , PUNCT bracis-33590 79 92 who who PRON bracis-33590 79 93 remains remain VERB bracis-33590 79 94 frozen frozen ADJ bracis-33590 79 95 during during ADP bracis-33590 79 96 training training NOUN bracis-33590 79 97 . . PUNCT bracis-33590 80 1 this this DET bracis-33590 80 2 approach approach NOUN bracis-33590 80 3 can can AUX bracis-33590 80 4 be be AUX bracis-33590 80 5 beneficial beneficial ADJ bracis-33590 80 6 as as SCONJ bracis-33590 80 7 it it PRON bracis-33590 80 8 removes remove VERB bracis-33590 80 9 the the DET bracis-33590 80 10 need need NOUN bracis-33590 80 11 for for ADP bracis-33590 80 12 making make VERB bracis-33590 80 13 hard hard ADJ bracis-33590 80 14 decisions decision NOUN bracis-33590 80 15 about about ADP bracis-33590 80 16 a a DET bracis-33590 80 17 passage passage NOUN bracis-33590 80 18 ’s ’s PART bracis-33590 80 19 relevance relevance NOUN bracis-33590 80 20 , , PUNCT bracis-33590 80 21 i.e. i.e. X bracis-33590 80 22 determining determine VERB bracis-33590 80 23 a a DET bracis-33590 80 24 threshold threshold NOUN bracis-33590 80 25 to to PART bracis-33590 80 26 obtain obtain VERB bracis-33590 80 27 binary binary ADJ bracis-33590 80 28 relevance relevance NOUN bracis-33590 80 29 labels label NOUN bracis-33590 80 30 , , PUNCT bracis-33590 80 31 and and CCONJ bracis-33590 80 32 instead instead ADV bracis-33590 80 33 focuses focus VERB bracis-33590 80 34 on on ADP bracis-33590 80 35 a a DET bracis-33590 80 36 soft soft ADJ bracis-33590 80 37 target target NOUN bracis-33590 80 38 objective objective NOUN bracis-33590 80 39 aimed aim VERB bracis-33590 80 40 at at ADP bracis-33590 80 41 aligning align VERB bracis-33590 80 42 the the DET bracis-33590 80 43 student student NOUN bracis-33590 80 44 ’s ’s PART bracis-33590 80 45 perception perception NOUN bracis-33590 80 46 of of ADP bracis-33590 80 47 relevance relevance NOUN bracis-33590 80 48 with with ADP bracis-33590 80 49 that that PRON bracis-33590 80 50 of of ADP bracis-33590 80 51 the the DET bracis-33590 80 52 teacher teacher NOUN bracis-33590 80 53 . . PUNCT bracis-33590 81 1 the the DET bracis-33590 81 2 second second ADJ bracis-33590 81 3 phase phase NOUN bracis-33590 81 4 , , PUNCT bracis-33590 81 5 with with ADP bracis-33590 81 6 a a DET bracis-33590 81 7 focus focus NOUN bracis-33590 81 8 on on ADP bracis-33590 81 9 zero zero NUM bracis-33590 81 10 - - PUNCT bracis-33590 81 11 shot shot NOUN bracis-33590 81 12 effectiveness effectiveness NOUN bracis-33590 81 13 , , PUNCT bracis-33590 81 14 uses use VERB bracis-33590 81 15 the the DET bracis-33590 81 16 same same ADJ bracis-33590 81 17 two two NUM bracis-33590 81 18 steps step NOUN bracis-33590 81 19 . . PUNCT bracis-33590 82 1 however however ADV bracis-33590 82 2 , , PUNCT bracis-33590 82 3 instead instead ADV bracis-33590 82 4 of of ADP bracis-33590 82 5 employing employ VERB bracis-33590 82 6 real real ADJ bracis-33590 82 7 queries query NOUN bracis-33590 82 8 sourced source VERB bracis-33590 82 9 from from ADP bracis-33590 82 10 a a DET bracis-33590 82 11 costly costly ADJ bracis-33590 82 12 human human ADJ bracis-33590 82 13 - - PUNCT bracis-33590 82 14 annotation annotation NOUN bracis-33590 82 15 process process NOUN bracis-33590 82 16 , , PUNCT bracis-33590 82 17 it it PRON bracis-33590 82 18 uses use VERB bracis-33590 82 19 synthetic synthetic ADJ bracis-33590 82 20 queries query NOUN bracis-33590 82 21 generated generate VERB bracis-33590 82 22 by by ADP bracis-33590 82 23 an an DET bracis-33590 82 24 llm llm NOUN bracis-33590 82 25 based base VERB bracis-33590 82 26 on on ADP bracis-33590 82 27 randomly randomly ADV bracis-33590 82 28 sampled sample VERB bracis-33590 82 29 documents document NOUN bracis-33590 82 30 from from ADP bracis-33590 82 31 the the DET bracis-33590 82 32 corpus corpus NOUN bracis-33590 82 33 . . PUNCT bracis-33590 83 1 in in ADP bracis-33590 83 2 this this DET bracis-33590 83 3 scenario scenario NOUN bracis-33590 83 4 , , PUNCT bracis-33590 83 5 the the DET bracis-33590 83 6 positive positive ADJ bracis-33590 83 7 document document NOUN bracis-33590 83 8 is be AUX bracis-33590 83 9 the the DET bracis-33590 83 10 one one NOUN bracis-33590 83 11 used use VERB bracis-33590 83 12 to to PART bracis-33590 83 13 create create VERB bracis-33590 83 14 the the DET bracis-33590 83 15 query query NOUN bracis-33590 83 16 , , PUNCT bracis-33590 83 17 and and CCONJ bracis-33590 83 18 the the DET bracis-33590 83 19 negatives negative NOUN bracis-33590 83 20 are be AUX bracis-33590 83 21 collected collect VERB bracis-33590 83 22 using use VERB bracis-33590 83 23 the the DET bracis-33590 83 24 same same ADJ bracis-33590 83 25 top top ADJ bracis-33590 83 26 - - PUNCT bracis-33590 83 27 k k NOUN bracis-33590 83 28 sampling sample VERB bracis-33590 83 29 approach approach NOUN bracis-33590 83 30 as as ADP bracis-33590 83 31 before before ADV bracis-33590 83 32 . . PUNCT bracis-33590 84 1 we we PRON bracis-33590 84 2 also also ADV bracis-33590 84 3 perform perform VERB bracis-33590 84 4 zero zero NUM bracis-33590 84 5 - - PUNCT bracis-33590 84 6 mean mean NOUN bracis-33590 84 7 normalization normalization NOUN bracis-33590 84 8 on on ADP bracis-33590 84 9 the the DET bracis-33590 84 10 teacher teacher NOUN bracis-33590 84 11 logits logit NOUN bracis-33590 84 12 for for ADP bracis-33590 84 13 each each DET bracis-33590 84 14 query query NOUN bracis-33590 84 15 - - PUNCT bracis-33590 84 16 document document NOUN bracis-33590 84 17 pair pair NOUN bracis-33590 84 18 , , PUNCT bracis-33590 84 19 independent independent ADJ bracis-33590 84 20 of of ADP bracis-33590 84 21 the the DET bracis-33590 84 22 overall overall ADJ bracis-33590 84 23 dataset dataset ADJ bracis-33590 84 24 distribution distribution NOUN bracis-33590 84 25 . . PUNCT bracis-33590 85 1 this this DET bracis-33590 85 2 approach approach NOUN bracis-33590 85 3 intends intend VERB bracis-33590 85 4 to to PART bracis-33590 85 5 make make VERB bracis-33590 85 6 the the DET bracis-33590 85 7 data datum NOUN bracis-33590 85 8 distribution distribution NOUN bracis-33590 85 9 symmetric symmetric NOUN bracis-33590 85 10 for for ADP bracis-33590 85 11 each each DET bracis-33590 85 12 query query NOUN bracis-33590 85 13 - - PUNCT bracis-33590 85 14 document document NOUN bracis-33590 85 15 pair pair NOUN bracis-33590 85 16 , , PUNCT bracis-33590 85 17 thereby thereby ADV bracis-33590 85 18 minimizing minimize VERB bracis-33590 85 19 the the DET bracis-33590 85 20 bias bias NOUN bracis-33590 85 21 that that SCONJ bracis-33590 85 22 inranker inranker NOUN bracis-33590 85 23 is be AUX bracis-33590 85 24 required require VERB bracis-33590 85 25 to to PART bracis-33590 85 26 learn learn VERB bracis-33590 85 27 . . PUNCT bracis-33590 86 1 formally formally ADV bracis-33590 86 2 : : PUNCT bracis-33590 86 3 $ $ SYM bracis-33590 86 4 $ $ SYM bracis-33590 86 5 \begin{aligned \begin{aligne VERB bracis-33590 86 6 } } PUNCT bracis-33590 86 7 \begin{aligned \begin{aligne VERB bracis-33590 86 8 } } PUNCT bracis-33590 86 9 { { PUNCT bracis-33590 86 10 l'}_\textrm{true l'}_\textrm{true PROPN bracis-33590 86 11 } } PUNCT bracis-33590 86 12 & & CCONJ bracis-33590 86 13 = = PUNCT bracis-33590 86 14 l_\textrm{true l_\textrm{true PROPN bracis-33590 86 15 } } PUNCT bracis-33590 86 16 \frac{l_\textrm{true \frac{l_\textrm{true PROPN bracis-33590 86 17 } } PUNCT bracis-33590 86 18 + + CCONJ bracis-33590 86 19 l_\textrm{false}}{2 l_\textrm{false}}{2 ADJ bracis-33590 86 20 } } PUNCT bracis-33590 86 21 \\ \\ NOUN bracis-33590 86 22 { { PUNCT bracis-33590 86 23 l'}_\textrm{false l'}_\textrm{false NOUN bracis-33590 86 24 } } PUNCT bracis-33590 86 25 & & CCONJ bracis-33590 86 26 = = PUNCT bracis-33590 86 27 l_\textrm{false l_\textrm{false ADJ bracis-33590 86 28 } } PUNCT bracis-33590 86 29 \frac{l_\textrm{true \frac{l_\textrm{true PROPN bracis-33590 86 30 } } PUNCT bracis-33590 86 31 + + CCONJ bracis-33590 86 32 l_\textrm{false}}{2 l_\textrm{false}}{2 AUX bracis-33590 86 33 } } PUNCT bracis-33590 86 34 \end{aligned \end{aligne VERB bracis-33590 86 35 } } PUNCT bracis-33590 86 36 \end{aligned}$$ \end{aligned}$$ X bracis-33590 86 37 ( ( PUNCT bracis-33590 86 38 1 1 NUM bracis-33590 86 39 ) ) PUNCT bracis-33590 86 40 with with ADP bracis-33590 86 41 \(l_\textrm{true}\ \(l_\textrm{true}\ NUM bracis-33590 86 42 ) ) PUNCT bracis-33590 86 43 and and CCONJ bracis-33590 86 44 \(l_\textrm{false}\ \(l_\textrm{false}\ NUM bracis-33590 86 45 ) ) PUNCT bracis-33590 86 46 denoting denote VERB bracis-33590 86 47 the the DET bracis-33590 86 48 teacher teacher NOUN bracis-33590 86 49 ’s ’s PART bracis-33590 86 50 logits logit NOUN bracis-33590 86 51 for for ADP bracis-33590 86 52 the the DET bracis-33590 86 53 relevant relevant ADJ bracis-33590 86 54 and and CCONJ bracis-33590 86 55 non non ADJ bracis-33590 86 56 - - ADJ bracis-33590 86 57 relevant relevant ADJ bracis-33590 86 58 classes class NOUN bracis-33590 86 59 , , PUNCT bracis-33590 86 60 respectively respectively ADV bracis-33590 86 61 , , PUNCT bracis-33590 86 62 and and CCONJ bracis-33590 86 63 \(l'\ \(l'\ PROPN bracis-33590 86 64 ) ) PUNCT bracis-33590 86 65 being be AUX bracis-33590 86 66 the the DET bracis-33590 86 67 normalized normalize VERB bracis-33590 86 68 values value NOUN bracis-33590 86 69 . . PUNCT bracis-33590 87 1 this this DET bracis-33590 87 2 results result NOUN bracis-33590 87 3 in in ADP bracis-33590 87 4 the the DET bracis-33590 87 5 following follow VERB bracis-33590 87 6 loss loss NOUN bracis-33590 87 7 for for ADP bracis-33590 87 8 each each DET bracis-33590 87 9 training training NOUN bracis-33590 87 10 example example NOUN bracis-33590 87 11 : : PUNCT bracis-33590 87 12 $ $ SYM bracis-33590 87 13 $ $ SYM bracis-33590 87 14 \begin{aligned \begin{aligne VERB bracis-33590 87 15 } } PUNCT bracis-33590 87 16 \mathcal \mathcal ADJ bracis-33590 87 17 { { PUNCT bracis-33590 87 18 l}_\textrm{mse l}_\textrm{mse NOUN bracis-33590 87 19 } } PUNCT bracis-33590 87 20 = = SYM bracis-33590 87 21 ( ( PUNCT bracis-33590 87 22 [ [ X bracis-33590 87 23 y_\textrm{true y_\textrm{true NOUN bracis-33590 87 24 } } PUNCT bracis-33590 87 25 { { PUNCT bracis-33590 87 26 l'}_\textrm{true}]^2 l'}_\textrm{true}]^2 PROPN bracis-33590 87 27 + + PROPN bracis-33590 88 1 [ [ X bracis-33590 88 2 y_\textrm{false y_\textrm{false PROPN bracis-33590 88 3 } } PUNCT bracis-33590 88 4 { { PUNCT bracis-33590 88 5 l'}_\textrm{false}]^2 l'}_\textrm{false}]^2 PROPN bracis-33590 88 6 ) ) PUNCT bracis-33590 88 7 \end{aligned}$$ \end{aligned}$$ X bracis-33590 88 8 ( ( PUNCT bracis-33590 88 9 2 2 NUM bracis-33590 88 10 ) ) PUNCT bracis-33590 88 11 with with ADP bracis-33590 88 12 \(y_\textrm{true}\ \(y_\textrm{true}\ NOUN bracis-33590 88 13 ) ) PUNCT bracis-33590 88 14 and and CCONJ bracis-33590 88 15 \(y_\textrm{false}\ \(y_\textrm{false}\ NUM bracis-33590 88 16 ) ) PUNCT bracis-33590 88 17 representing represent VERB bracis-33590 88 18 the the DET bracis-33590 88 19 logits logit NOUN bracis-33590 88 20 of of ADP bracis-33590 88 21 the the DET bracis-33590 88 22 student student NOUN bracis-33590 88 23 . . PUNCT bracis-33590 89 1 due due ADP bracis-33590 89 2 to to ADP bracis-33590 89 3 the the DET bracis-33590 89 4 training training NOUN bracis-33590 89 5 objective objective NOUN bracis-33590 89 6 described describe VERB bracis-33590 89 7 in in ADP bracis-33590 89 8 eq eq ADP bracis-33590 89 9 . . PUNCT bracis-33590 90 1 ( ( PUNCT bracis-33590 90 2 2 2 NUM bracis-33590 90 3 ) ) PUNCT bracis-33590 90 4 , , PUNCT bracis-33590 90 5 the the DET bracis-33590 90 6 model model NOUN bracis-33590 90 7 no no ADV bracis-33590 90 8 longer long ADV bracis-33590 90 9 determines determine VERB bracis-33590 90 10 the the DET bracis-33590 90 11 relevance relevance NOUN bracis-33590 90 12 of of ADP bracis-33590 90 13 passages passage NOUN bracis-33590 90 14 and and CCONJ bracis-33590 90 15 instead instead ADV bracis-33590 90 16 focuses focus VERB bracis-33590 90 17 on on ADP bracis-33590 90 18 replicating replicate VERB bracis-33590 90 19 the the DET bracis-33590 90 20 teacher teacher NOUN bracis-33590 90 21 ’s ’s PART bracis-33590 90 22 output output NOUN bracis-33590 90 23 , , PUNCT bracis-33590 90 24 thus thus ADV bracis-33590 90 25 eliminating eliminate VERB bracis-33590 90 26 the the DET bracis-33590 90 27 need need NOUN bracis-33590 90 28 for for ADP bracis-33590 90 29 tunning tun VERB bracis-33590 90 30 a a DET bracis-33590 90 31 relevance relevance NOUN bracis-33590 90 32 threshold threshold NOUN bracis-33590 90 33 that that PRON bracis-33590 90 34 would would AUX bracis-33590 90 35 be be AUX bracis-33590 90 36 needed need VERB bracis-33590 90 37 to to PART bracis-33590 90 38 produce produce VERB bracis-33590 90 39 a a DET bracis-33590 90 40 binary binary ADJ bracis-33590 90 41 label label NOUN bracis-33590 90 42 . . PUNCT bracis-33590 91 1 with with ADP bracis-33590 91 2 this this DET bracis-33590 91 3 approach approach NOUN bracis-33590 91 4 , , PUNCT bracis-33590 91 5 we we PRON bracis-33590 91 6 can can AUX bracis-33590 91 7 easily easily ADV bracis-33590 91 8 expand expand VERB bracis-33590 91 9 the the DET bracis-33590 91 10 out out ADJ bracis-33590 91 11 - - PUNCT bracis-33590 91 12 of of ADP bracis-33590 91 13 - - PUNCT bracis-33590 91 14 domain domain NOUN bracis-33590 91 15 knowledge knowledge NOUN bracis-33590 91 16 of of ADP bracis-33590 91 17 distilled distil VERB bracis-33590 91 18 models model NOUN bracis-33590 91 19 by by ADP bracis-33590 91 20 generating generate VERB bracis-33590 91 21 new new ADJ bracis-33590 91 22 queries query NOUN bracis-33590 91 23 for for ADP bracis-33590 91 24 documents document NOUN bracis-33590 91 25 using use VERB bracis-33590 91 26 an an DET bracis-33590 91 27 llm llm NOUN bracis-33590 91 28 and and CCONJ bracis-33590 91 29 fine fine ADV bracis-33590 91 30 - - PUNCT bracis-33590 91 31 tuning tune VERB bracis-33590 91 32 the the DET bracis-33590 91 33 distilled distil VERB bracis-33590 91 34 model model NOUN bracis-33590 91 35 using use VERB bracis-33590 91 36 the the DET bracis-33590 91 37 teacher teacher NOUN bracis-33590 91 38 ’s ’s PART bracis-33590 91 39 logits logit NOUN bracis-33590 91 40 . . PUNCT bracis-33590 92 1 in in ADP bracis-33590 92 2 the the DET bracis-33590 92 3 experiments experiment NOUN bracis-33590 92 4 section section NOUN bracis-33590 92 5 , , PUNCT bracis-33590 92 6 we we PRON bracis-33590 92 7 demonstrate demonstrate VERB bracis-33590 92 8 the the DET bracis-33590 92 9 effectiveness effectiveness NOUN bracis-33590 92 10 of of ADP bracis-33590 92 11 this this DET bracis-33590 92 12 approach approach NOUN bracis-33590 92 13 in in ADP bracis-33590 92 14 enhancing enhance VERB bracis-33590 92 15 the the DET bracis-33590 92 16 student student NOUN bracis-33590 92 17 model model NOUN bracis-33590 92 18 ’s ’s PART bracis-33590 92 19 effectiveness effectiveness NOUN bracis-33590 92 20 across across ADP bracis-33590 92 21 16 16 NUM bracis-33590 92 22 datasets dataset NOUN bracis-33590 92 23 of of ADP bracis-33590 92 24 beir beir NOUN bracis-33590 92 25 simultaneously simultaneously ADV bracis-33590 92 26 . . PUNCT bracis-33590 93 1 we we PRON bracis-33590 93 2 present present VERB bracis-33590 93 3 the the DET bracis-33590 93 4 hyperparameters hyperparameter NOUN bracis-33590 93 5 used use VERB bracis-33590 93 6 for for ADP bracis-33590 93 7 training training NOUN bracis-33590 93 8 and and CCONJ bracis-33590 93 9 the the DET bracis-33590 93 10 dataset dataset ADJ bracis-33590 93 11 curation curation NOUN bracis-33590 93 12 in in ADP bracis-33590 93 13 appendix appendix NOUN bracis-33590 93 14     SPACE bracis-33590 93 15 a a NOUN bracis-33590 93 16 , , PUNCT bracis-33590 93 17 and and CCONJ bracis-33590 93 18 we we PRON bracis-33590 93 19 discuss discuss VERB bracis-33590 93 20 variations variation NOUN bracis-33590 93 21 of of ADP bracis-33590 93 22 the the DET bracis-33590 93 23 training training NOUN bracis-33590 93 24 loss loss NOUN bracis-33590 93 25 in in ADP bracis-33590 93 26 appendix appendix NOUN bracis-33590 93 27     SPACE bracis-33590 93 28 c. c. NOUN bracis-33590 93 29 4 4 NUM bracis-33590 93 30 experiments experiment NOUN bracis-33590 93 31 4.1 4.1 NUM bracis-33590 93 32 english english ADJ bracis-33590 93 33 knowledge knowledge NOUN bracis-33590 93 34 distillation distillation NOUN bracis-33590 93 35 results result NOUN bracis-33590 93 36 we we PRON bracis-33590 93 37 distilled distil VERB bracis-33590 93 38 monot5 monot5 NOUN bracis-33590 93 39 - - PUNCT bracis-33590 93 40 3b 3b NUM bracis-33590 93 41 to to PART bracis-33590 93 42 models model NOUN bracis-33590 93 43 with with ADP bracis-33590 93 44 parameters parameter NOUN bracis-33590 93 45 ranging range VERB bracis-33590 93 46 from from ADP bracis-33590 93 47 60 60 NUM bracis-33590 93 48 m m NOUN bracis-33590 93 49 to to ADP bracis-33590 93 50 3b 3b NUM bracis-33590 93 51 , , PUNCT bracis-33590 93 52 using use VERB bracis-33590 93 53 combinations combination NOUN bracis-33590 93 54 of of ADP bracis-33590 93 55 the the DET bracis-33590 93 56 following follow VERB bracis-33590 93 57 configurations configuration NOUN bracis-33590 93 58 : : PUNCT bracis-33590 93 59 human human ADJ bracis-33590 93 60 hard hard ADV bracis-33590 93 61 : : PUNCT bracis-33590 93 62 representing represent VERB bracis-33590 93 63 the the DET bracis-33590 93 64 common common ADJ bracis-33590 93 65 approach approach NOUN bracis-33590 93 66 for for ADP bracis-33590 93 67 training training NOUN bracis-33590 93 68 rankers ranker NOUN bracis-33590 93 69 with with ADP bracis-33590 93 70 human human NOUN bracis-33590 93 71 - - PUNCT bracis-33590 93 72 annotated annotate VERB bracis-33590 93 73 hard hard ADV bracis-33590 93 74 ( ( PUNCT bracis-33590 93 75 i.e. i.e. X bracis-33590 93 76 , , PUNCT bracis-33590 93 77 binary binary ADJ bracis-33590 93 78 ) ) PUNCT bracis-33590 93 79 labels label NOUN bracis-33590 93 80 from from ADP bracis-33590 93 81 the the DET bracis-33590 93 82 ms ms PROPN bracis-33590 93 83 marco marco PROPN bracis-33590 93 84 passage passage NOUN bracis-33590 93 85 ranking rank VERB bracis-33590 93 86 dataset dataset NOUN bracis-33590 93 87 . . PUNCT bracis-33590 94 1 in in ADP bracis-33590 94 2 this this DET bracis-33590 94 3 case case NOUN bracis-33590 94 4 , , PUNCT bracis-33590 94 5 a a DET bracis-33590 94 6 vanilla vanilla NOUN bracis-33590 94 7 cross cross NOUN bracis-33590 94 8 - - ADJ bracis-33590 94 9 entropy entropy ADJ bracis-33590 94 10 loss loss NOUN bracis-33590 94 11 is be AUX bracis-33590 94 12 used use VERB bracis-33590 94 13 : : PUNCT bracis-33590 94 14 $ $ SYM bracis-33590 94 15 $ $ SYM bracis-33590 94 16 \begin{aligned \begin{aligne VERB bracis-33590 94 17 } } PUNCT bracis-33590 94 18 \mathcal \mathcal ADJ bracis-33590 94 19 { { PUNCT bracis-33590 94 20 l}_\textrm{ce l}_\textrm{ce NOUN bracis-33590 94 21 } } PUNCT bracis-33590 94 22 = = SYM bracis-33590 94 23 -\log -\log PROPN bracis-33590 94 24 p_\textrm{relevant p_\textrm{relevant PROPN bracis-33590 94 25 } } PUNCT bracis-33590 94 26 \log \log PROPN bracis-33590 94 27 p_\mathrm p_\mathrm PROPN bracis-33590 94 28 { { PUNCT bracis-33590 94 29 non non ADJ bracis-33590 94 30 - - ADJ bracis-33590 94 31 relevant relevant ADJ bracis-33590 94 32 } } PUNCT bracis-33590 94 33 \end{aligned}$$ \end{aligned}$$ X bracis-33590 94 34 ( ( PUNCT bracis-33590 94 35 3 3 NUM bracis-33590 94 36 ) ) PUNCT bracis-33590 94 37 where where SCONJ bracis-33590 94 38 \(p_\textrm{relevant}\ \(p_\textrm{relevant}\ NUM bracis-33590 94 39 ) ) PUNCT bracis-33590 94 40 and and CCONJ bracis-33590 94 41 \(p_\mathrm \(p_\mathrm PROPN bracis-33590 94 42 { { PUNCT bracis-33590 94 43 non non ADJ bracis-33590 94 44 - - ADJ bracis-33590 94 45 relevant}\ relevant}\ ADJ bracis-33590 94 46 ) ) PUNCT bracis-33590 94 47 are be AUX bracis-33590 94 48 the the DET bracis-33590 94 49 probabilities probability NOUN bracis-33590 94 50 assigned assign VERB bracis-33590 94 51 by by ADP bracis-33590 94 52 the the DET bracis-33590 94 53 model model NOUN bracis-33590 94 54 to to ADP bracis-33590 94 55 the the DET bracis-33590 94 56 relevant relevant ADJ bracis-33590 94 57 and and CCONJ bracis-33590 94 58 non non ADJ bracis-33590 94 59 - - ADJ bracis-33590 94 60 relevant relevant ADJ bracis-33590 94 61 query query NOUN bracis-33590 94 62 - - PUNCT bracis-33590 94 63 document document NOUN bracis-33590 94 64 pair pair NOUN bracis-33590 94 65 , , PUNCT bracis-33590 94 66 respectively respectively ADV bracis-33590 94 67 . . PUNCT bracis-33590 95 1 non non ADJ bracis-33590 95 2 - - ADJ bracis-33590 95 3 relevant relevant ADJ bracis-33590 95 4 pairs pair NOUN bracis-33590 95 5 are be AUX bracis-33590 95 6 sampled sample VERB bracis-33590 95 7 from from ADP bracis-33590 95 8 the the DET bracis-33590 95 9 top-1000 top-1000 NOUN bracis-33590 95 10 retrieved retrieve VERB bracis-33590 95 11 by by ADP bracis-33590 95 12 bm25 bm25 PROPN bracis-33590 95 13 . . PUNCT bracis-33590 96 1 human human ADJ bracis-33590 96 2 soft soft ADJ bracis-33590 96 3 : : PUNCT bracis-33590 96 4 representing represent VERB bracis-33590 96 5 a a DET bracis-33590 96 6 distillation distillation NOUN bracis-33590 96 7 step step NOUN bracis-33590 96 8 for for ADP bracis-33590 96 9 matching match VERB bracis-33590 96 10 the the DET bracis-33590 96 11 logits logit NOUN bracis-33590 96 12 of of ADP bracis-33590 96 13 a a DET bracis-33590 96 14 teacher teacher NOUN bracis-33590 96 15 and and CCONJ bracis-33590 96 16 a a DET bracis-33590 96 17 student student NOUN bracis-33590 96 18 model model NOUN bracis-33590 96 19 , , PUNCT bracis-33590 96 20 using use VERB bracis-33590 96 21 real real ADJ bracis-33590 96 22 ( ( PUNCT bracis-33590 96 23 human human NOUN bracis-33590 96 24 - - PUNCT bracis-33590 96 25 generated generate VERB bracis-33590 96 26 ) ) PUNCT bracis-33590 96 27 queries query NOUN bracis-33590 96 28 from from ADP bracis-33590 96 29 the the DET bracis-33590 96 30 ranking rank VERB bracis-33590 96 31 dataset dataset NOUN bracis-33590 96 32 as as ADP bracis-33590 96 33 inputs input NOUN bracis-33590 96 34 , , PUNCT bracis-33590 96 35 but but CCONJ bracis-33590 96 36 without without ADP bracis-33590 96 37 the the DET bracis-33590 96 38 binary binary ADJ bracis-33590 96 39 relevance relevance NOUN bracis-33590 96 40 judgments judgment NOUN bracis-33590 96 41 for for ADP bracis-33590 96 42 targets target NOUN bracis-33590 96 43 . . PUNCT bracis-33590 97 1 synthetic synthetic ADJ bracis-33590 97 2 soft soft ADJ bracis-33590 97 3 : : PUNCT bracis-33590 97 4 representing represent VERB bracis-33590 97 5 a a DET bracis-33590 97 6 distillation distillation NOUN bracis-33590 97 7 step step NOUN bracis-33590 97 8 for for ADP bracis-33590 97 9 matching match VERB bracis-33590 97 10 the the DET bracis-33590 97 11 logits logit NOUN bracis-33590 97 12 of of ADP bracis-33590 97 13 the the DET bracis-33590 97 14 two two NUM bracis-33590 97 15 models model NOUN bracis-33590 97 16 , , PUNCT bracis-33590 97 17 similar similar ADJ bracis-33590 97 18 to to ADP bracis-33590 97 19 the the DET bracis-33590 97 20 previous previous ADJ bracis-33590 97 21 configuration configuration NOUN bracis-33590 97 22 , , PUNCT bracis-33590 97 23 but but CCONJ bracis-33590 97 24 using use VERB bracis-33590 97 25 exclusively exclusively ADV bracis-33590 97 26 synthetic synthetic ADJ bracis-33590 97 27 queries query NOUN bracis-33590 97 28 generated generate VERB bracis-33590 97 29 from from ADP bracis-33590 97 30 the the DET bracis-33590 97 31 corresponding correspond VERB bracis-33590 97 32 beir beir PROPN bracis-33590 97 33 corpora corpora PROPN bracis-33590 97 34 with with ADP bracis-33590 97 35 inpars inpar NOUN bracis-33590 97 36     SPACE bracis-33590 98 1 [ [ X bracis-33590 98 2 2 2 NUM bracis-33590 98 3 , , PUNCT bracis-33590 98 4 19 19 NUM bracis-33590 98 5 ] ] PUNCT bracis-33590 98 6 . . PUNCT bracis-33590 99 1 table table NOUN bracis-33590 99 2 1 1 NUM bracis-33590 99 3 . . PUNCT bracis-33590 100 1 distillation distillation NOUN bracis-33590 100 2 results result NOUN bracis-33590 100 3 ( ( PUNCT bracis-33590 100 4 ndcg@10 ndcg@10 PROPN bracis-33590 100 5 ) ) PUNCT bracis-33590 100 6 on on ADP bracis-33590 100 7 16 16 NUM bracis-33590 100 8 beir beir PROPN bracis-33590 100 9 datasets dataset NOUN bracis-33590 100 10 . . PUNCT bracis-33590 101 1 the the DET bracis-33590 101 2 model model NOUN bracis-33590 101 3 marked mark VERB bracis-33590 101 4 with with ADP bracis-33590 101 5 * * PUNCT bracis-33590 101 6 represents represent VERB bracis-33590 101 7 the the DET bracis-33590 101 8 teacher teacher NOUN bracis-33590 101 9 model model NOUN bracis-33590 101 10 . . PUNCT bracis-33590 102 1 we we PRON bracis-33590 102 2 did do AUX bracis-33590 102 3 not not PART bracis-33590 102 4 train train VERB bracis-33590 102 5 inranker-3b inranker-3b PRON bracis-33590 102 6 on on ADP bracis-33590 102 7 human human ADJ bracis-33590 102 8 soft soft ADJ bracis-33590 102 9 labels label NOUN bracis-33590 102 10 due due ADJ bracis-33590 102 11 to to ADP bracis-33590 102 12 computational computational ADJ bracis-33590 102 13 constraints.full constraints.full NOUN bracis-33590 102 14 size size NOUN bracis-33590 102 15 table table NOUN bracis-33590 102 16 from from ADP bracis-33590 102 17 table table NOUN bracis-33590 102 18     SPACE bracis-33590 102 19 1 1 NUM bracis-33590 102 20 , , PUNCT bracis-33590 102 21 we we PRON bracis-33590 102 22 see see VERB bracis-33590 102 23 that that SCONJ bracis-33590 102 24 both both DET bracis-33590 102 25 distillation distillation NOUN bracis-33590 102 26 steps step NOUN bracis-33590 102 27 were be AUX bracis-33590 102 28 essential essential ADJ bracis-33590 102 29 for for ADP bracis-33590 102 30 improving improve VERB bracis-33590 102 31 the the DET bracis-33590 102 32 average average ADJ bracis-33590 102 33 ndcg@10 ndcg@10 NOUN bracis-33590 102 34 score score NOUN bracis-33590 102 35 compared compare VERB bracis-33590 102 36 to to ADP bracis-33590 102 37 the the DET bracis-33590 102 38 model model NOUN bracis-33590 102 39 trained train VERB bracis-33590 102 40 solely solely ADV bracis-33590 102 41 using use VERB bracis-33590 102 42 human human ADJ bracis-33590 102 43 hard hard ADJ bracis-33590 102 44 labels label NOUN bracis-33590 102 45 from from ADP bracis-33590 102 46 ms ms PROPN bracis-33590 102 47 marco.footnote marco.footnote PROPN bracis-33590 102 48 1 1 NUM bracis-33590 102 49 as as ADP bracis-33590 102 50 a a DET bracis-33590 102 51 result result NOUN bracis-33590 102 52 , , PUNCT bracis-33590 102 53 inranker-60 inranker-60 PROPN bracis-33590 102 54 m m PROPN bracis-33590 102 55 ( ( PUNCT bracis-33590 102 56 row row NOUN bracis-33590 102 57 3 3 NUM bracis-33590 102 58 ) ) PUNCT bracis-33590 102 59 and and CCONJ bracis-33590 102 60 inranker-220 inranker-220 ADJ bracis-33590 102 61 m m PROPN bracis-33590 102 62 ( ( PUNCT bracis-33590 102 63 row row NOUN bracis-33590 102 64 6 6 NUM bracis-33590 102 65 ) ) PUNCT bracis-33590 102 66 , , PUNCT bracis-33590 102 67 despite despite SCONJ bracis-33590 102 68 being be AUX bracis-33590 102 69 50x 50x NUM bracis-33590 102 70 and and CCONJ bracis-33590 102 71 13x 13x NOUN bracis-33590 102 72 smaller small ADJ bracis-33590 102 73 than than ADP bracis-33590 102 74 the the DET bracis-33590 102 75 teacher teacher NOUN bracis-33590 102 76 model model NOUN bracis-33590 102 77 , , PUNCT bracis-33590 102 78 were be AUX bracis-33590 102 79 able able ADJ bracis-33590 102 80 to to PART bracis-33590 102 81 improve improve VERB bracis-33590 102 82 their their PRON bracis-33590 102 83 effectiveness effectiveness NOUN bracis-33590 102 84 on on ADP bracis-33590 102 85 the the DET bracis-33590 102 86 beir beir PROPN bracis-33590 102 87 benchmark benchmark NOUN bracis-33590 102 88 significantly significantly ADV bracis-33590 102 89 . . PUNCT bracis-33590 103 1 moreover moreover ADV bracis-33590 103 2 , , PUNCT bracis-33590 103 3 models model NOUN bracis-33590 103 4 trained train VERB bracis-33590 103 5 exclusively exclusively ADV bracis-33590 103 6 on on ADP bracis-33590 103 7 ms ms PROPN bracis-33590 103 8 marco marco PROPN bracis-33590 103 9 soft soft ADJ bracis-33590 103 10 labels label NOUN bracis-33590 103 11 ( ( PUNCT bracis-33590 103 12 rows row NOUN bracis-33590 103 13 2 2 NUM bracis-33590 103 14 & & CCONJ bracis-33590 103 15 5 5 NUM bracis-33590 103 16 ) ) PUNCT bracis-33590 103 17 saw see VERB bracis-33590 103 18 an an DET bracis-33590 103 19 increase increase NOUN bracis-33590 103 20 in in ADP bracis-33590 103 21 effectiveness effectiveness NOUN bracis-33590 103 22 in in ADP bracis-33590 103 23 comparison comparison NOUN bracis-33590 103 24 to to ADP bracis-33590 103 25 training training NOUN bracis-33590 103 26 on on ADP bracis-33590 103 27 solely solely ADV bracis-33590 103 28 hard hard ADJ bracis-33590 103 29 labels label NOUN bracis-33590 103 30 ( ( PUNCT bracis-33590 103 31 rows row NOUN bracis-33590 103 32 1 1 NUM bracis-33590 103 33 & & CCONJ bracis-33590 103 34 4 4 NUM bracis-33590 103 35 ) ) PUNCT bracis-33590 103 36 , , PUNCT bracis-33590 103 37 corroborating corroborate VERB bracis-33590 103 38 findings finding NOUN bracis-33590 103 39 from from ADP bracis-33590 103 40 previous previous ADJ bracis-33590 103 41 studies study NOUN bracis-33590 103 42 regarding regard VERB bracis-33590 103 43 the the DET bracis-33590 103 44 effectiveness effectiveness NOUN bracis-33590 103 45 of of ADP bracis-33590 103 46 soft soft ADJ bracis-33590 103 47 labels label NOUN bracis-33590 103 48 [ [ X bracis-33590 103 49 14 14 NUM bracis-33590 103 50 , , PUNCT bracis-33590 103 51 16,17,18 16,17,18 NUM bracis-33590 103 52 ] ] PUNCT bracis-33590 103 53 . . PUNCT bracis-33590 104 1 furthermore furthermore ADV bracis-33590 104 2 , , PUNCT bracis-33590 104 3 we we PRON bracis-33590 104 4 observed observe VERB bracis-33590 104 5 an an DET bracis-33590 104 6 increase increase NOUN bracis-33590 104 7 in in ADP bracis-33590 104 8 the the DET bracis-33590 104 9 effectiveness effectiveness NOUN bracis-33590 104 10 even even ADV bracis-33590 104 11 in in ADP bracis-33590 104 12 self self NOUN bracis-33590 104 13 - - PUNCT bracis-33590 104 14 distillation distillation NOUN bracis-33590 104 15 training training NOUN bracis-33590 104 16 ( ( PUNCT bracis-33590 104 17 row row NOUN bracis-33590 104 18 8) 8) NUM bracis-33590 104 19 , , PUNCT bracis-33590 104 20 where where SCONJ bracis-33590 104 21 the the DET bracis-33590 104 22 student student NOUN bracis-33590 104 23 learns learn VERB bracis-33590 104 24 soft soft ADJ bracis-33590 104 25 labels label NOUN bracis-33590 104 26 generated generate VERB bracis-33590 104 27 by by ADP bracis-33590 104 28 itself itself PRON bracis-33590 104 29 . . PUNCT bracis-33590 105 1 we we PRON bracis-33590 105 2 hypothesize hypothesize VERB bracis-33590 105 3 that that SCONJ bracis-33590 105 4 the the DET bracis-33590 105 5 improvement improvement NOUN bracis-33590 105 6 stems stem VERB bracis-33590 105 7 from from ADP bracis-33590 105 8 the the DET bracis-33590 105 9 extra extra ADJ bracis-33590 105 10 knowledge knowledge NOUN bracis-33590 105 11 provided provide VERB bracis-33590 105 12 by by ADP bracis-33590 105 13 the the DET bracis-33590 105 14 language language NOUN bracis-33590 105 15 model model NOUN bracis-33590 105 16 used use VERB bracis-33590 105 17 to to PART bracis-33590 105 18 generate generate VERB bracis-33590 105 19 the the DET bracis-33590 105 20 synthetic synthetic ADJ bracis-33590 105 21 queries query NOUN bracis-33590 105 22 . . PUNCT bracis-33590 106 1 we we PRON bracis-33590 106 2 did do AUX bracis-33590 106 3 not not PART bracis-33590 106 4 provide provide VERB bracis-33590 106 5 results result NOUN bracis-33590 106 6 for for ADP bracis-33590 106 7 the the DET bracis-33590 106 8 3b 3b NUM bracis-33590 106 9 model model NOUN bracis-33590 106 10 trained train VERB bracis-33590 106 11 on on ADP bracis-33590 106 12 both both DET bracis-33590 106 13 human human ADJ bracis-33590 106 14 soft soft ADJ bracis-33590 106 15 and and CCONJ bracis-33590 106 16 synthetic synthetic ADJ bracis-33590 106 17 soft soft ADJ bracis-33590 106 18 due due ADJ bracis-33590 106 19 to to ADP bracis-33590 106 20 computational computational ADJ bracis-33590 106 21 costs cost NOUN bracis-33590 106 22 . . PUNCT bracis-33590 107 1 furthermore furthermore ADV bracis-33590 107 2 , , PUNCT bracis-33590 107 3 in in ADP bracis-33590 107 4 table table NOUN bracis-33590 107 5     SPACE bracis-33590 107 6 2 2 NUM bracis-33590 107 7 , , PUNCT bracis-33590 107 8 we we PRON bracis-33590 107 9 present present VERB bracis-33590 107 10 a a DET bracis-33590 107 11 effectiveness effectiveness NOUN bracis-33590 107 12 comparison comparison NOUN bracis-33590 107 13 between between ADP bracis-33590 107 14 inranker inranker NOUN bracis-33590 107 15 , , PUNCT bracis-33590 107 16 promptagator promptagator NOUN bracis-33590 107 17     SPACE bracis-33590 108 1 [ [ X bracis-33590 108 2 13 13 NUM bracis-33590 108 3 ] ] PUNCT bracis-33590 108 4 , , PUNCT bracis-33590 108 5 and and CCONJ bracis-33590 108 6 rankt5 rankt5 PROPN bracis-33590 108 7     SPACE bracis-33590 109 1 [ [ X bracis-33590 109 2 33 33 NUM bracis-33590 109 3 ] ] PUNCT bracis-33590 109 4 . . PUNCT bracis-33590 110 1 although although SCONJ bracis-33590 110 2 we we PRON bracis-33590 110 3 used use VERB bracis-33590 110 4 monot5 monot5 NOUN bracis-33590 110 5 - - PUNCT bracis-33590 110 6 3b 3b NOUN bracis-33590 110 7 as as ADP bracis-33590 110 8 a a DET bracis-33590 110 9 teacher teacher NOUN bracis-33590 110 10 for for ADP bracis-33590 110 11 our our PRON bracis-33590 110 12 experiments experiment NOUN bracis-33590 110 13 , , PUNCT bracis-33590 110 14 which which PRON bracis-33590 110 15 has have VERB bracis-33590 110 16 a a DET bracis-33590 110 17 lower low ADJ bracis-33590 110 18 effectiveness effectiveness NOUN bracis-33590 110 19 on on ADP bracis-33590 110 20 average average ADJ bracis-33590 110 21 when when SCONJ bracis-33590 110 22 compared compare VERB bracis-33590 110 23 to to ADP bracis-33590 110 24 promptagator promptagator NOUN bracis-33590 110 25 or or CCONJ bracis-33590 110 26 rankt5 rankt5 PROPN bracis-33590 110 27 - - PUNCT bracis-33590 110 28 3b 3b NUM bracis-33590 110 29 , , PUNCT bracis-33590 110 30 our our PRON bracis-33590 110 31 method method NOUN bracis-33590 110 32 is be AUX bracis-33590 110 33 model model NOUN bracis-33590 110 34 - - ADJ bracis-33590 110 35 agnostic agnostic ADJ bracis-33590 110 36 and and CCONJ bracis-33590 110 37 thus thus ADV bracis-33590 110 38 one one NUM bracis-33590 110 39 could could AUX bracis-33590 110 40 use use VERB bracis-33590 110 41 a a DET bracis-33590 110 42 stronger strong ADJ bracis-33590 110 43 teacher teacher NOUN bracis-33590 110 44 model model NOUN bracis-33590 110 45 and and CCONJ bracis-33590 110 46 anticipate anticipate VERB bracis-33590 110 47 even even ADV bracis-33590 110 48 stronger strong ADJ bracis-33590 110 49 results result NOUN bracis-33590 110 50 . . PUNCT bracis-33590 111 1 nonetheless nonetheless ADV bracis-33590 111 2 , , PUNCT bracis-33590 111 3 inranker inranker NOUN bracis-33590 111 4 remains remain VERB bracis-33590 111 5 competitive competitive ADJ bracis-33590 111 6 in in ADP bracis-33590 111 7 both both DET bracis-33590 111 8 model model NOUN bracis-33590 111 9 groups group NOUN bracis-33590 111 10 of of ADP bracis-33590 111 11 220 220 NUM bracis-33590 111 12 m m NOUN bracis-33590 111 13 and and CCONJ bracis-33590 111 14 3b 3b NUM bracis-33590 111 15 parameters parameter NOUN bracis-33590 111 16 , , PUNCT bracis-33590 111 17 outperforming outperform VERB bracis-33590 111 18 the the DET bracis-33590 111 19 other other ADJ bracis-33590 111 20 two two NUM bracis-33590 111 21 baselines baseline NOUN bracis-33590 111 22 in in ADP bracis-33590 111 23 6 6 NUM bracis-33590 111 24 out out ADP bracis-33590 111 25 of of ADP bracis-33590 111 26 the the DET bracis-33590 111 27 10 10 NUM bracis-33590 111 28 evaluated evaluated ADJ bracis-33590 111 29 datasets dataset NOUN bracis-33590 111 30 , , PUNCT bracis-33590 111 31 despite despite SCONJ bracis-33590 111 32 the the DET bracis-33590 111 33 average average ADJ bracis-33590 111 34 score score NOUN bracis-33590 111 35 not not PART bracis-33590 111 36 reflecting reflect VERB bracis-33590 111 37 this this PRON bracis-33590 111 38 due due ADJ bracis-33590 111 39 to to ADP bracis-33590 111 40 promptagator promptagator NOUN bracis-33590 111 41 and and CCONJ bracis-33590 111 42 rankt5 rankt5 NOUN bracis-33590 111 43 attaining attain VERB bracis-33590 111 44 a a DET bracis-33590 111 45 significantly significantly ADV bracis-33590 111 46 higher high ADJ bracis-33590 111 47 score score NOUN bracis-33590 111 48 in in ADP bracis-33590 111 49 two two NUM bracis-33590 111 50 datasets dataset NOUN bracis-33590 111 51 : : PUNCT bracis-33590 111 52 arguana arguana NOUN bracis-33590 111 53 and and CCONJ bracis-33590 111 54 touché touché NOUN bracis-33590 111 55 . . PUNCT bracis-33590 112 1 table table NOUN bracis-33590 112 2 2 2 NUM bracis-33590 112 3 . . PUNCT bracis-33590 112 4 comparison comparison NOUN bracis-33590 112 5 of of ADP bracis-33590 112 6 the the DET bracis-33590 112 7 effectiveness effectiveness NOUN bracis-33590 112 8 for for ADP bracis-33590 112 9 various various ADJ bracis-33590 112 10 reranking reranking NOUN bracis-33590 112 11 models model NOUN bracis-33590 112 12 , , PUNCT bracis-33590 112 13 measured measure VERB bracis-33590 112 14 by by ADP bracis-33590 112 15 ndcg@10 ndcg@10 NOUN bracis-33590 112 16 on on ADP bracis-33590 112 17 the the DET bracis-33590 112 18 beir beir PROPN bracis-33590 112 19 benchmark benchmark NOUN bracis-33590 112 20 . . PUNCT bracis-33590 113 1 the the DET bracis-33590 113 2 model model NOUN bracis-33590 113 3 marked mark VERB bracis-33590 113 4 with with ADP bracis-33590 113 5 * * PUNCT bracis-33590 113 6 represents represent VERB bracis-33590 113 7 the the DET bracis-33590 113 8 teacher teacher NOUN bracis-33590 113 9 model model NOUN bracis-33590 113 10 used use VERB bracis-33590 113 11 for for ADP bracis-33590 113 12 training training NOUN bracis-33590 113 13 inranker inranker NOUN bracis-33590 113 14 . . PUNCT bracis-33590 114 1 bolded bolde VERB bracis-33590 114 2 scores score NOUN bracis-33590 114 3 correspond correspond VERB bracis-33590 114 4 to to ADP bracis-33590 114 5 the the DET bracis-33590 114 6 best good ADJ bracis-33590 114 7 effectiveness effectiveness NOUN bracis-33590 114 8 on on ADP bracis-33590 114 9 a a DET bracis-33590 114 10 specific specific ADJ bracis-33590 114 11 dataset dataset NOUN bracis-33590 114 12 for for ADP bracis-33590 114 13 a a DET bracis-33590 114 14 given give VERB bracis-33590 114 15 model model NOUN bracis-33590 114 16 size size NOUN bracis-33590 114 17 , , PUNCT bracis-33590 114 18 while while SCONJ bracis-33590 114 19 underlined underline VERB bracis-33590 114 20 scores score NOUN bracis-33590 114 21 indicate indicate VERB bracis-33590 114 22 the the DET bracis-33590 114 23 best good ADJ bracis-33590 114 24 effectiveness effectiveness NOUN bracis-33590 114 25 overall.full overall.full NUM bracis-33590 114 26 size size NOUN bracis-33590 114 27 table table NOUN bracis-33590 114 28 4.2 4.2 NUM bracis-33590 114 29 portuguese portuguese ADJ bracis-33590 114 30 knowledge knowledge NOUN bracis-33590 114 31 distillation distillation NOUN bracis-33590 114 32 results result NOUN bracis-33590 114 33 to to PART bracis-33590 114 34 further far ADV bracis-33590 114 35 assess assess VERB bracis-33590 114 36 the the DET bracis-33590 114 37 efficacy efficacy NOUN bracis-33590 114 38 of of ADP bracis-33590 114 39 the the DET bracis-33590 114 40 technique technique NOUN bracis-33590 114 41 in in ADP bracis-33590 114 42 different different ADJ bracis-33590 114 43 languages language NOUN bracis-33590 114 44 , , PUNCT bracis-33590 114 45 we we PRON bracis-33590 114 46 evaluated evaluate VERB bracis-33590 114 47 inranker inranker NOUN bracis-33590 114 48 on on ADP bracis-33590 114 49 a a DET bracis-33590 114 50 portuguese portuguese ADJ bracis-33590 114 51 dataset dataset NOUN bracis-33590 114 52 for for ADP bracis-33590 114 53 information information NOUN bracis-33590 114 54 retrieval retrieval NOUN bracis-33590 114 55 : : PUNCT bracis-33590 115 1 quati quati PROPN bracis-33590 115 2 [ [ X bracis-33590 115 3 6 6 NUM bracis-33590 115 4 ] ] PUNCT bracis-33590 115 5 . . PUNCT bracis-33590 116 1 instead instead ADV bracis-33590 116 2 of of ADP bracis-33590 116 3 using use VERB bracis-33590 116 4 the the DET bracis-33590 116 5 same same ADJ bracis-33590 116 6 t5 t5 PROPN bracis-33590 116 7 model model NOUN bracis-33590 116 8 , , PUNCT bracis-33590 116 9 we we PRON bracis-33590 116 10 started start VERB bracis-33590 116 11 from from ADP bracis-33590 116 12 ptt5 ptt5 PROPN bracis-33590 116 13 , , PUNCT bracis-33590 116 14 a a DET bracis-33590 116 15 portuguese portuguese ADJ bracis-33590 116 16 fine fine ADV bracis-33590 116 17 - - PUNCT bracis-33590 116 18 tuned tune VERB bracis-33590 116 19 version version NOUN bracis-33590 116 20 of of ADP bracis-33590 116 21 t5 t5 PROPN bracis-33590 116 22 [ [ X bracis-33590 116 23 7 7 NUM bracis-33590 116 24 , , PUNCT bracis-33590 116 25 27 27 NUM bracis-33590 116 26 ] ] PUNCT bracis-33590 116 27 . . PUNCT bracis-33590 117 1 we we PRON bracis-33590 117 2 used use VERB bracis-33590 117 3 the the DET bracis-33590 117 4 same same ADJ bracis-33590 117 5 two two NUM bracis-33590 117 6 - - PUNCT bracis-33590 117 7 step step NOUN bracis-33590 117 8 training training NOUN bracis-33590 117 9 approach approach NOUN bracis-33590 117 10 as as ADP bracis-33590 117 11 before before ADV bracis-33590 117 12 , , PUNCT bracis-33590 117 13 but but CCONJ bracis-33590 117 14 with with ADP bracis-33590 117 15 a a DET bracis-33590 117 16 strategy strategy NOUN bracis-33590 117 17 that that PRON bracis-33590 117 18 allowed allow VERB bracis-33590 117 19 us we PRON bracis-33590 117 20 to to PART bracis-33590 117 21 distill distill VERB bracis-33590 117 22 a a DET bracis-33590 117 23 portuguese portuguese ADJ bracis-33590 117 24 model model NOUN bracis-33590 117 25 using use VERB bracis-33590 117 26 an an DET bracis-33590 117 27 english english ADJ bracis-33590 117 28 teacher teacher NOUN bracis-33590 117 29 ( ( PUNCT bracis-33590 117 30 monot5 monot5 NOUN bracis-33590 117 31 - - PUNCT bracis-33590 117 32 3b 3b NUM bracis-33590 117 33 ) ) PUNCT bracis-33590 117 34 . . PUNCT bracis-33590 118 1 given give VERB bracis-33590 118 2 the the DET bracis-33590 118 3 availability availability NOUN bracis-33590 118 4 of of ADP bracis-33590 118 5 a a DET bracis-33590 118 6 translated translate VERB bracis-33590 118 7 version version NOUN bracis-33590 118 8 of of ADP bracis-33590 118 9 ms ms PROPN bracis-33590 118 10 marco marco PROPN bracis-33590 118 11 in in ADP bracis-33590 118 12 portuguese portuguese PROPN bracis-33590 118 13 [ [ X bracis-33590 118 14 3 3 NUM bracis-33590 118 15 ] ] PUNCT bracis-33590 118 16 , , PUNCT bracis-33590 118 17 the the DET bracis-33590 118 18 first first ADJ bracis-33590 118 19 step step NOUN bracis-33590 118 20 ( ( PUNCT bracis-33590 118 21 human human NOUN bracis-33590 118 22 soft soft ADJ bracis-33590 118 23 ) ) PUNCT bracis-33590 118 24 involved involve VERB bracis-33590 118 25 training train VERB bracis-33590 118 26 the the DET bracis-33590 118 27 model model NOUN bracis-33590 118 28 using use VERB bracis-33590 118 29 the the DET bracis-33590 118 30 portuguese portuguese ADJ bracis-33590 118 31 text text NOUN bracis-33590 118 32 , , PUNCT bracis-33590 118 33 while while SCONJ bracis-33590 118 34 matching match VERB bracis-33590 118 35 the the DET bracis-33590 118 36 soft soft ADJ bracis-33590 118 37 labels label NOUN bracis-33590 118 38 generated generate VERB bracis-33590 118 39 by by ADP bracis-33590 118 40 the the DET bracis-33590 118 41 teacher teacher NOUN bracis-33590 118 42 using use VERB bracis-33590 118 43 the the DET bracis-33590 118 44 original original ADJ bracis-33590 118 45 english english ADJ bracis-33590 118 46 text text NOUN bracis-33590 118 47 . . PUNCT bracis-33590 119 1 this this DET bracis-33590 119 2 approach approach NOUN bracis-33590 119 3 enabled enable VERB bracis-33590 119 4 us we PRON bracis-33590 119 5 to to PART bracis-33590 119 6 leverage leverage VERB bracis-33590 119 7 a a DET bracis-33590 119 8 stronger strong ADJ bracis-33590 119 9 model model NOUN bracis-33590 119 10 that that PRON bracis-33590 119 11 is be AUX bracis-33590 119 12 not not PART bracis-33590 119 13 available available ADJ bracis-33590 119 14 in in ADP bracis-33590 119 15 portuguese portuguese NOUN bracis-33590 119 16 for for ADP bracis-33590 119 17 the the DET bracis-33590 119 18 distillation distillation NOUN bracis-33590 119 19 process process NOUN bracis-33590 119 20 . . PUNCT bracis-33590 120 1 in in ADP bracis-33590 120 2 the the DET bracis-33590 120 3 second second ADJ bracis-33590 120 4 step step NOUN bracis-33590 120 5 , , PUNCT bracis-33590 120 6 involving involve VERB bracis-33590 120 7 synthetic synthetic ADJ bracis-33590 120 8 soft soft ADJ bracis-33590 120 9 labels label NOUN bracis-33590 120 10 from from ADP bracis-33590 120 11 beir beir PROPN bracis-33590 120 12 , , PUNCT bracis-33590 120 13 we we PRON bracis-33590 120 14 trained train VERB bracis-33590 120 15 using use VERB bracis-33590 120 16 the the DET bracis-33590 120 17 english english ADJ bracis-33590 120 18 text text NOUN bracis-33590 120 19 , , PUNCT bracis-33590 120 20 as as SCONJ bracis-33590 120 21 there there PRON bracis-33590 120 22 is be VERB bracis-33590 120 23 no no DET bracis-33590 120 24 translated translate VERB bracis-33590 120 25 version version NOUN bracis-33590 120 26 of of ADP bracis-33590 120 27 beir beir PROPN bracis-33590 120 28 available available ADJ bracis-33590 120 29 in in ADP bracis-33590 120 30 portuguese portuguese PROPN bracis-33590 120 31 . . PUNCT bracis-33590 121 1 table table NOUN bracis-33590 121 2 3 3 NUM bracis-33590 121 3 . . PUNCT bracis-33590 122 1 inranker inranker NOUN bracis-33590 122 2 results result VERB bracis-33590 122 3 on on ADP bracis-33590 122 4 quati quati NOUN bracis-33590 122 5 , , PUNCT bracis-33590 122 6 a a DET bracis-33590 122 7 portuguese portuguese ADJ bracis-33590 122 8 evaluation evaluation NOUN bracis-33590 122 9 dataset dataset NOUN bracis-33590 122 10 for for ADP bracis-33590 122 11 information information NOUN bracis-33590 122 12 retrieval retrieval NOUN bracis-33590 122 13 using use VERB bracis-33590 122 14 ptt5 ptt5 PROPN bracis-33590 122 15 - - PUNCT bracis-33590 122 16 v2 v2 VERB bracis-33590 122 17     SPACE bracis-33590 122 18 [ [ X bracis-33590 122 19 27 27 NUM bracis-33590 122 20 ] ] PUNCT bracis-33590 122 21 . . PUNCT bracis-33590 123 1 all all DET bracis-33590 123 2 synthetic synthetic ADJ bracis-33590 123 3 soft soft ADJ bracis-33590 123 4 labels label NOUN bracis-33590 123 5 were be AUX bracis-33590 123 6 generated generate VERB bracis-33590 123 7 using use VERB bracis-33590 123 8 the the DET bracis-33590 123 9 beir beir PROPN bracis-33590 123 10 datasets.full datasets.full PROPN bracis-33590 123 11 size size NOUN bracis-33590 123 12 table table NOUN bracis-33590 123 13 the the DET bracis-33590 123 14 results result NOUN bracis-33590 123 15 of of ADP bracis-33590 123 16 this this DET bracis-33590 123 17 evaluation evaluation NOUN bracis-33590 123 18 are be AUX bracis-33590 123 19 presented present VERB bracis-33590 123 20 in in ADP bracis-33590 123 21 table table NOUN bracis-33590 123 22     SPACE bracis-33590 123 23 3 3 NUM bracis-33590 123 24 . . PUNCT bracis-33590 124 1 we we PRON bracis-33590 124 2 conclude conclude VERB bracis-33590 124 3 that that SCONJ bracis-33590 124 4 , , PUNCT bracis-33590 124 5 similarly similarly ADV bracis-33590 124 6 to to ADP bracis-33590 124 7 english english PROPN bracis-33590 124 8 , , PUNCT bracis-33590 124 9 the the DET bracis-33590 124 10 distillation distillation NOUN bracis-33590 124 11 process process NOUN bracis-33590 124 12 was be AUX bracis-33590 124 13 able able ADJ bracis-33590 124 14 to to PART bracis-33590 124 15 improve improve VERB bracis-33590 124 16 the the DET bracis-33590 124 17 effectiveness effectiveness NOUN bracis-33590 124 18 of of ADP bracis-33590 124 19 models model NOUN bracis-33590 124 20 in in ADP bracis-33590 124 21 a a DET bracis-33590 124 22 zero zero NUM bracis-33590 124 23 - - PUNCT bracis-33590 124 24 shot shot NOUN bracis-33590 124 25 manner manner NOUN bracis-33590 124 26 , , PUNCT bracis-33590 124 27 as as SCONJ bracis-33590 124 28 the the DET bracis-33590 124 29 models model NOUN bracis-33590 124 30 were be AUX bracis-33590 124 31 trained train VERB bracis-33590 124 32 using use VERB bracis-33590 124 33 only only ADV bracis-33590 124 34 real real ADJ bracis-33590 124 35 data datum NOUN bracis-33590 124 36 from from ADP bracis-33590 124 37 ms ms PROPN bracis-33590 124 38 marco marco PROPN bracis-33590 124 39 and and CCONJ bracis-33590 124 40 synthetic synthetic ADJ bracis-33590 124 41 data datum NOUN bracis-33590 124 42 from from ADP bracis-33590 124 43 beir beir PROPN bracis-33590 124 44 . . PUNCT bracis-33590 125 1 remarkably remarkably ADV bracis-33590 125 2 , , PUNCT bracis-33590 125 3 inranker-740 inranker-740 ADJ bracis-33590 125 4 m m VERB bracis-33590 125 5 surpassed surpass VERB bracis-33590 125 6 the the DET bracis-33590 125 7 effectiveness effectiveness NOUN bracis-33590 125 8 of of ADP bracis-33590 125 9 the the DET bracis-33590 125 10 mt5 mt5 ADV bracis-33590 125 11 - - PUNCT bracis-33590 125 12 3.7b 3.7b ADJ bracis-33590 125 13 on on ADP bracis-33590 125 14 quati quati NOUN bracis-33590 125 15 . . PUNCT bracis-33590 126 1 note note VERB bracis-33590 126 2 that that SCONJ bracis-33590 126 3 for for ADP bracis-33590 126 4 the the DET bracis-33590 126 5 quati quati PROPN bracis-33590 126 6 evaluation evaluation NOUN bracis-33590 126 7 we we PRON bracis-33590 126 8 used use VERB bracis-33590 126 9 the the DET bracis-33590 126 10 same same ADJ bracis-33590 126 11 prompt prompt NOUN bracis-33590 126 12 presented present VERB bracis-33590 126 13 in in ADP bracis-33590 126 14 the the DET bracis-33590 126 15 paper paper NOUN bracis-33590 126 16 to to PART bracis-33590 126 17 annotate annotate VERB bracis-33590 126 18 all all DET bracis-33590 126 19 unjudged unjudged ADJ bracis-33590 126 20 documents document NOUN bracis-33590 126 21 using use VERB bracis-33590 126 22 gpt-4 gpt-4 NOUN bracis-33590 126 23 - - PUNCT bracis-33590 126 24 turbo turbo NOUN bracis-33590 126 25 . . PUNCT bracis-33590 127 1 therefore therefore ADV bracis-33590 127 2 all all DET bracis-33590 127 3 results result NOUN bracis-33590 127 4 are be AUX bracis-33590 127 5 presented present VERB bracis-33590 127 6 with with ADP bracis-33590 127 7 a a DET bracis-33590 127 8 jugded@10 jugded@10 NOUN bracis-33590 127 9 of of ADP bracis-33590 127 10 100 100 NUM bracis-33590 127 11 % % NOUN bracis-33590 127 12 . . PUNCT bracis-33590 128 1 further further ADJ bracis-33590 128 2 results result NOUN bracis-33590 128 3 using use VERB bracis-33590 128 4 synthetic synthetic ADJ bracis-33590 128 5 data datum NOUN bracis-33590 128 6 from from ADP bracis-33590 128 7 quati quati NOUN bracis-33590 128 8 and and CCONJ bracis-33590 128 9 mixed mixed ADJ bracis-33590 128 10 training training NOUN bracis-33590 128 11 data datum NOUN bracis-33590 128 12 are be AUX bracis-33590 128 13 presented present VERB bracis-33590 128 14 in in ADP bracis-33590 128 15 appendix appendix PROPN bracis-33590 128 16     SPACE bracis-33590 128 17 e. e. PROPN bracis-33590 128 18 4.3 4.3 NUM bracis-33590 128 19 ablations ablation NOUN bracis-33590 128 20 in in ADP bracis-33590 128 21 this this DET bracis-33590 128 22 section section NOUN bracis-33590 128 23 , , PUNCT bracis-33590 128 24 we we PRON bracis-33590 128 25 present present VERB bracis-33590 128 26 our our PRON bracis-33590 128 27 ablation ablation NOUN bracis-33590 128 28 experiments experiment NOUN bracis-33590 128 29 aimed aim VERB bracis-33590 128 30 at at ADP bracis-33590 128 31 validating validate VERB bracis-33590 128 32 the the DET bracis-33590 128 33 best good ADJ bracis-33590 128 34 configuration configuration NOUN bracis-33590 128 35 for for ADP bracis-33590 128 36 distilling distil VERB bracis-33590 128 37 monot5 monot5 NOUN bracis-33590 128 38 - - PUNCT bracis-33590 128 39 3b 3b NOUN bracis-33590 128 40 into into ADP bracis-33590 128 41 smaller small ADJ bracis-33590 128 42 t5 t5 PROPN bracis-33590 128 43 - - PUNCT bracis-33590 128 44 based base VERB bracis-33590 128 45 models model NOUN bracis-33590 128 46 , , PUNCT bracis-33590 128 47 as as ADV bracis-33590 128 48 well well ADV bracis-33590 128 49 as as ADP bracis-33590 128 50 assessing assess VERB bracis-33590 128 51 their their PRON bracis-33590 128 52 zero zero NUM bracis-33590 128 53 - - PUNCT bracis-33590 128 54 shot shot NOUN bracis-33590 128 55 capabilities capability NOUN bracis-33590 128 56 . . PUNCT bracis-33590 129 1 the the DET bracis-33590 129 2 initial initial ADJ bracis-33590 129 3 experiments experiment NOUN bracis-33590 129 4 we we PRON bracis-33590 129 5 conducted conduct VERB bracis-33590 129 6 focused focus VERB bracis-33590 129 7 on on ADP bracis-33590 129 8 evaluating evaluate VERB bracis-33590 129 9 how how SCONJ bracis-33590 129 10 distillation distillation NOUN bracis-33590 129 11 would would AUX bracis-33590 129 12 affect affect VERB bracis-33590 129 13 the the DET bracis-33590 129 14 model model NOUN bracis-33590 129 15 ’s ’s PART bracis-33590 129 16 effectiveness effectiveness NOUN bracis-33590 129 17 on on ADP bracis-33590 129 18 novel novel ADJ bracis-33590 129 19 dataset dataset NOUN bracis-33590 129 20 distributions distribution NOUN bracis-33590 129 21 that that PRON bracis-33590 129 22 were be AUX bracis-33590 129 23 not not PART bracis-33590 129 24 seen see VERB bracis-33590 129 25 during during ADP bracis-33590 129 26 training training NOUN bracis-33590 129 27 , , PUNCT bracis-33590 129 28 i.e. i.e. X bracis-33590 129 29 , , PUNCT bracis-33590 129 30 we we PRON bracis-33590 129 31 did do AUX bracis-33590 129 32 not not PART bracis-33590 129 33 generate generate VERB bracis-33590 129 34 synthetic synthetic ADJ bracis-33590 129 35 queries query NOUN bracis-33590 129 36 for for ADP bracis-33590 129 37 them they PRON bracis-33590 129 38 . . PUNCT bracis-33590 130 1 to to PART bracis-33590 130 2 achieve achieve VERB bracis-33590 130 3 this this PRON bracis-33590 130 4 , , PUNCT bracis-33590 130 5 we we PRON bracis-33590 130 6 created create VERB bracis-33590 130 7 two two NUM bracis-33590 130 8 subsets subset NOUN bracis-33590 130 9 , , PUNCT bracis-33590 130 10 each each PRON bracis-33590 130 11 containing contain VERB bracis-33590 130 12 8 8 NUM bracis-33590 130 13 randomly randomly ADV bracis-33590 130 14 selected select VERB bracis-33590 130 15 datasets dataset NOUN bracis-33590 130 16 from from ADP bracis-33590 130 17 16 16 NUM bracis-33590 130 18 datasets dataset NOUN bracis-33590 130 19 of of ADP bracis-33590 130 20 beirfootnote beirfootnote NOUN bracis-33590 130 21 2 2 NUM bracis-33590 130 22 , , PUNCT bracis-33590 130 23 which which PRON bracis-33590 130 24 we we PRON bracis-33590 130 25 named name VERB bracis-33590 130 26 sample sample NOUN bracis-33590 130 27 sets set NOUN bracis-33590 130 28 1 1 NUM bracis-33590 130 29 and and CCONJ bracis-33590 130 30 2 2 NUM bracis-33590 130 31 and and CCONJ bracis-33590 130 32 used use VERB bracis-33590 130 33 only only ADV bracis-33590 130 34 one one NUM bracis-33590 130 35 set set NOUN bracis-33590 130 36 for for ADP bracis-33590 130 37 training training NOUN bracis-33590 130 38 per per ADP bracis-33590 130 39 experiment experiment NOUN bracis-33590 130 40 . . PUNCT bracis-33590 131 1 the the DET bracis-33590 131 2 datasets dataset NOUN bracis-33590 131 3 that that PRON bracis-33590 131 4 were be AUX bracis-33590 131 5 used use VERB bracis-33590 131 6 for for ADP bracis-33590 131 7 training training NOUN bracis-33590 131 8 are be AUX bracis-33590 131 9 designated designate VERB bracis-33590 131 10 as as ADP bracis-33590 131 11 the the DET bracis-33590 131 12 “ " PUNCT bracis-33590 131 13 in in ADP bracis-33590 131 14 - - PUNCT bracis-33590 131 15 domain domain NOUN bracis-33590 131 16 ” " PUNCT bracis-33590 131 17 category category NOUN bracis-33590 131 18 , , PUNCT bracis-33590 131 19 while while SCONJ bracis-33590 131 20 the the DET bracis-33590 131 21 remaining remain VERB bracis-33590 131 22 datasets dataset NOUN bracis-33590 131 23 , , PUNCT bracis-33590 131 24 i.e. i.e. X bracis-33590 131 25 the the DET bracis-33590 131 26 other other ADJ bracis-33590 131 27 8 8 NUM bracis-33590 131 28 datasets dataset NOUN bracis-33590 131 29 that that PRON bracis-33590 131 30 are be AUX bracis-33590 131 31 not not PART bracis-33590 131 32 part part NOUN bracis-33590 131 33 of of ADP bracis-33590 131 34 the the DET bracis-33590 131 35 training training NOUN bracis-33590 131 36 set set NOUN bracis-33590 131 37 , , PUNCT bracis-33590 131 38 represent represent VERB bracis-33590 131 39 the the DET bracis-33590 131 40 “ " PUNCT bracis-33590 131 41 out out ADP bracis-33590 131 42 - - PUNCT bracis-33590 131 43 of of ADP bracis-33590 131 44 - - PUNCT bracis-33590 131 45 domain domain NOUN bracis-33590 131 46 ” " PUNCT bracis-33590 131 47 ( ( PUNCT bracis-33590 131 48 o.o.d o.o.d PROPN bracis-33590 131 49 . . PUNCT bracis-33590 131 50 ) ) PUNCT bracis-33590 131 51 category category NOUN bracis-33590 131 52 . . PUNCT bracis-33590 132 1 table table NOUN bracis-33590 132 2 4 4 NUM bracis-33590 132 3 . . PUNCT bracis-33590 132 4 comparison comparison NOUN bracis-33590 132 5 of of ADP bracis-33590 132 6 the the DET bracis-33590 132 7 in in NOUN bracis-33590 132 8 - - PUNCT bracis-33590 132 9 domain domain NOUN bracis-33590 132 10 vs vs ADP bracis-33590 132 11 out out ADV bracis-33590 132 12 - - PUNCT bracis-33590 132 13 of of ADP bracis-33590 132 14 - - PUNCT bracis-33590 132 15 domain domain NOUN bracis-33590 132 16 effectiveness effectiveness NOUN bracis-33590 132 17 of of ADP bracis-33590 132 18 our our PRON bracis-33590 132 19 method method NOUN bracis-33590 132 20 , , PUNCT bracis-33590 132 21 measured measure VERB bracis-33590 132 22 by by ADP bracis-33590 132 23 ndcg@10 ndcg@10 PROPN bracis-33590 132 24 . . PUNCT bracis-33590 133 1 the the DET bracis-33590 133 2 model model NOUN bracis-33590 133 3 marked mark VERB bracis-33590 133 4 with with ADP bracis-33590 133 5 * * PUNCT bracis-33590 133 6 represents represent VERB bracis-33590 133 7 the the DET bracis-33590 133 8 teacher teacher NOUN bracis-33590 133 9 model model NOUN bracis-33590 133 10 used use VERB bracis-33590 133 11 for for ADP bracis-33590 133 12 the the DET bracis-33590 133 13 knowledge knowledge NOUN bracis-33590 133 14 distillation distillation NOUN bracis-33590 133 15 process.full process.full NOUN bracis-33590 133 16 size size NOUN bracis-33590 133 17 table table NOUN bracis-33590 133 18 impact impact NOUN bracis-33590 133 19 of of ADP bracis-33590 133 20 soft soft ADJ bracis-33590 133 21 knowledge knowledge NOUN bracis-33590 133 22 distillation distillation NOUN bracis-33590 133 23 on on ADP bracis-33590 133 24 o.o.d o.o.d PROPN bracis-33590 133 25 . . PROPN bracis-33590 133 26 effectiveness effectiveness NOUN bracis-33590 133 27 . . PUNCT bracis-33590 134 1 our our PRON bracis-33590 134 2 first first ADJ bracis-33590 134 3 ablation ablation NOUN bracis-33590 134 4 experiment experiment NOUN bracis-33590 134 5 focused focus VERB bracis-33590 134 6 on on ADP bracis-33590 134 7 evaluating evaluate VERB bracis-33590 134 8 the the DET bracis-33590 134 9 initial initial ADJ bracis-33590 134 10 distillation distillation NOUN bracis-33590 134 11 process process NOUN bracis-33590 134 12 using use VERB bracis-33590 134 13 the the DET bracis-33590 134 14 ms ms PROPN bracis-33590 134 15 marco marco PROPN bracis-33590 134 16 dataset dataset VERB bracis-33590 134 17 with with ADP bracis-33590 134 18 soft soft ADJ bracis-33590 134 19 labels label NOUN bracis-33590 134 20 . . PUNCT bracis-33590 135 1 to to PART bracis-33590 135 2 accomplish accomplish VERB bracis-33590 135 3 this this PRON bracis-33590 135 4 , , PUNCT bracis-33590 135 5 we we PRON bracis-33590 135 6 generated generate VERB bracis-33590 135 7 logits logit NOUN bracis-33590 135 8 with with ADP bracis-33590 135 9 monot5 monot5 NOUN bracis-33590 135 10 - - PUNCT bracis-33590 135 11 3b 3b NOUN bracis-33590 135 12 and and CCONJ bracis-33590 135 13 trained train VERB bracis-33590 135 14 both both CCONJ bracis-33590 135 15 t5 t5 PROPN bracis-33590 135 16 - - PUNCT bracis-33590 135 17 base base NOUN bracis-33590 135 18 and and CCONJ bracis-33590 135 19 t5 t5 PROPN bracis-33590 135 20 - - PUNCT bracis-33590 135 21 small small ADJ bracis-33590 135 22 models model NOUN bracis-33590 135 23 for for ADP bracis-33590 135 24 10 10 NUM bracis-33590 135 25 epochs epoch NOUN bracis-33590 135 26 . . PUNCT bracis-33590 136 1 as as SCONJ bracis-33590 136 2 shown show VERB bracis-33590 136 3 in in ADP bracis-33590 136 4 table table NOUN bracis-33590 136 5     SPACE bracis-33590 136 6 4 4 NUM bracis-33590 136 7 , , PUNCT bracis-33590 136 8 rows row VERB bracis-33590 136 9 1–2 1–2 NUM bracis-33590 136 10 & & CCONJ bracis-33590 136 11 5–6 5–6 NUM bracis-33590 136 12 , , PUNCT bracis-33590 136 13 both both DET bracis-33590 136 14 models model NOUN bracis-33590 136 15 demonstrated demonstrate VERB bracis-33590 136 16 an an DET bracis-33590 136 17 improvement improvement NOUN bracis-33590 136 18 in in ADP bracis-33590 136 19 their their PRON bracis-33590 136 20 ndcg@10 ndcg@10 PROPN bracis-33590 136 21 scores score NOUN bracis-33590 136 22 compared compare VERB bracis-33590 136 23 to to ADP bracis-33590 136 24 the the DET bracis-33590 136 25 baseline baseline NOUN bracis-33590 136 26 , , PUNCT bracis-33590 136 27 which which PRON bracis-33590 136 28 was be AUX bracis-33590 136 29 trained train VERB bracis-33590 136 30 using use VERB bracis-33590 136 31 the the DET bracis-33590 136 32 hard hard ADJ bracis-33590 136 33 labels label NOUN bracis-33590 136 34 from from ADP bracis-33590 136 35 ms ms PROPN bracis-33590 136 36 marco marco PROPN bracis-33590 136 37 . . PUNCT bracis-33590 137 1 remarkably remarkably ADV bracis-33590 137 2 , , PUNCT bracis-33590 137 3 the the DET bracis-33590 137 4 overall overall ADJ bracis-33590 137 5 score score NOUN bracis-33590 137 6 increased increase VERB bracis-33590 137 7 in in ADP bracis-33590 137 8 both both DET bracis-33590 137 9 scenarios scenario NOUN bracis-33590 137 10 , , PUNCT bracis-33590 137 11 even even ADV bracis-33590 137 12 though though SCONJ bracis-33590 137 13 the the DET bracis-33590 137 14 models model NOUN bracis-33590 137 15 were be AUX bracis-33590 137 16 not not PART bracis-33590 137 17 exposed expose VERB bracis-33590 137 18 to to ADP bracis-33590 137 19 any any DET bracis-33590 137 20 beir beir NOUN bracis-33590 137 21 passages passage NOUN bracis-33590 137 22 during during ADP bracis-33590 137 23 this this DET bracis-33590 137 24 phase.footnote phase.footnote NOUN bracis-33590 137 25 3 3 NUM bracis-33590 137 26 adding add VERB bracis-33590 137 27 soft soft ADJ bracis-33590 137 28 synthetic synthetic ADJ bracis-33590 137 29 targets target NOUN bracis-33590 137 30 as as ADP bracis-33590 137 31 a a DET bracis-33590 137 32 second second ADJ bracis-33590 137 33 distillation distillation NOUN bracis-33590 137 34 phase phase NOUN bracis-33590 137 35 . . PUNCT bracis-33590 138 1 for for ADP bracis-33590 138 2 the the DET bracis-33590 138 3 next next ADJ bracis-33590 138 4 experiment experiment NOUN bracis-33590 138 5 , , PUNCT bracis-33590 138 6 we we PRON bracis-33590 138 7 applied apply VERB bracis-33590 138 8 a a DET bracis-33590 138 9 second second ADJ bracis-33590 138 10 distillation distillation NOUN bracis-33590 138 11 step step NOUN bracis-33590 138 12 with with ADP bracis-33590 138 13 synthetic synthetic ADJ bracis-33590 138 14 soft soft ADJ bracis-33590 138 15 labels label NOUN bracis-33590 138 16 on on ADP bracis-33590 138 17 top top NOUN bracis-33590 138 18 of of ADP bracis-33590 138 19 the the DET bracis-33590 138 20 model model NOUN bracis-33590 138 21 that that PRON bracis-33590 138 22 we we PRON bracis-33590 138 23 acquired acquire VERB bracis-33590 138 24 from from ADP bracis-33590 138 25 the the DET bracis-33590 138 26 last last ADJ bracis-33590 138 27 phase phase NOUN bracis-33590 138 28 ( ( PUNCT bracis-33590 138 29 monot5 monot5 NOUN bracis-33590 138 30 w/ w/ PROPN bracis-33590 138 31 soft soft ADJ bracis-33590 138 32 human human ADJ bracis-33590 138 33 labels label NOUN bracis-33590 138 34 ) ) PUNCT bracis-33590 138 35 . . PUNCT bracis-33590 139 1 for for ADP bracis-33590 139 2 that that PRON bracis-33590 139 3 , , PUNCT bracis-33590 139 4 we we PRON bracis-33590 139 5 used use VERB bracis-33590 139 6 the the DET bracis-33590 139 7 100k 100k NUM bracis-33590 139 8 synthetic synthetic ADJ bracis-33590 139 9 queries query NOUN bracis-33590 139 10 generated generate VERB bracis-33590 139 11 by by ADP bracis-33590 139 12 inpars inpar NOUN bracis-33590 139 13 for for ADP bracis-33590 139 14 each each DET bracis-33590 139 15 dataset dataset NOUN bracis-33590 139 16 indicated indicate VERB bracis-33590 139 17 as as ADP bracis-33590 139 18 “ " PUNCT bracis-33590 139 19 in in ADP bracis-33590 139 20 - - PUNCT bracis-33590 139 21 domain domain NOUN bracis-33590 139 22 ” " PUNCT bracis-33590 139 23 and and CCONJ bracis-33590 139 24 trained train VERB bracis-33590 139 25 for for ADP bracis-33590 139 26 10 10 NUM bracis-33590 139 27 epochs epoch NOUN bracis-33590 139 28 . . PUNCT bracis-33590 140 1 as as SCONJ bracis-33590 140 2 shown show VERB bracis-33590 140 3 in in ADP bracis-33590 140 4 table table NOUN bracis-33590 140 5     SPACE bracis-33590 140 6 4 4 NUM bracis-33590 140 7 , , PUNCT bracis-33590 140 8 rows row VERB bracis-33590 140 9 3 3 NUM bracis-33590 140 10 & & CCONJ bracis-33590 140 11 7 7 NUM bracis-33590 140 12 , , PUNCT bracis-33590 140 13 while while SCONJ bracis-33590 140 14 it it PRON bracis-33590 140 15 was be AUX bracis-33590 140 16 expected expect VERB bracis-33590 140 17 that that SCONJ bracis-33590 140 18 the the DET bracis-33590 140 19 in in ADP bracis-33590 140 20 - - PUNCT bracis-33590 140 21 domain domain NOUN bracis-33590 140 22 datasets dataset NOUN bracis-33590 140 23 would would AUX bracis-33590 140 24 have have VERB bracis-33590 140 25 an an DET bracis-33590 140 26 increase increase NOUN bracis-33590 140 27 in in ADP bracis-33590 140 28 their their PRON bracis-33590 140 29 ndcg@10 ndcg@10 PROPN bracis-33590 140 30 scores score NOUN bracis-33590 140 31 , , PUNCT bracis-33590 140 32 we we PRON bracis-33590 140 33 observe observe VERB bracis-33590 140 34 that that SCONJ bracis-33590 140 35 the the DET bracis-33590 140 36 out out ADV bracis-33590 140 37 - - PUNCT bracis-33590 140 38 of of ADP bracis-33590 140 39 - - PUNCT bracis-33590 140 40 domain domain NOUN bracis-33590 140 41 datasets dataset NOUN bracis-33590 140 42 also also ADV bracis-33590 140 43 had have VERB bracis-33590 140 44 improvements improvement NOUN bracis-33590 140 45 , , PUNCT bracis-33590 140 46 suggesting suggest VERB bracis-33590 140 47 that that SCONJ bracis-33590 140 48 the the DET bracis-33590 140 49 model model NOUN bracis-33590 140 50 ’s ’s PART bracis-33590 140 51 generalization generalization NOUN bracis-33590 140 52 capabilities capability NOUN bracis-33590 140 53 were be AUX bracis-33590 140 54 enhanced enhance VERB bracis-33590 140 55 . . PUNCT bracis-33590 141 1 using use VERB bracis-33590 141 2 hard hard ADJ bracis-33590 141 3 human human ADJ bracis-33590 141 4 targets target NOUN bracis-33590 141 5 for for ADP bracis-33590 141 6 the the DET bracis-33590 141 7 first first ADJ bracis-33590 141 8 distillation distillation NOUN bracis-33590 141 9 phase phase NOUN bracis-33590 141 10 . . PUNCT bracis-33590 142 1 finally finally ADV bracis-33590 142 2 , , PUNCT bracis-33590 142 3 we we PRON bracis-33590 142 4 investigated investigate VERB bracis-33590 142 5 the the DET bracis-33590 142 6 impact impact NOUN bracis-33590 142 7 of of ADP bracis-33590 142 8 skipping skip VERB bracis-33590 142 9 the the DET bracis-33590 142 10 first first ADJ bracis-33590 142 11 phase phase NOUN bracis-33590 142 12 of of ADP bracis-33590 142 13 distillation distillation NOUN bracis-33590 142 14 on on ADP bracis-33590 142 15 ms ms PROPN bracis-33590 142 16 marco marco PROPN bracis-33590 142 17 logits logit NOUN bracis-33590 142 18 , , PUNCT bracis-33590 142 19 and and CCONJ bracis-33590 142 20 instead instead ADV bracis-33590 142 21 starting start VERB bracis-33590 142 22 from from ADP bracis-33590 142 23 a a DET bracis-33590 142 24 model model NOUN bracis-33590 142 25 that that PRON bracis-33590 142 26 was be AUX bracis-33590 142 27 trained train VERB bracis-33590 142 28 on on ADP bracis-33590 142 29 hard hard ADJ bracis-33590 142 30 human human ADJ bracis-33590 142 31 labels label NOUN bracis-33590 142 32 ( ( PUNCT bracis-33590 142 33 monot5 monot5 NOUN bracis-33590 142 34 - - PUNCT bracis-33590 142 35 small small ADJ bracis-33590 142 36 and and CCONJ bracis-33590 142 37 monot5 monot5 NOUN bracis-33590 142 38 - - PUNCT bracis-33590 142 39 base base NOUN bracis-33590 142 40 ) ) PUNCT bracis-33590 142 41 and and CCONJ bracis-33590 142 42 directly directly ADV bracis-33590 142 43 training train VERB bracis-33590 142 44 using use VERB bracis-33590 142 45 the the DET bracis-33590 142 46 synthetic synthetic ADJ bracis-33590 142 47 soft soft ADJ bracis-33590 142 48 beir beir NOUN bracis-33590 142 49 targets target NOUN bracis-33590 142 50 . . PUNCT bracis-33590 143 1 as as SCONJ bracis-33590 143 2 we we PRON bracis-33590 143 3 can can AUX bracis-33590 143 4 see see VERB bracis-33590 143 5 in in ADP bracis-33590 143 6 table table NOUN bracis-33590 143 7     SPACE bracis-33590 143 8 4 4 NUM bracis-33590 143 9 , , PUNCT bracis-33590 143 10 rows row VERB bracis-33590 143 11 3–4 3–4 NUM bracis-33590 143 12 & & CCONJ bracis-33590 143 13 7–8 7–8 NOUN bracis-33590 143 14 , , PUNCT bracis-33590 143 15 when when SCONJ bracis-33590 143 16 comparing compare VERB bracis-33590 143 17 with with ADP bracis-33590 143 18 the the DET bracis-33590 143 19 model model NOUN bracis-33590 143 20 that that PRON bracis-33590 143 21 was be AUX bracis-33590 143 22 trained train VERB bracis-33590 143 23 using use VERB bracis-33590 143 24 the the DET bracis-33590 143 25 soft soft ADJ bracis-33590 143 26 human human ADJ bracis-33590 143 27 targets target NOUN bracis-33590 143 28 , , PUNCT bracis-33590 143 29 the the DET bracis-33590 143 30 overall overall ADJ bracis-33590 143 31 effectiveness effectiveness NOUN bracis-33590 143 32 was be AUX bracis-33590 143 33 reduced reduce VERB bracis-33590 143 34 . . PUNCT bracis-33590 144 1 from from ADP bracis-33590 144 2 this this PRON bracis-33590 144 3 , , PUNCT bracis-33590 144 4 we we PRON bracis-33590 144 5 conclude conclude VERB bracis-33590 144 6 that that SCONJ bracis-33590 144 7 the the DET bracis-33590 144 8 distillation distillation NOUN bracis-33590 144 9 step step NOUN bracis-33590 144 10 that that PRON bracis-33590 144 11 includes include VERB bracis-33590 144 12 the the DET bracis-33590 144 13 soft soft ADJ bracis-33590 144 14 human human ADJ bracis-33590 144 15 targets target NOUN bracis-33590 144 16 on on ADP bracis-33590 144 17 ms ms PROPN bracis-33590 144 18 marco marco PROPN bracis-33590 144 19 is be AUX bracis-33590 144 20 beneficial beneficial ADJ bracis-33590 144 21 , , PUNCT bracis-33590 144 22 as as SCONJ bracis-33590 144 23 it it PRON bracis-33590 144 24 improves improve VERB bracis-33590 144 25 the the DET bracis-33590 144 26 model model NOUN bracis-33590 144 27 ’s ’s PART bracis-33590 144 28 effectiveness effectiveness NOUN bracis-33590 144 29 in in ADP bracis-33590 144 30 both both PRON bracis-33590 144 31 in in ADP bracis-33590 144 32 - - PUNCT bracis-33590 144 33 domain domain NOUN bracis-33590 144 34 and and CCONJ bracis-33590 144 35 out out ADP bracis-33590 144 36 - - PUNCT bracis-33590 144 37 of of ADP bracis-33590 144 38 - - PUNCT bracis-33590 144 39 domain domain NOUN bracis-33590 144 40 scenarios scenario NOUN bracis-33590 144 41 . . PUNCT bracis-33590 145 1 upper upper ADJ bracis-33590 145 2 bound bind VERB bracis-33590 145 3 for for ADP bracis-33590 145 4 soft soft ADJ bracis-33590 145 5 distillation distillation NOUN bracis-33590 145 6 . . PUNCT bracis-33590 146 1 to to PART bracis-33590 146 2 estimate estimate VERB bracis-33590 146 3 the the DET bracis-33590 146 4 upper upper ADJ bracis-33590 146 5 bound bound NOUN bracis-33590 146 6 of of ADP bracis-33590 146 7 the the DET bracis-33590 146 8 effectiveness effectiveness NOUN bracis-33590 146 9 that that SCONJ bracis-33590 146 10 these these DET bracis-33590 146 11 models model NOUN bracis-33590 146 12 could could AUX bracis-33590 146 13 attain attain VERB bracis-33590 146 14 through through ADP bracis-33590 146 15 distillation distillation NOUN bracis-33590 146 16 , , PUNCT bracis-33590 146 17 we we PRON bracis-33590 146 18 repeated repeat VERB bracis-33590 146 19 the the DET bracis-33590 146 20 process process NOUN bracis-33590 146 21 using use VERB bracis-33590 146 22 real real ADJ bracis-33590 146 23 queries query NOUN bracis-33590 146 24 from from ADP bracis-33590 146 25 beir beir PROPN bracis-33590 146 26 , , PUNCT bracis-33590 146 27 ( ( PUNCT bracis-33590 146 28 i.e. i.e. X bracis-33590 146 29 , , PUNCT bracis-33590 146 30 the the DET bracis-33590 146 31 validation validation NOUN bracis-33590 146 32 queries query NOUN bracis-33590 146 33 ) ) PUNCT bracis-33590 146 34 instead instead ADV bracis-33590 146 35 of of ADP bracis-33590 146 36 the the DET bracis-33590 146 37 synthetic synthetic ADJ bracis-33590 146 38 ones one NOUN bracis-33590 146 39 . . PUNCT bracis-33590 147 1 results result NOUN bracis-33590 147 2 presented present VERB bracis-33590 147 3 in in ADP bracis-33590 147 4 table table NOUN bracis-33590 147 5     SPACE bracis-33590 147 6 5 5 NUM bracis-33590 147 7 show show VERB bracis-33590 147 8 that that SCONJ bracis-33590 147 9 for for ADP bracis-33590 147 10 both both DET bracis-33590 147 11 model model NOUN bracis-33590 147 12 sizes size NOUN bracis-33590 147 13 , , PUNCT bracis-33590 147 14 there there PRON bracis-33590 147 15 was be VERB bracis-33590 147 16 an an DET bracis-33590 147 17 increase increase NOUN bracis-33590 147 18 in in ADP bracis-33590 147 19 effectiveness effectiveness NOUN bracis-33590 147 20 for for ADP bracis-33590 147 21 the the DET bracis-33590 147 22 in in ADP bracis-33590 147 23 - - PUNCT bracis-33590 147 24 domain domain NOUN bracis-33590 147 25 datasets dataset NOUN bracis-33590 147 26 , , PUNCT bracis-33590 147 27 as as SCONJ bracis-33590 147 28 the the DET bracis-33590 147 29 model model NOUN bracis-33590 147 30 was be AUX bracis-33590 147 31 exposed expose VERB bracis-33590 147 32 to to ADP bracis-33590 147 33 the the DET bracis-33590 147 34 evaluation evaluation NOUN bracis-33590 147 35 queries query NOUN bracis-33590 147 36 during during ADP bracis-33590 147 37 training training NOUN bracis-33590 147 38 . . PUNCT bracis-33590 148 1 however however ADV bracis-33590 148 2 , , PUNCT bracis-33590 148 3 we we PRON bracis-33590 148 4 also also ADV bracis-33590 148 5 observed observe VERB bracis-33590 148 6 an an DET bracis-33590 148 7 increase increase NOUN bracis-33590 148 8 in in ADP bracis-33590 148 9 effectiveness effectiveness NOUN bracis-33590 148 10 for for ADP bracis-33590 148 11 out out ADV bracis-33590 148 12 - - PUNCT bracis-33590 148 13 of of ADP bracis-33590 148 14 - - PUNCT bracis-33590 148 15 domain domain NOUN bracis-33590 148 16 datasets dataset NOUN bracis-33590 148 17 , , PUNCT bracis-33590 148 18 indicating indicate VERB bracis-33590 148 19 that that SCONJ bracis-33590 148 20 the the DET bracis-33590 148 21 synthetic synthetic ADJ bracis-33590 148 22 queries query NOUN bracis-33590 148 23 used use VERB bracis-33590 148 24 for for ADP bracis-33590 148 25 training training NOUN bracis-33590 148 26 could could AUX bracis-33590 148 27 be be AUX bracis-33590 148 28 improved improve VERB bracis-33590 148 29 . . PUNCT bracis-33590 149 1 table table NOUN bracis-33590 149 2 5 5 NUM bracis-33590 149 3 . . PUNCT bracis-33590 149 4 upper upper ADJ bracis-33590 149 5 bound bind VERB bracis-33590 149 6 effectiveness effectiveness NOUN bracis-33590 149 7 ( ( PUNCT bracis-33590 149 8 ndcg@10 ndcg@10 PROPN bracis-33590 149 9 ) ) PUNCT bracis-33590 149 10 using use VERB bracis-33590 149 11 real real ADJ bracis-33590 149 12 queries query NOUN bracis-33590 149 13 from from ADP bracis-33590 149 14 beir beir PROPN bracis-33590 149 15 for for ADP bracis-33590 149 16 the the DET bracis-33590 149 17 distillation distillation NOUN bracis-33590 149 18 datasets dataset NOUN bracis-33590 149 19 . . PUNCT bracis-33590 150 1 bold bold ADJ bracis-33590 150 2 indicates indicate VERB bracis-33590 150 3 the the DET bracis-33590 150 4 best good ADJ bracis-33590 150 5 between between ADP bracis-33590 150 6 using use VERB bracis-33590 150 7 synthetic synthetic ADJ bracis-33590 150 8 and and CCONJ bracis-33590 150 9 real real ADJ bracis-33590 150 10 queries.full queries.full ADJ bracis-33590 150 11 size size NOUN bracis-33590 150 12 table table NOUN bracis-33590 150 13 5 5 NUM bracis-33590 150 14 conclusion conclusion NOUN bracis-33590 150 15 this this DET bracis-33590 150 16 paper paper NOUN bracis-33590 150 17 introduces introduce VERB bracis-33590 150 18 a a DET bracis-33590 150 19 method method NOUN bracis-33590 150 20 for for ADP bracis-33590 150 21 distilling distil VERB bracis-33590 150 22 the the DET bracis-33590 150 23 knowledge knowledge NOUN bracis-33590 150 24 of of ADP bracis-33590 150 25 information information NOUN bracis-33590 150 26 retrieval retrieval NOUN bracis-33590 150 27 models model NOUN bracis-33590 150 28 and and CCONJ bracis-33590 150 29 improve improve VERB bracis-33590 150 30 upon upon SCONJ bracis-33590 150 31 previous previous ADJ bracis-33590 150 32 work work NOUN bracis-33590 150 33 how how SCONJ bracis-33590 150 34 to to PART bracis-33590 150 35 better well ADV bracis-33590 150 36 use use VERB bracis-33590 150 37 synthetic synthetic ADJ bracis-33590 150 38 data datum NOUN bracis-33590 150 39 , , PUNCT bracis-33590 150 40 aimed aim VERB bracis-33590 150 41 at at ADP bracis-33590 150 42 improving improve VERB bracis-33590 150 43 the the DET bracis-33590 150 44 out out ADJ bracis-33590 150 45 - - PUNCT bracis-33590 150 46 of of ADP bracis-33590 150 47 - - PUNCT bracis-33590 150 48 domain domain NOUN bracis-33590 150 49 effectiveness effectiveness NOUN bracis-33590 150 50 of of ADP bracis-33590 150 51 students student NOUN bracis-33590 150 52 . . PUNCT bracis-33590 151 1 the the DET bracis-33590 151 2 study study NOUN bracis-33590 151 3 reveals reveal VERB bracis-33590 151 4 that that SCONJ bracis-33590 151 5 , , PUNCT bracis-33590 151 6 through through ADP bracis-33590 151 7 this this DET bracis-33590 151 8 knowledge knowledge NOUN bracis-33590 151 9 distillation distillation NOUN bracis-33590 151 10 process process NOUN bracis-33590 151 11 , , PUNCT bracis-33590 151 12 smaller small ADJ bracis-33590 151 13 models model NOUN bracis-33590 151 14 can can AUX bracis-33590 151 15 achieve achieve VERB bracis-33590 151 16 results result NOUN bracis-33590 151 17 comparable comparable ADJ bracis-33590 151 18 to to ADP bracis-33590 151 19 the the DET bracis-33590 151 20 teacher teacher NOUN bracis-33590 151 21 , , PUNCT bracis-33590 151 22 even even ADV bracis-33590 151 23 in in ADP bracis-33590 151 24 the the DET bracis-33590 151 25 context context NOUN bracis-33590 151 26 of of ADP bracis-33590 151 27 multilingual multilingual ADJ bracis-33590 151 28 transfer transfer NOUN bracis-33590 151 29 knowledge knowledge NOUN bracis-33590 151 30 . . PUNCT bracis-33590 152 1 this this DET bracis-33590 152 2 approach approach NOUN bracis-33590 152 3 is be AUX bracis-33590 152 4 particularly particularly ADV bracis-33590 152 5 significant significant ADJ bracis-33590 152 6 for for ADP bracis-33590 152 7 applications application NOUN bracis-33590 152 8 where where SCONJ bracis-33590 152 9 computational computational ADJ bracis-33590 152 10 resources resource NOUN bracis-33590 152 11 are be AUX bracis-33590 152 12 limited limit VERB bracis-33590 152 13 , , PUNCT bracis-33590 152 14 in in ADP bracis-33590 152 15 production production NOUN bracis-33590 152 16 environments environment NOUN bracis-33590 152 17 , , PUNCT bracis-33590 152 18 or or CCONJ bracis-33590 152 19 for for ADP bracis-33590 152 20 languages language NOUN bracis-33590 152 21 with with ADP bracis-33590 152 22 a a DET bracis-33590 152 23 lack lack NOUN bracis-33590 152 24 of of ADP bracis-33590 152 25 available available ADJ bracis-33590 152 26 models model NOUN bracis-33590 152 27 that that PRON bracis-33590 152 28 can can AUX bracis-33590 152 29 serve serve VERB bracis-33590 152 30 as as ADP bracis-33590 152 31 a a DET bracis-33590 152 32 teacher teacher NOUN bracis-33590 152 33 . . PUNCT bracis-33590 153 1 the the DET bracis-33590 153 2 methodology methodology NOUN bracis-33590 153 3 involves involve VERB bracis-33590 153 4 two two NUM bracis-33590 153 5 steps step NOUN bracis-33590 153 6 of of ADP bracis-33590 153 7 distillation distillation NOUN bracis-33590 153 8 : : PUNCT bracis-33590 153 9 ( ( PUNCT bracis-33590 153 10 1 1 X bracis-33590 153 11 ) ) PUNCT bracis-33590 153 12 using use VERB bracis-33590 153 13 a a DET bracis-33590 153 14 human human NOUN bracis-33590 153 15 - - PUNCT bracis-33590 153 16 curated curate VERB bracis-33590 153 17 corpus corpus NOUN bracis-33590 153 18 , , PUNCT bracis-33590 153 19 and and CCONJ bracis-33590 153 20 ( ( PUNCT bracis-33590 153 21 2 2 X bracis-33590 153 22 ) ) PUNCT bracis-33590 153 23 using use VERB bracis-33590 153 24 synthetic synthetic ADJ bracis-33590 153 25 data datum NOUN bracis-33590 153 26 generated generate VERB bracis-33590 153 27 by by ADP bracis-33590 153 28 an an DET bracis-33590 153 29 llm llm NOUN bracis-33590 153 30 . . PUNCT bracis-33590 154 1 consequently consequently ADV bracis-33590 154 2 , , PUNCT bracis-33590 154 3 our our PRON bracis-33590 154 4 work work NOUN bracis-33590 154 5 shows show VERB bracis-33590 154 6 that that SCONJ bracis-33590 154 7 it it PRON bracis-33590 154 8 is be AUX bracis-33590 154 9 possible possible ADJ bracis-33590 154 10 to to PART bracis-33590 154 11 improve improve VERB bracis-33590 154 12 a a DET bracis-33590 154 13 reranker reranker NOUN bracis-33590 154 14 ’s ’s PART bracis-33590 154 15 capabilities capability NOUN bracis-33590 154 16 in in ADP bracis-33590 154 17 specific specific ADJ bracis-33590 154 18 domains domain NOUN bracis-33590 154 19 without without ADP bracis-33590 154 20 requiring require VERB bracis-33590 154 21 additional additional ADJ bracis-33590 154 22 human human NOUN bracis-33590 154 23 - - PUNCT bracis-33590 154 24 annotated annotate VERB bracis-33590 154 25 labels label NOUN bracis-33590 154 26 . . PUNCT bracis-33590 155 1 finally finally ADV bracis-33590 155 2 , , PUNCT bracis-33590 155 3 we we PRON bracis-33590 155 4 observe observe VERB bracis-33590 155 5 that that SCONJ bracis-33590 155 6 synthetic synthetic ADJ bracis-33590 155 7 query query NOUN bracis-33590 155 8 generation generation NOUN bracis-33590 155 9 could could AUX bracis-33590 155 10 be be AUX bracis-33590 155 11 improved improve VERB bracis-33590 155 12 since since SCONJ bracis-33590 155 13 the the DET bracis-33590 155 14 real real ADJ bracis-33590 155 15 queries query NOUN bracis-33590 155 16 achieved achieve VERB bracis-33590 155 17 a a DET bracis-33590 155 18 better well ADJ bracis-33590 155 19 out out ADJ bracis-33590 155 20 - - PUNCT bracis-33590 155 21 of of ADP bracis-33590 155 22 - - PUNCT bracis-33590 155 23 domain domain NOUN bracis-33590 155 24 effectiveness effectiveness NOUN bracis-33590 155 25 compared compare VERB bracis-33590 155 26 to to ADP bracis-33590 155 27 the the DET bracis-33590 155 28 model model NOUN bracis-33590 155 29 trained train VERB bracis-33590 155 30 solely solely ADV bracis-33590 155 31 on on ADP bracis-33590 155 32 synthetic synthetic ADJ bracis-33590 155 33 ones one NOUN bracis-33590 155 34 . . PUNCT bracis-33590 156 1 however however ADV bracis-33590 156 2 , , PUNCT bracis-33590 156 3 the the DET bracis-33590 156 4 presented present VERB bracis-33590 156 5 method method NOUN bracis-33590 156 6 has have VERB bracis-33590 156 7 limitations limitation NOUN bracis-33590 156 8 . . PUNCT bracis-33590 157 1 specifically specifically ADV bracis-33590 157 2 , , PUNCT bracis-33590 157 3 it it PRON bracis-33590 157 4 is be AUX bracis-33590 157 5 not not PART bracis-33590 157 6 clear clear ADJ bracis-33590 157 7 how how SCONJ bracis-33590 157 8 to to PART bracis-33590 157 9 adapt adapt VERB bracis-33590 157 10 the the DET bracis-33590 157 11 proposed propose VERB bracis-33590 157 12 loss loss NOUN bracis-33590 157 13 to to PART bracis-33590 157 14 train train VERB bracis-33590 157 15 dense dense ADJ bracis-33590 157 16 retrievers retriever NOUN bracis-33590 157 17 , , PUNCT bracis-33590 157 18 which which PRON bracis-33590 157 19 tipically tipically ADV bracis-33590 157 20 use use VERB bracis-33590 157 21 a a DET bracis-33590 157 22 contrastive contrastive ADJ bracis-33590 157 23 loss loss NOUN bracis-33590 157 24 . . PUNCT bracis-33590 158 1 notes note NOUN bracis-33590 158 2 1.results 1.results PROPN bracis-33590 158 3 per per ADP bracis-33590 158 4 dataset dataset NOUN bracis-33590 158 5 are be AUX bracis-33590 158 6 shown show VERB bracis-33590 158 7 in in ADP bracis-33590 158 8 appendix appendix NOUN bracis-33590 158 9     SPACE bracis-33590 158 10 d. d. PROPN bracis-33590 158 11 2.we 2.we NUM bracis-33590 158 12 list list VERB bracis-33590 158 13 their their PRON bracis-33590 158 14 exact exact ADJ bracis-33590 158 15 composition composition NOUN bracis-33590 158 16 in in ADP bracis-33590 158 17 appendix appendix NOUN bracis-33590 158 18     SPACE bracis-33590 158 19 b. b. NOUN bracis-33590 158 20 3.the 3.the PRON bracis-33590 158 21 individual individual ADJ bracis-33590 158 22 results result NOUN bracis-33590 158 23 for for ADP bracis-33590 158 24 each each DET bracis-33590 158 25 dataset dataset NOUN bracis-33590 158 26 are be AUX bracis-33590 158 27 presented present VERB bracis-33590 158 28 in in ADP bracis-33590 158 29 appendix appendix PROPN bracis-33590 158 30     SPACE bracis-33590 158 31 d. d. PROPN bracis-33590 158 32 references reference NOUN bracis-33590 158 33 alaofi alaofi ADJ bracis-33590 158 34 , , PUNCT bracis-33590 158 35 m. m. NOUN bracis-33590 158 36 , , PUNCT bracis-33590 158 37 gallagher gallagher PROPN bracis-33590 158 38 , , PUNCT bracis-33590 158 39 l. l. PROPN bracis-33590 158 40 , , PUNCT bracis-33590 158 41 sanderson sanderson PROPN bracis-33590 158 42 , , PUNCT bracis-33590 158 43 m. m. NOUN bracis-33590 158 44 , , PUNCT bracis-33590 158 45 scholer scholer NOUN bracis-33590 158 46 , , PUNCT bracis-33590 158 47 f. f. PROPN bracis-33590 158 48 , , PUNCT bracis-33590 158 49 thomas thomas PROPN bracis-33590 158 50 , , PUNCT bracis-33590 158 51 p. p. NOUN bracis-33590 158 52 : : PUNCT bracis-33590 158 53 can can AUX bracis-33590 158 54 generative generative VERB bracis-33590 158 55 llms llm NOUN bracis-33590 158 56 create create VERB bracis-33590 158 57 query query NOUN bracis-33590 158 58 variants variant NOUN bracis-33590 158 59 for for ADP bracis-33590 158 60 test test NOUN bracis-33590 158 61 collections collection NOUN bracis-33590 158 62 ? ? PUNCT bracis-33590 159 1 an an DET bracis-33590 159 2 exploratory exploratory ADJ bracis-33590 159 3 study study NOUN bracis-33590 159 4 . . PUNCT bracis-33590 160 1 in in ADP bracis-33590 160 2 : : PUNCT bracis-33590 160 3 proceedings proceeding NOUN bracis-33590 160 4 of of ADP bracis-33590 160 5 the the DET bracis-33590 160 6 46th 46th ADJ bracis-33590 160 7 international international PROPN bracis-33590 160 8 acm acm PROPN bracis-33590 160 9 sigir sigir PROPN bracis-33590 160 10 conference conference PROPN bracis-33590 160 11 on on ADP bracis-33590 160 12 research research NOUN bracis-33590 160 13 and and CCONJ bracis-33590 160 14 development development NOUN bracis-33590 160 15 in in ADP bracis-33590 160 16 information information NOUN bracis-33590 160 17 retrieval retrieval NOUN bracis-33590 160 18 , , PUNCT bracis-33590 160 19 pp pp ADJ bracis-33590 160 20 . . PUNCT bracis-33590 161 1 1869–1873 1869–1873 X bracis-33590 161 2 . . PUNCT bracis-33590 162 1 sigir sigir PROPN bracis-33590 162 2 2023 2023 NUM bracis-33590 162 3 . . PUNCT bracis-33590 163 1 association association NOUN bracis-33590 163 2 for for ADP bracis-33590 163 3 computing compute VERB bracis-33590 163 4 machinery machinery NOUN bracis-33590 163 5 , , PUNCT bracis-33590 163 6 new new PROPN bracis-33590 163 7 york york PROPN bracis-33590 163 8 ( ( PUNCT bracis-33590 163 9 2023 2023 NUM bracis-33590 163 10 ) ) PUNCT bracis-33590 163 11 . . PUNCT bracis-33590 164 1 https://doi.org/10.1145/3539618.3591960 https://doi.org/10.1145/3539618.3591960 PROPN bracis-33590 164 2 bonifacio bonifacio PROPN bracis-33590 164 3 , , PUNCT bracis-33590 164 4 l. l. PROPN bracis-33590 164 5 , , PUNCT bracis-33590 164 6 abonizio abonizio PROPN bracis-33590 164 7 , , PUNCT bracis-33590 164 8 h. h. PROPN bracis-33590 164 9 , , PUNCT bracis-33590 164 10 fadaee fadaee PROPN bracis-33590 164 11 , , PUNCT bracis-33590 164 12 m. m. NOUN bracis-33590 164 13 , , PUNCT bracis-33590 164 14 nogueira nogueira PROPN bracis-33590 164 15 , , PUNCT bracis-33590 164 16 r. r. PROPN bracis-33590 164 17 : : PUNCT bracis-33590 164 18 inpars inpar NOUN bracis-33590 164 19 : : PUNCT bracis-33590 164 20 unsupervised unsupervised ADJ bracis-33590 164 21 dataset dataset NOUN bracis-33590 164 22 generation generation NOUN bracis-33590 164 23 for for ADP bracis-33590 164 24 information information NOUN bracis-33590 164 25 retrieval retrieval NOUN bracis-33590 164 26 . . PUNCT bracis-33590 165 1 in in ADP bracis-33590 165 2 : : PUNCT bracis-33590 165 3 proceedings proceeding NOUN bracis-33590 165 4 of of ADP bracis-33590 165 5 the the DET bracis-33590 165 6 45th 45th ADJ bracis-33590 165 7 international international PROPN bracis-33590 165 8 acm acm PROPN bracis-33590 165 9 sigir sigir PROPN bracis-33590 165 10 conference conference PROPN bracis-33590 165 11 on on ADP bracis-33590 165 12 research research NOUN bracis-33590 165 13 and and CCONJ bracis-33590 165 14 development development NOUN bracis-33590 165 15 in in ADP bracis-33590 165 16 information information NOUN bracis-33590 165 17 retrieval retrieval NOUN bracis-33590 165 18 , , PUNCT bracis-33590 165 19 pp pp ADP bracis-33590 165 20 . . PUNCT bracis-33590 165 21 2387–2392 2387–2392 NUM bracis-33590 165 22 . . PUNCT bracis-33590 165 23 sigir sigir PROPN bracis-33590 165 24 2022 2022 NUM bracis-33590 165 25 . . PUNCT bracis-33590 166 1 association association NOUN bracis-33590 166 2 for for ADP bracis-33590 166 3 computing compute VERB bracis-33590 166 4 machinery machinery NOUN bracis-33590 166 5 , , PUNCT bracis-33590 166 6 new new PROPN bracis-33590 166 7 york york PROPN bracis-33590 166 8 ( ( PUNCT bracis-33590 166 9 2022 2022 NUM bracis-33590 166 10 ) ) PUNCT bracis-33590 166 11 . . PUNCT bracis-33590 167 1 https://doi.org/10.1145/3477495.3531863 https://doi.org/10.1145/3477495.3531863 PROPN bracis-33590 167 2 bonifacio bonifacio PROPN bracis-33590 167 3 , , PUNCT bracis-33590 167 4 l. l. PROPN bracis-33590 167 5 , , PUNCT bracis-33590 167 6 campiotti campiotti PROPN bracis-33590 167 7 , , PUNCT bracis-33590 167 8 i. i. NOUN bracis-33590 167 9 , , PUNCT bracis-33590 167 10 de de NOUN bracis-33590 167 11     SPACE bracis-33590 167 12 alencar alencar PROPN bracis-33590 167 13     SPACE bracis-33590 167 14 lotufo lotufo PROPN bracis-33590 167 15 , , PUNCT bracis-33590 167 16 r. r. PROPN bracis-33590 167 17 , , PUNCT bracis-33590 167 18 nogueira nogueira PROPN bracis-33590 167 19 , , PUNCT bracis-33590 167 20 r.f r.f PROPN bracis-33590 167 21 . . PROPN bracis-33590 167 22 : : PUNCT bracis-33590 168 1 mmarco mmarco ADJ bracis-33590 168 2 : : PUNCT bracis-33590 168 3 a a DET bracis-33590 168 4 multilingual multilingual ADJ bracis-33590 168 5 version version NOUN bracis-33590 168 6 of of ADP bracis-33590 168 7 ms ms PROPN bracis-33590 168 8 marco marco PROPN bracis-33590 168 9 passage passage NOUN bracis-33590 168 10 ranking rank VERB bracis-33590 168 11 dataset dataset NOUN bracis-33590 168 12 . . PUNCT bracis-33590 169 1 corr corr PROPN bracis-33590 169 2 abs/2108.13897 abs/2108.13897 PROPN bracis-33590 169 3 ( ( PUNCT bracis-33590 169 4 2021 2021 NUM bracis-33590 169 5 ) ) PUNCT bracis-33590 169 6 . . PUNCT bracis-33590 170 1 https://arxiv.org/abs/2108.13897 https://arxiv.org/abs/2108.13897 PROPN bracis-33590 170 2 boytsov boytsov PROPN bracis-33590 170 3 , , PUNCT bracis-33590 170 4 l. l. PROPN bracis-33590 170 5 , , PUNCT bracis-33590 170 6 et et PROPN bracis-33590 170 7 al al PROPN bracis-33590 170 8 . . PROPN bracis-33590 170 9 : : PUNCT bracis-33590 171 1 inpars inpar NOUN bracis-33590 171 2 - - PUNCT bracis-33590 171 3 light light ADJ bracis-33590 171 4 : : PUNCT bracis-33590 171 5 cost cost NOUN bracis-33590 171 6 - - PUNCT bracis-33590 171 7 effective effective ADJ bracis-33590 171 8 unsupervised unsupervised ADJ bracis-33590 171 9 training training NOUN bracis-33590 171 10 of of ADP bracis-33590 171 11 efficient efficient ADJ bracis-33590 171 12 rankers ranker NOUN bracis-33590 171 13 ( ( PUNCT bracis-33590 171 14 2023 2023 NUM bracis-33590 171 15 ) ) PUNCT bracis-33590 171 16 google google NOUN bracis-33590 171 17 scholar scholar NOUN bracis-33590 171 18     SPACE bracis-33590 171 19 brown brown NOUN bracis-33590 171 20 , , PUNCT bracis-33590 171 21 t. t. PROPN bracis-33590 171 22 , , PUNCT bracis-33590 171 23 et et PROPN bracis-33590 171 24 al al PROPN bracis-33590 171 25 . . PUNCT bracis-33590 171 26 : : PUNCT bracis-33590 172 1 language language NOUN bracis-33590 172 2 models model NOUN bracis-33590 172 3 are be AUX bracis-33590 172 4 few few ADJ bracis-33590 172 5 - - PUNCT bracis-33590 172 6 shot shot NOUN bracis-33590 172 7 learners learner NOUN bracis-33590 172 8 . . PUNCT bracis-33590 173 1 in in ADP bracis-33590 173 2 : : PUNCT bracis-33590 173 3 larochelle larochelle PROPN bracis-33590 173 4 , , PUNCT bracis-33590 173 5 h. h. PROPN bracis-33590 173 6 , , PUNCT bracis-33590 173 7 ranzato ranzato NOUN bracis-33590 173 8 , , PUNCT bracis-33590 173 9 m. m. NOUN bracis-33590 173 10 , , PUNCT bracis-33590 173 11 hadsell hadsell PROPN bracis-33590 173 12 , , PUNCT bracis-33590 173 13 r. r. PROPN bracis-33590 173 14 , , PUNCT bracis-33590 173 15 balcan balcan PROPN bracis-33590 173 16 , , PUNCT bracis-33590 173 17 m. m. NOUN bracis-33590 173 18 , , PUNCT bracis-33590 173 19 lin lin PROPN bracis-33590 173 20 , , PUNCT bracis-33590 173 21 h. h. PROPN bracis-33590 173 22 ( ( PUNCT bracis-33590 173 23 eds eds PROPN bracis-33590 173 24 . . PUNCT bracis-33590 173 25 ) ) PUNCT bracis-33590 174 1 advances advance NOUN bracis-33590 174 2 in in ADP bracis-33590 174 3 neural neural ADJ bracis-33590 174 4 information information NOUN bracis-33590 174 5 processing processing NOUN bracis-33590 174 6 systems system NOUN bracis-33590 174 7 , , PUNCT bracis-33590 174 8 vol vol NOUN bracis-33590 174 9 . . PUNCT bracis-33590 174 10     SPACE bracis-33590 175 1 33 33 NUM bracis-33590 175 2 , , PUNCT bracis-33590 175 3 pp pp ADJ bracis-33590 175 4 . . PUNCT bracis-33590 175 5 1877–1901 1877–1901 NUM bracis-33590 175 6 . . PUNCT bracis-33590 176 1 curran curran PROPN bracis-33590 176 2 associates associates PROPN bracis-33590 176 3 , , PUNCT bracis-33590 176 4 inc inc PROPN bracis-33590 176 5 . . PROPN bracis-33590 176 6 ( ( PUNCT bracis-33590 176 7 2020 2020 NUM bracis-33590 176 8 ) ) PUNCT bracis-33590 176 9 . . PUNCT bracis-33590 177 1 https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-paper.pdf https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-paper.pdf PROPN bracis-33590 177 2 bueno bueno PROPN bracis-33590 177 3 , , PUNCT bracis-33590 177 4 m. m. NOUN bracis-33590 177 5 , , PUNCT bracis-33590 177 6 de de PROPN bracis-33590 177 7     SPACE bracis-33590 177 8 oliveira oliveira PROPN bracis-33590 177 9 , , PUNCT bracis-33590 177 10 e.s e.s PROPN bracis-33590 177 11 . . PROPN bracis-33590 177 12 , , PUNCT bracis-33590 177 13 nogueira nogueira PROPN bracis-33590 177 14 , , PUNCT bracis-33590 177 15 r. r. PROPN bracis-33590 177 16 , , PUNCT bracis-33590 177 17 lotufo lotufo PROPN bracis-33590 177 18 , , PUNCT bracis-33590 177 19 r.a r.a PROPN bracis-33590 177 20 . . PROPN bracis-33590 177 21 , , PUNCT bracis-33590 177 22 pereira pereira PROPN bracis-33590 177 23 , , PUNCT bracis-33590 177 24 j.a j.a PROPN bracis-33590 177 25 . . PROPN bracis-33590 177 26 : : PUNCT bracis-33590 178 1 quati quati NOUN bracis-33590 178 2 : : PUNCT bracis-33590 178 3 a a DET bracis-33590 178 4 brazilian brazilian ADJ bracis-33590 178 5 portuguese portuguese ADJ bracis-33590 178 6 information information NOUN bracis-33590 178 7 retrieval retrieval NOUN bracis-33590 178 8 dataset dataset NOUN bracis-33590 178 9 from from ADP bracis-33590 178 10 native native ADJ bracis-33590 178 11 speakers speaker NOUN bracis-33590 178 12 ( ( PUNCT bracis-33590 178 13 2024 2024 NUM bracis-33590 178 14 ) ) PUNCT bracis-33590 178 15 google google PROPN bracis-33590 178 16 scholar scholar NOUN bracis-33590 178 17     SPACE bracis-33590 178 18 carmo carmo PROPN bracis-33590 178 19 , , PUNCT bracis-33590 178 20 d. d. PROPN bracis-33590 178 21 , , PUNCT bracis-33590 178 22 piau piau NOUN bracis-33590 178 23 , , PUNCT bracis-33590 178 24 m. m. NOUN bracis-33590 178 25 , , PUNCT bracis-33590 178 26 campiotti campiotti PROPN bracis-33590 178 27 , , PUNCT bracis-33590 178 28 i. i. PROPN bracis-33590 178 29 , , PUNCT bracis-33590 178 30 nogueira nogueira PROPN bracis-33590 178 31 , , PUNCT bracis-33590 178 32 r. r. PROPN bracis-33590 178 33 , , PUNCT bracis-33590 178 34 lotufo lotufo PROPN bracis-33590 178 35 , , PUNCT bracis-33590 178 36 r. r. PROPN bracis-33590 178 37 : : PUNCT bracis-33590 178 38 ptt5 ptt5 PROPN bracis-33590 178 39 : : PUNCT bracis-33590 178 40 pretraining pretraine VERB bracis-33590 178 41 and and CCONJ bracis-33590 178 42 validating validate VERB bracis-33590 178 43 the the DET bracis-33590 178 44 t5 t5 PROPN bracis-33590 178 45 model model NOUN bracis-33590 178 46 on on ADP bracis-33590 178 47 brazilian brazilian ADJ bracis-33590 178 48 portuguese portuguese ADJ bracis-33590 178 49 data datum NOUN bracis-33590 178 50 ( ( PUNCT bracis-33590 178 51 2020 2020 NUM bracis-33590 178 52 ) ) PUNCT bracis-33590 178 53 google google PROPN bracis-33590 178 54 scholar scholar NOUN bracis-33590 178 55     SPACE bracis-33590 178 56 chowdhery chowdhery NOUN bracis-33590 178 57 , , PUNCT bracis-33590 178 58 a. a. PROPN bracis-33590 178 59 , , PUNCT bracis-33590 178 60 narang narang PROPN bracis-33590 178 61 , , PUNCT bracis-33590 178 62 s. s. PROPN bracis-33590 178 63 , , PUNCT bracis-33590 178 64 devlin devlin PROPN bracis-33590 178 65 , , PUNCT bracis-33590 178 66 j. j. PROPN bracis-33590 178 67 , , PUNCT bracis-33590 178 68 et et PROPN bracis-33590 178 69 . . PUNCT bracis-33590 179 1 al al PROPN bracis-33590 179 2 : : PUNCT bracis-33590 179 3 palm palm NOUN bracis-33590 179 4 : : PUNCT bracis-33590 179 5 scaling scale VERB bracis-33590 179 6 language language NOUN bracis-33590 179 7 modeling modeling NOUN bracis-33590 179 8 with with ADP bracis-33590 179 9 pathways pathway NOUN bracis-33590 179 10 ( ( PUNCT bracis-33590 179 11 2022 2022 NUM bracis-33590 179 12 ) ) PUNCT bracis-33590 179 13 google google PROPN bracis-33590 179 14 scholar scholar NOUN bracis-33590 179 15     SPACE bracis-33590 179 16 chung chung PROPN bracis-33590 179 17 , , PUNCT bracis-33590 179 18 h.w h.w PROPN bracis-33590 179 19 . . PROPN bracis-33590 179 20 , , PUNCT bracis-33590 179 21 et et PROPN bracis-33590 179 22 al al PROPN bracis-33590 179 23 . . PUNCT bracis-33590 179 24 : : PUNCT bracis-33590 179 25 scaling scale VERB bracis-33590 179 26 instruction instruction NOUN bracis-33590 179 27 - - PUNCT bracis-33590 179 28 finetuned finetune VERB bracis-33590 179 29 language language NOUN bracis-33590 179 30 models model NOUN bracis-33590 179 31 ( ( PUNCT bracis-33590 179 32 2022 2022 NUM bracis-33590 179 33 ) ) PUNCT bracis-33590 179 34 google google NOUN bracis-33590 179 35 scholar scholar NOUN bracis-33590 179 36     SPACE bracis-33590 179 37 craswell craswell ADJ bracis-33590 179 38 , , PUNCT bracis-33590 179 39 n. n. NOUN bracis-33590 179 40 , , PUNCT bracis-33590 179 41 mitra mitra PROPN bracis-33590 179 42 , , PUNCT bracis-33590 179 43 b. b. PROPN bracis-33590 179 44 , , PUNCT bracis-33590 179 45 yilmaz yilmaz PROPN bracis-33590 179 46 , , PUNCT bracis-33590 179 47 e. e. PROPN bracis-33590 179 48 , , PUNCT bracis-33590 179 49 campos campos PROPN bracis-33590 179 50 , , PUNCT bracis-33590 179 51 d. d. PROPN bracis-33590 179 52 : : PUNCT bracis-33590 179 53 overview overview NOUN bracis-33590 179 54 of of ADP bracis-33590 179 55 the the DET bracis-33590 179 56 trec trec PROPN bracis-33590 179 57 2020 2020 NUM bracis-33590 179 58 deep deep ADJ bracis-33590 179 59 learning learning NOUN bracis-33590 179 60 track track NOUN bracis-33590 179 61 ( ( PUNCT bracis-33590 179 62 2021 2021 NUM bracis-33590 179 63 ) ) PUNCT bracis-33590 179 64 google google NOUN bracis-33590 179 65 scholar scholar NOUN bracis-33590 179 66     SPACE bracis-33590 179 67 craswell craswell ADJ bracis-33590 179 68 , , PUNCT bracis-33590 179 69 n. n. NOUN bracis-33590 179 70 , , PUNCT bracis-33590 179 71 mitra mitra PROPN bracis-33590 179 72 , , PUNCT bracis-33590 179 73 b. b. PROPN bracis-33590 179 74 , , PUNCT bracis-33590 179 75 yilmaz yilmaz PROPN bracis-33590 179 76 , , PUNCT bracis-33590 179 77 e. e. PROPN bracis-33590 179 78 , , PUNCT bracis-33590 179 79 campos campos PROPN bracis-33590 179 80 , , PUNCT bracis-33590 179 81 d. d. PROPN bracis-33590 179 82 , , PUNCT bracis-33590 179 83 lin lin PROPN bracis-33590 179 84 , , PUNCT bracis-33590 179 85 j. j. PROPN bracis-33590 179 86 : : PUNCT bracis-33590 179 87 overview overview NOUN bracis-33590 179 88 of of ADP bracis-33590 179 89 the the DET bracis-33590 179 90 trec trec PROPN bracis-33590 179 91 2021 2021 NUM bracis-33590 179 92 deep deep ADJ bracis-33590 179 93 learning learning NOUN bracis-33590 179 94 track track NOUN bracis-33590 179 95 . . PUNCT bracis-33590 180 1 in in ADP bracis-33590 180 2 : : PUNCT bracis-33590 180 3 soboroff soboroff PROPN bracis-33590 180 4 , , PUNCT bracis-33590 180 5 i. i. PROPN bracis-33590 180 6 , , PUNCT bracis-33590 180 7 ellis ellis PROPN bracis-33590 180 8 , , PUNCT bracis-33590 180 9 a. a. PROPN bracis-33590 180 10 ( ( PUNCT bracis-33590 180 11 eds eds PROPN bracis-33590 180 12 . . PUNCT bracis-33590 180 13 ) ) PUNCT bracis-33590 180 14 proceedings proceeding NOUN bracis-33590 180 15 of of ADP bracis-33590 180 16 the the DET bracis-33590 180 17 thirtieth thirtieth ADJ bracis-33590 180 18 text text NOUN bracis-33590 180 19 retrieval retrieval NOUN bracis-33590 180 20 conference conference NOUN bracis-33590 180 21 , , PUNCT bracis-33590 180 22 trec trec PROPN bracis-33590 180 23 2021 2021 NUM bracis-33590 180 24 , , PUNCT bracis-33590 180 25 online online INTJ bracis-33590 180 26 , , PUNCT bracis-33590 180 27 15–19 15–19 PROPN bracis-33590 180 28 november november PROPN bracis-33590 180 29 2021 2021 NUM bracis-33590 180 30 . . PUNCT bracis-33590 181 1 nist nist PROPN bracis-33590 181 2 special special ADJ bracis-33590 181 3 publication publication NOUN bracis-33590 181 4 , , PUNCT bracis-33590 181 5 vol vol NOUN bracis-33590 181 6 . . PROPN bracis-33590 182 1 500 500 NUM bracis-33590 182 2 - - SYM bracis-33590 182 3 335 335 NUM bracis-33590 182 4 . . PUNCT bracis-33590 183 1 national national PROPN bracis-33590 183 2 institute institute PROPN bracis-33590 183 3 of of ADP bracis-33590 183 4 standards standard NOUN bracis-33590 183 5 and and CCONJ bracis-33590 183 6 technology technology NOUN bracis-33590 183 7 ( ( PUNCT bracis-33590 183 8 nist nist NOUN bracis-33590 183 9 ) ) PUNCT bracis-33590 183 10 ( ( PUNCT bracis-33590 183 11 2021 2021 NUM bracis-33590 183 12 ) ) PUNCT bracis-33590 183 13 . . PUNCT bracis-33590 184 1 https://trec.nist.gov/pubs/trec30/papers/overview-dl.pdf https://trec.nist.gov/pubs/trec30/papers/overview-dl.pdf NOUN bracis-33590 184 2 craswell craswell NOUN bracis-33590 184 3 , , PUNCT bracis-33590 184 4 n. n. NOUN bracis-33590 184 5 , , PUNCT bracis-33590 184 6 et et PROPN bracis-33590 184 7 al al PROPN bracis-33590 184 8 . . PUNCT bracis-33590 184 9 : : PUNCT bracis-33590 185 1 overview overview NOUN bracis-33590 185 2 of of ADP bracis-33590 185 3 the the DET bracis-33590 185 4 trec trec PROPN bracis-33590 185 5 2022 2022 NUM bracis-33590 185 6 deep deep ADJ bracis-33590 185 7 learning learning NOUN bracis-33590 185 8 track track NOUN bracis-33590 185 9 . . PUNCT bracis-33590 186 1 in in ADP bracis-33590 186 2 : : PUNCT bracis-33590 186 3 soboroff soboroff PROPN bracis-33590 186 4 , , PUNCT bracis-33590 186 5 i. i. PROPN bracis-33590 186 6 , , PUNCT bracis-33590 186 7 ellis ellis PROPN bracis-33590 186 8 , , PUNCT bracis-33590 186 9 a. a. PROPN bracis-33590 186 10 ( ( PUNCT bracis-33590 186 11 eds eds PROPN bracis-33590 186 12 . . PUNCT bracis-33590 186 13 ) ) PUNCT bracis-33590 186 14 proceedings proceeding NOUN bracis-33590 186 15 of of ADP bracis-33590 186 16 the the DET bracis-33590 186 17 thirty thirty NUM bracis-33590 186 18 - - PUNCT bracis-33590 186 19 first first ADJ bracis-33590 186 20 text text NOUN bracis-33590 186 21 retrieval retrieval NOUN bracis-33590 186 22 conference conference NOUN bracis-33590 186 23 , , PUNCT bracis-33590 186 24 trec trec PROPN bracis-33590 186 25 2022 2022 NUM bracis-33590 186 26 , , PUNCT bracis-33590 186 27 online online INTJ bracis-33590 186 28 , , PUNCT bracis-33590 186 29 15–19 15–19 PROPN bracis-33590 186 30 november november PROPN bracis-33590 186 31 2022 2022 NUM bracis-33590 186 32 . . PUNCT bracis-33590 187 1 nist nist PROPN bracis-33590 187 2 special special ADJ bracis-33590 187 3 publication publication NOUN bracis-33590 187 4 , , PUNCT bracis-33590 187 5 vol vol NOUN bracis-33590 187 6 . . PROPN bracis-33590 188 1 500 500 NUM bracis-33590 188 2 - - SYM bracis-33590 188 3 338 338 NUM bracis-33590 188 4 . . PUNCT bracis-33590 189 1 national national PROPN bracis-33590 189 2 institute institute PROPN bracis-33590 189 3 of of ADP bracis-33590 189 4 standards standard NOUN bracis-33590 189 5 and and CCONJ bracis-33590 189 6 technology technology NOUN bracis-33590 189 7 ( ( PUNCT bracis-33590 189 8 nist nist NOUN bracis-33590 189 9 ) ) PUNCT bracis-33590 189 10 ( ( PUNCT bracis-33590 189 11 2022 2022 NUM bracis-33590 189 12 ) ) PUNCT bracis-33590 189 13 . . PUNCT bracis-33590 190 1 https://trec.nist.gov/pubs/trec31/papers/overview_deep.pdf https://trec.nist.gov/pubs/trec31/papers/overview_deep.pdf PROPN bracis-33590 190 2 dai dai PROPN bracis-33590 190 3 , , PUNCT bracis-33590 190 4 z. z. PROPN bracis-33590 190 5 , , PUNCT bracis-33590 190 6 et et PROPN bracis-33590 190 7 al al PROPN bracis-33590 190 8 . . PUNCT bracis-33590 190 9 : : PUNCT bracis-33590 190 10 promptagator promptagator NOUN bracis-33590 190 11 : : PUNCT bracis-33590 190 12 few few ADJ bracis-33590 190 13 - - PUNCT bracis-33590 190 14 shot shoot VERB bracis-33590 190 15 dense dense ADJ bracis-33590 190 16 retrieval retrieval NOUN bracis-33590 190 17 from from ADP bracis-33590 190 18 8 8 NUM bracis-33590 190 19 examples example NOUN bracis-33590 190 20 . . PUNCT bracis-33590 191 1 in in ADP bracis-33590 191 2 : : PUNCT bracis-33590 191 3 the the DET bracis-33590 191 4 eleventh eleventh ADJ bracis-33590 191 5 international international ADJ bracis-33590 191 6 conference conference NOUN bracis-33590 191 7 on on ADP bracis-33590 191 8 learning learn VERB bracis-33590 191 9 representations representation NOUN bracis-33590 191 10 ( ( PUNCT bracis-33590 191 11 2023 2023 NUM bracis-33590 191 12 ) ) PUNCT bracis-33590 191 13 . . PUNCT bracis-33590 192 1 https://openreview.net/forum?id=gml46ympu2j https://openreview.net/forum?id=gml46ympu2j NOUN bracis-33590 192 2 formal formal ADJ bracis-33590 192 3 , , PUNCT bracis-33590 192 4 t. t. PROPN bracis-33590 192 5 , , PUNCT bracis-33590 192 6 lassance lassance PROPN bracis-33590 192 7 , , PUNCT bracis-33590 192 8 c. c. NOUN bracis-33590 192 9 , , PUNCT bracis-33590 192 10 piwowarski piwowarski PROPN bracis-33590 192 11 , , PUNCT bracis-33590 192 12 b. b. PROPN bracis-33590 192 13 , , PUNCT bracis-33590 192 14 clinchant clinchant PROPN bracis-33590 192 15 , , PUNCT bracis-33590 192 16 s. s. PROPN bracis-33590 192 17 : : PUNCT bracis-33590 192 18 from from ADP bracis-33590 192 19 distillation distillation NOUN bracis-33590 192 20 to to ADP bracis-33590 192 21 hard hard ADJ bracis-33590 192 22 negative negative ADJ bracis-33590 192 23 sampling sampling NOUN bracis-33590 192 24 : : PUNCT bracis-33590 192 25 making make VERB bracis-33590 192 26 sparse sparse ADJ bracis-33590 192 27 neural neural ADJ bracis-33590 192 28 ir ir NOUN bracis-33590 192 29 models model NOUN bracis-33590 192 30 more more ADV bracis-33590 192 31 effective effective ADJ bracis-33590 192 32 . . PUNCT bracis-33590 193 1 in in ADP bracis-33590 193 2 : : PUNCT bracis-33590 193 3 proceedings proceeding NOUN bracis-33590 193 4 of of ADP bracis-33590 193 5 the the DET bracis-33590 193 6 45th 45th ADJ bracis-33590 193 7 international international PROPN bracis-33590 193 8 acm acm PROPN bracis-33590 193 9 sigir sigir PROPN bracis-33590 193 10 conference conference PROPN bracis-33590 193 11 on on ADP bracis-33590 193 12 research research NOUN bracis-33590 193 13 and and CCONJ bracis-33590 193 14 development development NOUN bracis-33590 193 15 in in ADP bracis-33590 193 16 information information NOUN bracis-33590 193 17 retrieval retrieval NOUN bracis-33590 193 18 , , PUNCT bracis-33590 193 19 pp pp ADP bracis-33590 193 20 . . PUNCT bracis-33590 193 21 2353–2359 2353–2359 NUM bracis-33590 193 22 . . PUNCT bracis-33590 194 1 sigir sigir PROPN bracis-33590 194 2 2022 2022 NUM bracis-33590 194 3 . . PUNCT bracis-33590 195 1 association association NOUN bracis-33590 195 2 for for ADP bracis-33590 195 3 computing compute VERB bracis-33590 195 4 machinery machinery NOUN bracis-33590 195 5 , , PUNCT bracis-33590 195 6 new new PROPN bracis-33590 195 7 york york PROPN bracis-33590 195 8 ( ( PUNCT bracis-33590 195 9 2022 2022 NUM bracis-33590 195 10 ) ) PUNCT bracis-33590 195 11 . . PUNCT bracis-33590 196 1 https://doi.org/10.1145/3477495.3531857 https://doi.org/10.1145/3477495.3531857 PROPN bracis-33590 196 2 fu fu PROPN bracis-33590 196 3 , , PUNCT bracis-33590 196 4 y. y. PROPN bracis-33590 196 5 , , PUNCT bracis-33590 196 6 peng peng PROPN bracis-33590 196 7 , , PUNCT bracis-33590 196 8 h. h. PROPN bracis-33590 196 9 , , PUNCT bracis-33590 196 10 ou ou PROPN bracis-33590 196 11 , , PUNCT bracis-33590 196 12 l. l. PROPN bracis-33590 196 13 , , PUNCT bracis-33590 196 14 sabharwal sabharwal PROPN bracis-33590 196 15 , , PUNCT bracis-33590 196 16 a. a. NOUN bracis-33590 196 17 , , PUNCT bracis-33590 196 18 khot khot ADJ bracis-33590 196 19 , , PUNCT bracis-33590 196 20 t. t. PROPN bracis-33590 196 21 : : PUNCT bracis-33590 196 22 specializing specialize VERB bracis-33590 196 23 smaller small ADJ bracis-33590 196 24 language language NOUN bracis-33590 196 25 models model NOUN bracis-33590 196 26 towards towards ADP bracis-33590 196 27 multi multi ADJ bracis-33590 196 28 - - ADJ bracis-33590 196 29 step step ADJ bracis-33590 196 30 reasoning reasoning NOUN bracis-33590 196 31 . . PUNCT bracis-33590 197 1 in in ADP bracis-33590 197 2 : : PUNCT bracis-33590 197 3 krause krause PROPN bracis-33590 197 4 , , PUNCT bracis-33590 197 5 a. a. NOUN bracis-33590 197 6 , , PUNCT bracis-33590 197 7 brunskill brunskill NOUN bracis-33590 197 8 , , PUNCT bracis-33590 197 9 e. e. PROPN bracis-33590 197 10 , , PUNCT bracis-33590 197 11 cho cho PROPN bracis-33590 197 12 , , PUNCT bracis-33590 197 13 k. k. PROPN bracis-33590 197 14 , , PUNCT bracis-33590 197 15 engelhardt engelhardt PROPN bracis-33590 197 16 , , PUNCT bracis-33590 197 17 b. b. PROPN bracis-33590 197 18 , , PUNCT bracis-33590 197 19 sabato sabato PROPN bracis-33590 197 20 , , PUNCT bracis-33590 197 21 s. s. PROPN bracis-33590 197 22 , , PUNCT bracis-33590 197 23 scarlett scarlett PROPN bracis-33590 197 24 , , PUNCT bracis-33590 197 25 j. j. PROPN bracis-33590 197 26 ( ( PUNCT bracis-33590 197 27 eds eds PROPN bracis-33590 197 28 . . PUNCT bracis-33590 197 29 ) ) PUNCT bracis-33590 197 30 proceedings proceeding NOUN bracis-33590 197 31 of of ADP bracis-33590 197 32 the the DET bracis-33590 197 33 40th 40th ADJ bracis-33590 197 34 international international ADJ bracis-33590 197 35 conference conference NOUN bracis-33590 197 36 on on ADP bracis-33590 197 37 machine machine NOUN bracis-33590 197 38 learning learning NOUN bracis-33590 197 39 . . PUNCT bracis-33590 198 1 proceedings proceeding NOUN bracis-33590 198 2 of of ADP bracis-33590 198 3 machine machine NOUN bracis-33590 198 4 learning learn VERB bracis-33590 198 5 research research NOUN bracis-33590 198 6 , , PUNCT bracis-33590 198 7 vol vol NOUN bracis-33590 198 8 . . PUNCT bracis-33590 198 9     SPACE bracis-33590 198 10 202 202 NUM bracis-33590 198 11 , , PUNCT bracis-33590 198 12 pp pp ADJ bracis-33590 198 13 . . PUNCT bracis-33590 198 14 10421–10430 10421–10430 NUM bracis-33590 198 15 . . PUNCT bracis-33590 198 16 pmlr pmlr NOUN bracis-33590 198 17 ( ( PUNCT bracis-33590 198 18 2023 2023 NUM bracis-33590 198 19 ) ) PUNCT bracis-33590 198 20 . . PUNCT bracis-33590 199 1 https://proceedings.mlr.press/v202/fu23d.html https://proceedings.mlr.press/v202/fu23d.html PROPN bracis-33590 199 2 hashemi hashemi PROPN bracis-33590 199 3 , , PUNCT bracis-33590 199 4 h. h. PROPN bracis-33590 199 5 , , PUNCT bracis-33590 199 6 zhuang zhuang PROPN bracis-33590 199 7 , , PUNCT bracis-33590 199 8 y. y. PROPN bracis-33590 199 9 , , PUNCT bracis-33590 199 10 kothur kothur NOUN bracis-33590 199 11 , , PUNCT bracis-33590 199 12 s.s.r s.s.r NOUN bracis-33590 199 13 . . PROPN bracis-33590 199 14 , , PUNCT bracis-33590 199 15 prasad prasad PROPN bracis-33590 199 16 , , PUNCT bracis-33590 199 17 s. s. PROPN bracis-33590 199 18 , , PUNCT bracis-33590 199 19 meij meij PROPN bracis-33590 199 20 , , PUNCT bracis-33590 199 21 e. e. PROPN bracis-33590 199 22 , , PUNCT bracis-33590 199 23 croft croft PROPN bracis-33590 199 24 , , PUNCT bracis-33590 199 25 w.b w.b PROPN bracis-33590 199 26 . . PROPN bracis-33590 199 27 : : PUNCT bracis-33590 199 28 dense dense ADJ bracis-33590 199 29 retrieval retrieval NOUN bracis-33590 199 30 adaptation adaptation NOUN bracis-33590 199 31 using use VERB bracis-33590 199 32 target target NOUN bracis-33590 199 33 domain domain NOUN bracis-33590 199 34 description description NOUN bracis-33590 199 35 . . PUNCT bracis-33590 200 1 in in ADP bracis-33590 200 2 : : PUNCT bracis-33590 200 3 proceedings proceeding NOUN bracis-33590 200 4 of of ADP bracis-33590 200 5 the the DET bracis-33590 200 6 2023 2023 NUM bracis-33590 200 7 acm acm PROPN bracis-33590 200 8 sigir sigir PROPN bracis-33590 200 9 international international PROPN bracis-33590 200 10 conference conference NOUN bracis-33590 200 11 on on ADP bracis-33590 200 12 theory theory NOUN bracis-33590 200 13 of of ADP bracis-33590 200 14 information information NOUN bracis-33590 200 15 retrieval retrieval NOUN bracis-33590 200 16 , , PUNCT bracis-33590 200 17 pp pp ADV bracis-33590 200 18 . . PUNCT bracis-33590 201 1 95–104 95–104 PROPN bracis-33590 201 2 . . PUNCT bracis-33590 201 3 ictir ictir PROPN bracis-33590 201 4 2023 2023 NUM bracis-33590 201 5 . . PUNCT bracis-33590 202 1 association association NOUN bracis-33590 202 2 for for ADP bracis-33590 202 3 computing compute VERB bracis-33590 202 4 machinery machinery NOUN bracis-33590 202 5 , , PUNCT bracis-33590 202 6 new new PROPN bracis-33590 202 7 york york PROPN bracis-33590 202 8 ( ( PUNCT bracis-33590 202 9 2023 2023 NUM bracis-33590 202 10 ) ) PUNCT bracis-33590 202 11 . . PUNCT bracis-33590 203 1 https://doi.org/10.1145/3578337.3605127 https://doi.org/10.1145/3578337.3605127 PROPN bracis-33590 203 2 hinton hinton PROPN bracis-33590 203 3 , , PUNCT bracis-33590 203 4 g. g. PROPN bracis-33590 203 5 , , PUNCT bracis-33590 203 6 vinyals vinyal NOUN bracis-33590 203 7 , , PUNCT bracis-33590 203 8 o. o. PROPN bracis-33590 203 9 , , PUNCT bracis-33590 203 10 dean dean PROPN bracis-33590 203 11 , , PUNCT bracis-33590 203 12 j. j. PROPN bracis-33590 203 13 : : PUNCT bracis-33590 203 14 distilling distil VERB bracis-33590 203 15 the the DET bracis-33590 203 16 knowledge knowledge NOUN bracis-33590 203 17 in in ADP bracis-33590 203 18 a a DET bracis-33590 203 19 neural neural ADJ bracis-33590 203 20 network network NOUN bracis-33590 203 21 ( ( PUNCT bracis-33590 203 22 2015 2015 NUM bracis-33590 203 23 ) ) PUNCT bracis-33590 203 24 google google PROPN bracis-33590 203 25 scholar scholar NOUN bracis-33590 203 26     SPACE bracis-33590 203 27 hofstätter hofstätter NOUN bracis-33590 203 28 , , PUNCT bracis-33590 203 29 s. s. PROPN bracis-33590 203 30 , , PUNCT bracis-33590 203 31 althammer althammer PROPN bracis-33590 203 32 , , PUNCT bracis-33590 203 33 s. s. PROPN bracis-33590 203 34 , , PUNCT bracis-33590 203 35 schröder schröder NOUN bracis-33590 203 36 , , PUNCT bracis-33590 203 37 m. m. NOUN bracis-33590 203 38 , , PUNCT bracis-33590 203 39 sertkan sertkan PROPN bracis-33590 203 40 , , PUNCT bracis-33590 203 41 m. m. NOUN bracis-33590 203 42 , , PUNCT bracis-33590 203 43 hanbury hanbury PROPN bracis-33590 203 44 , , PUNCT bracis-33590 203 45 a. a. NOUN bracis-33590 203 46 : : PUNCT bracis-33590 203 47 improving improve VERB bracis-33590 203 48 efficient efficient ADJ bracis-33590 203 49 neural neural ADJ bracis-33590 203 50 ranking rank VERB bracis-33590 203 51 models model NOUN bracis-33590 203 52 with with ADP bracis-33590 203 53 cross cross ADJ bracis-33590 203 54 - - ADJ bracis-33590 203 55 architecture architecture ADJ bracis-33590 203 56 knowledge knowledge NOUN bracis-33590 203 57 distillation distillation NOUN bracis-33590 203 58 ( ( PUNCT bracis-33590 203 59 2020 2020 NUM bracis-33590 203 60 ) ) PUNCT bracis-33590 203 61 google google PROPN bracis-33590 203 62 scholar scholar NOUN bracis-33590 203 63     SPACE bracis-33590 203 64 jeronymo jeronymo NOUN bracis-33590 203 65 , , PUNCT bracis-33590 203 66 v. v. ADV bracis-33590 203 67 , , PUNCT bracis-33590 203 68 et et PROPN bracis-33590 203 69 al al PROPN bracis-33590 203 70 . . PROPN bracis-33590 203 71 : : PUNCT bracis-33590 204 1 inpars inpar NOUN bracis-33590 204 2 - - PUNCT bracis-33590 204 3 v2 v2 NOUN bracis-33590 204 4 : : PUNCT bracis-33590 204 5 large large ADJ bracis-33590 204 6 language language NOUN bracis-33590 204 7 models model NOUN bracis-33590 204 8 as as ADP bracis-33590 204 9 efficient efficient ADJ bracis-33590 204 10 dataset dataset NOUN bracis-33590 204 11 generators generator NOUN bracis-33590 204 12 for for ADP bracis-33590 204 13 information information NOUN bracis-33590 204 14 retrieval retrieval NOUN bracis-33590 204 15 ( ( PUNCT bracis-33590 204 16 2023 2023 NUM bracis-33590 204 17 ) ) PUNCT bracis-33590 204 18 google google NOUN bracis-33590 204 19 scholar scholar NOUN bracis-33590 204 20     SPACE bracis-33590 204 21 magister magister NOUN bracis-33590 204 22 , , PUNCT bracis-33590 204 23 l.c l.c PROPN bracis-33590 204 24 . . PROPN bracis-33590 204 25 , , PUNCT bracis-33590 204 26 mallinson mallinson PROPN bracis-33590 204 27 , , PUNCT bracis-33590 204 28 j. j. PROPN bracis-33590 204 29 , , PUNCT bracis-33590 204 30 adamek adamek PROPN bracis-33590 204 31 , , PUNCT bracis-33590 204 32 j. j. PROPN bracis-33590 204 33 , , PUNCT bracis-33590 204 34 malmi malmi PROPN bracis-33590 204 35 , , PUNCT bracis-33590 204 36 e. e. PROPN bracis-33590 204 37 , , PUNCT bracis-33590 204 38 severyn severyn PROPN bracis-33590 204 39 , , PUNCT bracis-33590 204 40 a. a. NOUN bracis-33590 204 41 : : PUNCT bracis-33590 204 42 teaching teach VERB bracis-33590 204 43 small small ADJ bracis-33590 204 44 language language NOUN bracis-33590 204 45 models model NOUN bracis-33590 204 46 to to PART bracis-33590 204 47 reason reason VERB bracis-33590 204 48 . . PUNCT bracis-33590 205 1 in in ADP bracis-33590 205 2 : : PUNCT bracis-33590 205 3 rogers roger NOUN bracis-33590 205 4 , , PUNCT bracis-33590 205 5 a. a. PROPN bracis-33590 205 6 , , PUNCT bracis-33590 205 7 boyd boyd NOUN bracis-33590 205 8 - - PUNCT bracis-33590 205 9 graber graber PROPN bracis-33590 205 10 , , PUNCT bracis-33590 205 11 j. j. PROPN bracis-33590 205 12 , , PUNCT bracis-33590 205 13 okazaki okazaki PROPN bracis-33590 205 14 , , PUNCT bracis-33590 205 15 n. n. PROPN bracis-33590 205 16 ( ( PUNCT bracis-33590 205 17 eds ed NOUN bracis-33590 205 18 . . PUNCT bracis-33590 205 19 ) ) PUNCT bracis-33590 205 20 proceedings proceeding NOUN bracis-33590 205 21 of of ADP bracis-33590 205 22 the the DET bracis-33590 205 23 61st 61st ADJ bracis-33590 205 24 annual annual ADJ bracis-33590 205 25 meeting meeting NOUN bracis-33590 205 26 of of ADP bracis-33590 205 27 the the DET bracis-33590 205 28 association association NOUN bracis-33590 205 29 for for ADP bracis-33590 205 30 computational computational ADJ bracis-33590 205 31 linguistics linguistic NOUN bracis-33590 205 32 ( ( PUNCT bracis-33590 205 33 volume volume NOUN bracis-33590 205 34 2 2 NUM bracis-33590 205 35 : : PUNCT bracis-33590 205 36 short short ADJ bracis-33590 205 37 papers paper NOUN bracis-33590 205 38 ) ) PUNCT bracis-33590 205 39 , , PUNCT bracis-33590 205 40 pp pp ADP bracis-33590 205 41 . . PUNCT bracis-33590 206 1 1773–1781 1773–1781 NUM bracis-33590 206 2 . . X bracis-33590 206 3 association association NOUN bracis-33590 206 4 for for ADP bracis-33590 206 5 computational computational ADJ bracis-33590 206 6 linguistics linguistic NOUN bracis-33590 206 7 , , PUNCT bracis-33590 206 8 toronto toronto PROPN bracis-33590 206 9 , , PUNCT bracis-33590 206 10 canada canada PROPN bracis-33590 206 11 ( ( PUNCT bracis-33590 206 12 2023 2023 NUM bracis-33590 206 13 ) ) PUNCT bracis-33590 206 14 . . PUNCT bracis-33590 207 1 https://doi.org/10.18653/v1/2023.acl-short.151 https://doi.org/10.18653/v1/2023.acl-short.151 PROPN bracis-33590 207 2 . . PUNCT bracis-33590 208 1 https://aclanthology.org/2023.acl-short.151 https://aclanthology.org/2023.acl-short.151 PROPN bracis-33590 208 2 muhamed muhamed PROPN bracis-33590 208 3 , , PUNCT bracis-33590 208 4 a. a. PROPN bracis-33590 208 5 , , PUNCT bracis-33590 208 6 et et PROPN bracis-33590 208 7 al al PROPN bracis-33590 208 8 . . PROPN bracis-33590 208 9 : : PUNCT bracis-33590 209 1 ctr ctr PROPN bracis-33590 209 2 - - PUNCT bracis-33590 209 3 bert bert PROPN bracis-33590 209 4 : : PUNCT bracis-33590 209 5 cost cost NOUN bracis-33590 209 6 - - PUNCT bracis-33590 209 7 effective effective ADJ bracis-33590 209 8 knowledge knowledge NOUN bracis-33590 209 9 distillation distillation NOUN bracis-33590 209 10 for for ADP bracis-33590 209 11 billion billion NUM bracis-33590 209 12 - - PUNCT bracis-33590 209 13 parameter parameter NOUN bracis-33590 209 14 teacher teacher NOUN bracis-33590 209 15 models model NOUN bracis-33590 209 16 . . PUNCT bracis-33590 210 1 in in ADP bracis-33590 210 2 : : PUNCT bracis-33590 210 3 neurips neurip NOUN bracis-33590 210 4 efficient efficient ADJ bracis-33590 210 5 natural natural ADJ bracis-33590 210 6 language language NOUN bracis-33590 210 7 and and CCONJ bracis-33590 210 8 speech speech NOUN bracis-33590 210 9 processing processing NOUN bracis-33590 210 10 workshop workshop NOUN bracis-33590 210 11 ( ( PUNCT bracis-33590 210 12 2021 2021 NUM bracis-33590 210 13 ) ) PUNCT bracis-33590 210 14 google google NOUN bracis-33590 210 15 scholar scholar NOUN bracis-33590 210 16     SPACE bracis-33590 210 17 neelakantan neelakantan NOUN bracis-33590 210 18 , , PUNCT bracis-33590 210 19 a. a. PROPN bracis-33590 210 20 , , PUNCT bracis-33590 210 21 et et PROPN bracis-33590 210 22 al al PROPN bracis-33590 210 23 . . PUNCT bracis-33590 210 24 : : PUNCT bracis-33590 211 1 text text NOUN bracis-33590 211 2 and and CCONJ bracis-33590 211 3 code code NOUN bracis-33590 211 4 embeddings embedding NOUN bracis-33590 211 5 by by ADP bracis-33590 211 6 contrastive contrastive ADJ bracis-33590 211 7 pre pre NOUN bracis-33590 211 8 - - NOUN bracis-33590 211 9 training training ADJ bracis-33590 211 10 ( ( PUNCT bracis-33590 211 11 2022 2022 NUM bracis-33590 211 12 ) ) PUNCT bracis-33590 211 13 google google NOUN bracis-33590 211 14 scholar scholar NOUN bracis-33590 211 15     SPACE bracis-33590 211 16 nguyen nguyen NOUN bracis-33590 211 17 , , PUNCT bracis-33590 211 18 t. t. PROPN bracis-33590 211 19 , , PUNCT bracis-33590 211 20 et et PROPN bracis-33590 211 21 al al PROPN bracis-33590 211 22 . . PUNCT bracis-33590 211 23 : : PUNCT bracis-33590 212 1 ms ms PROPN bracis-33590 212 2 marco marco PROPN bracis-33590 212 3 : : PUNCT bracis-33590 212 4 a a DET bracis-33590 212 5 human human ADJ bracis-33590 212 6 generated generate VERB bracis-33590 212 7 machine machine NOUN bracis-33590 212 8 reading reading NOUN bracis-33590 212 9 comprehension comprehension NOUN bracis-33590 212 10 dataset dataset NOUN bracis-33590 212 11 ( ( PUNCT bracis-33590 212 12 2016 2016 NUM bracis-33590 212 13 ) ) PUNCT bracis-33590 212 14 google google PROPN bracis-33590 212 15 scholar scholar NOUN bracis-33590 212 16     SPACE bracis-33590 212 17 ni ni PROPN bracis-33590 212 18 , , PUNCT bracis-33590 212 19 j. j. PROPN bracis-33590 212 20 , , PUNCT bracis-33590 212 21 et et PROPN bracis-33590 212 22 al al PROPN bracis-33590 212 23 . . PUNCT bracis-33590 212 24 : : PUNCT bracis-33590 213 1 large large ADJ bracis-33590 213 2 dual dual ADJ bracis-33590 213 3 encoders encoder NOUN bracis-33590 213 4 are be AUX bracis-33590 213 5 generalizable generalizable ADJ bracis-33590 213 6 retrievers retriever NOUN bracis-33590 213 7 . . PUNCT bracis-33590 214 1 in in ADP bracis-33590 214 2 : : PUNCT bracis-33590 214 3 goldberg goldberg PROPN bracis-33590 214 4 , , PUNCT bracis-33590 214 5 y. y. PROPN bracis-33590 214 6 , , PUNCT bracis-33590 214 7 kozareva kozareva PROPN bracis-33590 214 8 , , PUNCT bracis-33590 214 9 z. z. PROPN bracis-33590 214 10 , , PUNCT bracis-33590 214 11 zhang zhang PROPN bracis-33590 214 12 , , PUNCT bracis-33590 214 13 y. y. PROPN bracis-33590 214 14 ( ( PUNCT bracis-33590 214 15 eds eds PROPN bracis-33590 214 16 . . PUNCT bracis-33590 214 17 ) ) PUNCT bracis-33590 214 18 proceedings proceeding NOUN bracis-33590 214 19 of of ADP bracis-33590 214 20 the the DET bracis-33590 214 21 2022 2022 NUM bracis-33590 214 22 conference conference NOUN bracis-33590 214 23 on on ADP bracis-33590 214 24 empirical empirical ADJ bracis-33590 214 25 methods method NOUN bracis-33590 214 26 in in ADP bracis-33590 214 27 natural natural ADJ bracis-33590 214 28 language language NOUN bracis-33590 214 29 processing processing NOUN bracis-33590 214 30 , , PUNCT bracis-33590 214 31 pp pp ADJ bracis-33590 214 32 . . PUNCT bracis-33590 214 33 9844–9855 9844–9855 NUM bracis-33590 214 34 . . PUNCT bracis-33590 214 35 association association NOUN bracis-33590 214 36 for for ADP bracis-33590 214 37 computational computational ADJ bracis-33590 214 38 linguistics linguistic NOUN bracis-33590 214 39 , , PUNCT bracis-33590 214 40 abu abu PROPN bracis-33590 214 41 dhabi dhabi PROPN bracis-33590 214 42 , , PUNCT bracis-33590 214 43 united united PROPN bracis-33590 214 44 arab arab PROPN bracis-33590 214 45 emirates emirates PROPN bracis-33590 214 46 ( ( PUNCT bracis-33590 214 47 2022 2022 NUM bracis-33590 214 48 ) ) PUNCT bracis-33590 214 49 . . PUNCT bracis-33590 215 1 https://doi.org/10.18653/v1/2022.emnlp-main.669 https://doi.org/10.18653/v1/2022.emnlp-main.669 ADJ bracis-33590 215 2 . . PUNCT bracis-33590 216 1 https://aclanthology.org/2022.emnlp-main.669 https://aclanthology.org/2022.emnlp-main.669 PROPN bracis-33590 216 2 nogueira nogueira PROPN bracis-33590 216 3 , , PUNCT bracis-33590 216 4 r. r. PROPN bracis-33590 216 5 , , PUNCT bracis-33590 216 6 jiang jiang PROPN bracis-33590 216 7 , , PUNCT bracis-33590 216 8 z. z. PROPN bracis-33590 216 9 , , PUNCT bracis-33590 216 10 pradeep pradeep PROPN bracis-33590 216 11 , , PUNCT bracis-33590 216 12 r. r. PROPN bracis-33590 216 13 , , PUNCT bracis-33590 216 14 lin lin PROPN bracis-33590 216 15 , , PUNCT bracis-33590 216 16 j. j. PROPN bracis-33590 216 17 : : PUNCT bracis-33590 216 18 document document NOUN bracis-33590 216 19 ranking rank VERB bracis-33590 216 20 with with ADP bracis-33590 216 21 a a DET bracis-33590 216 22 pretrained pretraine VERB bracis-33590 216 23 sequence sequence NOUN bracis-33590 216 24 - - PUNCT bracis-33590 216 25 to to ADP bracis-33590 216 26 - - PUNCT bracis-33590 216 27 sequence sequence NOUN bracis-33590 216 28 model model NOUN bracis-33590 216 29 . . PUNCT bracis-33590 217 1 in in ADP bracis-33590 217 2 : : PUNCT bracis-33590 217 3 cohn cohn PROPN bracis-33590 217 4 , , PUNCT bracis-33590 217 5 t. t. PROPN bracis-33590 217 6 , , PUNCT bracis-33590 217 7 he he PRON bracis-33590 217 8 , , PUNCT bracis-33590 217 9 y. y. PROPN bracis-33590 217 10 , , PUNCT bracis-33590 217 11 liu liu PROPN bracis-33590 217 12 , , PUNCT bracis-33590 217 13 y. y. PROPN bracis-33590 217 14 ( ( PUNCT bracis-33590 217 15 eds eds PROPN bracis-33590 217 16 . . PUNCT bracis-33590 217 17 ) ) PUNCT bracis-33590 218 1 findings finding NOUN bracis-33590 218 2 of of ADP bracis-33590 218 3 the the DET bracis-33590 218 4 association association NOUN bracis-33590 218 5 for for ADP bracis-33590 218 6 computational computational ADJ bracis-33590 218 7 linguistics linguistic NOUN bracis-33590 218 8 : : PUNCT bracis-33590 218 9 emnlp emnlp PROPN bracis-33590 218 10 2020 2020 NUM bracis-33590 218 11 , , PUNCT bracis-33590 218 12 pp pp ADV bracis-33590 218 13 . . PUNCT bracis-33590 219 1 708–718 708–718 NUM bracis-33590 219 2 . . PUNCT bracis-33590 219 3 association association NOUN bracis-33590 219 4 for for ADP bracis-33590 219 5 computational computational ADJ bracis-33590 219 6 linguistics linguistic NOUN bracis-33590 219 7 , , PUNCT bracis-33590 219 8 online online ADV bracis-33590 219 9 ( ( PUNCT bracis-33590 219 10 2020 2020 NUM bracis-33590 219 11 ) ) PUNCT bracis-33590 219 12 . . PUNCT bracis-33590 220 1 https://doi.org/10.18653/v1/2020.findings-emnlp.63 https://doi.org/10.18653/v1/2020.findings-emnlp.63 X bracis-33590 220 2 . . PUNCT bracis-33590 221 1 https://aclanthology.org/2020.findings-emnlp.63 https://aclanthology.org/2020.findings-emnlp.63 PROPN bracis-33590 221 2 penha penha NOUN bracis-33590 221 3 , , PUNCT bracis-33590 221 4 g. g. PROPN bracis-33590 221 5 , , PUNCT bracis-33590 221 6 palumbo palumbo PROPN bracis-33590 221 7 , , PUNCT bracis-33590 221 8 e. e. PROPN bracis-33590 221 9 , , PUNCT bracis-33590 221 10 aziz aziz PROPN bracis-33590 221 11 , , PUNCT bracis-33590 221 12 m. m. NOUN bracis-33590 221 13 , , PUNCT bracis-33590 221 14 wang wang PROPN bracis-33590 221 15 , , PUNCT bracis-33590 221 16 a. a. PROPN bracis-33590 221 17 , , PUNCT bracis-33590 221 18 bouchard bouchard PROPN bracis-33590 221 19 , , PUNCT bracis-33590 221 20 h. h. PROPN bracis-33590 221 21 : : PUNCT bracis-33590 221 22 improving improve VERB bracis-33590 221 23 content content NOUN bracis-33590 221 24 retrievability retrievability NOUN bracis-33590 221 25 in in ADP bracis-33590 221 26 search search NOUN bracis-33590 221 27 with with ADP bracis-33590 221 28 controllable controllable ADJ bracis-33590 221 29 query query NOUN bracis-33590 221 30 generation generation NOUN bracis-33590 221 31 . . PUNCT bracis-33590 222 1 in in ADP bracis-33590 222 2 : : PUNCT bracis-33590 222 3 proceedings proceeding NOUN bracis-33590 222 4 of of ADP bracis-33590 222 5 the the DET bracis-33590 222 6 acm acm PROPN bracis-33590 222 7 web web NOUN bracis-33590 222 8 conference conference NOUN bracis-33590 222 9 2023 2023 NUM bracis-33590 222 10 , , PUNCT bracis-33590 222 11 pp pp ADJ bracis-33590 222 12 . . PUNCT bracis-33590 222 13 3182–3192 3182–3192 NOUN bracis-33590 222 14 . . PUNCT bracis-33590 222 15 www www PROPN bracis-33590 222 16 2023 2023 NUM bracis-33590 222 17 . . PUNCT bracis-33590 223 1 association association NOUN bracis-33590 223 2 for for ADP bracis-33590 223 3 computing compute VERB bracis-33590 223 4 machinery machinery NOUN bracis-33590 223 5 , , PUNCT bracis-33590 223 6 new new PROPN bracis-33590 223 7 york york PROPN bracis-33590 223 8 ( ( PUNCT bracis-33590 223 9 2023 2023 NUM bracis-33590 223 10 ) ) PUNCT bracis-33590 223 11 . . PUNCT bracis-33590 224 1 https://doi.org/10.1145/3543507.3583261 https://doi.org/10.1145/3543507.3583261 PROPN bracis-33590 224 2 piau piau PROPN bracis-33590 224 3 , , PUNCT bracis-33590 224 4 m. m. NOUN bracis-33590 224 5 , , PUNCT bracis-33590 224 6 lotufo lotufo PROPN bracis-33590 224 7 , , PUNCT bracis-33590 224 8 r. r. PROPN bracis-33590 224 9 , , PUNCT bracis-33590 224 10 nogueira nogueira PROPN bracis-33590 224 11 , , PUNCT bracis-33590 224 12 r. r. PROPN bracis-33590 224 13 : : PUNCT bracis-33590 224 14 ptt5 ptt5 PROPN bracis-33590 224 15 - - PUNCT bracis-33590 224 16 v2 v2 PROPN bracis-33590 224 17 : : PUNCT bracis-33590 224 18 a a DET bracis-33590 224 19 closer close ADJ bracis-33590 224 20 look look NOUN bracis-33590 224 21 at at ADP bracis-33590 224 22 continued continued ADJ bracis-33590 224 23 pretraining pretraine VERB bracis-33590 224 24 of of ADP bracis-33590 224 25 t5 t5 PROPN bracis-33590 224 26 models model NOUN bracis-33590 224 27 for for ADP bracis-33590 224 28 the the DET bracis-33590 224 29 portuguese portuguese ADJ bracis-33590 224 30 language language NOUN bracis-33590 224 31 ( ( PUNCT bracis-33590 224 32 2024 2024 NUM bracis-33590 224 33 ) ) PUNCT bracis-33590 224 34 google google PROPN bracis-33590 224 35 scholar scholar NOUN bracis-33590 224 36     SPACE bracis-33590 224 37 pradeep pradeep PROPN bracis-33590 224 38 , , PUNCT bracis-33590 224 39 r. r. PROPN bracis-33590 224 40 , , PUNCT bracis-33590 224 41 nogueira nogueira PROPN bracis-33590 224 42 , , PUNCT bracis-33590 224 43 r. r. PROPN bracis-33590 224 44 , , PUNCT bracis-33590 224 45 lin lin PROPN bracis-33590 224 46 , , PUNCT bracis-33590 224 47 j. j. PROPN bracis-33590 224 48 : : PUNCT bracis-33590 224 49 the the DET bracis-33590 224 50 expando expando PROPN bracis-33590 224 51 - - PUNCT bracis-33590 224 52 mono mono NOUN bracis-33590 224 53 - - PUNCT bracis-33590 224 54 duo duo NOUN bracis-33590 224 55 design design NOUN bracis-33590 224 56 pattern pattern NOUN bracis-33590 224 57 for for ADP bracis-33590 224 58 text text NOUN bracis-33590 224 59 ranking rank VERB bracis-33590 224 60 with with ADP bracis-33590 224 61 pretrained pretraine VERB bracis-33590 224 62 sequence sequence NOUN bracis-33590 224 63 - - PUNCT bracis-33590 224 64 to to ADP bracis-33590 224 65 - - PUNCT bracis-33590 224 66 sequence sequence NOUN bracis-33590 224 67 models model NOUN bracis-33590 224 68 ( ( PUNCT bracis-33590 224 69 2021 2021 NUM bracis-33590 224 70 ) ) PUNCT bracis-33590 224 71 google google PROPN bracis-33590 224 72 scholar scholar NOUN bracis-33590 224 73     SPACE bracis-33590 224 74 ren ren PROPN bracis-33590 224 75 , , PUNCT bracis-33590 224 76 r. r. PROPN bracis-33590 224 77 , , PUNCT bracis-33590 224 78 et et PROPN bracis-33590 224 79 al al PROPN bracis-33590 224 80 . . PUNCT bracis-33590 224 81 : : PUNCT bracis-33590 225 1 a a DET bracis-33590 225 2 thorough thorough ADJ bracis-33590 225 3 examination examination NOUN bracis-33590 225 4 on on ADP bracis-33590 225 5 zero zero NUM bracis-33590 225 6 - - PUNCT bracis-33590 225 7 shot shoot VERB bracis-33590 225 8 dense dense ADJ bracis-33590 225 9 retrieval retrieval NOUN bracis-33590 225 10 . . PUNCT bracis-33590 226 1 in in ADP bracis-33590 226 2 : : PUNCT bracis-33590 226 3 bouamor bouamor PROPN bracis-33590 226 4 , , PUNCT bracis-33590 226 5 h. h. PROPN bracis-33590 226 6 , , PUNCT bracis-33590 226 7 pino pino PROPN bracis-33590 226 8 , , PUNCT bracis-33590 226 9 j. j. PROPN bracis-33590 226 10 , , PUNCT bracis-33590 226 11 bali bali PROPN bracis-33590 226 12 , , PUNCT bracis-33590 226 13 k. k. PROPN bracis-33590 226 14 ( ( PUNCT bracis-33590 226 15 eds eds PROPN bracis-33590 226 16 . . PUNCT bracis-33590 226 17 ) ) PUNCT bracis-33590 227 1 findings finding NOUN bracis-33590 227 2 of of ADP bracis-33590 227 3 the the DET bracis-33590 227 4 association association NOUN bracis-33590 227 5 for for ADP bracis-33590 227 6 computational computational ADJ bracis-33590 227 7 linguistics linguistic NOUN bracis-33590 227 8 : : PUNCT bracis-33590 227 9 emnlp emnlp ADP bracis-33590 227 10 2023 2023 NUM bracis-33590 227 11 , , PUNCT bracis-33590 227 12 pp pp ADJ bracis-33590 227 13 . . PUNCT bracis-33590 228 1 15783–15796 15783–15796 NUM bracis-33590 228 2 . . PUNCT bracis-33590 229 1 association association NOUN bracis-33590 229 2 for for ADP bracis-33590 229 3 computational computational ADJ bracis-33590 229 4 linguistics linguistic NOUN bracis-33590 229 5 , , PUNCT bracis-33590 229 6 singapore singapore PROPN bracis-33590 229 7 ( ( PUNCT bracis-33590 229 8 2023 2023 NUM bracis-33590 229 9 ) ) PUNCT bracis-33590 229 10 . . PUNCT bracis-33590 230 1 https://doi.org/10.18653/v1/2023.findings-emnlp.1057 https://doi.org/10.18653/v1/2023.findings-emnlp.1057 VERB bracis-33590 230 2 . . PUNCT bracis-33590 231 1 https://aclanthology.org/2023.findings-emnlp.1057 https://aclanthology.org/2023.findings-emnlp.1057 PROPN bracis-33590 231 2 rosa rosa PROPN bracis-33590 231 3 , , PUNCT bracis-33590 231 4 g.m g.m PROPN bracis-33590 231 5 . . PROPN bracis-33590 231 6 , , PUNCT bracis-33590 231 7 et et PROPN bracis-33590 231 8 al al PROPN bracis-33590 231 9 . . PUNCT bracis-33590 231 10 : : PUNCT bracis-33590 232 1 no no DET bracis-33590 232 2 parameter parameter NOUN bracis-33590 232 3 left leave VERB bracis-33590 232 4 behind behind ADV bracis-33590 232 5 : : PUNCT bracis-33590 232 6 how how SCONJ bracis-33590 232 7 distillation distillation NOUN bracis-33590 232 8 and and CCONJ bracis-33590 232 9 model model NOUN bracis-33590 232 10 size size NOUN bracis-33590 232 11 affect affect VERB bracis-33590 232 12 zero zero NUM bracis-33590 232 13 - - PUNCT bracis-33590 232 14 shot shot NOUN bracis-33590 232 15 retrieval retrieval NOUN bracis-33590 232 16 ( ( PUNCT bracis-33590 232 17 2022 2022 NUM bracis-33590 232 18 ) ) PUNCT bracis-33590 232 19 google google PROPN bracis-33590 232 20 scholar scholar NOUN bracis-33590 232 21     SPACE bracis-33590 232 22 thakur thakur PROPN bracis-33590 232 23 , , PUNCT bracis-33590 232 24 n. n. NOUN bracis-33590 232 25 , , PUNCT bracis-33590 232 26 reimers reimer NOUN bracis-33590 232 27 , , PUNCT bracis-33590 232 28 n. n. NOUN bracis-33590 232 29 , , PUNCT bracis-33590 232 30 rücklé rücklé PROPN bracis-33590 232 31 , , PUNCT bracis-33590 232 32 a. a. PROPN bracis-33590 232 33 , , PUNCT bracis-33590 232 34 srivastava srivastava PROPN bracis-33590 232 35 , , PUNCT bracis-33590 232 36 a. a. NOUN bracis-33590 232 37 , , PUNCT bracis-33590 232 38 gurevych gurevych NOUN bracis-33590 232 39 , , PUNCT bracis-33590 232 40 i. i. NOUN bracis-33590 232 41 : : PUNCT bracis-33590 232 42 beir beir PROPN bracis-33590 232 43 : : PUNCT bracis-33590 232 44 a a DET bracis-33590 232 45 heterogeneous heterogeneous ADJ bracis-33590 232 46 benchmark benchmark NOUN bracis-33590 232 47 for for ADP bracis-33590 232 48 zero zero NUM bracis-33590 232 49 - - PUNCT bracis-33590 232 50 shot shot NOUN bracis-33590 232 51 evaluation evaluation NOUN bracis-33590 232 52 of of ADP bracis-33590 232 53 information information NOUN bracis-33590 232 54 retrieval retrieval NOUN bracis-33590 232 55 models model NOUN bracis-33590 232 56 . . PUNCT bracis-33590 233 1 in in ADP bracis-33590 233 2 : : PUNCT bracis-33590 233 3 thirty thirty NUM bracis-33590 233 4 - - PUNCT bracis-33590 233 5 fifth fifth ADJ bracis-33590 233 6 conference conference NOUN bracis-33590 233 7 on on ADP bracis-33590 233 8 neural neural ADJ bracis-33590 233 9 information information NOUN bracis-33590 233 10 processing processing NOUN bracis-33590 233 11 systems system NOUN bracis-33590 233 12 datasets dataset NOUN bracis-33590 233 13 and and CCONJ bracis-33590 233 14 benchmarks benchmark NOUN bracis-33590 233 15 track track NOUN bracis-33590 233 16 ( ( PUNCT bracis-33590 233 17 round round NOUN bracis-33590 233 18 2 2 NUM bracis-33590 233 19 ) ) PUNCT bracis-33590 233 20 ( ( PUNCT bracis-33590 233 21 2021 2021 NUM bracis-33590 233 22 ) ) PUNCT bracis-33590 233 23 . . PUNCT bracis-33590 234 1 https://openreview.net/forum?id=wcu6t5xfjej https://openreview.net/forum?id=wcu6t5xfjej PROPN bracis-33590 234 2 wang wang PROPN bracis-33590 234 3 , , PUNCT bracis-33590 234 4 w. w. PROPN bracis-33590 234 5 , , PUNCT bracis-33590 234 6 wei wei PROPN bracis-33590 234 7 , , PUNCT bracis-33590 234 8 f. f. PROPN bracis-33590 234 9 , , PUNCT bracis-33590 234 10 dong dong PROPN bracis-33590 234 11 , , PUNCT bracis-33590 234 12 l. l. PROPN bracis-33590 234 13 , , PUNCT bracis-33590 234 14 bao bao PROPN bracis-33590 234 15 , , PUNCT bracis-33590 234 16 h. h. PROPN bracis-33590 234 17 , , PUNCT bracis-33590 234 18 yang yang PROPN bracis-33590 234 19 , , PUNCT bracis-33590 234 20 n. n. PROPN bracis-33590 234 21 , , PUNCT bracis-33590 234 22 zhou zhou PROPN bracis-33590 234 23 , , PUNCT bracis-33590 234 24 m. m. NOUN bracis-33590 234 25 : : PUNCT bracis-33590 234 26 minilm minilm NOUN bracis-33590 234 27 : : PUNCT bracis-33590 234 28 deep deep ADJ bracis-33590 234 29 self self NOUN bracis-33590 234 30 - - PUNCT bracis-33590 234 31 attention attention NOUN bracis-33590 234 32 distillation distillation NOUN bracis-33590 234 33 for for ADP bracis-33590 234 34 task task NOUN bracis-33590 234 35 - - PUNCT bracis-33590 234 36 agnostic agnostic ADJ bracis-33590 234 37 compression compression NOUN bracis-33590 234 38 of of ADP bracis-33590 234 39 pre pre ADJ bracis-33590 234 40 - - ADJ bracis-33590 234 41 trained train VERB bracis-33590 234 42 transformers transformer NOUN bracis-33590 234 43 . . PUNCT bracis-33590 235 1 in in ADP bracis-33590 235 2 : : PUNCT bracis-33590 235 3 larochelle larochelle PROPN bracis-33590 235 4 , , PUNCT bracis-33590 235 5 h. h. PROPN bracis-33590 235 6 , , PUNCT bracis-33590 235 7 ranzato ranzato NOUN bracis-33590 235 8 , , PUNCT bracis-33590 235 9 m. m. NOUN bracis-33590 235 10 , , PUNCT bracis-33590 235 11 hadsell hadsell PROPN bracis-33590 235 12 , , PUNCT bracis-33590 235 13 r. r. PROPN bracis-33590 235 14 , , PUNCT bracis-33590 235 15 balcan balcan PROPN bracis-33590 235 16 , , PUNCT bracis-33590 235 17 m. m. NOUN bracis-33590 235 18 , , PUNCT bracis-33590 235 19 lin lin PROPN bracis-33590 235 20 , , PUNCT bracis-33590 235 21 h. h. PROPN bracis-33590 235 22 ( ( PUNCT bracis-33590 235 23 eds eds PROPN bracis-33590 235 24 . . PUNCT bracis-33590 235 25 ) ) PUNCT bracis-33590 236 1 advances advance NOUN bracis-33590 236 2 in in ADP bracis-33590 236 3 neural neural ADJ bracis-33590 236 4 information information NOUN bracis-33590 236 5 processing processing NOUN bracis-33590 236 6 systems system NOUN bracis-33590 236 7 , , PUNCT bracis-33590 236 8 vol vol NOUN bracis-33590 236 9 . . PUNCT bracis-33590 236 10     SPACE bracis-33590 236 11 33 33 NUM bracis-33590 236 12 , , PUNCT bracis-33590 236 13 pp pp ADJ bracis-33590 236 14 . . PUNCT bracis-33590 237 1 5776–5788 5776–5788 NUM bracis-33590 237 2 . . PUNCT bracis-33590 238 1 curran curran PROPN bracis-33590 238 2 associates associates PROPN bracis-33590 238 3 , , PUNCT bracis-33590 238 4 inc inc PROPN bracis-33590 238 5 . . PROPN bracis-33590 238 6 ( ( PUNCT bracis-33590 238 7 2020 2020 NUM bracis-33590 238 8 ) ) PUNCT bracis-33590 238 9 google google PROPN bracis-33590 238 10 scholar scholar NOUN bracis-33590 238 11     SPACE bracis-33590 238 12 zhuang zhuang PROPN bracis-33590 238 13 , , PUNCT bracis-33590 238 14 h. h. PROPN bracis-33590 238 15 , , PUNCT bracis-33590 238 16 et et PROPN bracis-33590 238 17 al al PROPN bracis-33590 238 18 . . PUNCT bracis-33590 238 19 : : PUNCT bracis-33590 239 1 rankt5 rankt5 PROPN bracis-33590 239 2 : : PUNCT bracis-33590 239 3 fine fine ADJ bracis-33590 239 4 - - PUNCT bracis-33590 239 5 tuning tune VERB bracis-33590 239 6 t5 t5 PROPN bracis-33590 239 7 for for ADP bracis-33590 239 8 text text NOUN bracis-33590 239 9 ranking rank VERB bracis-33590 239 10 with with ADP bracis-33590 239 11 ranking ranking ADJ bracis-33590 239 12 losses loss NOUN bracis-33590 239 13 . . PUNCT bracis-33590 240 1 in in ADP bracis-33590 240 2 : : PUNCT bracis-33590 240 3 proceedings proceeding NOUN bracis-33590 240 4 of of ADP bracis-33590 240 5 the the DET bracis-33590 240 6 46th 46th ADJ bracis-33590 240 7 international international PROPN bracis-33590 240 8 acm acm PROPN bracis-33590 240 9 sigir sigir PROPN bracis-33590 240 10 conference conference PROPN bracis-33590 240 11 on on ADP bracis-33590 240 12 research research NOUN bracis-33590 240 13 and and CCONJ bracis-33590 240 14 development development NOUN bracis-33590 240 15 in in ADP bracis-33590 240 16 information information NOUN bracis-33590 240 17 retrieval retrieval NOUN bracis-33590 240 18 , , PUNCT bracis-33590 240 19 pp pp ADV bracis-33590 240 20 . . PUNCT bracis-33590 240 21 2308–2313 2308–2313 NUM bracis-33590 240 22 . . PUNCT bracis-33590 241 1 sigir sigir PROPN bracis-33590 241 2 2023 2023 NUM bracis-33590 241 3 . . PUNCT bracis-33590 242 1 association association NOUN bracis-33590 242 2 for for ADP bracis-33590 242 3 computing compute VERB bracis-33590 242 4 machinery machinery NOUN bracis-33590 242 5 , , PUNCT bracis-33590 242 6 new new PROPN bracis-33590 242 7 york york PROPN bracis-33590 242 8 ( ( PUNCT bracis-33590 242 9 2023 2023 NUM bracis-33590 242 10 ) ) PUNCT bracis-33590 242 11 . . PUNCT bracis-33590 243 1 https://doi.org/10.1145/3539618.3592047 https://doi.org/10.1145/3539618.3592047 PROPN bracis-33590 243 2 download download PROPN bracis-33590 243 3 references reference NOUN bracis-33590 243 4 author author NOUN bracis-33590 243 5 information information NOUN bracis-33590 243 6 authors author NOUN bracis-33590 243 7 and and CCONJ bracis-33590 243 8 affiliations affiliation NOUN bracis-33590 243 9 school school NOUN bracis-33590 243 10 of of ADP bracis-33590 243 11 electrical electrical ADJ bracis-33590 243 12 and and CCONJ bracis-33590 243 13 computing compute VERB bracis-33590 243 14 engineering engineering NOUN bracis-33590 243 15 , , PUNCT bracis-33590 243 16 state state NOUN bracis-33590 243 17 university university PROPN bracis-33590 243 18 of of ADP bracis-33590 243 19 campinas campinas PROPN bracis-33590 243 20 ( ( PUNCT bracis-33590 243 21 unicamp unicamp PROPN bracis-33590 243 22 ) ) PUNCT bracis-33590 243 23 , , PUNCT bracis-33590 243 24 campinas campinas PROPN bracis-33590 243 25 , , PUNCT bracis-33590 243 26 brazil brazil PROPN bracis-33590 243 27 thiago thiago PROPN bracis-33590 243 28 soares soares PROPN bracis-33590 243 29 laitz laitz PROPN bracis-33590 243 30 , , PUNCT bracis-33590 243 31     SPACE bracis-33590 243 32 roberto roberto PROPN bracis-33590 243 33 lotufo lotufo PROPN bracis-33590 243 34     SPACE bracis-33590 243 35 & & CCONJ bracis-33590 243 36     SPACE bracis-33590 243 37 rodrigo rodrigo PROPN bracis-33590 243 38 nogueira nogueira PROPN bracis-33590 243 39 maritaca maritaca PROPN bracis-33590 243 40 ai ai PROPN bracis-33590 243 41 , , PUNCT bracis-33590 243 42 campinas campinas PROPN bracis-33590 243 43 , , PUNCT bracis-33590 243 44 brazil brazil PROPN bracis-33590 243 45 thiago thiago PROPN bracis-33590 243 46 soares soares PROPN bracis-33590 243 47 laitz laitz PROPN bracis-33590 243 48     SPACE bracis-33590 243 49 & & CCONJ bracis-33590 243 50     SPACE bracis-33590 243 51 rodrigo rodrigo PROPN bracis-33590 243 52 nogueira nogueira PROPN bracis-33590 243 53 zeta zeta PROPN bracis-33590 243 54 alpha alpha PROPN bracis-33590 243 55 , , PUNCT bracis-33590 243 56 amsterdam amsterdam PROPN bracis-33590 243 57 , , PUNCT bracis-33590 243 58 netherlands netherlands PROPN bracis-33590 243 59 konstantinos konstantinos PROPN bracis-33590 243 60 papakostas papakostas PROPN bracis-33590 243 61     SPACE bracis-33590 243 62 & & CCONJ bracis-33590 243 63     SPACE bracis-33590 243 64 rodrigo rodrigo PROPN bracis-33590 243 65 nogueira nogueira PROPN bracis-33590 243 66 neuralmind neuralmind PROPN bracis-33590 243 67 , , PUNCT bracis-33590 243 68 campinas campinas PROPN bracis-33590 243 69 , , PUNCT bracis-33590 243 70 brazil brazil PROPN bracis-33590 243 71 roberto roberto PROPN bracis-33590 243 72 lotufo lotufo PROPN bracis-33590 243 73 authors authors PROPN bracis-33590 243 74 thiago thiago PROPN bracis-33590 243 75 soares soares PROPN bracis-33590 243 76 laitzview laitzview PROPN bracis-33590 244 1 author author NOUN bracis-33590 244 2 publications publication NOUN bracis-33590 244 3 search search NOUN bracis-33590 244 4 author author NOUN bracis-33590 244 5 on on ADP bracis-33590 244 6 : : PUNCT bracis-33590 244 7 pubmed pubmed PROPN bracis-33590 244 8     SPACE bracis-33590 244 9 google google PROPN bracis-33590 244 10 scholar scholar PROPN bracis-33590 244 11 konstantinos konstantinos PROPN bracis-33590 244 12 papakostasview papakostasview PROPN bracis-33590 244 13 author author NOUN bracis-33590 244 14 publications publication NOUN bracis-33590 244 15 search search NOUN bracis-33590 244 16 author author NOUN bracis-33590 244 17 on on ADP bracis-33590 244 18 : : PUNCT bracis-33590 244 19 pubmed pubmed PROPN bracis-33590 244 20     SPACE bracis-33590 244 21 google google PROPN bracis-33590 244 22 scholar scholar PROPN bracis-33590 244 23 roberto roberto PROPN bracis-33590 244 24 lotufoview lotufoview PROPN bracis-33590 244 25 author author NOUN bracis-33590 244 26 publications publication NOUN bracis-33590 244 27 search search NOUN bracis-33590 244 28 author author NOUN bracis-33590 244 29 on on ADP bracis-33590 244 30 : : PUNCT bracis-33590 244 31 pubmed pubmed PROPN bracis-33590 244 32     SPACE bracis-33590 244 33 google google PROPN bracis-33590 244 34 scholar scholar PROPN bracis-33590 244 35 rodrigo rodrigo PROPN bracis-33590 244 36 nogueiraview nogueiraview PROPN bracis-33590 244 37 author author NOUN bracis-33590 244 38 publications publication VERB bracis-33590 244 39 search search NOUN bracis-33590 244 40 author author NOUN bracis-33590 244 41 on on ADP bracis-33590 244 42 : : PUNCT bracis-33590 244 43 pubmed pubmed PROPN bracis-33590 244 44     SPACE bracis-33590 244 45 google google PROPN bracis-33590 244 46 scholar scholar NOUN bracis-33590 244 47 corresponding correspond VERB bracis-33590 244 48 author author NOUN bracis-33590 244 49 correspondence correspondence NOUN bracis-33590 244 50 to to ADP bracis-33590 244 51 thiago thiago PROPN bracis-33590 244 52 soares soares PROPN bracis-33590 244 53 laitz laitz PROPN bracis-33590 244 54 . . PUNCT bracis-33590 245 1 editor editor NOUN bracis-33590 245 2 information information NOUN bracis-33590 245 3 editors editor NOUN bracis-33590 245 4 and and CCONJ bracis-33590 245 5 affiliations affiliation NOUN bracis-33590 245 6 universidade universidade VERB bracis-33590 245 7 federal federal PROPN bracis-33590 245 8 fluminense fluminense PROPN bracis-33590 245 9 , , PUNCT bracis-33590 245 10 niterói niterói PROPN bracis-33590 245 11 , , PUNCT bracis-33590 245 12 brazil brazil PROPN bracis-33590 245 13 aline aline PROPN bracis-33590 245 14 paes paes PROPN bracis-33590 245 15 instituto instituto PROPN bracis-33590 245 16 tecnológico tecnológico PROPN bracis-33590 245 17 de de PROPN bracis-33590 245 18 aeronáutica aeronáutica PROPN bracis-33590 245 19 , , PUNCT bracis-33590 245 20 são são PROPN bracis-33590 245 21 josé josé PROPN bracis-33590 245 22 dos dos PROPN bracis-33590 245 23 campos campos PROPN bracis-33590 245 24 , , PUNCT bracis-33590 245 25 brazil brazil PROPN bracis-33590 245 26 filipe filipe PROPN bracis-33590 245 27 a. a. PROPN bracis-33590 245 28 n. n. PROPN bracis-33590 245 29 verri verri PROPN bracis-33590 245 30 ethics ethic NOUN bracis-33590 245 31 declarations declaration VERB bracis-33590 245 32 disclosure disclosure NOUN bracis-33590 245 33 of of ADP bracis-33590 245 34 interests interest NOUN bracis-33590 245 35 the the DET bracis-33590 245 36 authors author NOUN bracis-33590 245 37 have have VERB bracis-33590 245 38 no no DET bracis-33590 245 39 competing compete VERB bracis-33590 245 40 interests interest NOUN bracis-33590 245 41 to to PART bracis-33590 245 42 declare declare VERB bracis-33590 245 43 that that PRON bracis-33590 245 44 are be AUX bracis-33590 245 45 relevant relevant ADJ bracis-33590 245 46 to to ADP bracis-33590 245 47 the the DET bracis-33590 245 48 content content NOUN bracis-33590 245 49 of of ADP bracis-33590 245 50 this this DET bracis-33590 245 51 article article NOUN bracis-33590 245 52 . . PUNCT bracis-33590 246 1 appendices appendice VERB bracis-33590 246 2 a a DET bracis-33590 246 3 training training NOUN bracis-33590 246 4 details detail NOUN bracis-33590 246 5 this this DET bracis-33590 246 6 appendix appendix NOUN bracis-33590 246 7 presents present VERB bracis-33590 246 8 the the DET bracis-33590 246 9 parameters parameter NOUN bracis-33590 246 10 used use VERB bracis-33590 246 11 for for ADP bracis-33590 246 12 training train VERB bracis-33590 246 13 the the DET bracis-33590 246 14 models model NOUN bracis-33590 246 15 using use VERB bracis-33590 246 16 an an DET bracis-33590 246 17 a100 a100 PROPN bracis-33590 246 18 gpu gpu NOUN bracis-33590 246 19 with with ADP bracis-33590 246 20 80 80 NUM bracis-33590 246 21 gb gb NOUN bracis-33590 246 22 of of ADP bracis-33590 246 23 vram vram NOUN bracis-33590 246 24 . . PUNCT bracis-33590 247 1 all all DET bracis-33590 247 2 experiments experiment NOUN bracis-33590 247 3 were be AUX bracis-33590 247 4 conducted conduct VERB bracis-33590 247 5 using use VERB bracis-33590 247 6 the the DET bracis-33590 247 7 same same ADJ bracis-33590 247 8 learning learning NOUN bracis-33590 247 9 rate rate NOUN bracis-33590 247 10 of of ADP bracis-33590 247 11 7e-5 7e-5 PROPN bracis-33590 247 12 and and CCONJ bracis-33590 247 13 the the DET bracis-33590 247 14 adamw adamw NOUN bracis-33590 247 15 optimizer optimizer NOUN bracis-33590 247 16 with with ADP bracis-33590 247 17 its its PRON bracis-33590 247 18 default default NOUN bracis-33590 247 19 hyperparameters hyperparameter NOUN bracis-33590 247 20 in in ADP bracis-33590 247 21 huggingface huggingface NOUN bracis-33590 247 22 . . PUNCT bracis-33590 248 1 the the DET bracis-33590 248 2 batch batch NOUN bracis-33590 248 3 size size NOUN bracis-33590 248 4 was be AUX bracis-33590 248 5 set set VERB bracis-33590 248 6 to to ADP bracis-33590 248 7 32 32 NUM bracis-33590 248 8 . . PUNCT bracis-33590 249 1 for for ADP bracis-33590 249 2 the the DET bracis-33590 249 3 3b 3b PROPN bracis-33590 249 4 model model NOUN bracis-33590 249 5 , , PUNCT bracis-33590 249 6 we we PRON bracis-33590 249 7 used use VERB bracis-33590 249 8 gradient gradient NOUN bracis-33590 249 9 checkpointing checkpointing NOUN bracis-33590 249 10 and and CCONJ bracis-33590 249 11 gradient gradient ADJ bracis-33590 249 12 accumulation accumulation NOUN bracis-33590 249 13 ( ( PUNCT bracis-33590 249 14 to to PART bracis-33590 249 15 achieve achieve VERB bracis-33590 249 16 an an DET bracis-33590 249 17 effective effective ADJ bracis-33590 249 18 batch batch NOUN bracis-33590 249 19 size size NOUN bracis-33590 249 20 of of ADP bracis-33590 249 21 \(2 \(2 NUM bracis-33590 249 22 \times \time NOUN bracis-33590 249 23 16\ 16\ NUM bracis-33590 249 24 ) ) PUNCT bracis-33590 249 25 ) ) PUNCT bracis-33590 249 26 due due ADP bracis-33590 249 27 to to ADP bracis-33590 249 28 memory memory NOUN bracis-33590 249 29 constraints constraint NOUN bracis-33590 249 30 . . PUNCT bracis-33590 250 1 during during ADP bracis-33590 250 2 the the DET bracis-33590 250 3 generation generation NOUN bracis-33590 250 4 of of ADP bracis-33590 250 5 soft soft ADJ bracis-33590 250 6 labels label NOUN bracis-33590 250 7 using use VERB bracis-33590 250 8 the the DET bracis-33590 250 9 teacher teacher NOUN bracis-33590 250 10 model model NOUN bracis-33590 250 11 , , PUNCT bracis-33590 250 12 we we PRON bracis-33590 250 13 sampled sample VERB bracis-33590 250 14 9 9 NUM bracis-33590 250 15 non non ADJ bracis-33590 250 16 - - ADJ bracis-33590 250 17 relevant relevant ADJ bracis-33590 250 18 passages passage NOUN bracis-33590 250 19 passage passage VERB bracis-33590 250 20 for for ADP bracis-33590 250 21 each each DET bracis-33590 250 22 relevant relevant ADJ bracis-33590 250 23 passage passage NOUN bracis-33590 250 24 , , PUNCT bracis-33590 250 25 leading lead VERB bracis-33590 250 26 to to ADP bracis-33590 250 27 10 10 NUM bracis-33590 250 28 pairs pair NOUN bracis-33590 250 29 of of ADP bracis-33590 250 30 logits logit NOUN bracis-33590 250 31 per per ADP bracis-33590 250 32 query query NOUN bracis-33590 250 33 . . PUNCT bracis-33590 251 1 differently differently ADV bracis-33590 251 2 from from ADP bracis-33590 251 3 inpars inpar NOUN bracis-33590 251 4 and and CCONJ bracis-33590 251 5 promptagator promptagator NOUN bracis-33590 251 6 , , PUNCT bracis-33590 251 7 which which PRON bracis-33590 251 8 train train VERB bracis-33590 251 9 a a DET bracis-33590 251 10 separate separate ADJ bracis-33590 251 11 model model NOUN bracis-33590 251 12 for for ADP bracis-33590 251 13 each each DET bracis-33590 251 14 dataset dataset NOUN bracis-33590 251 15 , , PUNCT bracis-33590 251 16 inranker inranker NOUN bracis-33590 251 17 is be AUX bracis-33590 251 18 a a DET bracis-33590 251 19 single single ADJ bracis-33590 251 20 model model NOUN bracis-33590 251 21 trained train VERB bracis-33590 251 22 on on ADP bracis-33590 251 23 all all DET bracis-33590 251 24 16 16 NUM bracis-33590 251 25 datasets dataset NOUN bracis-33590 251 26 from from ADP bracis-33590 251 27 beir beir PROPN bracis-33590 251 28 . . PUNCT bracis-33590 252 1 b b NOUN bracis-33590 252 2 datasets dataset NOUN bracis-33590 252 3 used use VERB bracis-33590 252 4 in in ADP bracis-33590 252 5     SPACE bracis-33590 252 6 ablations ablation NOUN bracis-33590 252 7 this this DET bracis-33590 252 8 section section NOUN bracis-33590 252 9 shows show VERB bracis-33590 252 10 the the DET bracis-33590 252 11 datasets dataset NOUN bracis-33590 252 12 that that PRON bracis-33590 252 13 were be AUX bracis-33590 252 14 randomly randomly ADV bracis-33590 252 15 chosen choose VERB bracis-33590 252 16 for for ADP bracis-33590 252 17 inclusion inclusion NOUN bracis-33590 252 18 in in ADP bracis-33590 252 19 each each DET bracis-33590 252 20 sample sample NOUN bracis-33590 252 21 set set NOUN bracis-33590 252 22 , , PUNCT bracis-33590 252 23 resulting result VERB bracis-33590 252 24 in in ADP bracis-33590 252 25 the the DET bracis-33590 252 26 use use NOUN bracis-33590 252 27 of of ADP bracis-33590 252 28 12 12 NUM bracis-33590 252 29 out out ADP bracis-33590 252 30 of of ADP bracis-33590 252 31 the the DET bracis-33590 252 32 16 16 NUM bracis-33590 252 33 beir beir PROPN bracis-33590 252 34 datasets dataset NOUN bracis-33590 252 35 ( ( PUNCT bracis-33590 252 36 as as SCONJ bracis-33590 252 37 some some PRON bracis-33590 252 38 were be AUX bracis-33590 252 39 not not PART bracis-33590 252 40 used use VERB bracis-33590 252 41 for for ADP bracis-33590 252 42 training training NOUN bracis-33590 252 43 at at ADV bracis-33590 252 44 all all ADV bracis-33590 252 45 ) ) PUNCT bracis-33590 252 46 . . PUNCT bracis-33590 253 1 sample sample NOUN bracis-33590 253 2 set set VERB bracis-33590 253 3 1 1 NUM bracis-33590 253 4 includes include VERB bracis-33590 253 5 the the DET bracis-33590 253 6 following follow VERB bracis-33590 253 7 datasets dataset NOUN bracis-33590 253 8 from from ADP bracis-33590 253 9 the the DET bracis-33590 253 10 beir beir PROPN bracis-33590 253 11 benchmark benchmark PROPN bracis-33590 253 12 : : PUNCT bracis-33590 253 13 nfcorpus nfcorpus PROPN bracis-33590 253 14 , , PUNCT bracis-33590 253 15 nq nq PROPN bracis-33590 253 16 , , PUNCT bracis-33590 253 17 hotpotqa hotpotqa NOUN bracis-33590 253 18 , , PUNCT bracis-33590 253 19 dbpedia dbpedia PROPN bracis-33590 253 20 , , PUNCT bracis-33590 253 21 quora quora PROPN bracis-33590 253 22 , , PUNCT bracis-33590 253 23 scidocs scidoc NOUN bracis-33590 253 24 , , PUNCT bracis-33590 253 25 fiqa-2018 fiqa-2018 NOUN bracis-33590 253 26 , , PUNCT bracis-33590 253 27 and and CCONJ bracis-33590 253 28 signal-1 signal-1 NUM bracis-33590 253 29 m. m. NOUN bracis-33590 253 30 sample sample NOUN bracis-33590 253 31 set set VERB bracis-33590 253 32 2 2 NUM bracis-33590 253 33 comprises comprise VERB bracis-33590 253 34 trec trec PROPN bracis-33590 253 35 - - PUNCT bracis-33590 253 36 covid covid PROPN bracis-33590 253 37 , , PUNCT bracis-33590 253 38 bioasq bioasq PROPN bracis-33590 253 39 , , PUNCT bracis-33590 253 40 nq nq PROPN bracis-33590 253 41 , , PUNCT bracis-33590 253 42 hotpotqa hotpotqa NOUN bracis-33590 253 43 , , PUNCT bracis-33590 253 44 robust04 robust04 ADJ bracis-33590 253 45 , , PUNCT bracis-33590 253 46 scidocs scidoc NOUN bracis-33590 253 47 , , PUNCT bracis-33590 253 48 scifact scifact ADJ bracis-33590 253 49 , , PUNCT bracis-33590 253 50 and and CCONJ bracis-33590 253 51 fiqa-2018 fiqa-2018 NOUN bracis-33590 253 52 . . PUNCT bracis-33590 254 1 climate climate NOUN bracis-33590 254 2 - - PUNCT bracis-33590 254 3 fever fever NOUN bracis-33590 254 4 , , PUNCT bracis-33590 254 5 trec trec PROPN bracis-33590 254 6 - - PUNCT bracis-33590 254 7 news news NOUN bracis-33590 254 8 , , PUNCT bracis-33590 254 9 arguana arguana NOUN bracis-33590 254 10 , , PUNCT bracis-33590 254 11 and and CCONJ bracis-33590 254 12 touché-2020 touché-2020 NOUN bracis-33590 254 13 are be AUX bracis-33590 254 14 not not PART bracis-33590 254 15 included include VERB bracis-33590 254 16 in in ADP bracis-33590 254 17 either either DET bracis-33590 254 18 sample sample NOUN bracis-33590 254 19 set set NOUN bracis-33590 254 20 . . PUNCT bracis-33590 255 1 c c NOUN bracis-33590 255 2 loss loss NOUN bracis-33590 255 3 function function NOUN bracis-33590 255 4 ablation ablation NOUN bracis-33590 255 5 we we PRON bracis-33590 255 6 tested test VERB bracis-33590 255 7 different different ADJ bracis-33590 255 8 loss loss NOUN bracis-33590 255 9 functions function NOUN bracis-33590 255 10 , , PUNCT bracis-33590 255 11 including include VERB bracis-33590 255 12 the the DET bracis-33590 255 13 kl kl PROPN bracis-33590 255 14 divergence divergence NOUN bracis-33590 255 15 and and CCONJ bracis-33590 255 16 mse mse NOUN bracis-33590 255 17 , , PUNCT bracis-33590 255 18 to to PART bracis-33590 255 19 match match VERB bracis-33590 255 20 the the DET bracis-33590 255 21 logits logit NOUN bracis-33590 255 22 of of ADP bracis-33590 255 23 the the DET bracis-33590 255 24 two two NUM bracis-33590 255 25 models model NOUN bracis-33590 255 26 . . PUNCT bracis-33590 256 1 the the DET bracis-33590 256 2 results result NOUN bracis-33590 256 3 indicates indicate VERB bracis-33590 256 4 that that SCONJ bracis-33590 256 5 kl kl PROPN bracis-33590 256 6 divergence divergence NOUN bracis-33590 256 7 was be AUX bracis-33590 256 8 slightly slightly ADV bracis-33590 256 9 worse bad ADJ bracis-33590 256 10 for for ADP bracis-33590 256 11 t5 t5 PROPN bracis-33590 256 12 - - PUNCT bracis-33590 256 13 small small PROPN bracis-33590 256 14 and and CCONJ bracis-33590 256 15 that that SCONJ bracis-33590 256 16 using use VERB bracis-33590 256 17 only only ADV bracis-33590 256 18 the the DET bracis-33590 256 19 true true ADJ bracis-33590 256 20 label label NOUN bracis-33590 256 21 in in ADP bracis-33590 256 22 mse mse PROPN bracis-33590 256 23 as as SCONJ bracis-33590 256 24 opposed oppose VERB bracis-33590 256 25 to to ADP bracis-33590 256 26 using use VERB bracis-33590 256 27 both both CCONJ bracis-33590 256 28 true true ADJ bracis-33590 256 29 and and CCONJ bracis-33590 256 30 false false ADJ bracis-33590 256 31 labels label NOUN bracis-33590 256 32 also also ADV bracis-33590 256 33 reduced reduce VERB bracis-33590 256 34 the the DET bracis-33590 256 35 effectiveness effectiveness NOUN bracis-33590 256 36 . . PUNCT bracis-33590 257 1 for for ADP bracis-33590 257 2 a a DET bracis-33590 257 3 model model NOUN bracis-33590 257 4 with with ADP bracis-33590 257 5 60 60 NUM bracis-33590 257 6 m m PROPN bracis-33590 257 7 parameters parameter NOUN bracis-33590 257 8 , , PUNCT bracis-33590 257 9 the the DET bracis-33590 257 10 mse mse NOUN bracis-33590 257 11 with with ADP bracis-33590 257 12 normalized normalized ADJ bracis-33590 257 13 logits logit NOUN bracis-33590 257 14 yielded yield VERB bracis-33590 257 15 a a DET bracis-33590 257 16 result result NOUN bracis-33590 257 17 of of ADP bracis-33590 257 18 0.4807 0.4807 NUM bracis-33590 257 19 , , PUNCT bracis-33590 257 20 while while SCONJ bracis-33590 257 21 using use VERB bracis-33590 257 22 the the DET bracis-33590 257 23 true true ADJ bracis-33590 257 24 logits logit NOUN bracis-33590 257 25 only only ADV bracis-33590 257 26 resulted result VERB bracis-33590 257 27 in in ADP bracis-33590 257 28 0.4748 0.4748 NUM bracis-33590 257 29 . . PUNCT bracis-33590 258 1 the the DET bracis-33590 258 2 kl kl PROPN bracis-33590 258 3 divergence divergence NOUN bracis-33590 258 4 for for ADP bracis-33590 258 5 the the DET bracis-33590 258 6 same same ADJ bracis-33590 258 7 model model NOUN bracis-33590 258 8 size size NOUN bracis-33590 258 9 was be AUX bracis-33590 258 10 0.4712 0.4712 NUM bracis-33590 258 11 . . PUNCT bracis-33590 259 1 for for ADP bracis-33590 259 2 a a DET bracis-33590 259 3 larger large ADJ bracis-33590 259 4 model model NOUN bracis-33590 259 5 with with ADP bracis-33590 259 6 220 220 NUM bracis-33590 259 7 m m PROPN bracis-33590 259 8 parameters parameter NOUN bracis-33590 259 9 , , PUNCT bracis-33590 259 10 the the DET bracis-33590 259 11 mse mse NOUN bracis-33590 259 12 with with ADP bracis-33590 259 13 normalized normalize VERB bracis-33590 259 14 logits logit NOUN bracis-33590 259 15 produced produce VERB bracis-33590 259 16 a a DET bracis-33590 259 17 result result NOUN bracis-33590 259 18 of of ADP bracis-33590 259 19 0.5008 0.5008 NUM bracis-33590 259 20 , , PUNCT bracis-33590 259 21 and and CCONJ bracis-33590 259 22 the the DET bracis-33590 259 23 kl kl PROPN bracis-33590 259 24 divergence divergence NOUN bracis-33590 259 25 was be AUX bracis-33590 259 26 0.5012 0.5012 NUM bracis-33590 259 27 . . PUNCT bracis-33590 260 1 these these DET bracis-33590 260 2 results result NOUN bracis-33590 260 3 reflect reflect VERB bracis-33590 260 4 the the DET bracis-33590 260 5 average average ADJ bracis-33590 260 6 ndcg@10 ndcg@10 NOUN bracis-33590 260 7 on on ADP bracis-33590 260 8 16 16 NUM bracis-33590 260 9 datasets dataset NOUN bracis-33590 260 10 of of ADP bracis-33590 260 11 the the DET bracis-33590 260 12 beir beir PROPN bracis-33590 260 13 benchmark benchmark NOUN bracis-33590 260 14 with with ADP bracis-33590 260 15 the the DET bracis-33590 260 16 varying vary VERB bracis-33590 260 17 loss loss NOUN bracis-33590 260 18 functions function NOUN bracis-33590 260 19 . . PUNCT bracis-33590 261 1 d d PRON bracis-33590 261 2 complete complete ADJ bracis-33590 261 3 results result NOUN bracis-33590 261 4 on on ADP bracis-33590 261 5     SPACE bracis-33590 261 6 beir beir PROPN bracis-33590 261 7 table table NOUN bracis-33590 261 8     SPACE bracis-33590 261 9 6 6 NUM bracis-33590 261 10 presents present VERB bracis-33590 261 11 the the DET bracis-33590 261 12 results result NOUN bracis-33590 261 13 obtained obtain VERB bracis-33590 261 14 after after ADP bracis-33590 261 15 distilling distil VERB bracis-33590 261 16 the the DET bracis-33590 261 17 models model NOUN bracis-33590 261 18 using use VERB bracis-33590 261 19 soft soft ADJ bracis-33590 261 20 labels label NOUN bracis-33590 261 21 from from ADP bracis-33590 261 22 ms ms PROPN bracis-33590 261 23 marco marco PROPN bracis-33590 261 24 and and CCONJ bracis-33590 261 25 beir beir PROPN bracis-33590 261 26 . . PUNCT bracis-33590 262 1 we we PRON bracis-33590 262 2 can can AUX bracis-33590 262 3 observe observe VERB bracis-33590 262 4 the the DET bracis-33590 262 5 impact impact NOUN bracis-33590 262 6 of of ADP bracis-33590 262 7 both both DET bracis-33590 262 8 proposed propose VERB bracis-33590 262 9 distillation distillation NOUN bracis-33590 262 10 steps step NOUN bracis-33590 262 11 , , PUNCT bracis-33590 262 12 namely namely ADV bracis-33590 262 13 using use VERB bracis-33590 262 14 soft soft ADJ bracis-33590 262 15 human human ADJ bracis-33590 262 16 labels label NOUN bracis-33590 262 17 and and CCONJ bracis-33590 262 18 soft soft ADJ bracis-33590 262 19 synthetic synthetic ADJ bracis-33590 262 20 labels label NOUN bracis-33590 262 21 , , PUNCT bracis-33590 262 22 which which PRON bracis-33590 262 23 bring bring VERB bracis-33590 262 24 significant significant ADJ bracis-33590 262 25 effectiveness effectiveness NOUN bracis-33590 262 26 improvements improvement NOUN bracis-33590 262 27 over over ADP bracis-33590 262 28 the the DET bracis-33590 262 29 base base NOUN bracis-33590 262 30 models model NOUN bracis-33590 262 31 . . PUNCT bracis-33590 263 1 in in ADP bracis-33590 263 2 particular particular ADJ bracis-33590 263 3 , , PUNCT bracis-33590 263 4 using use VERB bracis-33590 263 5 logits logit NOUN bracis-33590 263 6 from from ADP bracis-33590 263 7 ms ms PROPN bracis-33590 263 8 marco marco PROPN bracis-33590 263 9 leads lead VERB bracis-33590 263 10 to to ADP bracis-33590 263 11 an an DET bracis-33590 263 12 average average NOUN bracis-33590 263 13 of of ADP bracis-33590 263 14 a a DET bracis-33590 263 15 2 2 NUM bracis-33590 263 16 - - PUNCT bracis-33590 263 17 point point NOUN bracis-33590 263 18 ndcg@10 ndcg@10 NOUN bracis-33590 263 19 improvement improvement NOUN bracis-33590 263 20 for for ADP bracis-33590 263 21 each each DET bracis-33590 263 22 model model NOUN bracis-33590 263 23 , , PUNCT bracis-33590 263 24 while while SCONJ bracis-33590 263 25 the the DET bracis-33590 263 26 subsequent subsequent ADJ bracis-33590 263 27 fine fine ADV bracis-33590 263 28 - - PUNCT bracis-33590 263 29 tuning tune VERB bracis-33590 263 30 phase phase NOUN bracis-33590 263 31 with with ADP bracis-33590 263 32 the the DET bracis-33590 263 33 synthetic synthetic ADJ bracis-33590 263 34 beir beir PROPN bracis-33590 263 35 queries query NOUN bracis-33590 263 36 further far ADV bracis-33590 263 37 enhances enhance VERB bracis-33590 263 38 their their PRON bracis-33590 263 39 effectiveness effectiveness NOUN bracis-33590 263 40 by by ADP bracis-33590 263 41 4.5 4.5 NUM bracis-33590 263 42 points point NOUN bracis-33590 263 43 for for ADP bracis-33590 263 44 t5 t5 PROPN bracis-33590 263 45 - - PUNCT bracis-33590 263 46 small small ADJ bracis-33590 263 47 and and CCONJ bracis-33590 263 48 approximately approximately ADV bracis-33590 263 49 1.4 1.4 NUM bracis-33590 263 50 points point NOUN bracis-33590 263 51 for for ADP bracis-33590 263 52 t5 t5 PROPN bracis-33590 263 53 - - PUNCT bracis-33590 263 54 base base NOUN bracis-33590 263 55 . . PUNCT bracis-33590 264 1 table table NOUN bracis-33590 264 2 6 6 NUM bracis-33590 264 3 . . PUNCT bracis-33590 265 1 ndcg@10 ndcg@10 VERB bracis-33590 265 2 values value NOUN bracis-33590 265 3 for for ADP bracis-33590 265 4 each each DET bracis-33590 265 5 dataset dataset NOUN bracis-33590 265 6 after after ADP bracis-33590 265 7 two two NUM bracis-33590 265 8 steps step NOUN bracis-33590 265 9 of of ADP bracis-33590 265 10 distillation.full distillation.full NOUN bracis-33590 265 11 size size NOUN bracis-33590 265 12 table table NOUN bracis-33590 265 13 e e X bracis-33590 265 14 complete complete ADJ bracis-33590 265 15 results result NOUN bracis-33590 265 16 on on ADP bracis-33590 265 17     SPACE bracis-33590 265 18 quati quati PROPN bracis-33590 265 19 table table NOUN bracis-33590 265 20     SPACE bracis-33590 265 21 7 7 NUM bracis-33590 265 22 shows show VERB bracis-33590 265 23 the the DET bracis-33590 265 24 results result NOUN bracis-33590 265 25 obtained obtain VERB bracis-33590 265 26 by by ADP bracis-33590 265 27 fine fine ADV bracis-33590 265 28 - - PUNCT bracis-33590 265 29 tuning tune VERB bracis-33590 265 30 ptt5 ptt5 NOUN bracis-33590 265 31 - - PUNCT bracis-33590 265 32 v1 v1 NOUN bracis-33590 265 33 and and CCONJ bracis-33590 265 34 ptt5 ptt5 NOUN bracis-33590 265 35 - - PUNCT bracis-33590 265 36 v2 v2 NOUN bracis-33590 265 37     SPACE bracis-33590 266 1 [ [ NOUN bracis-33590 266 2 27 27 NUM bracis-33590 266 3 ] ] PUNCT bracis-33590 266 4 using use VERB bracis-33590 266 5 different different ADJ bracis-33590 266 6 training training NOUN bracis-33590 266 7 sets set NOUN bracis-33590 266 8 . . PUNCT bracis-33590 267 1 in in ADP bracis-33590 267 2 particular particular ADJ bracis-33590 267 3 , , PUNCT bracis-33590 267 4 ptt5 ptt5 PROPN bracis-33590 267 5 - - PUNCT bracis-33590 267 6 v2 v2 PROPN bracis-33590 267 7 has have VERB bracis-33590 267 8 a a DET bracis-33590 267 9 better well ADJ bracis-33590 267 10 overall overall ADJ bracis-33590 267 11 ndgg@10 ndgg@10 NOUN bracis-33590 267 12 , , PUNCT bracis-33590 267 13 showing show VERB bracis-33590 267 14 that that SCONJ bracis-33590 267 15 even even ADV bracis-33590 267 16 though though SCONJ bracis-33590 267 17 both both DET bracis-33590 267 18 versions version NOUN bracis-33590 267 19 have have VERB bracis-33590 267 20 the the DET bracis-33590 267 21 same same ADJ bracis-33590 267 22 number number NOUN bracis-33590 267 23 of of ADP bracis-33590 267 24 parameters parameter NOUN bracis-33590 267 25 , , PUNCT bracis-33590 267 26 a a DET bracis-33590 267 27 better well ADJ bracis-33590 267 28 pre pre ADJ bracis-33590 267 29 - - ADJ bracis-33590 267 30 training training ADJ bracis-33590 267 31 process process NOUN bracis-33590 267 32 can can AUX bracis-33590 267 33 improve improve VERB bracis-33590 267 34 downstream downstream ADJ bracis-33590 267 35 tasks task NOUN bracis-33590 267 36 such such ADJ bracis-33590 267 37 as as ADP bracis-33590 267 38 information information NOUN bracis-33590 267 39 retrieval retrieval NOUN bracis-33590 267 40 . . PUNCT bracis-33590 268 1 for for ADP bracis-33590 268 2 the the DET bracis-33590 268 3 quati quati NOUN bracis-33590 268 4 soft soft ADJ bracis-33590 268 5 labels label NOUN bracis-33590 268 6 generation generation NOUN bracis-33590 268 7 we we PRON bracis-33590 268 8 used use VERB bracis-33590 268 9 the the DET bracis-33590 268 10 mt5 mt5 ADV bracis-33590 268 11 - - PUNCT bracis-33590 268 12 3.7b 3.7b NOUN bracis-33590 268 13 as as ADP bracis-33590 268 14 a a DET bracis-33590 268 15 teacher teacher NOUN bracis-33590 268 16 instead instead ADV bracis-33590 268 17 of of ADP bracis-33590 268 18 t5 t5 PROPN bracis-33590 268 19 - - PUNCT bracis-33590 268 20 3b 3b NUM bracis-33590 268 21 , , PUNCT bracis-33590 268 22 since since SCONJ bracis-33590 268 23 this this DET bracis-33590 268 24 model model NOUN bracis-33590 268 25 has have VERB bracis-33590 268 26 a a DET bracis-33590 268 27 better well ADJ bracis-33590 268 28 performance performance NOUN bracis-33590 268 29 on on ADP bracis-33590 268 30 portuguese portuguese ADJ bracis-33590 268 31 text text NOUN bracis-33590 268 32 . . PUNCT bracis-33590 269 1 table table NOUN bracis-33590 269 2 7 7 NUM bracis-33590 269 3 . . PUNCT bracis-33590 270 1 complete complete ADJ bracis-33590 270 2 results result NOUN bracis-33590 270 3 ( ( PUNCT bracis-33590 270 4 ndcg@10 ndcg@10 NOUN bracis-33590 270 5 ) ) PUNCT bracis-33590 270 6 on on ADP bracis-33590 270 7 quati quati NOUN bracis-33590 270 8 . . PUNCT bracis-33590 271 1 all all DET bracis-33590 271 2 training training NOUN bracis-33590 271 3 datasets dataset NOUN bracis-33590 271 4 were be AUX bracis-33590 271 5 used use VERB bracis-33590 271 6 to to PART bracis-33590 271 7 distill distill VERB bracis-33590 271 8 knowledge knowledge NOUN bracis-33590 271 9 from from ADP bracis-33590 271 10 a a DET bracis-33590 271 11 teacher teacher NOUN bracis-33590 271 12 model.full model.full NOUN bracis-33590 271 13 size size NOUN bracis-33590 271 14 table table NOUN bracis-33590 271 15 rights right NOUN bracis-33590 271 16 and and CCONJ bracis-33590 271 17 permissions permission NOUN bracis-33590 271 18 reprints reprint NOUN bracis-33590 271 19 and and CCONJ bracis-33590 271 20 permissions permission VERB bracis-33590 271 21 copyright copyright NOUN bracis-33590 271 22 information information NOUN bracis-33590 271 23 © © ADP bracis-33590 271 24 2025 2025 NUM bracis-33590 271 25 the the DET bracis-33590 271 26 author(s author(s NOUN bracis-33590 271 27 ) ) PUNCT bracis-33590 271 28 , , PUNCT bracis-33590 271 29 under under ADP bracis-33590 271 30 exclusive exclusive ADJ bracis-33590 271 31 license license NOUN bracis-33590 271 32 to to ADP bracis-33590 271 33 springer springer NOUN bracis-33590 271 34 nature nature PROPN bracis-33590 271 35 switzerland switzerland PROPN bracis-33590 271 36 ag ag PROPN bracis-33590 271 37 about about ADP bracis-33590 271 38 this this DET bracis-33590 271 39 paper paper NOUN bracis-33590 271 40 cite cite VERB bracis-33590 271 41 this this DET bracis-33590 271 42 paper paper NOUN bracis-33590 271 43 laitz laitz PROPN bracis-33590 271 44 , , PUNCT bracis-33590 271 45 t.s t.s PROPN bracis-33590 271 46 . . PROPN bracis-33590 271 47 , , PUNCT bracis-33590 271 48 papakostas papakosta NOUN bracis-33590 271 49 , , PUNCT bracis-33590 271 50 k. k. PROPN bracis-33590 271 51 , , PUNCT bracis-33590 271 52 lotufo lotufo PROPN bracis-33590 271 53 , , PUNCT bracis-33590 271 54 r. r. PROPN bracis-33590 271 55 , , PUNCT bracis-33590 271 56 nogueira nogueira PROPN bracis-33590 271 57 , , PUNCT bracis-33590 271 58 r. r. PROPN bracis-33590 271 59 ( ( PUNCT bracis-33590 271 60 2025 2025 NUM bracis-33590 271 61 ) ) PUNCT bracis-33590 271 62 . . PUNCT bracis-33590 272 1 inranker inranker PROPN bracis-33590 272 2 : : PUNCT bracis-33590 272 3 distilled distil VERB bracis-33590 272 4 rankers ranker NOUN bracis-33590 272 5 for for ADP bracis-33590 272 6     SPACE bracis-33590 272 7 zero zero NUM bracis-33590 272 8 - - PUNCT bracis-33590 272 9 shot shot NOUN bracis-33590 272 10 information information NOUN bracis-33590 272 11 retrieval retrieval NOUN bracis-33590 272 12 . . PUNCT bracis-33590 273 1 in in ADP bracis-33590 273 2 : : PUNCT bracis-33590 273 3 paes paes PROPN bracis-33590 273 4 , , PUNCT bracis-33590 273 5 a. a. PROPN bracis-33590 273 6 , , PUNCT bracis-33590 273 7 verri verri NOUN bracis-33590 273 8 , , PUNCT bracis-33590 273 9 f.a.n f.a.n ADJ bracis-33590 273 10 . . PUNCT bracis-33590 273 11 ( ( PUNCT bracis-33590 273 12 eds ed NOUN bracis-33590 273 13 ) ) PUNCT bracis-33590 273 14 intelligent intelligent ADJ bracis-33590 273 15 systems system NOUN bracis-33590 273 16 . . PUNCT bracis-33590 273 17 bracis bracis PROPN bracis-33590 273 18 2024 2024 NUM bracis-33590 273 19 . . PUNCT bracis-33590 274 1 lecture lecture NOUN bracis-33590 274 2 notes note NOUN bracis-33590 274 3 in in ADP bracis-33590 274 4 computer computer NOUN bracis-33590 274 5 science science NOUN bracis-33590 274 6 ( ( PUNCT bracis-33590 274 7 ) ) PUNCT bracis-33590 274 8 , , PUNCT bracis-33590 274 9 vol vol NOUN bracis-33590 274 10 15413 15413 NUM bracis-33590 274 11 . . PUNCT bracis-33590 275 1 springer springer NOUN bracis-33590 275 2 , , PUNCT bracis-33590 275 3 cham cham PROPN bracis-33590 275 4 . . PUNCT bracis-33590 276 1 https://doi.org/10.1007/978-3-031-79032-4_10 https://doi.org/10.1007/978-3-031-79032-4_10 PROPN bracis-33590 276 2 download download NOUN bracis-33590 276 3 citation citation NOUN bracis-33590 276 4 .ris .ris PUNCT bracis-33590 277 1 .enw .enw PROPN bracis-33590 277 2 .bib .bib PUNCT bracis-33590 278 1 doi doi PROPN bracis-33590 278 2 : : PUNCT bracis-33590 278 3 https://doi.org/10.1007/978-3-031-79032-4_10 https://doi.org/10.1007/978-3-031-79032-4_10 NOUN bracis-33590 278 4 published publish VERB bracis-33590 278 5 : : PUNCT bracis-33590 278 6 30 30 NUM bracis-33590 278 7 january january PROPN bracis-33590 278 8 2025 2025 NUM bracis-33590 278 9 publisher publisher NOUN bracis-33590 278 10 name name NOUN bracis-33590 278 11 : : PUNCT bracis-33590 278 12 springer springer NOUN bracis-33590 278 13 , , PUNCT bracis-33590 278 14 cham cham PROPN bracis-33590 278 15 print print PROPN bracis-33590 278 16 isbn isbn PROPN bracis-33590 278 17 : : PUNCT bracis-33590 278 18 978 978 NUM bracis-33590 278 19 - - SYM bracis-33590 278 20 3 3 NUM bracis-33590 278 21 - - PUNCT bracis-33590 278 22 031 031 NUM bracis-33590 278 23 - - PUNCT bracis-33590 278 24 79031 79031 NUM bracis-33590 278 25 - - SYM bracis-33590 278 26 7 7 NUM bracis-33590 278 27 online online ADJ bracis-33590 278 28 isbn isbn NOUN bracis-33590 278 29 : : PUNCT bracis-33590 278 30 978 978 NUM bracis-33590 278 31 - - SYM bracis-33590 278 32 3 3 NUM bracis-33590 278 33 - - PUNCT bracis-33590 278 34 031 031 NUM bracis-33590 278 35 - - PUNCT bracis-33590 278 36 79032 79032 NUM bracis-33590 278 37 - - SYM bracis-33590 278 38 4 4 NUM bracis-33590 278 39 ebook ebook NOUN bracis-33590 278 40 packages package NOUN bracis-33590 278 41 : : PUNCT bracis-33590 278 42 computer computer NOUN bracis-33590 278 43 sciencecomputer sciencecomputer NOUN bracis-33590 278 44 science science NOUN bracis-33590 278 45 ( ( PUNCT bracis-33590 278 46 r0 r0 NOUN bracis-33590 278 47 ) ) PUNCT bracis-33590 278 48 share share VERB bracis-33590 278 49 this this DET bracis-33590 278 50 paper paper NOUN bracis-33590 278 51 anyone anyone PRON bracis-33590 278 52 you you PRON bracis-33590 278 53 share share VERB bracis-33590 278 54 the the DET bracis-33590 278 55 following follow VERB bracis-33590 278 56 link link NOUN bracis-33590 278 57 with with ADP bracis-33590 278 58 will will AUX bracis-33590 278 59 be be AUX bracis-33590 278 60 able able ADJ bracis-33590 278 61 to to PART bracis-33590 278 62 read read VERB bracis-33590 278 63 this this DET bracis-33590 278 64 content content NOUN bracis-33590 278 65 : : PUNCT bracis-33590 278 66 get get VERB bracis-33590 278 67 shareable shareable ADJ bracis-33590 278 68 linksorry linksorry NOUN bracis-33590 278 69 , , PUNCT bracis-33590 278 70 a a DET bracis-33590 278 71 shareable shareable ADJ bracis-33590 278 72 link link NOUN bracis-33590 278 73 is be AUX bracis-33590 278 74 not not PART bracis-33590 278 75 currently currently ADV bracis-33590 278 76 available available ADJ bracis-33590 278 77 for for ADP bracis-33590 278 78 this this DET bracis-33590 278 79 article article NOUN bracis-33590 278 80 . . PUNCT bracis-33590 279 1 copy copy VERB bracis-33590 279 2 shareable shareable ADJ bracis-33590 279 3 link link NOUN bracis-33590 279 4 to to PART bracis-33590 279 5 clipboard clipboard NOUN bracis-33590 279 6 provided provide VERB bracis-33590 279 7 by by ADP bracis-33590 279 8 the the DET bracis-33590 279 9 springer springer NOUN bracis-33590 279 10 nature nature PROPN bracis-33590 279 11 sharedit sharedit PROPN bracis-33590 279 12 content content NOUN bracis-33590 279 13 - - PUNCT bracis-33590 279 14 sharing share VERB bracis-33590 279 15 initiative initiative NOUN bracis-33590 279 16 keywords keyword NOUN bracis-33590 279 17 deep deep ADJ bracis-33590 279 18 learning learning NOUN bracis-33590 279 19 language language NOUN bracis-33590 279 20 models model NOUN bracis-33590 279 21 information information NOUN bracis-33590 279 22 retrieval retrieval NOUN bracis-33590 279 23 publish publish NOUN bracis-33590 279 24 with with ADP bracis-33590 279 25 us us PROPN bracis-33590 279 26 policies policy NOUN bracis-33590 279 27 and and CCONJ bracis-33590 279 28 ethics ethic NOUN bracis-33590 279 29 search search NOUN bracis-33590 279 30 search search NOUN bracis-33590 279 31 by by ADP bracis-33590 279 32 keyword keyword NOUN bracis-33590 279 33 or or CCONJ bracis-33590 279 34 author author NOUN bracis-33590 279 35 search search NOUN bracis-33590 279 36 navigation navigation NOUN bracis-33590 279 37 find find VERB bracis-33590 279 38 a a DET bracis-33590 279 39 journal journal NOUN bracis-33590 279 40 publish publish VERB bracis-33590 279 41 with with ADP bracis-33590 279 42 us we PRON bracis-33590 279 43 track track VERB bracis-33590 279 44 your your PRON bracis-33590 279 45 research research NOUN bracis-33590 279 46 discover discover VERB bracis-33590 279 47 content content NOUN bracis-33590 279 48 journals journal NOUN bracis-33590 279 49 a a DET bracis-33590 279 50 - - PUNCT bracis-33590 279 51 z z NOUN bracis-33590 279 52 books book NOUN bracis-33590 279 53 a a DET bracis-33590 279 54 - - PUNCT bracis-33590 279 55 z z NOUN bracis-33590 279 56 publish publish NOUN bracis-33590 279 57 with with ADP bracis-33590 279 58 us us PROPN bracis-33590 279 59 journal journal PROPN bracis-33590 279 60 finder finder PROPN bracis-33590 279 61 publish publish VERB bracis-33590 279 62 your your PRON bracis-33590 279 63 research research NOUN bracis-33590 279 64 language language NOUN bracis-33590 279 65 editing edit VERB bracis-33590 279 66 open open ADJ bracis-33590 279 67 access access NOUN bracis-33590 279 68 publishing publishing NOUN bracis-33590 279 69 products product NOUN bracis-33590 279 70 and and CCONJ bracis-33590 279 71 services service NOUN bracis-33590 279 72 our our PRON bracis-33590 279 73 products product NOUN bracis-33590 279 74 librarians librarian VERB bracis-33590 279 75 societies society NOUN bracis-33590 279 76 partners partner NOUN bracis-33590 279 77 and and CCONJ bracis-33590 279 78 advertisers advertiser NOUN bracis-33590 279 79 our our PRON bracis-33590 279 80 brands brand NOUN bracis-33590 279 81 springer springer NOUN bracis-33590 279 82 nature nature PROPN bracis-33590 279 83 portfolio portfolio PROPN bracis-33590 279 84 bmc bmc PROPN bracis-33590 279 85 palgrave palgrave PROPN bracis-33590 279 86 macmillan macmillan PROPN bracis-33590 279 87 apress apress PROPN bracis-33590 279 88 discover discover VERB bracis-33590 279 89 your your PRON bracis-33590 279 90 privacy privacy NOUN bracis-33590 279 91 choices choice NOUN bracis-33590 279 92 / / SYM bracis-33590 279 93 manage manage NOUN bracis-33590 279 94 cookies cookie NOUN bracis-33590 279 95 your your PRON bracis-33590 279 96 us us PROPN bracis-33590 280 1 state state NOUN bracis-33590 280 2 privacy privacy NOUN bracis-33590 280 3 rights right NOUN bracis-33590 280 4 accessibility accessibility NOUN bracis-33590 280 5 statement statement NOUN bracis-33590 280 6 terms term NOUN bracis-33590 280 7 and and CCONJ bracis-33590 280 8 conditions condition NOUN bracis-33590 280 9 privacy privacy NOUN bracis-33590 280 10 policy policy NOUN bracis-33590 280 11 help help NOUN bracis-33590 280 12 and and CCONJ bracis-33590 280 13 support support VERB bracis-33590 280 14 legal legal ADJ bracis-33590 280 15 notice notice NOUN bracis-33590 280 16 cancel cancel VERB bracis-33590 280 17 contracts contract NOUN bracis-33590 280 18 here here ADV bracis-33590 280 19 129.74.145.123 129.74.145.123 NUM bracis-33590 280 20 hesburgh hesburgh PROPN bracis-33590 280 21 library library PROPN bracis-33590 280 22 er er INTJ bracis-33590 280 23 unit unit NOUN bracis-33590 280 24 ( ( PUNCT bracis-33590 280 25 3005732405 3005732405 NUM bracis-33590 280 26 ) ) PUNCT bracis-33590 280 27 northeast northeast ADJ bracis-33590 280 28 research research NOUN bracis-33590 280 29 libraries library NOUN bracis-33590 280 30 ( ( PUNCT bracis-33590 280 31 nerl nerl PROPN bracis-33590 280 32 ) ) PUNCT bracis-33590 280 33 ( ( PUNCT bracis-33590 280 34 8200828607 8200828607 NUM bracis-33590 280 35 ) ) PUNCT bracis-33590 280 36 nerl nerl VERB bracis-33590 280 37 ta ta X bracis-33590 280 38 account account NOUN bracis-33590 280 39 ( ( PUNCT bracis-33590 280 40 3006206169 3006206169 NUM bracis-33590 280 41 ) ) PUNCT bracis-33590 280 42 university university NOUN bracis-33590 280 43 of of ADP bracis-33590 280 44 notre notre PROPN bracis-33590 280 45 dame dame PROPN bracis-33590 280 46 hesburgh hesburgh PROPN bracis-33590 280 47 library library NOUN bracis-33590 280 48 ( ( PUNCT bracis-33590 280 49 3000184373 3000184373 NUM bracis-33590 280 50 ) ) PUNCT bracis-33590 281 1 © © ADP bracis-33590 281 2 2025 2025 NUM bracis-33590 281 3 springer springer NOUN bracis-33590 281 4 nature nature NOUN