id sid tid token lemma pos american_scientific_journal-2305 1 1 97 97 NUM american_scientific_journal-2305 1 2 american american ADJ american_scientific_journal-2305 1 3 scientific scientific ADJ american_scientific_journal-2305 1 4 research research NOUN american_scientific_journal-2305 1 5 journal journal NOUN american_scientific_journal-2305 1 6 for for ADP american_scientific_journal-2305 1 7 engineering engineering NOUN american_scientific_journal-2305 1 8 , , PUNCT american_scientific_journal-2305 1 9 technology technology NOUN american_scientific_journal-2305 1 10 , , PUNCT american_scientific_journal-2305 1 11 and and CCONJ american_scientific_journal-2305 1 12 sciences science NOUN american_scientific_journal-2305 1 13 ( ( PUNCT american_scientific_journal-2305 1 14 asrjets asrjet NOUN american_scientific_journal-2305 1 15 ) ) PUNCT american_scientific_journal-2305 1 16 issn issn PROPN american_scientific_journal-2305 1 17 ( ( PUNCT american_scientific_journal-2305 1 18 print print NOUN american_scientific_journal-2305 1 19 ) ) PUNCT american_scientific_journal-2305 1 20 2313 2313 NUM american_scientific_journal-2305 1 21 - - SYM american_scientific_journal-2305 1 22 4410 4410 NUM american_scientific_journal-2305 1 23 , , PUNCT american_scientific_journal-2305 1 24 issn issn PROPN american_scientific_journal-2305 1 25 ( ( PUNCT american_scientific_journal-2305 1 26 online online ADJ american_scientific_journal-2305 1 27 ) ) PUNCT american_scientific_journal-2305 1 28 2313 2313 NUM american_scientific_journal-2305 1 29 - - SYM american_scientific_journal-2305 1 30 4402 4402 NUM american_scientific_journal-2305 1 31 © © PROPN american_scientific_journal-2305 1 32 global global ADJ american_scientific_journal-2305 1 33 society society NOUN american_scientific_journal-2305 1 34 of of ADP american_scientific_journal-2305 1 35 scientific scientific ADJ american_scientific_journal-2305 1 36 research research NOUN american_scientific_journal-2305 1 37 and and CCONJ american_scientific_journal-2305 1 38 researchers researcher NOUN american_scientific_journal-2305 1 39 http://asrjetsjournal.org/ http://asrjetsjournal.org/ VERB american_scientific_journal-2305 1 40 quantitative quantitative ADJ american_scientific_journal-2305 1 41 & & CCONJ american_scientific_journal-2305 1 42 qualitative qualitative ADJ american_scientific_journal-2305 1 43 evaluation evaluation NOUN american_scientific_journal-2305 1 44 of of ADP american_scientific_journal-2305 1 45 three three NUM american_scientific_journal-2305 1 46 search search NOUN american_scientific_journal-2305 1 47 engines engine NOUN american_scientific_journal-2305 1 48 ( ( PUNCT american_scientific_journal-2305 1 49 google google PROPN american_scientific_journal-2305 1 50 , , PUNCT american_scientific_journal-2305 1 51 yahoo yahoo PROPN american_scientific_journal-2305 1 52 , , PUNCT american_scientific_journal-2305 1 53 and and CCONJ american_scientific_journal-2305 1 54 bing bing NOUN american_scientific_journal-2305 1 55 ) ) PUNCT american_scientific_journal-2305 1 56 mohammad mohammad PROPN american_scientific_journal-2305 1 57 asmaran asmaran PROPN american_scientific_journal-2305 1 58 * * VERB american_scientific_journal-2305 1 59 al al PROPN american_scientific_journal-2305 1 60 - - PUNCT american_scientific_journal-2305 1 61 balqa’applied balqa’applie VERB american_scientific_journal-2305 1 62 university university NOUN american_scientific_journal-2305 1 63 , , PUNCT american_scientific_journal-2305 1 64 al al PROPN american_scientific_journal-2305 1 65 - - PUNCT american_scientific_journal-2305 1 66 salt salt NOUN american_scientific_journal-2305 1 67 19117 19117 NUM american_scientific_journal-2305 1 68 , , PUNCT american_scientific_journal-2305 1 69 jordan jordan PROPN american_scientific_journal-2305 1 70 email email NOUN american_scientific_journal-2305 1 71 : : PUNCT american_scientific_journal-2305 1 72 m_asmaran@yahoo.com m_asmaran@yahoo.com X american_scientific_journal-2305 1 73 abstract abstract ADJ american_scientific_journal-2305 1 74 as as SCONJ american_scientific_journal-2305 1 75 internet internet NOUN american_scientific_journal-2305 1 76 evolution evolution NOUN american_scientific_journal-2305 1 77 becomes become VERB american_scientific_journal-2305 1 78 bigger big ADJ american_scientific_journal-2305 1 79 every every DET american_scientific_journal-2305 1 80 day day NOUN american_scientific_journal-2305 1 81 , , PUNCT american_scientific_journal-2305 1 82 people people NOUN american_scientific_journal-2305 1 83 become become VERB american_scientific_journal-2305 1 84 more more ADV american_scientific_journal-2305 1 85 interested interested ADJ american_scientific_journal-2305 1 86 in in ADP american_scientific_journal-2305 1 87 finding find VERB american_scientific_journal-2305 1 88 services service NOUN american_scientific_journal-2305 1 89 and and CCONJ american_scientific_journal-2305 1 90 information information NOUN american_scientific_journal-2305 1 91 spread spread VERB american_scientific_journal-2305 1 92 all all ADV american_scientific_journal-2305 1 93 over over ADP american_scientific_journal-2305 1 94 the the DET american_scientific_journal-2305 1 95 web web NOUN american_scientific_journal-2305 1 96 . . PUNCT american_scientific_journal-2305 2 1 this this PRON american_scientific_journal-2305 2 2 is be AUX american_scientific_journal-2305 2 3 a a DET american_scientific_journal-2305 2 4 difficult difficult ADJ american_scientific_journal-2305 2 5 process process NOUN american_scientific_journal-2305 2 6 because because SCONJ american_scientific_journal-2305 2 7 of of ADP american_scientific_journal-2305 2 8 the the DET american_scientific_journal-2305 2 9 neuromas neuromas NOUN american_scientific_journal-2305 2 10 number number NOUN american_scientific_journal-2305 2 11 of of ADP american_scientific_journal-2305 2 12 sites site NOUN american_scientific_journal-2305 2 13 released release VERB american_scientific_journal-2305 2 14 every every DET american_scientific_journal-2305 2 15 day day NOUN american_scientific_journal-2305 2 16 . . PUNCT american_scientific_journal-2305 3 1 this this PRON american_scientific_journal-2305 3 2 brings bring VERB american_scientific_journal-2305 3 3 the the DET american_scientific_journal-2305 3 4 importance importance NOUN american_scientific_journal-2305 3 5 of of ADP american_scientific_journal-2305 3 6 search search NOUN american_scientific_journal-2305 3 7 engines engine NOUN american_scientific_journal-2305 3 8 to to PART american_scientific_journal-2305 3 9 be be AUX american_scientific_journal-2305 3 10 very very ADV american_scientific_journal-2305 3 11 high high ADJ american_scientific_journal-2305 3 12 to to ADP american_scientific_journal-2305 3 13 web web NOUN american_scientific_journal-2305 3 14 users user NOUN american_scientific_journal-2305 3 15 so so SCONJ american_scientific_journal-2305 3 16 they they PRON american_scientific_journal-2305 3 17 can can AUX american_scientific_journal-2305 3 18 surf surf VERB american_scientific_journal-2305 3 19 the the DET american_scientific_journal-2305 3 20 web web NOUN american_scientific_journal-2305 3 21 easily easily ADV american_scientific_journal-2305 3 22 . . PUNCT american_scientific_journal-2305 4 1 search search NOUN american_scientific_journal-2305 4 2 engines engine NOUN american_scientific_journal-2305 4 3 are be AUX american_scientific_journal-2305 4 4 required require VERB american_scientific_journal-2305 4 5 to to PART american_scientific_journal-2305 4 6 provide provide VERB american_scientific_journal-2305 4 7 appropriate appropriate ADJ american_scientific_journal-2305 4 8 and and CCONJ american_scientific_journal-2305 4 9 accurate accurate ADJ american_scientific_journal-2305 4 10 results result NOUN american_scientific_journal-2305 4 11 to to ADP american_scientific_journal-2305 4 12 users user NOUN american_scientific_journal-2305 4 13 looking look VERB american_scientific_journal-2305 4 14 for for ADP american_scientific_journal-2305 4 15 any any DET american_scientific_journal-2305 4 16 information information NOUN american_scientific_journal-2305 4 17 . . PUNCT american_scientific_journal-2305 5 1 this this DET american_scientific_journal-2305 5 2 research research NOUN american_scientific_journal-2305 5 3 evaluates evaluate VERB american_scientific_journal-2305 5 4 three three NUM american_scientific_journal-2305 5 5 of of ADP american_scientific_journal-2305 5 6 the the DET american_scientific_journal-2305 5 7 top top ADJ american_scientific_journal-2305 5 8 search search NOUN american_scientific_journal-2305 5 9 engines engine NOUN american_scientific_journal-2305 5 10 over over ADP american_scientific_journal-2305 5 11 the the DET american_scientific_journal-2305 5 12 internet internet NOUN american_scientific_journal-2305 5 13 ( ( PUNCT american_scientific_journal-2305 5 14 i.e. i.e. X american_scientific_journal-2305 5 15 google google PROPN american_scientific_journal-2305 5 16 , , PUNCT american_scientific_journal-2305 5 17 yahoo yahoo PROPN american_scientific_journal-2305 5 18 , , PUNCT american_scientific_journal-2305 5 19 and and CCONJ american_scientific_journal-2305 5 20 bing bing NOUN american_scientific_journal-2305 5 21 ) ) PUNCT american_scientific_journal-2305 5 22 using use VERB american_scientific_journal-2305 5 23 well well ADV american_scientific_journal-2305 5 24 know know NOUN american_scientific_journal-2305 5 25 qualitative qualitative ADJ american_scientific_journal-2305 5 26 and and CCONJ american_scientific_journal-2305 5 27 quantitative quantitative ADJ american_scientific_journal-2305 5 28 approaches approach NOUN american_scientific_journal-2305 5 29 . . PUNCT american_scientific_journal-2305 6 1 according accord VERB american_scientific_journal-2305 6 2 to to ADP american_scientific_journal-2305 6 3 the the DET american_scientific_journal-2305 6 4 research research NOUN american_scientific_journal-2305 6 5 results result NOUN american_scientific_journal-2305 6 6 , , PUNCT american_scientific_journal-2305 6 7 google google PROPN american_scientific_journal-2305 6 8 is be AUX american_scientific_journal-2305 6 9 the the DET american_scientific_journal-2305 6 10 best good ADJ american_scientific_journal-2305 6 11 of of ADP american_scientific_journal-2305 6 12 the the DET american_scientific_journal-2305 6 13 three three NUM american_scientific_journal-2305 6 14 engines engine NOUN american_scientific_journal-2305 6 15 in in ADP american_scientific_journal-2305 6 16 term term NOUN american_scientific_journal-2305 6 17 of of ADP american_scientific_journal-2305 6 18 quality quality NOUN american_scientific_journal-2305 6 19 of of ADP american_scientific_journal-2305 6 20 search search NOUN american_scientific_journal-2305 6 21 results result NOUN american_scientific_journal-2305 6 22 while while SCONJ american_scientific_journal-2305 6 23 yahoo yahoo PROPN american_scientific_journal-2305 6 24 is be AUX american_scientific_journal-2305 6 25 the the DET american_scientific_journal-2305 6 26 best good ADJ american_scientific_journal-2305 6 27 in in ADP american_scientific_journal-2305 6 28 terms term NOUN american_scientific_journal-2305 6 29 of of ADP american_scientific_journal-2305 6 30 search search NOUN american_scientific_journal-2305 6 31 speed speed NOUN american_scientific_journal-2305 6 32 . . PUNCT american_scientific_journal-2305 7 1 keywords keyword NOUN american_scientific_journal-2305 7 2 : : PUNCT american_scientific_journal-2305 7 3 information information NOUN american_scientific_journal-2305 7 4 retrieval retrieval NOUN american_scientific_journal-2305 7 5 ; ; PUNCT american_scientific_journal-2305 7 6 data datum NOUN american_scientific_journal-2305 7 7 ranking ranking NOUN american_scientific_journal-2305 7 8 ; ; PUNCT american_scientific_journal-2305 7 9 search search NOUN american_scientific_journal-2305 7 10 engine engine NOUN american_scientific_journal-2305 7 11 evaluation evaluation NOUN american_scientific_journal-2305 7 12 ; ; PUNCT american_scientific_journal-2305 7 13 search search NOUN american_scientific_journal-2305 7 14 engines engine NOUN american_scientific_journal-2305 7 15 comparison comparison NOUN american_scientific_journal-2305 7 16 . . PUNCT american_scientific_journal-2305 8 1 1 1 X american_scientific_journal-2305 8 2 . . X american_scientific_journal-2305 8 3 introduction introduction NOUN american_scientific_journal-2305 8 4 web web NOUN american_scientific_journal-2305 8 5 search search NOUN american_scientific_journal-2305 8 6 engines engine NOUN american_scientific_journal-2305 8 7 become become VERB american_scientific_journal-2305 8 8 very very ADV american_scientific_journal-2305 8 9 important important ADJ american_scientific_journal-2305 8 10 as as SCONJ american_scientific_journal-2305 8 11 internet internet NOUN american_scientific_journal-2305 8 12 reaches reach VERB american_scientific_journal-2305 8 13 to to ADP american_scientific_journal-2305 8 14 almost almost ADV american_scientific_journal-2305 8 15 every every PRON american_scientific_journal-2305 8 16 detail detail NOUN american_scientific_journal-2305 8 17 of of ADP american_scientific_journal-2305 8 18 life life NOUN american_scientific_journal-2305 8 19 . . PUNCT american_scientific_journal-2305 9 1 users user NOUN american_scientific_journal-2305 9 2 are be AUX american_scientific_journal-2305 9 3 always always ADV american_scientific_journal-2305 9 4 looking look VERB american_scientific_journal-2305 9 5 for for ADP american_scientific_journal-2305 9 6 services service NOUN american_scientific_journal-2305 9 7 and and CCONJ american_scientific_journal-2305 9 8 information information NOUN american_scientific_journal-2305 9 9 over over ADP american_scientific_journal-2305 9 10 the the DET american_scientific_journal-2305 9 11 web web NOUN american_scientific_journal-2305 9 12 . . PUNCT american_scientific_journal-2305 10 1 these these PRON american_scientific_journal-2305 10 2 needs need VERB american_scientific_journal-2305 10 3 lead lead VERB american_scientific_journal-2305 10 4 to to ADP american_scientific_journal-2305 10 5 an an DET american_scientific_journal-2305 10 6 extensive extensive ADJ american_scientific_journal-2305 10 7 use use NOUN american_scientific_journal-2305 10 8 of of ADP american_scientific_journal-2305 10 9 search search NOUN american_scientific_journal-2305 10 10 engines engine NOUN american_scientific_journal-2305 10 11 looking look VERB american_scientific_journal-2305 10 12 for for ADP american_scientific_journal-2305 10 13 appropriate appropriate ADJ american_scientific_journal-2305 10 14 information information NOUN american_scientific_journal-2305 10 15 . . PUNCT american_scientific_journal-2305 11 1 as as SCONJ american_scientific_journal-2305 11 2 the the DET american_scientific_journal-2305 11 3 number number NOUN american_scientific_journal-2305 11 4 of of ADP american_scientific_journal-2305 11 5 search search NOUN american_scientific_journal-2305 11 6 engines engine NOUN american_scientific_journal-2305 11 7 increases increase VERB american_scientific_journal-2305 11 8 day day NOUN american_scientific_journal-2305 11 9 by by ADP american_scientific_journal-2305 11 10 day day NOUN american_scientific_journal-2305 11 11 , , PUNCT american_scientific_journal-2305 11 12 an an DET american_scientific_journal-2305 11 13 evaluation evaluation NOUN american_scientific_journal-2305 11 14 criteria criterion NOUN american_scientific_journal-2305 11 15 should should AUX american_scientific_journal-2305 11 16 be be AUX american_scientific_journal-2305 11 17 exist exist VERB american_scientific_journal-2305 11 18 to to PART american_scientific_journal-2305 11 19 evaluate evaluate VERB american_scientific_journal-2305 11 20 the the DET american_scientific_journal-2305 11 21 quality quality NOUN american_scientific_journal-2305 11 22 of of ADP american_scientific_journal-2305 11 23 search search NOUN american_scientific_journal-2305 11 24 results result NOUN american_scientific_journal-2305 11 25 so so SCONJ american_scientific_journal-2305 11 26 that that SCONJ american_scientific_journal-2305 11 27 we we PRON american_scientific_journal-2305 11 28 can can AUX american_scientific_journal-2305 11 29 decide decide VERB american_scientific_journal-2305 11 30 which which DET american_scientific_journal-2305 11 31 engine engine NOUN american_scientific_journal-2305 11 32 is be AUX american_scientific_journal-2305 11 33 the the DET american_scientific_journal-2305 11 34 best good ADJ american_scientific_journal-2305 11 35 choice choice NOUN american_scientific_journal-2305 11 36 to to PART american_scientific_journal-2305 11 37 use use VERB american_scientific_journal-2305 11 38 . . PUNCT american_scientific_journal-2305 12 1 this this DET american_scientific_journal-2305 12 2 research research NOUN american_scientific_journal-2305 12 3 has have AUX american_scientific_journal-2305 12 4 applied apply VERB american_scientific_journal-2305 12 5 an an DET american_scientific_journal-2305 12 6 evaluation evaluation NOUN american_scientific_journal-2305 12 7 methodology methodology NOUN american_scientific_journal-2305 12 8 to to PART american_scientific_journal-2305 12 9 evaluate evaluate VERB american_scientific_journal-2305 12 10 three three NUM american_scientific_journal-2305 12 11 search search NOUN american_scientific_journal-2305 12 12 engines engine NOUN american_scientific_journal-2305 12 13 google google PROPN american_scientific_journal-2305 12 14 , , PUNCT american_scientific_journal-2305 12 15 yahoo yahoo PROPN american_scientific_journal-2305 12 16 , , PUNCT american_scientific_journal-2305 12 17 and and CCONJ american_scientific_journal-2305 12 18 bing bing VERB american_scientific_journal-2305 12 19 [ [ X american_scientific_journal-2305 12 20 1 1 NUM american_scientific_journal-2305 12 21 , , PUNCT american_scientific_journal-2305 12 22 2 2 NUM american_scientific_journal-2305 12 23 , , PUNCT american_scientific_journal-2305 12 24 3 3 NUM american_scientific_journal-2305 12 25 ] ] PUNCT american_scientific_journal-2305 12 26 . . PUNCT american_scientific_journal-2305 13 1 evaluation evaluation NOUN american_scientific_journal-2305 13 2 involves involve VERB american_scientific_journal-2305 13 3 representing represent VERB american_scientific_journal-2305 13 4 results result NOUN american_scientific_journal-2305 13 5 quantitatively quantitatively ADV american_scientific_journal-2305 13 6 . . PUNCT american_scientific_journal-2305 14 1 quantitative quantitative ADJ american_scientific_journal-2305 14 2 representation representation NOUN american_scientific_journal-2305 14 3 of of ADP american_scientific_journal-2305 14 4 search search NOUN american_scientific_journal-2305 14 5 results result NOUN american_scientific_journal-2305 14 6 helps help VERB american_scientific_journal-2305 14 7 evaluating evaluate VERB american_scientific_journal-2305 14 8 the the DET american_scientific_journal-2305 14 9 quality quality NOUN american_scientific_journal-2305 14 10 of of ADP american_scientific_journal-2305 14 11 search search NOUN american_scientific_journal-2305 14 12 results result NOUN american_scientific_journal-2305 14 13 . . PUNCT american_scientific_journal-2305 15 1 while while SCONJ american_scientific_journal-2305 15 2 quality quality NOUN american_scientific_journal-2305 15 3 of of ADP american_scientific_journal-2305 15 4 search search NOUN american_scientific_journal-2305 15 5 engines engine NOUN american_scientific_journal-2305 15 6 can can AUX american_scientific_journal-2305 15 7 be be AUX american_scientific_journal-2305 15 8 measured measure VERB american_scientific_journal-2305 15 9 by by ADP american_scientific_journal-2305 15 10 two two NUM american_scientific_journal-2305 15 11 factors factor NOUN american_scientific_journal-2305 15 12 : : PUNCT american_scientific_journal-2305 15 13 effectiveness effectiveness NOUN american_scientific_journal-2305 15 14 and and CCONJ american_scientific_journal-2305 15 15 efficiency efficiency NOUN american_scientific_journal-2305 15 16 . . PUNCT american_scientific_journal-2305 16 1 effectiveness effectiveness NOUN american_scientific_journal-2305 16 2 describes describe VERB american_scientific_journal-2305 16 3 the the DET american_scientific_journal-2305 16 4 quality quality NOUN american_scientific_journal-2305 16 5 of of ADP american_scientific_journal-2305 16 6 the the DET american_scientific_journal-2305 16 7 results result NOUN american_scientific_journal-2305 16 8 while while SCONJ american_scientific_journal-2305 16 9 efficiency efficiency NOUN american_scientific_journal-2305 16 10 represents represent VERB american_scientific_journal-2305 16 11 how how SCONJ american_scientific_journal-2305 16 12 long long ADV american_scientific_journal-2305 16 13 it it PRON american_scientific_journal-2305 16 14 takes take VERB american_scientific_journal-2305 16 15 the the DET american_scientific_journal-2305 16 16 user user NOUN american_scientific_journal-2305 16 17 to to PART american_scientific_journal-2305 16 18 obtain obtain VERB american_scientific_journal-2305 16 19 intended intended ADJ american_scientific_journal-2305 16 20 results result NOUN american_scientific_journal-2305 16 21 from from ADP american_scientific_journal-2305 16 22 the the DET american_scientific_journal-2305 16 23 search search NOUN american_scientific_journal-2305 16 24 engine engine NOUN american_scientific_journal-2305 16 25 [ [ X american_scientific_journal-2305 16 26 4 4 NUM american_scientific_journal-2305 16 27 , , PUNCT american_scientific_journal-2305 16 28 5 5 NUM american_scientific_journal-2305 16 29 , , PUNCT american_scientific_journal-2305 16 30 6 6 NUM american_scientific_journal-2305 16 31 , , PUNCT american_scientific_journal-2305 16 32 7 7 NUM american_scientific_journal-2305 16 33 , , PUNCT american_scientific_journal-2305 16 34 8 8 NUM american_scientific_journal-2305 16 35 , , PUNCT american_scientific_journal-2305 16 36 9 9 NUM american_scientific_journal-2305 16 37 , , PUNCT american_scientific_journal-2305 16 38 10 10 NUM american_scientific_journal-2305 16 39 , , PUNCT american_scientific_journal-2305 16 40 11 11 NUM american_scientific_journal-2305 16 41 ] ] PUNCT american_scientific_journal-2305 16 42 . . PUNCT american_scientific_journal-2305 17 1 ----------------------------------------------------------------------- ----------------------------------------------------------------------- PUNCT american_scientific_journal-2305 18 1 * * PUNCT american_scientific_journal-2305 18 2 corresponding correspond VERB american_scientific_journal-2305 18 3 author author NOUN american_scientific_journal-2305 18 4 . . PUNCT american_scientific_journal-2305 19 1 http://asrjetsjournal.org/ http://asrjetsjournal.org/ PROPN american_scientific_journal-2305 19 2 american american PROPN american_scientific_journal-2305 19 3 scientific scientific PROPN american_scientific_journal-2305 19 4 research research NOUN american_scientific_journal-2305 19 5 journal journal NOUN american_scientific_journal-2305 19 6 for for ADP american_scientific_journal-2305 19 7 engineering engineering NOUN american_scientific_journal-2305 19 8 , , PUNCT american_scientific_journal-2305 19 9 technology technology NOUN american_scientific_journal-2305 19 10 , , PUNCT american_scientific_journal-2305 19 11 and and CCONJ american_scientific_journal-2305 19 12 sciences science NOUN american_scientific_journal-2305 19 13 ( ( PUNCT american_scientific_journal-2305 19 14 asrjets asrjet NOUN american_scientific_journal-2305 19 15 ) ) PUNCT american_scientific_journal-2305 19 16 ( ( PUNCT american_scientific_journal-2305 19 17 2016 2016 NUM american_scientific_journal-2305 19 18 ) ) PUNCT american_scientific_journal-2305 19 19 volume volume NOUN american_scientific_journal-2305 19 20 26 26 NUM american_scientific_journal-2305 19 21 , , PUNCT american_scientific_journal-2305 19 22 no no DET american_scientific_journal-2305 19 23 2 2 NUM american_scientific_journal-2305 19 24 , , PUNCT american_scientific_journal-2305 19 25 pp pp ADV american_scientific_journal-2305 19 26 97 97 NUM american_scientific_journal-2305 19 27 - - SYM american_scientific_journal-2305 19 28 106 106 NUM american_scientific_journal-2305 19 29 98 98 NUM american_scientific_journal-2305 19 30 1.1 1.1 NUM american_scientific_journal-2305 19 31 . . PUNCT american_scientific_journal-2305 20 1 theoretical theoretical ADJ american_scientific_journal-2305 20 2 background background NOUN american_scientific_journal-2305 20 3 as as SCONJ american_scientific_journal-2305 20 4 described describe VERB american_scientific_journal-2305 20 5 earlier early ADV american_scientific_journal-2305 20 6 in in ADP american_scientific_journal-2305 20 7 the the DET american_scientific_journal-2305 20 8 introduction introduction NOUN american_scientific_journal-2305 20 9 , , PUNCT american_scientific_journal-2305 20 10 there there PRON american_scientific_journal-2305 20 11 are be VERB american_scientific_journal-2305 20 12 two two NUM american_scientific_journal-2305 20 13 main main ADJ american_scientific_journal-2305 20 14 factors factor NOUN american_scientific_journal-2305 20 15 to to PART american_scientific_journal-2305 20 16 evaluate evaluate VERB american_scientific_journal-2305 20 17 web web NOUN american_scientific_journal-2305 20 18 search search NOUN american_scientific_journal-2305 20 19 engine engine NOUN american_scientific_journal-2305 20 20 these these DET american_scientific_journal-2305 20 21 factors factor NOUN american_scientific_journal-2305 20 22 are be AUX american_scientific_journal-2305 20 23 effectiveness effectiveness NOUN american_scientific_journal-2305 20 24 and and CCONJ american_scientific_journal-2305 20 25 efficiency efficiency NOUN american_scientific_journal-2305 20 26 [ [ X american_scientific_journal-2305 20 27 4 4 NUM american_scientific_journal-2305 20 28 , , PUNCT american_scientific_journal-2305 20 29 5 5 NUM american_scientific_journal-2305 20 30 , , PUNCT american_scientific_journal-2305 20 31 6 6 NUM american_scientific_journal-2305 20 32 , , PUNCT american_scientific_journal-2305 20 33 7 7 NUM american_scientific_journal-2305 20 34 , , PUNCT american_scientific_journal-2305 20 35 8 8 NUM american_scientific_journal-2305 20 36 , , PUNCT american_scientific_journal-2305 20 37 9 9 NUM american_scientific_journal-2305 20 38 , , PUNCT american_scientific_journal-2305 20 39 10 10 NUM american_scientific_journal-2305 20 40 , , PUNCT american_scientific_journal-2305 20 41 11 11 NUM american_scientific_journal-2305 20 42 ] ] PUNCT american_scientific_journal-2305 20 43 . . PUNCT american_scientific_journal-2305 21 1 a. a. NOUN american_scientific_journal-2305 21 2 effectiveness effectiveness PROPN american_scientific_journal-2305 21 3 : : PUNCT american_scientific_journal-2305 21 4 indicates indicate VERB american_scientific_journal-2305 21 5 to to ADP american_scientific_journal-2305 21 6 the the DET american_scientific_journal-2305 21 7 quality quality NOUN american_scientific_journal-2305 21 8 of of ADP american_scientific_journal-2305 21 9 search search NOUN american_scientific_journal-2305 21 10 engine engine NOUN american_scientific_journal-2305 21 11 results result NOUN american_scientific_journal-2305 21 12 . . PUNCT american_scientific_journal-2305 22 1 this this PRON american_scientific_journal-2305 22 2 can can AUX american_scientific_journal-2305 22 3 be be AUX american_scientific_journal-2305 22 4 achieved achieve VERB american_scientific_journal-2305 22 5 by by ADP american_scientific_journal-2305 22 6 applying apply VERB american_scientific_journal-2305 22 7 one one NUM american_scientific_journal-2305 22 8 of of ADP american_scientific_journal-2305 22 9 the the DET american_scientific_journal-2305 22 10 standard standard ADJ american_scientific_journal-2305 22 11 evaluation evaluation NOUN american_scientific_journal-2305 22 12 equations equation NOUN american_scientific_journal-2305 22 13 such such ADJ american_scientific_journal-2305 22 14 as as ADP american_scientific_journal-2305 22 15 harmonic harmonic ADJ american_scientific_journal-2305 22 16 mean mean NOUN american_scientific_journal-2305 22 17 , , PUNCT american_scientific_journal-2305 22 18 average average ADJ american_scientific_journal-2305 22 19 precision precision NOUN american_scientific_journal-2305 22 20 , , PUNCT american_scientific_journal-2305 22 21 or or CCONJ american_scientific_journal-2305 22 22 discounted discount VERB american_scientific_journal-2305 22 23 cumulative cumulative ADJ american_scientific_journal-2305 22 24 gain gain NOUN american_scientific_journal-2305 22 25 ( ( PUNCT american_scientific_journal-2305 22 26 dcg dcg PROPN american_scientific_journal-2305 22 27 ) ) PUNCT american_scientific_journal-2305 22 28 , , PUNCT american_scientific_journal-2305 22 29 etc etc X american_scientific_journal-2305 22 30 . . X american_scientific_journal-2305 23 1 [ [ X american_scientific_journal-2305 23 2 4 4 NUM american_scientific_journal-2305 23 3 , , PUNCT american_scientific_journal-2305 23 4 5 5 NUM american_scientific_journal-2305 23 5 , , PUNCT american_scientific_journal-2305 23 6 6 6 NUM american_scientific_journal-2305 23 7 , , PUNCT american_scientific_journal-2305 23 8 7 7 NUM american_scientific_journal-2305 23 9 , , PUNCT american_scientific_journal-2305 23 10 8 8 NUM american_scientific_journal-2305 23 11 , , PUNCT american_scientific_journal-2305 23 12 9 9 NUM american_scientific_journal-2305 23 13 , , PUNCT american_scientific_journal-2305 23 14 10 10 NUM american_scientific_journal-2305 23 15 , , PUNCT american_scientific_journal-2305 23 16 11 11 NUM american_scientific_journal-2305 23 17 ] ] PUNCT american_scientific_journal-2305 23 18 . . PUNCT american_scientific_journal-2305 24 1 discounted discount VERB american_scientific_journal-2305 24 2 cumulative cumulative ADJ american_scientific_journal-2305 24 3 gain gain NOUN american_scientific_journal-2305 24 4 ( ( PUNCT american_scientific_journal-2305 24 5 dcg dcg PROPN american_scientific_journal-2305 24 6 ) ) PUNCT american_scientific_journal-2305 24 7 has have AUX american_scientific_journal-2305 24 8 been be AUX american_scientific_journal-2305 24 9 selected select VERB american_scientific_journal-2305 24 10 as as ADP american_scientific_journal-2305 24 11 an an DET american_scientific_journal-2305 24 12 evaluation evaluation NOUN american_scientific_journal-2305 24 13 equation equation NOUN american_scientific_journal-2305 24 14 in in ADP american_scientific_journal-2305 24 15 this this DET american_scientific_journal-2305 24 16 research research NOUN american_scientific_journal-2305 24 17 . . PUNCT american_scientific_journal-2305 25 1 this this DET american_scientific_journal-2305 25 2 metric metric NOUN american_scientific_journal-2305 25 3 is be AUX american_scientific_journal-2305 25 4 the the DET american_scientific_journal-2305 25 5 best well ADV american_scientific_journal-2305 25 6 suited suit VERB american_scientific_journal-2305 25 7 in in ADP american_scientific_journal-2305 25 8 this this DET american_scientific_journal-2305 25 9 type type NOUN american_scientific_journal-2305 25 10 of of ADP american_scientific_journal-2305 25 11 research research NOUN american_scientific_journal-2305 25 12 since since SCONJ american_scientific_journal-2305 25 13 other other ADJ american_scientific_journal-2305 25 14 factors factor NOUN american_scientific_journal-2305 25 15 measure measure NOUN american_scientific_journal-2305 25 16 according accord VERB american_scientific_journal-2305 25 17 to to ADP american_scientific_journal-2305 25 18 two two NUM american_scientific_journal-2305 25 19 main main ADJ american_scientific_journal-2305 25 20 factors factor NOUN american_scientific_journal-2305 25 21 called call VERB american_scientific_journal-2305 25 22 recall recall NOUN american_scientific_journal-2305 25 23 and and CCONJ american_scientific_journal-2305 25 24 precision precision NOUN american_scientific_journal-2305 25 25 . . PUNCT american_scientific_journal-2305 26 1 recall recall NOUN american_scientific_journal-2305 26 2 and and CCONJ american_scientific_journal-2305 26 3 precision precision NOUN american_scientific_journal-2305 26 4 are be AUX american_scientific_journal-2305 26 5 calculated calculate VERB american_scientific_journal-2305 26 6 based base VERB american_scientific_journal-2305 26 7 on on ADP american_scientific_journal-2305 26 8 the the DET american_scientific_journal-2305 26 9 total total ADJ american_scientific_journal-2305 26 10 number number NOUN american_scientific_journal-2305 26 11 of of ADP american_scientific_journal-2305 26 12 relevant relevant ADJ american_scientific_journal-2305 26 13 documents document NOUN american_scientific_journal-2305 26 14 over over ADP american_scientific_journal-2305 26 15 the the DET american_scientific_journal-2305 26 16 web web NOUN american_scientific_journal-2305 26 17 , , PUNCT american_scientific_journal-2305 26 18 number number NOUN american_scientific_journal-2305 26 19 retrieved retrieve VERB american_scientific_journal-2305 26 20 documents document NOUN american_scientific_journal-2305 26 21 , , PUNCT american_scientific_journal-2305 26 22 in in ADP american_scientific_journal-2305 26 23 addition addition NOUN american_scientific_journal-2305 26 24 to to ADP american_scientific_journal-2305 26 25 the the DET american_scientific_journal-2305 26 26 number number NOUN american_scientific_journal-2305 26 27 of of ADP american_scientific_journal-2305 26 28 relevant relevant ADJ american_scientific_journal-2305 26 29 documents document NOUN american_scientific_journal-2305 26 30 in in ADP american_scientific_journal-2305 26 31 the the DET american_scientific_journal-2305 26 32 search search NOUN american_scientific_journal-2305 26 33 results result NOUN american_scientific_journal-2305 26 34 . . PUNCT american_scientific_journal-2305 27 1 these these DET american_scientific_journal-2305 27 2 values value NOUN american_scientific_journal-2305 27 3 ca can AUX american_scientific_journal-2305 27 4 n’t not PART american_scientific_journal-2305 27 5 be be AUX american_scientific_journal-2305 27 6 determined determine VERB american_scientific_journal-2305 27 7 in in ADP american_scientific_journal-2305 27 8 case case NOUN american_scientific_journal-2305 27 9 of of ADP american_scientific_journal-2305 27 10 web web NOUN american_scientific_journal-2305 27 11 search search NOUN american_scientific_journal-2305 27 12 to to PART american_scientific_journal-2305 27 13 go go VERB american_scientific_journal-2305 27 14 further far ADV american_scientific_journal-2305 27 15 in in ADP american_scientific_journal-2305 27 16 the the DET american_scientific_journal-2305 27 17 evaluation evaluation NOUN american_scientific_journal-2305 27 18 process process NOUN american_scientific_journal-2305 27 19 . . PUNCT american_scientific_journal-2305 28 1 though though ADV american_scientific_journal-2305 28 2 , , PUNCT american_scientific_journal-2305 28 3 discounted discount VERB american_scientific_journal-2305 28 4 cumulative cumulative ADJ american_scientific_journal-2305 28 5 gain gain NOUN american_scientific_journal-2305 28 6 ( ( PUNCT american_scientific_journal-2305 28 7 dcg dcg PROPN american_scientific_journal-2305 28 8 ) ) PUNCT american_scientific_journal-2305 28 9 is be AUX american_scientific_journal-2305 28 10 best well ADV american_scientific_journal-2305 28 11 suitable suitable ADJ american_scientific_journal-2305 28 12 for for ADP american_scientific_journal-2305 28 13 the the DET american_scientific_journal-2305 28 14 web web NOUN american_scientific_journal-2305 28 15 search search NOUN american_scientific_journal-2305 28 16 engines engine NOUN american_scientific_journal-2305 28 17 since since SCONJ american_scientific_journal-2305 28 18 it it PRON american_scientific_journal-2305 28 19 evaluates evaluate VERB american_scientific_journal-2305 28 20 only only ADV american_scientific_journal-2305 28 21 top top ADJ american_scientific_journal-2305 28 22 twenty twenty NUM american_scientific_journal-2305 28 23 results result NOUN american_scientific_journal-2305 28 24 based base VERB american_scientific_journal-2305 28 25 on on ADP american_scientific_journal-2305 28 26 the the DET american_scientific_journal-2305 28 27 relevancy relevancy NOUN american_scientific_journal-2305 28 28 level level NOUN american_scientific_journal-2305 28 29 that that PRON american_scientific_journal-2305 28 30 varies vary VERB american_scientific_journal-2305 28 31 between between ADP american_scientific_journal-2305 28 32 0 0 NUM american_scientific_journal-2305 28 33 ( ( PUNCT american_scientific_journal-2305 28 34 worst bad ADJ american_scientific_journal-2305 28 35 ) ) PUNCT american_scientific_journal-2305 28 36 and and CCONJ american_scientific_journal-2305 28 37 5 5 NUM american_scientific_journal-2305 28 38 ( ( PUNCT american_scientific_journal-2305 28 39 best good ADJ american_scientific_journal-2305 28 40 ) ) PUNCT american_scientific_journal-2305 28 41 . . PUNCT american_scientific_journal-2305 29 1 note note VERB american_scientific_journal-2305 29 2 that that SCONJ american_scientific_journal-2305 29 3 we we PRON american_scientific_journal-2305 29 4 can can AUX american_scientific_journal-2305 29 5 calculate calculate VERB american_scientific_journal-2305 29 6 dcgp dcgp NOUN american_scientific_journal-2305 29 7 using use VERB american_scientific_journal-2305 29 8 equation equation NOUN american_scientific_journal-2305 29 9 1 1 NUM american_scientific_journal-2305 29 10 , , PUNCT american_scientific_journal-2305 29 11 note note VERB american_scientific_journal-2305 29 12 that that SCONJ american_scientific_journal-2305 29 13 p p PRON american_scientific_journal-2305 29 14 refers refer VERB american_scientific_journal-2305 29 15 to to ADP american_scientific_journal-2305 29 16 the the DET american_scientific_journal-2305 29 17 result result NOUN american_scientific_journal-2305 29 18 position position NOUN american_scientific_journal-2305 29 19 index index NOUN american_scientific_journal-2305 29 20 ( ( PUNCT american_scientific_journal-2305 29 21 first first ADJ american_scientific_journal-2305 29 22 , , PUNCT american_scientific_journal-2305 29 23 second second ADJ american_scientific_journal-2305 29 24 , , PUNCT american_scientific_journal-2305 29 25 third third ADJ american_scientific_journal-2305 29 26 , , PUNCT american_scientific_journal-2305 29 27 up up ADP american_scientific_journal-2305 29 28 to to ADP american_scientific_journal-2305 29 29 twentieth twentieth ADJ american_scientific_journal-2305 29 30 result result NOUN american_scientific_journal-2305 29 31 ) ) PUNCT american_scientific_journal-2305 30 1 [ [ X american_scientific_journal-2305 30 2 4 4 NUM american_scientific_journal-2305 30 3 , , PUNCT american_scientific_journal-2305 30 4 5 5 NUM american_scientific_journal-2305 30 5 , , PUNCT american_scientific_journal-2305 30 6 6 6 NUM american_scientific_journal-2305 30 7 , , PUNCT american_scientific_journal-2305 30 8 7 7 NUM american_scientific_journal-2305 30 9 , , PUNCT american_scientific_journal-2305 30 10 8 8 NUM american_scientific_journal-2305 30 11 , , PUNCT american_scientific_journal-2305 30 12 9 9 NUM american_scientific_journal-2305 30 13 , , PUNCT american_scientific_journal-2305 30 14 10 10 NUM american_scientific_journal-2305 30 15 , , PUNCT american_scientific_journal-2305 30 16 11 11 NUM american_scientific_journal-2305 30 17 ] ] PUNCT american_scientific_journal-2305 30 18 . . PUNCT american_scientific_journal-2305 31 1 𝐷𝐷𝐷𝐷𝐷𝐷𝑝𝑝 𝐷𝐷𝐷𝐷𝐷𝐷𝑝𝑝 PROPN american_scientific_journal-2305 31 2 = = SYM american_scientific_journal-2305 31 3 𝑟𝑟𝑟𝑟𝑟𝑟1 𝑟𝑟𝑟𝑟𝑟𝑟1 NOUN american_scientific_journal-2305 31 4 + + SYM american_scientific_journal-2305 31 5 � � PROPN american_scientific_journal-2305 31 6 𝑟𝑟𝑟𝑟𝑟𝑟𝑖𝑖 𝑟𝑟𝑟𝑟𝑟𝑟𝑖𝑖 NOUN american_scientific_journal-2305 31 7 𝑟𝑟𝑙𝑙𝑙𝑙2(𝑖𝑖 𝑟𝑟𝑙𝑙𝑙𝑙2(𝑖𝑖 PROPN american_scientific_journal-2305 31 8 ) ) PUNCT american_scientific_journal-2305 31 9 𝑝𝑝 𝑝𝑝 VERB american_scientific_journal-2305 31 10 𝑖𝑖=2 𝑖𝑖=2 ADV american_scientific_journal-2305 31 11 ( ( PUNCT american_scientific_journal-2305 31 12 1 1 X american_scientific_journal-2305 31 13 ) ) PUNCT american_scientific_journal-2305 31 14 where where SCONJ american_scientific_journal-2305 31 15 reli reli NOUN american_scientific_journal-2305 31 16 refers refer VERB american_scientific_journal-2305 31 17 to to ADP american_scientific_journal-2305 31 18 the the DET american_scientific_journal-2305 31 19 relevancy relevancy NOUN american_scientific_journal-2305 31 20 level level NOUN american_scientific_journal-2305 31 21 ( ( PUNCT american_scientific_journal-2305 31 22 0=