id sid tid token lemma pos american_scientific_journal-6910 1 1 11 11 NUM american_scientific_journal-6910 1 2 american american ADJ american_scientific_journal-6910 1 3 academic academic ADJ american_scientific_journal-6910 1 4 scientific scientific ADJ american_scientific_journal-6910 1 5 research research NOUN american_scientific_journal-6910 1 6 journal journal NOUN american_scientific_journal-6910 1 7 for for ADP american_scientific_journal-6910 1 8 engineering engineering NOUN american_scientific_journal-6910 1 9 , , PUNCT american_scientific_journal-6910 1 10 technology technology NOUN american_scientific_journal-6910 1 11 , , PUNCT american_scientific_journal-6910 1 12 and and CCONJ american_scientific_journal-6910 1 13 sciences sciences PROPN american_scientific_journal-6910 1 14 issn issn PROPN american_scientific_journal-6910 1 15 ( ( PUNCT american_scientific_journal-6910 1 16 print print NOUN american_scientific_journal-6910 1 17 ) ) PUNCT american_scientific_journal-6910 1 18 2313 2313 NUM american_scientific_journal-6910 1 19 - - SYM american_scientific_journal-6910 1 20 4410 4410 NUM american_scientific_journal-6910 1 21 , , PUNCT american_scientific_journal-6910 1 22 issn issn PROPN american_scientific_journal-6910 1 23 ( ( PUNCT american_scientific_journal-6910 1 24 online online ADJ american_scientific_journal-6910 1 25 ) ) PUNCT american_scientific_journal-6910 1 26 2313 2313 NUM american_scientific_journal-6910 1 27 - - SYM american_scientific_journal-6910 1 28 4402 4402 NUM american_scientific_journal-6910 1 29 http://asrjetsjournal.org/ http://asrjetsjournal.org/ NOUN american_scientific_journal-6910 1 30 a a DET american_scientific_journal-6910 1 31 q q ADV american_scientific_journal-6910 1 32 - - PUNCT american_scientific_journal-6910 1 33 learning learning ADJ american_scientific_journal-6910 1 34 based base VERB american_scientific_journal-6910 1 35 slice slice NOUN american_scientific_journal-6910 1 36 admission admission NOUN american_scientific_journal-6910 1 37 algorithm algorithm NOUN american_scientific_journal-6910 1 38 for for ADP american_scientific_journal-6910 1 39 multitier multitier ADJ american_scientific_journal-6910 1 40 5 5 NUM american_scientific_journal-6910 1 41 g g NOUN american_scientific_journal-6910 1 42 cellular cellular ADJ american_scientific_journal-6910 1 43 wireless wireless ADJ american_scientific_journal-6910 1 44 networks network NOUN american_scientific_journal-6910 1 45 elizabeth elizabeth PROPN american_scientific_journal-6910 1 46 m. m. PROPN american_scientific_journal-6910 1 47 okumu okumu PROPN american_scientific_journal-6910 1 48 * * PROPN american_scientific_journal-6910 1 49 kabarak kabarak PROPN american_scientific_journal-6910 1 50 university university PROPN american_scientific_journal-6910 1 51 , , PUNCT american_scientific_journal-6910 1 52 school school NOUN american_scientific_journal-6910 1 53 of of ADP american_scientific_journal-6910 1 54 science science NOUN american_scientific_journal-6910 1 55 engineering engineering NOUN american_scientific_journal-6910 1 56 and and CCONJ american_scientific_journal-6910 1 57 technology technology NOUN american_scientific_journal-6910 1 58 , , PUNCT american_scientific_journal-6910 1 59 p. p. PROPN american_scientific_journal-6910 1 60 o. o. PROPN american_scientific_journal-6910 1 61 box box PROPN american_scientific_journal-6910 1 62 private private ADJ american_scientific_journal-6910 1 63 bag bag NOUN american_scientific_journal-6910 1 64 20157 20157 NUM american_scientific_journal-6910 1 65 , , PUNCT american_scientific_journal-6910 1 66 nakuru nakuru PROPN american_scientific_journal-6910 1 67 20100 20100 NUM american_scientific_journal-6910 1 68 , , PUNCT american_scientific_journal-6910 1 69 kenya kenya PROPN american_scientific_journal-6910 1 70 email email NOUN american_scientific_journal-6910 1 71 : : PUNCT american_scientific_journal-6910 1 72 eokumu@kabarak.ac.ke eokumu@kabarak.ac.ke ADJ american_scientific_journal-6910 1 73 abstract abstract ADJ american_scientific_journal-6910 1 74 network network NOUN american_scientific_journal-6910 1 75 slicing slicing NOUN american_scientific_journal-6910 1 76 enables enable VERB american_scientific_journal-6910 1 77 a a DET american_scientific_journal-6910 1 78 5 5 NUM american_scientific_journal-6910 1 79 g g NOUN american_scientific_journal-6910 1 80 infrastructure infrastructure NOUN american_scientific_journal-6910 1 81 provider provider NOUN american_scientific_journal-6910 1 82 ( ( PUNCT american_scientific_journal-6910 1 83 network network NOUN american_scientific_journal-6910 1 84 infrastructure infrastructure NOUN american_scientific_journal-6910 1 85 owner owner NOUN american_scientific_journal-6910 1 86 ) ) PUNCT american_scientific_journal-6910 1 87 to to PART american_scientific_journal-6910 1 88 create create VERB american_scientific_journal-6910 1 89 multiple multiple ADJ american_scientific_journal-6910 1 90 separate separate ADJ american_scientific_journal-6910 1 91 virtual virtual ADJ american_scientific_journal-6910 1 92 networks network NOUN american_scientific_journal-6910 1 93 , , PUNCT american_scientific_journal-6910 1 94 each each PRON american_scientific_journal-6910 1 95 tailored tailor VERB american_scientific_journal-6910 1 96 at at ADP american_scientific_journal-6910 1 97 a a DET american_scientific_journal-6910 1 98 specific specific ADJ american_scientific_journal-6910 1 99 performance performance NOUN american_scientific_journal-6910 1 100 requirement requirement NOUN american_scientific_journal-6910 1 101 , , PUNCT american_scientific_journal-6910 1 102 on on ADP american_scientific_journal-6910 1 103 a a DET american_scientific_journal-6910 1 104 common common ADJ american_scientific_journal-6910 1 105 physical physical ADJ american_scientific_journal-6910 1 106 network network NOUN american_scientific_journal-6910 1 107 . . PUNCT american_scientific_journal-6910 2 1 in in ADP american_scientific_journal-6910 2 2 this this DET american_scientific_journal-6910 2 3 context context NOUN american_scientific_journal-6910 2 4 , , PUNCT american_scientific_journal-6910 2 5 slice slice NOUN american_scientific_journal-6910 2 6 admission admission NOUN american_scientific_journal-6910 2 7 algorithms algorithm NOUN american_scientific_journal-6910 2 8 are be AUX american_scientific_journal-6910 2 9 required require VERB american_scientific_journal-6910 2 10 to to PART american_scientific_journal-6910 2 11 process process VERB american_scientific_journal-6910 2 12 slice slice NOUN american_scientific_journal-6910 2 13 requests request NOUN american_scientific_journal-6910 2 14 received receive VERB american_scientific_journal-6910 2 15 by by ADP american_scientific_journal-6910 2 16 the the DET american_scientific_journal-6910 2 17 infrastructure infrastructure NOUN american_scientific_journal-6910 2 18 provider provider NOUN american_scientific_journal-6910 2 19 . . PUNCT american_scientific_journal-6910 3 1 these these DET american_scientific_journal-6910 3 2 algorithms algorithm NOUN american_scientific_journal-6910 3 3 are be AUX american_scientific_journal-6910 3 4 tailored tailor VERB american_scientific_journal-6910 3 5 to to PART american_scientific_journal-6910 3 6 admit admit VERB american_scientific_journal-6910 3 7 and and CCONJ american_scientific_journal-6910 3 8 allocate allocate ADJ american_scientific_journal-6910 3 9 resources resource NOUN american_scientific_journal-6910 3 10 to to ADP american_scientific_journal-6910 3 11 network network NOUN american_scientific_journal-6910 3 12 slices slice NOUN american_scientific_journal-6910 3 13 in in ADP american_scientific_journal-6910 3 14 a a DET american_scientific_journal-6910 3 15 manner manner NOUN american_scientific_journal-6910 3 16 that that PRON american_scientific_journal-6910 3 17 results result VERB american_scientific_journal-6910 3 18 in in ADP american_scientific_journal-6910 3 19 the the DET american_scientific_journal-6910 3 20 optimization optimization NOUN american_scientific_journal-6910 3 21 of of ADP american_scientific_journal-6910 3 22 a a DET american_scientific_journal-6910 3 23 given give VERB american_scientific_journal-6910 3 24 objective objective NOUN american_scientific_journal-6910 3 25 . . PUNCT american_scientific_journal-6910 4 1 in in ADP american_scientific_journal-6910 4 2 this this DET american_scientific_journal-6910 4 3 paper paper NOUN american_scientific_journal-6910 4 4 , , PUNCT american_scientific_journal-6910 4 5 a a DET american_scientific_journal-6910 4 6 q q ADJ american_scientific_journal-6910 4 7 - - PUNCT american_scientific_journal-6910 4 8 learning learn VERB american_scientific_journal-6910 4 9 slice slice NOUN american_scientific_journal-6910 4 10 admission admission NOUN american_scientific_journal-6910 4 11 algorithm algorithm NOUN american_scientific_journal-6910 4 12 , , PUNCT american_scientific_journal-6910 4 13 which which PRON american_scientific_journal-6910 4 14 maximizes maximize VERB american_scientific_journal-6910 4 15 the the DET american_scientific_journal-6910 4 16 infrastructure infrastructure NOUN american_scientific_journal-6910 4 17 provider provider NOUN american_scientific_journal-6910 4 18 ’s ’s PART american_scientific_journal-6910 4 19 revenue revenue NOUN american_scientific_journal-6910 4 20 , , PUNCT american_scientific_journal-6910 4 21 is be AUX american_scientific_journal-6910 4 22 designed design VERB american_scientific_journal-6910 4 23 . . PUNCT american_scientific_journal-6910 5 1 results result NOUN american_scientific_journal-6910 5 2 show show VERB american_scientific_journal-6910 5 3 that that SCONJ american_scientific_journal-6910 5 4 the the DET american_scientific_journal-6910 5 5 designed design VERB american_scientific_journal-6910 5 6 algorithm algorithm NOUN american_scientific_journal-6910 5 7 learns learn VERB american_scientific_journal-6910 5 8 from from ADP american_scientific_journal-6910 5 9 its its PRON american_scientific_journal-6910 5 10 environment environment NOUN american_scientific_journal-6910 5 11 , , PUNCT american_scientific_journal-6910 5 12 which which PRON american_scientific_journal-6910 5 13 enables enable VERB american_scientific_journal-6910 5 14 it it PRON american_scientific_journal-6910 5 15 to to PART american_scientific_journal-6910 5 16 acquire acquire VERB american_scientific_journal-6910 5 17 knowledge knowledge NOUN american_scientific_journal-6910 5 18 about about ADP american_scientific_journal-6910 5 19 the the DET american_scientific_journal-6910 5 20 multi multi ADJ american_scientific_journal-6910 5 21 - - ADJ american_scientific_journal-6910 5 22 tiered tiered ADJ american_scientific_journal-6910 5 23 cellular cellular ADJ american_scientific_journal-6910 5 24 network network NOUN american_scientific_journal-6910 5 25 , , PUNCT american_scientific_journal-6910 5 26 thus thus ADV american_scientific_journal-6910 5 27 allowing allow VERB american_scientific_journal-6910 5 28 it it PRON american_scientific_journal-6910 5 29 make make VERB american_scientific_journal-6910 5 30 optimal optimal ADJ american_scientific_journal-6910 5 31 slice slice NOUN american_scientific_journal-6910 5 32 admission admission NOUN american_scientific_journal-6910 5 33 decisions decision NOUN american_scientific_journal-6910 5 34 . . PUNCT american_scientific_journal-6910 6 1 the the DET american_scientific_journal-6910 6 2 results result NOUN american_scientific_journal-6910 6 3 further far ADV american_scientific_journal-6910 6 4 show show VERB american_scientific_journal-6910 6 5 that that SCONJ american_scientific_journal-6910 6 6 the the DET american_scientific_journal-6910 6 7 designed design VERB american_scientific_journal-6910 6 8 algorithm algorithm NOUN american_scientific_journal-6910 6 9 has have VERB american_scientific_journal-6910 6 10 superior superior ADJ american_scientific_journal-6910 6 11 performance performance NOUN american_scientific_journal-6910 6 12 in in ADP american_scientific_journal-6910 6 13 terms term NOUN american_scientific_journal-6910 6 14 of of ADP american_scientific_journal-6910 6 15 revenue revenue NOUN american_scientific_journal-6910 6 16 achieved achieve VERB american_scientific_journal-6910 6 17 when when SCONJ american_scientific_journal-6910 6 18 compared compare VERB american_scientific_journal-6910 6 19 to to ADP american_scientific_journal-6910 6 20 algorithms algorithm NOUN american_scientific_journal-6910 6 21 that that PRON american_scientific_journal-6910 6 22 admit admit VERB american_scientific_journal-6910 6 23 , , PUNCT american_scientific_journal-6910 6 24 a a PRON american_scientific_journal-6910 6 25 ) ) PUNCT american_scientific_journal-6910 6 26 to to PART american_scientific_journal-6910 6 27 maximize maximize VERB american_scientific_journal-6910 6 28 immediate immediate ADJ american_scientific_journal-6910 6 29 rewards reward NOUN american_scientific_journal-6910 6 30 and and CCONJ american_scientific_journal-6910 6 31 b b X american_scientific_journal-6910 6 32 ) ) PUNCT american_scientific_journal-6910 6 33 slices slice NOUN american_scientific_journal-6910 6 34 in in ADP american_scientific_journal-6910 6 35 a a DET american_scientific_journal-6910 6 36 random random ADJ american_scientific_journal-6910 6 37 manner manner NOUN american_scientific_journal-6910 6 38 . . PUNCT american_scientific_journal-6910 7 1 keywords keyword NOUN american_scientific_journal-6910 7 2 : : PUNCT american_scientific_journal-6910 7 3 network network NOUN american_scientific_journal-6910 7 4 slice slice NOUN american_scientific_journal-6910 7 5 ; ; PUNCT american_scientific_journal-6910 7 6 5 5 NUM american_scientific_journal-6910 7 7 g g NOUN american_scientific_journal-6910 7 8 ; ; PUNCT american_scientific_journal-6910 7 9 reinforcement reinforcement NOUN american_scientific_journal-6910 7 10 learning learning NOUN american_scientific_journal-6910 7 11 ; ; PUNCT american_scientific_journal-6910 7 12 slice slice NOUN american_scientific_journal-6910 7 13 admission admission NOUN american_scientific_journal-6910 7 14 ; ; PUNCT american_scientific_journal-6910 7 15 resource resource NOUN american_scientific_journal-6910 7 16 allocation allocation NOUN american_scientific_journal-6910 7 17 . . PUNCT american_scientific_journal-6910 8 1 1 1 X american_scientific_journal-6910 8 2 . . X american_scientific_journal-6910 8 3 introduction introduction NOUN american_scientific_journal-6910 8 4 fifth fifth ADJ american_scientific_journal-6910 8 5 generation generation NOUN american_scientific_journal-6910 8 6 ( ( PUNCT american_scientific_journal-6910 8 7 5 5 NUM american_scientific_journal-6910 8 8 g g NOUN american_scientific_journal-6910 8 9 ) ) PUNCT american_scientific_journal-6910 8 10 wireless wireless NOUN american_scientific_journal-6910 8 11 networks network NOUN american_scientific_journal-6910 8 12 are be AUX american_scientific_journal-6910 8 13 expected expect VERB american_scientific_journal-6910 8 14 to to PART american_scientific_journal-6910 8 15 accommodate accommodate VERB american_scientific_journal-6910 8 16 a a DET american_scientific_journal-6910 8 17 profusion profusion NOUN american_scientific_journal-6910 8 18 of of ADP american_scientific_journal-6910 8 19 mobile mobile ADJ american_scientific_journal-6910 8 20 devices device NOUN american_scientific_journal-6910 8 21 and and CCONJ american_scientific_journal-6910 8 22 support support VERB american_scientific_journal-6910 8 23 a a DET american_scientific_journal-6910 8 24 variety variety NOUN american_scientific_journal-6910 8 25 of of ADP american_scientific_journal-6910 8 26 services service NOUN american_scientific_journal-6910 8 27 with with ADP american_scientific_journal-6910 8 28 unique unique ADJ american_scientific_journal-6910 8 29 performance performance NOUN american_scientific_journal-6910 8 30 requirements requirement NOUN american_scientific_journal-6910 8 31 . . PUNCT american_scientific_journal-6910 9 1 the the DET american_scientific_journal-6910 9 2 one one NUM american_scientific_journal-6910 9 3 - - PUNCT american_scientific_journal-6910 9 4 size size NOUN american_scientific_journal-6910 9 5 - - PUNCT american_scientific_journal-6910 9 6 fits fit VERB american_scientific_journal-6910 9 7 - - PUNCT american_scientific_journal-6910 9 8 all all PRON american_scientific_journal-6910 9 9 approach approach NOUN american_scientific_journal-6910 9 10 employed employ VERB american_scientific_journal-6910 9 11 by by ADP american_scientific_journal-6910 9 12 traditional traditional ADJ american_scientific_journal-6910 9 13 networks network NOUN american_scientific_journal-6910 9 14 , , PUNCT american_scientific_journal-6910 9 15 e.g. e.g. ADV american_scientific_journal-6910 9 16 4 4 NUM american_scientific_journal-6910 9 17 g g NOUN american_scientific_journal-6910 9 18 , , PUNCT american_scientific_journal-6910 9 19 is be AUX american_scientific_journal-6910 9 20 incapable incapable ADJ american_scientific_journal-6910 9 21 of of ADP american_scientific_journal-6910 9 22 addressing address VERB american_scientific_journal-6910 9 23 these these DET american_scientific_journal-6910 9 24 varying vary VERB american_scientific_journal-6910 9 25 performance performance NOUN american_scientific_journal-6910 9 26 requirements requirement NOUN american_scientific_journal-6910 9 27 . . PUNCT american_scientific_journal-6910 10 1 softwaredefined softwaredefine VERB american_scientific_journal-6910 10 2 radio radio NOUN american_scientific_journal-6910 10 3 ( ( PUNCT american_scientific_journal-6910 10 4 sdn sdn PROPN american_scientific_journal-6910 10 5 ) ) PUNCT american_scientific_journal-6910 10 6 and and CCONJ american_scientific_journal-6910 10 7 network network NOUN american_scientific_journal-6910 10 8 function function NOUN american_scientific_journal-6910 10 9 virtualization virtualization NOUN american_scientific_journal-6910 10 10 ( ( PUNCT american_scientific_journal-6910 10 11 nfv nfv NOUN american_scientific_journal-6910 10 12 ) ) PUNCT american_scientific_journal-6910 10 13 are be AUX american_scientific_journal-6910 10 14 enabling enable VERB american_scientific_journal-6910 10 15 technologies technology NOUN american_scientific_journal-6910 10 16 for for ADP american_scientific_journal-6910 10 17 softwarized softwarized ADJ american_scientific_journal-6910 10 18 and and CCONJ american_scientific_journal-6910 10 19 virtualized virtualized ADJ american_scientific_journal-6910 10 20 networks network NOUN american_scientific_journal-6910 10 21 [ [ X american_scientific_journal-6910 10 22 1,2,3 1,2,3 NOUN american_scientific_journal-6910 10 23 ] ] PUNCT american_scientific_journal-6910 10 24 . . PUNCT american_scientific_journal-6910 11 1 by by ADP american_scientific_journal-6910 11 2 leveraging leverage VERB american_scientific_journal-6910 11 3 on on ADP american_scientific_journal-6910 11 4 the the DET american_scientific_journal-6910 11 5 aforementioned aforementioned ADJ american_scientific_journal-6910 11 6 technologies technology NOUN american_scientific_journal-6910 11 7 , , PUNCT american_scientific_journal-6910 11 8 5 5 NUM american_scientific_journal-6910 11 9 g g NOUN american_scientific_journal-6910 11 10 networks network NOUN american_scientific_journal-6910 11 11 can can AUX american_scientific_journal-6910 11 12 address address VERB american_scientific_journal-6910 11 13 the the DET american_scientific_journal-6910 11 14 divergent divergent ADJ american_scientific_journal-6910 11 15 service service NOUN american_scientific_journal-6910 11 16 requirements requirement NOUN american_scientific_journal-6910 11 17 using use VERB american_scientific_journal-6910 11 18 network network NOUN american_scientific_journal-6910 11 19 slicing slicing NOUN american_scientific_journal-6910 11 20 . . PUNCT american_scientific_journal-6910 12 1 with with ADP american_scientific_journal-6910 12 2 network network NOUN american_scientific_journal-6910 12 3 slicing slicing NOUN american_scientific_journal-6910 12 4 , , PUNCT american_scientific_journal-6910 12 5 the the DET american_scientific_journal-6910 12 6 physical physical ADJ american_scientific_journal-6910 12 7 network network NOUN american_scientific_journal-6910 12 8 is be AUX american_scientific_journal-6910 12 9 sliced slice VERB american_scientific_journal-6910 12 10 into into ADP american_scientific_journal-6910 12 11 multiple multiple ADJ american_scientific_journal-6910 12 12 logical logical ADJ american_scientific_journal-6910 12 13 networks network NOUN american_scientific_journal-6910 12 14 , , PUNCT american_scientific_journal-6910 12 15 each each PRON american_scientific_journal-6910 12 16 customized customize VERB american_scientific_journal-6910 12 17 for for ADP american_scientific_journal-6910 12 18 a a DET american_scientific_journal-6910 12 19 unique unique ADJ american_scientific_journal-6910 12 20 service service NOUN american_scientific_journal-6910 12 21 requirement requirement NOUN american_scientific_journal-6910 13 1 [ [ X american_scientific_journal-6910 13 2 4 4 NUM american_scientific_journal-6910 13 3 ] ] PUNCT american_scientific_journal-6910 13 4 . . PUNCT american_scientific_journal-6910 14 1 ----------------------------------------------------------------------- ----------------------------------------------------------------------- PUNCT american_scientific_journal-6910 15 1 * * PUNCT american_scientific_journal-6910 15 2 corresponding correspond VERB american_scientific_journal-6910 15 3 author author NOUN american_scientific_journal-6910 15 4 . . PUNCT american_scientific_journal-6910 16 1 http://asrjetsjournal.org/ http://asrjetsjournal.org/ PROPN american_scientific_journal-6910 16 2 american american PROPN american_scientific_journal-6910 16 3 scientific scientific PROPN american_scientific_journal-6910 16 4 research research NOUN american_scientific_journal-6910 16 5 journal journal NOUN american_scientific_journal-6910 16 6 for for ADP american_scientific_journal-6910 16 7 engineering engineering NOUN american_scientific_journal-6910 16 8 , , PUNCT american_scientific_journal-6910 16 9 technology technology NOUN american_scientific_journal-6910 16 10 , , PUNCT american_scientific_journal-6910 16 11 and and CCONJ american_scientific_journal-6910 16 12 sciences science NOUN american_scientific_journal-6910 16 13 ( ( PUNCT american_scientific_journal-6910 16 14 asrjets asrjet NOUN american_scientific_journal-6910 16 15 ) ) PUNCT american_scientific_journal-6910 16 16 ( ( PUNCT american_scientific_journal-6910 16 17 2021 2021 NUM american_scientific_journal-6910 16 18 ) ) PUNCT american_scientific_journal-6910 16 19 volume volume NOUN american_scientific_journal-6910 16 20 82 82 NUM american_scientific_journal-6910 16 21 , , PUNCT american_scientific_journal-6910 16 22 no no DET american_scientific_journal-6910 16 23 1 1 NUM american_scientific_journal-6910 16 24 , , PUNCT american_scientific_journal-6910 16 25 pp pp ADV american_scientific_journal-6910 16 26 11 11 NUM american_scientific_journal-6910 16 27 - - SYM american_scientific_journal-6910 16 28 18 18 NUM american_scientific_journal-6910 16 29 12 12 NUM american_scientific_journal-6910 16 30 network network NOUN american_scientific_journal-6910 16 31 resources resource NOUN american_scientific_journal-6910 16 32 are be AUX american_scientific_journal-6910 16 33 dynamically dynamically ADV american_scientific_journal-6910 16 34 allocated allocate VERB american_scientific_journal-6910 16 35 to to ADP american_scientific_journal-6910 16 36 network network NOUN american_scientific_journal-6910 16 37 slices slice NOUN american_scientific_journal-6910 16 38 , , PUNCT american_scientific_journal-6910 16 39 depending depend VERB american_scientific_journal-6910 16 40 on on ADP american_scientific_journal-6910 16 41 their their PRON american_scientific_journal-6910 16 42 service service NOUN american_scientific_journal-6910 16 43 requirements requirement NOUN american_scientific_journal-6910 16 44 , , PUNCT american_scientific_journal-6910 16 45 enabling enable VERB american_scientific_journal-6910 16 46 the the DET american_scientific_journal-6910 16 47 efficient efficient ADJ american_scientific_journal-6910 16 48 deployment deployment NOUN american_scientific_journal-6910 16 49 of of ADP american_scientific_journal-6910 16 50 the the DET american_scientific_journal-6910 16 51 various various ADJ american_scientific_journal-6910 16 52 services service NOUN american_scientific_journal-6910 16 53 . . PUNCT american_scientific_journal-6910 17 1 network network NOUN american_scientific_journal-6910 17 2 slicing slicing NOUN american_scientific_journal-6910 17 3 brings bring VERB american_scientific_journal-6910 17 4 about about ADP american_scientific_journal-6910 17 5 a a DET american_scientific_journal-6910 17 6 division division NOUN american_scientific_journal-6910 17 7 of of ADP american_scientific_journal-6910 17 8 roles role NOUN american_scientific_journal-6910 17 9 in in ADP american_scientific_journal-6910 17 10 the the DET american_scientific_journal-6910 17 11 5 5 NUM american_scientific_journal-6910 17 12 g g NOUN american_scientific_journal-6910 17 13 network network NOUN american_scientific_journal-6910 17 14 between between ADP american_scientific_journal-6910 17 15 infrastructure infrastructure NOUN american_scientific_journal-6910 17 16 providers provider NOUN american_scientific_journal-6910 17 17 , , PUNCT american_scientific_journal-6910 17 18 who who PRON american_scientific_journal-6910 17 19 own own VERB american_scientific_journal-6910 17 20 and and CCONJ american_scientific_journal-6910 17 21 operate operate VERB american_scientific_journal-6910 17 22 the the DET american_scientific_journal-6910 17 23 physical physical ADJ american_scientific_journal-6910 17 24 network network NOUN american_scientific_journal-6910 17 25 recourses recourse NOUN american_scientific_journal-6910 17 26 , , PUNCT american_scientific_journal-6910 17 27 and and CCONJ american_scientific_journal-6910 17 28 slice slice NOUN american_scientific_journal-6910 17 29 tenants tenant NOUN american_scientific_journal-6910 17 30 , , PUNCT american_scientific_journal-6910 17 31 who who PRON american_scientific_journal-6910 17 32 buy buy VERB american_scientific_journal-6910 17 33 slices slice NOUN american_scientific_journal-6910 17 34 from from ADP american_scientific_journal-6910 17 35 the the DET american_scientific_journal-6910 17 36 infrastructure infrastructure NOUN american_scientific_journal-6910 17 37 providers provider NOUN american_scientific_journal-6910 17 38 , , PUNCT american_scientific_journal-6910 17 39 and and CCONJ american_scientific_journal-6910 17 40 then then ADV american_scientific_journal-6910 17 41 sell sell VERB american_scientific_journal-6910 17 42 them they PRON american_scientific_journal-6910 17 43 to to ADP american_scientific_journal-6910 17 44 the the DET american_scientific_journal-6910 17 45 end end NOUN american_scientific_journal-6910 17 46 users user NOUN american_scientific_journal-6910 17 47 . . PUNCT american_scientific_journal-6910 18 1 slice slice NOUN american_scientific_journal-6910 18 2 admission admission NOUN american_scientific_journal-6910 18 3 algorithms algorithm NOUN american_scientific_journal-6910 18 4 are be AUX american_scientific_journal-6910 18 5 required require VERB american_scientific_journal-6910 18 6 for for ADP american_scientific_journal-6910 18 7 efficient efficient ADJ american_scientific_journal-6910 18 8 allocation allocation NOUN american_scientific_journal-6910 18 9 of of ADP american_scientific_journal-6910 18 10 resources resource NOUN american_scientific_journal-6910 18 11 , , PUNCT american_scientific_journal-6910 18 12 and and CCONJ american_scientific_journal-6910 18 13 to to PART american_scientific_journal-6910 18 14 meet meet VERB american_scientific_journal-6910 18 15 predetermined predetermined ADJ american_scientific_journal-6910 18 16 objectives objective NOUN american_scientific_journal-6910 18 17 for for ADP american_scientific_journal-6910 18 18 the the DET american_scientific_journal-6910 18 19 infrastructure infrastructure NOUN american_scientific_journal-6910 18 20 provider provider NOUN american_scientific_journal-6910 18 21 . . PUNCT american_scientific_journal-6910 19 1 the the DET american_scientific_journal-6910 19 2 objectives objective NOUN american_scientific_journal-6910 19 3 can can AUX american_scientific_journal-6910 19 4 be be AUX american_scientific_journal-6910 19 5 broadly broadly ADV american_scientific_journal-6910 19 6 classified classify VERB american_scientific_journal-6910 19 7 as as ADP american_scientific_journal-6910 19 8 revenue revenue NOUN american_scientific_journal-6910 19 9 optimization optimization NOUN american_scientific_journal-6910 19 10 , , PUNCT american_scientific_journal-6910 19 11 qos qos PROPN american_scientific_journal-6910 19 12 control control PROPN american_scientific_journal-6910 19 13 , , PUNCT american_scientific_journal-6910 19 14 interslice interslice VERB american_scientific_journal-6910 19 15 congestion congestion NOUN american_scientific_journal-6910 19 16 control control NOUN american_scientific_journal-6910 19 17 and and CCONJ american_scientific_journal-6910 19 18 slice slice NOUN american_scientific_journal-6910 19 19 fairness fairness NOUN american_scientific_journal-6910 19 20 assurance assurance NOUN american_scientific_journal-6910 20 1 [ [ X american_scientific_journal-6910 20 2 5 5 NUM american_scientific_journal-6910 20 3 ] ] PUNCT american_scientific_journal-6910 20 4 . . PUNCT american_scientific_journal-6910 21 1 the the DET american_scientific_journal-6910 21 2 authors author NOUN american_scientific_journal-6910 21 3 in in ADP american_scientific_journal-6910 21 4 [ [ X american_scientific_journal-6910 21 5 6 6 NUM american_scientific_journal-6910 21 6 ] ] PUNCT american_scientific_journal-6910 21 7 designed design VERB american_scientific_journal-6910 21 8 a a DET american_scientific_journal-6910 21 9 revenue revenue NOUN american_scientific_journal-6910 21 10 optimizing optimize VERB american_scientific_journal-6910 21 11 qlearning qlearning NOUN american_scientific_journal-6910 21 12 algorithm algorithm NOUN american_scientific_journal-6910 21 13 for for ADP american_scientific_journal-6910 21 14 elastic elastic ADJ american_scientific_journal-6910 21 15 and and CCONJ american_scientific_journal-6910 21 16 inelastic inelastic ADJ american_scientific_journal-6910 21 17 service service NOUN american_scientific_journal-6910 21 18 types type NOUN american_scientific_journal-6910 21 19 ; ; PUNCT american_scientific_journal-6910 21 20 slice slice NOUN american_scientific_journal-6910 21 21 requests request NOUN american_scientific_journal-6910 21 22 that that PRON american_scientific_journal-6910 21 23 were be AUX american_scientific_journal-6910 21 24 not not PART american_scientific_journal-6910 21 25 serviced service VERB american_scientific_journal-6910 21 26 were be AUX american_scientific_journal-6910 21 27 lost lose VERB american_scientific_journal-6910 21 28 . . PUNCT american_scientific_journal-6910 22 1 in in ADP american_scientific_journal-6910 22 2 this this DET american_scientific_journal-6910 22 3 paper paper NOUN american_scientific_journal-6910 22 4 , , PUNCT american_scientific_journal-6910 22 5 reinforcement reinforcement NOUN american_scientific_journal-6910 22 6 learning learning NOUN american_scientific_journal-6910 22 7 techniques technique NOUN american_scientific_journal-6910 22 8 are be AUX american_scientific_journal-6910 22 9 used use VERB american_scientific_journal-6910 22 10 to to PART american_scientific_journal-6910 22 11 develop develop VERB american_scientific_journal-6910 22 12 an an DET american_scientific_journal-6910 22 13 adaptive adaptive ADJ american_scientific_journal-6910 22 14 revenue revenue NOUN american_scientific_journal-6910 22 15 optimizing optimize VERB american_scientific_journal-6910 22 16 slice slice NOUN american_scientific_journal-6910 22 17 admission admission NOUN american_scientific_journal-6910 22 18 algorithm algorithm NOUN american_scientific_journal-6910 22 19 for for ADP american_scientific_journal-6910 22 20 a a DET american_scientific_journal-6910 22 21 multi multi ADJ american_scientific_journal-6910 22 22 - - ADJ american_scientific_journal-6910 22 23 tied tie VERB american_scientific_journal-6910 22 24 5 5 NUM american_scientific_journal-6910 22 25 g g NOUN american_scientific_journal-6910 22 26 wireless wireless ADJ american_scientific_journal-6910 22 27 network network NOUN american_scientific_journal-6910 22 28 . . PUNCT american_scientific_journal-6910 23 1 network network NOUN american_scientific_journal-6910 23 2 slice slice NOUN american_scientific_journal-6910 23 3 requests request NOUN american_scientific_journal-6910 23 4 are be AUX american_scientific_journal-6910 23 5 placed place VERB american_scientific_journal-6910 23 6 on on ADP american_scientific_journal-6910 23 7 queues queue NOUN american_scientific_journal-6910 23 8 from from ADP american_scientific_journal-6910 23 9 where where SCONJ american_scientific_journal-6910 23 10 they they PRON american_scientific_journal-6910 23 11 are be AUX american_scientific_journal-6910 23 12 processed process VERB american_scientific_journal-6910 23 13 from from ADP american_scientific_journal-6910 23 14 . . PUNCT american_scientific_journal-6910 24 1 the the DET american_scientific_journal-6910 24 2 designed design VERB american_scientific_journal-6910 24 3 q q ADJ american_scientific_journal-6910 24 4 - - PUNCT american_scientific_journal-6910 24 5 learning learn VERB american_scientific_journal-6910 24 6 algorithm algorithm NOUN american_scientific_journal-6910 24 7 also also ADV american_scientific_journal-6910 24 8 ensures ensure VERB american_scientific_journal-6910 24 9 that that SCONJ american_scientific_journal-6910 24 10 the the DET american_scientific_journal-6910 24 11 service service NOUN american_scientific_journal-6910 24 12 requirements requirement NOUN american_scientific_journal-6910 24 13 of of ADP american_scientific_journal-6910 24 14 the the DET american_scientific_journal-6910 24 15 different different ADJ american_scientific_journal-6910 24 16 slices slice NOUN american_scientific_journal-6910 24 17 are be AUX american_scientific_journal-6910 24 18 met meet VERB american_scientific_journal-6910 24 19 . . PUNCT american_scientific_journal-6910 25 1 1.1 1.1 NUM american_scientific_journal-6910 25 2 . . PUNCT american_scientific_journal-6910 25 3 reinforcement reinforcement NOUN american_scientific_journal-6910 25 4 learning learning NOUN american_scientific_journal-6910 25 5 reinforcement reinforcement NOUN american_scientific_journal-6910 25 6 learning learning NOUN american_scientific_journal-6910 25 7 ( ( PUNCT american_scientific_journal-6910 25 8 rl rl NOUN american_scientific_journal-6910 25 9 ) ) PUNCT american_scientific_journal-6910 25 10 is be AUX american_scientific_journal-6910 25 11 a a DET american_scientific_journal-6910 25 12 machine machine NOUN american_scientific_journal-6910 25 13 learning learning NOUN american_scientific_journal-6910 25 14 technique technique NOUN american_scientific_journal-6910 25 15 that that PRON american_scientific_journal-6910 25 16 enables enable VERB american_scientific_journal-6910 25 17 an an DET american_scientific_journal-6910 25 18 autonomous autonomous ADJ american_scientific_journal-6910 25 19 agent agent NOUN american_scientific_journal-6910 25 20 to to PART american_scientific_journal-6910 25 21 select select VERB american_scientific_journal-6910 25 22 optimal optimal ADJ american_scientific_journal-6910 25 23 actions action NOUN american_scientific_journal-6910 25 24 without without ADP american_scientific_journal-6910 25 25 prior prior ADJ american_scientific_journal-6910 25 26 knowledge knowledge NOUN american_scientific_journal-6910 25 27 of of ADP american_scientific_journal-6910 25 28 the the DET american_scientific_journal-6910 25 29 environment environment NOUN american_scientific_journal-6910 25 30 ( ( PUNCT american_scientific_journal-6910 25 31 system system NOUN american_scientific_journal-6910 25 32 ) ) PUNCT american_scientific_journal-6910 26 1 [ [ X american_scientific_journal-6910 26 2 7 7 NUM american_scientific_journal-6910 26 3 ] ] PUNCT american_scientific_journal-6910 26 4 . . PUNCT american_scientific_journal-6910 27 1 the the DET american_scientific_journal-6910 27 2 agent agent NOUN american_scientific_journal-6910 27 3 takes take VERB american_scientific_journal-6910 27 4 actions action NOUN american_scientific_journal-6910 27 5 , , PUNCT american_scientific_journal-6910 27 6 observes observe VERB american_scientific_journal-6910 27 7 the the DET american_scientific_journal-6910 27 8 response response NOUN american_scientific_journal-6910 27 9 from from ADP american_scientific_journal-6910 27 10 the the DET american_scientific_journal-6910 27 11 environment environment NOUN american_scientific_journal-6910 27 12 and and CCONJ american_scientific_journal-6910 27 13 then then ADV american_scientific_journal-6910 27 14 automatically automatically ADV american_scientific_journal-6910 27 15 modifies modify VERB american_scientific_journal-6910 27 16 its its PRON american_scientific_journal-6910 27 17 approach approach NOUN american_scientific_journal-6910 27 18 to to PART american_scientific_journal-6910 27 19 achieve achieve VERB american_scientific_journal-6910 27 20 the the DET american_scientific_journal-6910 27 21 optimal optimal ADJ american_scientific_journal-6910 27 22 policy policy NOUN american_scientific_journal-6910 27 23 . . PUNCT american_scientific_journal-6910 28 1 in in ADP american_scientific_journal-6910 28 2 rl rl PROPN american_scientific_journal-6910 28 3 , , PUNCT american_scientific_journal-6910 28 4 the the DET american_scientific_journal-6910 28 5 environment environment NOUN american_scientific_journal-6910 28 6 is be AUX american_scientific_journal-6910 28 7 modeled model VERB american_scientific_journal-6910 28 8 as as ADP american_scientific_journal-6910 28 9 a a DET american_scientific_journal-6910 28 10 markov markov NOUN american_scientific_journal-6910 28 11 decision decision NOUN american_scientific_journal-6910 28 12 process process NOUN american_scientific_journal-6910 28 13 ( ( PUNCT american_scientific_journal-6910 28 14 mdp mdp NOUN american_scientific_journal-6910 28 15 ) ) PUNCT american_scientific_journal-6910 29 1 [ [ X american_scientific_journal-6910 29 2 8 8 NUM american_scientific_journal-6910 29 3 ] ] PUNCT american_scientific_journal-6910 29 4 . . PUNCT american_scientific_journal-6910 30 1 mdps mdps PROPN american_scientific_journal-6910 30 2 model model NOUN american_scientific_journal-6910 30 3 decision decision NOUN american_scientific_journal-6910 30 4 making make VERB american_scientific_journal-6910 30 5 in in ADP american_scientific_journal-6910 30 6 a a DET american_scientific_journal-6910 30 7 discrete discrete ADJ american_scientific_journal-6910 30 8 , , PUNCT american_scientific_journal-6910 30 9 stochastic stochastic ADJ american_scientific_journal-6910 30 10 environment environment NOUN american_scientific_journal-6910 30 11 under under ADP american_scientific_journal-6910 30 12 the the DET american_scientific_journal-6910 30 13 control control NOUN american_scientific_journal-6910 30 14 of of ADP american_scientific_journal-6910 30 15 a a DET american_scientific_journal-6910 30 16 decision decision NOUN american_scientific_journal-6910 30 17 maker maker NOUN american_scientific_journal-6910 30 18 or or CCONJ american_scientific_journal-6910 30 19 agent agent NOUN american_scientific_journal-6910 30 20 . . PUNCT american_scientific_journal-6910 31 1 an an DET american_scientific_journal-6910 31 2 mdp mdp NOUN american_scientific_journal-6910 31 3 is be AUX american_scientific_journal-6910 31 4 defined define VERB american_scientific_journal-6910 31 5 by by ADP american_scientific_journal-6910 31 6 ο‚· ο‚· X american_scientific_journal-6910 31 7 a a DET american_scientific_journal-6910 31 8 finite finite ADJ american_scientific_journal-6910 31 9 set set NOUN american_scientific_journal-6910 31 10 of of ADP american_scientific_journal-6910 31 11 states state NOUN american_scientific_journal-6910 31 12 , , PUNCT american_scientific_journal-6910 31 13 𝑆 𝑆 PROPN american_scientific_journal-6910 31 14 , , PUNCT american_scientific_journal-6910 31 15 of of ADP american_scientific_journal-6910 31 16 the the DET american_scientific_journal-6910 31 17 environment environment NOUN american_scientific_journal-6910 31 18 . . PUNCT american_scientific_journal-6910 32 1 ο‚· ο‚· X american_scientific_journal-6910 32 2 a a DET american_scientific_journal-6910 32 3 finite finite ADJ american_scientific_journal-6910 32 4 set set NOUN american_scientific_journal-6910 32 5 of of ADP american_scientific_journal-6910 32 6 actions action NOUN american_scientific_journal-6910 32 7 , , PUNCT american_scientific_journal-6910 32 8 𝐴 𝐴 PROPN american_scientific_journal-6910 32 9 ο‚· ο‚· NOUN american_scientific_journal-6910 32 10 a a DET american_scientific_journal-6910 32 11 transition transition NOUN american_scientific_journal-6910 32 12 probability probability NOUN american_scientific_journal-6910 32 13 , , PUNCT american_scientific_journal-6910 32 14 𝑃(𝑠 𝑃(𝑠 PRON american_scientific_journal-6910 32 15 , , PUNCT american_scientific_journal-6910 32 16 π‘Ž π‘Ž NOUN american_scientific_journal-6910 32 17 , , PUNCT american_scientific_journal-6910 32 18 𝑠′ 𝑠′ NOUN american_scientific_journal-6910 32 19 ) ) PUNCT american_scientific_journal-6910 32 20 , , PUNCT american_scientific_journal-6910 32 21 from from ADP american_scientific_journal-6910 32 22 state state NOUN american_scientific_journal-6910 32 23 s s NOUN american_scientific_journal-6910 32 24 to to PART american_scientific_journal-6910 32 25 state state VERB american_scientific_journal-6910 32 26 𝑠′ 𝑠′ PROPN american_scientific_journal-6910 32 27 ( ( PUNCT american_scientific_journal-6910 32 28 𝑠 𝑠 PROPN american_scientific_journal-6910 32 29 , , PUNCT american_scientific_journal-6910 32 30 𝑠′ 𝑠′ PROPN american_scientific_journal-6910 32 31 ∈ ∈ PROPN american_scientific_journal-6910 32 32 𝑆 𝑆 PROPN american_scientific_journal-6910 32 33 ) ) PUNCT american_scientific_journal-6910 32 34 when when SCONJ american_scientific_journal-6910 32 35 action action NOUN american_scientific_journal-6910 32 36 π‘Ž π‘Ž PROPN american_scientific_journal-6910 32 37 ∈ ∈ PROPN american_scientific_journal-6910 32 38 𝐴 𝐴 PROPN american_scientific_journal-6910 32 39 is be AUX american_scientific_journal-6910 32 40 executed execute VERB american_scientific_journal-6910 32 41 . . PUNCT american_scientific_journal-6910 33 1 ο‚· ο‚· X american_scientific_journal-6910 33 2 an an DET american_scientific_journal-6910 33 3 immediate immediate ADJ american_scientific_journal-6910 33 4 reward reward NOUN american_scientific_journal-6910 33 5 , , PUNCT american_scientific_journal-6910 33 6 π‘Ÿ π‘Ÿ X american_scientific_journal-6910 33 7 , , PUNCT american_scientific_journal-6910 33 8 that that PRON american_scientific_journal-6910 33 9 is be AUX american_scientific_journal-6910 33 10 received receive VERB american_scientific_journal-6910 33 11 after after SCONJ american_scientific_journal-6910 33 12 action action NOUN american_scientific_journal-6910 33 13 π‘Ž π‘Ž NOUN american_scientific_journal-6910 33 14 is be AUX american_scientific_journal-6910 33 15 performed perform VERB american_scientific_journal-6910 33 16 . . PUNCT american_scientific_journal-6910 34 1 the the DET american_scientific_journal-6910 34 2 role role NOUN american_scientific_journal-6910 34 3 of of ADP american_scientific_journal-6910 34 4 the the DET american_scientific_journal-6910 34 5 agent agent NOUN american_scientific_journal-6910 34 6 is be AUX american_scientific_journal-6910 34 7 to to PART american_scientific_journal-6910 34 8 learn learn VERB american_scientific_journal-6910 34 9 a a DET american_scientific_journal-6910 34 10 control control NOUN american_scientific_journal-6910 34 11 policy policy NOUN american_scientific_journal-6910 34 12 πœ‹ πœ‹ PRON american_scientific_journal-6910 34 13 used use VERB american_scientific_journal-6910 34 14 to to PART american_scientific_journal-6910 34 15 select select VERB american_scientific_journal-6910 34 16 the the DET american_scientific_journal-6910 34 17 next next ADJ american_scientific_journal-6910 34 18 action action NOUN american_scientific_journal-6910 34 19 π‘Žπ‘‘ π‘Žπ‘‘ ADP american_scientific_journal-6910 34 20 , , PUNCT american_scientific_journal-6910 34 21 given give VERB american_scientific_journal-6910 34 22 the the DET american_scientific_journal-6910 34 23 current current ADJ american_scientific_journal-6910 34 24 state state NOUN american_scientific_journal-6910 34 25 𝑠𝑑 𝑠𝑑 PROPN american_scientific_journal-6910 34 26 , , PUNCT american_scientific_journal-6910 34 27 at at ADP american_scientific_journal-6910 34 28 each each DET american_scientific_journal-6910 34 29 discrete discrete ADJ american_scientific_journal-6910 34 30 time time NOUN american_scientific_journal-6910 34 31 step step NOUN american_scientific_journal-6910 34 32 𝑑 𝑑 PROPN american_scientific_journal-6910 34 33 ; ; PUNCT american_scientific_journal-6910 34 34 that that PRON american_scientific_journal-6910 34 35 is be AUX american_scientific_journal-6910 34 36 πœ‹(𝑠𝑑 πœ‹(𝑠𝑑 NOUN american_scientific_journal-6910 34 37 ) ) PUNCT american_scientific_journal-6910 34 38 = = SYM american_scientific_journal-6910 34 39 π‘Žπ‘‘ π‘Žπ‘‘ PROPN american_scientific_journal-6910 34 40 for for ADP american_scientific_journal-6910 34 41 an an DET american_scientific_journal-6910 34 42 infinite infinite ADJ american_scientific_journal-6910 34 43 time time NOUN american_scientific_journal-6910 34 44 horizon horizon PROPN american_scientific_journal-6910 34 45 mdp mdp PROPN american_scientific_journal-6910 34 46 , , PUNCT american_scientific_journal-6910 34 47 the the DET american_scientific_journal-6910 34 48 goal goal NOUN american_scientific_journal-6910 34 49 is be AUX american_scientific_journal-6910 34 50 to to PART american_scientific_journal-6910 34 51 determine determine VERB american_scientific_journal-6910 34 52 the the DET american_scientific_journal-6910 34 53 optimal optimal ADJ american_scientific_journal-6910 34 54 policy policy NOUN american_scientific_journal-6910 34 55 , , PUNCT american_scientific_journal-6910 34 56 πœ‹βˆ— πœ‹βˆ— PROPN american_scientific_journal-6910 34 57 , , PUNCT american_scientific_journal-6910 34 58 that that PRON american_scientific_journal-6910 34 59 maximizes maximize VERB american_scientific_journal-6910 34 60 the the DET american_scientific_journal-6910 34 61 discounted discount VERB american_scientific_journal-6910 34 62 cumulative cumulative ADJ american_scientific_journal-6910 34 63 reward reward NOUN american_scientific_journal-6910 34 64 , , PUNCT american_scientific_journal-6910 34 65 defined define VERB american_scientific_journal-6910 34 66 as as ADP american_scientific_journal-6910 34 67 π‘‰πœ‹(𝑠𝑑 π‘‰πœ‹(𝑠𝑑 NOUN american_scientific_journal-6910 34 68 ) ) PUNCT american_scientific_journal-6910 34 69 = = PUNCT american_scientific_journal-6910 35 1 βˆ‘ βˆ‘ PUNCT american_scientific_journal-6910 35 2 π›Ύπ‘–π‘Ÿπ‘‘+𝑖 π›Ύπ‘–π‘Ÿπ‘‘+𝑖 NOUN american_scientific_journal-6910 35 3 , , PUNCT american_scientific_journal-6910 35 4 ∞ ∞ PROPN american_scientific_journal-6910 35 5 𝑖=0 𝑖=0 PROPN american_scientific_journal-6910 35 6 βˆ€π‘  βˆ€π‘  ADJ american_scientific_journal-6910 35 7 ∈ ∈ PROPN american_scientific_journal-6910 35 8 𝑆 𝑆 PROPN american_scientific_journal-6910 35 9 0 0 NUM american_scientific_journal-6910 35 10 ≀ ≀ NOUN american_scientific_journal-6910 35 11 𝛾 𝛾 ADP american_scientific_journal-6910 35 12 < < X american_scientific_journal-6910 35 13 1 1 NUM american_scientific_journal-6910 35 14 is be AUX american_scientific_journal-6910 35 15 the the DET american_scientific_journal-6910 35 16 discount discount NOUN american_scientific_journal-6910 35 17 factor factor NOUN american_scientific_journal-6910 35 18 . . PUNCT american_scientific_journal-6910 36 1 beginning begin VERB american_scientific_journal-6910 36 2 at at ADP american_scientific_journal-6910 36 3 the the DET american_scientific_journal-6910 36 4 state state NOUN american_scientific_journal-6910 36 5 𝑠𝑑 𝑠𝑑 PROPN american_scientific_journal-6910 36 6 , , PUNCT american_scientific_journal-6910 36 7 the the DET american_scientific_journal-6910 36 8 sequence sequence NOUN american_scientific_journal-6910 36 9 of of ADP american_scientific_journal-6910 36 10 rewards reward NOUN american_scientific_journal-6910 36 11 π‘Ÿπ‘‘+𝑖 π‘Ÿπ‘‘+𝑖 PROPN american_scientific_journal-6910 36 12 are be AUX american_scientific_journal-6910 36 13 generated generate VERB american_scientific_journal-6910 36 14 by by ADP american_scientific_journal-6910 36 15 repeatedly repeatedly ADV american_scientific_journal-6910 36 16 selecting select VERB american_scientific_journal-6910 36 17 actions action NOUN american_scientific_journal-6910 36 18 using use VERB american_scientific_journal-6910 36 19 the the DET american_scientific_journal-6910 36 20 policy policy NOUN american_scientific_journal-6910 36 21 πœ‹. πœ‹. VERB american_scientific_journal-6910 36 22 the the DET american_scientific_journal-6910 36 23 optimal optimal ADJ american_scientific_journal-6910 36 24 policy policy NOUN american_scientific_journal-6910 36 25 πœ‹βˆ— πœ‹βˆ— NOUN american_scientific_journal-6910 36 26 , , PUNCT american_scientific_journal-6910 36 27 that that PRON american_scientific_journal-6910 36 28 chooses choose VERB american_scientific_journal-6910 36 29 the the DET american_scientific_journal-6910 36 30 optimal optimal ADJ american_scientific_journal-6910 36 31 action action NOUN american_scientific_journal-6910 36 32 for for ADP american_scientific_journal-6910 36 33 each each DET american_scientific_journal-6910 36 34 state state NOUN american_scientific_journal-6910 36 35 , , PUNCT american_scientific_journal-6910 36 36 can can AUX american_scientific_journal-6910 36 37 be be AUX american_scientific_journal-6910 36 38 realized realize VERB american_scientific_journal-6910 36 39 by by ADP american_scientific_journal-6910 36 40 learning learn VERB american_scientific_journal-6910 36 41 the the DET american_scientific_journal-6910 36 42 optimal optimal ADJ american_scientific_journal-6910 36 43 value value NOUN american_scientific_journal-6910 36 44 function function NOUN american_scientific_journal-6910 36 45 given give VERB american_scientific_journal-6910 36 46 by by ADP american_scientific_journal-6910 36 47 [ [ PUNCT american_scientific_journal-6910 36 48 9 9 NUM american_scientific_journal-6910 36 49 ] ] SYM american_scientific_journal-6910 36 50 π‘‰βˆ—(𝑠 π‘‰βˆ—(𝑠 X american_scientific_journal-6910 36 51 ) ) PUNCT american_scientific_journal-6910 37 1 = = SYM american_scientific_journal-6910 37 2 max max PROPN american_scientific_journal-6910 37 3 π‘Žπ‘‘ π‘Žπ‘‘ ADP american_scientific_journal-6910 37 4 [ [ X american_scientific_journal-6910 37 5 π‘Ÿ(𝑠𝑑 π‘Ÿ(𝑠𝑑 NOUN american_scientific_journal-6910 37 6 , , PUNCT american_scientific_journal-6910 37 7 π‘Žπ‘‘ π‘Žπ‘‘ PROPN american_scientific_journal-6910 37 8 ) ) PUNCT american_scientific_journal-6910 37 9 + + NUM american_scientific_journal-6910 37 10 π›Ύπ‘‰πœ‹(𝑠𝑑+1 π›Ύπ‘‰πœ‹(𝑠𝑑+1 NOUN american_scientific_journal-6910 37 11 ) ) PUNCT american_scientific_journal-6910 37 12 ] ] PUNCT american_scientific_journal-6910 37 13 in in ADP american_scientific_journal-6910 37 14 q q NOUN american_scientific_journal-6910 37 15 - - PUNCT american_scientific_journal-6910 37 16 learning learning NOUN american_scientific_journal-6910 37 17 , , PUNCT american_scientific_journal-6910 37 18 the the DET american_scientific_journal-6910 37 19 evaluation evaluation NOUN american_scientific_journal-6910 37 20 function function NOUN american_scientific_journal-6910 37 21 to to PART american_scientific_journal-6910 37 22 be be AUX american_scientific_journal-6910 37 23 learned learn VERB american_scientific_journal-6910 37 24 is be AUX american_scientific_journal-6910 37 25 𝑄(𝑠 𝑄(𝑠 PROPN american_scientific_journal-6910 37 26 , , PUNCT american_scientific_journal-6910 37 27 π‘Ž π‘Ž NOUN american_scientific_journal-6910 37 28 ) ) PUNCT american_scientific_journal-6910 37 29 , , PUNCT american_scientific_journal-6910 37 30 defined define VERB american_scientific_journal-6910 37 31 as as ADP american_scientific_journal-6910 37 32 𝑄(𝑠 𝑄(𝑠 PROPN american_scientific_journal-6910 37 33 , , PUNCT american_scientific_journal-6910 37 34 π‘Ž π‘Ž NOUN american_scientific_journal-6910 37 35 ) ) PUNCT american_scientific_journal-6910 37 36 = = SYM american_scientific_journal-6910 37 37 π‘Ÿ(𝑠𝑑 π‘Ÿ(𝑠𝑑 NOUN american_scientific_journal-6910 37 38 , , PUNCT american_scientific_journal-6910 37 39 π‘Žπ‘‘ π‘Žπ‘‘ PROPN american_scientific_journal-6910 37 40 ) ) PUNCT american_scientific_journal-6910 37 41 + + NUM american_scientific_journal-6910 37 42 π›Ύπ‘‰πœ‹(𝑠𝑑+1 π›Ύπ‘‰πœ‹(𝑠𝑑+1 NOUN american_scientific_journal-6910 37 43 ) ) PUNCT american_scientific_journal-6910 37 44 . . PUNCT american_scientific_journal-6910 38 1 thus thus ADV american_scientific_journal-6910 38 2 , , PUNCT american_scientific_journal-6910 38 3 the the DET american_scientific_journal-6910 38 4 optimal optimal ADJ american_scientific_journal-6910 38 5 value value NOUN american_scientific_journal-6910 38 6 function function NOUN american_scientific_journal-6910 38 7 can can AUX american_scientific_journal-6910 38 8 be be AUX american_scientific_journal-6910 38 9 expressed express VERB american_scientific_journal-6910 38 10 as as ADP american_scientific_journal-6910 38 11 π‘‰βˆ—(𝑠 π‘‰βˆ—(𝑠 NOUN american_scientific_journal-6910 38 12 ) ) PUNCT american_scientific_journal-6910 39 1 = = SYM american_scientific_journal-6910 39 2 maxπ‘Žπ‘‘ maxπ‘Žπ‘‘ PROPN american_scientific_journal-6910 39 3 𝑄(𝑠 𝑄(𝑠 PROPN american_scientific_journal-6910 39 4 , , PUNCT american_scientific_journal-6910 39 5 π‘Ž π‘Ž NOUN american_scientific_journal-6910 39 6 ) ) PUNCT american_scientific_journal-6910 39 7 . . PUNCT american_scientific_journal-6910 40 1 the the DET american_scientific_journal-6910 40 2 q q PROPN american_scientific_journal-6910 40 3 values value NOUN american_scientific_journal-6910 40 4 are be AUX american_scientific_journal-6910 40 5 stored store VERB american_scientific_journal-6910 40 6 in in ADP american_scientific_journal-6910 40 7 a a DET american_scientific_journal-6910 40 8 large large ADJ american_scientific_journal-6910 40 9 american american ADJ american_scientific_journal-6910 40 10 scientific scientific ADJ american_scientific_journal-6910 40 11 research research NOUN american_scientific_journal-6910 40 12 journal journal NOUN american_scientific_journal-6910 40 13 for for ADP american_scientific_journal-6910 40 14 engineering engineering NOUN american_scientific_journal-6910 40 15 , , PUNCT american_scientific_journal-6910 40 16 technology technology NOUN american_scientific_journal-6910 40 17 , , PUNCT american_scientific_journal-6910 40 18 and and CCONJ american_scientific_journal-6910 40 19 sciences science NOUN american_scientific_journal-6910 40 20 ( ( PUNCT american_scientific_journal-6910 40 21 asrjets asrjet NOUN american_scientific_journal-6910 40 22 ) ) PUNCT american_scientific_journal-6910 40 23 ( ( PUNCT american_scientific_journal-6910 40 24 2021 2021 NUM american_scientific_journal-6910 40 25 ) ) PUNCT american_scientific_journal-6910 40 26 volume volume NOUN american_scientific_journal-6910 40 27 82 82 NUM american_scientific_journal-6910 40 28 , , PUNCT american_scientific_journal-6910 40 29 no no DET american_scientific_journal-6910 40 30 1 1 NUM american_scientific_journal-6910 40 31 , , PUNCT american_scientific_journal-6910 40 32 pp pp ADV american_scientific_journal-6910 40 33 11 11 NUM american_scientific_journal-6910 40 34 - - SYM american_scientific_journal-6910 40 35 18 18 NUM american_scientific_journal-6910 40 36 13 13 NUM american_scientific_journal-6910 40 37 table table NOUN american_scientific_journal-6910 40 38 , , PUNCT american_scientific_journal-6910 40 39 the the DET american_scientific_journal-6910 40 40 q q NOUN american_scientific_journal-6910 40 41 - - PUNCT american_scientific_journal-6910 40 42 table table NOUN american_scientific_journal-6910 40 43 , , PUNCT american_scientific_journal-6910 40 44 with with ADP american_scientific_journal-6910 40 45 a a DET american_scientific_journal-6910 40 46 separate separate ADJ american_scientific_journal-6910 40 47 entry entry NOUN american_scientific_journal-6910 40 48 for for ADP american_scientific_journal-6910 40 49 each each DET american_scientific_journal-6910 40 50 state state NOUN american_scientific_journal-6910 40 51 - - PUNCT american_scientific_journal-6910 40 52 action action NOUN american_scientific_journal-6910 40 53 pair pair NOUN american_scientific_journal-6910 40 54 . . PUNCT american_scientific_journal-6910 41 1 the the DET american_scientific_journal-6910 41 2 optimal optimal ADJ american_scientific_journal-6910 41 3 policy policy NOUN american_scientific_journal-6910 41 4 is be AUX american_scientific_journal-6910 41 5 now now ADV american_scientific_journal-6910 41 6 determined determine VERB american_scientific_journal-6910 41 7 by by ADP american_scientific_journal-6910 41 8 finding find VERB american_scientific_journal-6910 41 9 the the DET american_scientific_journal-6910 41 10 optimal optimal ADJ american_scientific_journal-6910 41 11 values value NOUN american_scientific_journal-6910 41 12 for for ADP american_scientific_journal-6910 41 13 all all DET american_scientific_journal-6910 41 14 state state NOUN american_scientific_journal-6910 41 15 - - PUNCT american_scientific_journal-6910 41 16 action action NOUN american_scientific_journal-6910 41 17 pairs pair NOUN american_scientific_journal-6910 41 18 . . PUNCT american_scientific_journal-6910 42 1 the the DET american_scientific_journal-6910 42 2 agent agent NOUN american_scientific_journal-6910 42 3 perceives perceive VERB american_scientific_journal-6910 42 4 its its PRON american_scientific_journal-6910 42 5 present present ADJ american_scientific_journal-6910 42 6 state state NOUN american_scientific_journal-6910 42 7 𝑠 𝑠 PROPN american_scientific_journal-6910 42 8 , , PUNCT american_scientific_journal-6910 42 9 executes execute VERB american_scientific_journal-6910 42 10 an an DET american_scientific_journal-6910 42 11 action action NOUN american_scientific_journal-6910 42 12 π‘Ž π‘Ž ADP american_scientific_journal-6910 42 13 , , PUNCT american_scientific_journal-6910 42 14 receives receive VERB american_scientific_journal-6910 42 15 a a DET american_scientific_journal-6910 42 16 reward reward NOUN american_scientific_journal-6910 42 17 π‘Ÿ π‘Ÿ NOUN american_scientific_journal-6910 42 18 and and CCONJ american_scientific_journal-6910 42 19 moves move NOUN american_scientific_journal-6910 42 20 to to ADP american_scientific_journal-6910 42 21 the the DET american_scientific_journal-6910 42 22 next next ADJ american_scientific_journal-6910 42 23 state state NOUN american_scientific_journal-6910 42 24 𝑠′. 𝑠′. NOUN american_scientific_journal-6910 42 25 the the DET american_scientific_journal-6910 42 26 q q NOUN american_scientific_journal-6910 42 27 table table NOUN american_scientific_journal-6910 42 28 is be AUX american_scientific_journal-6910 42 29 then then ADV american_scientific_journal-6910 42 30 updated update VERB american_scientific_journal-6910 42 31 in in ADP american_scientific_journal-6910 42 32 an an DET american_scientific_journal-6910 42 33 iterative iterative NOUN american_scientific_journal-6910 42 34 manner manner NOUN american_scientific_journal-6910 42 35 after after ADP american_scientific_journal-6910 42 36 each each DET american_scientific_journal-6910 42 37 action action NOUN american_scientific_journal-6910 42 38 . . PUNCT american_scientific_journal-6910 43 1 if if SCONJ american_scientific_journal-6910 43 2 𝑄𝑛(𝑠 𝑄𝑛(𝑠 NOUN american_scientific_journal-6910 43 3 , , PUNCT american_scientific_journal-6910 43 4 π‘Ž π‘Ž X american_scientific_journal-6910 43 5 ) ) PUNCT american_scientific_journal-6910 43 6 denotes denote NOUN american_scientific_journal-6910 43 7 the the DET american_scientific_journal-6910 43 8 learned learn VERB american_scientific_journal-6910 43 9 value value NOUN american_scientific_journal-6910 43 10 after after ADP american_scientific_journal-6910 43 11 the the DET american_scientific_journal-6910 43 12 π‘›π‘‘β„Ž π‘›π‘‘β„Ž PROPN american_scientific_journal-6910 43 13 iteration iteration NOUN american_scientific_journal-6910 43 14 , , PUNCT american_scientific_journal-6910 43 15 then then ADV american_scientific_journal-6910 43 16 the the DET american_scientific_journal-6910 43 17 entries entry NOUN american_scientific_journal-6910 43 18 in in ADP american_scientific_journal-6910 43 19 the the DET american_scientific_journal-6910 43 20 q q NOUN american_scientific_journal-6910 43 21 table table NOUN american_scientific_journal-6910 43 22 are be AUX american_scientific_journal-6910 43 23 updated update VERB american_scientific_journal-6910 43 24 using use VERB american_scientific_journal-6910 43 25 the the DET american_scientific_journal-6910 43 26 following follow VERB american_scientific_journal-6910 43 27 rule rule NOUN american_scientific_journal-6910 43 28 𝑄𝑛(𝑠 𝑄𝑛(𝑠 NOUN american_scientific_journal-6910 43 29 , , PUNCT american_scientific_journal-6910 43 30 π‘Ž π‘Ž NOUN american_scientific_journal-6910 43 31 ) ) PUNCT american_scientific_journal-6910 43 32 ← ← PROPN american_scientific_journal-6910 43 33 π‘„π‘›βˆ’1(𝑠 π‘„π‘›βˆ’1(𝑠 PROPN american_scientific_journal-6910 43 34 , , PUNCT american_scientific_journal-6910 43 35 π‘Ž π‘Ž NOUN american_scientific_journal-6910 43 36 ) ) PUNCT american_scientific_journal-6910 44 1 + + NOUN american_scientific_journal-6910 44 2 π›Όπ‘›βˆ’1 π›Όπ‘›βˆ’1 PROPN american_scientific_journal-6910 45 1 [ [ X american_scientific_journal-6910 45 2 π‘Ÿπ‘› π‘Ÿπ‘› NOUN american_scientific_journal-6910 46 1 + + CCONJ american_scientific_journal-6910 46 2 𝛾 𝛾 PROPN american_scientific_journal-6910 46 3 max max PROPN american_scientific_journal-6910 46 4 π‘Žβ€² π‘Žβ€² PUNCT american_scientific_journal-6910 46 5 π‘„π‘›βˆ’1(𝑠′ π‘„π‘›βˆ’1(𝑠′ NOUN american_scientific_journal-6910 46 6 , , PUNCT american_scientific_journal-6910 46 7 π‘Žβ€² π‘Žβ€² NUM american_scientific_journal-6910 46 8 ) ) PUNCT american_scientific_journal-6910 46 9 βˆ’ βˆ’ PROPN american_scientific_journal-6910 47 1 π‘„π‘›βˆ’1(𝑠 π‘„π‘›βˆ’1(𝑠 PROPN american_scientific_journal-6910 47 2 , , PUNCT american_scientific_journal-6910 47 3 π‘Ž π‘Ž NOUN american_scientific_journal-6910 47 4 ) ) PUNCT american_scientific_journal-6910 47 5 ] ] PUNCT american_scientific_journal-6910 48 1 𝛼𝑛 𝛼𝑛 X american_scientific_journal-6910 48 2 ∈ ∈ PROPN american_scientific_journal-6910 49 1 [ [ X american_scientific_journal-6910 49 2 0,1 0,1 NUM american_scientific_journal-6910 49 3 ] ] PUNCT american_scientific_journal-6910 49 4 is be AUX american_scientific_journal-6910 49 5 the the DET american_scientific_journal-6910 49 6 learning learning NOUN american_scientific_journal-6910 49 7 rate rate NOUN american_scientific_journal-6910 49 8 which which PRON american_scientific_journal-6910 49 9 has have VERB american_scientific_journal-6910 49 10 to to PART american_scientific_journal-6910 49 11 satisfy satisfy VERB american_scientific_journal-6910 49 12 the the DET american_scientific_journal-6910 49 13 conditions condition NOUN american_scientific_journal-6910 49 14 βˆ‘ βˆ‘ PUNCT american_scientific_journal-6910 49 15 𝛼𝑛 𝛼𝑛 PROPN american_scientific_journal-6910 49 16 = = SYM american_scientific_journal-6910 49 17 ∞∞ ∞∞ NOUN american_scientific_journal-6910 49 18 𝑛=0 𝑛=0 NOUN american_scientific_journal-6910 49 19 and and CCONJ american_scientific_journal-6910 49 20 βˆ‘ βˆ‘ PUNCT american_scientific_journal-6910 49 21 𝛼2 𝛼2 VERB american_scientific_journal-6910 49 22 < < X american_scientific_journal-6910 49 23 ∞∞ ∞∞ NOUN american_scientific_journal-6910 49 24 𝑛=0 𝑛=0 X american_scientific_journal-6910 50 1 [ [ X american_scientific_journal-6910 50 2 10 10 NUM american_scientific_journal-6910 50 3 ] ] PUNCT american_scientific_journal-6910 50 4 . . PUNCT american_scientific_journal-6910 51 1 the the DET american_scientific_journal-6910 51 2 qlearning qlearning NOUN american_scientific_journal-6910 51 3 algorithm algorithm NOUN american_scientific_journal-6910 51 4 belongs belong VERB american_scientific_journal-6910 51 5 to to ADP american_scientific_journal-6910 51 6 the the DET american_scientific_journal-6910 51 7 class class NOUN american_scientific_journal-6910 51 8 of of ADP american_scientific_journal-6910 51 9 temporal temporal ADJ american_scientific_journal-6910 51 10 difference difference NOUN american_scientific_journal-6910 51 11 algorithms algorithm NOUN american_scientific_journal-6910 51 12 , , PUNCT american_scientific_journal-6910 51 13 learns learn VERB american_scientific_journal-6910 51 14 by by ADP american_scientific_journal-6910 51 15 reducing reduce VERB american_scientific_journal-6910 51 16 the the DET american_scientific_journal-6910 51 17 differences difference NOUN american_scientific_journal-6910 51 18 between between ADP american_scientific_journal-6910 51 19 estimates estimate NOUN american_scientific_journal-6910 51 20 made make VERB american_scientific_journal-6910 51 21 by by ADP american_scientific_journal-6910 51 22 the the DET american_scientific_journal-6910 51 23 agent agent NOUN american_scientific_journal-6910 51 24 at at ADP american_scientific_journal-6910 51 25 different different ADJ american_scientific_journal-6910 51 26 time time NOUN american_scientific_journal-6910 51 27 units unit NOUN american_scientific_journal-6910 51 28 [ [ X american_scientific_journal-6910 51 29 9 9 NUM american_scientific_journal-6910 51 30 ] ] PUNCT american_scientific_journal-6910 51 31 . . PUNCT american_scientific_journal-6910 52 1 2 2 X american_scientific_journal-6910 52 2 . . X american_scientific_journal-6910 52 3 q q X american_scientific_journal-6910 52 4 - - PUNCT american_scientific_journal-6910 52 5 learning learn VERB american_scientific_journal-6910 52 6 slice slice NOUN american_scientific_journal-6910 52 7 admission admission NOUN american_scientific_journal-6910 52 8 algorithm algorithm NOUN american_scientific_journal-6910 52 9 2.1 2.1 NUM american_scientific_journal-6910 52 10 . . PUNCT american_scientific_journal-6910 53 1 system system NOUN american_scientific_journal-6910 53 2 model model NOUN american_scientific_journal-6910 53 3 the the DET american_scientific_journal-6910 53 4 network network NOUN american_scientific_journal-6910 53 5 model model NOUN american_scientific_journal-6910 53 6 is be AUX american_scientific_journal-6910 53 7 a a DET american_scientific_journal-6910 53 8 multi multi ADJ american_scientific_journal-6910 53 9 - - ADJ american_scientific_journal-6910 53 10 tiered tiered ADJ american_scientific_journal-6910 53 11 5 5 NUM american_scientific_journal-6910 53 12 g g NOUN american_scientific_journal-6910 53 13 network network NOUN american_scientific_journal-6910 53 14 consisting consist VERB american_scientific_journal-6910 53 15 of of ADP american_scientific_journal-6910 53 16 a a DET american_scientific_journal-6910 53 17 single single ADJ american_scientific_journal-6910 53 18 macro macro NOUN american_scientific_journal-6910 53 19 - - NOUN american_scientific_journal-6910 53 20 cell cell NOUN american_scientific_journal-6910 53 21 overlaid overlay VERB american_scientific_journal-6910 53 22 with with ADP american_scientific_journal-6910 53 23 𝐡 𝐡 NOUN american_scientific_journal-6910 53 24 small small ADJ american_scientific_journal-6910 53 25 cells cell NOUN american_scientific_journal-6910 53 26 . . PUNCT american_scientific_journal-6910 54 1 the the DET american_scientific_journal-6910 54 2 macro macro NOUN american_scientific_journal-6910 54 3 - - NOUN american_scientific_journal-6910 54 4 cell cell NOUN american_scientific_journal-6910 54 5 has have VERB american_scientific_journal-6910 54 6 a a DET american_scientific_journal-6910 54 7 capacity capacity NOUN american_scientific_journal-6910 54 8 of of ADP american_scientific_journal-6910 54 9 πΆπ‘€π‘Žπ‘ πΆπ‘€π‘Žπ‘ ADJ american_scientific_journal-6910 54 10 , , PUNCT american_scientific_journal-6910 54 11 while while SCONJ american_scientific_journal-6910 54 12 each each DET american_scientific_journal-6910 54 13 small small ADJ american_scientific_journal-6910 54 14 cell cell NOUN american_scientific_journal-6910 54 15 has have VERB american_scientific_journal-6910 54 16 a a DET american_scientific_journal-6910 54 17 capacity capacity NOUN american_scientific_journal-6910 54 18 of of ADP american_scientific_journal-6910 54 19 𝐢𝑆𝑐. 𝐢𝑆𝑐. PROPN american_scientific_journal-6910 54 20 it it PRON american_scientific_journal-6910 54 21 is be AUX american_scientific_journal-6910 54 22 assumed assume VERB american_scientific_journal-6910 54 23 that that SCONJ american_scientific_journal-6910 54 24 at at ADP american_scientific_journal-6910 54 25 any any DET american_scientific_journal-6910 54 26 given give VERB american_scientific_journal-6910 54 27 time time NOUN american_scientific_journal-6910 54 28 , , PUNCT american_scientific_journal-6910 54 29 a a DET american_scientific_journal-6910 54 30 user user NOUN american_scientific_journal-6910 54 31 in in ADP american_scientific_journal-6910 54 32 the the DET american_scientific_journal-6910 54 33 cellular cellular ADJ american_scientific_journal-6910 54 34 network network NOUN american_scientific_journal-6910 54 35 can can AUX american_scientific_journal-6910 54 36 only only ADV american_scientific_journal-6910 54 37 communicate communicate VERB american_scientific_journal-6910 54 38 through through ADP american_scientific_journal-6910 54 39 a a DET american_scientific_journal-6910 54 40 single single ADJ american_scientific_journal-6910 54 41 base base NOUN american_scientific_journal-6910 54 42 station station NOUN american_scientific_journal-6910 54 43 , , PUNCT american_scientific_journal-6910 54 44 i.e. i.e. X american_scientific_journal-6910 54 45 the the DET american_scientific_journal-6910 54 46 macrocell macrocell NOUN american_scientific_journal-6910 54 47 ’s ’s NOUN american_scientific_journal-6910 54 48 or or CCONJ american_scientific_journal-6910 54 49 one one NUM american_scientific_journal-6910 54 50 small small ADJ american_scientific_journal-6910 54 51 cell cell NOUN american_scientific_journal-6910 54 52 ’s ’s NOUN american_scientific_journal-6910 54 53 . . PUNCT american_scientific_journal-6910 55 1 geographically geographically ADV american_scientific_journal-6910 55 2 , , PUNCT american_scientific_journal-6910 55 3 it it PRON american_scientific_journal-6910 55 4 is be AUX american_scientific_journal-6910 55 5 assumed assume VERB american_scientific_journal-6910 55 6 that that SCONJ american_scientific_journal-6910 55 7 the the DET american_scientific_journal-6910 55 8 users user NOUN american_scientific_journal-6910 55 9 are be AUX american_scientific_journal-6910 55 10 uniformly uniformly ADV american_scientific_journal-6910 55 11 distributed distribute VERB american_scientific_journal-6910 55 12 among among ADP american_scientific_journal-6910 55 13 the the DET american_scientific_journal-6910 55 14 small small ADJ american_scientific_journal-6910 55 15 cells cell NOUN american_scientific_journal-6910 55 16 ; ; PUNCT american_scientific_journal-6910 55 17 the the DET american_scientific_journal-6910 55 18 geographical geographical ADJ american_scientific_journal-6910 55 19 position position NOUN american_scientific_journal-6910 55 20 of of ADP american_scientific_journal-6910 55 21 a a DET american_scientific_journal-6910 55 22 user user NOUN american_scientific_journal-6910 55 23 is be AUX american_scientific_journal-6910 55 24 given give VERB american_scientific_journal-6910 55 25 with with ADP american_scientific_journal-6910 55 26 respect respect NOUN american_scientific_journal-6910 55 27 to to ADP american_scientific_journal-6910 55 28 the the DET american_scientific_journal-6910 55 29 coverage coverage NOUN american_scientific_journal-6910 55 30 area area NOUN american_scientific_journal-6910 55 31 of of ADP american_scientific_journal-6910 55 32 the the DET american_scientific_journal-6910 55 33 small small ADJ american_scientific_journal-6910 55 34 cell cell NOUN american_scientific_journal-6910 55 35 the the DET american_scientific_journal-6910 55 36 user user NOUN american_scientific_journal-6910 55 37 is be AUX american_scientific_journal-6910 55 38 located locate VERB american_scientific_journal-6910 55 39 in in ADP american_scientific_journal-6910 55 40 . . PUNCT american_scientific_journal-6910 56 1 it it PRON american_scientific_journal-6910 56 2 is be AUX american_scientific_journal-6910 56 3 assumed assume VERB american_scientific_journal-6910 56 4 that that SCONJ american_scientific_journal-6910 56 5 all all DET american_scientific_journal-6910 56 6 the the DET american_scientific_journal-6910 56 7 small small ADJ american_scientific_journal-6910 56 8 cells cell NOUN american_scientific_journal-6910 56 9 have have VERB american_scientific_journal-6910 56 10 equal equal ADJ american_scientific_journal-6910 56 11 coverage coverage NOUN american_scientific_journal-6910 56 12 area area NOUN american_scientific_journal-6910 56 13 and and CCONJ american_scientific_journal-6910 56 14 that that SCONJ american_scientific_journal-6910 56 15 the the DET american_scientific_journal-6910 56 16 coverage coverage NOUN american_scientific_journal-6910 56 17 areas area NOUN american_scientific_journal-6910 56 18 do do AUX american_scientific_journal-6910 56 19 not not PART american_scientific_journal-6910 56 20 overlap overlap VERB american_scientific_journal-6910 56 21 . . PUNCT american_scientific_journal-6910 57 1 in in ADP american_scientific_journal-6910 57 2 this this DET american_scientific_journal-6910 57 3 paper paper NOUN american_scientific_journal-6910 57 4 , , PUNCT american_scientific_journal-6910 57 5 the the DET american_scientific_journal-6910 57 6 focus focus NOUN american_scientific_journal-6910 57 7 is be AUX american_scientific_journal-6910 57 8 on on ADP american_scientific_journal-6910 57 9 three three NUM american_scientific_journal-6910 57 10 types type NOUN american_scientific_journal-6910 57 11 of of ADP american_scientific_journal-6910 57 12 services service NOUN american_scientific_journal-6910 57 13 , , PUNCT american_scientific_journal-6910 57 14 ultra ultra ADJ american_scientific_journal-6910 57 15 - - ADJ american_scientific_journal-6910 57 16 reliable reliable ADJ american_scientific_journal-6910 57 17 low low ADJ american_scientific_journal-6910 57 18 latency latency NOUN american_scientific_journal-6910 57 19 communication communication NOUN american_scientific_journal-6910 57 20 ( ( PUNCT american_scientific_journal-6910 57 21 urllc urllc ADJ american_scientific_journal-6910 57 22 ) ) PUNCT american_scientific_journal-6910 57 23 , , PUNCT american_scientific_journal-6910 57 24 enhanced enhance VERB american_scientific_journal-6910 57 25 mobile mobile ADJ american_scientific_journal-6910 57 26 broadband broadband NOUN american_scientific_journal-6910 57 27 ( ( PUNCT american_scientific_journal-6910 57 28 embb embb ADJ american_scientific_journal-6910 57 29 ) ) PUNCT american_scientific_journal-6910 57 30 and and CCONJ american_scientific_journal-6910 57 31 internet internet NOUN american_scientific_journal-6910 57 32 of of ADP american_scientific_journal-6910 57 33 things thing NOUN american_scientific_journal-6910 57 34 ( ( PUNCT american_scientific_journal-6910 57 35 iot iot NOUN american_scientific_journal-6910 57 36 ) ) PUNCT american_scientific_journal-6910 57 37 services service NOUN american_scientific_journal-6910 57 38 . . PUNCT american_scientific_journal-6910 58 1 the the DET american_scientific_journal-6910 58 2 iot iot PROPN american_scientific_journal-6910 58 3 devices device NOUN american_scientific_journal-6910 58 4 are be AUX american_scientific_journal-6910 58 5 assumed assume VERB american_scientific_journal-6910 58 6 to to PART american_scientific_journal-6910 58 7 be be AUX american_scientific_journal-6910 58 8 low low ADJ american_scientific_journal-6910 58 9 data datum NOUN american_scientific_journal-6910 58 10 rate rate NOUN american_scientific_journal-6910 58 11 sensors sensor NOUN american_scientific_journal-6910 58 12 . . PUNCT american_scientific_journal-6910 59 1 we we PRON american_scientific_journal-6910 59 2 define define VERB american_scientific_journal-6910 59 3 an an DET american_scientific_journal-6910 59 4 iot iot NOUN american_scientific_journal-6910 59 5 user user NOUN american_scientific_journal-6910 59 6 as as ADP american_scientific_journal-6910 59 7 a a DET american_scientific_journal-6910 59 8 group group NOUN american_scientific_journal-6910 59 9 of of ADP american_scientific_journal-6910 59 10 𝑑𝑖 𝑑𝑖 PROPN american_scientific_journal-6910 59 11 iot iot PROPN american_scientific_journal-6910 59 12 devices device NOUN american_scientific_journal-6910 59 13 ; ; PUNCT american_scientific_journal-6910 59 14 each each DET american_scientific_journal-6910 59 15 iot iot NOUN american_scientific_journal-6910 59 16 device device NOUN american_scientific_journal-6910 59 17 requires require VERB american_scientific_journal-6910 59 18 a a DET american_scientific_journal-6910 59 19 capacity capacity NOUN american_scientific_journal-6910 59 20 of of ADP american_scientific_journal-6910 59 21 𝐢𝑖/𝑑𝑖 𝐢𝑖/𝑑𝑖 NOUN american_scientific_journal-6910 59 22 , , PUNCT american_scientific_journal-6910 59 23 therefore therefore ADV american_scientific_journal-6910 59 24 the the DET american_scientific_journal-6910 59 25 iot iot PROPN american_scientific_journal-6910 59 26 user user PROPN american_scientific_journal-6910 59 27 capacity capacity NOUN american_scientific_journal-6910 59 28 requirement requirement NOUN american_scientific_journal-6910 59 29 is be AUX american_scientific_journal-6910 59 30 𝐢𝑖. 𝐢𝑖. PROPN american_scientific_journal-6910 59 31 the the DET american_scientific_journal-6910 59 32 capacity capacity NOUN american_scientific_journal-6910 59 33 required require VERB american_scientific_journal-6910 59 34 by by ADP american_scientific_journal-6910 59 35 urrlc urrlc NOUN american_scientific_journal-6910 59 36 and and CCONJ american_scientific_journal-6910 59 37 emmb emmb ADJ american_scientific_journal-6910 59 38 users user NOUN american_scientific_journal-6910 59 39 are be AUX american_scientific_journal-6910 59 40 𝐢𝑒 𝐢𝑒 NOUN american_scientific_journal-6910 59 41 and and CCONJ american_scientific_journal-6910 59 42 𝐢𝑒 𝐢𝑒 PROPN american_scientific_journal-6910 59 43 respectively respectively ADV american_scientific_journal-6910 59 44 . . PUNCT american_scientific_journal-6910 60 1 iot iot PROPN american_scientific_journal-6910 60 2 and and CCONJ american_scientific_journal-6910 60 3 emmb emmb ADJ american_scientific_journal-6910 60 4 users user NOUN american_scientific_journal-6910 60 5 are be AUX american_scientific_journal-6910 60 6 serviced service VERB american_scientific_journal-6910 60 7 through through ADP american_scientific_journal-6910 60 8 the the DET american_scientific_journal-6910 60 9 macro macro ADJ american_scientific_journal-6910 60 10 - - NOUN american_scientific_journal-6910 60 11 cell cell NOUN american_scientific_journal-6910 60 12 base base NOUN american_scientific_journal-6910 60 13 station station NOUN american_scientific_journal-6910 60 14 while while SCONJ american_scientific_journal-6910 60 15 the the DET american_scientific_journal-6910 60 16 urrlc urrlc NOUN american_scientific_journal-6910 60 17 users user NOUN american_scientific_journal-6910 60 18 , , PUNCT american_scientific_journal-6910 60 19 due due ADP american_scientific_journal-6910 60 20 to to ADP american_scientific_journal-6910 60 21 the the DET american_scientific_journal-6910 60 22 latency latency NOUN american_scientific_journal-6910 60 23 sensitive sensitive ADJ american_scientific_journal-6910 60 24 nature nature NOUN american_scientific_journal-6910 60 25 of of ADP american_scientific_journal-6910 60 26 urllc urllc PROPN american_scientific_journal-6910 60 27 services service NOUN american_scientific_journal-6910 60 28 , , PUNCT american_scientific_journal-6910 60 29 are be AUX american_scientific_journal-6910 60 30 serviced service VERB american_scientific_journal-6910 60 31 through through ADP american_scientific_journal-6910 60 32 the the DET american_scientific_journal-6910 60 33 small small ADJ american_scientific_journal-6910 60 34 cell cell NOUN american_scientific_journal-6910 60 35 base base NOUN american_scientific_journal-6910 60 36 station station NOUN american_scientific_journal-6910 60 37 whose whose DET american_scientific_journal-6910 60 38 coverage coverage NOUN american_scientific_journal-6910 60 39 area area NOUN american_scientific_journal-6910 60 40 they they PRON american_scientific_journal-6910 60 41 are be AUX american_scientific_journal-6910 60 42 located locate VERB american_scientific_journal-6910 60 43 in in ADP american_scientific_journal-6910 60 44 . . PUNCT american_scientific_journal-6910 61 1 the the DET american_scientific_journal-6910 61 2 network network NOUN american_scientific_journal-6910 61 3 is be AUX american_scientific_journal-6910 61 4 assumed assume VERB american_scientific_journal-6910 61 5 to to PART american_scientific_journal-6910 61 6 be be AUX american_scientific_journal-6910 61 7 owned own VERB american_scientific_journal-6910 61 8 and and CCONJ american_scientific_journal-6910 61 9 operated operate VERB american_scientific_journal-6910 61 10 by by ADP american_scientific_journal-6910 61 11 an an DET american_scientific_journal-6910 61 12 infrastructure infrastructure NOUN american_scientific_journal-6910 61 13 provider provider NOUN american_scientific_journal-6910 61 14 who who PRON american_scientific_journal-6910 61 15 provides provide VERB american_scientific_journal-6910 61 16 network network NOUN american_scientific_journal-6910 61 17 slices slice NOUN american_scientific_journal-6910 61 18 to to ADP american_scientific_journal-6910 61 19 tenants tenant NOUN american_scientific_journal-6910 61 20 ; ; PUNCT american_scientific_journal-6910 61 21 the the DET american_scientific_journal-6910 61 22 tenants tenant NOUN american_scientific_journal-6910 61 23 in in ADP american_scientific_journal-6910 61 24 turn turn NOUN american_scientific_journal-6910 61 25 provide provide VERB american_scientific_journal-6910 61 26 services service NOUN american_scientific_journal-6910 61 27 to to ADP american_scientific_journal-6910 61 28 the the DET american_scientific_journal-6910 61 29 end end NOUN american_scientific_journal-6910 61 30 users user NOUN american_scientific_journal-6910 61 31 . . PUNCT american_scientific_journal-6910 62 1 a a DET american_scientific_journal-6910 62 2 network network NOUN american_scientific_journal-6910 62 3 slice slice NOUN american_scientific_journal-6910 62 4 is be AUX american_scientific_journal-6910 62 5 defined define VERB american_scientific_journal-6910 62 6 as as SCONJ american_scientific_journal-6910 62 7 follows follow VERB american_scientific_journal-6910 62 8 ; ; PUNCT american_scientific_journal-6910 62 9 ο‚· ο‚· NOUN american_scientific_journal-6910 62 10 service service NOUN american_scientific_journal-6910 62 11 type type NOUN american_scientific_journal-6910 62 12 π‘š π‘š X american_scientific_journal-6910 62 13 ∈ ∈ PROPN american_scientific_journal-6910 63 1 [ [ X american_scientific_journal-6910 63 2 1 1 NUM american_scientific_journal-6910 63 3 , , PUNCT american_scientific_journal-6910 63 4 2 2 NUM american_scientific_journal-6910 63 5 , , PUNCT american_scientific_journal-6910 63 6 3 3 NUM american_scientific_journal-6910 63 7 ] ] PUNCT american_scientific_journal-6910 63 8 ; ; PUNCT american_scientific_journal-6910 63 9 the the DET american_scientific_journal-6910 63 10 supported support VERB american_scientific_journal-6910 63 11 service service NOUN american_scientific_journal-6910 63 12 types type NOUN american_scientific_journal-6910 63 13 iot iot VERB american_scientific_journal-6910 63 14 , , PUNCT american_scientific_journal-6910 63 15 urrlc urrlc NOUN american_scientific_journal-6910 63 16 and and CCONJ american_scientific_journal-6910 63 17 emmb emmb ADJ american_scientific_journal-6910 63 18 are be AUX american_scientific_journal-6910 63 19 represented represent VERB american_scientific_journal-6910 63 20 by by ADP american_scientific_journal-6910 63 21 π‘š π‘š PROPN american_scientific_journal-6910 63 22 = = SYM american_scientific_journal-6910 63 23 1 1 NUM american_scientific_journal-6910 63 24 , , PUNCT american_scientific_journal-6910 63 25 2 2 NUM american_scientific_journal-6910 63 26 π‘Žπ‘›π‘‘ π‘Žπ‘›π‘‘ ADJ american_scientific_journal-6910 63 27 3 3 NUM american_scientific_journal-6910 63 28 respectively respectively ADV american_scientific_journal-6910 63 29 . . PUNCT american_scientific_journal-6910 64 1 ο‚· ο‚· NOUN american_scientific_journal-6910 64 2 size size NOUN american_scientific_journal-6910 64 3 𝑛 𝑛 PROPN american_scientific_journal-6910 64 4 : : PUNCT american_scientific_journal-6910 64 5 this this PRON american_scientific_journal-6910 64 6 is be AUX american_scientific_journal-6910 64 7 the the DET american_scientific_journal-6910 64 8 number number NOUN american_scientific_journal-6910 64 9 of of ADP american_scientific_journal-6910 64 10 users user NOUN american_scientific_journal-6910 64 11 the the DET american_scientific_journal-6910 64 12 slice slice NOUN american_scientific_journal-6910 64 13 can can AUX american_scientific_journal-6910 64 14 support support VERB american_scientific_journal-6910 64 15 2.2 2.2 NUM american_scientific_journal-6910 64 16 . . PUNCT american_scientific_journal-6910 65 1 the the DET american_scientific_journal-6910 65 2 q q ADJ american_scientific_journal-6910 65 3 - - PUNCT american_scientific_journal-6910 65 4 learning learning ADJ american_scientific_journal-6910 65 5 algorithm algorithm NOUN american_scientific_journal-6910 65 6 markov markov NOUN american_scientific_journal-6910 65 7 decision decision NOUN american_scientific_journal-6910 65 8 process process NOUN american_scientific_journal-6910 65 9 theory theory NOUN american_scientific_journal-6910 65 10 ( ( PUNCT american_scientific_journal-6910 65 11 mdp mdp NOUN american_scientific_journal-6910 65 12 ) ) PUNCT american_scientific_journal-6910 65 13 is be AUX american_scientific_journal-6910 65 14 used use VERB american_scientific_journal-6910 65 15 to to PART american_scientific_journal-6910 65 16 model model VERB american_scientific_journal-6910 65 17 the the DET american_scientific_journal-6910 65 18 system system NOUN american_scientific_journal-6910 65 19 as as ADP american_scientific_journal-6910 65 20 a a DET american_scientific_journal-6910 65 21 set set NOUN american_scientific_journal-6910 65 22 of of ADP american_scientific_journal-6910 65 23 𝑆 𝑆 PROPN american_scientific_journal-6910 65 24 finite finite NOUN american_scientific_journal-6910 65 25 states state NOUN american_scientific_journal-6910 65 26 and and CCONJ american_scientific_journal-6910 65 27 a a DET american_scientific_journal-6910 65 28 set set NOUN american_scientific_journal-6910 65 29 of of ADP american_scientific_journal-6910 65 30 𝐴 𝐴 PROPN american_scientific_journal-6910 65 31 finite finite NOUN american_scientific_journal-6910 65 32 actions action NOUN american_scientific_journal-6910 65 33 . . PUNCT american_scientific_journal-6910 66 1 a a DET american_scientific_journal-6910 66 2 state state NOUN american_scientific_journal-6910 66 3 𝑠 𝑠 PROPN american_scientific_journal-6910 66 4 ∈ ∈ PROPN american_scientific_journal-6910 66 5 𝑆 𝑆 PROPN american_scientific_journal-6910 66 6 is be AUX american_scientific_journal-6910 66 7 defined define VERB american_scientific_journal-6910 66 8 as as ADP american_scientific_journal-6910 66 9 ( ( PUNCT american_scientific_journal-6910 66 10 𝑧1 𝑧1 NOUN american_scientific_journal-6910 66 11 , , PUNCT american_scientific_journal-6910 66 12 … … PUNCT american_scientific_journal-6910 66 13 , , PUNCT american_scientific_journal-6910 66 14 π‘§π‘š π‘§π‘š ADP american_scientific_journal-6910 66 15 ) ) PUNCT american_scientific_journal-6910 66 16 where where SCONJ american_scientific_journal-6910 66 17 π‘§π‘š π‘§π‘š NOUN american_scientific_journal-6910 66 18 is be AUX american_scientific_journal-6910 66 19 an an DET american_scientific_journal-6910 66 20 n n CCONJ american_scientific_journal-6910 66 21 - - PUNCT american_scientific_journal-6910 66 22 tuple tuple NOUN american_scientific_journal-6910 66 23 ( ( PUNCT american_scientific_journal-6910 66 24 π‘§π‘š1 π‘§π‘š1 NOUN american_scientific_journal-6910 66 25 , , PUNCT american_scientific_journal-6910 66 26 π‘§π‘š2 π‘§π‘š2 PROPN american_scientific_journal-6910 66 27 … … PUNCT american_scientific_journal-6910 66 28 . . PUNCT american_scientific_journal-6910 66 29 . . PUNCT american_scientific_journal-6910 67 1 π‘§π‘šπ‘π‘š π‘§π‘šπ‘π‘š PROPN american_scientific_journal-6910 67 2 ) ) PUNCT american_scientific_journal-6910 67 3 which which PRON american_scientific_journal-6910 67 4 describes describe VERB american_scientific_journal-6910 67 5 the the DET american_scientific_journal-6910 67 6 number number NOUN american_scientific_journal-6910 67 7 slices slice NOUN american_scientific_journal-6910 67 8 of of ADP american_scientific_journal-6910 67 9 different different ADJ american_scientific_journal-6910 67 10 sizes size NOUN american_scientific_journal-6910 67 11 present present ADJ american_scientific_journal-6910 67 12 in in ADP american_scientific_journal-6910 67 13 the the DET american_scientific_journal-6910 67 14 system system NOUN american_scientific_journal-6910 67 15 for for ADP american_scientific_journal-6910 67 16 service service NOUN american_scientific_journal-6910 67 17 type type NOUN american_scientific_journal-6910 67 18 π‘š. π‘š. NOUN american_scientific_journal-6910 68 1 π‘π‘š π‘π‘š PROPN american_scientific_journal-6910 68 2 represents represent VERB american_scientific_journal-6910 68 3 the the DET american_scientific_journal-6910 68 4 maximum maximum ADJ american_scientific_journal-6910 68 5 slice slice NOUN american_scientific_journal-6910 68 6 size size NOUN american_scientific_journal-6910 68 7 for for ADP american_scientific_journal-6910 68 8 service service NOUN american_scientific_journal-6910 68 9 type type NOUN american_scientific_journal-6910 68 10 π‘š. π‘š. ADV american_scientific_journal-6910 68 11 the the DET american_scientific_journal-6910 68 12 states state NOUN american_scientific_journal-6910 68 13 in in ADP american_scientific_journal-6910 68 14 the the DET american_scientific_journal-6910 68 15 state state NOUN american_scientific_journal-6910 68 16 space space NOUN american_scientific_journal-6910 68 17 𝑆 𝑆 PROPN american_scientific_journal-6910 68 18 have have VERB american_scientific_journal-6910 68 19 to to PART american_scientific_journal-6910 68 20 satisfy satisfy VERB american_scientific_journal-6910 68 21 the the DET american_scientific_journal-6910 68 22 following follow VERB american_scientific_journal-6910 68 23 constraints constraint NOUN american_scientific_journal-6910 68 24 american american PROPN american_scientific_journal-6910 68 25 scientific scientific ADJ american_scientific_journal-6910 68 26 research research NOUN american_scientific_journal-6910 68 27 journal journal NOUN american_scientific_journal-6910 68 28 for for ADP american_scientific_journal-6910 68 29 engineering engineering NOUN american_scientific_journal-6910 68 30 , , PUNCT american_scientific_journal-6910 68 31 technology technology NOUN american_scientific_journal-6910 68 32 , , PUNCT american_scientific_journal-6910 68 33 and and CCONJ american_scientific_journal-6910 68 34 sciences science NOUN american_scientific_journal-6910 68 35 ( ( PUNCT american_scientific_journal-6910 68 36 asrjets asrjet NOUN american_scientific_journal-6910 68 37 ) ) PUNCT american_scientific_journal-6910 68 38 ( ( PUNCT american_scientific_journal-6910 68 39 2021 2021 NUM american_scientific_journal-6910 68 40 ) ) PUNCT american_scientific_journal-6910 68 41 volume volume NOUN american_scientific_journal-6910 68 42 82 82 NUM american_scientific_journal-6910 68 43 , , PUNCT american_scientific_journal-6910 68 44 no no DET american_scientific_journal-6910 68 45 1 1 NUM american_scientific_journal-6910 68 46 , , PUNCT american_scientific_journal-6910 68 47 pp pp ADV american_scientific_journal-6910 68 48 11 11 NUM american_scientific_journal-6910 68 49 - - SYM american_scientific_journal-6910 68 50 18 18 NUM american_scientific_journal-6910 68 51 14 14 NUM american_scientific_journal-6910 68 52 𝐢𝑖 𝐢𝑖 PROPN american_scientific_journal-6910 68 53 βˆ‘ βˆ‘ ADP american_scientific_journal-6910 68 54 𝑛𝑧1𝑛 𝑛𝑧1𝑛 PROPN american_scientific_journal-6910 68 55 𝑁1 𝑁1 NOUN american_scientific_journal-6910 68 56 𝑛=1 𝑛=1 NOUN american_scientific_journal-6910 68 57 + + X american_scientific_journal-6910 69 1 𝐢𝑒 𝐢𝑒 PROPN american_scientific_journal-6910 69 2 βˆ‘ βˆ‘ ADP american_scientific_journal-6910 69 3 𝑛𝑧3𝑛 𝑛𝑧3𝑛 PROPN american_scientific_journal-6910 69 4 𝑁3 𝑁3 ADJ american_scientific_journal-6910 69 5 𝑛=1 𝑛=1 NOUN american_scientific_journal-6910 69 6 ≀ ≀ ADJ american_scientific_journal-6910 69 7 πΆπ‘€π‘Žπ‘ πΆπ‘€π‘Žπ‘ PUNCT american_scientific_journal-6910 70 1 𝐢𝑒 𝐢𝑒 VERB american_scientific_journal-6910 70 2 βˆ‘ βˆ‘ ADP american_scientific_journal-6910 70 3 𝑛𝑧2𝑛 𝑛𝑧2𝑛 PROPN american_scientific_journal-6910 70 4 𝑁2 𝑁2 NOUN american_scientific_journal-6910 70 5 𝑛=1 𝑛=1 NOUN american_scientific_journal-6910 70 6 ≀ ≀ NOUN american_scientific_journal-6910 70 7 𝐡𝐢𝑆𝑐 𝐡𝐢𝑆𝑐 NOUN american_scientific_journal-6910 70 8 the the DET american_scientific_journal-6910 70 9 slice slice NOUN american_scientific_journal-6910 70 10 requests request NOUN american_scientific_journal-6910 70 11 submitted submit VERB american_scientific_journal-6910 70 12 to to ADP american_scientific_journal-6910 70 13 the the DET american_scientific_journal-6910 70 14 infrastructure infrastructure NOUN american_scientific_journal-6910 70 15 provider provider NOUN american_scientific_journal-6910 70 16 are be AUX american_scientific_journal-6910 70 17 in in ADP american_scientific_journal-6910 70 18 of of ADP american_scientific_journal-6910 70 19 the the DET american_scientific_journal-6910 70 20 form form NOUN american_scientific_journal-6910 70 21 { { PUNCT american_scientific_journal-6910 70 22 π‘š π‘š NOUN american_scientific_journal-6910 70 23 , , PUNCT american_scientific_journal-6910 70 24 𝑛 𝑛 PROPN american_scientific_journal-6910 70 25 , , PUNCT american_scientific_journal-6910 70 26 𝑑 𝑑 X american_scientific_journal-6910 70 27 } } PUNCT american_scientific_journal-6910 70 28 , , PUNCT american_scientific_journal-6910 70 29 where where SCONJ american_scientific_journal-6910 70 30 𝑑 𝑑 PROPN american_scientific_journal-6910 70 31 is be AUX american_scientific_journal-6910 70 32 the the DET american_scientific_journal-6910 70 33 number number NOUN american_scientific_journal-6910 70 34 of of ADP american_scientific_journal-6910 70 35 time time NOUN american_scientific_journal-6910 70 36 units unit NOUN american_scientific_journal-6910 70 37 the the DET american_scientific_journal-6910 70 38 slice slice NOUN american_scientific_journal-6910 70 39 is be AUX american_scientific_journal-6910 70 40 required require VERB american_scientific_journal-6910 70 41 for for ADP american_scientific_journal-6910 70 42 . . PUNCT american_scientific_journal-6910 71 1 incoming incoming ADJ american_scientific_journal-6910 71 2 slice slice NOUN american_scientific_journal-6910 71 3 requests request NOUN american_scientific_journal-6910 71 4 are be AUX american_scientific_journal-6910 71 5 placed place VERB american_scientific_journal-6910 71 6 in in ADP american_scientific_journal-6910 71 7 queues queue NOUN american_scientific_journal-6910 71 8 depending depend VERB american_scientific_journal-6910 71 9 on on ADP american_scientific_journal-6910 71 10 their their PRON american_scientific_journal-6910 71 11 type type NOUN american_scientific_journal-6910 71 12 and and CCONJ american_scientific_journal-6910 71 13 size size NOUN american_scientific_journal-6910 71 14 . . PUNCT american_scientific_journal-6910 72 1 a a DET american_scientific_journal-6910 72 2 slice slice NOUN american_scientific_journal-6910 72 3 request request NOUN american_scientific_journal-6910 72 4 of of ADP american_scientific_journal-6910 72 5 type type NOUN american_scientific_journal-6910 72 6 π‘š π‘š NOUN american_scientific_journal-6910 72 7 and and CCONJ american_scientific_journal-6910 72 8 size size NOUN american_scientific_journal-6910 72 9 𝑛 𝑛 PROPN american_scientific_journal-6910 72 10 is be AUX american_scientific_journal-6910 72 11 placed place VERB american_scientific_journal-6910 72 12 it it PRON american_scientific_journal-6910 72 13 the the DET american_scientific_journal-6910 72 14 queue queue NOUN american_scientific_journal-6910 72 15 π‘„π‘šπ‘› π‘„π‘šπ‘› PROPN american_scientific_journal-6910 72 16 . . PUNCT american_scientific_journal-6910 73 1 the the DET american_scientific_journal-6910 73 2 slice slice NOUN american_scientific_journal-6910 73 3 admission admission NOUN american_scientific_journal-6910 73 4 algorithm algorithm NOUN american_scientific_journal-6910 73 5 retrieves retrieve VERB american_scientific_journal-6910 73 6 the the DET american_scientific_journal-6910 73 7 slice slice NOUN american_scientific_journal-6910 73 8 requests request NOUN american_scientific_journal-6910 73 9 from from ADP american_scientific_journal-6910 73 10 the the DET american_scientific_journal-6910 73 11 queues queue NOUN american_scientific_journal-6910 73 12 in in ADP american_scientific_journal-6910 73 13 a a DET american_scientific_journal-6910 73 14 first first ADJ american_scientific_journal-6910 73 15 in in ADP american_scientific_journal-6910 73 16 first first ADJ american_scientific_journal-6910 73 17 out out ADV american_scientific_journal-6910 73 18 manner manner NOUN american_scientific_journal-6910 73 19 . . PUNCT american_scientific_journal-6910 74 1 if if SCONJ american_scientific_journal-6910 74 2 resources resource NOUN american_scientific_journal-6910 74 3 are be AUX american_scientific_journal-6910 74 4 available available ADJ american_scientific_journal-6910 74 5 the the DET american_scientific_journal-6910 74 6 slice slice NOUN american_scientific_journal-6910 74 7 request request NOUN american_scientific_journal-6910 74 8 is be AUX american_scientific_journal-6910 74 9 processed process VERB american_scientific_journal-6910 74 10 and and CCONJ american_scientific_journal-6910 74 11 resources resource NOUN american_scientific_journal-6910 74 12 are be AUX american_scientific_journal-6910 74 13 allocated allocate VERB american_scientific_journal-6910 74 14 to to ADP american_scientific_journal-6910 74 15 the the DET american_scientific_journal-6910 74 16 network network NOUN american_scientific_journal-6910 74 17 slice slice NOUN american_scientific_journal-6910 74 18 ; ; PUNCT american_scientific_journal-6910 74 19 the the DET american_scientific_journal-6910 74 20 slice slice NOUN american_scientific_journal-6910 74 21 request request NOUN american_scientific_journal-6910 74 22 is be AUX american_scientific_journal-6910 74 23 then then ADV american_scientific_journal-6910 74 24 removed remove VERB american_scientific_journal-6910 74 25 from from ADP american_scientific_journal-6910 74 26 the the DET american_scientific_journal-6910 74 27 queue queue NOUN american_scientific_journal-6910 74 28 . . PUNCT american_scientific_journal-6910 75 1 a a DET american_scientific_journal-6910 75 2 revenue revenue NOUN american_scientific_journal-6910 75 3 ( ( PUNCT american_scientific_journal-6910 75 4 reward reward NOUN american_scientific_journal-6910 75 5 ) ) PUNCT american_scientific_journal-6910 75 6 of of ADP american_scientific_journal-6910 75 7 π‘Ÿ π‘Ÿ NOUN american_scientific_journal-6910 75 8 = = PUNCT american_scientific_journal-6910 75 9 π‘‘π‘›πœŒπ‘š π‘‘π‘›πœŒπ‘š NOUN american_scientific_journal-6910 75 10 , , PUNCT american_scientific_journal-6910 75 11 where where SCONJ american_scientific_journal-6910 75 12 πœŒπ‘š πœŒπ‘š PROPN american_scientific_journal-6910 75 13 is be AUX american_scientific_journal-6910 75 14 the the DET american_scientific_journal-6910 75 15 revenue revenue NOUN american_scientific_journal-6910 75 16 ( ( PUNCT american_scientific_journal-6910 75 17 reward reward NOUN american_scientific_journal-6910 75 18 ) ) PUNCT american_scientific_journal-6910 75 19 per per ADP american_scientific_journal-6910 75 20 unit unit NOUN american_scientific_journal-6910 75 21 time time NOUN american_scientific_journal-6910 75 22 for for ADP american_scientific_journal-6910 75 23 service service NOUN american_scientific_journal-6910 75 24 type type NOUN american_scientific_journal-6910 75 25 π‘š π‘š NOUN american_scientific_journal-6910 75 26 , , PUNCT american_scientific_journal-6910 75 27 is be AUX american_scientific_journal-6910 75 28 earned earn VERB american_scientific_journal-6910 75 29 by by ADP american_scientific_journal-6910 75 30 the the DET american_scientific_journal-6910 75 31 infrastructure infrastructure NOUN american_scientific_journal-6910 75 32 provider provider NOUN american_scientific_journal-6910 75 33 . . PUNCT american_scientific_journal-6910 76 1 but but CCONJ american_scientific_journal-6910 76 2 if if SCONJ american_scientific_journal-6910 76 3 resources resource NOUN american_scientific_journal-6910 76 4 are be AUX american_scientific_journal-6910 76 5 not not PART american_scientific_journal-6910 76 6 available available ADJ american_scientific_journal-6910 76 7 , , PUNCT american_scientific_journal-6910 76 8 the the DET american_scientific_journal-6910 76 9 slice slice NOUN american_scientific_journal-6910 76 10 request request NOUN american_scientific_journal-6910 76 11 will will AUX american_scientific_journal-6910 76 12 not not PART american_scientific_journal-6910 76 13 be be AUX american_scientific_journal-6910 76 14 serviced service VERB american_scientific_journal-6910 76 15 but but CCONJ american_scientific_journal-6910 76 16 will will AUX american_scientific_journal-6910 76 17 remain remain VERB american_scientific_journal-6910 76 18 in in ADP american_scientific_journal-6910 76 19 the the DET american_scientific_journal-6910 76 20 queue queue NOUN american_scientific_journal-6910 76 21 , , PUNCT american_scientific_journal-6910 76 22 and and CCONJ american_scientific_journal-6910 76 23 no no DET american_scientific_journal-6910 76 24 reward reward NOUN american_scientific_journal-6910 76 25 will will AUX american_scientific_journal-6910 76 26 be be AUX american_scientific_journal-6910 76 27 earned earn VERB american_scientific_journal-6910 76 28 . . PUNCT american_scientific_journal-6910 77 1 the the DET american_scientific_journal-6910 77 2 possible possible ADJ american_scientific_journal-6910 77 3 actions action NOUN american_scientific_journal-6910 77 4 , , PUNCT american_scientific_journal-6910 77 5 π‘Ž π‘Ž PROPN american_scientific_journal-6910 77 6 ∈ ∈ PROPN american_scientific_journal-6910 77 7 𝐴 𝐴 PROPN american_scientific_journal-6910 77 8 are be AUX american_scientific_journal-6910 77 9 defined define VERB american_scientific_journal-6910 77 10 as as ADP american_scientific_journal-6910 77 11 ( ( PUNCT american_scientific_journal-6910 77 12 π‘Ž1 π‘Ž1 PROPN american_scientific_journal-6910 77 13 , , PUNCT american_scientific_journal-6910 77 14 π‘Ž2 π‘Ž2 PROPN american_scientific_journal-6910 77 15 , , PUNCT american_scientific_journal-6910 77 16 π‘Ž3 π‘Ž3 PROPN american_scientific_journal-6910 77 17 , , PUNCT american_scientific_journal-6910 77 18 𝑅 𝑅 PROPN american_scientific_journal-6910 77 19 ) ) PUNCT american_scientific_journal-6910 77 20 , , PUNCT american_scientific_journal-6910 77 21 where where SCONJ american_scientific_journal-6910 77 22 π‘Žπ‘š π‘Žπ‘š NOUN american_scientific_journal-6910 77 23 is be AUX american_scientific_journal-6910 77 24 an an DET american_scientific_journal-6910 77 25 n n CCONJ american_scientific_journal-6910 77 26 - - PUNCT american_scientific_journal-6910 77 27 tuple tuple NOUN american_scientific_journal-6910 77 28 ( ( PUNCT american_scientific_journal-6910 77 29 π‘Žπ‘š1 π‘Žπ‘š1 PROPN american_scientific_journal-6910 77 30 , , PUNCT american_scientific_journal-6910 77 31 π‘Žπ‘š2 π‘Žπ‘š2 NOUN american_scientific_journal-6910 77 32 , , PUNCT american_scientific_journal-6910 77 33 … … PUNCT american_scientific_journal-6910 77 34 . . PUNCT american_scientific_journal-6910 78 1 , , PUNCT american_scientific_journal-6910 78 2 π‘Žπ‘šπ‘π‘š π‘Žπ‘šπ‘π‘š PROPN american_scientific_journal-6910 78 3 ) ) PUNCT american_scientific_journal-6910 78 4 ; ; PUNCT american_scientific_journal-6910 78 5 the the DET american_scientific_journal-6910 78 6 π‘›π‘‘β„Ž π‘›π‘‘β„Ž NOUN american_scientific_journal-6910 78 7 element element NOUN american_scientific_journal-6910 78 8 of of ADP american_scientific_journal-6910 78 9 π‘Žπ‘š π‘Žπ‘š NOUN american_scientific_journal-6910 78 10 corresponds correspond VERB american_scientific_journal-6910 78 11 to to ADP american_scientific_journal-6910 78 12 the the DET american_scientific_journal-6910 78 13 action action NOUN american_scientific_journal-6910 78 14 of of ADP american_scientific_journal-6910 78 15 accepting accept VERB american_scientific_journal-6910 78 16 a a DET american_scientific_journal-6910 78 17 slice slice NOUN american_scientific_journal-6910 78 18 of of ADP american_scientific_journal-6910 78 19 size size NOUN american_scientific_journal-6910 78 20 𝑛 𝑛 PROPN american_scientific_journal-6910 78 21 of of ADP american_scientific_journal-6910 78 22 service service NOUN american_scientific_journal-6910 78 23 type type NOUN american_scientific_journal-6910 78 24 π‘š. π‘š. NOUN american_scientific_journal-6910 78 25 based base VERB american_scientific_journal-6910 78 26 on on ADP american_scientific_journal-6910 78 27 the the DET american_scientific_journal-6910 78 28 model model NOUN american_scientific_journal-6910 78 29 described describe VERB american_scientific_journal-6910 78 30 , , PUNCT american_scientific_journal-6910 78 31 the the DET american_scientific_journal-6910 78 32 q q NOUN american_scientific_journal-6910 78 33 - - PUNCT american_scientific_journal-6910 78 34 learning learn VERB american_scientific_journal-6910 78 35 algorithm algorithm NOUN american_scientific_journal-6910 78 36 is be AUX american_scientific_journal-6910 78 37 described describe VERB american_scientific_journal-6910 78 38 in in ADP american_scientific_journal-6910 78 39 table table NOUN american_scientific_journal-6910 78 40 1 1 NUM american_scientific_journal-6910 78 41 . . PUNCT american_scientific_journal-6910 78 42 table table NOUN american_scientific_journal-6910 78 43 1 1 NUM american_scientific_journal-6910 78 44 : : PUNCT american_scientific_journal-6910 78 45 q q ADJ american_scientific_journal-6910 78 46 - - PUNCT american_scientific_journal-6910 78 47 learning learn VERB american_scientific_journal-6910 78 48 algorithm algorithm NOUN american_scientific_journal-6910 78 49 for for ADP american_scientific_journal-6910 78 50 each each DET american_scientific_journal-6910 78 51 ( ( PUNCT american_scientific_journal-6910 78 52 𝑠 𝑠 PROPN american_scientific_journal-6910 78 53 , , PUNCT american_scientific_journal-6910 78 54 π‘Ž π‘Ž NOUN american_scientific_journal-6910 78 55 ) ) PUNCT american_scientific_journal-6910 78 56 pair pair NOUN american_scientific_journal-6910 78 57 , , PUNCT american_scientific_journal-6910 78 58 initial initial ADJ american_scientific_journal-6910 78 59 the the DET american_scientific_journal-6910 78 60 q q NOUN american_scientific_journal-6910 78 61 table table NOUN american_scientific_journal-6910 78 62 entry entry NOUN american_scientific_journal-6910 78 63 𝑄(𝑠 𝑄(𝑠 PROPN american_scientific_journal-6910 78 64 , , PUNCT american_scientific_journal-6910 78 65 π‘Ž π‘Ž NOUN american_scientific_journal-6910 78 66 ) ) PUNCT american_scientific_journal-6910 78 67 to to ADP american_scientific_journal-6910 78 68 zero zero NUM american_scientific_journal-6910 78 69 observe observe VERB american_scientific_journal-6910 78 70 the the DET american_scientific_journal-6910 78 71 current current ADJ american_scientific_journal-6910 78 72 state state NOUN american_scientific_journal-6910 78 73 𝑠 𝑠 PROPN american_scientific_journal-6910 78 74 for for ADP american_scientific_journal-6910 78 75 𝑛 𝑛 NOUN american_scientific_journal-6910 78 76 = = SYM american_scientific_journal-6910 78 77 1 1 NUM american_scientific_journal-6910 78 78 to to ADP american_scientific_journal-6910 78 79 𝐸 𝐸 PROPN american_scientific_journal-6910 78 80 from from ADP american_scientific_journal-6910 78 81 state state NOUN american_scientific_journal-6910 78 82 𝑠 𝑠 PROPN american_scientific_journal-6910 78 83 execute execute VERB american_scientific_journal-6910 78 84 action action NOUN american_scientific_journal-6910 78 85 π‘Ž π‘Ž NOUN american_scientific_journal-6910 78 86 receive receive VERB american_scientific_journal-6910 78 87 immediate immediate ADJ american_scientific_journal-6910 78 88 reward reward NOUN american_scientific_journal-6910 78 89 π‘Ÿ π‘Ÿ PRON american_scientific_journal-6910 78 90 observe observe VERB american_scientific_journal-6910 78 91 new new ADJ american_scientific_journal-6910 78 92 state state NOUN american_scientific_journal-6910 78 93 𝑠′ 𝑠′ NOUN american_scientific_journal-6910 78 94 update update VERB american_scientific_journal-6910 78 95 the the DET american_scientific_journal-6910 78 96 table table NOUN american_scientific_journal-6910 78 97 entry entry NOUN american_scientific_journal-6910 78 98 𝑄(𝑠 𝑄(𝑠 PROPN american_scientific_journal-6910 78 99 , , PUNCT american_scientific_journal-6910 78 100 π‘Ž π‘Ž NOUN american_scientific_journal-6910 78 101 ) ) PUNCT american_scientific_journal-6910 78 102 as as SCONJ american_scientific_journal-6910 78 103 follows follow VERB american_scientific_journal-6910 78 104 𝑄𝑛(𝑠 𝑄𝑛(𝑠 NOUN american_scientific_journal-6910 78 105 , , PUNCT american_scientific_journal-6910 78 106 π‘Ž π‘Ž NOUN american_scientific_journal-6910 78 107 ) ) PUNCT american_scientific_journal-6910 78 108 ← ← PROPN american_scientific_journal-6910 78 109 π‘„π‘›βˆ’1(𝑠 π‘„π‘›βˆ’1(𝑠 PROPN american_scientific_journal-6910 78 110 , , PUNCT american_scientific_journal-6910 78 111 π‘Ž π‘Ž NOUN american_scientific_journal-6910 78 112 ) ) PUNCT american_scientific_journal-6910 79 1 + + NOUN american_scientific_journal-6910 79 2 π›Όπ‘›βˆ’1 π›Όπ‘›βˆ’1 PROPN american_scientific_journal-6910 80 1 [ [ X american_scientific_journal-6910 80 2 π‘Ÿπ‘› π‘Ÿπ‘› NOUN american_scientific_journal-6910 81 1 + + CCONJ american_scientific_journal-6910 81 2 𝛾 𝛾 PROPN american_scientific_journal-6910 81 3 max max PROPN american_scientific_journal-6910 81 4 π‘Žβ€² π‘Žβ€² PUNCT american_scientific_journal-6910 81 5 π‘„π‘›βˆ’1(𝑠′ π‘„π‘›βˆ’1(𝑠′ NOUN american_scientific_journal-6910 81 6 , , PUNCT american_scientific_journal-6910 81 7 π‘Žβ€² π‘Žβ€² NUM american_scientific_journal-6910 81 8 ) ) PUNCT american_scientific_journal-6910 81 9 βˆ’ βˆ’ PROPN american_scientific_journal-6910 82 1 π‘„π‘›βˆ’1(𝑠 π‘„π‘›βˆ’1(𝑠 PROPN american_scientific_journal-6910 82 2 , , PUNCT american_scientific_journal-6910 82 3 π‘Ž π‘Ž NOUN american_scientific_journal-6910 82 4 ) ) PUNCT american_scientific_journal-6910 82 5 ] ] PUNCT american_scientific_journal-6910 82 6 replace replace NOUN american_scientific_journal-6910 82 7 𝑠 𝑠 PROPN american_scientific_journal-6910 82 8 ← ← PROPN american_scientific_journal-6910 82 9 𝑠′ 𝑠′ PROPN american_scientific_journal-6910 82 10 end end VERB american_scientific_journal-6910 82 11 for for SCONJ american_scientific_journal-6910 82 12 the the DET american_scientific_journal-6910 82 13 learning learning NOUN american_scientific_journal-6910 82 14 rate rate NOUN american_scientific_journal-6910 82 15 is be AUX american_scientific_journal-6910 82 16 determined determine VERB american_scientific_journal-6910 82 17 as as ADP american_scientific_journal-6910 82 18 𝛼𝑛 𝛼𝑛 NOUN american_scientific_journal-6910 82 19 = = SYM american_scientific_journal-6910 82 20 1 1 NUM american_scientific_journal-6910 82 21 1 1 NUM american_scientific_journal-6910 82 22 + + CCONJ american_scientific_journal-6910 82 23 𝜏(𝑠 𝜏(𝑠 PROPN american_scientific_journal-6910 82 24 , , PUNCT american_scientific_journal-6910 82 25 π‘Ž)⁄ π‘Ž)⁄ NOUN american_scientific_journal-6910 82 26 , , PUNCT american_scientific_journal-6910 82 27 where where SCONJ american_scientific_journal-6910 82 28 𝜏(𝑠 𝜏(𝑠 PROPN american_scientific_journal-6910 82 29 , , PUNCT american_scientific_journal-6910 82 30 π‘Ž π‘Ž NOUN american_scientific_journal-6910 82 31 ) ) PUNCT american_scientific_journal-6910 82 32 is be AUX american_scientific_journal-6910 82 33 the the DET american_scientific_journal-6910 82 34 number number NOUN american_scientific_journal-6910 82 35 of of ADP american_scientific_journal-6910 82 36 times time NOUN american_scientific_journal-6910 82 37 the the DET american_scientific_journal-6910 82 38 action action NOUN american_scientific_journal-6910 82 39 π‘Ž π‘Ž NOUN american_scientific_journal-6910 82 40 has have AUX american_scientific_journal-6910 82 41 been be AUX american_scientific_journal-6910 82 42 executed execute VERB american_scientific_journal-6910 82 43 from from ADP american_scientific_journal-6910 82 44 state state NOUN american_scientific_journal-6910 82 45 𝑠 𝑠 PROPN american_scientific_journal-6910 83 1 [ [ X american_scientific_journal-6910 83 2 9 9 NUM american_scientific_journal-6910 83 3 ] ] PUNCT american_scientific_journal-6910 83 4 . . PUNCT american_scientific_journal-6910 84 1 choosing choose VERB american_scientific_journal-6910 84 2 the the DET american_scientific_journal-6910 84 3 action action NOUN american_scientific_journal-6910 84 4 that that PRON american_scientific_journal-6910 84 5 maximizes maximize VERB american_scientific_journal-6910 84 6 𝑄(𝑠 𝑄(𝑠 PRON american_scientific_journal-6910 84 7 , , PUNCT american_scientific_journal-6910 84 8 π‘Ž π‘Ž NOUN american_scientific_journal-6910 84 9 ) ) PUNCT american_scientific_journal-6910 84 10 , , PUNCT american_scientific_journal-6910 84 11 exploits exploit VERB american_scientific_journal-6910 84 12 the the DET american_scientific_journal-6910 84 13 knowledge knowledge NOUN american_scientific_journal-6910 84 14 of of ADP american_scientific_journal-6910 84 15 already already ADV american_scientific_journal-6910 84 16 visited visit VERB american_scientific_journal-6910 84 17 states state NOUN american_scientific_journal-6910 84 18 to to PART american_scientific_journal-6910 84 19 maximize maximize VERB american_scientific_journal-6910 84 20 the the DET american_scientific_journal-6910 84 21 overall overall ADJ american_scientific_journal-6910 84 22 revenue revenue NOUN american_scientific_journal-6910 84 23 . . PUNCT american_scientific_journal-6910 85 1 relying rely VERB american_scientific_journal-6910 85 2 on on ADP american_scientific_journal-6910 85 3 exploitation exploitation NOUN american_scientific_journal-6910 85 4 will will AUX american_scientific_journal-6910 85 5 result result VERB american_scientific_journal-6910 85 6 in in ADP american_scientific_journal-6910 85 7 an an DET american_scientific_journal-6910 85 8 algorithm algorithm NOUN american_scientific_journal-6910 85 9 that that PRON american_scientific_journal-6910 85 10 utilizes utilize VERB american_scientific_journal-6910 85 11 only only ADV american_scientific_journal-6910 85 12 ( ( PUNCT american_scientific_journal-6910 85 13 𝑠 𝑠 PROPN american_scientific_journal-6910 85 14 , , PUNCT american_scientific_journal-6910 85 15 π‘Ž π‘Ž NOUN american_scientific_journal-6910 85 16 ) ) PUNCT american_scientific_journal-6910 85 17 determined determine VERB american_scientific_journal-6910 85 18 in in ADP american_scientific_journal-6910 85 19 the the DET american_scientific_journal-6910 85 20 early early ADJ american_scientific_journal-6910 85 21 stages stage NOUN american_scientific_journal-6910 85 22 , , PUNCT american_scientific_journal-6910 85 23 while while SCONJ american_scientific_journal-6910 85 24 failing fail VERB american_scientific_journal-6910 85 25 to to PART american_scientific_journal-6910 85 26 explore explore VERB american_scientific_journal-6910 85 27 other other ADJ american_scientific_journal-6910 85 28 ( ( PUNCT american_scientific_journal-6910 85 29 𝑠 𝑠 PROPN american_scientific_journal-6910 85 30 , , PUNCT american_scientific_journal-6910 85 31 π‘Ž π‘Ž NOUN american_scientific_journal-6910 85 32 ) ) PUNCT american_scientific_journal-6910 85 33 that that PRON american_scientific_journal-6910 85 34 may may AUX american_scientific_journal-6910 85 35 potentially potentially ADV american_scientific_journal-6910 85 36 yield yield VERB american_scientific_journal-6910 85 37 higher high ADJ american_scientific_journal-6910 85 38 rewards reward NOUN american_scientific_journal-6910 85 39 . . PUNCT american_scientific_journal-6910 86 1 in in ADP american_scientific_journal-6910 86 2 order order NOUN american_scientific_journal-6910 86 3 to to PART american_scientific_journal-6910 86 4 tradeoff tradeoff VERB american_scientific_journal-6910 86 5 between between ADP american_scientific_journal-6910 86 6 exploration exploration NOUN american_scientific_journal-6910 86 7 and and CCONJ american_scientific_journal-6910 86 8 exploitation exploitation NOUN american_scientific_journal-6910 86 9 , , PUNCT american_scientific_journal-6910 86 10 a a DET american_scientific_journal-6910 86 11 probabilistic probabilistic ADJ american_scientific_journal-6910 86 12 approach approach NOUN american_scientific_journal-6910 86 13 is be AUX american_scientific_journal-6910 86 14 used use VERB american_scientific_journal-6910 86 15 to to PART american_scientific_journal-6910 86 16 select select VERB american_scientific_journal-6910 86 17 actions action NOUN american_scientific_journal-6910 86 18 . . PUNCT american_scientific_journal-6910 87 1 the the DET american_scientific_journal-6910 87 2 probability probability NOUN american_scientific_journal-6910 87 3 of of ADP american_scientific_journal-6910 87 4 selecting select VERB american_scientific_journal-6910 87 5 action action NOUN american_scientific_journal-6910 87 6 π‘Žπ‘–when π‘Žπ‘–when NOUN american_scientific_journal-6910 87 7 in in ADP american_scientific_journal-6910 87 8 state state NOUN american_scientific_journal-6910 87 9 𝑠 𝑠 PROPN american_scientific_journal-6910 87 10 is be AUX american_scientific_journal-6910 87 11 determined determine VERB american_scientific_journal-6910 87 12 as as SCONJ american_scientific_journal-6910 87 13 follows follow VERB american_scientific_journal-6910 87 14 [ [ X american_scientific_journal-6910 87 15 9 9 NUM american_scientific_journal-6910 87 16 ] ] X american_scientific_journal-6910 87 17 american american ADJ american_scientific_journal-6910 87 18 scientific scientific ADJ american_scientific_journal-6910 87 19 research research PROPN american_scientific_journal-6910 87 20 journal journal NOUN american_scientific_journal-6910 87 21 for for ADP american_scientific_journal-6910 87 22 engineering engineering NOUN american_scientific_journal-6910 87 23 , , PUNCT american_scientific_journal-6910 87 24 technology technology NOUN american_scientific_journal-6910 87 25 , , PUNCT american_scientific_journal-6910 87 26 and and CCONJ american_scientific_journal-6910 87 27 sciences science NOUN american_scientific_journal-6910 87 28 ( ( PUNCT american_scientific_journal-6910 87 29 asrjets asrjet NOUN american_scientific_journal-6910 87 30 ) ) PUNCT american_scientific_journal-6910 87 31 ( ( PUNCT american_scientific_journal-6910 87 32 2021 2021 NUM american_scientific_journal-6910 87 33 ) ) PUNCT american_scientific_journal-6910 87 34 volume volume NOUN american_scientific_journal-6910 87 35 82 82 NUM american_scientific_journal-6910 87 36 , , PUNCT american_scientific_journal-6910 87 37 no no DET american_scientific_journal-6910 87 38 1 1 NUM american_scientific_journal-6910 87 39 , , PUNCT american_scientific_journal-6910 87 40 pp pp ADV american_scientific_journal-6910 87 41 11 11 NUM american_scientific_journal-6910 87 42 - - SYM american_scientific_journal-6910 87 43 18 18 NUM american_scientific_journal-6910 87 44 15 15 NUM american_scientific_journal-6910 87 45 𝑃(π‘Žπ‘–\𝑠 𝑃(π‘Žπ‘–\𝑠 NOUN american_scientific_journal-6910 87 46 ) ) PUNCT american_scientific_journal-6910 87 47 = = SYM american_scientific_journal-6910 87 48 π‘˜π‘„(𝑠,π‘Žπ‘– π‘˜π‘„(𝑠,π‘Žπ‘– PROPN american_scientific_journal-6910 87 49 ) ) PUNCT american_scientific_journal-6910 87 50 βˆ‘ βˆ‘ PUNCT american_scientific_journal-6910 87 51 π‘˜π‘„(𝑠,π‘Žπ‘— π‘˜π‘„(𝑠,π‘Žπ‘— PROPN american_scientific_journal-6910 87 52 ) ) PUNCT american_scientific_journal-6910 88 1 𝑗 𝑗 INTJ american_scientific_journal-6910 88 2 the the DET american_scientific_journal-6910 88 3 value value NOUN american_scientific_journal-6910 88 4 the the DET american_scientific_journal-6910 88 5 constant constant ADJ american_scientific_journal-6910 88 6 π‘˜ π‘˜ X american_scientific_journal-6910 88 7 > > X american_scientific_journal-6910 88 8 0 0 NUM american_scientific_journal-6910 88 9 is be AUX american_scientific_journal-6910 88 10 varied varied ADJ american_scientific_journal-6910 88 11 ( ( PUNCT american_scientific_journal-6910 88 12 from from ADP american_scientific_journal-6910 88 13 small small ADJ american_scientific_journal-6910 88 14 to to PART american_scientific_journal-6910 88 15 large large ADJ american_scientific_journal-6910 88 16 ) ) PUNCT american_scientific_journal-6910 88 17 so so SCONJ american_scientific_journal-6910 88 18 as as SCONJ american_scientific_journal-6910 88 19 to to PART american_scientific_journal-6910 88 20 favor favor VERB american_scientific_journal-6910 88 21 exploration exploration NOUN american_scientific_journal-6910 88 22 in in ADP american_scientific_journal-6910 88 23 the the DET american_scientific_journal-6910 88 24 early early ADJ american_scientific_journal-6910 88 25 stages stage NOUN american_scientific_journal-6910 88 26 of of ADP american_scientific_journal-6910 88 27 the the DET american_scientific_journal-6910 88 28 learning learning NOUN american_scientific_journal-6910 88 29 process process NOUN american_scientific_journal-6910 88 30 , , PUNCT american_scientific_journal-6910 88 31 which which PRON american_scientific_journal-6910 88 32 then then ADV american_scientific_journal-6910 88 33 gradually gradually ADV american_scientific_journal-6910 88 34 shifts shift NOUN american_scientific_journal-6910 88 35 to to ADP american_scientific_journal-6910 88 36 exploitation exploitation NOUN american_scientific_journal-6910 88 37 . . PUNCT american_scientific_journal-6910 89 1 𝐸 𝐸 PROPN american_scientific_journal-6910 89 2 is be AUX american_scientific_journal-6910 89 3 used use VERB american_scientific_journal-6910 89 4 to to PART american_scientific_journal-6910 89 5 indicate indicate VERB american_scientific_journal-6910 89 6 the the DET american_scientific_journal-6910 89 7 end end NOUN american_scientific_journal-6910 89 8 of of ADP american_scientific_journal-6910 89 9 an an DET american_scientific_journal-6910 89 10 episode episode NOUN american_scientific_journal-6910 89 11 . . PUNCT american_scientific_journal-6910 90 1 3 3 X american_scientific_journal-6910 90 2 . . X american_scientific_journal-6910 90 3 simulation simulation NOUN american_scientific_journal-6910 90 4 and and CCONJ american_scientific_journal-6910 90 5 results result NOUN american_scientific_journal-6910 90 6 in in ADP american_scientific_journal-6910 90 7 this this DET american_scientific_journal-6910 90 8 section section NOUN american_scientific_journal-6910 90 9 , , PUNCT american_scientific_journal-6910 90 10 the the DET american_scientific_journal-6910 90 11 performance performance NOUN american_scientific_journal-6910 90 12 of of ADP american_scientific_journal-6910 90 13 the the DET american_scientific_journal-6910 90 14 q q NOUN american_scientific_journal-6910 90 15 - - PUNCT american_scientific_journal-6910 90 16 learning learn VERB american_scientific_journal-6910 90 17 algorithm algorithm NOUN american_scientific_journal-6910 90 18 is be AUX american_scientific_journal-6910 90 19 evaluated evaluate VERB american_scientific_journal-6910 90 20 via via ADP american_scientific_journal-6910 90 21 simulations simulation NOUN american_scientific_journal-6910 90 22 , , PUNCT american_scientific_journal-6910 90 23 based base VERB american_scientific_journal-6910 90 24 on on ADP american_scientific_journal-6910 90 25 the the DET american_scientific_journal-6910 90 26 following follow VERB american_scientific_journal-6910 90 27 network network NOUN american_scientific_journal-6910 90 28 settings setting NOUN american_scientific_journal-6910 90 29 and and CCONJ american_scientific_journal-6910 90 30 parameters parameter NOUN american_scientific_journal-6910 90 31 . . PUNCT american_scientific_journal-6910 91 1 ο‚· ο‚· X american_scientific_journal-6910 91 2 the the DET american_scientific_journal-6910 91 3 number number NOUN american_scientific_journal-6910 91 4 of of ADP american_scientific_journal-6910 91 5 small small ADJ american_scientific_journal-6910 91 6 cells cell NOUN american_scientific_journal-6910 91 7 is be AUX american_scientific_journal-6910 91 8 𝐡 𝐡 NOUN american_scientific_journal-6910 91 9 = = NOUN american_scientific_journal-6910 91 10 3 3 NUM american_scientific_journal-6910 91 11 ο‚· ο‚· PRON american_scientific_journal-6910 91 12 πΆπ‘€π‘Žπ‘ πΆπ‘€π‘Žπ‘ PUNCT american_scientific_journal-6910 91 13 = = SYM american_scientific_journal-6910 91 14 3𝐢𝑆𝑐 3𝐢𝑆𝑐 NUM american_scientific_journal-6910 91 15 ο‚· ο‚· NOUN american_scientific_journal-6910 92 1 𝐢𝑒 𝐢𝑒 NOUN american_scientific_journal-6910 92 2 = = SYM american_scientific_journal-6910 92 3 𝐢𝑆𝑐/2 𝐢𝑆𝑐/2 PROPN american_scientific_journal-6910 92 4 , , PUNCT american_scientific_journal-6910 92 5 𝐢𝑒 𝐢𝑒 PROPN american_scientific_journal-6910 92 6 = = SYM american_scientific_journal-6910 92 7 1.5𝐢𝑒 1.5𝐢𝑒 PROPN american_scientific_journal-6910 92 8 and and CCONJ american_scientific_journal-6910 92 9 𝐢𝑖 𝐢𝑖 PROPN american_scientific_journal-6910 92 10 = = PUNCT american_scientific_journal-6910 92 11 𝐢𝑒/2 𝐢𝑒/2 NOUN american_scientific_journal-6910 92 12 ο‚· ο‚· NOUN american_scientific_journal-6910 92 13 𝑁1 𝑁1 PROPN american_scientific_journal-6910 92 14 = = SYM american_scientific_journal-6910 92 15 πΆπ‘€π‘Žπ‘/𝐢𝑖 πΆπ‘€π‘Žπ‘/𝐢𝑖 PROPN american_scientific_journal-6910 92 16 , , PUNCT american_scientific_journal-6910 92 17 𝑁2 𝑁2 NOUN american_scientific_journal-6910 92 18 = = PUNCT american_scientific_journal-6910 92 19 𝐡𝐢𝑆𝑐/𝐢𝑒 𝐡𝐢𝑆𝑐/𝐢𝑒 PROPN american_scientific_journal-6910 92 20 and and CCONJ american_scientific_journal-6910 92 21 𝑁3 𝑁3 X american_scientific_journal-6910 92 22 = = SYM american_scientific_journal-6910 92 23 πΆπ‘€π‘Žπ‘/𝐢𝑒 πΆπ‘€π‘Žπ‘/𝐢𝑒 X american_scientific_journal-6910 92 24 ο‚· ο‚· PRON american_scientific_journal-6910 92 25 maximum maximum ADJ american_scientific_journal-6910 92 26 slice slice NOUN american_scientific_journal-6910 92 27 size size NOUN american_scientific_journal-6910 92 28 of of ADP american_scientific_journal-6910 92 29 2 2 NUM american_scientific_journal-6910 92 30 , , PUNCT american_scientific_journal-6910 92 31 that that PRON american_scientific_journal-6910 92 32 is be AUX american_scientific_journal-6910 92 33 𝑛 𝑛 DET american_scientific_journal-6910 92 34 ∈ ∈ PROPN american_scientific_journal-6910 93 1 [ [ X american_scientific_journal-6910 93 2 1,2 1,2 NUM american_scientific_journal-6910 93 3 ] ] PUNCT american_scientific_journal-6910 93 4 ο‚· ο‚· NOUN american_scientific_journal-6910 93 5 𝜌2 𝜌2 PROPN american_scientific_journal-6910 93 6 = = SYM american_scientific_journal-6910 93 7 4𝜌1 4𝜌1 NUM american_scientific_journal-6910 93 8 , , PUNCT american_scientific_journal-6910 93 9 𝜌3 𝜌3 NOUN american_scientific_journal-6910 93 10 = = SYM american_scientific_journal-6910 93 11 3𝜌1 3𝜌1 NUM american_scientific_journal-6910 93 12 and and CCONJ american_scientific_journal-6910 93 13 𝜌1 𝜌1 NOUN american_scientific_journal-6910 93 14 = = NOUN american_scientific_journal-6910 93 15 5 5 NUM american_scientific_journal-6910 93 16 ο‚· ο‚· NOUN american_scientific_journal-6910 93 17 the the DET american_scientific_journal-6910 93 18 arrival arrival NOUN american_scientific_journal-6910 93 19 rates rate NOUN american_scientific_journal-6910 93 20 for for ADP american_scientific_journal-6910 93 21 iot iot NOUN american_scientific_journal-6910 93 22 , , PUNCT american_scientific_journal-6910 93 23 emmb emmb ADJ american_scientific_journal-6910 93 24 and and CCONJ american_scientific_journal-6910 93 25 urllc urllc ADJ american_scientific_journal-6910 93 26 slice slice NOUN american_scientific_journal-6910 93 27 requests request NOUN american_scientific_journal-6910 93 28 are be AUX american_scientific_journal-6910 93 29 0.2 0.2 NUM american_scientific_journal-6910 93 30 , , PUNCT american_scientific_journal-6910 93 31 0.35 0.35 NUM american_scientific_journal-6910 93 32 and and CCONJ american_scientific_journal-6910 93 33 0.35 0.35 NUM american_scientific_journal-6910 93 34 respectively respectively ADV american_scientific_journal-6910 93 35 ο‚· ο‚· DET american_scientific_journal-6910 93 36 number number NOUN american_scientific_journal-6910 93 37 of of ADP american_scientific_journal-6910 93 38 queues queue NOUN american_scientific_journal-6910 93 39 is be AUX american_scientific_journal-6910 93 40 6 6 NUM american_scientific_journal-6910 93 41 , , PUNCT american_scientific_journal-6910 93 42 each each DET american_scientific_journal-6910 93 43 queue queue NOUN american_scientific_journal-6910 93 44 is be AUX american_scientific_journal-6910 93 45 stores store NOUN american_scientific_journal-6910 93 46 a a DET american_scientific_journal-6910 93 47 maximum maximum NOUN american_scientific_journal-6910 93 48 of of ADP american_scientific_journal-6910 93 49 100 100 NUM american_scientific_journal-6910 93 50 slice slice NOUN american_scientific_journal-6910 93 51 requests request NOUN american_scientific_journal-6910 93 52 the the DET american_scientific_journal-6910 93 53 performance performance NOUN american_scientific_journal-6910 93 54 of of ADP american_scientific_journal-6910 93 55 the the DET american_scientific_journal-6910 93 56 q q NOUN american_scientific_journal-6910 93 57 - - PUNCT american_scientific_journal-6910 93 58 learning learn VERB american_scientific_journal-6910 93 59 slice slice NOUN american_scientific_journal-6910 93 60 admission admission NOUN american_scientific_journal-6910 93 61 algorithm algorithm NOUN american_scientific_journal-6910 93 62 is be AUX american_scientific_journal-6910 93 63 compared compare VERB american_scientific_journal-6910 93 64 to to ADP american_scientific_journal-6910 93 65 1 1 NUM american_scientific_journal-6910 93 66 ) ) PUNCT american_scientific_journal-6910 93 67 a a DET american_scientific_journal-6910 93 68 greedy greedy ADJ american_scientific_journal-6910 93 69 algorithm algorithm NOUN american_scientific_journal-6910 93 70 that that PRON american_scientific_journal-6910 93 71 admits admit VERB american_scientific_journal-6910 93 72 slices slice NOUN american_scientific_journal-6910 93 73 that that PRON american_scientific_journal-6910 93 74 maximize maximize VERB american_scientific_journal-6910 93 75 the the DET american_scientific_journal-6910 93 76 immediate immediate ADJ american_scientific_journal-6910 93 77 reward reward NOUN american_scientific_journal-6910 93 78 , , PUNCT american_scientific_journal-6910 93 79 2 2 X american_scientific_journal-6910 93 80 ) ) PUNCT american_scientific_journal-6910 93 81 an an DET american_scientific_journal-6910 93 82 algorithm algorithm NOUN american_scientific_journal-6910 93 83 that that PRON american_scientific_journal-6910 93 84 admits admit VERB american_scientific_journal-6910 93 85 slices slice NOUN american_scientific_journal-6910 93 86 in in ADP american_scientific_journal-6910 93 87 a a DET american_scientific_journal-6910 93 88 random random ADJ american_scientific_journal-6910 93 89 manner manner NOUN american_scientific_journal-6910 93 90 . . PUNCT american_scientific_journal-6910 94 1 figure figure NOUN american_scientific_journal-6910 94 2 1 1 NUM american_scientific_journal-6910 94 3 shows show VERB american_scientific_journal-6910 94 4 the the DET american_scientific_journal-6910 94 5 average average ADJ american_scientific_journal-6910 94 6 cumulative cumulative ADJ american_scientific_journal-6910 94 7 revenue revenue NOUN american_scientific_journal-6910 94 8 gained gain VERB american_scientific_journal-6910 94 9 per per ADP american_scientific_journal-6910 94 10 slice slice NOUN american_scientific_journal-6910 94 11 request request NOUN american_scientific_journal-6910 94 12 . . PUNCT american_scientific_journal-6910 95 1 figure figure VERB american_scientific_journal-6910 95 2 1 1 NUM american_scientific_journal-6910 95 3 : : PUNCT american_scientific_journal-6910 95 4 plot plot NOUN american_scientific_journal-6910 95 5 of of ADP american_scientific_journal-6910 95 6 average average ADJ american_scientific_journal-6910 95 7 cumulative cumulative ADJ american_scientific_journal-6910 95 8 revenue revenue NOUN american_scientific_journal-6910 95 9 against against ADP american_scientific_journal-6910 95 10 number number NOUN american_scientific_journal-6910 95 11 of of ADP american_scientific_journal-6910 95 12 episodes episode NOUN american_scientific_journal-6910 95 13 it it PRON american_scientific_journal-6910 95 14 is be AUX american_scientific_journal-6910 95 15 observed observe VERB american_scientific_journal-6910 95 16 that that SCONJ american_scientific_journal-6910 95 17 the the DET american_scientific_journal-6910 95 18 q q NOUN american_scientific_journal-6910 95 19 - - PUNCT american_scientific_journal-6910 95 20 learning learn VERB american_scientific_journal-6910 95 21 algorithm algorithm NOUN american_scientific_journal-6910 95 22 outperforms outperform VERB american_scientific_journal-6910 95 23 the the DET american_scientific_journal-6910 95 24 greedy greedy ADJ american_scientific_journal-6910 95 25 and and CCONJ american_scientific_journal-6910 95 26 random random ADJ american_scientific_journal-6910 95 27 algorithms algorithm NOUN american_scientific_journal-6910 95 28 for for ADP american_scientific_journal-6910 95 29 episodes episode NOUN american_scientific_journal-6910 95 30 > > X american_scientific_journal-6910 95 31 50 50 NUM american_scientific_journal-6910 95 32 . . PUNCT american_scientific_journal-6910 96 1 for for ADP american_scientific_journal-6910 96 2 episodes episode NOUN american_scientific_journal-6910 96 3 1 1 NUM american_scientific_journal-6910 96 4 βˆ’ βˆ’ NOUN american_scientific_journal-6910 96 5 150 150 NUM american_scientific_journal-6910 96 6 , , PUNCT american_scientific_journal-6910 96 7 the the DET american_scientific_journal-6910 96 8 q q NOUN american_scientific_journal-6910 96 9 - - PUNCT american_scientific_journal-6910 96 10 learning learn VERB american_scientific_journal-6910 96 11 algorithm algorithm NOUN american_scientific_journal-6910 96 12 has have AUX american_scientific_journal-6910 96 13 not not PART american_scientific_journal-6910 96 14 converged converge VERB american_scientific_journal-6910 96 15 , , PUNCT american_scientific_journal-6910 96 16 this this DET american_scientific_journal-6910 96 17 results result NOUN american_scientific_journal-6910 96 18 in in ADP american_scientific_journal-6910 96 19 low low ADJ american_scientific_journal-6910 96 20 average average ADJ american_scientific_journal-6910 96 21 cumulative cumulative ADJ american_scientific_journal-6910 96 22 american american ADJ american_scientific_journal-6910 96 23 scientific scientific ADJ american_scientific_journal-6910 96 24 research research NOUN american_scientific_journal-6910 96 25 journal journal NOUN american_scientific_journal-6910 96 26 for for ADP american_scientific_journal-6910 96 27 engineering engineering NOUN american_scientific_journal-6910 96 28 , , PUNCT american_scientific_journal-6910 96 29 technology technology NOUN american_scientific_journal-6910 96 30 , , PUNCT american_scientific_journal-6910 96 31 and and CCONJ american_scientific_journal-6910 96 32 sciences science NOUN american_scientific_journal-6910 96 33 ( ( PUNCT american_scientific_journal-6910 96 34 asrjets asrjet NOUN american_scientific_journal-6910 96 35 ) ) PUNCT american_scientific_journal-6910 96 36 ( ( PUNCT american_scientific_journal-6910 96 37 2021 2021 NUM american_scientific_journal-6910 96 38 ) ) PUNCT american_scientific_journal-6910 96 39 volume volume NOUN american_scientific_journal-6910 96 40 82 82 NUM american_scientific_journal-6910 96 41 , , PUNCT american_scientific_journal-6910 96 42 no no DET american_scientific_journal-6910 96 43 1 1 NUM american_scientific_journal-6910 96 44 , , PUNCT american_scientific_journal-6910 96 45 pp pp ADV american_scientific_journal-6910 96 46 11 11 NUM american_scientific_journal-6910 96 47 - - SYM american_scientific_journal-6910 96 48 18 18 NUM american_scientific_journal-6910 96 49 16 16 NUM american_scientific_journal-6910 96 50 revenue revenue NOUN american_scientific_journal-6910 96 51 value value NOUN american_scientific_journal-6910 96 52 . . PUNCT american_scientific_journal-6910 97 1 but but CCONJ american_scientific_journal-6910 97 2 after after ADP american_scientific_journal-6910 97 3 convergence convergence NOUN american_scientific_journal-6910 97 4 , , PUNCT american_scientific_journal-6910 97 5 the the DET american_scientific_journal-6910 97 6 revenue revenue NOUN american_scientific_journal-6910 97 7 value value NOUN american_scientific_journal-6910 97 8 stabilizes stabilize VERB american_scientific_journal-6910 97 9 to to ADP american_scientific_journal-6910 97 10 a a DET american_scientific_journal-6910 97 11 maximum maximum ADJ american_scientific_journal-6910 97 12 value value NOUN american_scientific_journal-6910 97 13 that that PRON american_scientific_journal-6910 97 14 is be AUX american_scientific_journal-6910 97 15 greater great ADJ american_scientific_journal-6910 97 16 than than ADP american_scientific_journal-6910 97 17 that that PRON american_scientific_journal-6910 97 18 of of ADP american_scientific_journal-6910 97 19 the the DET american_scientific_journal-6910 97 20 other other ADJ american_scientific_journal-6910 97 21 two two NUM american_scientific_journal-6910 97 22 algorithms algorithm NOUN american_scientific_journal-6910 97 23 . . PUNCT american_scientific_journal-6910 98 1 figures figure NOUN american_scientific_journal-6910 98 2 2(a 2(a NUM american_scientific_journal-6910 98 3 ) ) PUNCT american_scientific_journal-6910 98 4 , , PUNCT american_scientific_journal-6910 98 5 ( ( PUNCT american_scientific_journal-6910 98 6 b b X american_scientific_journal-6910 98 7 ) ) PUNCT american_scientific_journal-6910 98 8 and and CCONJ american_scientific_journal-6910 98 9 ( ( PUNCT american_scientific_journal-6910 98 10 c c X american_scientific_journal-6910 98 11 ) ) PUNCT american_scientific_journal-6910 98 12 show show VERB american_scientific_journal-6910 98 13 the the DET american_scientific_journal-6910 98 14 slice slice NOUN american_scientific_journal-6910 98 15 admission admission NOUN american_scientific_journal-6910 98 16 rates rate NOUN american_scientific_journal-6910 98 17 for for ADP american_scientific_journal-6910 98 18 q q NOUN american_scientific_journal-6910 98 19 - - PUNCT american_scientific_journal-6910 98 20 learning learning ADJ american_scientific_journal-6910 98 21 , , PUNCT american_scientific_journal-6910 98 22 greedy greedy ADJ american_scientific_journal-6910 98 23 and and CCONJ american_scientific_journal-6910 98 24 random random ADJ american_scientific_journal-6910 98 25 algorithms algorithm NOUN american_scientific_journal-6910 98 26 , , PUNCT american_scientific_journal-6910 98 27 respectively respectively ADV american_scientific_journal-6910 98 28 . . PUNCT american_scientific_journal-6910 99 1 figure figure NOUN american_scientific_journal-6910 99 2 2 2 NUM american_scientific_journal-6910 99 3 : : PUNCT american_scientific_journal-6910 99 4 average average ADJ american_scientific_journal-6910 99 5 slice slice NOUN american_scientific_journal-6910 99 6 admission admission NOUN american_scientific_journal-6910 99 7 rate rate NOUN american_scientific_journal-6910 99 8 for for ADP american_scientific_journal-6910 99 9 ( ( PUNCT american_scientific_journal-6910 99 10 a a PRON american_scientific_journal-6910 99 11 ) ) PUNCT american_scientific_journal-6910 99 12 q q NOUN american_scientific_journal-6910 99 13 - - PUNCT american_scientific_journal-6910 99 14 learning learn VERB american_scientific_journal-6910 99 15 ( ( PUNCT american_scientific_journal-6910 99 16 b b NOUN american_scientific_journal-6910 99 17 ) ) PUNCT american_scientific_journal-6910 99 18 greedy greedy ADJ american_scientific_journal-6910 99 19 and and CCONJ american_scientific_journal-6910 99 20 ( ( PUNCT american_scientific_journal-6910 99 21 c c NOUN american_scientific_journal-6910 99 22 ) ) PUNCT american_scientific_journal-6910 99 23 random random ADJ american_scientific_journal-6910 99 24 ( ( PUNCT american_scientific_journal-6910 99 25 a a NOUN american_scientific_journal-6910 99 26 ) ) PUNCT american_scientific_journal-6910 99 27 ( ( PUNCT american_scientific_journal-6910 99 28 b b X american_scientific_journal-6910 99 29 ) ) PUNCT american_scientific_journal-6910 99 30 ( ( PUNCT american_scientific_journal-6910 99 31 c c X american_scientific_journal-6910 99 32 ) ) PUNCT american_scientific_journal-6910 99 33 american american ADJ american_scientific_journal-6910 99 34 scientific scientific ADJ american_scientific_journal-6910 99 35 research research NOUN american_scientific_journal-6910 99 36 journal journal NOUN american_scientific_journal-6910 99 37 for for ADP american_scientific_journal-6910 99 38 engineering engineering NOUN american_scientific_journal-6910 99 39 , , PUNCT american_scientific_journal-6910 99 40 technology technology NOUN american_scientific_journal-6910 99 41 , , PUNCT american_scientific_journal-6910 99 42 and and CCONJ american_scientific_journal-6910 99 43 sciences science NOUN american_scientific_journal-6910 99 44 ( ( PUNCT american_scientific_journal-6910 99 45 asrjets asrjet NOUN american_scientific_journal-6910 99 46 ) ) PUNCT american_scientific_journal-6910 99 47 ( ( PUNCT american_scientific_journal-6910 99 48 2021 2021 NUM american_scientific_journal-6910 99 49 ) ) PUNCT american_scientific_journal-6910 99 50 volume volume NOUN american_scientific_journal-6910 99 51 82 82 NUM american_scientific_journal-6910 99 52 , , PUNCT american_scientific_journal-6910 99 53 no no DET american_scientific_journal-6910 99 54 1 1 NUM american_scientific_journal-6910 99 55 , , PUNCT american_scientific_journal-6910 99 56 pp pp ADV american_scientific_journal-6910 99 57 11 11 NUM american_scientific_journal-6910 99 58 - - SYM american_scientific_journal-6910 99 59 18 18 NUM american_scientific_journal-6910 99 60 17 17 NUM american_scientific_journal-6910 99 61 the the DET american_scientific_journal-6910 99 62 plots plot NOUN american_scientific_journal-6910 99 63 for for ADP american_scientific_journal-6910 99 64 admission admission NOUN american_scientific_journal-6910 99 65 rates rate NOUN american_scientific_journal-6910 99 66 for for ADP american_scientific_journal-6910 99 67 , , PUNCT american_scientific_journal-6910 99 68 ( ( PUNCT american_scientific_journal-6910 99 69 i i NOUN american_scientific_journal-6910 99 70 ) ) PUNCT american_scientific_journal-6910 99 71 iot iot PROPN american_scientific_journal-6910 99 72 slice slice NOUN american_scientific_journal-6910 99 73 requests request NOUN american_scientific_journal-6910 99 74 of of ADP american_scientific_journal-6910 99 75 size size NOUN american_scientific_journal-6910 99 76 1 1 NUM american_scientific_journal-6910 99 77 and and CCONJ american_scientific_journal-6910 99 78 2 2 NUM american_scientific_journal-6910 99 79 ( ( PUNCT american_scientific_journal-6910 99 80 πΌπ‘œπ‘‡1 πΌπ‘œπ‘‡1 VERB american_scientific_journal-6910 99 81 π‘Žπ‘›π‘‘ π‘Žπ‘›π‘‘ ADJ american_scientific_journal-6910 99 82 πΌπ‘œπ‘‡2 πΌπ‘œπ‘‡2 NOUN american_scientific_journal-6910 99 83 ) ) PUNCT american_scientific_journal-6910 99 84 , , PUNCT american_scientific_journal-6910 99 85 ( ( PUNCT american_scientific_journal-6910 99 86 ii ii NOUN american_scientific_journal-6910 99 87 ) ) PUNCT american_scientific_journal-6910 99 88 emmb emmb ADJ american_scientific_journal-6910 99 89 slice slice NOUN american_scientific_journal-6910 99 90 requests request NOUN american_scientific_journal-6910 99 91 of of ADP american_scientific_journal-6910 99 92 size size NOUN american_scientific_journal-6910 99 93 1 1 NUM american_scientific_journal-6910 99 94 and and CCONJ american_scientific_journal-6910 99 95 2 2 NUM american_scientific_journal-6910 99 96 ( ( PUNCT american_scientific_journal-6910 99 97 𝑒𝑀𝑀𝐡1 𝑒𝑀𝑀𝐡1 ADV american_scientific_journal-6910 99 98 π‘Žπ‘›π‘‘ π‘Žπ‘›π‘‘ ADJ american_scientific_journal-6910 99 99 𝑒𝑀𝑀𝐡2 𝑒𝑀𝑀𝐡2 PROPN american_scientific_journal-6910 99 100 ) ) PUNCT american_scientific_journal-6910 99 101 and and CCONJ american_scientific_journal-6910 99 102 ( ( PUNCT american_scientific_journal-6910 99 103 ii ii NOUN american_scientific_journal-6910 99 104 ) ) PUNCT american_scientific_journal-6910 99 105 urrlc urrlc VERB american_scientific_journal-6910 99 106 slice slice NOUN american_scientific_journal-6910 99 107 requests request NOUN american_scientific_journal-6910 99 108 of of ADP american_scientific_journal-6910 99 109 size size NOUN american_scientific_journal-6910 99 110 1 1 NUM american_scientific_journal-6910 99 111 and and CCONJ american_scientific_journal-6910 99 112 2 2 NUM american_scientific_journal-6910 99 113 ( ( PUNCT american_scientific_journal-6910 99 114 𝑒𝑅𝐿𝐿𝐢1 𝑒𝑅𝐿𝐿𝐢1 X american_scientific_journal-6910 99 115 π‘Žπ‘›π‘‘ π‘Žπ‘›π‘‘ ADJ american_scientific_journal-6910 99 116 𝑒𝑅𝐿𝐿𝐢2 𝑒𝑅𝐿𝐿𝐢2 PROPN american_scientific_journal-6910 99 117 ) ) PUNCT american_scientific_journal-6910 99 118 . . PUNCT american_scientific_journal-6910 100 1 from from ADP american_scientific_journal-6910 100 2 figure figure NOUN american_scientific_journal-6910 100 3 2(a 2(a NUM american_scientific_journal-6910 100 4 ) ) PUNCT american_scientific_journal-6910 100 5 , , PUNCT american_scientific_journal-6910 100 6 it it PRON american_scientific_journal-6910 100 7 is be AUX american_scientific_journal-6910 100 8 observed observe VERB american_scientific_journal-6910 100 9 that that SCONJ american_scientific_journal-6910 100 10 the the DET american_scientific_journal-6910 100 11 q q NOUN american_scientific_journal-6910 100 12 - - PUNCT american_scientific_journal-6910 100 13 learning learn VERB american_scientific_journal-6910 100 14 algorithm algorithm NOUN american_scientific_journal-6910 100 15 , , PUNCT american_scientific_journal-6910 100 16 after after ADP american_scientific_journal-6910 100 17 convergence convergence NOUN american_scientific_journal-6910 100 18 , , PUNCT american_scientific_journal-6910 100 19 maintains maintain VERB american_scientific_journal-6910 100 20 the the DET american_scientific_journal-6910 100 21 admission admission NOUN american_scientific_journal-6910 100 22 rates rate NOUN american_scientific_journal-6910 100 23 for for ADP american_scientific_journal-6910 100 24 all all DET american_scientific_journal-6910 100 25 slice slice NOUN american_scientific_journal-6910 100 26 request request NOUN american_scientific_journal-6910 100 27 above above ADP american_scientific_journal-6910 100 28 14 14 NUM american_scientific_journal-6910 100 29 % % NOUN american_scientific_journal-6910 100 30 . . PUNCT american_scientific_journal-6910 101 1 admission admission NOUN american_scientific_journal-6910 101 2 rates rate NOUN american_scientific_journal-6910 101 3 are be AUX american_scientific_journal-6910 101 4 dependent dependent ADJ american_scientific_journal-6910 101 5 on on ADP american_scientific_journal-6910 101 6 the the DET american_scientific_journal-6910 101 7 reward reward NOUN american_scientific_journal-6910 101 8 and and CCONJ american_scientific_journal-6910 101 9 slice slice NOUN american_scientific_journal-6910 101 10 size size NOUN american_scientific_journal-6910 101 11 ; ; PUNCT american_scientific_journal-6910 101 12 a a DET american_scientific_journal-6910 101 13 larger large ADJ american_scientific_journal-6910 101 14 reward reward NOUN american_scientific_journal-6910 101 15 translates translate VERB american_scientific_journal-6910 101 16 to to ADP american_scientific_journal-6910 101 17 higher high ADJ american_scientific_journal-6910 101 18 admission admission NOUN american_scientific_journal-6910 101 19 rate rate NOUN american_scientific_journal-6910 101 20 while while SCONJ american_scientific_journal-6910 101 21 a a DET american_scientific_journal-6910 101 22 bigger big ADJ american_scientific_journal-6910 101 23 slice slice NOUN american_scientific_journal-6910 101 24 size size NOUN american_scientific_journal-6910 101 25 reduces reduce VERB american_scientific_journal-6910 101 26 the the DET american_scientific_journal-6910 101 27 admission admission NOUN american_scientific_journal-6910 101 28 rate rate NOUN american_scientific_journal-6910 101 29 . . PUNCT american_scientific_journal-6910 102 1 it it PRON american_scientific_journal-6910 102 2 is be AUX american_scientific_journal-6910 102 3 more more ADV american_scientific_journal-6910 102 4 difficult difficult ADJ american_scientific_journal-6910 102 5 to to PART american_scientific_journal-6910 102 6 allocate allocate VERB american_scientific_journal-6910 102 7 resources resource NOUN american_scientific_journal-6910 102 8 to to ADP american_scientific_journal-6910 102 9 a a DET american_scientific_journal-6910 102 10 slice slice NOUN american_scientific_journal-6910 102 11 request request NOUN american_scientific_journal-6910 102 12 with with ADP american_scientific_journal-6910 102 13 a a DET american_scientific_journal-6910 102 14 larger large ADJ american_scientific_journal-6910 102 15 size size NOUN american_scientific_journal-6910 102 16 . . PUNCT american_scientific_journal-6910 103 1 it it PRON american_scientific_journal-6910 103 2 is be AUX american_scientific_journal-6910 103 3 evident evident ADJ american_scientific_journal-6910 103 4 that that SCONJ american_scientific_journal-6910 103 5 the the DET american_scientific_journal-6910 103 6 q q NOUN american_scientific_journal-6910 103 7 - - PUNCT american_scientific_journal-6910 103 8 learning learn VERB american_scientific_journal-6910 103 9 algorithm algorithm NOUN american_scientific_journal-6910 103 10 learns learn VERB american_scientific_journal-6910 103 11 from from ADP american_scientific_journal-6910 103 12 the the DET american_scientific_journal-6910 103 13 environment environment NOUN american_scientific_journal-6910 103 14 , , PUNCT american_scientific_journal-6910 103 15 enabling enable VERB american_scientific_journal-6910 103 16 it it PRON american_scientific_journal-6910 103 17 to to PART american_scientific_journal-6910 103 18 prioritize prioritize VERB american_scientific_journal-6910 103 19 slice slice NOUN american_scientific_journal-6910 103 20 requests request NOUN american_scientific_journal-6910 103 21 in in ADP american_scientific_journal-6910 103 22 a a DET american_scientific_journal-6910 103 23 manner manner NOUN american_scientific_journal-6910 103 24 that that PRON american_scientific_journal-6910 103 25 results result VERB american_scientific_journal-6910 103 26 in in ADP american_scientific_journal-6910 103 27 maximized maximized ADJ american_scientific_journal-6910 103 28 cumulative cumulative ADJ american_scientific_journal-6910 103 29 revenue revenue NOUN american_scientific_journal-6910 103 30 and and CCONJ american_scientific_journal-6910 103 31 fair fair ADJ american_scientific_journal-6910 103 32 admission admission NOUN american_scientific_journal-6910 103 33 rates rate NOUN american_scientific_journal-6910 103 34 for for ADP american_scientific_journal-6910 103 35 the the DET american_scientific_journal-6910 103 36 slices slice NOUN american_scientific_journal-6910 103 37 . . PUNCT american_scientific_journal-6910 104 1 the the DET american_scientific_journal-6910 104 2 greedy greedy ADJ american_scientific_journal-6910 104 3 algorithm algorithm NOUN american_scientific_journal-6910 104 4 , , PUNCT american_scientific_journal-6910 104 5 as as SCONJ american_scientific_journal-6910 104 6 seen see VERB american_scientific_journal-6910 104 7 in in ADP american_scientific_journal-6910 104 8 figure figure NOUN american_scientific_journal-6910 104 9 2(b 2(b NUM american_scientific_journal-6910 104 10 ) ) PUNCT american_scientific_journal-6910 104 11 , , PUNCT american_scientific_journal-6910 104 12 which which PRON american_scientific_journal-6910 104 13 maximizes maximize VERB american_scientific_journal-6910 104 14 immediate immediate ADJ american_scientific_journal-6910 104 15 rewards reward NOUN american_scientific_journal-6910 104 16 , , PUNCT american_scientific_journal-6910 104 17 prioritizes prioritize VERB american_scientific_journal-6910 104 18 𝑒𝑅𝐿𝐿𝐢2 𝑒𝑅𝐿𝐿𝐢2 PROPN american_scientific_journal-6910 104 19 , , PUNCT american_scientific_journal-6910 104 20 𝑒𝑀𝑀𝐡2 𝑒𝑀𝑀𝐡2 PROPN american_scientific_journal-6910 104 21 and and CCONJ american_scientific_journal-6910 104 22 𝑒𝑅𝐿𝐿𝐢1 𝑒𝑅𝐿𝐿𝐢1 NUM american_scientific_journal-6910 104 23 at at ADP american_scientific_journal-6910 104 24 the the DET american_scientific_journal-6910 104 25 expense expense NOUN american_scientific_journal-6910 104 26 of of ADP american_scientific_journal-6910 104 27 the the DET american_scientific_journal-6910 104 28 other other ADJ american_scientific_journal-6910 104 29 slice slice NOUN american_scientific_journal-6910 104 30 requests request NOUN american_scientific_journal-6910 104 31 which which PRON american_scientific_journal-6910 104 32 have have VERB american_scientific_journal-6910 104 33 lower low ADJ american_scientific_journal-6910 104 34 immediate immediate ADJ american_scientific_journal-6910 104 35 rewards reward NOUN american_scientific_journal-6910 104 36 . . PUNCT american_scientific_journal-6910 105 1 this this DET american_scientific_journal-6910 105 2 results result NOUN american_scientific_journal-6910 105 3 in in ADP american_scientific_journal-6910 105 4 cumulative cumulative ADJ american_scientific_journal-6910 105 5 revenue revenue NOUN american_scientific_journal-6910 105 6 that that PRON american_scientific_journal-6910 105 7 is be AUX american_scientific_journal-6910 105 8 high high ADJ american_scientific_journal-6910 105 9 for for ADP american_scientific_journal-6910 105 10 initial initial ADJ american_scientific_journal-6910 105 11 episodes episode NOUN american_scientific_journal-6910 105 12 , , PUNCT american_scientific_journal-6910 105 13 and and CCONJ american_scientific_journal-6910 105 14 then then ADV american_scientific_journal-6910 105 15 decreases decrease VERB american_scientific_journal-6910 105 16 as as ADP american_scientific_journal-6910 105 17 the the DET american_scientific_journal-6910 105 18 number number NOUN american_scientific_journal-6910 105 19 of of ADP american_scientific_journal-6910 105 20 episodes episode NOUN american_scientific_journal-6910 105 21 increases increase NOUN american_scientific_journal-6910 105 22 . . PUNCT american_scientific_journal-6910 106 1 the the DET american_scientific_journal-6910 106 2 random random ADJ american_scientific_journal-6910 106 3 algorithm algorithm NOUN american_scientific_journal-6910 106 4 , , PUNCT american_scientific_journal-6910 106 5 as as SCONJ american_scientific_journal-6910 106 6 seen see VERB american_scientific_journal-6910 106 7 in in ADP american_scientific_journal-6910 106 8 figure figure NOUN american_scientific_journal-6910 106 9 2(c 2(c NUM american_scientific_journal-6910 106 10 ) ) PUNCT american_scientific_journal-6910 106 11 , , PUNCT american_scientific_journal-6910 106 12 maintains maintain VERB american_scientific_journal-6910 106 13 the the DET american_scientific_journal-6910 106 14 admission admission NOUN american_scientific_journal-6910 106 15 rates rate NOUN american_scientific_journal-6910 106 16 between between ADP american_scientific_journal-6910 106 17 14 14 NUM american_scientific_journal-6910 106 18 % % NOUN american_scientific_journal-6910 106 19 and and CCONJ american_scientific_journal-6910 106 20 19 19 NUM american_scientific_journal-6910 106 21 % % NOUN american_scientific_journal-6910 106 22 . . PUNCT american_scientific_journal-6910 107 1 since since SCONJ american_scientific_journal-6910 107 2 the the DET american_scientific_journal-6910 107 3 algorithm algorithm NOUN american_scientific_journal-6910 107 4 selects select VERB american_scientific_journal-6910 107 5 slice slice NOUN american_scientific_journal-6910 107 6 requests request NOUN american_scientific_journal-6910 107 7 in in ADP american_scientific_journal-6910 107 8 a a DET american_scientific_journal-6910 107 9 random random ADJ american_scientific_journal-6910 107 10 manner manner NOUN american_scientific_journal-6910 107 11 , , PUNCT american_scientific_journal-6910 107 12 the the DET american_scientific_journal-6910 107 13 admission admission NOUN american_scientific_journal-6910 107 14 rate rate NOUN american_scientific_journal-6910 107 15 for for ADP american_scientific_journal-6910 107 16 each each DET american_scientific_journal-6910 107 17 slice slice NOUN american_scientific_journal-6910 107 18 should should AUX american_scientific_journal-6910 107 19 be be AUX american_scientific_journal-6910 107 20 approximately approximately ADV american_scientific_journal-6910 107 21 16.6 16.6 NUM american_scientific_journal-6910 107 22 % % NOUN american_scientific_journal-6910 107 23 . . PUNCT american_scientific_journal-6910 108 1 but but CCONJ american_scientific_journal-6910 108 2 a a DET american_scientific_journal-6910 108 3 selected select VERB american_scientific_journal-6910 108 4 slice slice NOUN american_scientific_journal-6910 108 5 will will AUX american_scientific_journal-6910 108 6 not not PART american_scientific_journal-6910 108 7 necessarily necessarily ADV american_scientific_journal-6910 108 8 be be AUX american_scientific_journal-6910 108 9 admitted admit VERB american_scientific_journal-6910 108 10 because because SCONJ american_scientific_journal-6910 108 11 the the DET american_scientific_journal-6910 108 12 resources resource NOUN american_scientific_journal-6910 108 13 may may AUX american_scientific_journal-6910 108 14 not not PART american_scientific_journal-6910 108 15 be be AUX american_scientific_journal-6910 108 16 available available ADJ american_scientific_journal-6910 108 17 , , PUNCT american_scientific_journal-6910 108 18 therefore therefore ADV american_scientific_journal-6910 108 19 the the DET american_scientific_journal-6910 108 20 slice slice NOUN american_scientific_journal-6910 108 21 request request NOUN american_scientific_journal-6910 108 22 do do AUX american_scientific_journal-6910 108 23 not not PART american_scientific_journal-6910 108 24 have have VERB american_scientific_journal-6910 108 25 the the DET american_scientific_journal-6910 108 26 same same ADJ american_scientific_journal-6910 108 27 admission admission NOUN american_scientific_journal-6910 108 28 rate rate NOUN american_scientific_journal-6910 108 29 . . PUNCT american_scientific_journal-6910 109 1 4 4 X american_scientific_journal-6910 109 2 . . X american_scientific_journal-6910 109 3 conclusions conclusion NOUN american_scientific_journal-6910 109 4 in in ADP american_scientific_journal-6910 109 5 this this DET american_scientific_journal-6910 109 6 paper paper NOUN american_scientific_journal-6910 109 7 , , PUNCT american_scientific_journal-6910 109 8 q q NOUN american_scientific_journal-6910 109 9 - - PUNCT american_scientific_journal-6910 109 10 learning learning ADJ american_scientific_journal-6910 109 11 based base VERB american_scientific_journal-6910 109 12 slice slice NOUN american_scientific_journal-6910 109 13 admission admission NOUN american_scientific_journal-6910 109 14 algorithm algorithm NOUN american_scientific_journal-6910 109 15 , , PUNCT american_scientific_journal-6910 109 16 that that PRON american_scientific_journal-6910 109 17 maximizes maximize VERB american_scientific_journal-6910 109 18 the the DET american_scientific_journal-6910 109 19 revenue revenue NOUN american_scientific_journal-6910 109 20 for for ADP american_scientific_journal-6910 109 21 a a DET american_scientific_journal-6910 109 22 multi multi ADJ american_scientific_journal-6910 109 23 - - NOUN american_scientific_journal-6910 109 24 tier tier ADJ american_scientific_journal-6910 109 25 5 5 NUM american_scientific_journal-6910 109 26 g g NOUN american_scientific_journal-6910 109 27 cellular cellular ADJ american_scientific_journal-6910 109 28 wireless wireless ADJ american_scientific_journal-6910 109 29 network network NOUN american_scientific_journal-6910 109 30 infrastructure infrastructure NOUN american_scientific_journal-6910 109 31 was be AUX american_scientific_journal-6910 109 32 designed design VERB american_scientific_journal-6910 109 33 and and CCONJ american_scientific_journal-6910 109 34 implemented implement VERB american_scientific_journal-6910 109 35 . . PUNCT american_scientific_journal-6910 110 1 results result NOUN american_scientific_journal-6910 110 2 show show VERB american_scientific_journal-6910 110 3 that that SCONJ american_scientific_journal-6910 110 4 the the DET american_scientific_journal-6910 110 5 algorithm algorithm NOUN american_scientific_journal-6910 110 6 ’s ’s PART american_scientific_journal-6910 110 7 capability capability NOUN american_scientific_journal-6910 110 8 to to PART american_scientific_journal-6910 110 9 learn learn VERB american_scientific_journal-6910 110 10 from from ADP american_scientific_journal-6910 110 11 the the DET american_scientific_journal-6910 110 12 environment environment NOUN american_scientific_journal-6910 110 13 ( ( PUNCT american_scientific_journal-6910 110 14 network network NOUN american_scientific_journal-6910 110 15 ) ) PUNCT american_scientific_journal-6910 110 16 allowing allow VERB american_scientific_journal-6910 110 17 it it PRON american_scientific_journal-6910 110 18 to to PART american_scientific_journal-6910 110 19 adaptively adaptively ADV american_scientific_journal-6910 110 20 allocate allocate VERB american_scientific_journal-6910 110 21 resources resource NOUN american_scientific_journal-6910 110 22 , , PUNCT american_scientific_journal-6910 110 23 this this PRON american_scientific_journal-6910 110 24 enabled enable VERB american_scientific_journal-6910 110 25 it it PRON american_scientific_journal-6910 110 26 provide provide VERB american_scientific_journal-6910 110 27 revenue revenue NOUN american_scientific_journal-6910 110 28 gains gain NOUN american_scientific_journal-6910 110 29 when when SCONJ american_scientific_journal-6910 110 30 compared compare VERB american_scientific_journal-6910 110 31 to to ADP american_scientific_journal-6910 110 32 greedy greedy ADJ american_scientific_journal-6910 110 33 and and CCONJ american_scientific_journal-6910 110 34 random random ADJ american_scientific_journal-6910 110 35 slice slice NOUN american_scientific_journal-6910 110 36 admission admission NOUN american_scientific_journal-6910 110 37 algorithms algorithm NOUN american_scientific_journal-6910 110 38 . . PUNCT american_scientific_journal-6910 111 1 5 5 X american_scientific_journal-6910 111 2 . . X american_scientific_journal-6910 111 3 recommendations recommendation NOUN american_scientific_journal-6910 111 4 the the DET american_scientific_journal-6910 111 5 q q ADV american_scientific_journal-6910 111 6 - - PUNCT american_scientific_journal-6910 111 7 learning learn VERB american_scientific_journal-6910 111 8 algorithm algorithm NOUN american_scientific_journal-6910 111 9 used use VERB american_scientific_journal-6910 111 10 in in ADP american_scientific_journal-6910 111 11 this this DET american_scientific_journal-6910 111 12 study study NOUN american_scientific_journal-6910 111 13 learns learn VERB american_scientific_journal-6910 111 14 by by ADP american_scientific_journal-6910 111 15 maintaining maintain VERB american_scientific_journal-6910 111 16 and and CCONJ american_scientific_journal-6910 111 17 updating update VERB american_scientific_journal-6910 111 18 q q NOUN american_scientific_journal-6910 111 19 - - PUNCT american_scientific_journal-6910 111 20 values value NOUN american_scientific_journal-6910 111 21 for for ADP american_scientific_journal-6910 111 22 all all DET american_scientific_journal-6910 111 23 state state NOUN american_scientific_journal-6910 111 24 - - PUNCT american_scientific_journal-6910 111 25 action action NOUN american_scientific_journal-6910 111 26 pairs pair NOUN american_scientific_journal-6910 111 27 . . PUNCT american_scientific_journal-6910 112 1 if if SCONJ american_scientific_journal-6910 112 2 the the DET american_scientific_journal-6910 112 3 wireless wireless ADJ american_scientific_journal-6910 112 4 network network NOUN american_scientific_journal-6910 112 5 is be AUX american_scientific_journal-6910 112 6 large large ADJ american_scientific_journal-6910 112 7 in in ADP american_scientific_journal-6910 112 8 scale scale NOUN american_scientific_journal-6910 112 9 , , PUNCT american_scientific_journal-6910 112 10 as as SCONJ american_scientific_journal-6910 112 11 5 5 NUM american_scientific_journal-6910 112 12 g g NOUN american_scientific_journal-6910 112 13 networks network NOUN american_scientific_journal-6910 112 14 tend tend VERB american_scientific_journal-6910 112 15 to to PART american_scientific_journal-6910 112 16 be be AUX american_scientific_journal-6910 112 17 , , PUNCT american_scientific_journal-6910 112 18 then then ADV american_scientific_journal-6910 112 19 the the DET american_scientific_journal-6910 112 20 number number NOUN american_scientific_journal-6910 112 21 of of ADP american_scientific_journal-6910 112 22 states state NOUN american_scientific_journal-6910 112 23 can can AUX american_scientific_journal-6910 112 24 become become VERB american_scientific_journal-6910 112 25 quite quite ADV american_scientific_journal-6910 112 26 large large ADJ american_scientific_journal-6910 112 27 or or CCONJ american_scientific_journal-6910 112 28 even even ADV american_scientific_journal-6910 112 29 unlimited unlimited ADJ american_scientific_journal-6910 112 30 , , PUNCT american_scientific_journal-6910 112 31 negatively negatively ADV american_scientific_journal-6910 112 32 impacting impact VERB american_scientific_journal-6910 112 33 algorithm algorithm NOUN american_scientific_journal-6910 112 34 efficiency efficiency NOUN american_scientific_journal-6910 112 35 . . PUNCT american_scientific_journal-6910 113 1 this this DET american_scientific_journal-6910 113 2 issue issue NOUN american_scientific_journal-6910 113 3 can can AUX american_scientific_journal-6910 113 4 be be AUX american_scientific_journal-6910 113 5 overcome overcome VERB american_scientific_journal-6910 113 6 if if SCONJ american_scientific_journal-6910 113 7 deep deep ADJ american_scientific_journal-6910 113 8 q q NOUN american_scientific_journal-6910 113 9 - - PUNCT american_scientific_journal-6910 113 10 learning learning NOUN american_scientific_journal-6910 113 11 , , PUNCT american_scientific_journal-6910 113 12 which which PRON american_scientific_journal-6910 113 13 combines combine VERB american_scientific_journal-6910 113 14 q q ADV american_scientific_journal-6910 113 15 - - PUNCT american_scientific_journal-6910 113 16 learning learn VERB american_scientific_journal-6910 113 17 and and CCONJ american_scientific_journal-6910 113 18 deep deep ADJ american_scientific_journal-6910 113 19 learning learning NOUN american_scientific_journal-6910 113 20 techniques technique NOUN american_scientific_journal-6910 113 21 , , PUNCT american_scientific_journal-6910 113 22 is be AUX american_scientific_journal-6910 113 23 used use VERB american_scientific_journal-6910 113 24 . . PUNCT american_scientific_journal-6910 114 1 references reference NOUN american_scientific_journal-6910 114 2 [ [ X american_scientific_journal-6910 114 3 1 1 NUM american_scientific_journal-6910 114 4 ] ] PUNCT american_scientific_journal-6910 114 5 . . PUNCT american_scientific_journal-6910 115 1 onf onf PROPN american_scientific_journal-6910 115 2 tr-526 tr-526 PROPN american_scientific_journal-6910 115 3 , , PUNCT american_scientific_journal-6910 115 4 β€œ " PUNCT american_scientific_journal-6910 115 5 applying apply VERB american_scientific_journal-6910 115 6 sdn sdn NOUN american_scientific_journal-6910 115 7 architecture architecture NOUN american_scientific_journal-6910 115 8 to to ADP american_scientific_journal-6910 115 9 5 5 NUM american_scientific_journal-6910 115 10 g g NOUN american_scientific_journal-6910 115 11 slicing slicing NOUN american_scientific_journal-6910 115 12 , , PUNCT american_scientific_journal-6910 115 13 ” " PUNCT american_scientific_journal-6910 115 14 apr apr NOUN american_scientific_journal-6910 115 15 . . PROPN american_scientific_journal-6910 115 16 2016 2016 NUM american_scientific_journal-6910 115 17 . . PUNCT american_scientific_journal-6910 116 1 [ [ X american_scientific_journal-6910 116 2 2 2 NUM american_scientific_journal-6910 116 3 ] ] PUNCT american_scientific_journal-6910 116 4 . . PUNCT american_scientific_journal-6910 117 1 etsi etsi NOUN american_scientific_journal-6910 117 2 gs gs INTJ american_scientific_journal-6910 117 3 nfv nfv INTJ american_scientific_journal-6910 117 4 002 002 NUM american_scientific_journal-6910 117 5 , , PUNCT american_scientific_journal-6910 117 6 β€œ " PUNCT american_scientific_journal-6910 117 7 network network NOUN american_scientific_journal-6910 117 8 functions function NOUN american_scientific_journal-6910 117 9 virtualization virtualization NOUN american_scientific_journal-6910 117 10 ( ( PUNCT american_scientific_journal-6910 117 11 nfv nfv NOUN american_scientific_journal-6910 117 12 ) ) PUNCT american_scientific_journal-6910 117 13 ; ; PUNCT american_scientific_journal-6910 117 14 architectural architectural ADJ american_scientific_journal-6910 117 15 framework framework NOUN american_scientific_journal-6910 117 16 , , PUNCT american_scientific_journal-6910 117 17 ” " PUNCT american_scientific_journal-6910 117 18 v. v. CCONJ american_scientific_journal-6910 117 19 1.1.1 1.1.1 NUM american_scientific_journal-6910 117 20 , , PUNCT american_scientific_journal-6910 117 21 dec dec PROPN american_scientific_journal-6910 117 22 . . PROPN american_scientific_journal-6910 117 23 2014 2014 NUM american_scientific_journal-6910 117 24 . . PUNCT american_scientific_journal-6910 118 1 [ [ X american_scientific_journal-6910 118 2 3 3 NUM american_scientific_journal-6910 118 3 ] ] PUNCT american_scientific_journal-6910 118 4 . . PUNCT american_scientific_journal-6910 119 1 n. n. PROPN american_scientific_journal-6910 119 2 m. m. PROPN american_scientific_journal-6910 119 3 m. m. PROPN american_scientific_journal-6910 119 4 k. k. PROPN american_scientific_journal-6910 119 5 chowdhury chowdhury PROPN american_scientific_journal-6910 119 6 and and CCONJ american_scientific_journal-6910 119 7 r. r. PROPN american_scientific_journal-6910 119 8 boutaba boutaba PROPN american_scientific_journal-6910 119 9 , , PUNCT american_scientific_journal-6910 119 10 β€œ " PUNCT american_scientific_journal-6910 119 11 a a DET american_scientific_journal-6910 119 12 survey survey NOUN american_scientific_journal-6910 119 13 of of ADP american_scientific_journal-6910 119 14 network network NOUN american_scientific_journal-6910 119 15 virtualization virtualization NOUN american_scientific_journal-6910 119 16 , , PUNCT american_scientific_journal-6910 119 17 ” " PUNCT american_scientific_journal-6910 119 18 computer computer NOUN american_scientific_journal-6910 119 19 networks network NOUN american_scientific_journal-6910 119 20 , , PUNCT american_scientific_journal-6910 119 21 vol vol NOUN american_scientific_journal-6910 119 22 . . PROPN american_scientific_journal-6910 119 23 54 54 NUM american_scientific_journal-6910 119 24 , , PUNCT american_scientific_journal-6910 119 25 no no INTJ american_scientific_journal-6910 119 26 . . NOUN american_scientific_journal-6910 119 27 5 5 NUM american_scientific_journal-6910 119 28 , , PUNCT american_scientific_journal-6910 119 29 apr apr PROPN american_scientific_journal-6910 119 30 . . PROPN american_scientific_journal-6910 119 31 2010 2010 NUM american_scientific_journal-6910 119 32 , , PUNCT american_scientific_journal-6910 119 33 pp pp ADP american_scientific_journal-6910 119 34 . . PUNCT american_scientific_journal-6910 120 1 862–76 862–76 NOUN american_scientific_journal-6910 121 1 [ [ X american_scientific_journal-6910 121 2 4 4 NUM american_scientific_journal-6910 121 3 ] ] PUNCT american_scientific_journal-6910 121 4 . . PUNCT american_scientific_journal-6910 122 1 ngmn ngmn PROPN american_scientific_journal-6910 122 2 alliance alliance PROPN american_scientific_journal-6910 122 3 , , PUNCT american_scientific_journal-6910 122 4 β€œ " PUNCT american_scientific_journal-6910 122 5 description description NOUN american_scientific_journal-6910 122 6 of of ADP american_scientific_journal-6910 122 7 network network NOUN american_scientific_journal-6910 122 8 slicing slice VERB american_scientific_journal-6910 122 9 concept concept NOUN american_scientific_journal-6910 122 10 , , PUNCT american_scientific_journal-6910 122 11 ” " PUNCT american_scientific_journal-6910 122 12 public public NOUN american_scientific_journal-6910 122 13 deliverable deliverable VERB american_scientific_journal-6910 122 14 , , PUNCT american_scientific_journal-6910 122 15 2016 2016 NUM american_scientific_journal-6910 123 1 [ [ X american_scientific_journal-6910 123 2 5 5 NUM american_scientific_journal-6910 123 3 ] ] PUNCT american_scientific_journal-6910 123 4 . . PUNCT american_scientific_journal-6910 124 1 m. m. NOUN american_scientific_journal-6910 124 2 o. o. PROPN american_scientific_journal-6910 124 3 ojijo ojijo PROPN american_scientific_journal-6910 124 4 and and CCONJ american_scientific_journal-6910 124 5 o. o. PROPN american_scientific_journal-6910 124 6 e. e. PROPN american_scientific_journal-6910 124 7 falowo falowo PROPN american_scientific_journal-6910 124 8 , , PUNCT american_scientific_journal-6910 124 9 " " PUNCT american_scientific_journal-6910 124 10 a a DET american_scientific_journal-6910 124 11 survey survey NOUN american_scientific_journal-6910 124 12 on on ADP american_scientific_journal-6910 124 13 slice slice NOUN american_scientific_journal-6910 124 14 admission admission NOUN american_scientific_journal-6910 124 15 control control NOUN american_scientific_journal-6910 124 16 strategies strategy NOUN american_scientific_journal-6910 124 17 and and CCONJ american_scientific_journal-6910 124 18 optimization optimization NOUN american_scientific_journal-6910 124 19 schemes scheme NOUN american_scientific_journal-6910 124 20 in in ADP american_scientific_journal-6910 124 21 5 5 NUM american_scientific_journal-6910 124 22 g g NOUN american_scientific_journal-6910 124 23 network network NOUN american_scientific_journal-6910 124 24 " " PUNCT american_scientific_journal-6910 124 25 , , PUNCT american_scientific_journal-6910 124 26 ieee ieee NOUN american_scientific_journal-6910 124 27 access access NOUN american_scientific_journal-6910 124 28 , , PUNCT american_scientific_journal-6910 124 29 vol vol NOUN american_scientific_journal-6910 124 30 . . PROPN american_scientific_journal-6910 124 31 8 8 NUM american_scientific_journal-6910 124 32 , , PUNCT american_scientific_journal-6910 124 33 pp pp ADJ american_scientific_journal-6910 124 34 . . PUNCT american_scientific_journal-6910 125 1 14977 14977 NUM american_scientific_journal-6910 125 2 - - SYM american_scientific_journal-6910 125 3 14990 14990 NUM american_scientific_journal-6910 125 4 , , PUNCT american_scientific_journal-6910 125 5 2020 2020 NUM american_scientific_journal-6910 125 6 . . PUNCT american_scientific_journal-6910 126 1 [ [ X american_scientific_journal-6910 126 2 6 6 NUM american_scientific_journal-6910 126 3 ] ] PUNCT american_scientific_journal-6910 126 4 . . PUNCT american_scientific_journal-6910 127 1 d. d. PROPN american_scientific_journal-6910 127 2 bega bega PROPN american_scientific_journal-6910 127 3 , , PUNCT american_scientific_journal-6910 127 4 m. m. NOUN american_scientific_journal-6910 127 5 gramaglia gramaglia PROPN american_scientific_journal-6910 127 6 , , PUNCT american_scientific_journal-6910 127 7 a. a. NOUN american_scientific_journal-6910 127 8 banchs banchs PROPN american_scientific_journal-6910 127 9 , , PUNCT american_scientific_journal-6910 127 10 v. v. ADP american_scientific_journal-6910 127 11 sciancalepore sciancalepore PROPN american_scientific_journal-6910 127 12 , , PUNCT american_scientific_journal-6910 127 13 k. k. PROPN american_scientific_journal-6910 127 14 samdanis samdanis PROPN american_scientific_journal-6910 127 15 , , PUNCT american_scientific_journal-6910 127 16 and and CCONJ american_scientific_journal-6910 127 17 x. x. PROPN american_scientific_journal-6910 127 18 costa costa PROPN american_scientific_journal-6910 127 19 - - PUNCT american_scientific_journal-6910 127 20 perez perez PROPN american_scientific_journal-6910 127 21 , , PUNCT american_scientific_journal-6910 127 22 β€˜ ' PUNCT american_scientific_journal-6910 127 23 β€˜ ' PUNCT american_scientific_journal-6910 127 24 optimising optimise VERB american_scientific_journal-6910 127 25 american american ADJ american_scientific_journal-6910 127 26 scientific scientific ADJ american_scientific_journal-6910 127 27 research research NOUN american_scientific_journal-6910 127 28 journal journal NOUN american_scientific_journal-6910 127 29 for for ADP american_scientific_journal-6910 127 30 engineering engineering NOUN american_scientific_journal-6910 127 31 , , PUNCT american_scientific_journal-6910 127 32 technology technology NOUN american_scientific_journal-6910 127 33 , , PUNCT american_scientific_journal-6910 127 34 and and CCONJ american_scientific_journal-6910 127 35 sciences science NOUN american_scientific_journal-6910 127 36 ( ( PUNCT american_scientific_journal-6910 127 37 asrjets asrjet NOUN american_scientific_journal-6910 127 38 ) ) PUNCT american_scientific_journal-6910 127 39 ( ( PUNCT american_scientific_journal-6910 127 40 2021 2021 NUM american_scientific_journal-6910 127 41 ) ) PUNCT american_scientific_journal-6910 127 42 volume volume NOUN american_scientific_journal-6910 127 43 82 82 NUM american_scientific_journal-6910 127 44 , , PUNCT american_scientific_journal-6910 127 45 no no DET american_scientific_journal-6910 127 46 1 1 NUM american_scientific_journal-6910 127 47 , , PUNCT american_scientific_journal-6910 127 48 pp pp ADV american_scientific_journal-6910 127 49 11 11 NUM american_scientific_journal-6910 127 50 - - SYM american_scientific_journal-6910 127 51 18 18 NUM american_scientific_journal-6910 127 52 18 18 NUM american_scientific_journal-6910 127 53 5 5 NUM american_scientific_journal-6910 127 54 g g NOUN american_scientific_journal-6910 127 55 infrastructure infrastructure NOUN american_scientific_journal-6910 127 56 markets market NOUN american_scientific_journal-6910 127 57 : : PUNCT american_scientific_journal-6910 127 58 the the DET american_scientific_journal-6910 127 59 business business NOUN american_scientific_journal-6910 127 60 ofnetwork ofnetwork NOUN american_scientific_journal-6910 127 61 slicing slicing NOUN american_scientific_journal-6910 127 62 , , PUNCT american_scientific_journal-6910 127 63 ’’ ’' PUNCT american_scientific_journal-6910 127 64 inproc inproc NOUN american_scientific_journal-6910 127 65 . . PUNCT american_scientific_journal-6910 128 1 ieee ieee PROPN american_scientific_journal-6910 128 2 infocom infocom PROPN american_scientific_journal-6910 128 3 , , PUNCT american_scientific_journal-6910 128 4 atlanta atlanta PROPN american_scientific_journal-6910 128 5 , , PUNCT american_scientific_journal-6910 128 6 ga ga PROPN american_scientific_journal-6910 128 7 , , PUNCT american_scientific_journal-6910 128 8 usa usa PROPN american_scientific_journal-6910 128 9 , , PUNCT american_scientific_journal-6910 128 10 may may AUX american_scientific_journal-6910 128 11 2017,pp 2017,pp NUM american_scientific_journal-6910 128 12 . . PUNCT american_scientific_journal-6910 129 1 1–9 1–9 NOUN american_scientific_journal-6910 129 2 . . PUNCT american_scientific_journal-6910 130 1 [ [ X american_scientific_journal-6910 130 2 7 7 NUM american_scientific_journal-6910 130 3 ] ] PUNCT american_scientific_journal-6910 130 4 . . PUNCT american_scientific_journal-6910 131 1 r. r. PROPN american_scientific_journal-6910 131 2 s. s. PROPN american_scientific_journal-6910 131 3 sutton sutton PROPN american_scientific_journal-6910 131 4 and and CCONJ american_scientific_journal-6910 131 5 a. a. PROPN american_scientific_journal-6910 131 6 g. g. PROPN american_scientific_journal-6910 131 7 barto barto PROPN american_scientific_journal-6910 131 8 , , PUNCT american_scientific_journal-6910 131 9 reinforcement reinforcement NOUN american_scientific_journal-6910 131 10 learning learning NOUN american_scientific_journal-6910 131 11 : : PUNCT american_scientific_journal-6910 131 12 an an DET american_scientific_journal-6910 131 13 introduction introduction NOUN american_scientific_journal-6910 131 14 . . PUNCT american_scientific_journal-6910 132 1 mit mit PROPN american_scientific_journal-6910 132 2 press press PROPN american_scientific_journal-6910 132 3 cambridge cambridge PROPN american_scientific_journal-6910 132 4 , , PUNCT american_scientific_journal-6910 132 5 1998 1998 NUM american_scientific_journal-6910 132 6 . . PUNCT american_scientific_journal-6910 133 1 [ [ X american_scientific_journal-6910 133 2 8 8 NUM american_scientific_journal-6910 133 3 ] ] PUNCT american_scientific_journal-6910 133 4 . . PUNCT american_scientific_journal-6910 134 1 r. r. PROPN american_scientific_journal-6910 134 2 bellman bellman PROPN american_scientific_journal-6910 134 3 , , PUNCT american_scientific_journal-6910 134 4 β€œ " PUNCT american_scientific_journal-6910 134 5 a a DET american_scientific_journal-6910 134 6 markovian markovian ADJ american_scientific_journal-6910 134 7 decision decision NOUN american_scientific_journal-6910 134 8 process process NOUN american_scientific_journal-6910 134 9 , , PUNCT american_scientific_journal-6910 134 10 ” " PUNCT american_scientific_journal-6910 134 11 dtic dtic ADJ american_scientific_journal-6910 134 12 , , PUNCT american_scientific_journal-6910 134 13 tech tech NOUN american_scientific_journal-6910 134 14 . . PUNCT american_scientific_journal-6910 135 1 rep rep PROPN american_scientific_journal-6910 135 2 . . PROPN american_scientific_journal-6910 135 3 , , PUNCT american_scientific_journal-6910 135 4 1957 1957 NUM american_scientific_journal-6910 135 5 . . PUNCT american_scientific_journal-6910 136 1 [ [ X american_scientific_journal-6910 136 2 9 9 NUM american_scientific_journal-6910 136 3 ] ] PUNCT american_scientific_journal-6910 136 4 . . PUNCT american_scientific_journal-6910 137 1 t. t. PROPN american_scientific_journal-6910 137 2 mitchell mitchell PROPN american_scientific_journal-6910 137 3 . . PUNCT american_scientific_journal-6910 138 1 machine machine PROPN american_scientific_journal-6910 138 2 learning learning PROPN american_scientific_journal-6910 138 3 , , PUNCT american_scientific_journal-6910 138 4 mcgraw mcgraw PROPN american_scientific_journal-6910 138 5 - - PUNCT american_scientific_journal-6910 138 6 hill hill NOUN american_scientific_journal-6910 138 7 , , PUNCT american_scientific_journal-6910 138 8 1997 1997 NUM american_scientific_journal-6910 138 9 . . PUNCT american_scientific_journal-6910 139 1 [ [ X american_scientific_journal-6910 139 2 10 10 NUM american_scientific_journal-6910 139 3 ] ] PUNCT american_scientific_journal-6910 139 4 . . PUNCT american_scientific_journal-6910 140 1 e. e. PROPN american_scientific_journal-6910 140 2 even even ADV american_scientific_journal-6910 140 3 - - PUNCT american_scientific_journal-6910 140 4 dar dar PROPN american_scientific_journal-6910 140 5 and and CCONJ american_scientific_journal-6910 140 6 y. y. PROPN american_scientific_journal-6910 140 7 mansour mansour PROPN american_scientific_journal-6910 140 8 , , PUNCT american_scientific_journal-6910 140 9 β€œ " PUNCT american_scientific_journal-6910 140 10 learning learn VERB american_scientific_journal-6910 140 11 rates rate NOUN american_scientific_journal-6910 140 12 for for ADP american_scientific_journal-6910 140 13 q q NOUN american_scientific_journal-6910 140 14 - - PUNCT american_scientific_journal-6910 140 15 learning learning NOUN american_scientific_journal-6910 140 16 , , PUNCT american_scientific_journal-6910 140 17 ” " PUNCT american_scientific_journal-6910 140 18 journal journal NOUN american_scientific_journal-6910 140 19 of of ADP american_scientific_journal-6910 140 20 machine machine NOUN american_scientific_journal-6910 140 21 learning learn VERB american_scientific_journal-6910 140 22 research research NOUN american_scientific_journal-6910 140 23 , , PUNCT american_scientific_journal-6910 140 24 vol vol NOUN american_scientific_journal-6910 140 25 . . PROPN american_scientific_journal-6910 140 26 5 5 NUM american_scientific_journal-6910 140 27 , , PUNCT american_scientific_journal-6910 140 28 pp pp ADJ american_scientific_journal-6910 140 29 . . PUNCT american_scientific_journal-6910 141 1 1–25 1–25 ADJ american_scientific_journal-6910 141 2 , , PUNCT american_scientific_journal-6910 141 3 dec dec PROPN american_scientific_journal-6910 141 4 . . PROPN american_scientific_journal-6910 141 5 2003 2003 NUM american_scientific_journal-6910 141 6 . . PUNCT