id sid tid token lemma pos fcis-5211 1 1 frontiers frontier NOUN fcis-5211 1 2 in in ADP fcis-5211 1 3 computing computing NOUN fcis-5211 1 4 and and CCONJ fcis-5211 1 5 intelligent intelligent ADJ fcis-5211 1 6 systems system NOUN fcis-5211 1 7 issn issn VERB fcis-5211 1 8 : : PUNCT fcis-5211 1 9 2832 2832 NUM fcis-5211 1 10 - - SYM fcis-5211 1 11 6024 6024 NUM fcis-5211 1 12 | | NOUN fcis-5211 1 13 vol vol NOUN fcis-5211 1 14 . . PROPN fcis-5211 2 1 2 2 NUM fcis-5211 2 2 , , PUNCT fcis-5211 2 3 no no INTJ fcis-5211 2 4 . . NOUN fcis-5211 2 5 3 3 NUM fcis-5211 2 6 , , PUNCT fcis-5211 2 7 2022 2022 NUM fcis-5211 2 8 48 48 NUM fcis-5211 2 9 a a DET fcis-5211 2 10 vehicle vehicle NOUN fcis-5211 2 11 service service NOUN fcis-5211 2 12 migration migration NOUN fcis-5211 2 13 strategy strategy NOUN fcis-5211 2 14 algorithm algorithm NOUN fcis-5211 2 15 in in ADP fcis-5211 2 16 5 5 NUM fcis-5211 2 17 g g NOUN fcis-5211 2 18 nr nr NOUN fcis-5211 2 19 - - PUNCT fcis-5211 2 20 v2x v2x VERB fcis-5211 2 21 lv lv PROPN fcis-5211 2 22 zhou zhou PROPN fcis-5211 2 23 * * PUNCT fcis-5211 2 24 school school NOUN fcis-5211 2 25 of of ADP fcis-5211 2 26 optical optical ADJ fcis-5211 2 27 - - PUNCT fcis-5211 2 28 electrical electrical ADJ fcis-5211 2 29 and and CCONJ fcis-5211 2 30 computer computer NOUN fcis-5211 2 31 engineering engineering NOUN fcis-5211 2 32 , , PUNCT fcis-5211 2 33 university university NOUN fcis-5211 2 34 of of ADP fcis-5211 2 35 shanghai shanghai PROPN fcis-5211 2 36 for for ADP fcis-5211 2 37 science science NOUN fcis-5211 2 38 and and CCONJ fcis-5211 2 39 technology technology NOUN fcis-5211 2 40 , , PUNCT fcis-5211 2 41 shanghai shanghai PROPN fcis-5211 2 42 200093 200093 NUM fcis-5211 2 43 , , PUNCT fcis-5211 2 44 china china PROPN fcis-5211 2 45 * * PUNCT fcis-5211 2 46 corresponding correspond VERB fcis-5211 2 47 author author NOUN fcis-5211 2 48 : : PUNCT fcis-5211 2 49 email email NOUN fcis-5211 2 50 : : PUNCT fcis-5211 2 51 zhoulv2012@hotmail.com zhoulv2012@hotmail.com X fcis-5211 3 1 abstract abstract ADJ fcis-5211 3 2 : : PUNCT fcis-5211 3 3 in in ADP fcis-5211 3 4 recent recent ADJ fcis-5211 3 5 years year NOUN fcis-5211 3 6 , , PUNCT fcis-5211 3 7 a a DET fcis-5211 3 8 new new ADJ fcis-5211 3 9 technology technology NOUN fcis-5211 3 10 called call VERB fcis-5211 3 11 mobile mobile ADJ fcis-5211 3 12 edge edge NOUN fcis-5211 3 13 computing computing NOUN fcis-5211 3 14 ( ( PUNCT fcis-5211 3 15 mec mec PROPN fcis-5211 3 16 ) ) PUNCT fcis-5211 3 17 is be AUX fcis-5211 3 18 proposed propose VERB fcis-5211 3 19 to to PART fcis-5211 3 20 alleviate alleviate VERB fcis-5211 3 21 mobile mobile ADJ fcis-5211 3 22 devices device NOUN fcis-5211 3 23 ’ ' PUNCT fcis-5211 3 24 increasing increase VERB fcis-5211 3 25 demands demand NOUN fcis-5211 3 26 on on ADP fcis-5211 3 27 computing compute VERB fcis-5211 3 28 resources resource NOUN fcis-5211 3 29 and and CCONJ fcis-5211 3 30 service service NOUN fcis-5211 3 31 latency latency NOUN fcis-5211 3 32 . . PUNCT fcis-5211 4 1 however however ADV fcis-5211 4 2 , , PUNCT fcis-5211 4 3 users user NOUN fcis-5211 4 4 may may AUX fcis-5211 4 5 stay stay VERB fcis-5211 4 6 away away ADV fcis-5211 4 7 from from ADP fcis-5211 4 8 the the DET fcis-5211 4 9 fixed fixed ADJ fcis-5211 4 10 mec mec PROPN fcis-5211 4 11 server server NOUN fcis-5211 4 12 or or CCONJ fcis-5211 4 13 even even ADV fcis-5211 4 14 leave leave VERB fcis-5211 4 15 the the DET fcis-5211 4 16 service service NOUN fcis-5211 4 17 scope scope NOUN fcis-5211 4 18 of of ADP fcis-5211 4 19 the the DET fcis-5211 4 20 mec mec PROPN fcis-5211 4 21 server server NOUN fcis-5211 4 22 during during ADP fcis-5211 4 23 the the DET fcis-5211 4 24 mobile mobile ADJ fcis-5211 4 25 process process NOUN fcis-5211 4 26 , , PUNCT fcis-5211 4 27 which which PRON fcis-5211 4 28 will will AUX fcis-5211 4 29 lead lead VERB fcis-5211 4 30 to to ADP fcis-5211 4 31 service service NOUN fcis-5211 4 32 performance performance NOUN fcis-5211 4 33 degradation degradation NOUN fcis-5211 4 34 or or CCONJ fcis-5211 4 35 service service NOUN fcis-5211 4 36 interruption interruption NOUN fcis-5211 4 37 . . PUNCT fcis-5211 5 1 such such DET fcis-5211 5 2 an an DET fcis-5211 5 3 interruption interruption NOUN fcis-5211 5 4 is be AUX fcis-5211 5 5 intolerable intolerable ADJ fcis-5211 5 6 for for ADP fcis-5211 5 7 vehicle vehicle NOUN fcis-5211 5 8 in in ADP fcis-5211 5 9 v2x v2x NOUN fcis-5211 5 10 . . PUNCT fcis-5211 6 1 therefore therefore ADV fcis-5211 6 2 , , PUNCT fcis-5211 6 3 it it PRON fcis-5211 6 4 is be AUX fcis-5211 6 5 necessary necessary ADJ fcis-5211 6 6 to to PART fcis-5211 6 7 consider consider VERB fcis-5211 6 8 the the DET fcis-5211 6 9 issue issue NOUN fcis-5211 6 10 of of ADP fcis-5211 6 11 service service NOUN fcis-5211 6 12 migration migration NOUN fcis-5211 6 13 . . PUNCT fcis-5211 7 1 in in ADP fcis-5211 7 2 this this DET fcis-5211 7 3 paper paper NOUN fcis-5211 7 4 , , PUNCT fcis-5211 7 5 we we PRON fcis-5211 7 6 model model VERB fcis-5211 7 7 the the DET fcis-5211 7 8 service service NOUN fcis-5211 7 9 migration migration NOUN fcis-5211 7 10 problem problem NOUN fcis-5211 7 11 in in ADP fcis-5211 7 12 v2x v2x NOUN fcis-5211 7 13 as as ADP fcis-5211 7 14 a a DET fcis-5211 7 15 multidimensional multidimensional ADJ fcis-5211 7 16 markov markov NOUN fcis-5211 7 17 decision decision NOUN fcis-5211 7 18 process process NOUN fcis-5211 7 19 problem problem NOUN fcis-5211 7 20 and and CCONJ fcis-5211 7 21 consider consider VERB fcis-5211 7 22 a a DET fcis-5211 7 23 variety variety NOUN fcis-5211 7 24 of of ADP fcis-5211 7 25 metrics metric NOUN fcis-5211 7 26 including include VERB fcis-5211 7 27 computing compute VERB fcis-5211 7 28 cost cost NOUN fcis-5211 7 29 , , PUNCT fcis-5211 7 30 migration migration NOUN fcis-5211 7 31 cost cost NOUN fcis-5211 7 32 and and CCONJ fcis-5211 7 33 energy energy NOUN fcis-5211 7 34 consumption consumption NOUN fcis-5211 7 35 . . PUNCT fcis-5211 8 1 a a DET fcis-5211 8 2 novel novel ADJ fcis-5211 8 3 user user NOUN fcis-5211 8 4 mobility mobility NOUN fcis-5211 8 5 model model NOUN fcis-5211 8 6 is be AUX fcis-5211 8 7 also also ADV fcis-5211 8 8 considered consider VERB fcis-5211 8 9 to to PART fcis-5211 8 10 accurately accurately ADV fcis-5211 8 11 reflect reflect VERB fcis-5211 8 12 the the DET fcis-5211 8 13 motion motion NOUN fcis-5211 8 14 state state NOUN fcis-5211 8 15 of of ADP fcis-5211 8 16 users user NOUN fcis-5211 8 17 in in ADP fcis-5211 8 18 reality reality NOUN fcis-5211 8 19 . . PUNCT fcis-5211 9 1 then then ADV fcis-5211 9 2 , , PUNCT fcis-5211 9 3 a a DET fcis-5211 9 4 novel novel ADJ fcis-5211 9 5 service service NOUN fcis-5211 9 6 migration migration NOUN fcis-5211 9 7 algorithm algorithm NOUN fcis-5211 9 8 is be AUX fcis-5211 9 9 proposed propose VERB fcis-5211 9 10 to to PART fcis-5211 9 11 solve solve VERB fcis-5211 9 12 this this DET fcis-5211 9 13 multidimensional multidimensional ADJ fcis-5211 9 14 mdp mdp NOUN fcis-5211 9 15 problem problem NOUN fcis-5211 9 16 . . PUNCT fcis-5211 10 1 our our PRON fcis-5211 10 2 proposed propose VERB fcis-5211 10 3 algorithm algorithm NOUN fcis-5211 10 4 applies apply VERB fcis-5211 10 5 actor actor NOUN fcis-5211 10 6 - - PUNCT fcis-5211 10 7 critic critic NOUN fcis-5211 10 8 and and CCONJ fcis-5211 10 9 entropy entropy NOUN fcis-5211 10 10 to to PART fcis-5211 10 11 ensure ensure VERB fcis-5211 10 12 both both DET fcis-5211 10 13 convergence convergence NOUN fcis-5211 10 14 and and CCONJ fcis-5211 10 15 exportability exportability NOUN fcis-5211 10 16 . . PUNCT fcis-5211 11 1 experimental experimental ADJ fcis-5211 11 2 results result NOUN fcis-5211 11 3 show show VERB fcis-5211 11 4 that that SCONJ fcis-5211 11 5 our our PRON fcis-5211 11 6 proposed propose VERB fcis-5211 11 7 algorithm algorithm NOUN fcis-5211 11 8 outperforms outperform VERB fcis-5211 11 9 the the DET fcis-5211 11 10 baselines baseline NOUN fcis-5211 11 11 and and CCONJ fcis-5211 11 12 has have VERB fcis-5211 11 13 relatively relatively ADV fcis-5211 11 14 strong strong ADJ fcis-5211 11 15 robustness robustness NOUN fcis-5211 11 16 . . PUNCT fcis-5211 12 1 keywords keyword NOUN fcis-5211 12 2 : : PUNCT fcis-5211 12 3 mobile mobile ADJ fcis-5211 12 4 edge edge NOUN fcis-5211 12 5 computing computing NOUN fcis-5211 12 6 ; ; PUNCT fcis-5211 12 7 vehicle vehicle NOUN fcis-5211 12 8 edge edge NOUN fcis-5211 12 9 computing computing NOUN fcis-5211 12 10 ; ; PUNCT fcis-5211 12 11 service service NOUN fcis-5211 12 12 migration migration NOUN fcis-5211 12 13 ; ; PUNCT fcis-5211 12 14 markov markov NOUN fcis-5211 12 15 decision decision NOUN fcis-5211 12 16 process process NOUN fcis-5211 12 17 ; ; PUNCT fcis-5211 12 18 delay delay NOUN fcis-5211 12 19 ; ; PUNCT fcis-5211 12 20 energy energy NOUN fcis-5211 12 21 consumption consumption NOUN fcis-5211 12 22 ; ; PUNCT fcis-5211 12 23 deep deep ADJ fcis-5211 12 24 reinforcement reinforcement NOUN fcis-5211 12 25 learning learning NOUN fcis-5211 12 26 . . PUNCT fcis-5211 13 1 1 1 X fcis-5211 13 2 . . X fcis-5211 13 3 introduction introduction NOUN fcis-5211 13 4 in in ADP fcis-5211 13 5 recent recent ADJ fcis-5211 13 6 years year NOUN fcis-5211 13 7 , , PUNCT fcis-5211 13 8 with with ADP fcis-5211 13 9 the the DET fcis-5211 13 10 rapid rapid ADJ fcis-5211 13 11 development development NOUN fcis-5211 13 12 of of ADP fcis-5211 13 13 the the DET fcis-5211 13 14 internet internet NOUN fcis-5211 13 15 of of ADP fcis-5211 13 16 vehicles vehicle NOUN fcis-5211 13 17 ( ( PUNCT fcis-5211 13 18 iov iov PROPN fcis-5211 13 19 ) ) PUNCT fcis-5211 13 20 and and CCONJ fcis-5211 13 21 the the DET fcis-5211 13 22 continuous continuous ADJ fcis-5211 13 23 improvement improvement NOUN fcis-5211 13 24 of of ADP fcis-5211 13 25 network network NOUN fcis-5211 13 26 infrastructure infrastructure NOUN fcis-5211 13 27 , , PUNCT fcis-5211 13 28 vehicle vehicle NOUN fcis-5211 13 29 - - PUNCT fcis-5211 13 30 to to ADP fcis-5211 13 31 - - PUNCT fcis-5211 13 32 everything everything PRON fcis-5211 13 33 ( ( PUNCT fcis-5211 13 34 v2x v2x NOUN fcis-5211 13 35 ) ) PUNCT fcis-5211 13 36 applications application NOUN fcis-5211 13 37 ( ( PUNCT fcis-5211 13 38 e.g. e.g. ADV fcis-5211 13 39 , , PUNCT fcis-5211 13 40 autonomous autonomous ADJ fcis-5211 13 41 driving driving NOUN fcis-5211 13 42 and and CCONJ fcis-5211 13 43 real real ADJ fcis-5211 13 44 - - PUNCT fcis-5211 13 45 time time NOUN fcis-5211 13 46 traffic traffic NOUN fcis-5211 13 47 monitoring monitoring NOUN fcis-5211 13 48 , , PUNCT fcis-5211 13 49 etc etc X fcis-5211 13 50 . . X fcis-5211 13 51 ) ) PUNCT fcis-5211 13 52 are be AUX fcis-5211 13 53 gradually gradually ADV fcis-5211 13 54 appearing appear VERB fcis-5211 13 55 in in ADP fcis-5211 13 56 the the DET fcis-5211 13 57 public public ADJ fcis-5211 13 58 eye eye NOUN fcis-5211 13 59 , , PUNCT fcis-5211 13 60 providing provide VERB fcis-5211 13 61 many many ADJ fcis-5211 13 62 convenient convenient ADJ fcis-5211 13 63 aspects aspect NOUN fcis-5211 13 64 for for ADP fcis-5211 13 65 driving drive VERB fcis-5211 13 66 . . PUNCT fcis-5211 14 1 meanwhile meanwhile ADV fcis-5211 14 2 , , PUNCT fcis-5211 14 3 a a DET fcis-5211 14 4 new new ADJ fcis-5211 14 5 technology technology NOUN fcis-5211 14 6 called call VERB fcis-5211 14 7 mobile mobile ADJ fcis-5211 14 8 edge edge NOUN fcis-5211 14 9 computing computing NOUN fcis-5211 14 10 ( ( PUNCT fcis-5211 14 11 mec mec PROPN fcis-5211 14 12 ) ) PUNCT fcis-5211 14 13 has have AUX fcis-5211 14 14 been be AUX fcis-5211 14 15 proposed propose VERB fcis-5211 14 16 to to PART fcis-5211 14 17 meet meet VERB fcis-5211 14 18 these these DET fcis-5211 14 19 demands demand NOUN fcis-5211 14 20 due due ADP fcis-5211 14 21 to to ADP fcis-5211 14 22 the the DET fcis-5211 14 23 increasing increase VERB fcis-5211 14 24 requirements requirement NOUN fcis-5211 14 25 of of ADP fcis-5211 14 26 vehicles vehicle NOUN fcis-5211 14 27 for for ADP fcis-5211 14 28 computing compute VERB fcis-5211 14 29 resources resource NOUN fcis-5211 14 30 and and CCONJ fcis-5211 14 31 service service NOUN fcis-5211 14 32 latency latency NOUN fcis-5211 14 33 . . PUNCT fcis-5211 15 1 mec mec PROPN fcis-5211 15 2 servers server NOUN fcis-5211 15 3 are be AUX fcis-5211 15 4 micro micro ADJ fcis-5211 15 5 edge edge NOUN fcis-5211 15 6 clouds cloud NOUN fcis-5211 15 7 deployed deploy VERB fcis-5211 15 8 in in ADP fcis-5211 15 9 mobile mobile ADJ fcis-5211 15 10 networks network NOUN fcis-5211 15 11 . . PUNCT fcis-5211 16 1 vehicles vehicle NOUN fcis-5211 16 2 connect connect VERB fcis-5211 16 3 to to ADP fcis-5211 16 4 roadside roadside NOUN fcis-5211 16 5 units unit NOUN fcis-5211 16 6 ( ( PUNCT fcis-5211 16 7 rsus rsus NOUN fcis-5211 16 8 ) ) PUNCT fcis-5211 16 9 equipped equip VERB fcis-5211 16 10 with with ADP fcis-5211 16 11 mec mec PROPN fcis-5211 16 12 servers server NOUN fcis-5211 16 13 , , PUNCT fcis-5211 16 14 and and CCONJ fcis-5211 16 15 enjoy enjoy VERB fcis-5211 16 16 the the DET fcis-5211 16 17 convenience convenience NOUN fcis-5211 16 18 of of ADP fcis-5211 16 19 low low ADJ fcis-5211 16 20 latency latency NOUN fcis-5211 16 21 , , PUNCT fcis-5211 16 22 high high ADJ fcis-5211 16 23 bandwidth bandwidth NOUN fcis-5211 16 24 , , PUNCT fcis-5211 16 25 and and CCONJ fcis-5211 16 26 sufficient sufficient ADJ fcis-5211 16 27 computing computing NOUN fcis-5211 16 28 resources resource NOUN fcis-5211 16 29 . . PUNCT fcis-5211 17 1 however however ADV fcis-5211 17 2 , , PUNCT fcis-5211 17 3 the the DET fcis-5211 17 4 vehicle vehicle NOUN fcis-5211 17 5 may may AUX fcis-5211 17 6 move move VERB fcis-5211 17 7 away away ADV fcis-5211 17 8 from from ADP fcis-5211 17 9 the the DET fcis-5211 17 10 roadside roadside NOUN fcis-5211 17 11 unit unit NOUN fcis-5211 17 12 or or CCONJ fcis-5211 17 13 even even ADV fcis-5211 17 14 out out ADP fcis-5211 17 15 of of ADP fcis-5211 17 16 the the DET fcis-5211 17 17 service service NOUN fcis-5211 17 18 range range NOUN fcis-5211 17 19 of of ADP fcis-5211 17 20 the the DET fcis-5211 17 21 roadside roadside NOUN fcis-5211 17 22 unit unit NOUN fcis-5211 17 23 during during ADP fcis-5211 17 24 its its PRON fcis-5211 17 25 driving driving NOUN fcis-5211 17 26 movement movement NOUN fcis-5211 17 27 , , PUNCT fcis-5211 17 28 which which PRON fcis-5211 17 29 will will AUX fcis-5211 17 30 result result VERB fcis-5211 17 31 in in ADP fcis-5211 17 32 degraded degraded ADJ fcis-5211 17 33 service service NOUN fcis-5211 17 34 performance performance NOUN fcis-5211 17 35 or or CCONJ fcis-5211 17 36 service service NOUN fcis-5211 17 37 interruption interruption NOUN fcis-5211 17 38 . . PUNCT fcis-5211 18 1 especially especially ADV fcis-5211 18 2 in in ADP fcis-5211 18 3 some some DET fcis-5211 18 4 services service NOUN fcis-5211 18 5 that that PRON fcis-5211 18 6 are be AUX fcis-5211 18 7 highly highly ADV fcis-5211 18 8 sensitive sensitive ADJ fcis-5211 18 9 to to ADP fcis-5211 18 10 latency latency NOUN fcis-5211 18 11 , , PUNCT fcis-5211 18 12 such such ADJ fcis-5211 18 13 as as ADP fcis-5211 18 14 autonomous autonomous ADJ fcis-5211 18 15 driving driving NOUN fcis-5211 18 16 and and CCONJ fcis-5211 18 17 road road NOUN fcis-5211 18 18 condition condition NOUN fcis-5211 18 19 recognition recognition NOUN fcis-5211 18 20 , , PUNCT fcis-5211 18 21 such such ADJ fcis-5211 18 22 service service NOUN fcis-5211 18 23 interruptions interruption NOUN fcis-5211 18 24 can can AUX fcis-5211 18 25 affect affect VERB fcis-5211 18 26 the the DET fcis-5211 18 27 user user NOUN fcis-5211 18 28 experience experience NOUN fcis-5211 18 29 . . PUNCT fcis-5211 19 1 thus thus ADV fcis-5211 19 2 , , PUNCT fcis-5211 19 3 a a DET fcis-5211 19 4 model model NOUN fcis-5211 19 5 of of ADP fcis-5211 19 6 service service NOUN fcis-5211 19 7 migration migration NOUN fcis-5211 19 8 and and CCONJ fcis-5211 19 9 an an DET fcis-5211 19 10 optimized optimize VERB fcis-5211 19 11 solution solution NOUN fcis-5211 19 12 need need VERB fcis-5211 19 13 to to PART fcis-5211 19 14 be be AUX fcis-5211 19 15 explored explore VERB fcis-5211 19 16 . . PUNCT fcis-5211 20 1 service service NOUN fcis-5211 20 2 migration migration NOUN fcis-5211 20 3 under under ADP fcis-5211 20 4 v2x v2x NOUN fcis-5211 20 5 has have AUX fcis-5211 20 6 been be AUX fcis-5211 20 7 a a DET fcis-5211 20 8 topic topic NOUN fcis-5211 20 9 in in ADP fcis-5211 20 10 recent recent ADJ fcis-5211 20 11 years year NOUN fcis-5211 20 12 and and CCONJ fcis-5211 20 13 a a DET fcis-5211 20 14 lot lot NOUN fcis-5211 20 15 of of ADP fcis-5211 20 16 important important ADJ fcis-5211 20 17 work work NOUN fcis-5211 20 18 has have AUX fcis-5211 20 19 been be AUX fcis-5211 20 20 carried carry VERB fcis-5211 20 21 out out ADP fcis-5211 20 22 by by ADP fcis-5211 20 23 many many ADJ fcis-5211 20 24 researchers researcher NOUN fcis-5211 20 25 in in ADP fcis-5211 20 26 this this DET fcis-5211 20 27 area area NOUN fcis-5211 20 28 . . PUNCT fcis-5211 21 1 proposes propose VERB fcis-5211 21 2 a a DET fcis-5211 21 3 task task NOUN fcis-5211 21 4 offloading offload VERB fcis-5211 21 5 scheme scheme NOUN fcis-5211 21 6 to to PART fcis-5211 21 7 minimize minimize VERB fcis-5211 21 8 the the DET fcis-5211 21 9 total total ADJ fcis-5211 21 10 energy energy NOUN fcis-5211 21 11 consumption consumption NOUN fcis-5211 21 12 of of ADP fcis-5211 21 13 mobile mobile ADJ fcis-5211 21 14 devices device NOUN fcis-5211 21 15 and and CCONJ fcis-5211 21 16 edge edge NOUN fcis-5211 21 17 servers server NOUN fcis-5211 21 18 , , PUNCT fcis-5211 21 19 which which PRON fcis-5211 21 20 the the DET fcis-5211 21 21 authors author NOUN fcis-5211 21 22 solve solve VERB fcis-5211 21 23 by by ADP fcis-5211 21 24 a a DET fcis-5211 21 25 hybrid hybrid ADJ fcis-5211 21 26 metaheuristic metaheuristic ADJ fcis-5211 21 27 algorithm algorithm NOUN fcis-5211 21 28 that that PRON fcis-5211 21 29 yields yield VERB fcis-5211 21 30 a a DET fcis-5211 21 31 near near ADV fcis-5211 21 32 - - PUNCT fcis-5211 21 33 optimal optimal ADJ fcis-5211 21 34 solution solution NOUN fcis-5211 21 35 . . PUNCT fcis-5211 22 1 formulates formulate VERB fcis-5211 22 2 the the DET fcis-5211 22 3 stochastic stochastic ADJ fcis-5211 22 4 task task NOUN fcis-5211 22 5 offloading offload VERB fcis-5211 22 6 problem problem NOUN fcis-5211 22 7 in in ADP fcis-5211 22 8 a a DET fcis-5211 22 9 piecewise piecewise NOUN fcis-5211 22 10 wireless wireless NOUN fcis-5211 22 11 access access NOUN fcis-5211 22 12 network network NOUN fcis-5211 22 13 as as ADP fcis-5211 22 14 a a DET fcis-5211 22 15 markov markov NOUN fcis-5211 22 16 decision decision NOUN fcis-5211 22 17 process process NOUN fcis-5211 22 18 that that PRON fcis-5211 22 19 maximizes maximize VERB fcis-5211 22 20 long long ADJ fcis-5211 22 21 - - PUNCT fcis-5211 22 22 term term NOUN fcis-5211 22 23 utility utility NOUN fcis-5211 22 24 performance performance NOUN fcis-5211 22 25 by by ADP fcis-5211 22 26 considering consider VERB fcis-5211 22 27 time time NOUN fcis-5211 22 28 - - PUNCT fcis-5211 22 29 varying vary VERB fcis-5211 22 30 communication communication NOUN fcis-5211 22 31 quality quality NOUN fcis-5211 22 32 and and CCONJ fcis-5211 22 33 computing computing NOUN fcis-5211 22 34 resources resource NOUN fcis-5211 22 35 . . PUNCT fcis-5211 23 1 however however ADV fcis-5211 23 2 , , PUNCT fcis-5211 23 3 the the DET fcis-5211 23 4 above above ADJ fcis-5211 23 5 work work NOUN fcis-5211 23 6 can can AUX fcis-5211 23 7 not not PART fcis-5211 23 8 be be AUX fcis-5211 23 9 directly directly ADV fcis-5211 23 10 applied apply VERB fcis-5211 23 11 to to ADP fcis-5211 23 12 extremely extremely ADV fcis-5211 23 13 dynamic dynamic ADJ fcis-5211 23 14 vehicular vehicular ADJ fcis-5211 23 15 networks network NOUN fcis-5211 23 16 . . PUNCT fcis-5211 24 1 the the DET fcis-5211 24 2 follow follow NOUN fcis-5211 24 3 - - PUNCT fcis-5211 24 4 me i PRON fcis-5211 24 5 chain chain NOUN fcis-5211 24 6 algorithm algorithm NOUN fcis-5211 24 7 was be AUX fcis-5211 24 8 proposed propose VERB fcis-5211 24 9 in in ADP fcis-5211 24 10 the the DET fcis-5211 24 11 literature literature NOUN fcis-5211 24 12 to to PART fcis-5211 24 13 solve solve VERB fcis-5211 24 14 the the DET fcis-5211 24 15 service service NOUN fcis-5211 24 16 function function NOUN fcis-5211 24 17 chain chain NOUN fcis-5211 24 18 ( ( PUNCT fcis-5211 24 19 sfc sfc NOUN fcis-5211 24 20 ) ) PUNCT fcis-5211 24 21 problem problem NOUN fcis-5211 24 22 . . PUNCT fcis-5211 25 1 in in ADP fcis-5211 25 2 , , PUNCT fcis-5211 25 3 the the DET fcis-5211 25 4 authors author NOUN fcis-5211 25 5 propose propose VERB fcis-5211 25 6 a a DET fcis-5211 25 7 reinforcement reinforcement NOUN fcis-5211 25 8 learning learning NOUN fcis-5211 25 9 - - PUNCT fcis-5211 25 10 based base VERB fcis-5211 25 11 solution solution NOUN fcis-5211 25 12 for for ADP fcis-5211 25 13 offline offline ADJ fcis-5211 25 14 ran run VERB fcis-5211 25 15 slicing slice VERB fcis-5211 25 16 and and CCONJ fcis-5211 25 17 a a DET fcis-5211 25 18 low low ADJ fcis-5211 25 19 - - PUNCT fcis-5211 25 20 complexity complexity NOUN fcis-5211 25 21 heuristic heuristic ADJ fcis-5211 25 22 algorithm algorithm NOUN fcis-5211 25 23 to to PART fcis-5211 25 24 meet meet VERB fcis-5211 25 25 the the DET fcis-5211 25 26 communication communication NOUN fcis-5211 25 27 resource resource NOUN fcis-5211 25 28 requirements requirement NOUN fcis-5211 25 29 of of ADP fcis-5211 25 30 different different ADJ fcis-5211 25 31 slices slice NOUN fcis-5211 25 32 , , PUNCT fcis-5211 25 33 enabling enable VERB fcis-5211 25 34 maximum maximum ADJ fcis-5211 25 35 resource resource NOUN fcis-5211 25 36 utilization utilization NOUN fcis-5211 25 37 . . PUNCT fcis-5211 26 1 although although SCONJ fcis-5211 26 2 the the DET fcis-5211 26 3 existing exist VERB fcis-5211 26 4 work work NOUN fcis-5211 26 5 has have AUX fcis-5211 26 6 made make VERB fcis-5211 26 7 great great ADJ fcis-5211 26 8 progress progress NOUN fcis-5211 26 9 in in ADP fcis-5211 26 10 terms term NOUN fcis-5211 26 11 of of ADP fcis-5211 26 12 service service NOUN fcis-5211 26 13 migration migration NOUN fcis-5211 26 14 strategies strategy NOUN fcis-5211 26 15 , , PUNCT fcis-5211 26 16 there there PRON fcis-5211 26 17 are be VERB fcis-5211 26 18 still still ADV fcis-5211 26 19 some some DET fcis-5211 26 20 issues issue NOUN fcis-5211 26 21 that that PRON fcis-5211 26 22 need need VERB fcis-5211 26 23 to to PART fcis-5211 26 24 be be AUX fcis-5211 26 25 further far ADV fcis-5211 26 26 explored explore VERB fcis-5211 26 27 including include VERB fcis-5211 26 28 several several ADJ fcis-5211 26 29 costs cost NOUN fcis-5211 26 30 . . PUNCT fcis-5211 27 1 all all PRON fcis-5211 27 2 of of ADP fcis-5211 27 3 these these DET fcis-5211 27 4 impact impact NOUN fcis-5211 27 5 factors factor NOUN fcis-5211 27 6 need need VERB fcis-5211 27 7 to to PART fcis-5211 27 8 be be AUX fcis-5211 27 9 taken take VERB fcis-5211 27 10 into into ADP fcis-5211 27 11 account account NOUN fcis-5211 27 12 to to PART fcis-5211 27 13 fully fully ADV fcis-5211 27 14 evaluate evaluate VERB fcis-5211 27 15 the the DET fcis-5211 27 16 effects effect NOUN fcis-5211 27 17 of of ADP fcis-5211 27 18 migration migration NOUN fcis-5211 27 19 . . PUNCT fcis-5211 28 1 more more ADV fcis-5211 28 2 importantly importantly ADV fcis-5211 28 3 , , PUNCT fcis-5211 28 4 we we PRON fcis-5211 28 5 should should AUX fcis-5211 28 6 consider consider VERB fcis-5211 28 7 the the DET fcis-5211 28 8 long long ADJ fcis-5211 28 9 - - PUNCT fcis-5211 28 10 term term NOUN fcis-5211 28 11 cumulative cumulative ADJ fcis-5211 28 12 payback payback NOUN fcis-5211 28 13 of of ADP fcis-5211 28 14 migration migration NOUN fcis-5211 28 15 to to PART fcis-5211 28 16 weigh weigh VERB fcis-5211 28 17 the the DET fcis-5211 28 18 overall overall ADJ fcis-5211 28 19 performance performance NOUN fcis-5211 28 20 improvement improvement NOUN fcis-5211 28 21 . . PUNCT fcis-5211 29 1 in in ADP fcis-5211 29 2 order order NOUN fcis-5211 29 3 to to PART fcis-5211 29 4 solve solve VERB fcis-5211 29 5 this this DET fcis-5211 29 6 problem problem NOUN fcis-5211 29 7 . . PUNCT fcis-5211 30 1 then then ADV fcis-5211 30 2 , , PUNCT fcis-5211 30 3 we we PRON fcis-5211 30 4 model model VERB fcis-5211 30 5 the the DET fcis-5211 30 6 migration migration NOUN fcis-5211 30 7 process process NOUN fcis-5211 30 8 as as ADP fcis-5211 30 9 a a DET fcis-5211 30 10 markov markov NOUN fcis-5211 30 11 decision decision NOUN fcis-5211 30 12 process process NOUN fcis-5211 30 13 and and CCONJ fcis-5211 30 14 consider consider VERB fcis-5211 30 15 following follow VERB fcis-5211 30 16 metric metric ADJ fcis-5211 30 17 to to ADP fcis-5211 30 18 measuring measure VERB fcis-5211 30 19 the the DET fcis-5211 30 20 cost cost NOUN fcis-5211 30 21 of of ADP fcis-5211 30 22 the the DET fcis-5211 30 23 migration migration NOUN fcis-5211 30 24 process process NOUN fcis-5211 30 25 in in ADP fcis-5211 30 26 this this DET fcis-5211 30 27 paper paper NOUN fcis-5211 30 28 . . PUNCT fcis-5211 31 1 in in ADP fcis-5211 31 2 addition addition NOUN fcis-5211 31 3 , , PUNCT fcis-5211 31 4 this this DET fcis-5211 31 5 paper paper NOUN fcis-5211 31 6 uses use VERB fcis-5211 31 7 a a DET fcis-5211 31 8 mobility mobility NOUN fcis-5211 31 9 model model NOUN fcis-5211 31 10 to to PART fcis-5211 31 11 represent represent VERB fcis-5211 31 12 the the DET fcis-5211 31 13 movement movement NOUN fcis-5211 31 14 state state NOUN fcis-5211 31 15 of of ADP fcis-5211 31 16 the the DET fcis-5211 31 17 vehicle vehicle NOUN fcis-5211 31 18 . . PUNCT fcis-5211 32 1 then then ADV fcis-5211 32 2 , , PUNCT fcis-5211 32 3 we we PRON fcis-5211 32 4 propose propose VERB fcis-5211 32 5 a a DET fcis-5211 32 6 multi multi ADJ fcis-5211 32 7 - - ADJ fcis-5211 32 8 agent agent ADJ fcis-5211 32 9 deep deep ADJ fcis-5211 32 10 reinforcement reinforcement NOUN fcis-5211 32 11 learning learning NOUN fcis-5211 32 12 based base VERB fcis-5211 32 13 service service NOUN fcis-5211 32 14 migration migration NOUN fcis-5211 32 15 algorithm algorithm NOUN fcis-5211 32 16 , , PUNCT fcis-5211 32 17 which which PRON fcis-5211 32 18 can can AUX fcis-5211 32 19 effectively effectively ADV fcis-5211 32 20 deal deal VERB fcis-5211 32 21 with with ADP fcis-5211 32 22 solving solve VERB fcis-5211 32 23 the the DET fcis-5211 32 24 problem problem NOUN fcis-5211 32 25 of of ADP fcis-5211 32 26 excessive excessive ADJ fcis-5211 32 27 dimensionality dimensionality NOUN fcis-5211 32 28 in in ADP fcis-5211 32 29 the the DET fcis-5211 32 30 traditional traditional ADJ fcis-5211 32 31 mdp mdp NOUN fcis-5211 32 32 problem problem NOUN fcis-5211 32 33 . . PUNCT fcis-5211 33 1 in in ADP fcis-5211 33 2 addition addition NOUN fcis-5211 33 3 , , PUNCT fcis-5211 33 4 our our PRON fcis-5211 33 5 proposed propose VERB fcis-5211 33 6 algorithm algorithm NOUN fcis-5211 33 7 applies apply VERB fcis-5211 33 8 actor actor NOUN fcis-5211 33 9 - - PUNCT fcis-5211 33 10 critic critic NOUN fcis-5211 33 11 network network NOUN fcis-5211 33 12 and and CCONJ fcis-5211 33 13 entropy entropy NOUN fcis-5211 33 14 to to PART fcis-5211 33 15 ensure ensure VERB fcis-5211 33 16 convergence convergence NOUN fcis-5211 33 17 and and CCONJ fcis-5211 33 18 exportability exportability NOUN fcis-5211 33 19 . . PUNCT fcis-5211 34 1 finally finally ADV fcis-5211 34 2 , , PUNCT fcis-5211 34 3 this this DET fcis-5211 34 4 paper paper NOUN fcis-5211 34 5 conducts conduct VERB fcis-5211 34 6 experiments experiment NOUN fcis-5211 34 7 and and CCONJ fcis-5211 34 8 evaluates evaluate VERB fcis-5211 34 9 the the DET fcis-5211 34 10 algorithm algorithm NOUN fcis-5211 34 11 based base VERB fcis-5211 34 12 on on ADP fcis-5211 34 13 real real ADJ fcis-5211 34 14 data datum NOUN fcis-5211 34 15 sets set NOUN fcis-5211 34 16 . . PUNCT fcis-5211 35 1 2 2 X fcis-5211 35 2 . . X fcis-5211 35 3 system system NOUN fcis-5211 35 4 model model NOUN fcis-5211 35 5 in in ADP fcis-5211 35 6 this this DET fcis-5211 35 7 paper paper NOUN fcis-5211 35 8 , , PUNCT fcis-5211 35 9 we we PRON fcis-5211 35 10 consider consider VERB fcis-5211 35 11 a a DET fcis-5211 35 12 vehicle vehicle NOUN fcis-5211 35 13 in in ADP fcis-5211 35 14 a a DET fcis-5211 35 15 vec vec NOUN fcis-5211 35 16 network network NOUN fcis-5211 35 17 traveling travel VERB fcis-5211 35 18 in in ADP fcis-5211 35 19 a a DET fcis-5211 35 20 one one NUM fcis-5211 35 21 - - PUNCT fcis-5211 35 22 way way NOUN fcis-5211 35 23 road road NOUN fcis-5211 35 24 equipped equip VERB fcis-5211 35 25 with with ADP fcis-5211 35 26 𝐼 𝐼 PROPN fcis-5211 35 27 roadside roadside NOUN fcis-5211 35 28 units unit NOUN fcis-5211 35 29 with with ADP fcis-5211 35 30 equal equal ADJ fcis-5211 35 31 communication communication NOUN fcis-5211 35 32 range range NOUN fcis-5211 35 33 , , PUNCT fcis-5211 35 34 and and CCONJ fcis-5211 35 35 each each DET fcis-5211 35 36 roadside roadside NOUN fcis-5211 35 37 unit unit NOUN fcis-5211 35 38 is be AUX fcis-5211 35 39 configured configure VERB fcis-5211 35 40 with with ADP fcis-5211 35 41 a a DET fcis-5211 35 42 roadside roadside NOUN fcis-5211 35 43 unit unit NOUN fcis-5211 35 44 𝑒 𝑒 VERB fcis-5211 35 45 of of ADP fcis-5211 35 46 equal equal ADJ fcis-5211 35 47 computing computing NOUN fcis-5211 35 48 power power NOUN fcis-5211 35 49 . . PUNCT fcis-5211 36 1 where where SCONJ fcis-5211 36 2 𝐸 𝐸 ADV fcis-5211 36 3 = = SYM fcis-5211 36 4 { { PUNCT fcis-5211 36 5 𝑒1 𝑒1 NOUN fcis-5211 36 6 , , PUNCT fcis-5211 36 7 𝑒2 𝑒2 PROPN fcis-5211 36 8 , , PUNCT fcis-5211 36 9 … … PUNCT fcis-5211 36 10 , , PUNCT fcis-5211 36 11 𝑒𝑖 𝑒𝑖 ADP fcis-5211 36 12 } } PUNCT fcis-5211 36 13 denotes denote VERB fcis-5211 36 14 the the DET fcis-5211 36 15 set set NOUN fcis-5211 36 16 of of ADP fcis-5211 36 17 all all DET fcis-5211 36 18 vecs vec NOUN fcis-5211 36 19 set set VERB fcis-5211 36 20 . . PUNCT fcis-5211 37 1 we we PRON fcis-5211 37 2 can can AUX fcis-5211 37 3 divide divide VERB fcis-5211 37 4 the the DET fcis-5211 37 5 road road NOUN fcis-5211 37 6 section section NOUN fcis-5211 37 7 into into ADP fcis-5211 37 8 𝐼 𝐼 PROPN fcis-5211 37 9 segments segment NOUN fcis-5211 37 10 , , PUNCT fcis-5211 37 11 and and CCONJ fcis-5211 37 12 each each DET fcis-5211 37 13 vehicle vehicle NOUN fcis-5211 37 14 is be AUX fcis-5211 37 15 randomly randomly ADV fcis-5211 37 16 distributed distribute VERB fcis-5211 37 17 in in ADP fcis-5211 37 18 the the DET fcis-5211 37 19 urban urban ADJ fcis-5211 37 20 area area NOUN fcis-5211 37 21 . . PUNCT fcis-5211 38 1 we we PRON fcis-5211 38 2 also also ADV fcis-5211 38 3 consider consider VERB fcis-5211 38 4 the the DET fcis-5211 38 5 vertical vertical ADJ fcis-5211 38 6 distance distance NOUN fcis-5211 38 7 between between ADP fcis-5211 38 8 the the DET fcis-5211 38 9 road road NOUN fcis-5211 38 10 and and CCONJ fcis-5211 38 11 the the DET fcis-5211 38 12 roadside roadside NOUN fcis-5211 38 13 unit unit NOUN fcis-5211 38 14 as as ADP fcis-5211 38 15 𝑑 𝑑 PRON fcis-5211 38 16 . . PUNCT fcis-5211 39 1 the the DET fcis-5211 39 2 ensemble ensemble ADJ fcis-5211 39 3 of of ADP fcis-5211 39 4 all all DET fcis-5211 39 5 vehicles vehicle NOUN fcis-5211 39 6 can can AUX fcis-5211 39 7 be be AUX fcis-5211 39 8 denoted denote VERB fcis-5211 39 9 as as ADP fcis-5211 39 10 π‘ˆ π‘ˆ PROPN fcis-5211 39 11 = = PROPN fcis-5211 39 12 49 49 NUM fcis-5211 39 13 { { PUNCT fcis-5211 39 14 𝑒1 𝑒1 PROPN fcis-5211 39 15 , , PUNCT fcis-5211 39 16 𝑒2 𝑒2 PROPN fcis-5211 39 17 , , PUNCT fcis-5211 39 18 … … PUNCT fcis-5211 39 19 , , PUNCT fcis-5211 39 20 𝑒𝑗 𝑒𝑗 NOUN fcis-5211 39 21 } } PUNCT fcis-5211 39 22 , , PUNCT fcis-5211 39 23 where where SCONJ fcis-5211 39 24 each each DET fcis-5211 39 25 vehicle vehicle NOUN fcis-5211 39 26 𝑒 𝑒 PROPN fcis-5211 39 27 ∈ ∈ PROPN fcis-5211 39 28 π‘ˆ π‘ˆ PROPN fcis-5211 39 29 has have VERB fcis-5211 39 30 a a DET fcis-5211 39 31 computing computing NOUN fcis-5211 39 32 task task NOUN fcis-5211 39 33 , , PUNCT fcis-5211 39 34 and and CCONJ fcis-5211 39 35 the the DET fcis-5211 39 36 vehicles vehicle NOUN fcis-5211 39 37 can can AUX fcis-5211 39 38 choose choose VERB fcis-5211 39 39 to to PART fcis-5211 39 40 compute compute VERB fcis-5211 39 41 locally locally ADV fcis-5211 39 42 or or CCONJ fcis-5211 39 43 offload offload NOUN fcis-5211 39 44 to to ADP fcis-5211 39 45 the the DET fcis-5211 39 46 roadside roadside NOUN fcis-5211 39 47 unit unit NOUN fcis-5211 39 48 . . PUNCT fcis-5211 40 1 these these DET fcis-5211 40 2 tasks task NOUN fcis-5211 40 3 are be AUX fcis-5211 40 4 offloaded offload VERB fcis-5211 40 5 to to ADP fcis-5211 40 6 the the DET fcis-5211 40 7 roadside roadside NOUN fcis-5211 40 8 unit unit NOUN fcis-5211 40 9 via via ADP fcis-5211 40 10 the the DET fcis-5211 40 11 roadside roadside NOUN fcis-5211 40 12 unit unit NOUN fcis-5211 40 13 . . PUNCT fcis-5211 41 1 vehicles vehicle NOUN fcis-5211 41 2 can can AUX fcis-5211 41 3 be be AUX fcis-5211 41 4 connected connect VERB fcis-5211 41 5 to to ADP fcis-5211 41 6 a a DET fcis-5211 41 7 roadside roadside NOUN fcis-5211 41 8 unit unit NOUN fcis-5211 41 9 𝑒 𝑒 PROPN fcis-5211 41 10 ∈ ∈ PROPN fcis-5211 41 11 𝐸 𝐸 PROPN fcis-5211 41 12 as as SCONJ fcis-5211 41 13 they they PRON fcis-5211 41 14 move move VERB fcis-5211 41 15 within within ADP fcis-5211 41 16 segment segment NOUN fcis-5211 41 17 𝑖 𝑖 PROPN fcis-5211 41 18 in in ADP fcis-5211 41 19 fig fig NOUN fcis-5211 41 20 . . PUNCT fcis-5211 42 1 1 1 X fcis-5211 42 2 . . X fcis-5211 42 3 considering consider VERB fcis-5211 42 4 the the DET fcis-5211 42 5 tradeoff tradeoff NOUN fcis-5211 42 6 between between ADP fcis-5211 42 7 cost cost NOUN fcis-5211 42 8 and and CCONJ fcis-5211 42 9 benefit benefit VERB fcis-5211 42 10 during during ADP fcis-5211 42 11 service service NOUN fcis-5211 42 12 migration migration NOUN fcis-5211 42 13 , , PUNCT fcis-5211 42 14 we we PRON fcis-5211 42 15 introduce introduce VERB fcis-5211 42 16 following follow VERB fcis-5211 42 17 relevant relevant ADJ fcis-5211 42 18 metrics metric NOUN fcis-5211 42 19 to to PART fcis-5211 42 20 measure measure VERB fcis-5211 42 21 the the DET fcis-5211 42 22 cost cost NOUN fcis-5211 42 23 : : PUNCT fcis-5211 42 24 container container NOUN fcis-5211 42 25 migration migration NOUN fcis-5211 42 26 cost cost NOUN fcis-5211 42 27 , , PUNCT fcis-5211 42 28 computing compute VERB fcis-5211 42 29 cost cost NOUN fcis-5211 42 30 and and CCONJ fcis-5211 42 31 energy energy NOUN fcis-5211 42 32 consumption consumption NOUN fcis-5211 42 33 . . PUNCT fcis-5211 43 1 energy energy NOUN fcis-5211 43 2 consumption consumption NOUN fcis-5211 43 3 is be AUX fcis-5211 43 4 a a DET fcis-5211 43 5 key key ADJ fcis-5211 43 6 metric metric NOUN fcis-5211 43 7 for for ADP fcis-5211 43 8 electric electric ADJ fcis-5211 43 9 vehicles vehicle NOUN fcis-5211 43 10 . . PUNCT fcis-5211 44 1 this this PRON fcis-5211 44 2 is be AUX fcis-5211 44 3 because because SCONJ fcis-5211 44 4 it it PRON fcis-5211 44 5 is be AUX fcis-5211 44 6 one one NUM fcis-5211 44 7 of of ADP fcis-5211 44 8 the the DET fcis-5211 44 9 biggest big ADJ fcis-5211 44 10 concerns concern NOUN fcis-5211 44 11 today today NOUN fcis-5211 44 12 . . PUNCT fcis-5211 45 1 usually usually ADV fcis-5211 45 2 the the DET fcis-5211 45 3 migration migration NOUN fcis-5211 45 4 cost cost NOUN fcis-5211 45 5 is be AUX fcis-5211 45 6 expected expect VERB fcis-5211 45 7 to to PART fcis-5211 45 8 increase increase VERB fcis-5211 45 9 with with ADP fcis-5211 45 10 the the DET fcis-5211 45 11 energy energy NOUN fcis-5211 45 12 consumption consumption NOUN fcis-5211 45 13 . . PUNCT fcis-5211 46 1 in in ADP fcis-5211 46 2 this this DET fcis-5211 46 3 paper paper NOUN fcis-5211 46 4 , , PUNCT fcis-5211 46 5 we we PRON fcis-5211 46 6 also also ADV fcis-5211 46 7 consider consider VERB fcis-5211 46 8 a a DET fcis-5211 46 9 scenario scenario NOUN fcis-5211 46 10 that that DET fcis-5211 46 11 vehicle vehicle NOUN fcis-5211 46 12 in in ADP fcis-5211 46 13 a a DET fcis-5211 46 14 vec vec NOUN fcis-5211 46 15 network network NOUN fcis-5211 46 16 traveling travel VERB fcis-5211 46 17 in in ADP fcis-5211 46 18 a a DET fcis-5211 46 19 one one NUM fcis-5211 46 20 - - PUNCT fcis-5211 46 21 way way NOUN fcis-5211 46 22 road road NOUN fcis-5211 46 23 equipped equip VERB fcis-5211 46 24 with with ADP fcis-5211 46 25 𝐼 𝐼 PROPN fcis-5211 46 26 roadside roadside NOUN fcis-5211 46 27 units unit NOUN fcis-5211 46 28 with with ADP fcis-5211 46 29 equal equal ADJ fcis-5211 46 30 communication communication NOUN fcis-5211 46 31 range range NOUN fcis-5211 46 32 π‘Ÿ π‘Ÿ NOUN fcis-5211 46 33 , , PUNCT fcis-5211 46 34 and and CCONJ fcis-5211 46 35 each each DET fcis-5211 46 36 roadside roadside NOUN fcis-5211 46 37 unit unit NOUN fcis-5211 46 38 is be AUX fcis-5211 46 39 configured configure VERB fcis-5211 46 40 with with ADP fcis-5211 46 41 a a DET fcis-5211 46 42 roadside roadside NOUN fcis-5211 46 43 unit unit NOUN fcis-5211 46 44 𝑒 𝑒 NOUN fcis-5211 46 45 , , PUNCT fcis-5211 46 46 where where SCONJ fcis-5211 46 47 𝐸 𝐸 ADJ fcis-5211 46 48 = = SYM fcis-5211 46 49 { { PUNCT fcis-5211 46 50 𝑒1 𝑒1 NOUN fcis-5211 46 51 , , PUNCT fcis-5211 46 52 𝑒2 𝑒2 PROPN fcis-5211 46 53 , , PUNCT fcis-5211 46 54 … … PUNCT fcis-5211 46 55 , , PUNCT fcis-5211 46 56 𝑒𝑖 𝑒𝑖 ADP fcis-5211 46 57 } } PUNCT fcis-5211 46 58 accordingly accordingly ADV fcis-5211 46 59 , , PUNCT fcis-5211 46 60 we we PRON fcis-5211 46 61 can can AUX fcis-5211 46 62 divide divide VERB fcis-5211 46 63 the the DET fcis-5211 46 64 road road NOUN fcis-5211 46 65 section section NOUN fcis-5211 46 66 into into ADP fcis-5211 46 67 𝐼. 𝐼. PROPN fcis-5211 46 68 we we PRON fcis-5211 46 69 also also ADV fcis-5211 46 70 consider consider VERB fcis-5211 46 71 the the DET fcis-5211 46 72 vertical vertical ADJ fcis-5211 46 73 distance distance NOUN fcis-5211 46 74 between between ADP fcis-5211 46 75 the the DET fcis-5211 46 76 road road NOUN fcis-5211 46 77 and and CCONJ fcis-5211 46 78 the the DET fcis-5211 46 79 roadside roadside NOUN fcis-5211 46 80 unit unit NOUN fcis-5211 46 81 as as ADP fcis-5211 46 82 𝑑 𝑑 PRON fcis-5211 46 83 . . PUNCT fcis-5211 47 1 the the DET fcis-5211 47 2 set set NOUN fcis-5211 47 3 of of ADP fcis-5211 47 4 all all DET fcis-5211 47 5 vehicles vehicle NOUN fcis-5211 47 6 can can AUX fcis-5211 47 7 be be AUX fcis-5211 47 8 denoted denote VERB fcis-5211 47 9 as as ADP fcis-5211 47 10 π‘ˆ π‘ˆ PROPN fcis-5211 47 11 = = SYM fcis-5211 47 12 { { PUNCT fcis-5211 47 13 𝑒1 𝑒1 PROPN fcis-5211 47 14 , , PUNCT fcis-5211 47 15 𝑒2 𝑒2 PROPN fcis-5211 47 16 , , PUNCT fcis-5211 47 17 … … PUNCT fcis-5211 47 18 , , PUNCT fcis-5211 47 19 𝑒𝑗 𝑒𝑗 NOUN fcis-5211 47 20 } } PUNCT fcis-5211 47 21 , , PUNCT fcis-5211 47 22 where where SCONJ fcis-5211 47 23 each each DET fcis-5211 47 24 vehicle vehicle NOUN fcis-5211 47 25 𝑒 𝑒 PROPN fcis-5211 47 26 ∈ ∈ PROPN fcis-5211 47 27 π‘ˆ π‘ˆ PROPN fcis-5211 47 28 the the DET fcis-5211 47 29 ensemble ensemble ADJ fcis-5211 47 30 of of ADP fcis-5211 47 31 all all DET fcis-5211 47 32 vehicles vehicle NOUN fcis-5211 47 33 can can AUX fcis-5211 47 34 be be AUX fcis-5211 47 35 denoted denote VERB fcis-5211 47 36 as as ADP fcis-5211 47 37 , , PUNCT fcis-5211 47 38 where where SCONJ fcis-5211 47 39 each each DET fcis-5211 47 40 vehicle vehicle NOUN fcis-5211 47 41 has have AUX fcis-5211 47 42 a a DET fcis-5211 47 43 computing computing NOUN fcis-5211 47 44 task task NOUN fcis-5211 47 45 , , PUNCT fcis-5211 47 46 and and CCONJ fcis-5211 47 47 the the DET fcis-5211 47 48 vehicles vehicle NOUN fcis-5211 47 49 can can AUX fcis-5211 47 50 choose choose VERB fcis-5211 47 51 to to PART fcis-5211 47 52 compute compute VERB fcis-5211 47 53 locally locally ADV fcis-5211 47 54 or or CCONJ fcis-5211 47 55 offload offload NOUN fcis-5211 47 56 to to ADP fcis-5211 47 57 the the DET fcis-5211 47 58 roadside roadside NOUN fcis-5211 47 59 unit unit NOUN fcis-5211 47 60 . . PUNCT fcis-5211 48 1 vehicles vehicle NOUN fcis-5211 48 2 can can AUX fcis-5211 48 3 be be AUX fcis-5211 48 4 connected connect VERB fcis-5211 48 5 to to ADP fcis-5211 48 6 a a DET fcis-5211 48 7 roadside roadside NOUN fcis-5211 48 8 unit unit NOUN fcis-5211 48 9 𝑒 𝑒 PROPN fcis-5211 48 10 ∈ ∈ PROPN fcis-5211 48 11 𝐸 𝐸 PROPN fcis-5211 48 12 as as SCONJ fcis-5211 48 13 they they PRON fcis-5211 48 14 move move VERB fcis-5211 48 15 within within ADP fcis-5211 48 16 segment segment NOUN fcis-5211 49 1 𝑖. 𝑖. NOUN fcis-5211 49 2 we we PRON fcis-5211 49 3 show show VERB fcis-5211 49 4 this this DET fcis-5211 49 5 vec vec PROPN fcis-5211 49 6 network network NOUN fcis-5211 49 7 in in ADP fcis-5211 49 8 fig fig NOUN fcis-5211 49 9 . . PUNCT fcis-5211 50 1 1 1 NUM fcis-5211 50 2 figure figure NOUN fcis-5211 50 3 1 1 NUM fcis-5211 50 4 v2x v2x NOUN fcis-5211 50 5 network network NOUN fcis-5211 50 6 architecture architecture NOUN fcis-5211 50 7 2.1 2.1 NUM fcis-5211 50 8 . . PUNCT fcis-5211 50 9 v2x v2x VERB fcis-5211 50 10 communication communication NOUN fcis-5211 50 11 cost cost NOUN fcis-5211 50 12 model model NOUN fcis-5211 50 13 in in ADP fcis-5211 50 14 vehicle vehicle NOUN fcis-5211 50 15 - - PUNCT fcis-5211 50 16 to to ADP fcis-5211 50 17 - - PUNCT fcis-5211 50 18 infrastructure infrastructure NOUN fcis-5211 50 19 ( ( PUNCT fcis-5211 50 20 v2i v2i NOUN fcis-5211 50 21 ) ) PUNCT fcis-5211 50 22 communication communication NOUN fcis-5211 50 23 , , PUNCT fcis-5211 50 24 this this DET fcis-5211 50 25 paper paper NOUN fcis-5211 50 26 considers consider VERB fcis-5211 50 27 vehicles vehicle NOUN fcis-5211 50 28 communicating communicate VERB fcis-5211 50 29 with with ADP fcis-5211 50 30 roadside roadside NOUN fcis-5211 50 31 units unit NOUN fcis-5211 50 32 via via ADP fcis-5211 50 33 cellular cellular ADJ fcis-5211 50 34 networks network NOUN fcis-5211 50 35 and and CCONJ fcis-5211 50 36 millimeter millimeter NOUN fcis-5211 50 37 waves wave NOUN fcis-5211 50 38 in in ADP fcis-5211 50 39 v2x v2x NOUN fcis-5211 50 40 . . PUNCT fcis-5211 51 1 the the DET fcis-5211 51 2 communication communication NOUN fcis-5211 51 3 model model NOUN fcis-5211 51 4 depends depend VERB fcis-5211 51 5 on on ADP fcis-5211 51 6 a a DET fcis-5211 51 7 certain certain ADJ fcis-5211 51 8 distance distance NOUN fcis-5211 51 9 between between ADP fcis-5211 51 10 the the DET fcis-5211 51 11 vehicle vehicle NOUN fcis-5211 51 12 and and CCONJ fcis-5211 51 13 the the DET fcis-5211 51 14 roadside roadside NOUN fcis-5211 51 15 unit unit NOUN fcis-5211 51 16 . . PUNCT fcis-5211 52 1 according accord VERB fcis-5211 52 2 to to ADP fcis-5211 52 3 the the DET fcis-5211 52 4 literature literature NOUN fcis-5211 52 5 the the DET fcis-5211 52 6 distance distance NOUN fcis-5211 52 7 between between ADP fcis-5211 52 8 two two NUM fcis-5211 52 9 network network NOUN fcis-5211 52 10 components component NOUN fcis-5211 52 11 is be AUX fcis-5211 52 12 suggested suggest VERB fcis-5211 52 13 to to PART fcis-5211 52 14 be be AUX fcis-5211 52 15 100 100 NUM fcis-5211 52 16 to to ADP fcis-5211 52 17 200 200 NUM fcis-5211 52 18 meters meter NOUN fcis-5211 52 19 . . PUNCT fcis-5211 53 1 therefore therefore ADV fcis-5211 53 2 , , PUNCT fcis-5211 53 3 we we PRON fcis-5211 53 4 assume assume VERB fcis-5211 53 5 a a DET fcis-5211 53 6 cellular cellular ADJ fcis-5211 53 7 link link NOUN fcis-5211 53 8 range range NOUN fcis-5211 53 9 of of ADP fcis-5211 53 10 200 200 NUM fcis-5211 53 11 meters meter NOUN fcis-5211 53 12 . . PUNCT fcis-5211 54 1 also also ADV fcis-5211 54 2 in in ADP fcis-5211 54 3 this this DET fcis-5211 54 4 paper paper NOUN fcis-5211 54 5 , , PUNCT fcis-5211 54 6 we we PRON fcis-5211 54 7 arrange arrange VERB fcis-5211 54 8 the the DET fcis-5211 54 9 cellular cellular ADJ fcis-5211 54 10 network network NOUN fcis-5211 54 11 in in ADP fcis-5211 54 12 mode mode PROPN fcis-5211 54 13 1 1 NUM fcis-5211 54 14 of of ADP fcis-5211 54 15 nr nr NOUN fcis-5211 54 16 - - PUNCT fcis-5211 54 17 v2x v2x NOUN fcis-5211 54 18 . . PUNCT fcis-5211 55 1 according accord VERB fcis-5211 55 2 to to ADP fcis-5211 55 3 the the DET fcis-5211 55 4 3gpp 3gpp PROPN fcis-5211 55 5 rel.16 rel.16 PROPN fcis-5211 55 6 standard standard NOUN fcis-5211 55 7 , , PUNCT fcis-5211 55 8 nr nr PRON fcis-5211 55 9 v2x v2x NOUN fcis-5211 55 10 is be AUX fcis-5211 55 11 capable capable ADJ fcis-5211 55 12 of of ADP fcis-5211 55 13 supporting support VERB fcis-5211 55 14 advanced advanced ADJ fcis-5211 55 15 v2x v2x NOUN fcis-5211 55 16 applications application NOUN fcis-5211 55 17 with with ADP fcis-5211 55 18 more more ADV fcis-5211 55 19 stringent stringent ADJ fcis-5211 55 20 qos qos NOUN fcis-5211 55 21 requirements requirement NOUN fcis-5211 55 22 than than ADP fcis-5211 55 23 those those PRON fcis-5211 55 24 supported support VERB fcis-5211 55 25 by by ADP fcis-5211 55 26 cellular cellular ADJ fcis-5211 55 27 v2x v2x NOUN fcis-5211 55 28 . . PUNCT fcis-5211 56 1 therefore therefore ADV fcis-5211 56 2 , , PUNCT fcis-5211 56 3 in in ADP fcis-5211 56 4 this this DET fcis-5211 56 5 paper paper NOUN fcis-5211 56 6 , , PUNCT fcis-5211 56 7 we we PRON fcis-5211 56 8 classify classify VERB fcis-5211 56 9 the the DET fcis-5211 56 10 communication communication NOUN fcis-5211 56 11 modes mode NOUN fcis-5211 56 12 into into ADP fcis-5211 56 13 5 5 NUM fcis-5211 56 14 g g NOUN fcis-5211 56 15 cellular cellular ADJ fcis-5211 56 16 and and CCONJ fcis-5211 56 17 millimeter millimeter NOUN fcis-5211 56 18 wave wave NOUN fcis-5211 56 19 modes mode NOUN fcis-5211 56 20 , , PUNCT fcis-5211 56 21 which which PRON fcis-5211 56 22 are be AUX fcis-5211 56 23 described describe VERB fcis-5211 56 24 in in ADP fcis-5211 56 25 detail detail NOUN fcis-5211 56 26 in in ADP fcis-5211 56 27 the the DET fcis-5211 56 28 following following NOUN fcis-5211 56 29 . . PUNCT fcis-5211 57 1 2.1.1 2.1.1 X fcis-5211 57 2 . . PUNCT fcis-5211 57 3 millimeter millimeter NOUN fcis-5211 57 4 wave wave PROPN fcis-5211 57 5 mode mode PROPN fcis-5211 57 6 nr nr PROPN fcis-5211 57 7 v2x v2x NOUN fcis-5211 57 8 uses use VERB fcis-5211 57 9 millimeter millimeter NOUN fcis-5211 57 10 wave wave NOUN fcis-5211 57 11 ( ( PUNCT fcis-5211 57 12 mm mm NOUN fcis-5211 57 13 wave wave NOUN fcis-5211 57 14 ) ) PUNCT fcis-5211 57 15 mode mode NOUN fcis-5211 57 16 for for ADP fcis-5211 57 17 nr nr PROPN fcis-5211 57 18 . . PROPN fcis-5211 58 1 to to PART fcis-5211 58 2 take take VERB fcis-5211 58 3 advantage advantage NOUN fcis-5211 58 4 of of ADP fcis-5211 58 5 the the DET fcis-5211 58 6 benefits benefit NOUN fcis-5211 58 7 offered offer VERB fcis-5211 58 8 by by ADP fcis-5211 58 9 the the DET fcis-5211 58 10 millimeter millimeter NOUN fcis-5211 58 11 wave wave NOUN fcis-5211 58 12 mode mode NOUN fcis-5211 58 13 in in ADP fcis-5211 58 14 v2i v2i NOUN fcis-5211 58 15 communication communication NOUN fcis-5211 58 16 mode mode NOUN fcis-5211 58 17 , , PUNCT fcis-5211 58 18 in in ADP fcis-5211 58 19 this this DET fcis-5211 58 20 paper paper NOUN fcis-5211 58 21 we we PRON fcis-5211 58 22 consider consider VERB fcis-5211 58 23 each each DET fcis-5211 58 24 vehicle vehicle NOUN fcis-5211 58 25 to to PART fcis-5211 58 26 be be AUX fcis-5211 58 27 equipped equip VERB fcis-5211 58 28 with with ADP fcis-5211 58 29 a a DET fcis-5211 58 30 directional directional ADJ fcis-5211 58 31 antenna antenna NOUN fcis-5211 58 32 array array NOUN fcis-5211 58 33 and and CCONJ fcis-5211 58 34 employ employ VERB fcis-5211 58 35 directional directional ADJ fcis-5211 58 36 beamforming beamforming NOUN fcis-5211 58 37 to to PART fcis-5211 58 38 enhance enhance VERB fcis-5211 58 39 the the DET fcis-5211 58 40 millimeter millimeter NOUN fcis-5211 58 41 wave wave NOUN fcis-5211 58 42 signal signal NOUN fcis-5211 58 43 propagation propagation NOUN fcis-5211 58 44 . . PUNCT fcis-5211 59 1 to to PART fcis-5211 59 2 maximize maximize VERB fcis-5211 59 3 the the DET fcis-5211 59 4 directivity directivity NOUN fcis-5211 59 5 gain gain NOUN fcis-5211 59 6 of of ADP fcis-5211 59 7 the the DET fcis-5211 59 8 millimeter millimeter NOUN fcis-5211 59 9 - - PUNCT fcis-5211 59 10 wave wave NOUN fcis-5211 59 11 antenna antenna NOUN fcis-5211 59 12 , , PUNCT fcis-5211 59 13 we we PRON fcis-5211 59 14 assume assume VERB fcis-5211 59 15 beam beam NOUN fcis-5211 59 16 collimation collimation NOUN fcis-5211 59 17 for for ADP fcis-5211 59 18 the the DET fcis-5211 59 19 transmitter transmitter NOUN fcis-5211 59 20 and and CCONJ fcis-5211 59 21 receiver receiver NOUN fcis-5211 59 22 and and CCONJ fcis-5211 59 23 so so ADV fcis-5211 59 24 we we PRON fcis-5211 59 25 can can AUX fcis-5211 59 26 approximate approximate VERB fcis-5211 59 27 the the DET fcis-5211 59 28 directional directional ADJ fcis-5211 59 29 antenna antenna NOUN fcis-5211 59 30 pattern pattern NOUN fcis-5211 59 31 as as ADP fcis-5211 59 32 a a DET fcis-5211 59 33 sector sector NOUN fcis-5211 59 34 model model NOUN fcis-5211 59 35 on on ADP fcis-5211 59 36 an an DET fcis-5211 59 37 ideal ideal ADJ fcis-5211 59 38 horizontal horizontal ADJ fcis-5211 59 39 plane plane NOUN fcis-5211 59 40 .. .. PUNCT fcis-5211 59 41 in in ADP fcis-5211 59 42 this this DET fcis-5211 59 43 paper paper NOUN fcis-5211 59 44 we we PRON fcis-5211 59 45 model model VERB fcis-5211 59 46 the the DET fcis-5211 59 47 antenna antenna NOUN fcis-5211 59 48 gain gain NOUN fcis-5211 59 49 as as ADP fcis-5211 59 50 . . PUNCT fcis-5211 60 1 𝑔𝑒,𝑒(Ξ· 𝑔𝑒,𝑒(Ξ· PROPN fcis-5211 60 2 ) ) PUNCT fcis-5211 61 1 = = PRON fcis-5211 61 2 { { PUNCT fcis-5211 61 3 π‘”π‘š π‘”π‘š NOUN fcis-5211 61 4 , , PUNCT fcis-5211 61 5 |Ξ·| |Ξ·| PROPN fcis-5211 61 6 ≀ ≀ NUM fcis-5211 61 7 πœ‚β€² πœ‚β€² NUM fcis-5211 61 8 2 2 NUM fcis-5211 61 9 𝑔𝑠 𝑔𝑠 NOUN fcis-5211 61 10 , , PUNCT fcis-5211 61 11 |Ξ·| |Ξ·| X fcis-5211 61 12 > > X fcis-5211 61 13 πœ‚β€² πœ‚β€² X fcis-5211 61 14 2 2 NUM fcis-5211 61 15 ( ( PUNCT fcis-5211 61 16 2 2 NUM fcis-5211 61 17 ) ) PUNCT fcis-5211 61 18 where where SCONJ fcis-5211 61 19 Ξ· Ξ· PROPN fcis-5211 61 20 is be AUX fcis-5211 61 21 the the DET fcis-5211 61 22 difference difference NOUN fcis-5211 61 23 between between ADP fcis-5211 61 24 the the DET fcis-5211 61 25 current current ADJ fcis-5211 61 26 antenna antenna NOUN fcis-5211 61 27 angle angle NOUN fcis-5211 61 28 and and CCONJ fcis-5211 61 29 the the DET fcis-5211 61 30 angle angle NOUN fcis-5211 61 31 when when SCONJ fcis-5211 61 32 the the DET fcis-5211 61 33 antenna antenna NOUN fcis-5211 61 34 gain gain NOUN fcis-5211 61 35 is be AUX fcis-5211 61 36 at at ADP fcis-5211 61 37 its its PRON fcis-5211 61 38 peak peak NOUN fcis-5211 61 39 , , PUNCT fcis-5211 61 40 i.e. i.e. X fcis-5211 61 41 the the DET fcis-5211 61 42 tolerable tolerable ADJ fcis-5211 61 43 alignment alignment NOUN fcis-5211 61 44 error error NOUN fcis-5211 61 45 in in ADP fcis-5211 61 46 the the DET fcis-5211 61 47 direction direction NOUN fcis-5211 61 48 of of ADP fcis-5211 61 49 antenna antenna NOUN fcis-5211 61 50 steering steering NOUN fcis-5211 61 51 , , PUNCT fcis-5211 61 52 πœ‚β€² πœ‚β€² VERB fcis-5211 61 53 the the DET fcis-5211 61 54 beamwidth beamwidth ADJ fcis-5211 61 55 , , PUNCT fcis-5211 61 56 theπ‘”π‘š theπ‘”π‘š NOUN fcis-5211 61 57 , , PUNCT fcis-5211 61 58 andπ‘”π‘š andπ‘”π‘š PROPN fcis-5211 61 59 are be AUX fcis-5211 61 60 the the DET fcis-5211 61 61 directional directional ADJ fcis-5211 61 62 gains gain NOUN fcis-5211 61 63 of of ADP fcis-5211 61 64 the the DET fcis-5211 61 65 main main ADJ fcis-5211 61 66 and and CCONJ fcis-5211 61 67 side side ADJ fcis-5211 61 68 flap flap NOUN fcis-5211 61 69 antennas antenna NOUN fcis-5211 61 70 , , PUNCT fcis-5211 61 71 respectively respectively ADV fcis-5211 61 72 . . PUNCT fcis-5211 62 1 then then ADV fcis-5211 62 2 we we PRON fcis-5211 62 3 formulate formulate VERB fcis-5211 62 4 the the DET fcis-5211 62 5 millimeter millimeter NOUN fcis-5211 62 6 wave wave NOUN fcis-5211 62 7 channel channel NOUN fcis-5211 62 8 bandwidth bandwidth NOUN fcis-5211 62 9 as as ADP fcis-5211 62 10 𝐢𝑒,𝑒 𝐢𝑒,𝑒 PROPN fcis-5211 62 11 π‘š π‘š NOUN fcis-5211 62 12 = = PUNCT fcis-5211 62 13 π΅π‘š π΅π‘š PROPN fcis-5211 62 14 log2(1 log2(1 PROPN fcis-5211 62 15 + + CCONJ fcis-5211 62 16 sinr𝑒,𝑒 sinr𝑒,𝑒 NUM fcis-5211 62 17 ) ) PUNCT fcis-5211 62 18 , , PUNCT fcis-5211 62 19 whereπ΅π‘š whereπ΅π‘š PROPN fcis-5211 62 20 is be AUX fcis-5211 62 21 the the DET fcis-5211 62 22 millimeter millimeter NOUN fcis-5211 62 23 wave wave NOUN fcis-5211 62 24 signal signal NOUN fcis-5211 62 25 bandwidth bandwidth NOUN fcis-5211 62 26 ; ; PUNCT fcis-5211 62 27 the the DET fcis-5211 62 28 sinr sinr NOUN fcis-5211 62 29 between between ADP fcis-5211 62 30 the the DET fcis-5211 62 31 vehicle vehicle NOUN fcis-5211 62 32 antenna antenna NOUN fcis-5211 62 33 and and CCONJ fcis-5211 62 34 the the DET fcis-5211 62 35 rsu rsu NOUN fcis-5211 62 36 antenna antenna NOUN fcis-5211 62 37 is be AUX fcis-5211 62 38 : : PUNCT fcis-5211 62 39 sinr𝑒,𝑒 sinr𝑒,𝑒 NUM fcis-5211 62 40 = = SYM fcis-5211 62 41 𝑝u 𝑝u NOUN fcis-5211 62 42 βˆ’ βˆ’ PROPN fcis-5211 63 1 π‘π‘š π‘π‘š ADV fcis-5211 63 2 βˆ’ βˆ’ PROPN fcis-5211 63 3 10log10 10log10 NUM fcis-5211 63 4 ( ( PUNCT fcis-5211 63 5 π΅π‘š π΅π‘š NOUN fcis-5211 63 6 ) ) PUNCT fcis-5211 64 1 + + CCONJ fcis-5211 64 2 2π‘”π‘š 2π‘”π‘š ADJ fcis-5211 64 3 βˆ’ βˆ’ NOUN fcis-5211 64 4 10𝛼 10𝛼 NUM fcis-5211 64 5 log10(𝑑𝑒,𝑒 log10(𝑑𝑒,𝑒 PROPN fcis-5211 64 6 ) ) PUNCT fcis-5211 64 7 βˆ’ βˆ’ PROPN fcis-5211 64 8 69.6 69.6 NUM fcis-5211 64 9 βˆ’ βˆ’ NOUN fcis-5211 64 10 𝜌 𝜌 NOUN fcis-5211 64 11 ) ) PUNCT fcis-5211 64 12 ( ( PUNCT fcis-5211 64 13 3 3 X fcis-5211 64 14 ) ) PUNCT fcis-5211 64 15 where where SCONJ fcis-5211 64 16 𝑝u 𝑝u NOUN fcis-5211 64 17 is be AUX fcis-5211 64 18 the the DET fcis-5211 64 19 transmission transmission NOUN fcis-5211 64 20 power power NOUN fcis-5211 64 21 of of ADP fcis-5211 64 22 the the DET fcis-5211 64 23 millimeter millimeter NOUN fcis-5211 64 24 - - PUNCT fcis-5211 64 25 wave wave NOUN fcis-5211 64 26 transceiver transceiver NOUN fcis-5211 64 27 the the DET fcis-5211 64 28 vehicle vehicle NOUN fcis-5211 64 29 𝑒 𝑒 NOUN fcis-5211 64 30 equipped equip VERB fcis-5211 64 31 with.π‘π‘š with.π‘π‘š PROPN fcis-5211 64 32 is be AUX fcis-5211 64 33 the the DET fcis-5211 64 34 noise noise NOUN fcis-5211 64 35 power power NOUN fcis-5211 64 36 spectral spectral ADJ fcis-5211 64 37 density density NOUN fcis-5211 64 38 ; ; PUNCT fcis-5211 64 39 the the DET fcis-5211 64 40 vehicle vehicle NOUN fcis-5211 64 41 𝑒 𝑒 NOUN fcis-5211 64 42 and and CCONJ fcis-5211 64 43 the the DET fcis-5211 64 44 rsu rsu PROPN fcis-5211 64 45 𝑒 𝑒 PROPN fcis-5211 64 46 manhattan manhattan PROPN fcis-5211 64 47 distance distance NOUN fcis-5211 64 48 between between ADP fcis-5211 64 49 the the DET fcis-5211 64 50 vehicle vehicle NOUN fcis-5211 64 51 and and CCONJ fcis-5211 64 52 the the DET fcis-5211 64 53 rsu rsu NOUN fcis-5211 64 54 is be AUX fcis-5211 64 55 more more ADV fcis-5211 64 56 appropriately appropriately ADV fcis-5211 64 57 reflected reflect VERB fcis-5211 64 58 than than ADP fcis-5211 64 59 the the DET fcis-5211 64 60 euclidean euclidean ADJ fcis-5211 64 61 distance distance NOUN fcis-5211 64 62 . . PUNCT fcis-5211 65 1 we we PRON fcis-5211 65 2 combine combine VERB fcis-5211 65 3 the the DET fcis-5211 65 4 vehicle vehicle NOUN fcis-5211 65 5 𝑒 𝑒 PART fcis-5211 65 6 antenna antenna NOUN fcis-5211 65 7 and and CCONJ fcis-5211 65 8 the the DET fcis-5211 65 9 rsu rsu PROPN fcis-5211 65 10 𝑒 𝑒 PROPN fcis-5211 65 11 distance distance NOUN fcis-5211 65 12 between between ADP fcis-5211 65 13 the the DET fcis-5211 65 14 vehicle vehicle NOUN fcis-5211 65 15 antenna antenna NOUN fcis-5211 65 16 and and CCONJ fcis-5211 65 17 the the DET fcis-5211 65 18 rsu rsu NOUN fcis-5211 65 19 antenna antenna NOUN fcis-5211 65 20 𝑑𝑒,𝑒 𝑑𝑒,𝑒 PUNCT fcis-5211 65 21 modeled model VERB fcis-5211 65 22 as as ADP fcis-5211 65 23 the the DET fcis-5211 65 24 manhattan manhattan PROPN fcis-5211 65 25 distance distance NOUN fcis-5211 65 26 . . PUNCT fcis-5211 66 1 𝜌 𝜌 ADP fcis-5211 66 2 ∼ ∼ VERB fcis-5211 66 3 𝑁(0 𝑁(0 NOUN fcis-5211 66 4 , , PUNCT fcis-5211 66 5 𝜎2 𝜎2 NOUN fcis-5211 66 6 ) ) PUNCT fcis-5211 66 7 is be AUX fcis-5211 66 8 the the DET fcis-5211 66 9 shadow shadow NOUN fcis-5211 66 10 fading fade VERB fcis-5211 66 11 model model NOUN fcis-5211 66 12 in in ADP fcis-5211 66 13 decibels decibel NOUN fcis-5211 66 14 , , PUNCT fcis-5211 66 15 and and CCONJ fcis-5211 66 16 𝜎 𝜎 PROPN fcis-5211 66 17 is be AUX fcis-5211 66 18 the the DET fcis-5211 66 19 standard standard ADJ fcis-5211 66 20 deviation deviation NOUN fcis-5211 66 21 . . PUNCT fcis-5211 67 1 2.1.2 2.1.2 X fcis-5211 67 2 . . X fcis-5211 67 3 communication communication NOUN fcis-5211 67 4 model model NOUN fcis-5211 67 5 𝐢𝑒,𝑒 𝐢𝑒,𝑒 PROPN fcis-5211 67 6 = = PUNCT fcis-5211 67 7 πœ†π‘πΆπ‘’,𝑒 πœ†π‘πΆπ‘’,𝑒 NUM fcis-5211 67 8 𝑐 𝑐 NOUN fcis-5211 68 1 + + NUM fcis-5211 68 2 πœ†π‘šπΆπ‘’,𝑒 πœ†π‘šπΆπ‘’,𝑒 X fcis-5211 68 3 π‘š π‘š ADP fcis-5211 68 4 𝑠. 𝑠. NOUN fcis-5211 68 5 𝑑. 𝑑. NOUN fcis-5211 68 6 πœ†π‘ πœ†π‘ ADP fcis-5211 68 7 = = PUNCT fcis-5211 68 8 { { PUNCT fcis-5211 68 9 0,1 0,1 NUM fcis-5211 68 10 } } PUNCT fcis-5211 68 11 , , PUNCT fcis-5211 68 12 πœ†π‘š πœ†π‘š ADP fcis-5211 68 13 = = SYM fcis-5211 68 14 { { PUNCT fcis-5211 68 15 0,1 0,1 NUM fcis-5211 68 16 } } PUNCT fcis-5211 68 17 , , PUNCT fcis-5211 68 18 πœ†π‘ πœ†π‘ ADP fcis-5211 68 19 + + CCONJ fcis-5211 68 20 πœ†π‘š πœ†π‘š X fcis-5211 68 21 = = SYM fcis-5211 68 22 1 1 NUM fcis-5211 68 23 ( ( PUNCT fcis-5211 68 24 4 4 NUM fcis-5211 68 25 ) ) PUNCT fcis-5211 68 26 whereπœ†π‘š whereπœ†π‘š NOUN fcis-5211 68 27 , , PUNCT fcis-5211 68 28 πœ†π‘š πœ†π‘š PROPN fcis-5211 68 29 are be AUX fcis-5211 68 30 the the DET fcis-5211 68 31 binary binary ADJ fcis-5211 68 32 variables variable NOUN fcis-5211 68 33 representing represent VERB fcis-5211 68 34 whether whether SCONJ fcis-5211 68 35 to to PART fcis-5211 68 36 use use VERB fcis-5211 68 37 5 5 NUM fcis-5211 68 38 g g NOUN fcis-5211 68 39 cellular cellular ADJ fcis-5211 68 40 network network NOUN fcis-5211 68 41 or or CCONJ fcis-5211 68 42 nr nr NOUN fcis-5211 68 43 mode mode NOUN fcis-5211 68 44 for for ADP fcis-5211 68 45 communication communication NOUN fcis-5211 68 46 , , PUNCT fcis-5211 68 47 respectively respectively ADV fcis-5211 68 48 ? ? PUNCT fcis-5211 69 1 when when SCONJ fcis-5211 69 2 πœ†π‘š πœ†π‘š X fcis-5211 69 3 = = SYM fcis-5211 69 4 1 1 NUM fcis-5211 69 5 time time NOUN fcis-5211 69 6 , , PUNCT fcis-5211 69 7 we we PRON fcis-5211 69 8 consider consider VERB fcis-5211 69 9 that that SCONJ fcis-5211 69 10 the the DET fcis-5211 69 11 vehicle𝑒 vehicle𝑒 NOUN fcis-5211 69 12 uses use VERB fcis-5211 69 13 5 5 NUM fcis-5211 69 14 g g NOUN fcis-5211 69 15 cellular cellular ADJ fcis-5211 69 16 network network NOUN fcis-5211 69 17 as as ADP fcis-5211 69 18 the the DET fcis-5211 69 19 communication communication NOUN fcis-5211 69 20 mode mode NOUN fcis-5211 69 21 , , PUNCT fcis-5211 69 22 soπœ†π‘š soπœ†π‘š NOUN fcis-5211 69 23 = = SYM fcis-5211 69 24 0 0 NUM fcis-5211 70 1 and and CCONJ fcis-5211 70 2 vice vice ADV fcis-5211 70 3 versa versa ADV fcis-5211 70 4 whenπœ†π‘š whenπœ†π‘š VERB fcis-5211 70 5 = = SYM fcis-5211 70 6 0 0 NUM fcis-5211 70 7 whenπœ†π‘š whenπœ†π‘š NOUN fcis-5211 70 8 = = SYM fcis-5211 70 9 1 1 NUM fcis-5211 70 10 we we PRON fcis-5211 70 11 consider consider VERB fcis-5211 70 12 that that SCONJ fcis-5211 70 13 the the DET fcis-5211 70 14 vehicle vehicle NOUN fcis-5211 70 15 𝑒 𝑒 PROPN fcis-5211 70 16 uses use VERB fcis-5211 70 17 nr nr PRON fcis-5211 70 18 mode mode NOUN fcis-5211 70 19 as as ADP fcis-5211 70 20 the the DET fcis-5211 70 21 communication communication NOUN fcis-5211 70 22 method method NOUN fcis-5211 70 23 . . PUNCT fcis-5211 71 1 2.2 2.2 NUM fcis-5211 71 2 . . PUNCT fcis-5211 71 3 v2x v2x VERB fcis-5211 71 4 migration migration NOUN fcis-5211 71 5 cost cost NOUN fcis-5211 71 6 model model NOUN fcis-5211 71 7 in in ADP fcis-5211 71 8 this this DET fcis-5211 71 9 paper paper NOUN fcis-5211 71 10 , , PUNCT fcis-5211 71 11 we we PRON fcis-5211 71 12 use use VERB fcis-5211 71 13 the the DET fcis-5211 71 14 platform platform NOUN fcis-5211 71 15 as as ADP fcis-5211 71 16 a a DET fcis-5211 71 17 service service NOUN fcis-5211 71 18 ( ( PUNCT fcis-5211 71 19 paas paas NOUN fcis-5211 71 20 ) ) PUNCT fcis-5211 71 21 paradigm paradigm NOUN fcis-5211 71 22 and and CCONJ fcis-5211 71 23 use use VERB fcis-5211 71 24 docker docker PROPN fcis-5211 71 25 technology technology NOUN fcis-5211 71 26 . . PUNCT fcis-5211 72 1 this this DET fcis-5211 72 2 technology technology NOUN fcis-5211 72 3 has have VERB fcis-5211 72 4 mechanisms mechanism NOUN fcis-5211 72 5 to to PART fcis-5211 72 6 enhance enhance VERB fcis-5211 72 7 application application NOUN fcis-5211 72 8 portability portability NOUN fcis-5211 72 9 and and CCONJ fcis-5211 72 10 allows allow VERB fcis-5211 72 11 applications application NOUN fcis-5211 72 12 to to PART fcis-5211 72 13 be be AUX fcis-5211 72 14 deployed deploy VERB fcis-5211 72 15 everywhere everywhere ADV fcis-5211 72 16 without without ADP fcis-5211 72 17 environmental environmental ADJ fcis-5211 72 18 differences difference NOUN fcis-5211 72 19 . . PUNCT fcis-5211 73 1 then then ADV fcis-5211 73 2 we we PRON fcis-5211 73 3 can can AUX fcis-5211 73 4 model model VERB fcis-5211 73 5 the the DET fcis-5211 73 6 migration migration NOUN fcis-5211 73 7 cost cost NOUN fcis-5211 73 8 as as ADP fcis-5211 73 9 following follow VERB fcis-5211 73 10 . . PUNCT fcis-5211 74 1 we we PRON fcis-5211 74 2 consider consider VERB fcis-5211 74 3 that that SCONJ fcis-5211 74 4 each each DET fcis-5211 74 5 vehicle vehicle NOUN fcis-5211 74 6 under under ADP fcis-5211 74 7 a a DET fcis-5211 74 8 v2x v2x NOUN fcis-5211 74 9 network network NOUN fcis-5211 74 10 contain contain NOUN fcis-5211 74 11 has have AUX fcis-5211 74 12 computing compute VERB fcis-5211 74 13 tasks task NOUN fcis-5211 74 14 and and CCONJ fcis-5211 74 15 that that SCONJ fcis-5211 74 16 the the DET fcis-5211 74 17 tasks task NOUN fcis-5211 74 18 are be AUX fcis-5211 74 19 defined define VERB fcis-5211 74 20 in in ADP fcis-5211 74 21 the the DET fcis-5211 74 22 following follow VERB fcis-5211 74 23 binary binary NOUN fcis-5211 74 24 . . PUNCT fcis-5211 75 1 π‘‡π‘š π‘‡π‘š PROPN fcis-5211 75 2 = = PRON fcis-5211 75 3 { { PUNCT fcis-5211 75 4 𝑝𝑒 𝑝𝑒 NOUN fcis-5211 75 5 , , PUNCT fcis-5211 75 6 𝑆𝑒 𝑆𝑒 PROPN fcis-5211 75 7 } } PUNCT fcis-5211 75 8 ( ( PUNCT fcis-5211 75 9 5 5 NUM fcis-5211 75 10 ) ) PUNCT fcis-5211 75 11 where where SCONJ fcis-5211 75 12 π‘π‘š π‘π‘š NOUN fcis-5211 75 13 is be AUX fcis-5211 75 14 the the DET fcis-5211 75 15 number number NOUN fcis-5211 75 16 of of ADP fcis-5211 75 17 computing compute VERB fcis-5211 75 18 resources resource NOUN fcis-5211 75 19 required require VERB fcis-5211 75 20 to to PART fcis-5211 75 21 complete complete VERB fcis-5211 75 22 the the DET fcis-5211 75 23 task task NOUN fcis-5211 75 24 π‘‡π‘š π‘‡π‘š SCONJ fcis-5211 75 25 the the DET fcis-5211 75 26 computing computing NOUN fcis-5211 75 27 resources resource NOUN fcis-5211 75 28 required require VERB fcis-5211 75 29 to to PART fcis-5211 75 30 complete complete VERB fcis-5211 75 31 the the DET fcis-5211 75 32 task task NOUN fcis-5211 75 33 , , PUNCT fcis-5211 75 34 andπ‘†π‘š andπ‘†π‘š NOUN fcis-5211 75 35 represents represent VERB fcis-5211 75 36 the the DET fcis-5211 75 37 vehicle vehicle NOUN fcis-5211 75 38 𝑒 𝑒 NOUN fcis-5211 75 39 the the DET fcis-5211 75 40 size size NOUN fcis-5211 75 41 of of ADP fcis-5211 75 42 the the DET fcis-5211 75 43 service service NOUN fcis-5211 75 44 image image NOUN fcis-5211 75 45 executed execute VERB fcis-5211 75 46 . . PUNCT fcis-5211 76 1 we we PRON fcis-5211 76 2 assume assume VERB fcis-5211 76 3 that that SCONJ fcis-5211 76 4 the the DET fcis-5211 76 5 vehicle vehicle NOUN fcis-5211 76 6 𝑒 𝑒 PRON fcis-5211 76 7 unload unload VERB fcis-5211 76 8 service service NOUN fcis-5211 76 9 to to ADP fcis-5211 76 10 a a DET fcis-5211 76 11 remote remote ADJ fcis-5211 76 12 rsu rsu NOUN fcis-5211 76 13 𝑒 𝑒 NOUN fcis-5211 76 14 with with ADP fcis-5211 76 15 a a DET fcis-5211 76 16 ratio ratio NOUN fcis-5211 76 17 of of ADP fcis-5211 76 18 πœ”π‘’,𝑒 πœ”π‘’,𝑒 PUNCT fcis-5211 76 19 vec vec PROPN fcis-5211 76 20 and and CCONJ fcis-5211 76 21 therefore therefore ADV fcis-5211 76 22 πœ”π‘š πœ”π‘š PROPN fcis-5211 76 23 loc loc PROPN fcis-5211 76 24 = = PROPN fcis-5211 76 25 1 1 NUM fcis-5211 76 26 βˆ’ βˆ’ NOUN fcis-5211 76 27 πœ”π‘’,𝑒 πœ”π‘’,𝑒 PUNCT fcis-5211 76 28 vec vec PROPN fcis-5211 76 29 is be AUX fcis-5211 76 30 the the DET fcis-5211 76 31 ratio ratio NOUN fcis-5211 76 32 that that PRON fcis-5211 76 33 vehicle vehicle NOUN fcis-5211 76 34 𝑒 𝑒 PROPN fcis-5211 76 35 compute compute PROPN fcis-5211 76 36 service service NOUN fcis-5211 76 37 locally locally ADV fcis-5211 76 38 . . PUNCT fcis-5211 77 1 considering consider VERB fcis-5211 77 2 the the DET fcis-5211 77 3 service service NOUN fcis-5211 77 4 image image NOUN fcis-5211 77 5 size size NOUN fcis-5211 77 6 , , PUNCT fcis-5211 77 7 the the DET fcis-5211 77 8 service service NOUN fcis-5211 77 9 image image NOUN fcis-5211 77 10 size size NOUN fcis-5211 77 11 executed execute VERB fcis-5211 77 12 at at ADP fcis-5211 77 13 the the DET fcis-5211 77 14 rsu rsu PROPN fcis-5211 77 15 𝑒 𝑒 PROPN fcis-5211 77 16 is be AUX fcis-5211 77 17 𝑆𝑒,𝑒 𝑆𝑒,𝑒 PROPN fcis-5211 77 18 vec vec PROPN fcis-5211 77 19 = = PROPN fcis-5211 77 20 πœ”π‘’ πœ”π‘’ PROPN fcis-5211 77 21 loc loc PROPN fcis-5211 77 22 Γ— Γ— PROPN fcis-5211 77 23 𝑆𝑒 𝑆𝑒 PROPN fcis-5211 77 24 . . PUNCT fcis-5211 78 1 thus thus ADV fcis-5211 78 2 , , PUNCT fcis-5211 78 3 the the DET fcis-5211 78 4 migration migration NOUN fcis-5211 78 5 cost cost NOUN fcis-5211 78 6 can can AUX fcis-5211 78 7 be be AUX fcis-5211 78 8 calculated calculate VERB fcis-5211 78 9 as as ADP fcis-5211 78 10 : : PUNCT fcis-5211 78 11 50 50 NUM fcis-5211 78 12 𝐺𝑒,𝑒 𝐺𝑒,𝑒 NOUN fcis-5211 78 13 mig mig X fcis-5211 78 14 = = SYM fcis-5211 78 15 𝑆𝑒,𝑒 𝑆𝑒,𝑒 PROPN fcis-5211 78 16 vec vec PROPN fcis-5211 78 17 𝐢𝑒,𝑒 𝐢𝑒,𝑒 PROPN fcis-5211 78 18 = = PROPN fcis-5211 78 19 πœ”π‘’ πœ”π‘’ PROPN fcis-5211 78 20 loc loc PROPN fcis-5211 78 21 Γ— Γ— PROPN fcis-5211 78 22 𝑆𝑒 𝑆𝑒 PROPN fcis-5211 78 23 πœ†π‘πΆπ‘’,𝑒 πœ†π‘πΆπ‘’,𝑒 NOUN fcis-5211 78 24 𝑐 𝑐 NOUN fcis-5211 79 1 + + NUM fcis-5211 79 2 πœ†π‘šπΆπ‘’,𝑒 πœ†π‘šπΆπ‘’,𝑒 PUNCT fcis-5211 79 3 π‘š π‘š ADP fcis-5211 79 4 𝑠. 𝑠. NOUN fcis-5211 79 5 𝑑. 𝑑. NOUN fcis-5211 79 6 πœ†π‘ πœ†π‘ ADP fcis-5211 79 7 = = PUNCT fcis-5211 79 8 { { PUNCT fcis-5211 79 9 0,1 0,1 NUM fcis-5211 79 10 } } PUNCT fcis-5211 79 11 , , PUNCT fcis-5211 79 12 πœ†π‘š πœ†π‘š ADP fcis-5211 79 13 = = SYM fcis-5211 79 14 { { PUNCT fcis-5211 79 15 0,1 0,1 NUM fcis-5211 79 16 } } PUNCT fcis-5211 79 17 , , PUNCT fcis-5211 79 18 πœ†π‘ πœ†π‘ ADP fcis-5211 79 19 + + CCONJ fcis-5211 79 20 πœ†π‘š πœ†π‘š X fcis-5211 79 21 = = SYM fcis-5211 79 22 1 1 NUM fcis-5211 79 23 ( ( PUNCT fcis-5211 79 24 6 6 NUM fcis-5211 79 25 ) ) PUNCT fcis-5211 79 26 2.3 2.3 NUM fcis-5211 79 27 . . PUNCT fcis-5211 80 1 v2x v2x VERB fcis-5211 80 2 computing compute VERB fcis-5211 80 3 cost cost NOUN fcis-5211 80 4 model model NOUN fcis-5211 80 5 in in ADP fcis-5211 80 6 the the DET fcis-5211 80 7 following following NOUN fcis-5211 80 8 , , PUNCT fcis-5211 80 9 we we PRON fcis-5211 80 10 present present VERB fcis-5211 80 11 two two NUM fcis-5211 80 12 computing computing NOUN fcis-5211 80 13 models model NOUN fcis-5211 80 14 , , PUNCT fcis-5211 80 15 local local ADJ fcis-5211 80 16 computation computation NOUN fcis-5211 80 17 and and CCONJ fcis-5211 80 18 remote remote ADJ fcis-5211 80 19 computation computation NOUN fcis-5211 80 20 , , PUNCT fcis-5211 80 21 to to PART fcis-5211 80 22 further far ADV fcis-5211 80 23 specify specify VERB fcis-5211 80 24 our our PRON fcis-5211 80 25 computing computing NOUN fcis-5211 80 26 model model NOUN fcis-5211 80 27 . . PUNCT fcis-5211 81 1 1 1 NUM fcis-5211 81 2 οΌ‰ οΌ‰ NOUN fcis-5211 81 3 local local ADJ fcis-5211 81 4 computing computing NOUN fcis-5211 81 5 when when SCONJ fcis-5211 81 6 a a DET fcis-5211 81 7 vehicle vehicle NOUN fcis-5211 81 8 𝑒 𝑒 NOUN fcis-5211 81 9 is be AUX fcis-5211 81 10 on on ADP fcis-5211 81 11 a a DET fcis-5211 81 12 local local ADJ fcis-5211 81 13 computing computing NOUN fcis-5211 81 14 task task NOUN fcis-5211 81 15 , , PUNCT fcis-5211 81 16 the the DET fcis-5211 81 17 computing computing NOUN fcis-5211 81 18 cost cost NOUN fcis-5211 81 19 depends depend VERB fcis-5211 81 20 on on ADP fcis-5211 81 21 its its PRON fcis-5211 81 22 available available ADJ fcis-5211 81 23 resources resource NOUN fcis-5211 81 24 . . PUNCT fcis-5211 82 1 we we PRON fcis-5211 82 2 consider consider VERB fcis-5211 82 3 that that SCONJ fcis-5211 82 4 π‘“π‘š π‘“π‘š PROPN fcis-5211 82 5 loc loc PROPN fcis-5211 82 6 is be AUX fcis-5211 82 7 the the DET fcis-5211 82 8 computing compute VERB fcis-5211 82 9 resources resource NOUN fcis-5211 82 10 of of ADP fcis-5211 82 11 vehicle vehicle NOUN fcis-5211 82 12 𝑒 𝑒 NOUN fcis-5211 82 13 , , PUNCT fcis-5211 82 14 then then ADV fcis-5211 82 15 the the DET fcis-5211 82 16 local local ADJ fcis-5211 82 17 computing computing NOUN fcis-5211 82 18 time time NOUN fcis-5211 82 19 π‘‘π‘š π‘‘π‘š PROPN fcis-5211 82 20 loc loc PROPN fcis-5211 82 21 can can AUX fcis-5211 82 22 be be AUX fcis-5211 82 23 obtained obtain VERB fcis-5211 82 24 as as ADP fcis-5211 82 25 : : PUNCT fcis-5211 82 26 π‘‘π‘š π‘‘π‘š PROPN fcis-5211 82 27 loc loc PROPN fcis-5211 82 28 = = SYM fcis-5211 82 29 𝑝𝑒 𝑝𝑒 PROPN fcis-5211 82 30 𝑓𝑒 𝑓𝑒 X fcis-5211 82 31 loc loc PROPN fcis-5211 82 32 ( ( PUNCT fcis-5211 82 33 7 7 NUM fcis-5211 82 34 ) ) SYM fcis-5211 82 35 1 1 NUM fcis-5211 82 36 οΌ‰ οΌ‰ NOUN fcis-5211 82 37 remote remote VERB fcis-5211 82 38 vec vec PROPN fcis-5211 82 39 computing computing PROPN fcis-5211 82 40 when when SCONJ fcis-5211 82 41 local local ADJ fcis-5211 82 42 computing compute VERB fcis-5211 82 43 resources resource NOUN fcis-5211 82 44 are be AUX fcis-5211 82 45 strained strain VERB fcis-5211 82 46 or or CCONJ fcis-5211 82 47 the the DET fcis-5211 82 48 computing computing NOUN fcis-5211 82 49 load load NOUN fcis-5211 82 50 is be AUX fcis-5211 82 51 too too ADV fcis-5211 82 52 high high ADJ fcis-5211 82 53 , , PUNCT fcis-5211 82 54 we we PRON fcis-5211 82 55 plan plan VERB fcis-5211 82 56 to to PART fcis-5211 82 57 offload offload VERB fcis-5211 82 58 the the DET fcis-5211 82 59 service service NOUN fcis-5211 82 60 to to ADP fcis-5211 82 61 a a DET fcis-5211 82 62 remote remote ADJ fcis-5211 82 63 roadside roadside NOUN fcis-5211 82 64 unit unit NOUN fcis-5211 82 65 for for ADP fcis-5211 82 66 computation computation NOUN fcis-5211 82 67 . . PUNCT fcis-5211 83 1 like like ADP fcis-5211 83 2 many many ADJ fcis-5211 83 3 applications application NOUN fcis-5211 83 4 , , PUNCT fcis-5211 83 5 i.e. i.e. X fcis-5211 83 6 , , PUNCT fcis-5211 83 7 road road NOUN fcis-5211 83 8 detection detection NOUN fcis-5211 83 9 , , PUNCT fcis-5211 83 10 smart smart ADJ fcis-5211 83 11 braking braking NOUN fcis-5211 83 12 , , PUNCT fcis-5211 83 13 etc etc X fcis-5211 83 14 . . X fcis-5211 83 15 , , PUNCT fcis-5211 83 16 the the DET fcis-5211 83 17 reception reception NOUN fcis-5211 83 18 time time NOUN fcis-5211 83 19 of of ADP fcis-5211 83 20 the the DET fcis-5211 83 21 computation computation NOUN fcis-5211 83 22 results result NOUN fcis-5211 83 23 returned return VERB fcis-5211 83 24 from from ADP fcis-5211 83 25 the the DET fcis-5211 83 26 roadside roadside NOUN fcis-5211 83 27 unit unit NOUN fcis-5211 83 28 is be AUX fcis-5211 83 29 ignored ignore VERB fcis-5211 83 30 because because SCONJ fcis-5211 83 31 the the DET fcis-5211 83 32 size size NOUN fcis-5211 83 33 of of ADP fcis-5211 83 34 the the DET fcis-5211 83 35 data datum NOUN fcis-5211 83 36 transferred transfer VERB fcis-5211 83 37 back back ADV fcis-5211 83 38 from from ADP fcis-5211 83 39 the the DET fcis-5211 83 40 roadside roadside NOUN fcis-5211 83 41 unit unit NOUN fcis-5211 83 42 is be AUX fcis-5211 83 43 negligible negligible ADJ fcis-5211 83 44 compared compare VERB fcis-5211 83 45 to to ADP fcis-5211 83 46 the the DET fcis-5211 83 47 size size NOUN fcis-5211 83 48 of of ADP fcis-5211 83 49 the the DET fcis-5211 83 50 output output NOUN fcis-5211 83 51 mirror mirror NOUN fcis-5211 83 52 . . PUNCT fcis-5211 84 1 in in ADP fcis-5211 84 2 this this DET fcis-5211 84 3 case case NOUN fcis-5211 84 4 , , PUNCT fcis-5211 84 5 π‘‘π‘š π‘‘π‘š PROPN fcis-5211 84 6 vec vec PROPN fcis-5211 84 7 indicates indicate VERB fcis-5211 84 8 that that SCONJ fcis-5211 84 9 the the DET fcis-5211 84 10 service service NOUN fcis-5211 84 11 execution execution NOUN fcis-5211 84 12 time time NOUN fcis-5211 84 13 can can AUX fcis-5211 84 14 be be AUX fcis-5211 84 15 expressed express VERB fcis-5211 84 16 as as ADP fcis-5211 84 17 : : PUNCT fcis-5211 84 18 𝑑𝑒 𝑑𝑒 PROPN fcis-5211 84 19 vec vec PROPN fcis-5211 84 20 = = PUNCT fcis-5211 84 21 𝑝𝑒 𝑝𝑒 PROPN fcis-5211 84 22 𝑓𝑒 𝑓𝑒 PROPN fcis-5211 84 23 vec vec PROPN fcis-5211 84 24 ( ( PUNCT fcis-5211 84 25 8) 8) NUM fcis-5211 84 26 where where SCONJ fcis-5211 84 27 𝑓𝑒 𝑓𝑒 PROPN fcis-5211 84 28 vec vec PROPN fcis-5211 84 29 denotes denote VERB fcis-5211 84 30 the the DET fcis-5211 84 31 computing computing NOUN fcis-5211 84 32 resources resource NOUN fcis-5211 84 33 the the DET fcis-5211 84 34 rsu rsu NOUN fcis-5211 84 35 allocated allocate VERB fcis-5211 84 36 to to ADP fcis-5211 84 37 the the DET fcis-5211 84 38 vehicle vehicle NOUN fcis-5211 84 39 𝑒 𝑒 NOUN fcis-5211 84 40 , , PUNCT fcis-5211 84 41 π‘π‘š π‘π‘š SCONJ fcis-5211 84 42 is be AUX fcis-5211 84 43 the the DET fcis-5211 84 44 number number NOUN fcis-5211 84 45 of of ADP fcis-5211 84 46 computing compute VERB fcis-5211 84 47 resources resource NOUN fcis-5211 84 48 required require VERB fcis-5211 84 49 to to PART fcis-5211 84 50 complete complete VERB fcis-5211 84 51 the the DET fcis-5211 84 52 task task NOUN fcis-5211 84 53 π‘‡π‘š. π‘‡π‘š. PROPN fcis-5211 84 54 we we PRON fcis-5211 84 55 assume assume VERB fcis-5211 84 56 that that SCONJ fcis-5211 84 57 the the DET fcis-5211 84 58 vehicle vehicle NOUN fcis-5211 84 59 𝑒 𝑒 NOUN fcis-5211 84 60 offloading offload VERB fcis-5211 84 61 service service NOUN fcis-5211 84 62 to to ADP fcis-5211 84 63 a a DET fcis-5211 84 64 remote remote ADJ fcis-5211 84 65 roadside roadside NOUN fcis-5211 84 66 unit𝑒 unit𝑒 ADJ fcis-5211 84 67 with with ADP fcis-5211 84 68 a a DET fcis-5211 84 69 offloading offload VERB fcis-5211 84 70 ratio ratio NOUN fcis-5211 84 71 of of ADP fcis-5211 84 72 πœ”π‘’,𝑒 πœ”π‘’,𝑒 PUNCT fcis-5211 84 73 vec vec PROPN fcis-5211 84 74 and and CCONJ fcis-5211 84 75 therefore therefore ADV fcis-5211 84 76 πœ”π‘š πœ”π‘š PROPN fcis-5211 84 77 loc loc PROPN fcis-5211 84 78 = = PROPN fcis-5211 84 79 1 1 NUM fcis-5211 84 80 βˆ’ βˆ’ NOUN fcis-5211 84 81 πœ”π‘’,𝑒 πœ”π‘’,𝑒 PUNCT fcis-5211 84 82 vec vec PROPN fcis-5211 84 83 is be AUX fcis-5211 84 84 the the DET fcis-5211 84 85 proportion proportion NOUN fcis-5211 84 86 of of ADP fcis-5211 84 87 vehicle vehicle NOUN fcis-5211 84 88 𝑒 𝑒 ADP fcis-5211 84 89 the the DET fcis-5211 84 90 proportion proportion NOUN fcis-5211 84 91 of of ADP fcis-5211 84 92 services service NOUN fcis-5211 84 93 offloaded offload VERB fcis-5211 84 94 to to PART fcis-5211 84 95 be be AUX fcis-5211 84 96 performed perform VERB fcis-5211 84 97 locally locally ADV fcis-5211 84 98 . . PUNCT fcis-5211 85 1 based base VERB fcis-5211 85 2 on on ADP fcis-5211 85 3 the the DET fcis-5211 85 4 service service NOUN fcis-5211 85 5 mirror mirror NOUN fcis-5211 85 6 size size NOUN fcis-5211 85 7 , , PUNCT fcis-5211 85 8 we we PRON fcis-5211 85 9 can can AUX fcis-5211 85 10 derive derive VERB fcis-5211 85 11 the the DET fcis-5211 85 12 percentage percentage NOUN fcis-5211 85 13 of of ADP fcis-5211 85 14 services service NOUN fcis-5211 85 15 executed execute VERB fcis-5211 85 16 at at ADP fcis-5211 85 17 the the DET fcis-5211 85 18 remote remote ADJ fcis-5211 85 19 rsu rsu PROPN fcis-5211 85 20 𝑒 𝑒 PROPN fcis-5211 85 21 the the DET fcis-5211 85 22 mirror mirror NOUN fcis-5211 85 23 size size NOUN fcis-5211 85 24 of of ADP fcis-5211 85 25 the the DET fcis-5211 85 26 services service NOUN fcis-5211 85 27 executed execute VERB fcis-5211 85 28 is be AUX fcis-5211 85 29 𝑆𝑒,𝑒 𝑆𝑒,𝑒 PROPN fcis-5211 85 30 vec vec PROPN fcis-5211 85 31 = = PROPN fcis-5211 85 32 πœ”π‘’ πœ”π‘’ PROPN fcis-5211 85 33 loc loc PROPN fcis-5211 85 34 Γ— Γ— PROPN fcis-5211 85 35 𝑆𝑒 𝑆𝑒 PROPN fcis-5211 85 36 . . PUNCT fcis-5211 86 1 thus thus ADV fcis-5211 86 2 , , PUNCT fcis-5211 86 3 the the DET fcis-5211 86 4 cost cost NOUN fcis-5211 86 5 is be AUX fcis-5211 86 6 calculated calculate VERB fcis-5211 86 7 as as ADP fcis-5211 86 8 : : PUNCT fcis-5211 86 9 𝐺𝑒,𝑒 𝐺𝑒,𝑒 NOUN fcis-5211 86 10 comp comp NOUN fcis-5211 86 11 = = SYM fcis-5211 86 12 πœ”π‘’ πœ”π‘’ PROPN fcis-5211 86 13 loc𝑑𝑒 loc𝑑𝑒 PROPN fcis-5211 86 14 loc loc PROPN fcis-5211 87 1 + + CCONJ fcis-5211 87 2 πœ”π‘’,𝑒 πœ”π‘’,𝑒 PUNCT fcis-5211 87 3 vec𝑑𝑒 vec𝑑𝑒 VERB fcis-5211 87 4 vec vec PROPN fcis-5211 87 5 = = SYM fcis-5211 87 6 πœ”π‘š πœ”π‘š PROPN fcis-5211 87 7 loc loc PROPN fcis-5211 87 8 𝑝𝑒 𝑝𝑒 PROPN fcis-5211 87 9 𝑓𝑒 𝑓𝑒 PROPN fcis-5211 87 10 loc loc PROPN fcis-5211 88 1 + + PROPN fcis-5211 88 2 πœ”π‘’,𝑒 πœ”π‘’,𝑒 PUNCT fcis-5211 88 3 vec vec PROPN fcis-5211 88 4 𝑝𝑒 𝑝𝑒 PROPN fcis-5211 88 5 𝑓𝑒 𝑓𝑒 PROPN fcis-5211 88 6 vec vec PROPN fcis-5211 88 7 ( ( PUNCT fcis-5211 88 8 9 9 NUM fcis-5211 88 9 ) ) PUNCT fcis-5211 88 10 2.4 2.4 NUM fcis-5211 88 11 . . PUNCT fcis-5211 89 1 v2x v2x VERB fcis-5211 89 2 energy energy NOUN fcis-5211 89 3 consumption consumption NOUN fcis-5211 89 4 model model NOUN fcis-5211 89 5 2 2 NUM fcis-5211 89 6 οΌ‰ οΌ‰ NOUN fcis-5211 89 7 local local ADJ fcis-5211 89 8 computing computing NOUN fcis-5211 89 9 when when SCONJ fcis-5211 89 10 a a DET fcis-5211 89 11 vehicle vehicle NOUN fcis-5211 89 12 𝑒 𝑒 PRON fcis-5211 89 13 computes compute VERB fcis-5211 89 14 tasks task NOUN fcis-5211 89 15 locally locally ADV fcis-5211 89 16 , , PUNCT fcis-5211 89 17 the the DET fcis-5211 89 18 computation computation NOUN fcis-5211 89 19 time time NOUN fcis-5211 89 20 and and CCONJ fcis-5211 89 21 energy energy NOUN fcis-5211 89 22 consumption consumption NOUN fcis-5211 89 23 depend depend VERB fcis-5211 89 24 on on ADP fcis-5211 89 25 its its PRON fcis-5211 89 26 available available ADJ fcis-5211 89 27 resources resource NOUN fcis-5211 89 28 . . PUNCT fcis-5211 90 1 we we PRON fcis-5211 90 2 consider consider VERB fcis-5211 90 3 π‘“π‘š π‘“π‘š PROPN fcis-5211 90 4 loc loc PROPN fcis-5211 90 5 as as ADP fcis-5211 90 6 the the DET fcis-5211 90 7 available available ADJ fcis-5211 90 8 computing compute VERB fcis-5211 90 9 resources resource NOUN fcis-5211 90 10 of of ADP fcis-5211 90 11 vehicle vehicle NOUN fcis-5211 90 12 𝑒 𝑒 NOUN fcis-5211 90 13 . . PUNCT fcis-5211 91 1 then then ADV fcis-5211 91 2 , , PUNCT fcis-5211 91 3 the the DET fcis-5211 91 4 local local ADJ fcis-5211 91 5 computation computation NOUN fcis-5211 91 6 energy energy NOUN fcis-5211 91 7 consumption consumption NOUN fcis-5211 91 8 π‘ƒπ‘š π‘ƒπ‘š PROPN fcis-5211 91 9 loc loc NOUN fcis-5211 91 10 can can AUX fcis-5211 91 11 be be AUX fcis-5211 91 12 calculated calculate VERB fcis-5211 91 13 as as ADP fcis-5211 91 14 following follow VERB fcis-5211 91 15 : : PUNCT fcis-5211 91 16 π‘ƒπ‘š π‘ƒπ‘š PROPN fcis-5211 91 17 loc loc NOUN fcis-5211 91 18 = = PUNCT fcis-5211 91 19 πœ—π‘’ πœ—π‘’ PROPN fcis-5211 91 20 Γ— Γ— PROPN fcis-5211 91 21 𝑝𝑒 𝑝𝑒 PROPN fcis-5211 91 22 ( ( PUNCT fcis-5211 91 23 10 10 NUM fcis-5211 91 24 ) ) PUNCT fcis-5211 91 25 where where SCONJ fcis-5211 91 26 πœ—π‘š πœ—π‘š NOUN fcis-5211 91 27 denotes denote VERB fcis-5211 91 28 the the DET fcis-5211 91 29 energy energy NOUN fcis-5211 91 30 consumption consumption NOUN fcis-5211 91 31 price price NOUN fcis-5211 91 32 of of ADP fcis-5211 91 33 local local ADJ fcis-5211 91 34 computing compute VERB fcis-5211 91 35 resources resource NOUN fcis-5211 91 36 . . PUNCT fcis-5211 92 1 3 3 NUM fcis-5211 92 2 οΌ‰ οΌ‰ NOUN fcis-5211 92 3 remote remote VERB fcis-5211 92 4 vec vec PROPN fcis-5211 92 5 computing computing NOUN fcis-5211 92 6 when when SCONJ fcis-5211 92 7 the the DET fcis-5211 92 8 local local ADJ fcis-5211 92 9 computing compute VERB fcis-5211 92 10 resources resource NOUN fcis-5211 92 11 are be AUX fcis-5211 92 12 tight tight ADJ fcis-5211 92 13 or or CCONJ fcis-5211 92 14 the the DET fcis-5211 92 15 computing computing NOUN fcis-5211 92 16 load load NOUN fcis-5211 92 17 is be AUX fcis-5211 92 18 too too ADV fcis-5211 92 19 high high ADJ fcis-5211 92 20 , , PUNCT fcis-5211 92 21 we we PRON fcis-5211 92 22 plan plan VERB fcis-5211 92 23 to to PART fcis-5211 92 24 offload offload VERB fcis-5211 92 25 the the DET fcis-5211 92 26 service service NOUN fcis-5211 92 27 to to ADP fcis-5211 92 28 the the DET fcis-5211 92 29 rsu rsu NOUN fcis-5211 92 30 . . PUNCT fcis-5211 93 1 in in ADP fcis-5211 93 2 this this DET fcis-5211 93 3 case case NOUN fcis-5211 93 4 , , PUNCT fcis-5211 93 5 the the DET fcis-5211 93 6 energy energy NOUN fcis-5211 93 7 consumption consumption NOUN fcis-5211 93 8 of of ADP fcis-5211 93 9 the the DET fcis-5211 93 10 rsu rsu PROPN fcis-5211 93 11 𝑒 𝑒 PROPN fcis-5211 93 12 can can AUX fcis-5211 93 13 be be AUX fcis-5211 93 14 calculated calculate VERB fcis-5211 93 15 as as ADP fcis-5211 93 16 following follow VERB fcis-5211 93 17 : : PUNCT fcis-5211 93 18 𝑃𝑒,e 𝑃𝑒,e PROPN fcis-5211 93 19 vec vec PROPN fcis-5211 93 20 = = PROPN fcis-5211 93 21 πœ—π‘’ πœ—π‘’ PROPN fcis-5211 93 22 Γ— Γ— PROPN fcis-5211 93 23 𝑆𝑒,𝑒 𝑆𝑒,𝑒 PROPN fcis-5211 93 24 vec vec PROPN fcis-5211 93 25 𝐢𝑒,𝑒 𝐢𝑒,𝑒 PROPN fcis-5211 93 26 ( ( PUNCT fcis-5211 93 27 11 11 NUM fcis-5211 93 28 ) ) PUNCT fcis-5211 93 29 where where SCONJ fcis-5211 93 30 πœ—π‘š πœ—π‘š NOUN fcis-5211 93 31 denotes denote VERB fcis-5211 93 32 the the DET fcis-5211 93 33 average average ADJ fcis-5211 93 34 transmission transmission NOUN fcis-5211 93 35 power power NOUN fcis-5211 93 36 of of ADP fcis-5211 93 37 the the DET fcis-5211 93 38 vehicle vehicle NOUN fcis-5211 93 39 𝑒 𝑒 NOUN fcis-5211 93 40 during during ADP fcis-5211 93 41 migration migration NOUN fcis-5211 93 42 . . PUNCT fcis-5211 94 1 𝑆𝑒,𝑒 𝑆𝑒,𝑒 PROPN fcis-5211 94 2 vec vec PROPN fcis-5211 94 3 is be AUX fcis-5211 94 4 the the DET fcis-5211 94 5 size size NOUN fcis-5211 94 6 of of ADP fcis-5211 94 7 the the DET fcis-5211 94 8 service service NOUN fcis-5211 94 9 image image NOUN fcis-5211 94 10 , , PUNCT fcis-5211 94 11 𝐢𝑒,𝑒 𝐢𝑒,𝑒 PROPN fcis-5211 94 12 is be AUX fcis-5211 94 13 the the DET fcis-5211 94 14 data data NOUN fcis-5211 94 15 transfer transfer NOUN fcis-5211 94 16 rate rate NOUN fcis-5211 94 17 of of ADP fcis-5211 94 18 vehicle𝑒 vehicle𝑒 NOUN fcis-5211 94 19 . . PUNCT fcis-5211 95 1 thus thus ADV fcis-5211 95 2 the the DET fcis-5211 95 3 vehicle vehicle NOUN fcis-5211 95 4 𝑒 𝑒 PROPN fcis-5211 95 5 energy energy NOUN fcis-5211 95 6 consumption consumption NOUN fcis-5211 95 7 can can AUX fcis-5211 95 8 be be AUX fcis-5211 95 9 expressed express VERB fcis-5211 95 10 as as ADP fcis-5211 95 11 : : PUNCT fcis-5211 95 12 𝑃𝑒,e 𝑃𝑒,e PROPN fcis-5211 95 13 = = PUNCT fcis-5211 95 14 𝑃𝑒 𝑃𝑒 NOUN fcis-5211 95 15 loc loc NOUN fcis-5211 96 1 + + CCONJ fcis-5211 97 1 𝑃𝑒,e 𝑃𝑒,e PROPN fcis-5211 97 2 vec vec PROPN fcis-5211 97 3 ( ( PUNCT fcis-5211 97 4 12 12 NUM fcis-5211 97 5 ) ) PUNCT fcis-5211 97 6 2.5 2.5 NUM fcis-5211 97 7 . . PUNCT fcis-5211 97 8 v2x v2x VERB fcis-5211 97 9 mobility mobility NOUN fcis-5211 97 10 model model NOUN fcis-5211 97 11 in in ADP fcis-5211 97 12 this this DET fcis-5211 97 13 section section NOUN fcis-5211 97 14 , , PUNCT fcis-5211 97 15 we we PRON fcis-5211 97 16 consider consider VERB fcis-5211 97 17 the the DET fcis-5211 97 18 position position NOUN fcis-5211 97 19 of of ADP fcis-5211 97 20 the the DET fcis-5211 97 21 vehicle vehicle NOUN fcis-5211 97 22 relative relative ADJ fcis-5211 97 23 to to ADP fcis-5211 97 24 the the DET fcis-5211 97 25 rsu rsu NOUN fcis-5211 97 26 and and CCONJ fcis-5211 97 27 the the DET fcis-5211 97 28 velocity velocity NOUN fcis-5211 97 29 of of ADP fcis-5211 97 30 motion motion NOUN fcis-5211 97 31 in in ADP fcis-5211 97 32 this this DET fcis-5211 97 33 model model NOUN fcis-5211 97 34 . . PUNCT fcis-5211 98 1 we we PRON fcis-5211 98 2 assume assume VERB fcis-5211 98 3 that that SCONJ fcis-5211 98 4 the the DET fcis-5211 98 5 vehicles vehicle NOUN fcis-5211 98 6 are be AUX fcis-5211 98 7 constantly constantly ADV fcis-5211 98 8 moving move VERB fcis-5211 98 9 and and CCONJ fcis-5211 98 10 the the DET fcis-5211 98 11 corresponding corresponding ADJ fcis-5211 98 12 rsu rsu NOUN fcis-5211 98 13 is be AUX fcis-5211 98 14 always always ADV fcis-5211 98 15 changing change VERB fcis-5211 98 16 for for ADP fcis-5211 98 17 better well ADJ fcis-5211 98 18 qos qos NOUN fcis-5211 98 19 . . PUNCT fcis-5211 99 1 in in ADP fcis-5211 99 2 this this DET fcis-5211 99 3 case case NOUN fcis-5211 99 4 , , PUNCT fcis-5211 99 5 a a DET fcis-5211 99 6 vehicle vehicle NOUN fcis-5211 99 7 mobility mobility NOUN fcis-5211 99 8 model model NOUN fcis-5211 99 9 is be AUX fcis-5211 99 10 proposed propose VERB fcis-5211 99 11 to to PART fcis-5211 99 12 represent represent VERB fcis-5211 99 13 the the DET fcis-5211 99 14 state state NOUN fcis-5211 99 15 of of ADP fcis-5211 99 16 vehicle vehicle NOUN fcis-5211 99 17 movement movement PROPN fcis-5211 99 18 state state NOUN fcis-5211 99 19 . . PUNCT fcis-5211 100 1 as as SCONJ fcis-5211 100 2 shown show VERB fcis-5211 100 3 in in ADP fcis-5211 100 4 figure figure NOUN fcis-5211 100 5 3 3 NUM fcis-5211 100 6 , , PUNCT fcis-5211 100 7 the𝑀𝑒,𝑒 the𝑀𝑒,𝑒 VERB fcis-5211 100 8 𝑑 𝑑 NOUN fcis-5211 100 9 indicates indicate VERB fcis-5211 100 10 the the DET fcis-5211 100 11 state state NOUN fcis-5211 100 12 of of ADP fcis-5211 100 13 vehicle vehicle NOUN fcis-5211 100 14 𝑒 𝑒 NOUN fcis-5211 100 15 in in ADP fcis-5211 100 16 time time NOUN fcis-5211 100 17 slot slot NOUN fcis-5211 100 18 𝑑. 𝑑. NOUN fcis-5211 100 19 𝑀𝑒,𝑒 𝑀𝑒,𝑒 NOUN fcis-5211 100 20 𝑑 𝑑 X fcis-5211 100 21 = = SYM fcis-5211 100 22 { { PUNCT fcis-5211 100 23 π‘₯𝑒,𝑒 π‘₯𝑒,𝑒 PUNCT fcis-5211 100 24 𝑑 𝑑 NOUN fcis-5211 100 25 , , PUNCT fcis-5211 100 26 𝑦𝑒,𝑒 𝑦𝑒,𝑒 NUM fcis-5211 100 27 𝑑 𝑑 PROPN fcis-5211 100 28 , , PUNCT fcis-5211 100 29 𝑣𝑒 𝑣𝑒 PROPN fcis-5211 100 30 𝑑 𝑑 PROPN fcis-5211 100 31 , , PUNCT fcis-5211 100 32 𝛼𝑒,𝑒 𝛼𝑒,𝑒 NUM fcis-5211 100 33 𝑑 𝑑 PROPN fcis-5211 100 34 } } PUNCT fcis-5211 100 35 ( ( PUNCT fcis-5211 100 36 13 13 NUM fcis-5211 100 37 ) ) PUNCT fcis-5211 100 38 where where SCONJ fcis-5211 100 39 π‘₯𝑒,𝑒 π‘₯𝑒,𝑒 PUNCT fcis-5211 100 40 𝑑 𝑑 NOUN fcis-5211 100 41 and𝑦𝑒,𝑒 and𝑦𝑒,𝑒 ADP fcis-5211 100 42 𝑑 𝑑 PRON fcis-5211 100 43 denote denote VERB fcis-5211 100 44 the the DET fcis-5211 100 45 distance distance NOUN fcis-5211 100 46 between between ADP fcis-5211 100 47 vehicle vehicle NOUN fcis-5211 100 48 𝑒 𝑒 NOUN fcis-5211 100 49 and and CCONJ fcis-5211 100 50 the the DET fcis-5211 100 51 corresponding correspond VERB fcis-5211 100 52 rsu rsu PROPN fcis-5211 100 53 𝑒 𝑒 PROPN fcis-5211 100 54 on on ADP fcis-5211 100 55 x x ADJ fcis-5211 100 56 - - ADJ fcis-5211 100 57 axis axis ADJ fcis-5211 100 58 and and CCONJ fcis-5211 100 59 y y NOUN fcis-5211 100 60 - - PUNCT fcis-5211 100 61 axis axis NOUN fcis-5211 100 62 in in ADP fcis-5211 100 63 time time NOUN fcis-5211 100 64 slot slot NOUN fcis-5211 100 65 𝑑 𝑑 PROPN fcis-5211 100 66 , , PUNCT fcis-5211 100 67 π‘£π‘š π‘£π‘š ADJ fcis-5211 100 68 𝑑 𝑑 PROPN fcis-5211 100 69 denotes denote NOUN fcis-5211 100 70 the the DET fcis-5211 100 71 velocity velocity NOUN fcis-5211 100 72 of of ADP fcis-5211 100 73 the the DET fcis-5211 100 74 vehicle vehicle NOUN fcis-5211 100 75 𝑒 𝑒 NOUN fcis-5211 100 76 which which PRON fcis-5211 100 77 can can AUX fcis-5211 100 78 be be AUX fcis-5211 100 79 obtained obtain VERB fcis-5211 100 80 from from ADP fcis-5211 100 81 the the DET fcis-5211 100 82 sensors sensor NOUN fcis-5211 100 83 equipped equip VERB fcis-5211 100 84 on on ADP fcis-5211 100 85 the the DET fcis-5211 100 86 vehicle vehicle NOUN fcis-5211 100 87 , , PUNCT fcis-5211 100 88 α𝑒,𝑒 α𝑒,𝑒 NUM fcis-5211 100 89 𝑑 𝑑 NOUN fcis-5211 100 90 represents represent VERB fcis-5211 100 91 the the DET fcis-5211 100 92 difference difference NOUN fcis-5211 100 93 between between ADP fcis-5211 100 94 the the DET fcis-5211 100 95 angle angle NOUN fcis-5211 100 96 between between ADP fcis-5211 100 97 the the DET fcis-5211 100 98 direction direction NOUN fcis-5211 100 99 of of ADP fcis-5211 100 100 travel travel NOUN fcis-5211 100 101 of of ADP fcis-5211 100 102 each each DET fcis-5211 100 103 vehicle vehicle NOUN fcis-5211 100 104 on on ADP fcis-5211 100 105 the the DET fcis-5211 100 106 x x NOUN fcis-5211 100 107 - - NOUN fcis-5211 100 108 axis axis NOUN fcis-5211 100 109 and and CCONJ fcis-5211 100 110 the the DET fcis-5211 100 111 angle angle NOUN fcis-5211 100 112 between between ADP fcis-5211 100 113 the the DET fcis-5211 100 114 line line NOUN fcis-5211 100 115 connecting connect VERB fcis-5211 100 116 the the DET fcis-5211 100 117 vehicle vehicle NOUN fcis-5211 100 118 and and CCONJ fcis-5211 100 119 the the DET fcis-5211 100 120 rsu rsu NOUN fcis-5211 100 121 on on ADP fcis-5211 100 122 the the DET fcis-5211 100 123 x x NOUN fcis-5211 100 124 - - NOUN fcis-5211 100 125 axis axis ADJ fcis-5211 100 126 . . PUNCT fcis-5211 101 1 figure figure NOUN fcis-5211 101 2 2 2 NUM fcis-5211 101 3 vehicle vehicle NOUN fcis-5211 101 4 mobilty mobilty NOUN fcis-5211 101 5 model model NOUN fcis-5211 101 6 3 3 PROPN fcis-5211 101 7 . . PUNCT fcis-5211 102 1 marl marl NOUN fcis-5211 102 2 - - PUNCT fcis-5211 102 3 based base VERB fcis-5211 102 4 5 5 NUM fcis-5211 102 5 g g ADP fcis-5211 102 6 nr nr NOUN fcis-5211 102 7 v2x v2x VERB fcis-5211 102 8 service service NOUN fcis-5211 102 9 migration migration NOUN fcis-5211 102 10 algorithm algorithm NOUN fcis-5211 102 11 3.1 3.1 NUM fcis-5211 102 12 . . PUNCT fcis-5211 102 13 service service NOUN fcis-5211 102 14 migration migration NOUN fcis-5211 102 15 problem problem NOUN fcis-5211 102 16 transformation transformation NOUN fcis-5211 102 17 based base VERB fcis-5211 102 18 on on ADP fcis-5211 102 19 the the DET fcis-5211 102 20 above above ADJ fcis-5211 102 21 discussion discussion NOUN fcis-5211 102 22 , , PUNCT fcis-5211 102 23 the the DET fcis-5211 102 24 service service NOUN fcis-5211 102 25 migration migration NOUN fcis-5211 102 26 strategy strategy NOUN fcis-5211 102 27 should should AUX fcis-5211 102 28 consider consider VERB fcis-5211 102 29 some some DET fcis-5211 102 30 intervention intervention NOUN fcis-5211 102 31 factors factor NOUN fcis-5211 102 32 . . PUNCT fcis-5211 103 1 markov markov NOUN fcis-5211 103 2 decision decision NOUN fcis-5211 103 3 process process NOUN fcis-5211 103 4 ( ( PUNCT fcis-5211 103 5 mdp mdp NOUN fcis-5211 103 6 ) ) PUNCT fcis-5211 103 7 is be AUX fcis-5211 103 8 a a DET fcis-5211 103 9 feasible feasible ADJ fcis-5211 103 10 model model NOUN fcis-5211 103 11 for for ADP fcis-5211 103 12 developing develop VERB fcis-5211 103 13 a a DET fcis-5211 103 14 service service NOUN fcis-5211 103 15 migration migration NOUN fcis-5211 103 16 process process NOUN fcis-5211 103 17 . . PUNCT fcis-5211 104 1 in in ADP fcis-5211 104 2 this this DET fcis-5211 104 3 model model NOUN fcis-5211 104 4 , , PUNCT fcis-5211 104 5 an an DET fcis-5211 104 6 intelligence intelligence NOUN fcis-5211 104 7 in in ADP fcis-5211 104 8 a a DET fcis-5211 104 9 given give VERB fcis-5211 104 10 state state NOUN fcis-5211 104 11 is be AUX fcis-5211 104 12 informed inform VERB fcis-5211 104 13 of of ADP fcis-5211 104 14 a a DET fcis-5211 104 15 set set NOUN fcis-5211 104 16 of of ADP fcis-5211 104 17 possible possible ADJ fcis-5211 104 18 actions action NOUN fcis-5211 104 19 it it PRON fcis-5211 104 20 can can AUX fcis-5211 104 21 take take VERB fcis-5211 104 22 ( ( PUNCT fcis-5211 104 23 e.g. e.g. ADV fcis-5211 104 24 , , PUNCT fcis-5211 104 25 migrate migrate VERB fcis-5211 104 26 or or CCONJ fcis-5211 104 27 not not PART fcis-5211 104 28 migrate migrate VERB fcis-5211 104 29 ) ) PUNCT fcis-5211 104 30 , , PUNCT fcis-5211 104 31 each each PRON fcis-5211 104 32 of of ADP fcis-5211 104 33 which which PRON fcis-5211 104 34 is be AUX fcis-5211 104 35 immediately immediately ADV fcis-5211 104 36 rewarded reward VERB fcis-5211 104 37 or or CCONJ fcis-5211 104 38 punished punish VERB fcis-5211 104 39 . . PUNCT fcis-5211 105 1 therefore therefore ADV fcis-5211 105 2 , , PUNCT fcis-5211 105 3 it it PRON fcis-5211 105 4 must must AUX fcis-5211 105 5 decide decide VERB fcis-5211 105 6 which which DET fcis-5211 105 7 action action NOUN fcis-5211 105 8 to to PART fcis-5211 105 9 take take VERB fcis-5211 105 10 to to PART fcis-5211 105 11 maximize maximize VERB fcis-5211 105 12 its its PRON fcis-5211 105 13 reward reward NOUN fcis-5211 105 14 , , PUNCT fcis-5211 105 15 in in ADP fcis-5211 105 16 other other ADJ fcis-5211 105 17 words word NOUN fcis-5211 105 18 , , PUNCT fcis-5211 105 19 to to PART fcis-5211 105 20 minimize minimize VERB fcis-5211 105 21 the the DET fcis-5211 105 22 penalty penalty NOUN fcis-5211 105 23 or or CCONJ fcis-5211 105 24 cost cost NOUN fcis-5211 105 25 in in ADP fcis-5211 105 26 the the DET fcis-5211 105 27 long long ADJ fcis-5211 105 28 run run NOUN fcis-5211 105 29 . . PUNCT fcis-5211 106 1 in in ADP fcis-5211 106 2 a a DET fcis-5211 106 3 multi multi ADJ fcis-5211 106 4 - - ADJ fcis-5211 106 5 intelligent intelligent ADJ fcis-5211 106 6 environment environment NOUN fcis-5211 106 7 , , PUNCT fcis-5211 106 8 the the DET fcis-5211 106 9 intelligences intelligence NOUN fcis-5211 106 10 generally generally ADV fcis-5211 106 11 can can AUX fcis-5211 106 12 not not PART fcis-5211 106 13 fully fully ADV fcis-5211 106 14 observe observe VERB fcis-5211 106 15 the the DET fcis-5211 106 16 states state NOUN fcis-5211 106 17 of of ADP fcis-5211 106 18 other other ADJ fcis-5211 106 19 intelligences intelligence NOUN fcis-5211 106 20 , , PUNCT fcis-5211 106 21 so so ADV fcis-5211 106 22 multi multi ADJ fcis-5211 106 23 - - ADJ fcis-5211 106 24 intelligent intelligent ADJ fcis-5211 106 25 reinforcement reinforcement NOUN fcis-5211 106 26 learning learning NOUN fcis-5211 106 27 is be AUX fcis-5211 106 28 essentially essentially ADV fcis-5211 106 29 considered consider VERB fcis-5211 106 30 as as ADP fcis-5211 106 31 a a DET fcis-5211 106 32 partially partially ADV fcis-5211 106 33 observable observable ADJ fcis-5211 106 34 markov markov NOUN fcis-5211 106 35 decision decision NOUN fcis-5211 106 36 process process NOUN fcis-5211 106 37 ( ( PUNCT fcis-5211 106 38 pomdp pomdp NOUN fcis-5211 106 39 ) ) PUNCT fcis-5211 106 40 . . PUNCT fcis-5211 107 1 in in ADP fcis-5211 107 2 a a DET fcis-5211 107 3 pomdp pomdp NOUN fcis-5211 107 4 with with ADP fcis-5211 107 5 multiple multiple ADJ fcis-5211 107 6 intelligences intelligence NOUN fcis-5211 107 7 , , PUNCT fcis-5211 107 8 unless unless SCONJ fcis-5211 107 9 the the DET fcis-5211 107 10 strategies strategy NOUN fcis-5211 107 11 of of ADP fcis-5211 107 12 other other ADJ fcis-5211 107 13 intelligences intelligence NOUN fcis-5211 107 14 converge converge VERB fcis-5211 107 15 to to ADP fcis-5211 107 16 , , PUNCT fcis-5211 107 17 the the DET fcis-5211 107 18 environment environment NOUN fcis-5211 107 19 of of ADP fcis-5211 107 20 the the DET fcis-5211 107 21 intelligences intelligence NOUN fcis-5211 107 22 is be AUX fcis-5211 107 23 of of ADP fcis-5211 107 24 a a DET fcis-5211 107 25 non non ADJ fcis-5211 107 26 - - ADJ fcis-5211 107 27 static static ADJ fcis-5211 107 28 nature nature NOUN fcis-5211 107 29 , , PUNCT fcis-5211 107 30 i.e. i.e. X fcis-5211 107 31 , , PUNCT fcis-5211 107 32 the the DET fcis-5211 107 33 intelligences intelligence NOUN fcis-5211 107 34 can can AUX fcis-5211 107 35 not not PART fcis-5211 107 36 determine determine VERB fcis-5211 107 37 whether whether SCONJ fcis-5211 107 38 their their PRON fcis-5211 107 39 own own ADJ fcis-5211 107 40 actions action NOUN fcis-5211 107 41 contribute contribute VERB fcis-5211 107 42 to to ADP fcis-5211 107 43 the the DET fcis-5211 107 44 learning learning NOUN fcis-5211 107 45 outcome outcome NOUN fcis-5211 107 46 . . PUNCT fcis-5211 108 1 to to PART fcis-5211 108 2 solve solve VERB fcis-5211 108 3 this this DET fcis-5211 108 4 problem problem NOUN fcis-5211 108 5 , , PUNCT fcis-5211 108 6 appropriate appropriate ADJ fcis-5211 108 7 rewards reward NOUN fcis-5211 108 8 must must AUX fcis-5211 108 9 be be AUX fcis-5211 108 10 given give VERB fcis-5211 108 11 based base VERB fcis-5211 108 12 on on ADP fcis-5211 108 13 the the DET fcis-5211 108 14 information information NOUN fcis-5211 108 15 from from ADP fcis-5211 108 16 other other ADJ fcis-5211 108 17 intelligences intelligence NOUN fcis-5211 108 18 , , PUNCT fcis-5211 108 19 otherwise otherwise ADV fcis-5211 108 20 , , PUNCT fcis-5211 108 21 policy policy NOUN fcis-5211 108 22 learning learning NOUN fcis-5211 108 23 must must AUX fcis-5211 108 24 be be AUX fcis-5211 108 25 performed perform VERB fcis-5211 108 26 while while SCONJ fcis-5211 108 27 keeping keep VERB fcis-5211 108 28 the the DET fcis-5211 108 29 multi multi ADJ fcis-5211 108 30 - - ADJ fcis-5211 108 31 intelligent intelligent ADJ fcis-5211 108 32 environment environment NOUN fcis-5211 108 33 static static NOUN fcis-5211 108 34 . . PUNCT fcis-5211 109 1 51 51 NUM fcis-5211 109 2 3.1.1 3.1.1 NUM fcis-5211 109 3 . . PUNCT fcis-5211 110 1 state state NOUN fcis-5211 110 2 space space NOUN fcis-5211 110 3 we we PRON fcis-5211 110 4 use use VERB fcis-5211 110 5 𝑆 𝑆 PROPN fcis-5211 110 6 to to PART fcis-5211 110 7 represent represent VERB fcis-5211 110 8 the the DET fcis-5211 110 9 status status NOUN fcis-5211 110 10 of of ADP fcis-5211 110 11 the the DET fcis-5211 110 12 vehicle vehicle NOUN fcis-5211 110 13 in in ADP fcis-5211 110 14 vec vec PROPN fcis-5211 110 15 network network PROPN fcis-5211 110 16 , , PUNCT fcis-5211 110 17 defined define VERB fcis-5211 110 18 as as SCONJ fcis-5211 110 19 follows follow VERB fcis-5211 110 20 . . PUNCT fcis-5211 111 1 𝑆 𝑆 PROPN fcis-5211 111 2 β‰œ β‰œ NOUN fcis-5211 111 3 { { PUNCT fcis-5211 111 4 𝑠 𝑠 PROPN fcis-5211 111 5 ∣ ∣ PROPN fcis-5211 111 6 𝑠 𝑠 PROPN fcis-5211 111 7 = = SYM fcis-5211 111 8 ( ( PUNCT fcis-5211 111 9 𝑇𝑒 𝑇𝑒 PROPN fcis-5211 111 10 , , PUNCT fcis-5211 111 11 𝑀𝑒,𝑒 𝑀𝑒,𝑒 PROPN fcis-5211 111 12 𝑑 𝑑 PROPN fcis-5211 111 13 ) ) PUNCT fcis-5211 111 14 } } PUNCT fcis-5211 111 15 ( ( PUNCT fcis-5211 111 16 14 14 NUM fcis-5211 111 17 ) ) PUNCT fcis-5211 111 18 where where SCONJ fcis-5211 111 19 π‘‡π‘š π‘‡π‘š PROPN fcis-5211 111 20 is be AUX fcis-5211 111 21 the the DET fcis-5211 111 22 computing computing NOUN fcis-5211 111 23 task task NOUN fcis-5211 111 24 contained contain VERB fcis-5211 111 25 in in ADP fcis-5211 111 26 each each DET fcis-5211 111 27 vehicle vehicle NOUN fcis-5211 111 28 and and CCONJ fcis-5211 111 29 the the DET fcis-5211 111 30 task task NOUN fcis-5211 111 31 definition definition NOUN fcis-5211 111 32 contains contain VERB fcis-5211 111 33 a a DET fcis-5211 111 34 binary binary ADJ fcis-5211 111 35 set set NOUN fcis-5211 111 36 of of ADP fcis-5211 111 37 the the DET fcis-5211 111 38 service service NOUN fcis-5211 111 39 image image NOUN fcis-5211 111 40 size size NOUN fcis-5211 111 41 and and CCONJ fcis-5211 111 42 the the DET fcis-5211 111 43 computing compute VERB fcis-5211 111 44 resources resource NOUN fcis-5211 111 45 required require VERB fcis-5211 111 46 for for ADP fcis-5211 111 47 the the DET fcis-5211 111 48 service service NOUN fcis-5211 111 49 , , PUNCT fcis-5211 111 50 and𝑀𝑒,𝑒 and𝑀𝑒,𝑒 PROPN fcis-5211 111 51 𝑑 𝑑 PROPN fcis-5211 111 52 is be AUX fcis-5211 111 53 the the DET fcis-5211 111 54 mobility mobility NOUN fcis-5211 111 55 model model NOUN fcis-5211 111 56 of of ADP fcis-5211 111 57 the the DET fcis-5211 111 58 vehicle vehicle NOUN fcis-5211 111 59 . . PUNCT fcis-5211 112 1 3.1.2 3.1.2 X fcis-5211 112 2 . . PUNCT fcis-5211 112 3 reward reward NOUN fcis-5211 112 4 functions function NOUN fcis-5211 112 5 in in ADP fcis-5211 112 6 this this DET fcis-5211 112 7 paper paper NOUN fcis-5211 112 8 , , PUNCT fcis-5211 112 9 the the DET fcis-5211 112 10 intelligences intelligence NOUN fcis-5211 112 11 will will AUX fcis-5211 112 12 collect collect VERB fcis-5211 112 13 information information NOUN fcis-5211 112 14 about about ADP fcis-5211 112 15 the the DET fcis-5211 112 16 environment environment NOUN fcis-5211 112 17 and and CCONJ fcis-5211 112 18 calculate calculate VERB fcis-5211 112 19 the the DET fcis-5211 112 20 reward reward NOUN fcis-5211 112 21 for for ADP fcis-5211 112 22 each each DET fcis-5211 112 23 action action NOUN fcis-5211 112 24 , , PUNCT fcis-5211 112 25 the the DET fcis-5211 112 26 specific specific ADJ fcis-5211 112 27 formulation formulation NOUN fcis-5211 112 28 is be AUX fcis-5211 112 29 as as SCONJ fcis-5211 112 30 follows follow VERB fcis-5211 112 31 . . PUNCT fcis-5211 113 1 π‘Ÿπ‘’,𝑒 π‘Ÿπ‘’,𝑒 X fcis-5211 113 2 π‘˜ π‘˜ X fcis-5211 113 3 = = SYM fcis-5211 113 4 Ο‰1(βˆ†πΊπ‘’,𝑒 Ο‰1(βˆ†πΊπ‘’,𝑒 PUNCT fcis-5211 113 5 mig mig NOUN fcis-5211 113 6 + + CCONJ fcis-5211 113 7 βˆ†πΊπ‘’,𝑒 βˆ†πΊπ‘’,𝑒 ADJ fcis-5211 113 8 comp comp NOUN fcis-5211 113 9 ) ) PUNCT fcis-5211 114 1 + + CCONJ fcis-5211 114 2 Ο‰2𝑃𝑒,e Ο‰2𝑃𝑒,e NOUN fcis-5211 114 3 , , PUNCT fcis-5211 114 4 βˆ€π‘’ βˆ€π‘’ PRON fcis-5211 114 5 ∈ ∈ PROPN fcis-5211 114 6 π‘ˆ π‘ˆ PROPN fcis-5211 114 7 , , PUNCT fcis-5211 114 8 βˆ€π‘’ βˆ€π‘’ X fcis-5211 115 1 ∈ ∈ PROPN fcis-5211 115 2 𝐸 𝐸 PROPN fcis-5211 115 3 ( ( PUNCT fcis-5211 115 4 15 15 NUM fcis-5211 115 5 ) ) PUNCT fcis-5211 115 6 where where SCONJ fcis-5211 115 7 𝐺𝑒,𝑒 𝐺𝑒,𝑒 PROPN fcis-5211 115 8 mig mig PROPN fcis-5211 115 9 , , PUNCT fcis-5211 115 10 𝐺𝑒,𝑒 𝐺𝑒,𝑒 PROPN fcis-5211 115 11 comp comp PROPN fcis-5211 115 12 and𝑃𝑒,e and𝑃𝑒,e NOUN fcis-5211 115 13 are be AUX fcis-5211 115 14 the the DET fcis-5211 115 15 estimated estimate VERB fcis-5211 115 16 migration migration NOUN fcis-5211 115 17 cost cost NOUN fcis-5211 115 18 , , PUNCT fcis-5211 115 19 computed compute VERB fcis-5211 115 20 cost cost NOUN fcis-5211 115 21 and and CCONJ fcis-5211 115 22 energy energy NOUN fcis-5211 115 23 consumption consumption NOUN fcis-5211 115 24 , , PUNCT fcis-5211 115 25 respectively respectively ADV fcis-5211 115 26 . . PUNCT fcis-5211 116 1 ω𝑖 ω𝑖 INTJ fcis-5211 116 2 ( ( PUNCT fcis-5211 116 3 𝑖 𝑖 NOUN fcis-5211 116 4 = = SYM fcis-5211 116 5 1,2 1,2 NUM fcis-5211 116 6 ) ) PUNCT fcis-5211 116 7 represent represent VERB fcis-5211 116 8 the the DET fcis-5211 116 9 different different ADJ fcis-5211 116 10 weights weight NOUN fcis-5211 116 11 that that PRON fcis-5211 116 12 affect affect VERB fcis-5211 116 13 the the DET fcis-5211 116 14 service service NOUN fcis-5211 116 15 migration migration NOUN fcis-5211 116 16 decision decision NOUN fcis-5211 116 17 . . PUNCT fcis-5211 117 1 3.2 3.2 NUM fcis-5211 117 2 . . PUNCT fcis-5211 118 1 algorithm algorithm NOUN fcis-5211 118 2 overview overview VERB fcis-5211 118 3 soft soft ADJ fcis-5211 118 4 actor actor NOUN fcis-5211 118 5 - - PUNCT fcis-5211 118 6 critic critic NOUN fcis-5211 118 7 ( ( PUNCT fcis-5211 118 8 sac sac NOUN fcis-5211 118 9 ) ) PUNCT fcis-5211 118 10 is be AUX fcis-5211 118 11 an an DET fcis-5211 118 12 off off ADJ fcis-5211 118 13 - - PUNCT fcis-5211 118 14 policy policy NOUN fcis-5211 118 15 reinforcement reinforcement NOUN fcis-5211 118 16 learning learning NOUN fcis-5211 118 17 algorithm algorithm NOUN fcis-5211 118 18 that that PRON fcis-5211 118 19 optimizes optimize VERB fcis-5211 118 20 stochastic stochastic ADJ fcis-5211 118 21 policies policy NOUN fcis-5211 118 22 . . PUNCT fcis-5211 119 1 this this DET fcis-5211 119 2 algorithm algorithm NOUN fcis-5211 119 3 considers consider VERB fcis-5211 119 4 the the DET fcis-5211 119 5 maximization maximization NOUN fcis-5211 119 6 benefit benefit NOUN fcis-5211 119 7 between between ADP fcis-5211 119 8 the the DET fcis-5211 119 9 expected expect VERB fcis-5211 119 10 benefit benefit NOUN fcis-5211 119 11 and and CCONJ fcis-5211 119 12 entropy entropy NOUN fcis-5211 119 13 . . PUNCT fcis-5211 120 1 this this PRON fcis-5211 120 2 is be AUX fcis-5211 120 3 closely closely ADV fcis-5211 120 4 related relate VERB fcis-5211 120 5 to to ADP fcis-5211 120 6 the the DET fcis-5211 120 7 trade trade NOUN fcis-5211 120 8 - - PUNCT fcis-5211 120 9 off off NOUN fcis-5211 120 10 between between ADP fcis-5211 120 11 exploration exploration NOUN fcis-5211 120 12 rate rate NOUN fcis-5211 120 13 and and CCONJ fcis-5211 120 14 utilization utilization NOUN fcis-5211 120 15 : : PUNCT fcis-5211 120 16 increasing increase VERB fcis-5211 120 17 the the DET fcis-5211 120 18 value value NOUN fcis-5211 120 19 of of ADP fcis-5211 120 20 this this DET fcis-5211 120 21 entropy entropy NOUN fcis-5211 120 22 leads lead VERB fcis-5211 120 23 to to ADP fcis-5211 120 24 a a DET fcis-5211 120 25 higher high ADJ fcis-5211 120 26 exploration exploration NOUN fcis-5211 120 27 rate rate NOUN fcis-5211 120 28 and and CCONJ fcis-5211 120 29 also also ADV fcis-5211 120 30 to to ADP fcis-5211 120 31 a a DET fcis-5211 120 32 faster fast ADJ fcis-5211 120 33 increase increase NOUN fcis-5211 120 34 in in ADP fcis-5211 120 35 utilization utilization NOUN fcis-5211 120 36 . . PUNCT fcis-5211 121 1 in in ADP fcis-5211 121 2 contrast contrast NOUN fcis-5211 121 3 to to ADP fcis-5211 121 4 traditional traditional ADJ fcis-5211 121 5 deep deep ADJ fcis-5211 121 6 q q ADJ fcis-5211 121 7 - - PUNCT fcis-5211 121 8 learning learn VERB fcis-5211 121 9 algorithms algorithm NOUN fcis-5211 121 10 , , PUNCT fcis-5211 121 11 it it PRON fcis-5211 121 12 prevents prevent VERB fcis-5211 121 13 the the DET fcis-5211 121 14 problem problem NOUN fcis-5211 121 15 of of ADP fcis-5211 121 16 fitting fitting NOUN fcis-5211 121 17 of of ADP fcis-5211 121 18 strategies strategy NOUN fcis-5211 121 19 . . PUNCT fcis-5211 122 1 once once ADV fcis-5211 122 2 an an DET fcis-5211 122 3 algorithm algorithm NOUN fcis-5211 122 4 falls fall VERB fcis-5211 122 5 into into ADP fcis-5211 122 6 this this DET fcis-5211 122 7 fitting fitting ADJ fcis-5211 122 8 trap trap NOUN fcis-5211 122 9 , , PUNCT fcis-5211 122 10 there there PRON fcis-5211 122 11 is be VERB fcis-5211 122 12 little little ADJ fcis-5211 122 13 that that PRON fcis-5211 122 14 can can AUX fcis-5211 122 15 be be AUX fcis-5211 122 16 done do VERB fcis-5211 122 17 to to PART fcis-5211 122 18 solve solve VERB fcis-5211 122 19 the the DET fcis-5211 122 20 overfitting overfitte VERB fcis-5211 122 21 problem problem NOUN fcis-5211 122 22 . . PUNCT fcis-5211 123 1 compared compare VERB fcis-5211 123 2 to to ADP fcis-5211 123 3 previous previous ADJ fcis-5211 123 4 deep deep ADJ fcis-5211 123 5 reinforcement reinforcement NOUN fcis-5211 123 6 learning learning NOUN fcis-5211 123 7 algorithms algorithm NOUN fcis-5211 123 8 , , PUNCT fcis-5211 123 9 the the DET fcis-5211 123 10 sac sac NOUN fcis-5211 123 11 algorithm algorithm NOUN fcis-5211 123 12 provides provide VERB fcis-5211 123 13 effective effective ADJ fcis-5211 123 14 sampling sampling NOUN fcis-5211 123 15 learning learning NOUN fcis-5211 123 16 while while SCONJ fcis-5211 123 17 retaining retain VERB fcis-5211 123 18 the the DET fcis-5211 123 19 benefits benefit NOUN fcis-5211 123 20 of of ADP fcis-5211 123 21 entropy entropy PROPN fcis-5211 123 22 maximization maximization NOUN fcis-5211 123 23 and and CCONJ fcis-5211 123 24 stability stability NOUN fcis-5211 123 25 . . PUNCT fcis-5211 124 1 in in ADP fcis-5211 124 2 traditional traditional ADJ fcis-5211 124 3 reinforcement reinforcement NOUN fcis-5211 124 4 learning learning NOUN fcis-5211 124 5 , , PUNCT fcis-5211 124 6 the the DET fcis-5211 124 7 goal goal NOUN fcis-5211 124 8 of of ADP fcis-5211 124 9 the the DET fcis-5211 124 10 algorithm algorithm NOUN fcis-5211 124 11 is be AUX fcis-5211 124 12 to to PART fcis-5211 124 13 increase increase VERB fcis-5211 124 14 the the DET fcis-5211 124 15 value value NOUN fcis-5211 124 16 of of ADP fcis-5211 124 17 the the DET fcis-5211 124 18 cumulative cumulative ADJ fcis-5211 124 19 expected expect VERB fcis-5211 124 20 reward reward NOUN fcis-5211 124 21 . . PUNCT fcis-5211 125 1 βˆ‘ βˆ‘ PUNCT fcis-5211 125 2 𝑑 𝑑 X fcis-5211 125 3 𝔼(𝑠𝑑,π‘Žπ‘‘)βˆΌπœŒπœ‹π›Ύ 𝔼(𝑠𝑑,π‘Žπ‘‘)βˆΌπœŒπœ‹π›Ύ PRON fcis-5211 125 4 𝑑[π‘Ÿ(𝑠𝑑 𝑑[π‘Ÿ(𝑠𝑑 PROPN fcis-5211 125 5 , , PUNCT fcis-5211 125 6 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 125 7 ) ) PUNCT fcis-5211 125 8 ] ] PUNCT fcis-5211 125 9 ( ( PUNCT fcis-5211 125 10 16 16 NUM fcis-5211 125 11 ) ) PUNCT fcis-5211 125 12 whereπ‘Žπ‘‘ whereπ‘Žπ‘‘ NOUN fcis-5211 125 13 represents represent VERB fcis-5211 125 14 the the DET fcis-5211 125 15 time time NOUN fcis-5211 125 16 gap gap NOUN fcis-5211 125 17 in in ADP fcis-5211 125 18 which which PRON fcis-5211 125 19 the the DET fcis-5211 125 20 intelligent intelligent ADJ fcis-5211 125 21 body𝑑 body𝑑 VERB fcis-5211 125 22 the the DET fcis-5211 125 23 action action NOUN fcis-5211 125 24 taken take VERB fcis-5211 125 25 by by ADP fcis-5211 125 26 the𝑠𝑑 the𝑠𝑑 NOUN fcis-5211 125 27 represents represent VERB fcis-5211 125 28 the the DET fcis-5211 125 29 state state NOUN fcis-5211 125 30 of of ADP fcis-5211 125 31 the the DET fcis-5211 125 32 intelligence intelligence NOUN fcis-5211 125 33 in in ADP fcis-5211 125 34 the the DET fcis-5211 125 35 time time NOUN fcis-5211 125 36 gap𝑑 gap𝑑 NOUN fcis-5211 125 37 the the DET fcis-5211 125 38 state state NOUN fcis-5211 125 39 of of ADP fcis-5211 125 40 the the DET fcis-5211 125 41 intelligence intelligence NOUN fcis-5211 125 42 , , PUNCT fcis-5211 125 43 and𝛾 and𝛾 NOUN fcis-5211 125 44 denotes denote VERB fcis-5211 125 45 the the DET fcis-5211 125 46 reward reward NOUN fcis-5211 125 47 value value NOUN fcis-5211 125 48 discount discount NOUN fcis-5211 125 49 rate rate NOUN fcis-5211 125 50 , , PUNCT fcis-5211 125 51 and and CCONJ fcis-5211 125 52 it it PRON fcis-5211 125 53 can can AUX fcis-5211 125 54 be be AUX fcis-5211 125 55 concluded conclude VERB fcis-5211 125 56 that that SCONJ fcis-5211 125 57 the the DET fcis-5211 125 58 optimal optimal ADJ fcis-5211 125 59 strategy strategy NOUN fcis-5211 125 60 is be AUX fcis-5211 125 61 πœ‹π‘ π‘‘π‘‘ πœ‹π‘ π‘‘π‘‘ NOUN fcis-5211 125 62 βˆ— βˆ— NOUN fcis-5211 125 63 = = SYM fcis-5211 125 64 argπ‘šπ‘Žπ‘₯ argπ‘šπ‘Žπ‘₯ PROPN fcis-5211 125 65 πœ‹ πœ‹ AUX fcis-5211 125 66 βˆ‘ βˆ‘ PROPN fcis-5211 125 67 𝑑 𝑑 X fcis-5211 125 68 𝔼(𝑠𝑑,π‘Žπ‘‘)βˆΌπœŒπœ‹ 𝔼(𝑠𝑑,π‘Žπ‘‘)βˆΌπœŒπœ‹ NOUN fcis-5211 125 69 [ [ X fcis-5211 125 70 π‘Ÿ(𝑠𝑑 π‘Ÿ(𝑠𝑑 NOUN fcis-5211 125 71 , , PUNCT fcis-5211 125 72 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 125 73 ) ) PUNCT fcis-5211 125 74 ] ] PUNCT fcis-5211 126 1 ( ( PUNCT fcis-5211 126 2 17 17 NUM fcis-5211 126 3 ) ) PUNCT fcis-5211 126 4 then then ADV fcis-5211 126 5 , , PUNCT fcis-5211 126 6 the the DET fcis-5211 126 7 entropy entropy NOUN fcis-5211 126 8 is be AUX fcis-5211 126 9 introduced introduce VERB fcis-5211 126 10 into into ADP fcis-5211 126 11 equation equation NOUN fcis-5211 126 12 ( ( PUNCT fcis-5211 126 13 22 22 NUM fcis-5211 126 14 ) ) PUNCT fcis-5211 126 15 with with ADP fcis-5211 126 16 the the DET fcis-5211 126 17 goal goal NOUN fcis-5211 126 18 of of ADP fcis-5211 126 19 finding find VERB fcis-5211 126 20 a a DET fcis-5211 126 21 most most ADJ fcis-5211 126 22 strategy strategy NOUN fcis-5211 126 23 to to PART fcis-5211 126 24 maximize maximize VERB fcis-5211 126 25 this this DET fcis-5211 126 26 objective objective ADJ fcis-5211 126 27 function function NOUN fcis-5211 126 28 . . PUNCT fcis-5211 127 1 thus thus ADV fcis-5211 127 2 , , PUNCT fcis-5211 127 3 the the DET fcis-5211 127 4 optimal optimal ADJ fcis-5211 127 5 strategy strategy NOUN fcis-5211 127 6 can can AUX fcis-5211 127 7 be be AUX fcis-5211 127 8 expressed express VERB fcis-5211 127 9 as as SCONJ fcis-5211 127 10 follows follow VERB fcis-5211 127 11 πœ‹βˆ— πœ‹βˆ— NOUN fcis-5211 127 12 = = SYM fcis-5211 127 13 argπ‘šπ‘Žπ‘₯ argπ‘šπ‘Žπ‘₯ NOUN fcis-5211 127 14 πœ‹ πœ‹ AUX fcis-5211 127 15 βˆ‘ βˆ‘ PROPN fcis-5211 127 16 𝑑 𝑑 PROPN fcis-5211 127 17 𝔼(𝑠𝑑,π‘Žπ‘‘)βˆΌπœŒπœ‹ 𝔼(𝑠𝑑,π‘Žπ‘‘)βˆΌπœŒπœ‹ NOUN fcis-5211 127 18 𝛾 𝛾 ADP fcis-5211 127 19 𝑑[π‘Ÿ(𝑠𝑑 𝑑[π‘Ÿ(𝑠𝑑 PROPN fcis-5211 127 20 , , PUNCT fcis-5211 127 21 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 127 22 ) ) PUNCT fcis-5211 128 1 + + CCONJ fcis-5211 129 1 𝛼ℋ(πœ‹ 𝛼ℋ(πœ‹ X fcis-5211 129 2 ( ( PUNCT fcis-5211 129 3 β‹…βˆ£βˆ£ β‹…βˆ£βˆ£ NOUN fcis-5211 129 4 𝑠𝑑 𝑠𝑑 PROPN fcis-5211 129 5 ) ) PUNCT fcis-5211 129 6 ) ) PUNCT fcis-5211 129 7 ] ] PUNCT fcis-5211 129 8 ( ( PUNCT fcis-5211 129 9 18 18 NUM fcis-5211 129 10 ) ) PUNCT fcis-5211 129 11 where where SCONJ fcis-5211 129 12 the the DET fcis-5211 129 13 temperature temperature NOUN fcis-5211 129 14 parameter𝛼 parameter𝛼 NOUN fcis-5211 129 15 determines determine VERB fcis-5211 129 16 the the DET fcis-5211 129 17 relative relative ADJ fcis-5211 129 18 importance importance NOUN fcis-5211 129 19 of of ADP fcis-5211 129 20 the the DET fcis-5211 129 21 entropy entropy NOUN fcis-5211 129 22 value value NOUN fcis-5211 129 23 to to ADP fcis-5211 129 24 the the DET fcis-5211 129 25 reward reward NOUN fcis-5211 129 26 value value NOUN fcis-5211 129 27 , , PUNCT fcis-5211 129 28 theβ„‹(πœ‹ theβ„‹(πœ‹ PROPN fcis-5211 129 29 ( ( PUNCT fcis-5211 129 30 β‹…βˆ£βˆ£ β‹…βˆ£βˆ£ NOUN fcis-5211 129 31 𝑠𝑑 𝑠𝑑 PROPN fcis-5211 129 32 ) ) PUNCT fcis-5211 129 33 ) ) PUNCT fcis-5211 129 34 represents represent VERB fcis-5211 129 35 the the DET fcis-5211 129 36 entropy entropy NOUN fcis-5211 129 37 , , PUNCT fcis-5211 129 38 and and CCONJ fcis-5211 129 39 the the DET fcis-5211 129 40 coefficient𝛼 coefficient𝛼 NOUN fcis-5211 129 41 can can AUX fcis-5211 129 42 control control VERB fcis-5211 129 43 the the DET fcis-5211 129 44 randomness randomness NOUN fcis-5211 129 45 of of ADP fcis-5211 129 46 the the DET fcis-5211 129 47 optimal optimal ADJ fcis-5211 129 48 strategy strategy NOUN fcis-5211 129 49 . . PUNCT fcis-5211 130 1 3.3 3.3 NUM fcis-5211 130 2 . . PUNCT fcis-5211 130 3 soft soft ADJ fcis-5211 130 4 q q NOUN fcis-5211 130 5 functions function NOUN fcis-5211 130 6 and and CCONJ fcis-5211 130 7 soft soft ADJ fcis-5211 130 8 values value NOUN fcis-5211 130 9 the the DET fcis-5211 130 10 algorithm algorithm NOUN fcis-5211 130 11 in in ADP fcis-5211 130 12 this this DET fcis-5211 130 13 chapter chapter NOUN fcis-5211 130 14 consists consist VERB fcis-5211 130 15 of of ADP fcis-5211 130 16 a a DET fcis-5211 130 17 critic critic ADJ fcis-5211 130 18 function function NOUN fcis-5211 130 19 and and CCONJ fcis-5211 130 20 an an DET fcis-5211 130 21 actor actor NOUN fcis-5211 130 22 function function NOUN fcis-5211 130 23 . . PUNCT fcis-5211 131 1 where where SCONJ fcis-5211 131 2 the the DET fcis-5211 131 3 critic critic NOUN fcis-5211 131 4 network network NOUN fcis-5211 131 5 is be AUX fcis-5211 131 6 used use VERB fcis-5211 131 7 to to PART fcis-5211 131 8 estimate estimate VERB fcis-5211 131 9 the the DET fcis-5211 131 10 value value NOUN fcis-5211 131 11 function function NOUN fcis-5211 131 12 , , PUNCT fcis-5211 131 13 containing contain VERB fcis-5211 131 14 the the DET fcis-5211 131 15 value value NOUN fcis-5211 131 16 of of ADP fcis-5211 131 17 the the DET fcis-5211 131 18 action action NOUN fcis-5211 131 19 ( ( PUNCT fcis-5211 131 20 q q NOUN fcis-5211 131 21 - - PUNCT fcis-5211 131 22 value value NOUN fcis-5211 131 23 ) ) PUNCT fcis-5211 131 24 or or CCONJ fcis-5211 131 25 the the DET fcis-5211 131 26 value value NOUN fcis-5211 131 27 of of ADP fcis-5211 131 28 the the DET fcis-5211 131 29 state state NOUN fcis-5211 131 30 ( ( PUNCT fcis-5211 131 31 v v NOUN fcis-5211 131 32 - - PUNCT fcis-5211 131 33 value value NOUN fcis-5211 131 34 ) ) PUNCT fcis-5211 131 35 , , PUNCT fcis-5211 131 36 while while SCONJ fcis-5211 131 37 the the DET fcis-5211 131 38 actor actor NOUN fcis-5211 131 39 network network NOUN fcis-5211 131 40 updates update VERB fcis-5211 131 41 the the DET fcis-5211 131 42 policy policy NOUN fcis-5211 131 43 distribution distribution NOUN fcis-5211 131 44 in in ADP fcis-5211 131 45 the the DET fcis-5211 131 46 direction direction NOUN fcis-5211 131 47 suggested suggest VERB fcis-5211 131 48 by by ADP fcis-5211 131 49 critic critic NOUN fcis-5211 131 50 ( ( PUNCT fcis-5211 131 51 e.g. e.g. ADV fcis-5211 131 52 with with ADP fcis-5211 131 53 the the DET fcis-5211 131 54 policy policy NOUN fcis-5211 131 55 gradient gradient NOUN fcis-5211 131 56 ) ) PUNCT fcis-5211 131 57 . . PUNCT fcis-5211 132 1 according accord VERB fcis-5211 132 2 to to ADP fcis-5211 132 3 soft soft ADJ fcis-5211 132 4 bellman bellman NOUN fcis-5211 132 5 equation equation NOUN fcis-5211 132 6 , , PUNCT fcis-5211 132 7 the the DET fcis-5211 132 8 long long ADJ fcis-5211 132 9 - - PUNCT fcis-5211 132 10 term term NOUN fcis-5211 132 11 cumulative cumulative ADJ fcis-5211 132 12 payoff payoff NOUN fcis-5211 132 13 can can AUX fcis-5211 132 14 be be AUX fcis-5211 132 15 expressed express VERB fcis-5211 132 16 as as ADP fcis-5211 132 17 : : PUNCT fcis-5211 132 18 𝑉soft(𝑠𝑑 𝑉soft(𝑠𝑑 NOUN fcis-5211 132 19 ) ) PUNCT fcis-5211 133 1 = = SYM fcis-5211 133 2 π”Όπ‘Žπ‘‘βˆΌπœ‹[𝑄soft(𝑠𝑑 π”Όπ‘Žπ‘‘βˆΌπœ‹[𝑄soft(𝑠𝑑 PROPN fcis-5211 133 3 , , PUNCT fcis-5211 133 4 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 133 5 ) ) PUNCT fcis-5211 133 6 βˆ’ βˆ’ PROPN fcis-5211 133 7 𝛼log(πœ‹ 𝛼log(πœ‹ PROPN fcis-5211 133 8 ( ( PUNCT fcis-5211 133 9 π‘Žπ‘‘ π‘Žπ‘‘ ADP fcis-5211 133 10 ∣∣ ∣∣ NUM fcis-5211 133 11 𝑠𝑑 𝑠𝑑 PROPN fcis-5211 133 12 ) ) PUNCT fcis-5211 133 13 ) ) PUNCT fcis-5211 133 14 ] ] PUNCT fcis-5211 133 15 ( ( PUNCT fcis-5211 133 16 19 19 NUM fcis-5211 133 17 ) ) PUNCT fcis-5211 133 18 the the DET fcis-5211 133 19 corresponding correspond VERB fcis-5211 133 20 q q NOUN fcis-5211 133 21 function function NOUN fcis-5211 133 22 is be AUX fcis-5211 133 23 : : PUNCT fcis-5211 133 24 𝑄soft(𝑠𝑑 𝑄soft(𝑠𝑑 PROPN fcis-5211 133 25 , , PUNCT fcis-5211 133 26 π‘Žπ‘‘ π‘Žπ‘‘ X fcis-5211 133 27 ) ) PUNCT fcis-5211 133 28 = = SYM fcis-5211 133 29 π‘Ÿ(𝑠𝑑 π‘Ÿ(𝑠𝑑 NOUN fcis-5211 133 30 , , PUNCT fcis-5211 133 31 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 133 32 ) ) PUNCT fcis-5211 133 33 + + CCONJ fcis-5211 133 34 𝛾𝔼𝑠𝑑+1,π‘Žπ‘‘+1[𝑄soft(𝑠𝑑+1 𝛾𝔼𝑠𝑑+1,π‘Žπ‘‘+1[𝑄soft(𝑠𝑑+1 NOUN fcis-5211 133 35 , , PUNCT fcis-5211 133 36 π‘Žπ‘‘+1 π‘Žπ‘‘+1 NOUN fcis-5211 133 37 ) ) PUNCT fcis-5211 133 38 βˆ’ βˆ’ PROPN fcis-5211 133 39 𝛼 𝛼 PROPN fcis-5211 133 40 log(πœ‹ log(πœ‹ PROPN fcis-5211 133 41 ( ( PUNCT fcis-5211 133 42 π‘Žπ‘‘+1 π‘Žπ‘‘+1 NOUN fcis-5211 133 43 ∣∣ ∣∣ NUM fcis-5211 133 44 𝑠𝑑+1 𝑠𝑑+1 NOUN fcis-5211 133 45 ) ) PUNCT fcis-5211 133 46 ) ) PUNCT fcis-5211 133 47 ] ] PUNCT fcis-5211 133 48 ( ( PUNCT fcis-5211 133 49 20 20 NUM fcis-5211 133 50 ) ) PUNCT fcis-5211 133 51 3.4 3.4 NUM fcis-5211 133 52 . . PUNCT fcis-5211 134 1 policy policy NOUN fcis-5211 134 2 improvement improvement NOUN fcis-5211 134 3 however however ADV fcis-5211 134 4 , , PUNCT fcis-5211 134 5 with with SCONJ fcis-5211 134 6 the the DET fcis-5211 134 7 size size NOUN fcis-5211 134 8 of of ADP fcis-5211 134 9 the the DET fcis-5211 134 10 problem problem NOUN fcis-5211 134 11 grows grow VERB fcis-5211 134 12 , , PUNCT fcis-5211 134 13 computing compute VERB fcis-5211 134 14 the the DET fcis-5211 134 15 value value NOUN fcis-5211 134 16 between between ADP fcis-5211 134 17 functions function NOUN fcis-5211 134 18 becomes become VERB fcis-5211 134 19 a a DET fcis-5211 134 20 challenge challenge NOUN fcis-5211 134 21 . . PUNCT fcis-5211 135 1 therefore therefore ADV fcis-5211 135 2 , , PUNCT fcis-5211 135 3 this this DET fcis-5211 135 4 chapter chapter NOUN fcis-5211 135 5 introduces introduce VERB fcis-5211 135 6 the the DET fcis-5211 135 7 degree degree NOUN fcis-5211 135 8 neural neural ADJ fcis-5211 135 9 network network NOUN fcis-5211 135 10 ( ( PUNCT fcis-5211 135 11 dnn dnn PROPN fcis-5211 135 12 ) ) PUNCT fcis-5211 135 13 technique technique NOUN fcis-5211 135 14 , , PUNCT fcis-5211 135 15 which which PRON fcis-5211 135 16 is be AUX fcis-5211 135 17 widely widely ADV fcis-5211 135 18 used use VERB fcis-5211 135 19 in in ADP fcis-5211 135 20 the the DET fcis-5211 135 21 field field NOUN fcis-5211 135 22 of of ADP fcis-5211 135 23 function function NOUN fcis-5211 135 24 approximation approximation NOUN fcis-5211 135 25 . . PUNCT fcis-5211 136 1 in in ADP fcis-5211 136 2 the the DET fcis-5211 136 3 strategyπœ‹ strategyπœ‹ PROPN fcis-5211 136 4 update update NOUN fcis-5211 136 5 process process NOUN fcis-5211 136 6 , , PUNCT fcis-5211 136 7 this this DET fcis-5211 136 8 chapter chapter NOUN fcis-5211 136 9 uses use VERB fcis-5211 136 10 a a DET fcis-5211 136 11 deep deep ADJ fcis-5211 136 12 neural neural ADJ fcis-5211 136 13 network network NOUN fcis-5211 136 14 to to PART fcis-5211 136 15 approximate approximate VERB fcis-5211 136 16 the the DET fcis-5211 136 17 soft soft ADJ fcis-5211 136 18 q q NOUN fcis-5211 136 19 function function NOUN fcis-5211 136 20 𝑄soft(𝑠𝑑 𝑄soft(𝑠𝑑 NOUN fcis-5211 136 21 , , PUNCT fcis-5211 136 22 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 136 23 ) ) PUNCT fcis-5211 136 24 to to PART fcis-5211 136 25 further far ADV fcis-5211 136 26 reduce reduce VERB fcis-5211 136 27 the the DET fcis-5211 136 28 error error NOUN fcis-5211 136 29 value.π‘„πœƒ(𝑠𝑑 value.π‘„πœƒ(𝑠𝑑 NOUN fcis-5211 136 30 , , PUNCT fcis-5211 136 31 π‘Žπ‘‘ π‘Žπ‘‘ INTJ fcis-5211 136 32 ) ) PUNCT fcis-5211 136 33 denotes denote VERB fcis-5211 136 34 the the DET fcis-5211 136 35 soft soft ADJ fcis-5211 136 36 approximated approximate VERB fcis-5211 136 37 q q NOUN fcis-5211 136 38 function function NOUN fcis-5211 136 39 , , PUNCT fcis-5211 136 40 which which PRON fcis-5211 136 41 is be AUX fcis-5211 136 42 estimated estimate VERB fcis-5211 136 43 by by ADP fcis-5211 136 44 a a DET fcis-5211 136 45 parameterized parameterized ADJ fcis-5211 136 46 dnn dnn PROPN fcis-5211 136 47 . . PUNCT fcis-5211 137 1 this this DET fcis-5211 137 2 chapter chapter NOUN fcis-5211 137 3 also also ADV fcis-5211 137 4 uses use VERB fcis-5211 137 5 the the DET fcis-5211 137 6 replay replay NOUN fcis-5211 137 7 bufferπ’Ÿ bufferπ’Ÿ PROPN fcis-5211 137 8 to to PART fcis-5211 137 9 improve improve VERB fcis-5211 137 10 its its PRON fcis-5211 137 11 performance performance NOUN fcis-5211 137 12 . . PUNCT fcis-5211 138 1 π’Ÿ π’Ÿ NOUN fcis-5211 138 2 ← ← PROPN fcis-5211 138 3 π’Ÿ π’Ÿ PROPN fcis-5211 138 4 βˆͺ βˆͺ NOUN fcis-5211 138 5 ( ( PUNCT fcis-5211 138 6 π‘ π‘š π‘ π‘š NOUN fcis-5211 138 7 , , PUNCT fcis-5211 138 8 π‘Žπ‘‘ π‘Žπ‘‘ INTJ fcis-5211 138 9 , , PUNCT fcis-5211 138 10 π‘Ÿ(𝑠𝑑 π‘Ÿ(𝑠𝑑 NUM fcis-5211 138 11 , , PUNCT fcis-5211 138 12 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 138 13 ) ) PUNCT fcis-5211 138 14 , , PUNCT fcis-5211 138 15 𝑠𝑑+1 𝑠𝑑+1 NOUN fcis-5211 138 16 ) ) PUNCT fcis-5211 138 17 ( ( PUNCT fcis-5211 138 18 21 21 NUM fcis-5211 138 19 ) ) PUNCT fcis-5211 138 20 therefore therefore ADV fcis-5211 138 21 , , PUNCT fcis-5211 138 22 during during ADP fcis-5211 138 23 the the DET fcis-5211 138 24 training training NOUN fcis-5211 138 25 process process NOUN fcis-5211 138 26 , , PUNCT fcis-5211 138 27 the the DET fcis-5211 138 28 dnn dnn PROPN fcis-5211 138 29 can can AUX fcis-5211 138 30 sample sample VERB fcis-5211 138 31 from from ADP fcis-5211 138 32 the the DET fcis-5211 138 33 replay replay NOUN fcis-5211 138 34 buffer buffer NOUN fcis-5211 138 35 to to PART fcis-5211 138 36 reduce reduce VERB fcis-5211 138 37 the the DET fcis-5211 138 38 internal internal ADJ fcis-5211 138 39 correlation correlation NOUN fcis-5211 138 40 between between ADP fcis-5211 138 41 samples sample NOUN fcis-5211 138 42 in in ADP fcis-5211 138 43 order order NOUN fcis-5211 138 44 to to PART fcis-5211 138 45 avoid avoid VERB fcis-5211 138 46 overfitting overfitte VERB fcis-5211 138 47 . . PUNCT fcis-5211 139 1 meanwhile meanwhile ADV fcis-5211 139 2 , , PUNCT fcis-5211 139 3 this this DET fcis-5211 139 4 algorithm algorithm NOUN fcis-5211 139 5 combines combine VERB fcis-5211 139 6 the the DET fcis-5211 139 7 q q NOUN fcis-5211 139 8 evaluation evaluation NOUN fcis-5211 139 9 valueπ‘„πœƒ(𝑠𝑑 valueπ‘„πœƒ(𝑠𝑑 X fcis-5211 139 10 , , PUNCT fcis-5211 139 11 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 139 12 ) ) PUNCT fcis-5211 139 13 and and CCONJ fcis-5211 139 14 the the DET fcis-5211 139 15 q q NOUN fcis-5211 139 16 target target NOUN fcis-5211 139 17 value value NOUN fcis-5211 139 18 οΏ½ οΏ½ PROPN fcis-5211 139 19 Μ‚ Μ‚ SYM fcis-5211 139 20 οΏ½ οΏ½ PROPN fcis-5211 139 21 ( ( PUNCT fcis-5211 139 22 𝑠𝑑 𝑠𝑑 PROPN fcis-5211 139 23 , , PUNCT fcis-5211 139 24 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 139 25 ) ) PUNCT fcis-5211 139 26 the the DET fcis-5211 139 27 average average ADJ fcis-5211 139 28 standard standard ADJ fcis-5211 139 29 error error NOUN fcis-5211 139 30 between between ADP fcis-5211 139 31 the the DET fcis-5211 139 32 q q NOUN fcis-5211 139 33 - - PUNCT fcis-5211 139 34 values value NOUN fcis-5211 139 35 is be AUX fcis-5211 139 36 used use VERB fcis-5211 139 37 as as ADP fcis-5211 139 38 the the DET fcis-5211 139 39 performance performance NOUN fcis-5211 139 40 index index NOUN fcis-5211 139 41 of of ADP fcis-5211 139 42 dnn dnn PROPN fcis-5211 139 43 , , PUNCT fcis-5211 139 44 while while SCONJ fcis-5211 139 45 we we PRON fcis-5211 139 46 create create VERB fcis-5211 139 47 two two NUM fcis-5211 139 48 q q ADV fcis-5211 139 49 - - PUNCT fcis-5211 139 50 valued value VERB fcis-5211 139 51 networks network NOUN fcis-5211 139 52 withπœƒ1 withπœƒ1 PROPN fcis-5211 139 53 andπœƒ2 andπœƒ2 PROPN fcis-5211 139 54 denoted denote VERB fcis-5211 139 55 . . PUNCT fcis-5211 140 1 the the DET fcis-5211 140 2 loss loss NOUN fcis-5211 140 3 functions function NOUN fcis-5211 140 4 of of ADP fcis-5211 140 5 these these DET fcis-5211 140 6 two two NUM fcis-5211 140 7 networks network NOUN fcis-5211 140 8 can can AUX fcis-5211 140 9 be be AUX fcis-5211 140 10 expressed express VERB fcis-5211 140 11 as as ADP fcis-5211 140 12 𝐽𝑄(πœƒ 𝐽𝑄(πœƒ NOUN fcis-5211 140 13 ) ) PUNCT fcis-5211 141 1 = = PUNCT fcis-5211 142 1 𝔼(π‘ π‘š,π‘Žπ‘‘)βˆΌπ’Ÿ 𝔼(π‘ π‘š,π‘Žπ‘‘)βˆΌπ’Ÿ PUNCT fcis-5211 142 2 [ [ PUNCT fcis-5211 142 3 1 1 NUM fcis-5211 142 4 2 2 NUM fcis-5211 142 5 ( ( PUNCT fcis-5211 142 6 π‘„πœƒ(𝑠𝑑 π‘„πœƒ(𝑠𝑑 PROPN fcis-5211 142 7 , , PUNCT fcis-5211 142 8 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 142 9 ) ) PUNCT fcis-5211 142 10 βˆ’ βˆ’ PROPN fcis-5211 142 11 οΏ½ οΏ½ PROPN fcis-5211 142 12 Μ‚ Μ‚ SYM fcis-5211 142 13 οΏ½ οΏ½ PROPN fcis-5211 142 14 ( ( PUNCT fcis-5211 142 15 𝑠𝑑 𝑠𝑑 PROPN fcis-5211 142 16 , , PUNCT fcis-5211 142 17 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 142 18 ) ) PUNCT fcis-5211 142 19 ) ) PUNCT fcis-5211 142 20 2 2 NUM fcis-5211 142 21 ] ] PUNCT fcis-5211 142 22 ( ( PUNCT fcis-5211 142 23 22 22 NUM fcis-5211 142 24 ) ) PUNCT fcis-5211 143 1 where where SCONJ fcis-5211 143 2 οΏ½ οΏ½ PROPN fcis-5211 143 3 Μ‚ Μ‚ SYM fcis-5211 143 4 οΏ½ οΏ½ PROPN fcis-5211 143 5 ( ( PUNCT fcis-5211 143 6 𝑠𝑑 𝑠𝑑 PROPN fcis-5211 143 7 , , PUNCT fcis-5211 143 8 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 143 9 ) ) PUNCT fcis-5211 143 10 = = SYM fcis-5211 143 11 π‘Ÿ(𝑠𝑑 π‘Ÿ(𝑠𝑑 NOUN fcis-5211 143 12 , , PUNCT fcis-5211 143 13 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 143 14 ) ) PUNCT fcis-5211 144 1 + + NUM fcis-5211 144 2 𝛾𝔼𝑠𝑑+1βˆΌπ‘ 𝛾𝔼𝑠𝑑+1βˆΌπ‘ DET fcis-5211 144 3 [ [ X fcis-5211 144 4 π‘‰πœ“(𝑠𝑑+1 π‘‰πœ“(𝑠𝑑+1 NOUN fcis-5211 144 5 ) ) PUNCT fcis-5211 144 6 ] ] PUNCT fcis-5211 144 7 , , PUNCT fcis-5211 144 8 the the DET fcis-5211 144 9 π’Ÿ π’Ÿ NOUN fcis-5211 144 10 represents represent VERB fcis-5211 144 11 the the DET fcis-5211 144 12 replay replay NOUN fcis-5211 144 13 buffer buffer NOUN fcis-5211 144 14 . . PUNCT fcis-5211 145 1 the the DET fcis-5211 145 2 reason reason NOUN fcis-5211 145 3 for for ADP fcis-5211 145 4 introducing introduce VERB fcis-5211 145 5 two two NUM fcis-5211 145 6 state state NOUN fcis-5211 145 7 action action NOUN fcis-5211 145 8 value value NOUN fcis-5211 145 9 functions function NOUN fcis-5211 145 10 here here ADV fcis-5211 145 11 in in ADP fcis-5211 145 12 this this DET fcis-5211 145 13 chapter chapter NOUN fcis-5211 145 14 is be AUX fcis-5211 145 15 to to PART fcis-5211 145 16 take take VERB fcis-5211 145 17 the the DET fcis-5211 145 18 smallest small ADJ fcis-5211 145 19 one one NUM fcis-5211 145 20 of of ADP fcis-5211 145 21 them they PRON fcis-5211 145 22 when when SCONJ fcis-5211 145 23 updating update VERB fcis-5211 145 24 the the DET fcis-5211 145 25 actors actor NOUN fcis-5211 145 26 later later ADV fcis-5211 145 27 to to PART fcis-5211 145 28 prevent prevent VERB fcis-5211 145 29 overestimation overestimation NOUN fcis-5211 145 30 , , PUNCT fcis-5211 145 31 which which PRON fcis-5211 145 32 is be AUX fcis-5211 145 33 similar similar ADJ fcis-5211 145 34 to to ADP fcis-5211 145 35 the the DET fcis-5211 145 36 idea idea NOUN fcis-5211 145 37 of of ADP fcis-5211 145 38 double double ADJ fcis-5211 145 39 - - PUNCT fcis-5211 145 40 dqn dqn NOUN fcis-5211 145 41 . . PUNCT fcis-5211 146 1 then then ADV fcis-5211 146 2 , , PUNCT fcis-5211 146 3 this this DET fcis-5211 146 4 chapter chapter NOUN fcis-5211 146 5 computes compute VERB fcis-5211 146 6 the the DET fcis-5211 146 7 gradient gradient NOUN fcis-5211 146 8 of of ADP fcis-5211 146 9 by by ADP fcis-5211 146 10 deriving derive VERB fcis-5211 146 11 βˆ‡Μ‚ βˆ‡Μ‚ NOUN fcis-5211 146 12 πœƒπ½π‘„(πœƒ πœƒπ½π‘„(πœƒ PUNCT fcis-5211 146 13 ) ) PUNCT fcis-5211 146 14 = = PUNCT fcis-5211 147 1 βˆ‡πœƒπ‘„πœƒ(𝑠𝑑 βˆ‡πœƒπ‘„πœƒ(𝑠𝑑 NOUN fcis-5211 147 2 , , PUNCT fcis-5211 147 3 π‘Žπ‘‘)(π‘„πœƒ(𝑠𝑑 π‘Žπ‘‘)(π‘„πœƒ(𝑠𝑑 PROPN fcis-5211 147 4 , , PUNCT fcis-5211 147 5 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 147 6 ) ) PUNCT fcis-5211 147 7 βˆ’ βˆ’ ADP fcis-5211 147 8 π‘Ÿ(𝑠𝑑 π‘Ÿ(𝑠𝑑 NOUN fcis-5211 147 9 , , PUNCT fcis-5211 147 10 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 147 11 ) ) PUNCT fcis-5211 147 12 βˆ’ βˆ’ PROPN fcis-5211 147 13 π›Ύπ‘‰πœ“(𝑠𝑑+1 π›Ύπ‘‰πœ“(𝑠𝑑+1 NOUN fcis-5211 147 14 ) ) PUNCT fcis-5211 147 15 ) ) PUNCT fcis-5211 147 16 ( ( PUNCT fcis-5211 147 17 23 23 NUM fcis-5211 147 18 ) ) PUNCT fcis-5211 147 19 the the DET fcis-5211 147 20 same same ADJ fcis-5211 147 21 soft soft ADJ fcis-5211 147 22 value value NOUN fcis-5211 147 23 function function NOUN fcis-5211 147 24 is be AUX fcis-5211 147 25 as as SCONJ fcis-5211 147 26 follows follow VERB fcis-5211 147 27 . . PUNCT fcis-5211 148 1 𝐽𝑉(πœ“ 𝐽𝑉(πœ“ NOUN fcis-5211 148 2 ) ) PUNCT fcis-5211 149 1 = = SYM fcis-5211 149 2 𝔼(π‘ π‘š 𝔼(π‘ π‘š NOUN fcis-5211 149 3 , , PUNCT fcis-5211 149 4 π‘Žπ‘‘)βˆΌπ’Ÿ[(π‘‰πœ“(𝑠𝑑 π‘Žπ‘‘)βˆΌπ’Ÿ[(π‘‰πœ“(𝑠𝑑 NOUN fcis-5211 149 5 ) ) PUNCT fcis-5211 149 6 βˆ’ βˆ’ PROPN fcis-5211 149 7 𝑉soft(𝑠𝑑 𝑉soft(𝑠𝑑 NOUN fcis-5211 149 8 ) ) PUNCT fcis-5211 149 9 ] ] PUNCT fcis-5211 149 10 2 2 NUM fcis-5211 149 11 ( ( PUNCT fcis-5211 149 12 24 24 NUM fcis-5211 149 13 ) ) PUNCT fcis-5211 149 14 with with ADP fcis-5211 149 15 βˆ‡Μ‚ βˆ‡Μ‚ NOUN fcis-5211 149 16 πœ“π½π‘‰(πœ“ πœ“π½π‘‰(πœ“ NOUN fcis-5211 149 17 ) ) PUNCT fcis-5211 149 18 = = SYM fcis-5211 149 19 βˆ‡πœ“π‘‰πœ“(s𝑑)(π‘‰πœ“(𝑠𝑑 βˆ‡πœ“π‘‰πœ“(s𝑑)(π‘‰πœ“(𝑠𝑑 NOUN fcis-5211 149 20 ) ) PUNCT fcis-5211 149 21 βˆ’ βˆ’ PROPN fcis-5211 150 1 π‘„πœƒ(𝑠𝑑 π‘„πœƒ(𝑠𝑑 NOUN fcis-5211 150 2 , , PUNCT fcis-5211 150 3 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 150 4 ) ) PUNCT fcis-5211 150 5 + + CCONJ fcis-5211 150 6 logπœ‹πœ™(π‘Žπ‘‘|𝑠𝑑 logπœ‹πœ™(π‘Žπ‘‘|𝑠𝑑 NOUN fcis-5211 150 7 ) ) PUNCT fcis-5211 150 8 ) ) PUNCT fcis-5211 150 9 ( ( PUNCT fcis-5211 150 10 25 25 NUM fcis-5211 150 11 ) ) PUNCT fcis-5211 150 12 under under ADP fcis-5211 150 13 a a DET fcis-5211 150 14 set set NOUN fcis-5211 150 15 of of ADP fcis-5211 150 16 action action NOUN fcis-5211 150 17 space space NOUN fcis-5211 150 18 collections collection NOUN fcis-5211 150 19 for for ADP fcis-5211 150 20 service service NOUN fcis-5211 150 21 migration migration NOUN fcis-5211 150 22 , , PUNCT fcis-5211 150 23 the the DET fcis-5211 150 24 improvement improvement NOUN fcis-5211 150 25 process process NOUN fcis-5211 150 26 for for ADP fcis-5211 150 27 soft soft ADJ fcis-5211 150 28 policies policy NOUN fcis-5211 150 29 is be AUX fcis-5211 150 30 as as SCONJ fcis-5211 150 31 follows follow VERB fcis-5211 150 32 . . PUNCT fcis-5211 151 1 Ο€β€² Ο€β€² X fcis-5211 151 2 = = PUNCT fcis-5211 152 1 argmin argmin NOUN fcis-5211 152 2 πœ‹π‘šβˆˆπ›± πœ‹π‘šβˆˆπ›± PROPN fcis-5211 152 3 𝐷𝐾𝐿 𝐷𝐾𝐿 PROPN fcis-5211 152 4 ( ( PUNCT fcis-5211 152 5 πœ‹π‘˜ πœ‹π‘˜ NOUN fcis-5211 152 6 ( ( PUNCT fcis-5211 152 7 β‹…βˆ£βˆ£ β‹…βˆ£βˆ£ NOUN fcis-5211 152 8 𝑠𝑑 𝑠𝑑 PROPN fcis-5211 152 9 ) ) PUNCT fcis-5211 152 10 βˆ₯ βˆ₯ PROPN fcis-5211 152 11 exp exp NOUN fcis-5211 152 12 ( ( PUNCT fcis-5211 152 13 1 1 NUM fcis-5211 152 14 𝛼 𝛼 X fcis-5211 152 15 𝑄soft 𝑄soft PROPN fcis-5211 152 16 πœ‹ πœ‹ X fcis-5211 152 17 ( ( PUNCT fcis-5211 152 18 𝑠𝑑 𝑠𝑑 PROPN fcis-5211 152 19 , , PUNCT fcis-5211 152 20 β‹… β‹… PROPN fcis-5211 152 21 ) ) PUNCT fcis-5211 152 22 ) ) PUNCT fcis-5211 153 1 𝑍soft 𝑍soft PROPN fcis-5211 153 2 πœ‹ πœ‹ PROPN fcis-5211 153 3 ( ( PUNCT fcis-5211 153 4 𝑠𝑑 𝑠𝑑 PROPN fcis-5211 153 5 ) ) PUNCT fcis-5211 153 6 ) ) PUNCT fcis-5211 153 7 ( ( PUNCT fcis-5211 153 8 26 26 NUM fcis-5211 153 9 ) ) PUNCT fcis-5211 153 10 where where SCONJ fcis-5211 153 11 Ο€β€² Ο€β€² NOUN fcis-5211 153 12 denotes denote VERB fcis-5211 153 13 the the DET fcis-5211 153 14 new new ADJ fcis-5211 153 15 service service NOUN fcis-5211 153 16 migration migration NOUN fcis-5211 153 17 policy policy NOUN fcis-5211 153 18 , , PUNCT fcis-5211 153 19 and and CCONJ fcis-5211 153 20 Ο€ Ο€ PROPN fcis-5211 153 21 denotes denote VERB fcis-5211 153 22 the the DET fcis-5211 153 23 old old ADJ fcis-5211 153 24 policy policy NOUN fcis-5211 153 25 , , PUNCT fcis-5211 153 26 and and CCONJ fcis-5211 153 27 𝛱 𝛱 PROPN fcis-5211 153 28 denotes denote VERB fcis-5211 153 29 the the DET fcis-5211 153 30 total total ADJ fcis-5211 153 31 feasible feasible ADJ fcis-5211 153 32 set set NOUN fcis-5211 153 33 of of ADP fcis-5211 153 34 policy policy NOUN fcis-5211 153 35 functions function NOUN fcis-5211 153 36 , , PUNCT fcis-5211 153 37 and and CCONJ fcis-5211 153 38 the the DET fcis-5211 153 39 expectation expectation NOUN fcis-5211 153 40 value value NOUN fcis-5211 153 41 under under ADP fcis-5211 153 42 state state NOUN fcis-5211 153 43 π‘ π‘š π‘ π‘š NOUN fcis-5211 153 44 under under ADP fcis-5211 153 45 the the DET fcis-5211 153 46 state state NOUN fcis-5211 153 47 can can AUX fcis-5211 153 48 be be AUX fcis-5211 153 49 approximated approximate VERB fcis-5211 153 50 by by ADP fcis-5211 153 51 sampling sample VERB fcis-5211 153 52 from from ADP fcis-5211 153 53 the the DET fcis-5211 153 54 replay replay NOUN fcis-5211 153 55 buffer buffer NOUN fcis-5211 153 56 π’Ÿ π’Ÿ PROPN fcis-5211 153 57 to to PART fcis-5211 153 58 approximate approximate VERB fcis-5211 153 59 the the DET fcis-5211 153 60 calculation calculation NOUN fcis-5211 153 61 , , PUNCT fcis-5211 153 62 and and CCONJ fcis-5211 153 63 π·π‘šπ‘š π·π‘šπ‘š PROPN fcis-5211 153 64 denotes denote NOUN fcis-5211 153 65 the the DET fcis-5211 153 66 kl kl PROPN fcis-5211 153 67 ( ( PUNCT fcis-5211 153 68 kullback kullback NOUN fcis-5211 153 69 - - PUNCT fcis-5211 153 70 leibler leibler NOUN fcis-5211 153 71 ) ) PUNCT fcis-5211 153 72 scatter scatter NOUN fcis-5211 153 73 , , PUNCT fcis-5211 153 74 and and CCONJ fcis-5211 153 75 𝑍soft 𝑍soft PROPN fcis-5211 153 76 πœ‹ πœ‹ PROPN fcis-5211 153 77 denotes denote VERB fcis-5211 153 78 the the DET fcis-5211 153 79 logarithmic logarithmic ADJ fcis-5211 153 80 partition partition NOUN fcis-5211 153 81 function function NOUN fcis-5211 153 82 , , PUNCT fcis-5211 153 83 which which PRON fcis-5211 153 84 normalizes normalize VERB fcis-5211 153 85 the the DET fcis-5211 153 86 distribution distribution NOUN fcis-5211 153 87 without without ADP fcis-5211 153 88 affecting affect VERB fcis-5211 153 89 the the DET fcis-5211 153 90 policy policy NOUN fcis-5211 153 91 gradient gradient NOUN fcis-5211 153 92 . . PUNCT fcis-5211 154 1 however however ADV fcis-5211 154 2 , , PUNCT fcis-5211 154 3 since since SCONJ fcis-5211 154 4 the the DET fcis-5211 154 5 actions action NOUN fcis-5211 154 6 π‘Žπ‘š π‘Žπ‘š PRON fcis-5211 154 7 are be AUX fcis-5211 154 8 sampled sample VERB fcis-5211 154 9 from from ADP fcis-5211 154 10 a a DET fcis-5211 154 11 random random ADJ fcis-5211 154 12 policy policy NOUN fcis-5211 154 13 distribution distribution NOUN fcis-5211 154 14 , , PUNCT fcis-5211 154 15 their their PRON fcis-5211 154 16 gradients gradient NOUN fcis-5211 154 17 can can AUX fcis-5211 154 18 not not PART fcis-5211 154 19 be be AUX fcis-5211 154 20 computed compute VERB fcis-5211 154 21 52 52 NUM fcis-5211 154 22 directly directly ADV fcis-5211 154 23 . . PUNCT fcis-5211 155 1 to to PART fcis-5211 155 2 solve solve VERB fcis-5211 155 3 this this DET fcis-5211 155 4 problem problem NOUN fcis-5211 155 5 , , PUNCT fcis-5211 155 6 this this DET fcis-5211 155 7 chapter chapter NOUN fcis-5211 155 8 introduces introduce VERB fcis-5211 155 9 a a DET fcis-5211 155 10 reparameterization reparameterization NOUN fcis-5211 155 11 technique technique NOUN fcis-5211 155 12 : : PUNCT fcis-5211 155 13 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 155 14 = = PUNCT fcis-5211 155 15 π‘“πœ™(πœ€π‘‘ π‘“πœ™(πœ€π‘‘ PROPN fcis-5211 155 16 ; ; PUNCT fcis-5211 155 17 𝑠𝑑 𝑠𝑑 NUM fcis-5211 155 18 ) ) PUNCT fcis-5211 155 19 = = PRON fcis-5211 155 20 π‘“πœ™ π‘“πœ™ ADP fcis-5211 155 21 πœ‡(𝑠𝑑 πœ‡(𝑠𝑑 NOUN fcis-5211 155 22 ) ) PUNCT fcis-5211 155 23 + + CCONJ fcis-5211 155 24 πœ€π‘‘βŠ™π‘“πœ™ πœ€π‘‘βŠ™π‘“πœ™ ADP fcis-5211 155 25 𝜎(𝑠𝑑 𝜎(𝑠𝑑 NOUN fcis-5211 155 26 ) ) PUNCT fcis-5211 155 27 , , PUNCT fcis-5211 155 28 whereπœ– whereπœ– NOUN fcis-5211 155 29 ∼ ∼ NOUN fcis-5211 155 30 𝒩(πœ– 𝒩(πœ– VERB fcis-5211 155 31 ) ) PUNCT fcis-5211 155 32 is be AUX fcis-5211 155 33 a a DET fcis-5211 155 34 noise noise NOUN fcis-5211 155 35 parameter parameter NOUN fcis-5211 155 36 . . PUNCT fcis-5211 156 1 the the DET fcis-5211 156 2 objective objective ADJ fcis-5211 156 3 function function NOUN fcis-5211 156 4 can can AUX fcis-5211 156 5 then then ADV fcis-5211 156 6 be be AUX fcis-5211 156 7 rewritten rewrite VERB fcis-5211 156 8 as as SCONJ fcis-5211 156 9 follows follow VERB fcis-5211 156 10 . . PUNCT fcis-5211 157 1 π½πœ‹(πœ™ π½πœ‹(πœ™ NOUN fcis-5211 157 2 ) ) PUNCT fcis-5211 157 3 = = PUNCT fcis-5211 157 4 π”Όπ¬π‘‘βˆΌπ’Ÿ,πœ–π‘‘βˆΌπ’© π”Όπ¬π‘‘βˆΌπ’Ÿ,πœ–π‘‘βˆΌπ’© PROPN fcis-5211 158 1 [ [ X fcis-5211 158 2 logπœ‹πœ™ logπœ‹πœ™ X fcis-5211 158 3 ( ( PUNCT fcis-5211 158 4 π‘“πœ™(πœ–π‘‘ π‘“πœ™(πœ–π‘‘ NOUN fcis-5211 158 5 ; ; PUNCT fcis-5211 158 6 𝑠𝑑)|𝑠𝑑 𝑠𝑑)|𝑠𝑑 NOUN fcis-5211 158 7 ) ) PUNCT fcis-5211 158 8 βˆ’π‘„πœƒ βˆ’π‘„πœƒ NOUN fcis-5211 158 9 ( ( PUNCT fcis-5211 158 10 𝑠𝑑 𝑠𝑑 INTJ fcis-5211 158 11 , , PUNCT fcis-5211 158 12 π‘“πœ™(πœ–π‘‘ π‘“πœ™(πœ–π‘‘ PROPN fcis-5211 158 13 ; ; PUNCT fcis-5211 158 14 𝑠𝑑 𝑠𝑑 NUM fcis-5211 158 15 ) ) PUNCT fcis-5211 158 16 ) ) PUNCT fcis-5211 158 17 ] ] PUNCT fcis-5211 158 18 ( ( PUNCT fcis-5211 158 19 27 27 NUM fcis-5211 158 20 ) ) PUNCT fcis-5211 158 21 the the DET fcis-5211 158 22 policy policy NOUN fcis-5211 158 23 gradient gradient NOUN fcis-5211 158 24 for for ADP fcis-5211 158 25 service service NOUN fcis-5211 158 26 migration migration NOUN fcis-5211 158 27 in in ADP fcis-5211 158 28 this this DET fcis-5211 158 29 chapter chapter NOUN fcis-5211 158 30 can can AUX fcis-5211 158 31 be be AUX fcis-5211 158 32 calculated calculate VERB fcis-5211 158 33 as as ADP fcis-5211 158 34 follows follow NOUN fcis-5211 158 35 . . PUNCT fcis-5211 159 1 βˆ‡Μ‚ βˆ‡Μ‚ ADJ fcis-5211 159 2 πœ™π½πœ‹(πœ™ πœ™π½πœ‹(πœ™ NOUN fcis-5211 159 3 ) ) PUNCT fcis-5211 160 1 = = VERB fcis-5211 161 1 βˆ‡πœ™ βˆ‡πœ™ VERB fcis-5211 161 2 π‘™π‘œπ‘” π‘™π‘œπ‘” NOUN fcis-5211 161 3 πœ‹πœ™(π‘Žπ‘‘|𝑠𝑑 πœ‹πœ™(π‘Žπ‘‘|𝑠𝑑 PROPN fcis-5211 161 4 ) ) PUNCT fcis-5211 161 5 + + CCONJ fcis-5211 161 6 ( ( PUNCT fcis-5211 161 7 βˆ‡π‘Žπ‘‘ βˆ‡π‘Žπ‘‘ PROPN fcis-5211 161 8 logπœ‹πœ™(π‘Žπ‘‘|𝑠𝑑 logπœ‹πœ™(π‘Žπ‘‘|𝑠𝑑 PROPN fcis-5211 161 9 ) ) PUNCT fcis-5211 161 10 βˆ’ βˆ’ PROPN fcis-5211 162 1 βˆ‡π‘Žπ‘‘π‘„(𝑠𝑑 βˆ‡π‘Žπ‘‘π‘„(𝑠𝑑 PROPN fcis-5211 162 2 , , PUNCT fcis-5211 162 3 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 162 4 ) ) PUNCT fcis-5211 162 5 ) ) PUNCT fcis-5211 163 1 βˆ‡πœ™π‘“πœ™(πœ–π‘‘ βˆ‡πœ™π‘“πœ™(πœ–π‘‘ PROPN fcis-5211 163 2 ; ; PUNCT fcis-5211 163 3 𝑠𝑑 𝑠𝑑 NUM fcis-5211 163 4 ) ) PUNCT fcis-5211 163 5 ( ( PUNCT fcis-5211 163 6 28 28 NUM fcis-5211 163 7 ) ) PUNCT fcis-5211 163 8 3.5 3.5 NUM fcis-5211 163 9 . . PUNCT fcis-5211 164 1 algorithm algorithm PROPN fcis-5211 164 2 implement implement PROPN fcis-5211 164 3 table table NOUN fcis-5211 164 4 1 1 NUM fcis-5211 164 5 . . PUNCT fcis-5211 165 1 marl marl NOUN fcis-5211 165 2 - - PUNCT fcis-5211 165 3 based base VERB fcis-5211 165 4 5 5 NUM fcis-5211 165 5 g g ADP fcis-5211 165 6 nr nr NOUN fcis-5211 165 7 v2x v2x VERB fcis-5211 165 8 service service NOUN fcis-5211 165 9 migration migration NOUN fcis-5211 165 10 algorithm algorithm NOUN fcis-5211 165 11 ( ( PUNCT fcis-5211 165 12 macsma macsma PROPN fcis-5211 165 13 ) ) PUNCT fcis-5211 165 14 1 1 NUM fcis-5211 165 15 : : PUNCT fcis-5211 165 16 input input NOUN fcis-5211 165 17 : : PUNCT fcis-5211 165 18 initial initial ADJ fcis-5211 165 19 policy policy NOUN fcis-5211 165 20 parameter parameter NOUN fcis-5211 165 21 πœ™ πœ™ NOUN fcis-5211 165 22 , , PUNCT fcis-5211 165 23 q q NOUN fcis-5211 165 24 function function NOUN fcis-5211 165 25 parameters parameter NOUN fcis-5211 165 26 πœƒ1 πœƒ1 VERB fcis-5211 165 27 , , PUNCT fcis-5211 165 28 πœƒ2 πœƒ2 PROPN fcis-5211 165 29 , , PUNCT fcis-5211 165 30 v v NOUN fcis-5211 165 31 function function NOUN fcis-5211 165 32 parameters parameter NOUN fcis-5211 165 33 πœ“1 πœ“1 NOUN fcis-5211 165 34 , , PUNCT fcis-5211 165 35 πœ“2 πœ“2 NOUN fcis-5211 165 36 2 2 NUM fcis-5211 165 37 : : PUNCT fcis-5211 165 38 output output NOUN fcis-5211 165 39 : : PUNCT fcis-5211 165 40 model model NOUN fcis-5211 165 41 weights weight NOUN fcis-5211 165 42 . . PUNCT fcis-5211 166 1 3 3 NUM fcis-5211 166 2 : : PUNCT fcis-5211 166 3 initial initial ADJ fcis-5211 166 4 replay replay NOUN fcis-5211 166 5 buffer buffer NOUN fcis-5211 166 6 π’Ÿ π’Ÿ NOUN fcis-5211 166 7 4 4 NUM fcis-5211 166 8 : : PUNCT fcis-5211 166 9 for for SCONJ fcis-5211 166 10 each each DET fcis-5211 166 11 iteration iteration NOUN fcis-5211 166 12 do do VERB fcis-5211 166 13 5 5 NUM fcis-5211 166 14 : : PUNCT fcis-5211 166 15 for for SCONJ fcis-5211 166 16 each each DET fcis-5211 166 17 environment environment NOUN fcis-5211 166 18 step step NOUN fcis-5211 166 19 do do VERB fcis-5211 166 20 6 6 NUM fcis-5211 166 21 : : PUNCT fcis-5211 166 22 observe observe VERB fcis-5211 166 23 state state NOUN fcis-5211 166 24 π‘‡π‘š π‘‡π‘š PROPN fcis-5211 166 25 , , PUNCT fcis-5211 166 26 𝑀𝑒,𝑒 𝑀𝑒,𝑒 PROPN fcis-5211 166 27 𝑑 𝑑 ADJ fcis-5211 166 28 and and CCONJ fcis-5211 166 29 select select ADJ fcis-5211 166 30 action action NOUN fcis-5211 166 31 π‘Žπ‘š π‘Žπ‘š NOUN fcis-5211 166 32 from from ADP fcis-5211 166 33 the the DET fcis-5211 166 34 policy policy NOUN fcis-5211 166 35 to to PART fcis-5211 166 36 decide decide VERB fcis-5211 166 37 the the DET fcis-5211 166 38 direction direction NOUN fcis-5211 166 39 of of ADP fcis-5211 166 40 migration migration NOUN fcis-5211 166 41 7 7 NUM fcis-5211 166 42 : : PUNCT fcis-5211 166 43 execute execute VERB fcis-5211 166 44 π‘Žπ‘š π‘Žπ‘š NOUN fcis-5211 166 45 and and CCONJ fcis-5211 166 46 observe observe VERB fcis-5211 166 47 next next ADJ fcis-5211 166 48 state state NOUN fcis-5211 166 49 𝑠𝑑+1 𝑠𝑑+1 NOUN fcis-5211 166 50 8 8 NUM fcis-5211 166 51 : : PUNCT fcis-5211 166 52 calculate calculate NOUN fcis-5211 166 53 cost cost NOUN fcis-5211 166 54 and and CCONJ fcis-5211 166 55 and and CCONJ fcis-5211 166 56 perform perform VERB fcis-5211 166 57 normalization normalization NOUN fcis-5211 166 58 . . PUNCT fcis-5211 167 1 9 9 NUM fcis-5211 167 2 : : PUNCT fcis-5211 167 3 calculate calculate VERB fcis-5211 167 4 reward reward NOUN fcis-5211 167 5 π‘Ÿ(π‘ π‘š π‘Ÿ(π‘ π‘š NOUN fcis-5211 167 6 , , PUNCT fcis-5211 167 7 π‘Žπ‘‘ π‘Žπ‘‘ PROPN fcis-5211 167 8 ) ) PUNCT fcis-5211 167 9 by by ADP fcis-5211 167 10 eq eq PROPN fcis-5211 167 11 . . PUNCT fcis-5211 168 1 ( ( PUNCT fcis-5211 168 2 15 15 NUM fcis-5211 168 3 ) ) PUNCT fcis-5211 168 4 10 10 NUM fcis-5211 168 5 : : PUNCT fcis-5211 168 6 update update NOUN fcis-5211 168 7 replay replay NOUN fcis-5211 168 8 buffer buffer NOUN fcis-5211 168 9 π’Ÿ π’Ÿ NOUN fcis-5211 168 10 by by ADP fcis-5211 168 11 eq eq PROPN fcis-5211 168 12 . . PUNCT fcis-5211 169 1 ( ( PUNCT fcis-5211 169 2 21 21 NUM fcis-5211 169 3 ) ) PUNCT fcis-5211 169 4 11 11 NUM fcis-5211 169 5 : : PUNCT fcis-5211 169 6 end end VERB fcis-5211 169 7 for for ADP fcis-5211 169 8 12 12 NUM fcis-5211 169 9 : : PUNCT fcis-5211 169 10 for for SCONJ fcis-5211 169 11 each each DET fcis-5211 169 12 gradient gradient ADJ fcis-5211 169 13 step step NOUN fcis-5211 169 14 do do VERB fcis-5211 169 15 13 13 NUM fcis-5211 169 16 : : PUNCT fcis-5211 169 17 sample sample NOUN fcis-5211 169 18 from from ADP fcis-5211 169 19 replay replay NOUN fcis-5211 169 20 buffer buffer NOUN fcis-5211 169 21 π’Ÿ π’Ÿ NOUN fcis-5211 169 22 14 14 NUM fcis-5211 169 23 : : PUNCT fcis-5211 169 24 calculate calculate VERB fcis-5211 169 25 and and CCONJ fcis-5211 169 26 update update VERB fcis-5211 169 27 parameters parameter NOUN fcis-5211 169 28 by by ADP fcis-5211 169 29 eq eq PROPN fcis-5211 169 30 . . PROPN fcis-5211 170 1 ( ( PUNCT fcis-5211 170 2 2225 2225 NUM fcis-5211 170 3 ) ) PUNCT fcis-5211 170 4 15 15 NUM fcis-5211 170 5 : : PUNCT fcis-5211 170 6 update update NOUN fcis-5211 170 7 policy policy NOUN fcis-5211 170 8 weights weight NOUN fcis-5211 170 9 by by ADP fcis-5211 170 10 eq eq PROPN fcis-5211 170 11 . . PUNCT fcis-5211 171 1 ( ( PUNCT fcis-5211 171 2 27 27 NUM fcis-5211 171 3 ) ) PUNCT fcis-5211 171 4 and and CCONJ fcis-5211 171 5 eq eq NOUN fcis-5211 171 6 . . PUNCT fcis-5211 172 1 ( ( PUNCT fcis-5211 172 2 28 28 NUM fcis-5211 172 3 ) ) PUNCT fcis-5211 172 4 16 16 NUM fcis-5211 172 5 : : PUNCT fcis-5211 172 6 update update NOUN fcis-5211 172 7 target target NOUN fcis-5211 172 8 value value NOUN fcis-5211 172 9 network network NOUN fcis-5211 172 10 by by ADP fcis-5211 172 11 πœ“ πœ“ PROPN fcis-5211 172 12 ← ← PROPN fcis-5211 172 13 πœπœ“ πœπœ“ PROPN fcis-5211 172 14 + + CCONJ fcis-5211 172 15 ( ( PUNCT fcis-5211 172 16 1 1 NUM fcis-5211 172 17 βˆ’ βˆ’ NUM fcis-5211 172 18 𝜏)πœ“ 𝜏)πœ“ NOUN fcis-5211 172 19 17 17 NUM fcis-5211 172 20 : : PUNCT fcis-5211 172 21 end end VERB fcis-5211 172 22 for for ADP fcis-5211 172 23 18 18 NUM fcis-5211 172 24 : : PUNCT fcis-5211 172 25 end end NOUN fcis-5211 172 26 for for ADP fcis-5211 172 27 the the DET fcis-5211 172 28 whole whole ADJ fcis-5211 172 29 experimental experimental ADJ fcis-5211 172 30 procedure procedure NOUN fcis-5211 172 31 is be AUX fcis-5211 172 32 based base VERB fcis-5211 172 33 on on ADP fcis-5211 172 34 the the DET fcis-5211 172 35 pythongym pythongym NOUN fcis-5211 172 36 environment environment NOUN fcis-5211 172 37 . . PUNCT fcis-5211 173 1 first first ADV fcis-5211 173 2 , , PUNCT fcis-5211 173 3 this this DET fcis-5211 173 4 paper paper NOUN fcis-5211 173 5 designs design VERB fcis-5211 173 6 a a DET fcis-5211 173 7 simulation simulation NOUN fcis-5211 173 8 environment environment NOUN fcis-5211 173 9 and and CCONJ fcis-5211 173 10 collects collect VERB fcis-5211 173 11 the the DET fcis-5211 173 12 state state NOUN fcis-5211 173 13 information information NOUN fcis-5211 173 14 in in ADP fcis-5211 173 15 the the DET fcis-5211 173 16 environment environment NOUN fcis-5211 173 17 . . PUNCT fcis-5211 174 1 second second ADJ fcis-5211 174 2 , , PUNCT fcis-5211 174 3 this this DET fcis-5211 174 4 paper paper NOUN fcis-5211 174 5 uses use VERB fcis-5211 174 6 a a DET fcis-5211 174 7 gym gym NOUN fcis-5211 174 8 wrapper wrapper NOUN fcis-5211 174 9 to to PART fcis-5211 174 10 transform transform VERB fcis-5211 174 11 the the DET fcis-5211 174 12 data datum NOUN fcis-5211 174 13 collected collect VERB fcis-5211 174 14 in in ADP fcis-5211 174 15 this this DET fcis-5211 174 16 paper paper NOUN fcis-5211 174 17 into into ADP fcis-5211 174 18 a a DET fcis-5211 174 19 specific specific ADJ fcis-5211 174 20 data data NOUN fcis-5211 174 21 structure structure NOUN fcis-5211 174 22 . . PUNCT fcis-5211 175 1 then then ADV fcis-5211 175 2 , , PUNCT fcis-5211 175 3 the the DET fcis-5211 175 4 intelligent intelligent ADJ fcis-5211 175 5 body body NOUN fcis-5211 175 6 performs perform VERB fcis-5211 175 7 some some DET fcis-5211 175 8 actions action NOUN fcis-5211 175 9 according accord VERB fcis-5211 175 10 to to ADP fcis-5211 175 11 the the DET fcis-5211 175 12 initial initial ADJ fcis-5211 175 13 random random ADJ fcis-5211 175 14 policy policy NOUN fcis-5211 175 15 and and CCONJ fcis-5211 175 16 observes observe VERB fcis-5211 175 17 the the DET fcis-5211 175 18 state state NOUN fcis-5211 175 19 of of ADP fcis-5211 175 20 the the DET fcis-5211 175 21 environment environment NOUN fcis-5211 175 22 in in ADP fcis-5211 175 23 the the DET fcis-5211 175 24 next next ADJ fcis-5211 175 25 time time NOUN fcis-5211 175 26 period period NOUN fcis-5211 175 27 . . PUNCT fcis-5211 176 1 in in ADP fcis-5211 176 2 this this DET fcis-5211 176 3 paper paper NOUN fcis-5211 176 4 , , PUNCT fcis-5211 176 5 an an DET fcis-5211 176 6 actor actor NOUN fcis-5211 176 7 network network NOUN fcis-5211 176 8 and and CCONJ fcis-5211 176 9 four four NUM fcis-5211 176 10 critic critic NOUN fcis-5211 176 11 networks network NOUN fcis-5211 176 12 are be AUX fcis-5211 176 13 designed design VERB fcis-5211 176 14 , , PUNCT fcis-5211 176 15 consisting consist VERB fcis-5211 176 16 of of ADP fcis-5211 176 17 a a DET fcis-5211 176 18 value value NOUN fcis-5211 176 19 network network NOUN fcis-5211 176 20 , , PUNCT fcis-5211 176 21 a a DET fcis-5211 176 22 target target NOUN fcis-5211 176 23 value value NOUN fcis-5211 176 24 network network NOUN fcis-5211 176 25 and and CCONJ fcis-5211 176 26 two two NUM fcis-5211 176 27 q q ADJ fcis-5211 176 28 - - PUNCT fcis-5211 176 29 value value NOUN fcis-5211 176 30 networks network NOUN fcis-5211 176 31 , , PUNCT fcis-5211 176 32 respectively respectively ADV fcis-5211 176 33 . . PUNCT fcis-5211 177 1 based base VERB fcis-5211 177 2 on on ADP fcis-5211 177 3 the the DET fcis-5211 177 4 currently currently ADV fcis-5211 177 5 observed observe VERB fcis-5211 177 6 stateπ‘ π‘š stateπ‘ π‘š NOUN fcis-5211 177 7 , , PUNCT fcis-5211 177 8 the the DET fcis-5211 177 9 actor actor NOUN fcis-5211 177 10 network network NOUN fcis-5211 177 11 outputs output VERB fcis-5211 177 12 the the DET fcis-5211 177 13 parameters parameter NOUN fcis-5211 177 14 of of ADP fcis-5211 177 15 the the DET fcis-5211 177 16 probability probability NOUN fcis-5211 177 17 distribution distribution NOUN fcis-5211 177 18 of of ADP fcis-5211 177 19 all all DET fcis-5211 177 20 actions action NOUN fcis-5211 177 21 , , PUNCT fcis-5211 177 22 and and CCONJ fcis-5211 177 23 then then ADV fcis-5211 177 24 the the DET fcis-5211 177 25 actions action NOUN fcis-5211 177 26 are be AUX fcis-5211 177 27 based base VERB fcis-5211 177 28 on on ADP fcis-5211 177 29 the the DET fcis-5211 177 30 probability probability NOUN fcis-5211 177 31 distribution distribution NOUN fcis-5211 177 32 π‘Žπ‘š π‘Žπ‘š NOUN fcis-5211 177 33 sampling sample VERB fcis-5211 177 34 is be AUX fcis-5211 177 35 performed perform VERB fcis-5211 177 36 , , PUNCT fcis-5211 177 37 and and CCONJ fcis-5211 177 38 after after SCONJ fcis-5211 177 39 the the DET fcis-5211 177 40 vehicle vehicle NOUN fcis-5211 177 41 adopts adopt VERB fcis-5211 177 42 the the DET fcis-5211 177 43 actionπ‘Žπ‘š actionπ‘Žπ‘š NOUN fcis-5211 177 44 after after ADP fcis-5211 177 45 that that PRON fcis-5211 177 46 , , PUNCT fcis-5211 177 47 collect collect VERB fcis-5211 177 48 the the DET fcis-5211 177 49 next next ADJ fcis-5211 177 50 𝑠𝑑+1 𝑠𝑑+1 NOUN fcis-5211 177 51 and and CCONJ fcis-5211 177 52 π‘Ÿπ‘‘+1 π‘Ÿπ‘‘+1 NOUN fcis-5211 177 53 . . PUNCT fcis-5211 178 1 the the DET fcis-5211 178 2 intelligence intelligence NOUN fcis-5211 178 3 is be AUX fcis-5211 178 4 then then ADV fcis-5211 178 5 trained train VERB fcis-5211 178 6 through through ADP fcis-5211 178 7 multiple multiple ADJ fcis-5211 178 8 iterations iteration NOUN fcis-5211 178 9 such such ADJ fcis-5211 178 10 that that SCONJ fcis-5211 178 11 its its PRON fcis-5211 178 12 long long ADJ fcis-5211 178 13 - - PUNCT fcis-5211 178 14 term term NOUN fcis-5211 178 15 cumulative cumulative ADJ fcis-5211 178 16 reward reward NOUN fcis-5211 178 17 is be AUX fcis-5211 178 18 maximized maximize VERB fcis-5211 178 19 . . PUNCT fcis-5211 179 1 in in ADP fcis-5211 179 2 this this DET fcis-5211 179 3 paper paper NOUN fcis-5211 179 4 , , PUNCT fcis-5211 179 5 ( ( PUNCT fcis-5211 179 6 π‘ π‘š π‘ π‘š ADP fcis-5211 179 7 , , PUNCT fcis-5211 179 8 π‘Žπ‘‘ π‘Žπ‘‘ INTJ fcis-5211 179 9 , , PUNCT fcis-5211 179 10 𝑠𝑑+1 𝑠𝑑+1 NOUN fcis-5211 179 11 , , PUNCT fcis-5211 179 12 π‘Ÿπ‘‘+1 π‘Ÿπ‘‘+1 NOUN fcis-5211 179 13 ) ) PUNCT fcis-5211 179 14 denotes denote NOUN fcis-5211 179 15 experience experience NOUN fcis-5211 179 16 and and CCONJ fcis-5211 179 17 we we PRON fcis-5211 179 18 puts put VERB fcis-5211 179 19 this this DET fcis-5211 179 20 experience experience NOUN fcis-5211 179 21 into into ADP fcis-5211 179 22 replay replay NOUN fcis-5211 179 23 buffer buffer NOUN fcis-5211 179 24 π’Ÿ. π’Ÿ. PROPN fcis-5211 179 25 the the DET fcis-5211 179 26 purpose purpose NOUN fcis-5211 179 27 of of ADP fcis-5211 179 28 the the DET fcis-5211 179 29 replay replay NOUN fcis-5211 179 30 buffer buffer NOUN fcis-5211 179 31 is be AUX fcis-5211 179 32 to to PART fcis-5211 179 33 remove remove VERB fcis-5211 179 34 the the DET fcis-5211 179 35 correlation correlation NOUN fcis-5211 179 36 between between ADP fcis-5211 179 37 experiences experience NOUN fcis-5211 179 38 , , PUNCT fcis-5211 179 39 since since SCONJ fcis-5211 179 40 previous previous ADJ fcis-5211 179 41 and and CCONJ fcis-5211 179 42 future future ADJ fcis-5211 179 43 actions action NOUN fcis-5211 179 44 in in ADP fcis-5211 179 45 reinforcement reinforcement NOUN fcis-5211 179 46 learning learning NOUN fcis-5211 179 47 are be AUX fcis-5211 179 48 usually usually ADV fcis-5211 179 49 strongly strongly ADV fcis-5211 179 50 correlated correlate VERB fcis-5211 179 51 . . PUNCT fcis-5211 180 1 then then ADV fcis-5211 180 2 we we PRON fcis-5211 180 3 update update VERB fcis-5211 180 4 the the DET fcis-5211 180 5 q q ADJ fcis-5211 180 6 - - PUNCT fcis-5211 180 7 value value NOUN fcis-5211 180 8 network network NOUN fcis-5211 180 9 , , PUNCT fcis-5211 180 10 v v NOUN fcis-5211 180 11 - - PUNCT fcis-5211 180 12 value value NOUN fcis-5211 180 13 network network NOUN fcis-5211 180 14 and and CCONJ fcis-5211 180 15 actor actor NOUN fcis-5211 180 16 , , PUNCT fcis-5211 180 17 and and CCONJ fcis-5211 180 18 repeats repeat VERB fcis-5211 180 19 the the DET fcis-5211 180 20 above above ADJ fcis-5211 180 21 steps step NOUN fcis-5211 180 22 until until SCONJ fcis-5211 180 23 the the DET fcis-5211 180 24 algorithm algorithm NOUN fcis-5211 180 25 converges converge VERB fcis-5211 180 26 . . PUNCT fcis-5211 181 1 finally finally ADV fcis-5211 181 2 , , PUNCT fcis-5211 181 3 the the DET fcis-5211 181 4 weights weight NOUN fcis-5211 181 5 of of ADP fcis-5211 181 6 the the DET fcis-5211 181 7 model model NOUN fcis-5211 181 8 are be AUX fcis-5211 181 9 obtained obtain VERB fcis-5211 181 10 , , PUNCT fcis-5211 181 11 i.e. i.e. X fcis-5211 181 12 , , PUNCT fcis-5211 181 13 the the DET fcis-5211 181 14 optimal optimal ADJ fcis-5211 181 15 service service NOUN fcis-5211 181 16 migration migration NOUN fcis-5211 181 17 strategy strategy NOUN fcis-5211 181 18 . . PUNCT fcis-5211 182 1 the the DET fcis-5211 182 2 complete complete ADJ fcis-5211 182 3 algorithm algorithm NOUN fcis-5211 182 4 is be AUX fcis-5211 182 5 shown show VERB fcis-5211 182 6 in in ADP fcis-5211 182 7 algorithm algorithm NOUN fcis-5211 182 8 1 1 NUM fcis-5211 182 9 . . NOUN fcis-5211 182 10 4 4 NUM fcis-5211 182 11 . . X fcis-5211 182 12 experimental experimental ADJ fcis-5211 182 13 results result NOUN fcis-5211 182 14 and and CCONJ fcis-5211 182 15 discussion discussion NOUN fcis-5211 182 16 in in ADP fcis-5211 182 17 this this DET fcis-5211 182 18 section section NOUN fcis-5211 182 19 , , PUNCT fcis-5211 182 20 the the DET fcis-5211 182 21 first first ADJ fcis-5211 182 22 subsection subsection NOUN fcis-5211 182 23 describes describe VERB fcis-5211 182 24 the the DET fcis-5211 182 25 experimental experimental ADJ fcis-5211 182 26 environment environment NOUN fcis-5211 182 27 . . PUNCT fcis-5211 183 1 then then ADV fcis-5211 183 2 the the DET fcis-5211 183 3 performance performance NOUN fcis-5211 183 4 of of ADP fcis-5211 183 5 the the DET fcis-5211 183 6 service service NOUN fcis-5211 183 7 migration migration NOUN fcis-5211 183 8 algorithm algorithm NOUN fcis-5211 183 9 proposed propose VERB fcis-5211 183 10 in in ADP fcis-5211 183 11 this this DET fcis-5211 183 12 chapter chapter NOUN fcis-5211 183 13 is be AUX fcis-5211 183 14 evaluated evaluate VERB fcis-5211 183 15 . . PUNCT fcis-5211 184 1 4.1 4.1 NUM fcis-5211 184 2 . . PUNCT fcis-5211 184 3 experimental experimental ADJ fcis-5211 184 4 environment environment NOUN fcis-5211 184 5 to to PART fcis-5211 184 6 evaluate evaluate VERB fcis-5211 184 7 the the DET fcis-5211 184 8 performance performance NOUN fcis-5211 184 9 of of ADP fcis-5211 184 10 the the DET fcis-5211 184 11 proposed propose VERB fcis-5211 184 12 algorithm algorithm NOUN fcis-5211 184 13 in in ADP fcis-5211 184 14 a a DET fcis-5211 184 15 real real ADJ fcis-5211 184 16 scenario scenario NOUN fcis-5211 184 17 , , PUNCT fcis-5211 184 18 this this DET fcis-5211 184 19 chapter chapter NOUN fcis-5211 184 20 uses use VERB fcis-5211 184 21 alibaba alibaba PROPN fcis-5211 184 22 cluster cluster NOUN fcis-5211 184 23 data datum NOUN fcis-5211 184 24 rather rather ADV fcis-5211 184 25 than than ADP fcis-5211 184 26 randomly randomly ADV fcis-5211 184 27 generated generate VERB fcis-5211 184 28 data datum NOUN fcis-5211 184 29 to to PART fcis-5211 184 30 simulate simulate VERB fcis-5211 184 31 the the DET fcis-5211 184 32 load load NOUN fcis-5211 184 33 of of ADP fcis-5211 184 34 mec mec PROPN fcis-5211 184 35 servers server NOUN fcis-5211 184 36 in in ADP fcis-5211 184 37 a a DET fcis-5211 184 38 real real ADJ fcis-5211 184 39 scenario scenario NOUN fcis-5211 184 40 . . PUNCT fcis-5211 185 1 in in ADP fcis-5211 185 2 this this DET fcis-5211 185 3 dataset dataset NOUN fcis-5211 185 4 , , PUNCT fcis-5211 185 5 there there PRON fcis-5211 185 6 is be VERB fcis-5211 185 7 resource resource NOUN fcis-5211 185 8 usage usage NOUN fcis-5211 185 9 of of ADP fcis-5211 185 10 each each DET fcis-5211 185 11 machine machine NOUN fcis-5211 185 12 , , PUNCT fcis-5211 185 13 meta meta ADJ fcis-5211 185 14 and and CCONJ fcis-5211 185 15 event event NOUN fcis-5211 185 16 information information NOUN fcis-5211 185 17 of of ADP fcis-5211 185 18 containers container NOUN fcis-5211 185 19 , , PUNCT fcis-5211 185 20 and and CCONJ fcis-5211 185 21 resource resource NOUN fcis-5211 185 22 usage usage NOUN fcis-5211 185 23 of of ADP fcis-5211 185 24 each each DET fcis-5211 185 25 container container NOUN fcis-5211 185 26 . . PUNCT fcis-5211 186 1 this this DET fcis-5211 186 2 chapter chapter NOUN fcis-5211 186 3 assumes assume VERB fcis-5211 186 4 that that SCONJ fcis-5211 186 5 there there PRON fcis-5211 186 6 is be VERB fcis-5211 186 7 a a DET fcis-5211 186 8 cellular cellular ADJ fcis-5211 186 9 network network NOUN fcis-5211 186 10 with with ADP fcis-5211 186 11 a a DET fcis-5211 186 12 number number NOUN fcis-5211 186 13 of of ADP fcis-5211 186 14 rsus rsus NOUN fcis-5211 186 15 . . PUNCT fcis-5211 187 1 each each DET fcis-5211 187 2 rsu rsu PROPN fcis-5211 187 3 is be AUX fcis-5211 187 4 equipped equip VERB fcis-5211 187 5 with with ADP fcis-5211 187 6 an an DET fcis-5211 187 7 mec mec PROPN fcis-5211 187 8 server server NOUN fcis-5211 187 9 and and CCONJ fcis-5211 187 10 is be AUX fcis-5211 187 11 deployed deploy VERB fcis-5211 187 12 within within ADP fcis-5211 187 13 a a DET fcis-5211 187 14 radius radius NOUN fcis-5211 187 15 of of ADP fcis-5211 187 16 300 300 NUM fcis-5211 187 17 meters meter NOUN fcis-5211 187 18 . . PUNCT fcis-5211 188 1 within within ADP fcis-5211 188 2 the the DET fcis-5211 188 3 communication communication NOUN fcis-5211 188 4 range range NOUN fcis-5211 188 5 , , PUNCT fcis-5211 188 6 user user NOUN fcis-5211 188 7 devices device NOUN fcis-5211 188 8 can can AUX fcis-5211 188 9 communicate communicate VERB fcis-5211 188 10 with with ADP fcis-5211 188 11 the the DET fcis-5211 188 12 rsu rsu NOUN fcis-5211 188 13 via via ADP fcis-5211 188 14 a a DET fcis-5211 188 15 data data NOUN fcis-5211 188 16 link link NOUN fcis-5211 188 17 and and CCONJ fcis-5211 188 18 obtain obtain VERB fcis-5211 188 19 services service NOUN fcis-5211 188 20 from from ADP fcis-5211 188 21 the the DET fcis-5211 188 22 mec mec PROPN fcis-5211 188 23 server server NOUN fcis-5211 188 24 . . PUNCT fcis-5211 189 1 in in ADP fcis-5211 189 2 the the DET fcis-5211 189 3 simulation simulation NOUN fcis-5211 189 4 experiments experiment NOUN fcis-5211 189 5 , , PUNCT fcis-5211 189 6 the the DET fcis-5211 189 7 maximum maximum ADJ fcis-5211 189 8 number number NOUN fcis-5211 189 9 of of ADP fcis-5211 189 10 training training NOUN fcis-5211 189 11 sets set NOUN fcis-5211 189 12 for for ADP fcis-5211 189 13 the the DET fcis-5211 189 14 proposed propose VERB fcis-5211 189 15 and and CCONJ fcis-5211 189 16 baseline baseline ADJ fcis-5211 189 17 algorithms algorithm NOUN fcis-5211 189 18 is be AUX fcis-5211 189 19 set set VERB fcis-5211 189 20 to to ADP fcis-5211 189 21 60,000 60,000 NUM fcis-5211 189 22 and and CCONJ fcis-5211 189 23 the the DET fcis-5211 189 24 maximum maximum ADJ fcis-5211 189 25 number number NOUN fcis-5211 189 26 of of ADP fcis-5211 189 27 attempts attempt NOUN fcis-5211 189 28 ( ( PUNCT fcis-5211 189 29 episodes episode NOUN fcis-5211 189 30 ) ) PUNCT fcis-5211 189 31 is be AUX fcis-5211 189 32 25 25 NUM fcis-5211 189 33 . . PUNCT fcis-5211 190 1 the the DET fcis-5211 190 2 learning learning NOUN fcis-5211 190 3 rate rate NOUN fcis-5211 190 4 of of ADP fcis-5211 190 5 the the DET fcis-5211 190 6 adam adam PROPN fcis-5211 190 7 optimizer optimizer NOUN fcis-5211 190 8 is be AUX fcis-5211 190 9 set set VERB fcis-5211 190 10 to to ADP fcis-5211 190 11 0.01 0.01 NUM fcis-5211 190 12 and and CCONJ fcis-5211 190 13 the the DET fcis-5211 190 14 discount discount NOUN fcis-5211 190 15 factor factor NOUN fcis-5211 190 16 Ξ³ Ξ³ PROPN fcis-5211 190 17 is be AUX fcis-5211 190 18 set set VERB fcis-5211 190 19 to to ADP fcis-5211 190 20 0.95 0.95 NUM fcis-5211 190 21 in in ADP fcis-5211 190 22 this this DET fcis-5211 190 23 paper paper NOUN fcis-5211 190 24 . . PUNCT fcis-5211 191 1 4.2 4.2 NUM fcis-5211 191 2 . . PUNCT fcis-5211 192 1 experiment experiment NOUN fcis-5211 192 2 results result NOUN fcis-5211 192 3 in in ADP fcis-5211 192 4 this this DET fcis-5211 192 5 subsection subsection NOUN fcis-5211 192 6 , , PUNCT fcis-5211 192 7 we we PRON fcis-5211 192 8 first first ADV fcis-5211 192 9 compare compare VERB fcis-5211 192 10 the the DET fcis-5211 192 11 average average ADJ fcis-5211 192 12 rewards reward NOUN fcis-5211 192 13 of of ADP fcis-5211 192 14 macsma macsma PROPN fcis-5211 192 15 with with ADP fcis-5211 192 16 different different ADJ fcis-5211 192 17 vehicle vehicle NOUN fcis-5211 192 18 number number NOUN fcis-5211 192 19 . . PUNCT fcis-5211 193 1 the the DET fcis-5211 193 2 iterations iteration NOUN fcis-5211 193 3 of of ADP fcis-5211 193 4 the the DET fcis-5211 193 5 algorithms algorithm NOUN fcis-5211 193 6 are be AUX fcis-5211 193 7 all all ADV fcis-5211 193 8 set set VERB fcis-5211 193 9 to to ADP fcis-5211 193 10 60,000 60,000 NUM fcis-5211 193 11 iterations iteration NOUN fcis-5211 193 12 . . PUNCT fcis-5211 194 1 as as SCONJ fcis-5211 194 2 can can AUX fcis-5211 194 3 be be AUX fcis-5211 194 4 seen see VERB fcis-5211 194 5 in in ADP fcis-5211 194 6 figure figure NOUN fcis-5211 194 7 3 3 NUM fcis-5211 194 8 , , PUNCT fcis-5211 194 9 the the DET fcis-5211 194 10 convergence convergence NOUN fcis-5211 194 11 of of ADP fcis-5211 194 12 macsma macsma PROPN fcis-5211 194 13 is be AUX fcis-5211 194 14 achieved achieve VERB fcis-5211 194 15 in in ADP fcis-5211 194 16 the the DET fcis-5211 194 17 following follow VERB fcis-5211 194 18 vehicle vehicle NOUN fcis-5211 194 19 density density NOUN fcis-5211 194 20 environments environment NOUN fcis-5211 194 21 , , PUNCT fcis-5211 194 22 and and CCONJ fcis-5211 194 23 the the DET fcis-5211 194 24 algorithm algorithm NOUN fcis-5211 194 25 performs perform VERB fcis-5211 194 26 better well ADV fcis-5211 194 27 when when SCONJ fcis-5211 194 28 the the DET fcis-5211 194 29 vehicle vehicle NOUN fcis-5211 194 30 density density NOUN fcis-5211 194 31 is be AUX fcis-5211 194 32 low low ADJ fcis-5211 194 33 . . PUNCT fcis-5211 195 1 with with ADP fcis-5211 195 2 the the DET fcis-5211 195 3 vehicle vehicle NOUN fcis-5211 195 4 density density NOUN fcis-5211 195 5 increases increase NOUN fcis-5211 195 6 , , PUNCT fcis-5211 195 7 the the DET fcis-5211 195 8 convergence convergence NOUN fcis-5211 195 9 and and CCONJ fcis-5211 195 10 performance performance NOUN fcis-5211 195 11 of of ADP fcis-5211 195 12 the the DET fcis-5211 195 13 algorithm algorithm NOUN fcis-5211 195 14 decreases decrease VERB fcis-5211 195 15 , , PUNCT fcis-5211 195 16 but but CCONJ fcis-5211 195 17 remains remain VERB fcis-5211 195 18 at at ADP fcis-5211 195 19 a a DET fcis-5211 195 20 more more ADV fcis-5211 195 21 stable stable ADJ fcis-5211 195 22 level level NOUN fcis-5211 195 23 . . PUNCT fcis-5211 196 1 figure figure NOUN fcis-5211 196 2 3 3 NUM fcis-5211 196 3 average average ADJ fcis-5211 196 4 reward reward NOUN fcis-5211 196 5 with with ADP fcis-5211 196 6 different different ADJ fcis-5211 196 7 vehicle vehicle NOUN fcis-5211 196 8 number number NOUN fcis-5211 196 9 then then ADV fcis-5211 196 10 , , PUNCT fcis-5211 196 11 to to PART fcis-5211 196 12 further far ADV fcis-5211 196 13 evaluate evaluate VERB fcis-5211 196 14 the the DET fcis-5211 196 15 performance performance NOUN fcis-5211 196 16 of of ADP fcis-5211 196 17 macsma macsma PROPN fcis-5211 196 18 , , PUNCT fcis-5211 196 19 this this DET fcis-5211 196 20 section section NOUN fcis-5211 196 21 considers consider VERB fcis-5211 196 22 the the DET fcis-5211 196 23 following follow VERB fcis-5211 196 24 metrics metric NOUN fcis-5211 196 25 . . PUNCT fcis-5211 197 1 migration migration NOUN fcis-5211 197 2 cost cost NOUN fcis-5211 197 3 : : PUNCT fcis-5211 197 4 the the DET fcis-5211 197 5 average average ADJ fcis-5211 197 6 time time NOUN fcis-5211 197 7 it it PRON fcis-5211 197 8 takes take VERB fcis-5211 197 9 to to PART fcis-5211 197 10 transfer transfer VERB fcis-5211 197 11 a a DET fcis-5211 197 12 service service NOUN fcis-5211 197 13 from from ADP fcis-5211 197 14 a a DET fcis-5211 197 15 transmitter transmitter NOUN fcis-5211 197 16 to to ADP fcis-5211 197 17 a a DET fcis-5211 197 18 receiver receiver NOUN fcis-5211 197 19 . . PUNCT fcis-5211 198 1 calculated calculate VERB fcis-5211 198 2 cost cost NOUN fcis-5211 198 3 : : PUNCT fcis-5211 198 4 the the DET fcis-5211 198 5 average average ADJ fcis-5211 198 6 time time NOUN fcis-5211 198 7 taken take VERB fcis-5211 198 8 to to PART fcis-5211 198 9 perform perform VERB fcis-5211 198 10 the the DET fcis-5211 198 11 task task NOUN fcis-5211 198 12 . . PUNCT fcis-5211 199 1 energy energy NOUN fcis-5211 199 2 consumption consumption NOUN fcis-5211 199 3 : : PUNCT fcis-5211 199 4 average average ADJ fcis-5211 199 5 total total ADJ fcis-5211 199 6 energy energy NOUN fcis-5211 199 7 consumption consumption NOUN fcis-5211 199 8 53 53 NUM fcis-5211 199 9 for for ADP fcis-5211 199 10 service service NOUN fcis-5211 199 11 migration migration NOUN fcis-5211 199 12 and and CCONJ fcis-5211 199 13 service service NOUN fcis-5211 199 14 calculation calculation NOUN fcis-5211 199 15 . . PUNCT fcis-5211 200 1 this this DET fcis-5211 200 2 section section NOUN fcis-5211 200 3 also also ADV fcis-5211 200 4 considers consider VERB fcis-5211 200 5 the the DET fcis-5211 200 6 sensitivity sensitivity NOUN fcis-5211 200 7 of of ADP fcis-5211 200 8 different different ADJ fcis-5211 200 9 vehicles vehicle NOUN fcis-5211 200 10 to to PART fcis-5211 200 11 delay delay VERB fcis-5211 200 12 and and CCONJ fcis-5211 200 13 energy energy NOUN fcis-5211 200 14 consumption consumption NOUN fcis-5211 200 15 , , PUNCT fcis-5211 200 16 and and CCONJ fcis-5211 200 17 by by ADP fcis-5211 200 18 controlling control VERB fcis-5211 200 19 πœ”1 πœ”1 ADJ fcis-5211 200 20 and and CCONJ fcis-5211 200 21 πœ”2 πœ”2 NOUN fcis-5211 200 22 in in ADP fcis-5211 200 23 eq eq ADP fcis-5211 200 24 . . PUNCT fcis-5211 201 1 ( ( PUNCT fcis-5211 201 2 15 15 NUM fcis-5211 201 3 ) ) PUNCT fcis-5211 201 4 in in ADP fcis-5211 201 5 to to PART fcis-5211 201 6 evaluate evaluate VERB fcis-5211 201 7 various various ADJ fcis-5211 201 8 types type NOUN fcis-5211 201 9 of of ADP fcis-5211 201 10 performance performance NOUN fcis-5211 201 11 . . PUNCT fcis-5211 202 1 ( ( PUNCT fcis-5211 202 2 a a X fcis-5211 202 3 ) ) PUNCT fcis-5211 202 4 ( ( PUNCT fcis-5211 202 5 b b X fcis-5211 202 6 ) ) PUNCT fcis-5211 202 7 ( ( PUNCT fcis-5211 202 8 c c X fcis-5211 202 9 ) ) PUNCT fcis-5211 202 10 figure figure NOUN fcis-5211 202 11 4 4 NUM fcis-5211 202 12 . . PUNCT fcis-5211 202 13 average average ADJ fcis-5211 202 14 computing computing NOUN fcis-5211 202 15 cost cost NOUN fcis-5211 202 16 ( ( PUNCT fcis-5211 202 17 a a X fcis-5211 202 18 ) ) PUNCT fcis-5211 202 19 , , PUNCT fcis-5211 202 20 migration migration NOUN fcis-5211 202 21 cost cost NOUN fcis-5211 202 22 ( ( PUNCT fcis-5211 202 23 b b NOUN fcis-5211 202 24 ) ) PUNCT fcis-5211 202 25 , , PUNCT fcis-5211 202 26 and and CCONJ fcis-5211 202 27 energy energy NOUN fcis-5211 202 28 consumption consumption NOUN fcis-5211 202 29 ( ( PUNCT fcis-5211 202 30 c c NOUN fcis-5211 202 31 ) ) PUNCT fcis-5211 202 32 with with ADP fcis-5211 202 33 different different ADJ fcis-5211 202 34 πœ”1 πœ”1 ADJ fcis-5211 202 35 ( ( PUNCT fcis-5211 202 36 a a NOUN fcis-5211 202 37 ) ) PUNCT fcis-5211 202 38 ( ( PUNCT fcis-5211 202 39 b b X fcis-5211 202 40 ) ) PUNCT fcis-5211 202 41 ( ( PUNCT fcis-5211 202 42 c c X fcis-5211 202 43 ) ) PUNCT fcis-5211 202 44 figure figure NOUN fcis-5211 202 45 5 5 NUM fcis-5211 202 46 . . PUNCT fcis-5211 202 47 average average ADJ fcis-5211 202 48 computing computing NOUN fcis-5211 202 49 cost cost NOUN fcis-5211 202 50 ( ( PUNCT fcis-5211 202 51 a a X fcis-5211 202 52 ) ) PUNCT fcis-5211 202 53 , , PUNCT fcis-5211 202 54 migration migration NOUN fcis-5211 202 55 cost cost NOUN fcis-5211 202 56 ( ( PUNCT fcis-5211 202 57 b b NOUN fcis-5211 202 58 ) ) PUNCT fcis-5211 202 59 , , PUNCT fcis-5211 202 60 and and CCONJ fcis-5211 202 61 energy energy NOUN fcis-5211 202 62 consumption consumption NOUN fcis-5211 202 63 ( ( PUNCT fcis-5211 202 64 c c NOUN fcis-5211 202 65 ) ) PUNCT fcis-5211 202 66 with with ADP fcis-5211 202 67 different different ADJ fcis-5211 202 68 πœ”2 πœ”2 PROPN fcis-5211 202 69 ( ( PUNCT fcis-5211 202 70 a a NOUN fcis-5211 202 71 ) ) PUNCT fcis-5211 202 72 ( ( PUNCT fcis-5211 202 73 b b X fcis-5211 202 74 ) ) PUNCT fcis-5211 202 75 figure figure NOUN fcis-5211 202 76 6 6 NUM fcis-5211 202 77 . . PUNCT fcis-5211 203 1 average average ADJ fcis-5211 203 2 service service NOUN fcis-5211 203 3 delay delay NOUN fcis-5211 203 4 ( ( PUNCT fcis-5211 203 5 a a NOUN fcis-5211 203 6 ) ) PUNCT fcis-5211 203 7 and and CCONJ fcis-5211 203 8 average average ADJ fcis-5211 203 9 energy energy NOUN fcis-5211 203 10 consumption consumption NOUN fcis-5211 203 11 ( ( PUNCT fcis-5211 203 12 b b NOUN fcis-5211 203 13 ) ) PUNCT fcis-5211 203 14 with with ADP fcis-5211 203 15 rsu rsu PROPN fcis-5211 203 16 load load NOUN fcis-5211 203 17 figures figure NOUN fcis-5211 203 18 4 4 NUM fcis-5211 203 19 and and CCONJ fcis-5211 203 20 5 5 NUM fcis-5211 203 21 illustrate illustrate VERB fcis-5211 203 22 the the DET fcis-5211 203 23 performance performance NOUN fcis-5211 203 24 of of ADP fcis-5211 203 25 service service NOUN fcis-5211 203 26 migration migration NOUN fcis-5211 203 27 with with ADP fcis-5211 203 28 different different ADJ fcis-5211 203 29 coefficient coefficient NOUN fcis-5211 203 30 parameters parameter NOUN fcis-5211 203 31 . . PUNCT fcis-5211 204 1 in in ADP fcis-5211 204 2 figure figure NOUN fcis-5211 204 3 4 4 NUM fcis-5211 204 4 , , PUNCT fcis-5211 204 5 when when SCONJ fcis-5211 204 6 πœ”2 πœ”2 ADJ fcis-5211 204 7 increases increase VERB fcis-5211 204 8 , , PUNCT fcis-5211 204 9 the the DET fcis-5211 204 10 average average ADJ fcis-5211 204 11 computing compute VERB fcis-5211 204 12 cost cost NOUN fcis-5211 204 13 of of ADP fcis-5211 204 14 macsma macsma PROPN fcis-5211 204 15 decreases decrease VERB fcis-5211 204 16 , , PUNCT fcis-5211 204 17 because because SCONJ fcis-5211 204 18 the the DET fcis-5211 204 19 larger large ADJ fcis-5211 204 20 πœ”1 πœ”1 NOUN fcis-5211 204 21 is be AUX fcis-5211 204 22 , , PUNCT fcis-5211 204 23 the the DET fcis-5211 204 24 greater great ADJ fcis-5211 204 25 impact impact NOUN fcis-5211 204 26 on on ADP fcis-5211 204 27 service service NOUN fcis-5211 204 28 latency latency NOUN fcis-5211 204 29 is be AUX fcis-5211 204 30 , , PUNCT fcis-5211 204 31 which which PRON fcis-5211 204 32 is be AUX fcis-5211 204 33 reasonable reasonable ADJ fcis-5211 204 34 because because SCONJ fcis-5211 204 35 πœ”1 πœ”1 ADJ fcis-5211 204 36 affects affect VERB fcis-5211 204 37 the the DET fcis-5211 204 38 weight weight NOUN fcis-5211 204 39 of of ADP fcis-5211 204 40 service service NOUN fcis-5211 204 41 delay delay NOUN fcis-5211 204 42 . . PUNCT fcis-5211 205 1 however however ADV fcis-5211 205 2 , , PUNCT fcis-5211 205 3 this this DET fcis-5211 205 4 result result NOUN fcis-5211 205 5 can can AUX fcis-5211 205 6 be be AUX fcis-5211 205 7 easily easily ADV fcis-5211 205 8 deduced deduce VERB fcis-5211 205 9 from from ADP fcis-5211 205 10 eq eq PROPN fcis-5211 205 11 . . PUNCT fcis-5211 206 1 ( ( PUNCT fcis-5211 206 2 15 15 NUM fcis-5211 206 3 ) ) PUNCT fcis-5211 206 4 in in ADP fcis-5211 206 5 this this DET fcis-5211 206 6 section section NOUN fcis-5211 206 7 . . PUNCT fcis-5211 207 1 therefore therefore ADV fcis-5211 207 2 , , PUNCT fcis-5211 207 3 the the DET fcis-5211 207 4 main main ADJ fcis-5211 207 5 purpose purpose NOUN fcis-5211 207 6 of of ADP fcis-5211 207 7 this this DET fcis-5211 207 8 section section NOUN fcis-5211 207 9 to to PART fcis-5211 207 10 introduce introduce VERB fcis-5211 207 11 the the DET fcis-5211 207 12 comparison comparison NOUN fcis-5211 207 13 into into ADP fcis-5211 207 14 this this DET fcis-5211 207 15 paper paper NOUN fcis-5211 207 16 is be AUX fcis-5211 207 17 to to PART fcis-5211 207 18 investigate investigate VERB fcis-5211 207 19 the the DET fcis-5211 207 20 performance performance NOUN fcis-5211 207 21 of of ADP fcis-5211 207 22 each each DET fcis-5211 207 23 algorithm algorithm NOUN fcis-5211 207 24 under under ADP fcis-5211 207 25 different different ADJ fcis-5211 207 26 service service NOUN fcis-5211 207 27 tendencies tendency NOUN fcis-5211 207 28 . . PUNCT fcis-5211 208 1 this this DET fcis-5211 208 2 section section NOUN fcis-5211 208 3 fixes fix VERB fcis-5211 208 4 the the DET fcis-5211 208 5 performance performance NOUN fcis-5211 208 6 of of ADP fcis-5211 208 7 the the DET fcis-5211 208 8 algorithms algorithm NOUN fcis-5211 208 9 by by ADP fcis-5211 208 10 varying vary VERB fcis-5211 208 11 theπœ”1 theπœ”1 NOUN fcis-5211 209 1 the the DET fcis-5211 209 2 value value NOUN fcis-5211 209 3 ofπœ”2 ofπœ”2 NOUN fcis-5211 209 4 value value NOUN fcis-5211 209 5 of of ADP fcis-5211 209 6 the the DET fcis-5211 209 7 algorithm algorithm NOUN fcis-5211 209 8 , , PUNCT fcis-5211 209 9 or or CCONJ fcis-5211 209 10 fixing fix VERB fcis-5211 209 11 only only ADV fcis-5211 209 12 theπœ”2 theπœ”2 NOUN fcis-5211 209 13 value value NOUN fcis-5211 209 14 while while SCONJ fcis-5211 209 15 changing change VERB fcis-5211 209 16 theπœ”2 theπœ”2 NOUN fcis-5211 209 17 values value NOUN fcis-5211 209 18 to to PART fcis-5211 209 19 change change VERB fcis-5211 209 20 the the DET fcis-5211 209 21 weights weight NOUN fcis-5211 209 22 of of ADP fcis-5211 209 23 latency latency NOUN fcis-5211 209 24 and and CCONJ fcis-5211 209 25 energy energy NOUN fcis-5211 209 26 consumption consumption NOUN fcis-5211 209 27 during during ADP fcis-5211 209 28 service service NOUN fcis-5211 209 29 migration migration NOUN fcis-5211 209 30 . . PUNCT fcis-5211 210 1 figures figure NOUN fcis-5211 210 2 4 4 NUM fcis-5211 210 3 ( ( PUNCT fcis-5211 210 4 a a NOUN fcis-5211 210 5 ) ) PUNCT fcis-5211 210 6 , , PUNCT fcis-5211 210 7 ( ( PUNCT fcis-5211 210 8 b b X fcis-5211 210 9 ) ) PUNCT fcis-5211 210 10 and and CCONJ fcis-5211 210 11 ( ( PUNCT fcis-5211 210 12 c c X fcis-5211 210 13 ) ) PUNCT fcis-5211 210 14 show show VERB fcis-5211 210 15 the the DET fcis-5211 210 16 average average ADJ fcis-5211 210 17 migration migration NOUN fcis-5211 210 18 cost cost NOUN fcis-5211 210 19 , , PUNCT fcis-5211 210 20 computing compute VERB fcis-5211 210 21 cost cost NOUN fcis-5211 210 22 and and CCONJ fcis-5211 210 23 energy energy NOUN fcis-5211 210 24 consumption consumption NOUN fcis-5211 210 25 of of ADP fcis-5211 210 26 the the DET fcis-5211 210 27 three three NUM fcis-5211 210 28 algorithms algorithm NOUN fcis-5211 210 29 . . PUNCT fcis-5211 211 1 when when SCONJ fcis-5211 211 2 πœ”1 πœ”1 ADJ fcis-5211 211 3 is be AUX fcis-5211 211 4 small small ADJ fcis-5211 211 5 , , PUNCT fcis-5211 211 6 dqn dqn NOUN fcis-5211 211 7 performs perform VERB fcis-5211 211 8 the the DET fcis-5211 211 9 worst bad ADJ fcis-5211 211 10 , , PUNCT fcis-5211 211 11 while while SCONJ fcis-5211 211 12 the the DET fcis-5211 211 13 algorithm algorithm NOUN fcis-5211 211 14 in in ADP fcis-5211 211 15 this this DET fcis-5211 211 16 paper paper NOUN fcis-5211 211 17 performs perform VERB fcis-5211 211 18 the the DET fcis-5211 211 19 best good ADJ fcis-5211 211 20 in in ADP fcis-5211 211 21 terms term NOUN fcis-5211 211 22 of of ADP fcis-5211 211 23 average average ADJ fcis-5211 211 24 computing computing NOUN fcis-5211 211 25 cost cost NOUN fcis-5211 211 26 and and CCONJ fcis-5211 211 27 energy energy NOUN fcis-5211 211 28 consumption consumption NOUN fcis-5211 211 29 . . PUNCT fcis-5211 212 1 however however ADV fcis-5211 212 2 , , PUNCT fcis-5211 212 3 as as ADP fcis-5211 212 4 theπœ”1 theπœ”1 NOUN fcis-5211 212 5 increases increase NOUN fcis-5211 212 6 , , PUNCT fcis-5211 212 7 the the DET fcis-5211 212 8 performance performance NOUN fcis-5211 212 9 of of ADP fcis-5211 212 10 dqn dqn NOUN fcis-5211 212 11 improves improve VERB fcis-5211 212 12 , , PUNCT fcis-5211 212 13 while while SCONJ fcis-5211 212 14 the the DET fcis-5211 212 15 proposed propose VERB fcis-5211 212 16 algorithm algorithm NOUN fcis-5211 212 17 in in ADP fcis-5211 212 18 this this DET fcis-5211 212 19 paper paper NOUN fcis-5211 212 20 is be AUX fcis-5211 212 21 still still ADV fcis-5211 212 22 the the DET fcis-5211 212 23 best good ADJ fcis-5211 212 24 in in ADP fcis-5211 212 25 fig fig NOUN fcis-5211 212 26 . . PUNCT fcis-5211 213 1 4(b 4(b NUM fcis-5211 213 2 ) ) PUNCT fcis-5211 214 1 and and CCONJ fcis-5211 214 2 ( ( PUNCT fcis-5211 214 3 c c NOUN fcis-5211 214 4 ) ) PUNCT fcis-5211 214 5 . . PUNCT fcis-5211 215 1 in in ADP fcis-5211 215 2 terms term NOUN fcis-5211 215 3 of of ADP fcis-5211 215 4 energy energy NOUN fcis-5211 215 5 consumption consumption NOUN fcis-5211 215 6 and and CCONJ fcis-5211 215 7 migration migration NOUN fcis-5211 215 8 cost cost NOUN fcis-5211 215 9 , , PUNCT fcis-5211 215 10 when when SCONJ fcis-5211 215 11 πœ”1 πœ”1 ADJ fcis-5211 215 12 is be AUX fcis-5211 215 13 small small ADJ fcis-5211 215 14 , , PUNCT fcis-5211 215 15 the the DET fcis-5211 215 16 algorithm algorithm NOUN fcis-5211 215 17 in in ADP fcis-5211 215 18 this this DET fcis-5211 215 19 paper paper NOUN fcis-5211 215 20 clearly clearly ADV fcis-5211 215 21 outperforms outperform VERB fcis-5211 215 22 the the DET fcis-5211 215 23 other other ADJ fcis-5211 215 24 baselines baseline NOUN fcis-5211 215 25 . . PUNCT fcis-5211 216 1 however however ADV fcis-5211 216 2 , , PUNCT fcis-5211 216 3 fig fig NOUN fcis-5211 216 4 . . PUNCT fcis-5211 217 1 6(c 6(c NUM fcis-5211 217 2 ) ) PUNCT fcis-5211 217 3 shows show VERB fcis-5211 217 4 that that SCONJ fcis-5211 217 5 as as ADP fcis-5211 217 6 πœ”1 πœ”1 ADJ fcis-5211 217 7 increases increase NOUN fcis-5211 217 8 , , PUNCT fcis-5211 217 9 the the DET fcis-5211 217 10 advantage advantage NOUN fcis-5211 217 11 of of ADP fcis-5211 217 12 this this DET fcis-5211 217 13 algorithm algorithm NOUN fcis-5211 217 14 over over ADP fcis-5211 217 15 other other ADJ fcis-5211 217 16 benchmark benchmark ADJ fcis-5211 217 17 algorithms algorithm NOUN fcis-5211 217 18 in in ADP fcis-5211 217 19 terms term NOUN fcis-5211 217 20 of of ADP fcis-5211 217 21 energy energy NOUN fcis-5211 217 22 consumption consumption NOUN fcis-5211 217 23 is be AUX fcis-5211 217 24 decreasing decrease VERB fcis-5211 217 25 . . PUNCT fcis-5211 218 1 the the DET fcis-5211 218 2 reason reason NOUN fcis-5211 218 3 for for ADP fcis-5211 218 4 this this DET fcis-5211 218 5 phenomenon phenomenon NOUN fcis-5211 218 6 can can AUX fcis-5211 218 7 be be AUX fcis-5211 218 8 attributed attribute VERB fcis-5211 218 9 to to ADP fcis-5211 218 10 the the DET fcis-5211 218 11 frequent frequent ADJ fcis-5211 218 12 migration migration NOUN fcis-5211 218 13 problem problem NOUN fcis-5211 218 14 , , PUNCT fcis-5211 218 15 which which PRON fcis-5211 218 16 is be AUX fcis-5211 218 17 caused cause VERB fcis-5211 218 18 54 54 NUM fcis-5211 218 19 by by ADP fcis-5211 218 20 the the DET fcis-5211 218 21 requirement requirement NOUN fcis-5211 218 22 to to PART fcis-5211 218 23 increase increase VERB fcis-5211 218 24 the the DET fcis-5211 218 25 exploration exploration NOUN fcis-5211 218 26 rate rate NOUN fcis-5211 218 27 to to PART fcis-5211 218 28 adapt adapt VERB fcis-5211 218 29 to to ADP fcis-5211 218 30 different different ADJ fcis-5211 218 31 environments environment NOUN fcis-5211 218 32 . . PUNCT fcis-5211 219 1 the the DET fcis-5211 219 2 pros pro NOUN fcis-5211 219 3 and and CCONJ fcis-5211 219 4 cons con NOUN fcis-5211 219 5 of of ADP fcis-5211 219 6 this this DET fcis-5211 219 7 feature feature NOUN fcis-5211 219 8 are be AUX fcis-5211 219 9 discussed discuss VERB fcis-5211 219 10 in in ADP fcis-5211 219 11 this this DET fcis-5211 219 12 section section NOUN fcis-5211 219 13 below below ADV fcis-5211 219 14 . . PUNCT fcis-5211 220 1 in in ADP fcis-5211 220 2 short short ADJ fcis-5211 220 3 , , PUNCT fcis-5211 220 4 the the DET fcis-5211 220 5 benefits benefit NOUN fcis-5211 220 6 of of ADP fcis-5211 220 7 a a DET fcis-5211 220 8 high high ADJ fcis-5211 220 9 exploration exploration NOUN fcis-5211 220 10 rate rate NOUN fcis-5211 220 11 far far ADV fcis-5211 220 12 outweigh outweigh VERB fcis-5211 220 13 its its PRON fcis-5211 220 14 increased increase VERB fcis-5211 220 15 cost cost NOUN fcis-5211 220 16 . . PUNCT fcis-5211 221 1 in in ADP fcis-5211 221 2 figure figure NOUN fcis-5211 221 3 5 5 NUM fcis-5211 221 4 , , PUNCT fcis-5211 221 5 this this DET fcis-5211 221 6 section section NOUN fcis-5211 221 7 focuses focus VERB fcis-5211 221 8 on on ADP fcis-5211 221 9 investigating investigate VERB fcis-5211 221 10 the the DET fcis-5211 221 11 effectiveness effectiveness NOUN fcis-5211 221 12 of of ADP fcis-5211 221 13 the the DET fcis-5211 221 14 proposed propose VERB fcis-5211 221 15 algorithm algorithm NOUN fcis-5211 221 16 with with ADP fcis-5211 221 17 different different ADJ fcis-5211 221 18 energy energy NOUN fcis-5211 221 19 consumption consumption NOUN fcis-5211 221 20 weights weight NOUN fcis-5211 221 21 . . PUNCT fcis-5211 222 1 this this DET fcis-5211 222 2 section section NOUN fcis-5211 222 3 finds find VERB fcis-5211 222 4 that that SCONJ fcis-5211 222 5 in in ADP fcis-5211 222 6 fig fig NOUN fcis-5211 222 7 . . PUNCT fcis-5211 223 1 5(c 5(c NUM fcis-5211 223 2 ) ) PUNCT fcis-5211 223 3 , , PUNCT fcis-5211 223 4 compared compare VERB fcis-5211 223 5 to to ADP fcis-5211 223 6 other other ADJ fcis-5211 223 7 benchmark benchmark ADJ fcis-5211 223 8 algorithms algorithm NOUN fcis-5211 223 9 , , PUNCT fcis-5211 223 10 the the DET fcis-5211 223 11 algorithm algorithm NOUN fcis-5211 223 12 in in ADP fcis-5211 223 13 this this DET fcis-5211 223 14 paper paper NOUN fcis-5211 223 15 is be AUX fcis-5211 223 16 very very ADV fcis-5211 223 17 sensitive sensitive ADJ fcis-5211 223 18 to to ADP fcis-5211 223 19 energy energy NOUN fcis-5211 223 20 consumption consumption NOUN fcis-5211 223 21 in in ADP fcis-5211 223 22 terms term NOUN fcis-5211 224 1 ofπœ”2 ofπœ”2 VERB fcis-5211 224 2 very very ADV fcis-5211 224 3 sensitive sensitive ADJ fcis-5211 224 4 . . PUNCT fcis-5211 225 1 in in ADP fcis-5211 225 2 other other ADJ fcis-5211 225 3 words word NOUN fcis-5211 225 4 , , PUNCT fcis-5211 225 5 this this DET fcis-5211 225 6 section section NOUN fcis-5211 225 7 can can AUX fcis-5211 225 8 be be AUX fcis-5211 225 9 improved improve VERB fcis-5211 225 10 by by ADP fcis-5211 225 11 changing change VERB fcis-5211 225 12 the the DET fcis-5211 225 13 πœ”2 πœ”2 NOUN fcis-5211 225 14 the the DET fcis-5211 225 15 energy energy NOUN fcis-5211 225 16 consumption consumption NOUN fcis-5211 225 17 of of ADP fcis-5211 225 18 the the DET fcis-5211 225 19 vehicle vehicle NOUN fcis-5211 225 20 easily easily ADV fcis-5211 225 21 . . PUNCT fcis-5211 226 1 in in ADP fcis-5211 226 2 addition addition NOUN fcis-5211 226 3 , , PUNCT fcis-5211 226 4 it it PRON fcis-5211 226 5 can can AUX fcis-5211 226 6 be be AUX fcis-5211 226 7 seen see VERB fcis-5211 226 8 from from ADP fcis-5211 226 9 fig fig NOUN fcis-5211 226 10 . . PUNCT fcis-5211 227 1 5(a 5(a NUM fcis-5211 227 2 ) ) PUNCT fcis-5211 227 3 and and CCONJ fcis-5211 227 4 ( ( PUNCT fcis-5211 227 5 b b X fcis-5211 227 6 ) ) PUNCT fcis-5211 227 7 that that SCONJ fcis-5211 227 8 the the DET fcis-5211 227 9 algorithm algorithm NOUN fcis-5211 227 10 in in ADP fcis-5211 227 11 this this DET fcis-5211 227 12 paper paper NOUN fcis-5211 227 13 has have VERB fcis-5211 227 14 an an DET fcis-5211 227 15 advantage advantage NOUN fcis-5211 227 16 in in ADP fcis-5211 227 17 terms term NOUN fcis-5211 227 18 of of ADP fcis-5211 227 19 migration migration NOUN fcis-5211 227 20 delay delay NOUN fcis-5211 227 21 and and CCONJ fcis-5211 227 22 computing computing NOUN fcis-5211 227 23 cost cost NOUN fcis-5211 227 24 . . PUNCT fcis-5211 228 1 regardless regardless ADV fcis-5211 228 2 of of ADP fcis-5211 228 3 the the DET fcis-5211 228 4 πœ”2 πœ”2 NOUN fcis-5211 228 5 of of ADP fcis-5211 228 6 the the DET fcis-5211 228 7 values value NOUN fcis-5211 228 8 , , PUNCT fcis-5211 228 9 our our PRON fcis-5211 228 10 proposed propose VERB fcis-5211 228 11 algorithm algorithm NOUN fcis-5211 228 12 in in ADP fcis-5211 228 13 this this DET fcis-5211 228 14 paper paper NOUN fcis-5211 228 15 and and CCONJ fcis-5211 228 16 sac sac NOUN fcis-5211 228 17 are be AUX fcis-5211 228 18 ranked rank VERB fcis-5211 228 19 second second ADJ fcis-5211 228 20 , , PUNCT fcis-5211 228 21 which which PRON fcis-5211 228 22 is be AUX fcis-5211 228 23 because because SCONJ fcis-5211 228 24 they they PRON fcis-5211 228 25 are be AUX fcis-5211 228 26 policy policy NOUN fcis-5211 228 27 optimization optimization NOUN fcis-5211 228 28 methods method NOUN fcis-5211 228 29 and and CCONJ fcis-5211 228 30 focus focus VERB fcis-5211 228 31 more more ADV fcis-5211 228 32 on on ADP fcis-5211 228 33 stability stability NOUN fcis-5211 228 34 . . PUNCT fcis-5211 229 1 figures figure NOUN fcis-5211 229 2 5(a 5(a NUM fcis-5211 229 3 ) ) PUNCT fcis-5211 229 4 , , PUNCT fcis-5211 229 5 ( ( PUNCT fcis-5211 229 6 b b X fcis-5211 229 7 ) ) PUNCT fcis-5211 229 8 and and CCONJ fcis-5211 229 9 ( ( PUNCT fcis-5211 229 10 c c X fcis-5211 229 11 ) ) PUNCT fcis-5211 229 12 show show VERB fcis-5211 229 13 that that SCONJ fcis-5211 229 14 dqn dqn NOUN fcis-5211 229 15 performs perform VERB fcis-5211 229 16 relatively relatively ADV fcis-5211 229 17 poorly poorly ADV fcis-5211 229 18 due due ADJ fcis-5211 229 19 to to ADP fcis-5211 229 20 the the DET fcis-5211 229 21 fact fact NOUN fcis-5211 229 22 that that SCONJ fcis-5211 229 23 dqn dqn NOUN fcis-5211 229 24 focuses focus VERB fcis-5211 229 25 on on ADP fcis-5211 229 26 training train VERB fcis-5211 229 27 the the DET fcis-5211 229 28 q q NOUN fcis-5211 229 29 function function NOUN fcis-5211 229 30 , , PUNCT fcis-5211 229 31 which which PRON fcis-5211 229 32 is be AUX fcis-5211 229 33 more more ADJ fcis-5211 229 34 sample sample NOUN fcis-5211 229 35 efficient efficient ADJ fcis-5211 229 36 but but CCONJ fcis-5211 229 37 also also ADV fcis-5211 229 38 tends tend VERB fcis-5211 229 39 to to PART fcis-5211 229 40 lead lead VERB fcis-5211 229 41 to to ADP fcis-5211 229 42 its its PRON fcis-5211 229 43 poor poor ADJ fcis-5211 229 44 stability stability NOUN fcis-5211 229 45 . . PUNCT fcis-5211 230 1 then then ADV fcis-5211 230 2 , , PUNCT fcis-5211 230 3 we we PRON fcis-5211 230 4 investigate investigate VERB fcis-5211 230 5 the the DET fcis-5211 230 6 average average ADJ fcis-5211 230 7 service service NOUN fcis-5211 230 8 delay delay NOUN fcis-5211 230 9 and and CCONJ fcis-5211 230 10 energy energy NOUN fcis-5211 230 11 consumption consumption NOUN fcis-5211 230 12 under under ADP fcis-5211 230 13 different different ADJ fcis-5211 230 14 rsu rsu NOUN fcis-5211 230 15 loads load NOUN fcis-5211 230 16 in in ADP fcis-5211 230 17 figure figure NOUN fcis-5211 230 18 6 6 NUM fcis-5211 230 19 . . PUNCT fcis-5211 231 1 in in ADP fcis-5211 231 2 this this DET fcis-5211 231 3 paper paper NOUN fcis-5211 231 4 , , PUNCT fcis-5211 231 5 we we PRON fcis-5211 231 6 set set VERB fcis-5211 231 7 the the DET fcis-5211 231 8 rsu rsu NOUN fcis-5211 231 9 load load NOUN fcis-5211 231 10 to to ADP fcis-5211 231 11 a a DET fcis-5211 231 12 value value NOUN fcis-5211 231 13 between between ADP fcis-5211 231 14 0 0 NUM fcis-5211 231 15 and and CCONJ fcis-5211 231 16 1 1 NUM fcis-5211 231 17 . . X fcis-5211 232 1 the the PRON fcis-5211 232 2 higher high ADJ fcis-5211 232 3 the the DET fcis-5211 232 4 value value NOUN fcis-5211 232 5 is be AUX fcis-5211 232 6 , , PUNCT fcis-5211 232 7 the the PRON fcis-5211 232 8 heavier heavy ADJ fcis-5211 232 9 the the DET fcis-5211 232 10 load load NOUN fcis-5211 232 11 of of ADP fcis-5211 232 12 rsu rsu NOUN fcis-5211 232 13 is be AUX fcis-5211 232 14 . . PUNCT fcis-5211 233 1 from from ADP fcis-5211 233 2 figure figure NOUN fcis-5211 233 3 6 6 NUM fcis-5211 233 4 ( ( PUNCT fcis-5211 233 5 a a NOUN fcis-5211 233 6 ) ) PUNCT fcis-5211 233 7 , , PUNCT fcis-5211 233 8 we we PRON fcis-5211 233 9 can can AUX fcis-5211 233 10 see see VERB fcis-5211 233 11 that that SCONJ fcis-5211 233 12 the the DET fcis-5211 233 13 average average ADJ fcis-5211 233 14 service service NOUN fcis-5211 233 15 delay delay NOUN fcis-5211 233 16 gradually gradually ADV fcis-5211 233 17 increases increase VERB fcis-5211 233 18 as as ADP fcis-5211 233 19 the the DET fcis-5211 233 20 load load NOUN fcis-5211 233 21 of of ADP fcis-5211 233 22 the the DET fcis-5211 233 23 rsu rsu NOUN fcis-5211 233 24 increases increase NOUN fcis-5211 233 25 . . PUNCT fcis-5211 234 1 since since SCONJ fcis-5211 234 2 the the DET fcis-5211 234 3 available available ADJ fcis-5211 234 4 computing compute VERB fcis-5211 234 5 resources resource NOUN fcis-5211 234 6 are be AUX fcis-5211 234 7 limited limit VERB fcis-5211 234 8 , , PUNCT fcis-5211 234 9 the the DET fcis-5211 234 10 rsu rsu NOUN fcis-5211 234 11 works work VERB fcis-5211 234 12 at at ADP fcis-5211 234 13 a a DET fcis-5211 234 14 higher high ADJ fcis-5211 234 15 load load NOUN fcis-5211 234 16 level level NOUN fcis-5211 234 17 , , PUNCT fcis-5211 234 18 which which PRON fcis-5211 234 19 means mean VERB fcis-5211 234 20 that that SCONJ fcis-5211 234 21 the the DET fcis-5211 234 22 computing compute VERB fcis-5211 234 23 ability ability NOUN fcis-5211 234 24 of of ADP fcis-5211 234 25 the the DET fcis-5211 234 26 rsu rsu PROPN fcis-5211 234 27 decreases decrease VERB fcis-5211 234 28 . . PUNCT fcis-5211 235 1 the the DET fcis-5211 235 2 average average ADJ fcis-5211 235 3 service service NOUN fcis-5211 235 4 delay delay NOUN fcis-5211 235 5 of of ADP fcis-5211 235 6 our our PRON fcis-5211 235 7 proposed propose VERB fcis-5211 235 8 algorithm algorithm NOUN fcis-5211 235 9 in in ADP fcis-5211 235 10 this this DET fcis-5211 235 11 paper paper NOUN fcis-5211 235 12 is be AUX fcis-5211 235 13 about about ADV fcis-5211 235 14 61ms 61ms NOUN fcis-5211 235 15 at at ADP fcis-5211 235 16 0.8 0.8 NUM fcis-5211 235 17 , , PUNCT fcis-5211 235 18 which which PRON fcis-5211 235 19 is be AUX fcis-5211 235 20 5ms 5ms ADV fcis-5211 235 21 less less ADV fcis-5211 235 22 compared compare VERB fcis-5211 235 23 to to ADP fcis-5211 235 24 the the DET fcis-5211 235 25 dqn dqn ADJ fcis-5211 235 26 algorithm algorithm NOUN fcis-5211 235 27 . . PUNCT fcis-5211 236 1 the the DET fcis-5211 236 2 reason reason NOUN fcis-5211 236 3 is be AUX fcis-5211 236 4 that that SCONJ fcis-5211 236 5 the the DET fcis-5211 236 6 migration migration NOUN fcis-5211 236 7 cost cost NOUN fcis-5211 236 8 model model NOUN fcis-5211 236 9 in in ADP fcis-5211 236 10 this this DET fcis-5211 236 11 paper paper NOUN fcis-5211 236 12 facilitates facilitate VERB fcis-5211 236 13 the the DET fcis-5211 236 14 load load NOUN fcis-5211 236 15 balancing balance VERB fcis-5211 236 16 in in ADP fcis-5211 236 17 resource resource NOUN fcis-5211 236 18 pricing pricing NOUN fcis-5211 236 19 . . PUNCT fcis-5211 237 1 in in ADP fcis-5211 237 2 figure figure NOUN fcis-5211 237 3 6 6 NUM fcis-5211 237 4 ( ( PUNCT fcis-5211 237 5 b b NOUN fcis-5211 237 6 ) ) PUNCT fcis-5211 237 7 , , PUNCT fcis-5211 237 8 the the DET fcis-5211 237 9 average average ADJ fcis-5211 237 10 energy energy NOUN fcis-5211 237 11 consumption consumption NOUN fcis-5211 237 12 increases increase VERB fcis-5211 237 13 gradually gradually ADV fcis-5211 237 14 with with ADP fcis-5211 237 15 the the DET fcis-5211 237 16 increase increase NOUN fcis-5211 237 17 of of ADP fcis-5211 237 18 the the DET fcis-5211 237 19 rsu rsu NOUN fcis-5211 237 20 load load NOUN fcis-5211 237 21 . . PUNCT fcis-5211 238 1 the the DET fcis-5211 238 2 reason reason NOUN fcis-5211 238 3 is be AUX fcis-5211 238 4 that that PRON fcis-5211 238 5 multiple multiple ADJ fcis-5211 238 6 service service NOUN fcis-5211 238 7 migrations migration NOUN fcis-5211 238 8 will will AUX fcis-5211 238 9 be be AUX fcis-5211 238 10 triggered trigger VERB fcis-5211 238 11 to to PART fcis-5211 238 12 avoid avoid VERB fcis-5211 238 13 waiting wait VERB fcis-5211 238 14 due due ADP fcis-5211 238 15 to to ADP fcis-5211 238 16 resource resource NOUN fcis-5211 238 17 exhaustion exhaustion NOUN fcis-5211 238 18 . . PUNCT fcis-5211 239 1 overall overall ADV fcis-5211 239 2 , , PUNCT fcis-5211 239 3 the the DET fcis-5211 239 4 performance performance NOUN fcis-5211 239 5 of of ADP fcis-5211 239 6 our our PRON fcis-5211 239 7 proposed propose VERB fcis-5211 239 8 algorithm algorithm NOUN fcis-5211 239 9 performs perform VERB fcis-5211 239 10 worse bad ADJ fcis-5211 239 11 than than SCONJ fcis-5211 239 12 sac sac VERB fcis-5211 239 13 under under ADP fcis-5211 239 14 low low ADJ fcis-5211 239 15 load load NOUN fcis-5211 239 16 , , PUNCT fcis-5211 239 17 but but CCONJ fcis-5211 239 18 its its PRON fcis-5211 239 19 advantage advantage NOUN fcis-5211 239 20 increases increase VERB fcis-5211 239 21 with with ADP fcis-5211 239 22 the the DET fcis-5211 239 23 increase increase NOUN fcis-5211 239 24 of of ADP fcis-5211 239 25 rsu rsu NOUN fcis-5211 239 26 load load NOUN fcis-5211 239 27 . . PUNCT fcis-5211 240 1 the the DET fcis-5211 240 2 reason reason NOUN fcis-5211 240 3 is be AUX fcis-5211 240 4 that that SCONJ fcis-5211 240 5 the the DET fcis-5211 240 6 singleagent singleagent ADJ fcis-5211 240 7 algorithm algorithm NOUN fcis-5211 240 8 has have VERB fcis-5211 240 9 the the DET fcis-5211 240 10 disadvantage disadvantage NOUN fcis-5211 240 11 of of ADP fcis-5211 240 12 not not PART fcis-5211 240 13 being be AUX fcis-5211 240 14 able able ADJ fcis-5211 240 15 to to PART fcis-5211 240 16 consider consider VERB fcis-5211 240 17 the the DET fcis-5211 240 18 behavior behavior NOUN fcis-5211 240 19 of of ADP fcis-5211 240 20 other other ADJ fcis-5211 240 21 vehicles vehicle NOUN fcis-5211 240 22 , , PUNCT fcis-5211 240 23 while while SCONJ fcis-5211 240 24 our our PRON fcis-5211 240 25 proposed propose VERB fcis-5211 240 26 algorithm algorithm NOUN fcis-5211 240 27 considers consider VERB fcis-5211 240 28 the the DET fcis-5211 240 29 resource resource NOUN fcis-5211 240 30 competition competition NOUN fcis-5211 240 31 problem problem NOUN fcis-5211 240 32 that that PRON fcis-5211 240 33 exists exist VERB fcis-5211 240 34 in in ADP fcis-5211 240 35 multi multi ADJ fcis-5211 240 36 - - ADJ fcis-5211 240 37 vehicle vehicle NOUN fcis-5211 240 38 scenarios scenario NOUN fcis-5211 240 39 and and CCONJ fcis-5211 240 40 thus thus ADV fcis-5211 240 41 has have VERB fcis-5211 240 42 better well ADJ fcis-5211 240 43 performance performance NOUN fcis-5211 240 44 under under ADP fcis-5211 240 45 high high ADJ fcis-5211 240 46 rsu rsu NOUN fcis-5211 240 47 load load NOUN fcis-5211 240 48 . . PUNCT fcis-5211 241 1 5 5 X fcis-5211 241 2 . . X fcis-5211 241 3 conclusion conclusion NOUN fcis-5211 241 4 in in ADP fcis-5211 241 5 this this DET fcis-5211 241 6 paper paper NOUN fcis-5211 241 7 , , PUNCT fcis-5211 241 8 we we PRON fcis-5211 241 9 study study VERB fcis-5211 241 10 the the DET fcis-5211 241 11 service service NOUN fcis-5211 241 12 migration migration NOUN fcis-5211 241 13 problem problem NOUN fcis-5211 241 14 under under ADP fcis-5211 241 15 5g 5g NUM fcis-5211 241 16 - - PUNCT fcis-5211 241 17 nr nr NOUN fcis-5211 241 18 v2x v2x NOUN fcis-5211 241 19 , , PUNCT fcis-5211 241 20 where where SCONJ fcis-5211 241 21 vehicles vehicle NOUN fcis-5211 241 22 migrate migrate VERB fcis-5211 241 23 services service NOUN fcis-5211 241 24 through through ADP fcis-5211 241 25 rsu rsu PROPN fcis-5211 241 26 and and CCONJ fcis-5211 241 27 are be AUX fcis-5211 241 28 optimized optimize VERB fcis-5211 241 29 to to PART fcis-5211 241 30 improve improve VERB fcis-5211 241 31 computing compute VERB fcis-5211 241 32 efficiency efficiency NOUN fcis-5211 241 33 by by ADP fcis-5211 241 34 decreasing decrease VERB fcis-5211 241 35 delay delay NOUN fcis-5211 241 36 and and CCONJ fcis-5211 241 37 energy energy NOUN fcis-5211 241 38 consumption consumption NOUN fcis-5211 241 39 as as ADV fcis-5211 241 40 much much ADV fcis-5211 241 41 as as ADP fcis-5211 241 42 possible possible ADJ fcis-5211 241 43 . . PUNCT fcis-5211 242 1 in in ADP fcis-5211 242 2 this this DET fcis-5211 242 3 paper paper NOUN fcis-5211 242 4 , , PUNCT fcis-5211 242 5 we we PRON fcis-5211 242 6 utilize utilize VERB fcis-5211 242 7 the the DET fcis-5211 242 8 communication communication NOUN fcis-5211 242 9 models model NOUN fcis-5211 242 10 of of ADP fcis-5211 242 11 5 5 NUM fcis-5211 242 12 g g NOUN fcis-5211 242 13 nrv2x nrv2x PROPN fcis-5211 242 14 , , PUNCT fcis-5211 242 15 i.e. i.e. X fcis-5211 242 16 , , PUNCT fcis-5211 242 17 cellular cellular ADJ fcis-5211 242 18 link link NOUN fcis-5211 242 19 and and CCONJ fcis-5211 242 20 millimeter millimeter NOUN fcis-5211 242 21 wave wave NOUN fcis-5211 242 22 , , PUNCT fcis-5211 242 23 to to PART fcis-5211 242 24 improve improve VERB fcis-5211 242 25 the the DET fcis-5211 242 26 system system NOUN fcis-5211 242 27 performance performance NOUN fcis-5211 242 28 by by ADP fcis-5211 242 29 modeling model VERB fcis-5211 242 30 the the DET fcis-5211 242 31 migration migration NOUN fcis-5211 242 32 cost cost NOUN fcis-5211 242 33 , , PUNCT fcis-5211 242 34 computing compute VERB fcis-5211 242 35 cost cost NOUN fcis-5211 242 36 , , PUNCT fcis-5211 242 37 and and CCONJ fcis-5211 242 38 energy energy NOUN fcis-5211 242 39 consumption consumption NOUN fcis-5211 242 40 based base VERB fcis-5211 242 41 on on ADP fcis-5211 242 42 two two NUM fcis-5211 242 43 communication communication NOUN fcis-5211 242 44 models model NOUN fcis-5211 242 45 under under ADP fcis-5211 242 46 v2x v2x NOUN fcis-5211 242 47 , , PUNCT fcis-5211 242 48 and and CCONJ fcis-5211 242 49 transforming transform VERB fcis-5211 242 50 the the DET fcis-5211 242 51 trade trade NOUN fcis-5211 242 52 - - PUNCT fcis-5211 242 53 off off ADP fcis-5211 242 54 problem problem NOUN fcis-5211 242 55 between between ADP fcis-5211 242 56 the the DET fcis-5211 242 57 cost cost NOUN fcis-5211 242 58 and and CCONJ fcis-5211 242 59 benefit benefit NOUN fcis-5211 242 60 of of ADP fcis-5211 242 61 service service NOUN fcis-5211 242 62 migration migration NOUN fcis-5211 242 63 into into ADP fcis-5211 242 64 a a DET fcis-5211 242 65 markov markov NOUN fcis-5211 242 66 decision decision NOUN fcis-5211 242 67 process process NOUN fcis-5211 242 68 . . PUNCT fcis-5211 243 1 then then ADV fcis-5211 243 2 this this DET fcis-5211 243 3 paper paper NOUN fcis-5211 243 4 proposes propose VERB fcis-5211 243 5 a a DET fcis-5211 243 6 multi multi ADJ fcis-5211 243 7 - - ADJ fcis-5211 243 8 intelligence intelligence ADJ fcis-5211 243 9 learning learning NOUN fcis-5211 243 10 algorithm algorithm NOUN fcis-5211 243 11 based base VERB fcis-5211 243 12 on on ADP fcis-5211 243 13 reinforcement reinforcement NOUN fcis-5211 243 14 learning learning NOUN fcis-5211 243 15 . . PUNCT fcis-5211 244 1 experiment experiment NOUN fcis-5211 244 2 shows show VERB fcis-5211 244 3 that that SCONJ fcis-5211 244 4 the the DET fcis-5211 244 5 algorithm algorithm NOUN fcis-5211 244 6 proposed propose VERB fcis-5211 244 7 in in ADP fcis-5211 244 8 this this DET fcis-5211 244 9 paper paper NOUN fcis-5211 244 10 can can AUX fcis-5211 244 11 improve improve VERB fcis-5211 244 12 both both DET fcis-5211 244 13 the the DET fcis-5211 244 14 service service NOUN fcis-5211 244 15 delay delay NOUN fcis-5211 244 16 and and CCONJ fcis-5211 244 17 energy energy NOUN fcis-5211 244 18 consumption consumption NOUN fcis-5211 244 19 . . PUNCT fcis-5211 245 1 references reference NOUN fcis-5211 245 2 [ [ X fcis-5211 245 3 1 1 NUM fcis-5211 245 4 ] ] PUNCT fcis-5211 245 5 a. a. NOUN fcis-5211 245 6 kostopoulos kostopoulos PROPN fcis-5211 245 7 , , PUNCT fcis-5211 245 8 i. i. PROPN fcis-5211 245 9 chochliouros chochliouros PROPN fcis-5211 245 10 , , PUNCT fcis-5211 245 11 j. j. PROPN fcis-5211 245 12 ferragut ferragut PROPN fcis-5211 245 13 , , PUNCT fcis-5211 245 14 y. y. PROPN fcis-5211 245 15 ma ma PROPN fcis-5211 245 16 , , PUNCT fcis-5211 245 17 m. m. NOUN fcis-5211 245 18 kutila kutila PROPN fcis-5211 245 19 , , PUNCT fcis-5211 245 20 a. a. PROPN fcis-5211 245 21 gavras gavras PROPN fcis-5211 245 22 , , PUNCT fcis-5211 245 23 s. s. PROPN fcis-5211 245 24 horsmanheimo horsmanheimo PROPN fcis-5211 245 25 , , PUNCT fcis-5211 245 26 k. k. PROPN fcis-5211 245 27 zhang zhang PROPN fcis-5211 245 28 , , PUNCT fcis-5211 245 29 l. l. PROPN fcis-5211 245 30 ladid ladid PROPN fcis-5211 245 31 , , PUNCT fcis-5211 245 32 and and CCONJ fcis-5211 245 33 a. a. NOUN fcis-5211 245 34 dardamanis dardamanis NOUN fcis-5211 245 35 , , PUNCT fcis-5211 245 36 " " PUNCT fcis-5211 245 37 use use VERB fcis-5211 245 38 cases case NOUN fcis-5211 245 39 and and CCONJ fcis-5211 245 40 standardisation standardisation NOUN fcis-5211 245 41 activities activity NOUN fcis-5211 245 42 for for ADP fcis-5211 245 43 embb embb ADJ fcis-5211 245 44 and and CCONJ fcis-5211 245 45 v2x v2x VERB fcis-5211 245 46 scenarios scenario NOUN fcis-5211 245 47 . . PUNCT fcis-5211 245 48 " " PUNCT fcis-5211 246 1 pp pp ADV fcis-5211 246 2 . . PUNCT fcis-5211 247 1 1 1 NUM fcis-5211 247 2 - - SYM fcis-5211 247 3 7 7 NUM fcis-5211 247 4 . . PUNCT fcis-5211 248 1 [ [ X fcis-5211 248 2 2 2 NUM fcis-5211 248 3 ] ] PUNCT fcis-5211 248 4 m. m. NOUN fcis-5211 248 5 h. h. PROPN fcis-5211 248 6 c. c. PROPN fcis-5211 248 7 garcia garcia PROPN fcis-5211 248 8 , , PUNCT fcis-5211 248 9 a. a. PROPN fcis-5211 248 10 molina molina PROPN fcis-5211 248 11 - - PUNCT fcis-5211 248 12 galan galan PROPN fcis-5211 248 13 , , PUNCT fcis-5211 248 14 m. m. PROPN fcis-5211 248 15 boban boban PROPN fcis-5211 248 16 , , PUNCT fcis-5211 248 17 j. j. PROPN fcis-5211 248 18 gozalvez gozalvez PROPN fcis-5211 248 19 , , PUNCT fcis-5211 248 20 b. b. PROPN fcis-5211 248 21 coll coll PROPN fcis-5211 248 22 - - PUNCT fcis-5211 248 23 perales perales PROPN fcis-5211 248 24 , , PUNCT fcis-5211 248 25 t. t. PROPN fcis-5211 248 26 şahin şahin PROPN fcis-5211 248 27 , , PUNCT fcis-5211 248 28 and and CCONJ fcis-5211 248 29 a. a. NOUN fcis-5211 248 30 kousaridas kousaridas PROPN fcis-5211 248 31 , , PUNCT fcis-5211 248 32 " " PUNCT fcis-5211 248 33 a a DET fcis-5211 248 34 tutorial tutorial NOUN fcis-5211 248 35 on on ADP fcis-5211 248 36 5 5 NUM fcis-5211 248 37 g g NOUN fcis-5211 248 38 nr nr NOUN fcis-5211 248 39 v2x v2x VERB fcis-5211 248 40 communications communication NOUN fcis-5211 248 41 , , PUNCT fcis-5211 248 42 " " PUNCT fcis-5211 248 43 ieee ieee NOUN fcis-5211 248 44 communications communication NOUN fcis-5211 248 45 surveys survey NOUN fcis-5211 248 46 & & CCONJ fcis-5211 248 47 tutorials tutorial NOUN fcis-5211 248 48 , , PUNCT fcis-5211 248 49 vol vol NOUN fcis-5211 248 50 . . PROPN fcis-5211 248 51 23 23 NUM fcis-5211 248 52 , , PUNCT fcis-5211 248 53 no no INTJ fcis-5211 248 54 . . NOUN fcis-5211 248 55 3 3 NUM fcis-5211 248 56 , , PUNCT fcis-5211 248 57 pp pp ADJ fcis-5211 248 58 . . PUNCT fcis-5211 249 1 1972 1972 NUM fcis-5211 249 2 - - SYM fcis-5211 249 3 2026 2026 NUM fcis-5211 249 4 , , PUNCT fcis-5211 249 5 2021 2021 NUM fcis-5211 249 6 . . PUNCT fcis-5211 250 1 [ [ X fcis-5211 250 2 3 3 X fcis-5211 250 3 ] ] X fcis-5211 250 4 j. j. PROPN fcis-5211 250 5 bi bi PROPN fcis-5211 250 6 , , PUNCT fcis-5211 250 7 h. h. PROPN fcis-5211 250 8 yuan yuan PROPN fcis-5211 250 9 , , PUNCT fcis-5211 250 10 s. s. PROPN fcis-5211 250 11 duanmu duanmu PROPN fcis-5211 250 12 , , PUNCT fcis-5211 250 13 m. m. NOUN fcis-5211 250 14 zhou zhou PROPN fcis-5211 250 15 , , PUNCT fcis-5211 250 16 and and CCONJ fcis-5211 250 17 a. a. NOUN fcis-5211 250 18 abusorrah abusorrah PROPN fcis-5211 250 19 , , PUNCT fcis-5211 250 20 " " PUNCT fcis-5211 250 21 energy energy NOUN fcis-5211 250 22 - - PUNCT fcis-5211 250 23 optimized optimize VERB fcis-5211 250 24 partial partial ADJ fcis-5211 250 25 computation computation NOUN fcis-5211 250 26 offloading offload VERB fcis-5211 250 27 in in ADP fcis-5211 250 28 mobileedge mobileedge NOUN fcis-5211 250 29 computing compute VERB fcis-5211 250 30 with with ADP fcis-5211 250 31 genetic genetic ADJ fcis-5211 250 32 simulated simulate VERB fcis-5211 250 33 - - PUNCT fcis-5211 250 34 annealing anneal VERB fcis-5211 250 35 - - PUNCT fcis-5211 250 36 based base VERB fcis-5211 250 37 particle particle NOUN fcis-5211 250 38 swarm swarm NOUN fcis-5211 250 39 optimization optimization NOUN fcis-5211 250 40 , , PUNCT fcis-5211 250 41 " " PUNCT fcis-5211 250 42 ieee ieee NOUN fcis-5211 250 43 internet internet NOUN fcis-5211 250 44 of of ADP fcis-5211 250 45 things thing NOUN fcis-5211 250 46 journal journal NOUN fcis-5211 250 47 , , PUNCT fcis-5211 250 48 vol vol NOUN fcis-5211 250 49 . . PROPN fcis-5211 250 50 8 8 NUM fcis-5211 250 51 , , PUNCT fcis-5211 250 52 no no INTJ fcis-5211 250 53 . . NOUN fcis-5211 250 54 5 5 NUM fcis-5211 250 55 , , PUNCT fcis-5211 250 56 pp pp ADJ fcis-5211 250 57 . . PUNCT fcis-5211 250 58 3774 3774 NUM fcis-5211 250 59 - - SYM fcis-5211 250 60 3785 3785 NUM fcis-5211 250 61 , , PUNCT fcis-5211 250 62 2020 2020 NUM fcis-5211 250 63 . . PUNCT fcis-5211 251 1 [ [ X fcis-5211 251 2 4 4 X fcis-5211 251 3 ] ] PUNCT fcis-5211 251 4 x. x. PROPN fcis-5211 251 5 chen chen PROPN fcis-5211 251 6 , , PUNCT fcis-5211 251 7 h. h. PROPN fcis-5211 251 8 zhang zhang PROPN fcis-5211 251 9 , , PUNCT fcis-5211 251 10 c. c. PROPN fcis-5211 251 11 wu wu PROPN fcis-5211 251 12 , , PUNCT fcis-5211 251 13 s. s. PROPN fcis-5211 251 14 mao mao PROPN fcis-5211 251 15 , , PUNCT fcis-5211 251 16 y. y. PROPN fcis-5211 251 17 ji ji PROPN fcis-5211 251 18 , , PUNCT fcis-5211 251 19 and and CCONJ fcis-5211 251 20 m. m. NOUN fcis-5211 251 21 bennis bennis PROPN fcis-5211 251 22 , , PUNCT fcis-5211 251 23 " " PUNCT fcis-5211 251 24 optimized optimize VERB fcis-5211 251 25 computation computation NOUN fcis-5211 251 26 offloading offload VERB fcis-5211 251 27 performance performance NOUN fcis-5211 251 28 in in ADP fcis-5211 251 29 virtual virtual ADJ fcis-5211 251 30 edge edge NOUN fcis-5211 251 31 computing computing NOUN fcis-5211 251 32 systems system NOUN fcis-5211 251 33 via via ADP fcis-5211 251 34 deep deep ADJ fcis-5211 251 35 reinforcement reinforcement NOUN fcis-5211 251 36 learning learning NOUN fcis-5211 251 37 , , PUNCT fcis-5211 251 38 " " PUNCT fcis-5211 251 39 ieee ieee NOUN fcis-5211 251 40 internet internet NOUN fcis-5211 251 41 of of ADP fcis-5211 251 42 things thing NOUN fcis-5211 251 43 journal journal NOUN fcis-5211 251 44 , , PUNCT fcis-5211 251 45 vol vol NOUN fcis-5211 251 46 . . PROPN fcis-5211 251 47 6 6 NUM fcis-5211 251 48 , , PUNCT fcis-5211 251 49 no no INTJ fcis-5211 251 50 . . NOUN fcis-5211 251 51 3 3 NUM fcis-5211 251 52 , , PUNCT fcis-5211 251 53 pp pp ADJ fcis-5211 251 54 . . PUNCT fcis-5211 252 1 4005 4005 NUM fcis-5211 252 2 - - SYM fcis-5211 252 3 4018 4018 NUM fcis-5211 252 4 , , PUNCT fcis-5211 252 5 2018 2018 NUM fcis-5211 252 6 . . PUNCT fcis-5211 253 1 [ [ X fcis-5211 253 2 5 5 X fcis-5211 253 3 ] ] PUNCT fcis-5211 253 4 t. t. PROPN fcis-5211 253 5 ouyang ouyang PROPN fcis-5211 253 6 , , PUNCT fcis-5211 253 7 z. z. PROPN fcis-5211 253 8 zhou zhou PROPN fcis-5211 253 9 , , PUNCT fcis-5211 253 10 and and CCONJ fcis-5211 253 11 x. x. PROPN fcis-5211 253 12 chen chen PROPN fcis-5211 253 13 , , PUNCT fcis-5211 253 14 " " PUNCT fcis-5211 253 15 follow follow VERB fcis-5211 253 16 me i PRON fcis-5211 253 17 at at ADP fcis-5211 253 18 the the DET fcis-5211 253 19 edge edge NOUN fcis-5211 253 20 : : PUNCT fcis-5211 253 21 mobility mobility NOUN fcis-5211 253 22 - - PUNCT fcis-5211 253 23 aware aware ADJ fcis-5211 253 24 dynamic dynamic ADJ fcis-5211 253 25 service service NOUN fcis-5211 253 26 placement placement NOUN fcis-5211 253 27 for for ADP fcis-5211 253 28 mobile mobile ADJ fcis-5211 253 29 edge edge NOUN fcis-5211 253 30 computing computing NOUN fcis-5211 253 31 , , PUNCT fcis-5211 253 32 " " PUNCT fcis-5211 253 33 ieee ieee NOUN fcis-5211 253 34 journal journal NOUN fcis-5211 253 35 on on ADP fcis-5211 253 36 selected select VERB fcis-5211 253 37 areas area NOUN fcis-5211 253 38 in in ADP fcis-5211 253 39 communications communication NOUN fcis-5211 253 40 , , PUNCT fcis-5211 253 41 vol vol NOUN fcis-5211 253 42 . . PROPN fcis-5211 254 1 36 36 NUM fcis-5211 254 2 , , PUNCT fcis-5211 254 3 no no INTJ fcis-5211 254 4 . . NOUN fcis-5211 254 5 10 10 NUM fcis-5211 254 6 , , PUNCT fcis-5211 254 7 pp pp ADJ fcis-5211 254 8 . . PUNCT fcis-5211 255 1 2333 2333 NUM fcis-5211 255 2 - - SYM fcis-5211 255 3 2345 2345 NUM fcis-5211 255 4 , , PUNCT fcis-5211 255 5 2018 2018 NUM fcis-5211 255 6 . . PUNCT fcis-5211 256 1 [ [ X fcis-5211 256 2 6 6 NUM fcis-5211 256 3 ] ] PUNCT fcis-5211 256 4 h. h. PROPN fcis-5211 256 5 d. d. PROPN fcis-5211 256 6 r. r. PROPN fcis-5211 256 7 albonda albonda PROPN fcis-5211 256 8 , , PUNCT fcis-5211 256 9 and and CCONJ fcis-5211 256 10 j. j. PROPN fcis-5211 256 11 pΓ©rez pΓ©rez PROPN fcis-5211 256 12 - - PUNCT fcis-5211 256 13 romero romero PROPN fcis-5211 256 14 , , PUNCT fcis-5211 256 15 " " PUNCT fcis-5211 256 16 an an DET fcis-5211 256 17 efficient efficient ADJ fcis-5211 256 18 ran ran NOUN fcis-5211 256 19 slicing slice VERB fcis-5211 256 20 strategy strategy NOUN fcis-5211 256 21 for for ADP fcis-5211 256 22 a a DET fcis-5211 256 23 heterogeneous heterogeneous ADJ fcis-5211 256 24 network network NOUN fcis-5211 256 25 with with ADP fcis-5211 256 26 embb embb ADJ fcis-5211 256 27 and and CCONJ fcis-5211 256 28 v2x v2x VERB fcis-5211 256 29 services service NOUN fcis-5211 256 30 , , PUNCT fcis-5211 256 31 " " PUNCT fcis-5211 256 32 ieee ieee NOUN fcis-5211 256 33 access access NOUN fcis-5211 256 34 , , PUNCT fcis-5211 256 35 vol vol NOUN fcis-5211 256 36 . . PROPN fcis-5211 256 37 7 7 NUM fcis-5211 256 38 , , PUNCT fcis-5211 256 39 pp pp ADJ fcis-5211 256 40 . . PUNCT fcis-5211 256 41 44771 44771 NUM fcis-5211 256 42 - - SYM fcis-5211 256 43 44782 44782 NUM fcis-5211 256 44 , , PUNCT fcis-5211 256 45 2019 2019 NUM fcis-5211 256 46 . . PUNCT fcis-5211 257 1 [ [ X fcis-5211 257 2 7 7 X fcis-5211 257 3 ] ] PUNCT fcis-5211 257 4 k. k. PROPN fcis-5211 257 5 guan guan PROPN fcis-5211 257 6 , , PUNCT fcis-5211 257 7 g. g. PROPN fcis-5211 257 8 li li PROPN fcis-5211 257 9 , , PUNCT fcis-5211 257 10 t. t. PROPN fcis-5211 257 11 kΓΌrner kΓΌrner PROPN fcis-5211 257 12 , , PUNCT fcis-5211 257 13 a. a. PROPN fcis-5211 257 14 f. f. PROPN fcis-5211 257 15 molisch molisch PROPN fcis-5211 257 16 , , PUNCT fcis-5211 257 17 b. b. PROPN fcis-5211 257 18 peng peng PROPN fcis-5211 257 19 , , PUNCT fcis-5211 257 20 r. r. PROPN fcis-5211 257 21 he he PRON fcis-5211 257 22 , , PUNCT fcis-5211 257 23 b. b. PROPN fcis-5211 257 24 hui hui PROPN fcis-5211 257 25 , , PUNCT fcis-5211 257 26 j. j. PROPN fcis-5211 257 27 kim kim PROPN fcis-5211 257 28 , , PUNCT fcis-5211 257 29 and and CCONJ fcis-5211 257 30 z. z. PROPN fcis-5211 257 31 zhong zhong PROPN fcis-5211 257 32 , , PUNCT fcis-5211 257 33 " " PUNCT fcis-5211 257 34 on on ADP fcis-5211 257 35 millimeter millimeter NOUN fcis-5211 257 36 wave wave NOUN fcis-5211 257 37 and and CCONJ fcis-5211 257 38 thz thz ADJ fcis-5211 257 39 mobile mobile ADJ fcis-5211 257 40 radio radio NOUN fcis-5211 257 41 channel channel NOUN fcis-5211 257 42 for for ADP fcis-5211 257 43 smart smart ADJ fcis-5211 257 44 rail rail NOUN fcis-5211 257 45 mobility mobility NOUN fcis-5211 257 46 , , PUNCT fcis-5211 257 47 " " PUNCT fcis-5211 257 48 ieee ieee NOUN fcis-5211 257 49 transactions transaction NOUN fcis-5211 257 50 on on ADP fcis-5211 257 51 vehicular vehicular ADJ fcis-5211 257 52 technology technology NOUN fcis-5211 257 53 , , PUNCT fcis-5211 257 54 vol vol NOUN fcis-5211 257 55 . . PROPN fcis-5211 257 56 66 66 NUM fcis-5211 257 57 , , PUNCT fcis-5211 257 58 no no INTJ fcis-5211 257 59 . . NOUN fcis-5211 257 60 7 7 NUM fcis-5211 257 61 , , PUNCT fcis-5211 257 62 pp pp ADJ fcis-5211 257 63 . . PUNCT fcis-5211 258 1 5658 5658 NUM fcis-5211 258 2 - - SYM fcis-5211 258 3 5674 5674 NUM fcis-5211 258 4 , , PUNCT fcis-5211 258 5 2016 2016 NUM fcis-5211 258 6 . . PUNCT fcis-5211 259 1 [ [ X fcis-5211 259 2 8 8 NUM fcis-5211 259 3 ] ] X fcis-5211 259 4 g. g. PROPN fcis-5211 259 5 naik naik PROPN fcis-5211 259 6 , , PUNCT fcis-5211 259 7 b. b. PROPN fcis-5211 259 8 choudhury choudhury PROPN fcis-5211 259 9 , , PUNCT fcis-5211 259 10 and and CCONJ fcis-5211 259 11 j.-m j.-m PROPN fcis-5211 259 12 . . PUNCT fcis-5211 260 1 park park PROPN fcis-5211 260 2 , , PUNCT fcis-5211 260 3 " " PUNCT fcis-5211 260 4 ieee ieee NOUN fcis-5211 260 5 802.11 802.11 NUM fcis-5211 260 6 bd bd PROPN fcis-5211 260 7 & & CCONJ fcis-5211 260 8 5 5 NUM fcis-5211 260 9 g g NOUN fcis-5211 260 10 nr nr NOUN fcis-5211 260 11 v2x v2x NOUN fcis-5211 260 12 : : PUNCT fcis-5211 260 13 evolution evolution NOUN fcis-5211 260 14 of of ADP fcis-5211 260 15 radio radio NOUN fcis-5211 260 16 access access NOUN fcis-5211 260 17 technologies technology NOUN fcis-5211 260 18 for for ADP fcis-5211 260 19 v2x v2x NOUN fcis-5211 260 20 communications communication NOUN fcis-5211 260 21 , , PUNCT fcis-5211 260 22 " " PUNCT fcis-5211 260 23 ieee ieee NOUN fcis-5211 260 24 access access NOUN fcis-5211 260 25 , , PUNCT fcis-5211 260 26 vol vol NOUN fcis-5211 260 27 . . PROPN fcis-5211 260 28 7 7 NUM fcis-5211 260 29 , , PUNCT fcis-5211 260 30 pp pp ADJ fcis-5211 260 31 . . PUNCT fcis-5211 261 1 70169 70169 NUM fcis-5211 261 2 - - SYM fcis-5211 261 3 70184 70184 NUM fcis-5211 261 4 , , PUNCT fcis-5211 261 5 2019 2019 NUM fcis-5211 261 6 . . PUNCT fcis-5211 262 1 [ [ X fcis-5211 262 2 9 9 NUM fcis-5211 262 3 ] ] PUNCT fcis-5211 262 4 m. m. NOUN fcis-5211 262 5 harounabadi harounabadi NOUN fcis-5211 262 6 , , PUNCT fcis-5211 262 7 d. d. PROPN fcis-5211 262 8 m. m. PROPN fcis-5211 262 9 soleymani soleymani PROPN fcis-5211 262 10 , , PUNCT fcis-5211 262 11 s. s. PROPN fcis-5211 262 12 bhadauria bhadauria PROPN fcis-5211 262 13 , , PUNCT fcis-5211 262 14 m. m. NOUN fcis-5211 262 15 leyh leyh PROPN fcis-5211 262 16 , , PUNCT fcis-5211 262 17 and and CCONJ fcis-5211 262 18 e. e. PROPN fcis-5211 262 19 roth roth PROPN fcis-5211 262 20 - - PUNCT fcis-5211 262 21 mandutz mandutz PROPN fcis-5211 262 22 , , PUNCT fcis-5211 262 23 " " PUNCT fcis-5211 262 24 v2x v2x VERB fcis-5211 262 25 in in ADP fcis-5211 262 26 3gpp 3gpp PROPN fcis-5211 262 27 standardization standardization NOUN fcis-5211 262 28 : : PUNCT fcis-5211 262 29 nr nr PRON fcis-5211 262 30 sidelink sidelink VERB fcis-5211 262 31 in in ADP fcis-5211 262 32 release-16 release-16 PROPN fcis-5211 262 33 and and CCONJ fcis-5211 262 34 beyond beyond ADP fcis-5211 262 35 , , PUNCT fcis-5211 262 36 " " PUNCT fcis-5211 262 37 ieee ieee NOUN fcis-5211 262 38 communications communication NOUN fcis-5211 262 39 standards standard NOUN fcis-5211 262 40 magazine magazine NOUN fcis-5211 262 41 , , PUNCT fcis-5211 262 42 vol vol NOUN fcis-5211 262 43 . . PROPN fcis-5211 262 44 5 5 NUM fcis-5211 262 45 , , PUNCT fcis-5211 262 46 no no INTJ fcis-5211 262 47 . . NOUN fcis-5211 262 48 1 1 NUM fcis-5211 262 49 , , PUNCT fcis-5211 262 50 pp pp ADJ fcis-5211 262 51 . . PUNCT fcis-5211 263 1 12 12 NUM fcis-5211 263 2 - - SYM fcis-5211 263 3 21 21 NUM fcis-5211 263 4 , , PUNCT fcis-5211 263 5 2021 2021 NUM fcis-5211 263 6 . . PUNCT fcis-5211 264 1 [ [ X fcis-5211 264 2 10 10 NUM fcis-5211 264 3 ] ] X fcis-5211 264 4 b. b. PROPN fcis-5211 264 5 sklar sklar PROPN fcis-5211 264 6 , , PUNCT fcis-5211 264 7 " " PUNCT fcis-5211 264 8 rayleigh rayleigh ADJ fcis-5211 264 9 fading fade VERB fcis-5211 264 10 channels channel NOUN fcis-5211 264 11 in in ADP fcis-5211 264 12 mobile mobile ADJ fcis-5211 264 13 digital digital ADJ fcis-5211 264 14 communication communication NOUN fcis-5211 264 15 systems system NOUN fcis-5211 264 16 .i .i PROPN fcis-5211 264 17 . . PUNCT fcis-5211 265 1 characterization characterization NOUN fcis-5211 265 2 , , PUNCT fcis-5211 265 3 " " PUNCT fcis-5211 265 4 ieee ieee NOUN fcis-5211 265 5 communications communication NOUN fcis-5211 265 6 magazine magazine NOUN fcis-5211 265 7 , , PUNCT fcis-5211 265 8 vol vol NOUN fcis-5211 265 9 . . PROPN fcis-5211 265 10 35 35 NUM fcis-5211 265 11 , , PUNCT fcis-5211 265 12 no no INTJ fcis-5211 265 13 . . NOUN fcis-5211 265 14 7 7 NUM fcis-5211 265 15 , , PUNCT fcis-5211 265 16 pp pp ADJ fcis-5211 265 17 . . PUNCT fcis-5211 266 1 90 90 NUM fcis-5211 266 2 - - SYM fcis-5211 266 3 100 100 NUM fcis-5211 266 4 , , PUNCT fcis-5211 266 5 1997 1997 NUM fcis-5211 266 6 . . PUNCT fcis-5211 267 1 [ [ X fcis-5211 267 2 11 11 NUM fcis-5211 267 3 ] ] PUNCT fcis-5211 267 4 j. j. PROPN fcis-5211 267 5 wildman wildman PROPN fcis-5211 267 6 , , PUNCT fcis-5211 267 7 p. p. PROPN fcis-5211 267 8 h. h. PROPN fcis-5211 267 9 j. j. PROPN fcis-5211 267 10 nardelli nardelli PROPN fcis-5211 267 11 , , PUNCT fcis-5211 267 12 m. m. NOUN fcis-5211 267 13 latva latva PROPN fcis-5211 267 14 - - PUNCT fcis-5211 267 15 aho aho NOUN fcis-5211 267 16 , , PUNCT fcis-5211 267 17 and and CCONJ fcis-5211 267 18 s. s. PROPN fcis-5211 267 19 weber weber PROPN fcis-5211 267 20 , , PUNCT fcis-5211 267 21 " " PUNCT fcis-5211 267 22 on on ADP fcis-5211 267 23 the the DET fcis-5211 267 24 joint joint ADJ fcis-5211 267 25 impact impact NOUN fcis-5211 267 26 of of ADP fcis-5211 267 27 beamwidth beamwidth NOUN fcis-5211 267 28 and and CCONJ fcis-5211 267 29 orientation orientation NOUN fcis-5211 267 30 error error NOUN fcis-5211 267 31 on on ADP fcis-5211 267 32 throughput throughput NOUN fcis-5211 267 33 in in ADP fcis-5211 267 34 directional directional ADJ fcis-5211 267 35 wireless wireless ADJ fcis-5211 267 36 poisson poisson NOUN fcis-5211 267 37 networks network NOUN fcis-5211 267 38 , , PUNCT fcis-5211 267 39 " " PUNCT fcis-5211 267 40 ieee ieee NOUN fcis-5211 267 41 transactions transaction NOUN fcis-5211 267 42 on on ADP fcis-5211 267 43 wireless wireless ADJ fcis-5211 267 44 communications communication NOUN fcis-5211 267 45 , , PUNCT fcis-5211 267 46 vol vol NOUN fcis-5211 267 47 . . PROPN fcis-5211 267 48 13 13 NUM fcis-5211 267 49 , , PUNCT fcis-5211 267 50 no no INTJ fcis-5211 267 51 . . NOUN fcis-5211 267 52 12 12 NUM fcis-5211 267 53 , , PUNCT fcis-5211 267 54 pp pp ADJ fcis-5211 267 55 . . PUNCT fcis-5211 268 1 7072 7072 NUM fcis-5211 268 2 - - SYM fcis-5211 268 3 7085 7085 NUM fcis-5211 268 4 , , PUNCT fcis-5211 268 5 2014 2014 NUM fcis-5211 268 6 . . PUNCT fcis-5211 269 1 [ [ X fcis-5211 269 2 12 12 NUM fcis-5211 269 3 ] ] PUNCT fcis-5211 269 4 z. z. PROPN fcis-5211 269 5 li li PROPN fcis-5211 269 6 , , PUNCT fcis-5211 269 7 l. l. PROPN fcis-5211 269 8 xiang xiang PROPN fcis-5211 269 9 , , PUNCT fcis-5211 269 10 x. x. PROPN fcis-5211 269 11 ge ge PROPN fcis-5211 269 12 , , PUNCT fcis-5211 269 13 g. g. PROPN fcis-5211 269 14 mao mao PROPN fcis-5211 269 15 , , PUNCT fcis-5211 269 16 and and CCONJ fcis-5211 269 17 h. h. PROPN fcis-5211 269 18 c. c. PROPN fcis-5211 269 19 chao chao PROPN fcis-5211 269 20 , , PUNCT fcis-5211 269 21 " " PUNCT fcis-5211 269 22 latency latency NOUN fcis-5211 269 23 and and CCONJ fcis-5211 269 24 reliability reliability NOUN fcis-5211 269 25 of of ADP fcis-5211 269 26 mmwave mmwave PROPN fcis-5211 269 27 multi multi ADJ fcis-5211 269 28 - - ADJ fcis-5211 269 29 hop hop ADJ fcis-5211 269 30 v2v v2v NOUN fcis-5211 269 31 communications communication NOUN fcis-5211 269 32 under under ADP fcis-5211 269 33 relay relay NOUN fcis-5211 269 34 selections selection NOUN fcis-5211 269 35 , , PUNCT fcis-5211 269 36 " " PUNCT fcis-5211 269 37 ieee ieee NOUN fcis-5211 269 38 transactions transaction NOUN fcis-5211 269 39 on on ADP fcis-5211 269 40 vehicular vehicular ADJ fcis-5211 269 41 technology technology NOUN fcis-5211 269 42 , , PUNCT fcis-5211 269 43 vol vol NOUN fcis-5211 269 44 . . PROPN fcis-5211 269 45 69 69 NUM fcis-5211 269 46 , , PUNCT fcis-5211 269 47 no no INTJ fcis-5211 269 48 . . NOUN fcis-5211 269 49 9 9 NUM fcis-5211 269 50 , , PUNCT fcis-5211 269 51 pp pp ADJ fcis-5211 269 52 . . PUNCT fcis-5211 270 1 9807 9807 NUM fcis-5211 270 2 - - SYM fcis-5211 270 3 9821 9821 NUM fcis-5211 270 4 , , PUNCT fcis-5211 270 5 2020 2020 NUM fcis-5211 270 6 . . PUNCT fcis-5211 271 1 [ [ X fcis-5211 271 2 13 13 NUM fcis-5211 271 3 ] ] X fcis-5211 271 4 y. y. NOUN fcis-5211 271 5 oike oike PROPN fcis-5211 271 6 , , PUNCT fcis-5211 271 7 m. m. NOUN fcis-5211 271 8 ikeda ikeda PROPN fcis-5211 271 9 , , PUNCT fcis-5211 271 10 and and CCONJ fcis-5211 271 11 k. k. PROPN fcis-5211 271 12 asada asada PROPN fcis-5211 271 13 , , PUNCT fcis-5211 271 14 " " PUNCT fcis-5211 271 15 a a DET fcis-5211 271 16 high high ADJ fcis-5211 271 17 - - PUNCT fcis-5211 271 18 speed speed NOUN fcis-5211 271 19 and and CCONJ fcis-5211 271 20 lowvoltage lowvoltage NOUN fcis-5211 271 21 associative associative NOUN fcis-5211 271 22 co co NOUN fcis-5211 271 23 - - NOUN fcis-5211 271 24 processor processor NOUN fcis-5211 271 25 with with ADP fcis-5211 271 26 exact exact ADJ fcis-5211 271 27 hamming hamming NOUN fcis-5211 271 28 / / SYM fcis-5211 271 29 manhattan manhattan NOUN fcis-5211 271 30 - - PUNCT fcis-5211 271 31 distance distance NOUN fcis-5211 271 32 estimation estimation NOUN fcis-5211 271 33 using use VERB fcis-5211 271 34 wordparallel wordparallel ADJ fcis-5211 271 35 and and CCONJ fcis-5211 271 36 hierarchical hierarchical ADJ fcis-5211 271 37 search search NOUN fcis-5211 271 38 architecture architecture NOUN fcis-5211 271 39 , , PUNCT fcis-5211 271 40 " " PUNCT fcis-5211 271 41 ieee ieee NOUN fcis-5211 271 42 journal journal NOUN fcis-5211 271 43 of of ADP fcis-5211 271 44 solid solid ADJ fcis-5211 271 45 - - PUNCT fcis-5211 271 46 state state NOUN fcis-5211 271 47 circuits circuit NOUN fcis-5211 271 48 , , PUNCT fcis-5211 271 49 vol vol NOUN fcis-5211 271 50 . . PROPN fcis-5211 271 51 39 39 NUM fcis-5211 271 52 , , PUNCT fcis-5211 271 53 no no INTJ fcis-5211 271 54 . . NOUN fcis-5211 271 55 8 8 NUM fcis-5211 271 56 , , PUNCT fcis-5211 271 57 pp pp ADJ fcis-5211 271 58 . . PUNCT fcis-5211 271 59 13831387 13831387 NUM fcis-5211 271 60 , , PUNCT fcis-5211 271 61 2004 2004 NUM fcis-5211 271 62 . . PUNCT fcis-5211 272 1 [ [ X fcis-5211 272 2 14 14 NUM fcis-5211 272 3 ] ] X fcis-5211 272 4 l. l. PROPN fcis-5211 272 5 qing qing PROPN fcis-5211 272 6 , , PUNCT fcis-5211 272 7 " " PUNCT fcis-5211 272 8 a a DET fcis-5211 272 9 5 5 NUM fcis-5211 272 10 g g NOUN fcis-5211 272 11 paas paas NOUN fcis-5211 272 12 collaborative collaborative ADJ fcis-5211 272 13 management management PROPN fcis-5211 272 14 and and CCONJ fcis-5211 272 15 control control NOUN fcis-5211 272 16 platform platform NOUN fcis-5211 272 17 technology technology NOUN fcis-5211 272 18 based base VERB fcis-5211 272 19 on on ADP fcis-5211 272 20 cloud cloud NOUN fcis-5211 272 21 edge edge NOUN fcis-5211 272 22 collaboration collaboration NOUN fcis-5211 272 23 based base VERB fcis-5211 272 24 on on ADP fcis-5211 272 25 particle particle NOUN fcis-5211 272 26 swarm swarm NOUN fcis-5211 272 27 optimization optimization NOUN fcis-5211 272 28 algorithm algorithm NOUN fcis-5211 272 29 . . PUNCT fcis-5211 272 30 " " PUNCT fcis-5211 273 1 pp pp ADV fcis-5211 273 2 . . PUNCT fcis-5211 274 1 144147 144147 NUM fcis-5211 274 2 . . PUNCT fcis-5211 275 1 [ [ X fcis-5211 275 2 15 15 NUM fcis-5211 275 3 ] ] X fcis-5211 275 4 a. a. NOUN fcis-5211 275 5 sergeev sergeev PROPN fcis-5211 275 6 , , PUNCT fcis-5211 275 7 e. e. PROPN fcis-5211 275 8 rezedinova rezedinova PROPN fcis-5211 275 9 , , PUNCT fcis-5211 275 10 and and CCONJ fcis-5211 275 11 a. a. PROPN fcis-5211 275 12 khakhina khakhina PROPN fcis-5211 275 13 , , PUNCT fcis-5211 275 14 " " PUNCT fcis-5211 275 15 docker docker NOUN fcis-5211 275 16 container container NOUN fcis-5211 275 17 performance performance NOUN fcis-5211 275 18 comparison comparison NOUN fcis-5211 275 19 on on ADP fcis-5211 275 20 windows window NOUN fcis-5211 275 21 and and CCONJ fcis-5211 275 22 linux linux PROPN fcis-5211 275 23 operating operating NOUN fcis-5211 275 24 systems system NOUN fcis-5211 275 25 . . PUNCT fcis-5211 275 26 " " PUNCT fcis-5211 276 1 pp pp ADV fcis-5211 276 2 . . PUNCT fcis-5211 277 1 1 1 NUM fcis-5211 277 2 - - SYM fcis-5211 277 3 4 4 NUM fcis-5211 277 4 . . PUNCT fcis-5211 278 1 [ [ X fcis-5211 278 2 16 16 NUM fcis-5211 278 3 ] ] PUNCT fcis-5211 278 4 r. r. PROPN fcis-5211 278 5 bellman bellman PROPN fcis-5211 278 6 , , PUNCT fcis-5211 278 7 " " PUNCT fcis-5211 278 8 a a DET fcis-5211 278 9 markovian markovian ADJ fcis-5211 278 10 decision decision NOUN fcis-5211 278 11 process process NOUN fcis-5211 278 12 , , PUNCT fcis-5211 278 13 " " PUNCT fcis-5211 278 14 journal journal NOUN fcis-5211 278 15 of of ADP fcis-5211 278 16 mathematics mathematic NOUN fcis-5211 278 17 and and CCONJ fcis-5211 278 18 mechanics mechanic NOUN fcis-5211 278 19 , , PUNCT fcis-5211 278 20 vol vol NOUN fcis-5211 278 21 . . PROPN fcis-5211 278 22 6 6 NUM fcis-5211 278 23 , , PUNCT fcis-5211 278 24 no no INTJ fcis-5211 278 25 . . NOUN fcis-5211 278 26 5 5 NUM fcis-5211 278 27 , , PUNCT fcis-5211 278 28 pp pp ADJ fcis-5211 278 29 . . PUNCT fcis-5211 279 1 679 679 NUM fcis-5211 279 2 - - SYM fcis-5211 279 3 684 684 NUM fcis-5211 279 4 , , PUNCT fcis-5211 279 5 1957 1957 NUM fcis-5211 279 6 . . PUNCT fcis-5211 280 1 55 55 NUM fcis-5211 281 1 [ [ X fcis-5211 281 2 17 17 NUM fcis-5211 281 3 ] ] PUNCT fcis-5211 281 4 t. t. PROPN fcis-5211 281 5 haarnoja haarnoja PROPN fcis-5211 281 6 , , PUNCT fcis-5211 281 7 a. a. NOUN fcis-5211 281 8 zhou zhou PROPN fcis-5211 281 9 , , PUNCT fcis-5211 281 10 p. p. NOUN fcis-5211 281 11 abbeel abbeel NOUN fcis-5211 281 12 , , PUNCT fcis-5211 281 13 and and CCONJ fcis-5211 281 14 s. s. PROPN fcis-5211 281 15 levine levine PROPN fcis-5211 281 16 , , PUNCT fcis-5211 281 17 " " PUNCT fcis-5211 281 18 soft soft ADJ fcis-5211 281 19 actorcritic actorcritic ADJ fcis-5211 281 20 : : PUNCT fcis-5211 281 21 off off ADP fcis-5211 281 22 - - PUNCT fcis-5211 281 23 policy policy NOUN fcis-5211 281 24 maximum maximum ADJ fcis-5211 281 25 entropy entropy NOUN fcis-5211 281 26 deep deep ADJ fcis-5211 281 27 reinforcement reinforcement NOUN fcis-5211 281 28 learning learning NOUN fcis-5211 281 29 with with ADP fcis-5211 281 30 a a DET fcis-5211 281 31 stochastic stochastic ADJ fcis-5211 281 32 actor actor NOUN fcis-5211 281 33 , , PUNCT fcis-5211 281 34 " " PUNCT fcis-5211 281 35 in in ADP fcis-5211 281 36 proceedings proceeding NOUN fcis-5211 281 37 of of ADP fcis-5211 281 38 the the DET fcis-5211 281 39 35th 35th ADJ fcis-5211 281 40 international international ADJ fcis-5211 281 41 conference conference NOUN fcis-5211 281 42 on on ADP fcis-5211 281 43 machine machine NOUN fcis-5211 281 44 learning learning NOUN fcis-5211 281 45 , , PUNCT fcis-5211 281 46 proceedings proceeding NOUN fcis-5211 281 47 of of ADP fcis-5211 281 48 machine machine NOUN fcis-5211 281 49 learning learn VERB fcis-5211 281 50 research research NOUN fcis-5211 281 51 , , PUNCT fcis-5211 281 52 2018 2018 NUM fcis-5211 281 53 , , PUNCT fcis-5211 281 54 pp pp ADJ fcis-5211 281 55 . . PUNCT fcis-5211 282 1 1861 1861 NUM fcis-5211 282 2 - - PUNCT fcis-5211 282 3 -1870 -1870 NOUN fcis-5211 282 4 . . PUNCT fcis-5211 283 1 [ [ X fcis-5211 283 2 18 18 NUM fcis-5211 283 3 ] ] X fcis-5211 283 4 c. c. PROPN fcis-5211 283 5 banerjee banerjee PROPN fcis-5211 283 6 , , PUNCT fcis-5211 283 7 z. z. PROPN fcis-5211 283 8 chen chen PROPN fcis-5211 283 9 , , PUNCT fcis-5211 283 10 and and CCONJ fcis-5211 283 11 n. n. PROPN fcis-5211 283 12 noman noman PROPN fcis-5211 283 13 , , PUNCT fcis-5211 283 14 " " PUNCT fcis-5211 283 15 improved improve VERB fcis-5211 283 16 soft soft ADJ fcis-5211 283 17 actorcritic actorcritic ADJ fcis-5211 283 18 : : PUNCT fcis-5211 283 19 mixing mix VERB fcis-5211 283 20 prioritized prioritize VERB fcis-5211 283 21 off off ADP fcis-5211 283 22 - - PUNCT fcis-5211 283 23 policy policy NOUN fcis-5211 283 24 samples sample NOUN fcis-5211 283 25 with with ADP fcis-5211 283 26 on on ADP fcis-5211 283 27 - - PUNCT fcis-5211 283 28 policy policy NOUN fcis-5211 283 29 experiences experience NOUN fcis-5211 283 30 , , PUNCT fcis-5211 283 31 " " PUNCT fcis-5211 283 32 ieee ieee NOUN fcis-5211 283 33 transactions transaction NOUN fcis-5211 283 34 on on ADP fcis-5211 283 35 neural neural ADJ fcis-5211 283 36 networks network NOUN fcis-5211 283 37 and and CCONJ fcis-5211 283 38 learning learning NOUN fcis-5211 283 39 systems system NOUN fcis-5211 283 40 , , PUNCT fcis-5211 283 41 2022 2022 NUM fcis-5211 283 42 . . PUNCT fcis-5211 284 1 [ [ X fcis-5211 284 2 19 19 NUM fcis-5211 284 3 ] ] X fcis-5211 284 4 r. r. PROPN fcis-5211 284 5 s. s. PROPN fcis-5211 284 6 sutton sutton PROPN fcis-5211 284 7 , , PUNCT fcis-5211 284 8 and and CCONJ fcis-5211 284 9 a. a. PROPN fcis-5211 284 10 g. g. PROPN fcis-5211 284 11 barto barto PROPN fcis-5211 284 12 , , PUNCT fcis-5211 284 13 reinforcement reinforcement NOUN fcis-5211 284 14 learning learning NOUN fcis-5211 284 15 : : PUNCT fcis-5211 284 16 an an DET fcis-5211 284 17 introduction introduction NOUN fcis-5211 284 18 : : PUNCT fcis-5211 284 19 mit mit PROPN fcis-5211 284 20 press press NOUN fcis-5211 284 21 , , PUNCT fcis-5211 284 22 2018 2018 NUM fcis-5211 284 23 . . PUNCT fcis-5211 285 1 [ [ X fcis-5211 285 2 20 20 NUM fcis-5211 285 3 ] ] PUNCT fcis-5211 285 4 h. h. PROPN fcis-5211 285 5 van van PROPN fcis-5211 285 6 hasselt hasselt PROPN fcis-5211 285 7 , , PUNCT fcis-5211 285 8 a. a. PROPN fcis-5211 285 9 guez guez PROPN fcis-5211 285 10 , , PUNCT fcis-5211 285 11 and and CCONJ fcis-5211 285 12 d. d. PROPN fcis-5211 285 13 silver silver NOUN fcis-5211 285 14 , , PUNCT fcis-5211 285 15 " " PUNCT fcis-5211 285 16 deep deep ADJ fcis-5211 285 17 reinforcement reinforcement NOUN fcis-5211 285 18 learning learning NOUN fcis-5211 285 19 with with ADP fcis-5211 285 20 double double ADJ fcis-5211 285 21 q q NOUN fcis-5211 285 22 - - PUNCT fcis-5211 285 23 learning learning NOUN fcis-5211 285 24 . . PUNCT fcis-5211 285 25 " " PUNCT fcis-5211 286 1 [ [ X fcis-5211 286 2 21 21 NUM fcis-5211 286 3 ] ] X fcis-5211 286 4 s. s. PROPN fcis-5211 286 5 kullback kullback PROPN fcis-5211 286 6 , , PUNCT fcis-5211 286 7 and and CCONJ fcis-5211 286 8 r. r. PROPN fcis-5211 286 9 a. a. PROPN fcis-5211 286 10 leibler leibler PROPN fcis-5211 286 11 , , PUNCT fcis-5211 286 12 " " PUNCT fcis-5211 286 13 on on ADP fcis-5211 286 14 information information NOUN fcis-5211 286 15 and and CCONJ fcis-5211 286 16 sufficiency sufficiency NOUN fcis-5211 286 17 , , PUNCT fcis-5211 286 18 " " PUNCT fcis-5211 286 19 the the DET fcis-5211 286 20 annals annal NOUN fcis-5211 286 21 of of ADP fcis-5211 286 22 mathematical mathematical ADJ fcis-5211 286 23 statistics statistic NOUN fcis-5211 286 24 , , PUNCT fcis-5211 286 25 vol vol NOUN fcis-5211 286 26 . . PROPN fcis-5211 286 27 22 22 NUM fcis-5211 286 28 , , PUNCT fcis-5211 286 29 no no INTJ fcis-5211 286 30 . . NOUN fcis-5211 286 31 1 1 NUM fcis-5211 286 32 , , PUNCT fcis-5211 286 33 pp pp ADJ fcis-5211 286 34 . . PUNCT fcis-5211 287 1 79 79 NUM fcis-5211 287 2 - - SYM fcis-5211 287 3 86 86 NUM fcis-5211 287 4 , , PUNCT fcis-5211 287 5 1951 1951 NUM fcis-5211 287 6 . . PUNCT