id sid tid token lemma pos spir-8434 1 1 selected select VERB spir-8434 1 2 papers paper NOUN spir-8434 1 3 of of ADP spir-8434 1 4 internet internet NOUN spir-8434 1 5 research research NOUN spir-8434 1 6 16 16 NUM spir-8434 1 7 : : PUNCT spir-8434 1 8 the the DET spir-8434 1 9 16th 16th ADJ spir-8434 1 10 annual annual ADJ spir-8434 1 11 meeting meeting NOUN spir-8434 1 12 of of ADP spir-8434 1 13 the the DET spir-8434 1 14 association association NOUN spir-8434 1 15 of of ADP spir-8434 1 16 internet internet NOUN spir-8434 1 17 researchers researcher NOUN spir-8434 1 18 phoenix phoenix PROPN spir-8434 1 19 , , PUNCT spir-8434 1 20 az az PROPN spir-8434 1 21 , , PUNCT spir-8434 1 22 usa usa PROPN spir-8434 1 23 / / SYM spir-8434 1 24 21 21 NUM spir-8434 1 25 - - SYM spir-8434 1 26 24 24 NUM spir-8434 1 27 october october PROPN spir-8434 1 28 2015 2015 NUM spir-8434 1 29 ! ! PUNCT spir-8434 2 1 architecture architecture NOUN spir-8434 2 2 for for ADP spir-8434 2 3 understanding understand VERB spir-8434 2 4 the the DET spir-8434 2 5 automated automated ADJ spir-8434 2 6 imaginary imaginary ADJ spir-8434 2 7 : : PUNCT spir-8434 2 8 a a DET spir-8434 2 9 working work VERB spir-8434 2 10 qualitative qualitative ADJ spir-8434 2 11 methodology methodology NOUN spir-8434 2 12 for for ADP spir-8434 2 13 research research NOUN spir-8434 2 14 on on ADP spir-8434 2 15 political political ADJ spir-8434 2 16 bots bot NOUN spir-8434 2 17 ) ) PUNCT spir-8434 2 18 norah&abokhodair norah&abokhodair PROPN spir-8434 2 19 & & CCONJ spir-8434 2 20 & & CCONJ spir-8434 2 21 university&of&washington,&information&school university&of&washington,&information&school PROPN spir-8434 2 22 & & CCONJ spir-8434 2 23 & & CCONJ spir-8434 2 24 & & CCONJ spir-8434 2 25 samuel&woolley samuel&woolley PROPN spir-8434 2 26 & & CCONJ spir-8434 2 27 university&of&washington,&communication&department university&of&washington,&communication&department PROPN spir-8434 2 28 & & CCONJ spir-8434 2 29 & & CCONJ spir-8434 2 30 philip&howard philip&howard PROPN spir-8434 2 31 & & CCONJ spir-8434 2 32 university&of&washington,&communication&department university&of&washington,&communication&department PROPN spir-8434 2 33 & & CCONJ spir-8434 2 34 & & CCONJ spir-8434 2 35 david&mcdonald david&mcdonald PROPN spir-8434 2 36 & & CCONJ spir-8434 2 37 university&of&washington,&human¢ered&design&and&engineering&department university&of&washington,&human¢ered&design&and&engineering&department PROPN spir-8434 2 38 & & CCONJ spir-8434 2 39 introduction introduction NOUN spir-8434 2 40 ) ) PUNCT spir-8434 2 41 social&media&–&especially&social&networking&sites&–&have&substantially&transformed&the social&media&–&especially&social&networking&sites&–&have&substantially&transformed&the PROPN spir-8434 2 42 & & CCONJ spir-8434 2 43 ways&in&which&people&discuss¤t&affairs&and&obtain&political&news&and&information ways&in&which&people&discuss¤t&affairs&and&obtain&political&news&and&information PROPN spir-8434 2 44 . . PROPN spir-8434 2 45 & & CCONJ spir-8434 2 46 because&of&increased&affordances&for&building&and&maintaining&social&connections because&of&increased&affordances&for&building&and&maintaining&social&connection NOUN spir-8434 2 47 , , PUNCT spir-8434 2 48 & & CCONJ spir-8434 2 49 young&people&are&better&able&to&cultivate&a&political&identity&and&engage&civically&in&both young&people&are&better&able&to&cultivate&a&political&identity&and&engage&civically&in&both PROPN spir-8434 2 50 & & CCONJ spir-8434 2 51 authoritarian&and&democratic®imes&[1].&activist&causes&and&democratic&movements authoritarian&and&democratic®imes&[1].&activist&causes&and&democratic&movements PROPN spir-8434 2 52 & & CCONJ spir-8434 2 53 have&been&born,&organized&and&disseminated&on&sites&including&facebook,&twitter have&been&born,&organized&and&disseminated&on&sites&including&facebook,&twitter PROPN spir-8434 2 54 , , PUNCT spir-8434 2 55 & & CCONJ spir-8434 2 56 weibo,&and&youtube&[2].&like&any&technology,&though,&the&interfaces,&applications,&and weibo,&and&youtube&[2].&like&any&technology,&though,&the&interfaces,&applications,&and NOUN spir-8434 2 57 & & CCONJ spir-8434 2 58 modes&of&communication&on&social&networking&sites&are&in&constant&negotiation modes&of&communication&on&social&networking&sites&are&in&constant&negotiation PROPN spir-8434 2 59 , , PUNCT spir-8434 2 60 & & CCONJ spir-8434 2 61 transformation,&and&repurposing&–&and&by&a&wide&variety&of&social&and&political&actors transformation,&and&repurposing&–&and&by&a&wide&variety&of&social&and&political&actors PROPN spir-8434 2 62 . . PROPN spir-8434 2 63 & & CCONJ spir-8434 2 64 on)social)bots on)social)bots PROPN spir-8434 2 65 ) ) PUNCT spir-8434 2 66 bots,&strings&of&automated&code,&are&a&complex&and&compelling&case&of&this,&as bots,&strings&of&automated&code,&are&a&complex&and&compelling&case&of&this,&as NOUN spir-8434 2 67 & & CCONJ spir-8434 2 68 automated&software&agents&are&increasingly&being&developed&and&deployed&on&social automated&software&agents&are&increasingly&being&developed&and&deployed&on&social PROPN spir-8434 2 69 & & CCONJ spir-8434 2 70 networking&sites&for&a&diverse&range&of&purposes.&security&experts&have&found&that&bots networking&sites&for&a&diverse&range&of&purposes.&security&experts&have&found&that&bots PROPN spir-8434 2 71 & & CCONJ spir-8434 2 72 generate&over&10&percent&of&content&on&social&media&websites&and&62&percent&of&all&web generate&over&10&percent&of&content&on&social&media&websites&and&62&percent&of&all&web PROPN spir-8434 2 73 & & CCONJ spir-8434 2 74 traffic&[3].&more&recently,&we&have&started&seeing&social&bots&emerging&in&contemporary traffic&[3].&more&recently,&we&have&started&seeing&social&bots&emerging&in&contemporary PROPN spir-8434 2 75 & & CCONJ spir-8434 2 76 suggested suggest VERB spir-8434 2 77 citation citation NOUN spir-8434 2 78 ( ( PUNCT spir-8434 2 79 apa apa PROPN spir-8434 2 80 ): ): PUNCT spir-8434 2 81 abokhodair abokhodair PROPN spir-8434 2 82 , , PUNCT spir-8434 2 83 n. n. PROPN spir-8434 2 84 , , PUNCT spir-8434 2 85 woolley woolley PROPN spir-8434 2 86 , , PUNCT spir-8434 2 87 s. s. PROPN spir-8434 2 88 , , PUNCT spir-8434 2 89 howard howard PROPN spir-8434 2 90 , , PUNCT spir-8434 2 91 p. p. PROPN spir-8434 2 92 , , PUNCT spir-8434 2 93 & & CCONJ spir-8434 2 94 mcdonald mcdonald PROPN spir-8434 2 95 , , PUNCT spir-8434 2 96 d d PROPN spir-8434 2 97 .. .. PUNCT spir-8434 2 98 ( ( PUNCT spir-8434 2 99 2015 2015 NUM spir-8434 2 100 , , PUNCT spir-8434 2 101 october october PROPN spir-8434 2 102 21 21 NUM spir-8434 2 103 - - SYM spir-8434 2 104 24 24 NUM spir-8434 2 105 ) ) PUNCT spir-8434 2 106 . . PUNCT spir-8434 3 1 architecture architecture NOUN spir-8434 3 2 for for ADP spir-8434 3 3 understanding understand VERB spir-8434 3 4 the the DET spir-8434 3 5 automated automated ADJ spir-8434 3 6 imaginary imaginary ADJ spir-8434 3 7 : : PUNCT spir-8434 3 8 a a DET spir-8434 3 9 working work VERB spir-8434 3 10 qualitative qualitative ADJ spir-8434 3 11 methodology methodology NOUN spir-8434 3 12 for for ADP spir-8434 3 13 research research NOUN spir-8434 3 14 on on ADP spir-8434 3 15 political political ADJ spir-8434 3 16 bots bot NOUN spir-8434 3 17 . . PUNCT spir-8434 4 1 paper paper NOUN spir-8434 4 2 presented present VERB spir-8434 4 3 at at ADP spir-8434 4 4 internet internet NOUN spir-8434 4 5 research research NOUN spir-8434 4 6 16 16 NUM spir-8434 4 7 : : PUNCT spir-8434 4 8 the the DET spir-8434 4 9 16th 16th ADJ spir-8434 4 10 annual annual ADJ spir-8434 4 11 meeting meeting NOUN spir-8434 4 12 of of ADP spir-8434 4 13 the the DET spir-8434 4 14 association association NOUN spir-8434 4 15 of of ADP spir-8434 4 16 internet internet NOUN spir-8434 4 17 researchers researcher NOUN spir-8434 4 18 . . PUNCT spir-8434 5 1 phoenix phoenix PROPN spir-8434 5 2 , , PUNCT spir-8434 5 3 az az PROPN spir-8434 5 4 , , PUNCT spir-8434 5 5 usa usa PROPN spir-8434 5 6 : : PUNCT spir-8434 5 7 aoir aoir NOUN spir-8434 5 8 . . PUNCT spir-8434 5 9 retrieved retrieve VERB spir-8434 5 10 from from ADP spir-8434 5 11 http://spir.aoir.org http://spir.aoir.org PROPN spir-8434 5 12 . . PUNCT spir-8434 5 13 ! ! PUNCT spir-8434 6 1 2 2 X spir-8434 6 2 ! ! X spir-8434 6 3 social&networking&sites&(sns)&such&as&twitter,&facebook,&and&reddit.&in&2012,&facebook social&networking&sites&(sns)&such&as&twitter,&facebook,&and&reddit.&in&2012,&facebook NOUN spir-8434 6 4 & & CCONJ spir-8434 6 5 estimated&that&5y6%&of&all&facebook&accounts&were&fake.&this&is&a&high&percentage&for estimated&that&5y6%&of&all&facebook&accounts&were&fake.&this&is&a&high&percentage&for PROPN spir-8434 6 6 & & CCONJ spir-8434 6 7 facebook,&as&it&means&that&approximately&50&million&user&accounts&are&manufactured&or facebook,&as&it&means&that&approximately&50&million&user&accounts&are&manufactured&or PROPN spir-8434 6 8 & & CCONJ spir-8434 6 9 not&human&[4].&a&recent&study&of&twitter&revealed&that&bots&make&up&32%&of&twitter not&human&[4].&a&recent&study&of&twitter&revealed&that&bots&make&up&32%&of&twitter PROPN spir-8434 6 10 & & CCONJ spir-8434 6 11 posts&generated&by&the&most&active&accounts&[5].&traditionally&bots&have&been posts&generated&by&the&most&active&accounts&[5].&traditionally&bots&have&been PROPN spir-8434 6 12 & & CCONJ spir-8434 6 13 developed&and&deployed&to&automate&benign&tasks&(e.g developed&and&deployed&to&automate&benign&tasks&(e.g PROPN spir-8434 6 14 . . PUNCT spir-8434 6 15 ,&fix&syntax,&fetch&news ,&fix&syntax,&fetch&news PROPN spir-8434 6 16 & & CCONJ spir-8434 6 17 headlines)&and&malicious&tasks&(e.g headlines)&and&malicious&tasks&(e.g PROPN spir-8434 6 18 . . PROPN spir-8434 6 19 ,&spambots,&bimbots,&and&denial&of&service&(dos ,&spambots,&bimbots,&and&denial&of&service&(dos PUNCT spir-8434 6 20 ) ) PUNCT spir-8434 6 21 & & CCONJ spir-8434 6 22 bots)&on&sns&platforms.&these&automated&functions&have&been&a&part&of&the&web&almost bots)&on&sns&platforms.&these&automated&functions&have&been&a&part&of&the&web&almost PROPN spir-8434 6 23 & & CCONJ spir-8434 6 24 since&its&inception.&on&the&other&hand,&there&has&been&a&recent&emergence&of&bots&with since&its&inception.&on&the&other&hand,&there&has&been&a&recent&emergence&of&bots&with PROPN spir-8434 6 25 & & CCONJ spir-8434 6 26 a&political&agenda.&these&bots&intervene&in&discourse&about&ongoing&political&events a&political&agenda.&these&bots&intervene&in&discourse&about&ongoing&political&event NOUN spir-8434 6 27 . . PUNCT spir-8434 6 28 & & CCONJ spir-8434 6 29 the&results&have&been&interesting&to&observe.&social&bots,&software&programs&designed the&results&have&been&interesting&to&observe.&social&bots,&software&programs&designed PROPN spir-8434 6 30 & & CCONJ spir-8434 6 31 to&appear&as&human&users&on&social&networking&sites&like&twitter,&instagram,&and to&appear&as&human&users&on&social&networking&sites&like&twitter,&instagram,&and PROPN spir-8434 6 32 & & CCONJ spir-8434 6 33 facebook,&are&now¬&only&deployed&to&peddle&questionable&pharmaceuticals&or&trick facebook,&are&now¬&only&deployed&to&peddle&questionable&pharmaceuticals&or&trick PROPN spir-8434 6 34 & & CCONJ spir-8434 6 35 people&into&sharing&their&bank&accounts.&another,&more&propagandistic,&side&of&this people&into&sharing&their&bank&accounts.&another,&more&propagandistic,&side&of&this PROPN spir-8434 6 36 & & CCONJ spir-8434 6 37 automated&technology&exists automated&technology&exists PROPN spir-8434 6 38 . . PUNCT spir-8434 7 1 & & CCONJ spir-8434 7 2 & & CCONJ spir-8434 7 3 computational)propaganda computational)propaganda PROPN spir-8434 7 4 ) ) PUNCT spir-8434 7 5 regimes&of&all&types&are&using&bots&across&multiple&sns&in&efforts&to&manipulate&public regimes&of&all&types&are&using&bots&across&multiple&sns&in&efforts&to&manipulate&public PROPN spir-8434 7 6 & & CCONJ spir-8434 7 7 opinion,&a&phenomenon&we&identify&and&theorize&as&‘computational&propaganda opinion,&a&phenomenon&we&identify&and&theorize&as&‘computational&propaganda NOUN spir-8434 7 8 . . PUNCT spir-8434 8 1 ’&while ’&while PROPN spir-8434 8 2 & & CCONJ spir-8434 8 3 there&are&similarities&that&unite&this&broader&use&of&bots&in&the&public&political&sphere there&are&similarities&that&unite&this&broader&use&of&bots&in&the&public&political&sphere PROPN spir-8434 8 4 , , PUNCT spir-8434 8 5 & & CCONJ spir-8434 8 6 each&case&of&political&bot&usage&is&also&driven&by&the&particular&set&of&circumstances each&case&of&political&bot&usage&is&also&driven&by&the&particular&set&of&circumstances PROPN spir-8434 8 7 & & CCONJ spir-8434 8 8 surrounding&specific&political&events.&during&the&onygoing&syrian&civil&war,&for&instance surrounding&specific&political&events.&during&the&onygoing&syrian&civil&war,&for&instance PROPN spir-8434 8 9 , , PUNCT spir-8434 8 10 & & CCONJ spir-8434 8 11 bot&accounts&have&been&spread&on&twitter&and&facebook&by&a&group&of&programmers bot&accounts&have&been&spread&on&twitter&and&facebook&by&a&group&of&programmer NOUN spir-8434 8 12 & & CCONJ spir-8434 8 13 employed&by&the&syrian&intelligence&[6].&based&on&a&recent&study&[7]&which&followed&the employed&by&the&syrian&intelligence&[6].&based&on&a&recent&study&[7]&which&followed&the PROPN spir-8434 8 14 & & CCONJ spir-8434 8 15 botnet&through&the&35&weeks&it&was&active,&the&botnet&generated&a&massive&amount&of botnet&through&the&35&weeks&it&was&active,&the&botnet&generated&a&massive&amount&of PROPN spir-8434 8 16 & & CCONJ spir-8434 8 17 content&with&more&than&3000&tweets&a&day&both&in&english&and&arabic.&according&to&this content&with&more&than&3000&tweets&a&day&both&in&english&and&arabic.&according&to&this PROPN spir-8434 8 18 & & CCONJ spir-8434 8 19 research,&the&social&bot&had&three&main&aims:&first,&flooding&the&syrian&revolution research,&the&social&bot&had&three&main&aims:&first,&flooding&the&syrian&revolution PROPN spir-8434 8 20 & & CCONJ spir-8434 8 21 hashtags&(for&example&#syria,&#hama,&#daraa)d&second,&overwhelming&the&proy hashtags&(for&example&#syria,&#hama,&#daraa)d&second,&overwhelming&the&proy PROPN spir-8434 8 22 revolution&discussion&on&twitter&and&other&social&media&portalsd&and&third,&misdirecting revolution&discussion&on&twitter&and&other&social&media&portalsd&and&third,&misdirecting NOUN spir-8434 8 23 & & CCONJ spir-8434 8 24 by&trying&to&get&the&audience&to&attend&to&other&content&(for&example,&the&protest&in by&trying&to&get&the&audience&to&attend&to&other&content&(for&example,&the&protest&in PROPN spir-8434 8 25 & & CCONJ spir-8434 8 26 bahrain&and&libya bahrain&and&libya PROPN spir-8434 8 27 ) ) PUNCT spir-8434 8 28 . . PUNCT spir-8434 9 1 & & CCONJ spir-8434 9 2 & & CCONJ spir-8434 9 3 & & CCONJ spir-8434 9 4 the)big)picture the)big)picture PROPN spir-8434 9 5 ) ) PUNCT spir-8434 9 6 this&paper&is&based&on&more&globally&focused&study&that&plots&out&a&working&three&part this&paper&is&based&on&more&globally&focused&study&that&plots&out&a&working&three&part PROPN spir-8434 9 7 & & CCONJ spir-8434 9 8 qualitative&methodology&for&researching&and&understanding&political&bots.&these qualitative&methodology&for&researching&and&understanding&political&bots.&these PROPN spir-8434 9 9 & & CCONJ spir-8434 9 10 methods&are&designed&for&usage&by&interdisciplinary&teams&of&computer&and&social methods&are&designed&for&usage&by&interdisciplinary&teams&of&computer&and&social PROPN spir-8434 9 11 & & CCONJ spir-8434 9 12 scientists&who&hope&to&use&creative&methods&to&work&and&communicate&with&diverse scientists&who&hope&to&use&creative&methods&to&work&and&communicate&with&diverse PROPN spir-8434 9 13 & & CCONJ spir-8434 9 14 research&and&public&communities.&part&one&focuses&on&the&development&of&a&codebook research&and&public&communities.&part&one&focuses&on&the&development&of&a&codebook PROPN spir-8434 9 15 & & CCONJ spir-8434 9 16 built&to&compile&a&comparative&event&dataset&of&all&available&instances&of&political&bot built&to&compile&a&comparative&event&dataset&of&all&available&instances&of&political&bot PROPN spir-8434 9 17 & & CCONJ spir-8434 9 18 usage&worldwide.&part&two&aims&at&explaining&approaches&for&interviewing&the&coders usage&worldwide.&part&two&aims&at&explaining&approaches&for&interviewing&the&coders PROPN spir-8434 9 19 & & CCONJ spir-8434 9 20 and&trackers&of&political&bots&with&an&aim&of&understanding&the&developmental&approach and&trackers&of&political&bots&with&an&aim&of&understanding&the&developmental&approach PROPN spir-8434 9 21 & & CCONJ spir-8434 9 22 to&building&these&automated&scripts.&part&three&is&a&dialogue&on&the&working to&building&these&automated&scripts.&part&three&is&a&dialogue&on&the&working PROPN spir-8434 9 23 & & CCONJ spir-8434 9 24 development&of&computational&and&communication&theory&on&political&bots,&an&iterative development&of&computational&and&communication&theory&on&political&bots,&an&iterative PROPN spir-8434 9 25 & & CCONJ spir-8434 9 26 ! ! PUNCT spir-8434 10 1 3 3 X spir-8434 10 2 ! ! X spir-8434 11 1 undertaking&based&upon&interactions&with&the&processes&and&findings&of&the&first&two undertaking&based&upon&interactions&with&the&processes&and&findings&of&the&first&two NUM spir-8434 11 2 & & CCONJ spir-8434 11 3 methodological&steps methodological&steps PROPN spir-8434 11 4 . . PROPN spir-8434 11 5 & & CCONJ spir-8434 11 6 & & CCONJ spir-8434 11 7 ! ! PUNCT spir-8434 12 1 figure'1:'three'part'qualitative'methodology figure'1:'three'part'qualitative'methodology NOUN spir-8434 12 2 ! ! PUNCT spir-8434 12 3 ) ) PUNCT spir-8434 13 1 event)dataset)&)code)book event)dataset)&)code)book VERB spir-8434 13 2 ) ) PUNCT spir-8434 14 1 in&this&submission,&our&aim&is&to&discuss&the&first&part&of&this&project&and&to&provide&a in&this&submission,&our&aim&is&to&discuss&the&first&part&of&this&project&and&to&provide&a PROPN spir-8434 14 2 & & CCONJ spir-8434 14 3 guide&to&developing&coding&manuals&from&scratch.&since&the&inception&of&this&project&in guide&to&developing&coding&manuals&from&scratch.&since&the&inception&of&this&project&in PROPN spir-8434 14 4 & & CCONJ spir-8434 14 5 august&2014&the&team&was&involved&in&the&construction&of&an&original&event&data&set august&2014&the&team&was&involved&in&the&construction&of&an&original&event&data&set PROPN spir-8434 14 6 & & CCONJ spir-8434 14 7 ( ( PUNCT spir-8434 14 8 with&more&than&68&cases)&that&is&more&comprehensive&than&any&previously&available with&more&than&68&cases)&that&is&more&comprehensive&than&any&previously&available PROPN spir-8434 14 9 & & CCONJ spir-8434 14 10 data&sets&on&political&bots.&following&the&classical&methodology&of&the&study&of&unusual data&sets&on&political&bots.&following&the&classical&methodology&of&the&study&of&unusual PROPN spir-8434 14 11 & & CCONJ spir-8434 14 12 phenomena&in&technology&diffusion&and&usability,&we&have&conducted&our&sampling&of phenomena&in&technology&diffusion&and&usability,&we&have&conducted&our&sampling&of PROPN spir-8434 14 13 & & CCONJ spir-8434 14 14 bot&use&by&means&of&news&reports&about&them&[8].&the&mediaybased&approach&to&data bot&use&by&means&of&news&reports&about&them&[8].&the&mediaybased&approach&to&data PROPN spir-8434 14 15 & & CCONJ spir-8434 14 16 collection&is&especially&valuable&when&the&phenomenon&at&hand&is&particularly&new.&the collection&is&especially&valuable&when&the&phenomenon&at&hand&is&particularly&new.&the PROPN spir-8434 14 17 & & CCONJ spir-8434 14 18 main&goal&of&the&event&dataset&is&to&find&themes&and&similarities&across&all&cases&to&help main&goal&of&the&event&dataset&is&to&find&themes&and&similarities&across&all&cases&to&help NOUN spir-8434 14 19 & & CCONJ spir-8434 14 20 us&in&the&project&final&step.&from&the&dataset&we&sampled&several&cases&in&order&to us&in&the&project&final&step.&from&the&dataset&we&sampled&several&cases&in&order&to PROPN spir-8434 14 21 & & CCONJ spir-8434 14 22 develop&a&codebook&using&qualitative&content&analysis.&this&step&was&necessary&to&aid develop&a&codebook&using&qualitative&content&analysis.&this&step&was&necessary&to&aid PROPN spir-8434 14 23 & & CCONJ spir-8434 14 24 the&coding&of&all&the&available&cases&of&political&bots.&in&the&codebook&we&included&seven the&coding&of&all&the&available&cases&of&political&bots.&in&the&codebook&we&included&seven PROPN spir-8434 14 25 & & CCONJ spir-8434 14 26 overarching&categories:&botnet&name,&botnet&description,&the&domain&impacted,&the overarching&categories:&botnet&name,&botnet&description,&the&domain&impacted,&the PROPN spir-8434 14 27 & & CCONJ spir-8434 14 28 target&country,&the&target&organization,&the&suspected&deployer,&and&the&depolyer target&country,&the&target&organization,&the&suspected&deployer,&and&the&depolyer PROPN spir-8434 14 29 & & CCONJ spir-8434 14 30 goal.&these&categories&were&developed&based&on&an&iterative&exploration&of&samples&of goal.&these&categories&were&developed&based&on&an&iterative&exploration&of&samples&of PROPN spir-8434 14 31 & & CCONJ spir-8434 14 32 the&events,&assumptions&about&the&way&a&political&botnet&might&work,&and&what&we&have the&events,&assumptions&about&the&way&a&political&botnet&might&work,&and&what&we&have PROPN spir-8434 14 33 & & CCONJ spir-8434 14 34 observed&in&the&prior&literature&on&political&bots observed&in&the&prior&literature&on&political&bot NOUN spir-8434 14 35 . . PUNCT spir-8434 15 1 & & CCONJ spir-8434 15 2 & & CCONJ spir-8434 15 3 & & CCONJ spir-8434 15 4 each&case&was&coded&three×&by&three&different&coders&resulting&in&a&total&of&174 each&case&was&coded&three×&by&three&different&coders&resulting&in&a&total&of&174 PROPN spir-8434 15 5 & & CCONJ spir-8434 15 6 coded&cases.&finally,&we&conducted&an&interycoder&reliability&test&to&finalize&the&codes coded&cases.&finally,&we&conducted&an&interycoder&reliability&test&to&finalize&the&code NOUN spir-8434 15 7 & & CCONJ spir-8434 15 8 and&improve&the&code&book.&our&goal&is&to&make&the&code&book&available&on&the&project and&improve&the&code&book.&our&goal&is&to&make&the&code&book&available&on&the&project PROPN spir-8434 15 9 & & CCONJ spir-8434 15 10 • • PROPN spir-8434 15 11 event'dataset event'dataset VERB spir-8434 16 1 • • NOUN spir-8434 16 2 code'book code'book ADJ spir-8434 16 3 part%one part%one NOUN spir-8434 16 4 • • NOUN spir-8434 16 5 interviewing interview VERB spir-8434 16 6 ' ' PUNCT spir-8434 16 7 bot'trackers bot'tracker NOUN spir-8434 16 8 • • NOUN spir-8434 16 9 interviewing interview VERB spir-8434 16 10 ' ' PUNCT spir-8434 16 11 bot'makers bot'maker NOUN spir-8434 16 12 part%two% part%two% X spir-8434 16 13 • • ADV spir-8434 16 14 developing develop VERB spir-8434 16 15 ' ' PUNCT spir-8434 16 16 theory theory NOUN spir-8434 16 17 • • NUM spir-8434 16 18 detection detection NOUN spir-8434 16 19 ' ' PART spir-8434 16 20 software software NOUN spir-8434 16 21 part part NOUN spir-8434 16 22 three three NUM spir-8434 16 23 ! ! PUNCT spir-8434 17 1 4 4 X spir-8434 17 2 ! ! X spir-8434 17 3 website1&for&other&researchers,&with&hopes&that&they&might&benefit&from&the&tool.&we website1&for&other&researchers,&with&hopes&that&they&might&benefit&from&the&tool.&we PROPN spir-8434 17 4 & & CCONJ spir-8434 17 5 have&also&included&a&political&bot&reporting&tool&on&the&website&in&an&effort&to&crowdy have&also&included&a&political&bot&reporting&tool&on&the&website&in&an&effort&to&crowdy CCONJ spir-8434 17 6 source&more&cases&worldwide.&as&mentioned&earlier,&our&goal&is&to&find&themes&across source&more&cases&worldwide.&as&mentioned&earlier,&our&goal&is&to&find&themes&across PROPN spir-8434 17 7 & & CCONJ spir-8434 17 8 these&cases&to&inform&theory&and&to&build&a&stronger&detection&software these&cases&to&inform&theory&and&to&build&a&stronger&detection&software PROPN spir-8434 17 9 . . PUNCT spir-8434 18 1 & & CCONJ spir-8434 18 2 conclusion conclusion PROPN spir-8434 18 3 & & CCONJ spir-8434 18 4 we&are¤tly&concluding&the&first&part&of&the&project&and&finding&many&important we&are¤tly&concluding&the&first&part&of&the&project&and&finding&many&important PROPN spir-8434 18 5 & & CCONJ spir-8434 18 6 lessons&to&report&for&researchers&interested&in&similar&work.&our&proposed&methodology lessons&to&report&for&researchers&interested&in&similar&work.&our&proposed&methodology PROPN spir-8434 18 7 & & CCONJ spir-8434 18 8 makes&use&of&triangulation&of&evidence&from&online&and&offline&sources&through&the makes&use&of&triangulation&of&evidence&from&online&and&offline&sources&through&the PROPN spir-8434 18 9 & & CCONJ spir-8434 18 10 analysis&of&data&emerging&from&the&qualitative&coding&stage&(part&one)&with&the&data&we analysis&of&data&emerging&from&the&qualitative&coding&stage&(part&one)&with&the&data&we PROPN spir-8434 18 11 & & CCONJ spir-8434 18 12 gain&from&interviewing&botnet&makers&and&botnet&trackers&(part&2)&in&order&to&piece gain&from&interviewing&botnet&makers&and&botnet&trackers&(part&2)&in&order&to&piece PROPN spir-8434 18 13 & & CCONJ spir-8434 18 14 together&parts&of&the&narrative&of&a&contemporary&ict&phenomenon.&the&results&of&this together&parts&of&the&narrative&of&a&contemporary&ict&phenomenon.&the&results&of&this PROPN spir-8434 18 15 & & CCONJ spir-8434 18 16 work&will&contribute&to&the&literature&on&internet&research&and&the&use&of&automated work&will&contribute&to&the&literature&on&internet&research&and&the&use&of&automated PROPN spir-8434 18 17 & & CCONJ spir-8434 18 18 scripts&in&many&ways.&one&way&is&through&the&development&of&a&comprehensive&analysis scripts&in&many&ways.&one&way&is&through&the&development&of&a&comprehensive&analysis PROPN spir-8434 18 19 & & CCONJ spir-8434 18 20 of&the¤t&ways&political&bots&are&being&utilized&and&how&they&influence&public of&the¤t&ways&political&bots&are&being&utilized&and&how&they&influence&public PROPN spir-8434 18 21 & & CCONJ spir-8434 18 22 opinion.&we&believe&that&this&work&will&help&local&and&foreign&policy&makers&better opinion.&we&believe&that&this&work&will&help&local&and&foreign&policy&makers&better NUM spir-8434 18 23 & & CCONJ spir-8434 18 24 understand&the&relationship&between&technology&diffusion&and&political&processes understand&the&relationship&between&technology&diffusion&and&political&processes PROPN spir-8434 18 25 . . PUNCT spir-8434 19 1 & & PROPN spir-8434 19 2 & & CCONJ spir-8434 19 3 & & CCONJ spir-8434 19 4 & & CCONJ spir-8434 19 5 references references PROPN spir-8434 19 6 & & CCONJ spir-8434 19 7 [ [ X spir-8434 20 1 1]&w.&lance&bennett&and&alexandra&segerberg,&the!logic!of!connective!action:!digital 1]&w.&lance&bennett&and&alexandra&segerberg,&the!logic!of!connective!action:!digital PROPN spir-8434 20 2 ! ! PUNCT spir-8434 21 1 media!and!the!personalization!of!contentious!politics,&2013d&philip&n.&howard,&the media!and!the!personalization!of!contentious!politics,&2013d&philip&n.&howard,&the X spir-8434 21 2 ! ! PUNCT spir-8434 21 3 digital!origins!of!dictatorship!and!democracy:!information!technology!and!political digital!origins!of!dictatorship!and!democracy:!information!technology!and!political PROPN spir-8434 21 4 ! ! PUNCT spir-8434 21 5 islam&(new&york,&ny:&oxford&university&press,&2010 islam&(new&york,&ny:&oxford&university&press,&2010 NOUN spir-8434 21 6 ) ) PUNCT spir-8434 21 7 . . PUNCT spir-8434 22 1 & & CCONJ spir-8434 23 1 [ [ X spir-8434 23 2 2]&f.&edwards,&philip&n.&howard,&and&mary&joyce,&“digital&activism&and&nonyviolent 2]&f.&edwards,&philip&n.&howard,&and&mary&joyce,&“digital&activism&and&nonyviolent NUM spir-8434 23 3 & & CCONJ spir-8434 23 4 conflict”&(digital&activism&research&project,&2013)d&jennifer&earl&and&katrina&kimport conflict”&(digital&activism&research&project,&2013)d&jennifer&earl&and&katrina&kimport NOUN spir-8434 23 5 , , PUNCT spir-8434 23 6 & & CCONJ spir-8434 23 7 digitally!enabled!social!change&(the&mit&press,&2011 digitally!enabled!social!change&(the&mit&press,&2011 ADJ spir-8434 23 8 ) ) PUNCT spir-8434 23 9 . . PUNCT spir-8434 24 1 & & CCONJ spir-8434 25 1 [ [ X spir-8434 25 2 3]&yuval&rosenberg,&“62&percent&of&all&web&traffic&comes&from&bots,”&the!week 3]&yuval&rosenberg,&“62&percent&of&all&web&traffic&comes&from&bots,”&the!week NUM spir-8434 25 3 , , PUNCT spir-8434 25 4 & & CCONJ spir-8434 25 5 december&16,&2013,&http://theweek.com december&16,&2013,&http://theweek.com PROPN spir-8434 25 6 / / SYM spir-8434 25 7 article article PROPN spir-8434 25 8 / / SYM spir-8434 25 9 index/254183/62ypercentyofyallyweby index/254183/62ypercentyofyallyweby ADJ spir-8434 25 10 trafficycomesyfromybots trafficycomesyfromybot NOUN spir-8434 25 11 . . PUNCT spir-8434 26 1 & & CCONJ spir-8434 27 1 [ [ X spir-8434 27 2 4]&&protalinski,&e.&(2012).&facebook:&5y6%&of&accounts&are&fake&|&zdnet.zdnet 4]&&protalinski,&e.&(2012).&facebook:&5y6%&of&accounts&are&fake&|&zdnet.zdnet PROPN spir-8434 27 3 . . PUNCT spir-8434 27 4 & & CCONJ spir-8434 27 5 retrieved&may&27,&2014,&from&http://www.zdnet.com retrieved&may&27,&2014,&from&http://www.zdnet.com PROPN spir-8434 27 6 / / SYM spir-8434 27 7 blog blog PROPN spir-8434 27 8 / / SYM spir-8434 27 9 facebook facebook PROPN spir-8434 27 10 / / SYM spir-8434 27 11 facebooky5y6yofy facebooky5y6yofy PROPN spir-8434 27 12 accountsyareyfake/10167 accountsyareyfake/10167 PROPN spir-8434 27 13 & & CCONJ spir-8434 27 14 [ [ X spir-8434 27 15 5]&cheng,&a 5]&cheng,&a NUM spir-8434 27 16 . . PUNCT spir-8434 27 17 ,&&&evans,&m.&(2009,&august&1).&twitter&statistics&y&an&inydepth&report&at ,&&&evans,&m.&(2009,&august&1).&twitter&statistics&y&an&inydepth&report&at PROPN spir-8434 27 18 & & CCONJ spir-8434 27 19 most&active&twitter&users.&social!media!monitoring!and!analytics!solutions.&retrieved most&active&twitter&users.&social!media!monitoring!and!analytics!solutions.&retrieved PROPN spir-8434 27 20 & & CCONJ spir-8434 27 21 june&3,&2014,&from&https://www.sysomos.com june&3,&2014,&from&https://www.sysomos.com PROPN spir-8434 27 22 / / SYM spir-8434 27 23 insidetwitter insidetwitter NOUN spir-8434 27 24 / / SYM spir-8434 27 25 mostactiveusers/ mostactiveusers/ PROPN spir-8434 27 26 & & CCONJ spir-8434 27 27 ! ! PUNCT spir-8434 27 28 ! ! PUNCT spir-8434 27 29 ! ! PUNCT spir-8434 27 30 ! ! PUNCT spir-8434 27 31 ! ! PUNCT spir-8434 27 32 ! ! PUNCT spir-8434 27 33 ! ! PUNCT spir-8434 27 34 ! ! PUNCT spir-8434 27 35 ! ! PUNCT spir-8434 27 36 ! ! PUNCT spir-8434 27 37 ! ! PUNCT spir-8434 27 38 ! ! PUNCT spir-8434 27 39 ! ! PUNCT spir-8434 27 40 ! ! PUNCT spir-8434 27 41 ! ! PUNCT spir-8434 27 42 ! ! PUNCT spir-8434 27 43 ! ! PUNCT spir-8434 27 44 ! ! PUNCT spir-8434 27 45 ! ! PUNCT spir-8434 27 46 ! ! PUNCT spir-8434 27 47 ! ! PUNCT spir-8434 27 48 ! ! PUNCT spir-8434 27 49 ! ! PUNCT spir-8434 27 50 ! ! PUNCT spir-8434 27 51 ! ! PUNCT spir-8434 27 52 ! ! PUNCT spir-8434 27 53 ! ! PUNCT spir-8434 27 54 ! ! PUNCT spir-8434 27 55 ! ! PUNCT spir-8434 27 56 ! ! PUNCT spir-8434 27 57 ! ! PUNCT spir-8434 27 58 ! ! PUNCT spir-8434 27 59 ! ! PUNCT spir-8434 27 60 ! ! PUNCT spir-8434 27 61 ! ! PUNCT spir-8434 27 62 ! ! PUNCT spir-8434 27 63 ! ! PUNCT spir-8434 27 64 ! ! PUNCT spir-8434 27 65 ! ! PUNCT spir-8434 27 66 ! ! PUNCT spir-8434 27 67 ! ! PUNCT spir-8434 27 68 ! ! PUNCT spir-8434 27 69 ! ! PUNCT spir-8434 27 70 ! ! PUNCT spir-8434 27 71 ! ! PUNCT spir-8434 27 72 ! ! PUNCT spir-8434 27 73 ! ! PUNCT spir-8434 27 74 ! ! PUNCT spir-8434 27 75 ! ! PUNCT spir-8434 27 76 ! ! PUNCT spir-8434 27 77 ! ! PUNCT spir-8434 27 78 ! ! PUNCT spir-8434 27 79 ! ! PUNCT spir-8434 27 80 ! ! PUNCT spir-8434 27 81 ! ! PUNCT spir-8434 27 82 ! ! PUNCT spir-8434 28 1 1!politicalbots.org 1!politicalbots.org NUM spir-8434 28 2 ! ! PUNCT spir-8434 28 3 ! ! PUNCT spir-8434 29 1 5 5 X spir-8434 29 2 ! ! PUNCT spir-8434 30 1 [ [ X spir-8434 30 2 6]&york,&j.&c.&(2011,&april&).&syria's&twitter&spambots.&(t.&guardian,&producer 6]&york,&j.&c.&(2011,&april&).&syria's&twitter&spambots.&(t.&guardian,&producer NUM spir-8434 30 3 ) ) PUNCT spir-8434 30 4 & & CCONJ spir-8434 30 5 retrieved&june&2014,&from&the&guardian retrieved&june&2014,&from&the&guardian PROPN spir-8434 30 6 : : PUNCT spir-8434 30 7 & & CCONJ spir-8434 30 8 http://www.theguardian.com/commentisfree/2011/apr/21/syriaytwitteryspambotsyproy http://www.theguardian.com/commentisfree/2011/apr/21/syriaytwitteryspambotsyproy PROPN spir-8434 30 9 revolution revolution PROPN spir-8434 30 10 & & CCONJ spir-8434 30 11 & & CCONJ spir-8434 30 12 [ [ X spir-8434 30 13 7]&abokhodair,&n 7]&abokhodair,&n NUM spir-8434 30 14 . . PUNCT spir-8434 30 15 ,&yoo,&d ,&yoo,&d PUNCT spir-8434 30 16 . . PUNCT spir-8434 31 1 ,&mcdonald,&d.&(2015).&dissecting&a&social&botnet:&growth ,&mcdonald,&d.&(2015).&dissecting&a&social&botnet:&growth PROPN spir-8434 31 2 , , PUNCT spir-8434 31 3 & & CCONJ spir-8434 31 4 content&and&influence&on&twitter.&proceedings&of&the&acm&conference&on&computer content&and&influence&on&twitter.&proceedings&of&the&acm&conference&on&computer PROPN spir-8434 31 5 & & CCONJ spir-8434 31 6 supported&cooperative&work&(cscw&2015).&acm supported&cooperative&work&(cscw&2015).&acm PROPN spir-8434 31 7 & & CCONJ spir-8434 31 8 [ [ X spir-8434 31 9 8]&earl,&j 8]&earl,&j NUM spir-8434 31 10 . . PUNCT spir-8434 31 11 ,&martin,&a ,&martin,&a PUNCT spir-8434 31 12 . . PUNCT spir-8434 32 1 ,&mccarthy,&j.d ,&mccarthy,&j.d PROPN spir-8434 32 2 . . PUNCT spir-8434 33 1 ,&soule,&s.a.&(2004).&the&use&of&newspaper&data ,&soule,&s.a.&(2004).&the&use&of&newspaper&data PROPN spir-8434 33 2 & & CCONJ spir-8434 33 3 in&the&study&of&collective&action.&annual&review&of&sociology.&30,&65y80 in&the&study&of&collective&action.&annual&review&of&sociology.&30,&65y80 ADJ spir-8434 33 4 . . PUNCT spir-8434 34 1 & & CCONJ