PAPER HOW TO IMPROVE THE ACCESSIBILITY AND REDUCE THE TOTAL COST OF OWNERSHIP WITH ECOLIG PROTOCOL AND ANDROID IN MOBILE LEARNING How to Improve the Accessibility and Reduce the Total Cost of Ownership with ECOLIG Protocol and Android in Mobile Learning http://dx.doi.org/ijim.v5i4.1648 S.M. Ismail, P.V.O. Miguel and G. Barreto State University of Campinas – UNICAMP, Campinas, Brazil Abstract—A new electronic learning device generation can be created from a new paradigm in human sense and effer- ent resources. The brain computer interfaces (BCI) with ECOLIG protocol can be used to get the advantages from “Near To Eye” and “Augmented Reality” technologies. In this way, this paper describes the results from an experi- ment using a mobile phone emulator system, a BCI and ECOLIG protocol to demonstrate the benefits in eliminat- ing the use of touch screen and keyboards features. Finally, it concludes that ECOLIG can be a long life time communi- cation technology between Human and Machines especially in a Singularity world. Index Terms—Brain Computer Interface; Singularity; Near to Eye; Augmented Reality I. INTRODUCTION A good learning system should promote mobility, flexibility, scalability, a friendly user interface and pref- erably a low total cost of ownership. In addition, an im- portant requirement is the accessibility, maybe one of the most important requirements, since the technology changes so fast that administrators, teachers and students are constantly away of the matter. A big challenge is to keep all persons updated about the current technical solu- tion. It usually changes the focus from learn the content to learn how to use the current or the next learning tool. Of course, it can be worse if the persons already have some kind of disability. What kind of technology could include those persons? What kind of technology could transfer the most of adaptive tasks to systems and not to users? What kind of technology could preserve the human interfaces in order to reduce investments with training and reduce the raw material consumption as well as the gar- bage when replaced? A learning system can be improved when it promotes the interaction and communication between its agents, resources and with the environment as well. The basic concepts are the data acquisition systems (afferent) and actuators systems (efferent) in charge to capture informa- tion and eventually to make changes respectively in a learning process [9]. A long time ago, when the human being created the first tool to work, for self-defense or even to improve the interaction with the environment, the electric principles and concepts were not available, at least, not to be used as nowadays. Therefore, the intuitive mechanical stuff and actions had made the difference and brought the necessary advantage to survive in a competitive world [18]. Never- theless, those artifacts became sophisticated and were adapted to different uses and situations. In spite of the improvement with research in several ar- eas of science, most of human actions over the environ- ment keep using mechanical tools, including the electric ones [22]. From a tree branch, when used as a tool, to a television remote control, interfaces depend on human arms, hands, bones and muscles to execute some action. Indeed, even to transfer an information through a letter, a sound wave, a keyboard or mouse, some kind of mechani- cal transduction is necessary. Curiously, the eyes were already supposed to be a very fast afferent interface, where the information is well con- verted from multi frequencies light wave, if available, and received through the optical nerve, after reflections on the environment, and so be detected by the eyes. In a short term, this afferent channel brings and processes as much information as necessary to determine whether any action should be executed on the environment. Since the interactions are needed to promote a learning process, the efficiency of afferent and efferent interfaces will contribute to do it in an easy or hard way. It is known that intelligence is even more complex, and depends on many agents, objects, scenarios and maturity level of the knowledge, usually gained in the life-story, therefore, a factor dependent on time. But the interfaces will contrib- ute significantly to promote a fast or slow interaction, with direct impact in learning time and efficiency of communi- cation with other local or remote agents. When Uexkul described his theory about Umwelt [15], he brought up more than a systematic way to observe a phenomenon in the animal world [18]. He directed his attention to the importance of the senses in a learning process as well. Those senses are gates to the semiotic signs. Therefore, the idea is to use them to propose a uni- versal language. However, the main issue comes from the differences between semiotic signs that are generated in each mind [1,2]. These signs are dependent on previous experiences and are the product of a cyclical process that looks for a definitive interpretation. This is a problem not so easy to solve. Looking for an answer, it is possible to work on some specific situations. There is a chance to simplify this ap- proach and get some advantages avoiding intermediary tools in the path to build a semiotic sign. Reducing the number of layers of transducers is expected to reduce noise, misunderstanding and timeframe to acquire reliable information and a correct interpretation of a situation. iJIM ‒ Volume 5, Issue 4, October 2011 11 http://dx.doi.org/ijac.v4i4.1648 PAPER HOW TO IMPROVE THE ACCESSIBILITY AND REDUCE THE TOTAL COST OF OWNERSHIP WITH ECOLIG PROTOCOL AND ANDROID IN MOBILE LEARNING Therefore, the proposal is to drive an information from the brain to the electronic world, faster than usual, avoiding some or every mechanical transductions [22]. Someone might consider this as a reductionist way to see the arms, legs and hands, since it seems to be a set of interconnected transducers to promote any interaction between the brain and the environment. Indeed, the idea of using the brain commands to members of the body as part of an electric protocol is even better than using arms and fingers to type some key and send some information to an electronic device. In addition, the possibility to con- nect thinking to the electronic world can offer a better tool to handle semiotic signs [3]. The proposal is to create an alternative way to send in- formation directly from the mind to the electronic world, keeping as reference the human sensorial system of in- formation associated with the human body. Therefore, if the senses and actions are essential for any learning system, it would be better to move the interaction to an electric mode, especially considering that human life has been inserted in an electronic world. Once human neural communication uses ionic signals, it is possible to connect it with the electronic world. Moreover, it should be easier to communicate through electric interfaces than mechanisms that need movement, biological or artificial ones, as hands or car wheels steering, for example. The main benefit comes from ubiquity, the capacity to be eve- rywhere at the same time, since the senses and actions can be anywhere through electronic systems. A good point to capture a semiotic sign is in the brain. In that region it is possible to associate some electric ac- tivity to some signification in a specific maturity level. From the brain, one can obtain feedback and so associate brain activities [14] to primitives of a protocol, in order to construct a universal language. In that part of human body is possible to identify similar cognitive information be- tween individuals of the same species. Moreover, the in- terpretation is a product of mind, so the brain can be a key place to associate electric signals to codes in a semiotic protocol that can be used to communicate with electronic world [22]. II. A SEMIOTIC PROTOCOL A knowledge level can be seen as a state of a process in an intelligent system, a level of understanding, interpreta- tion and assimilation. The semiotic theory proposes that knowledge evolves in cycles [4]. Indeed, this evolution seems to be a spiral where each ring is closed with a se- miotic sign and a new ring starts looking for a new sign which could better define the previous state [22]. When one tries to transmit knowledge to another person or to the electronic world, it is likely that the first one will drive the other through the same spiral, like a journey, Fig. 1. But if the trajectory, the velocity and other condi- tions are affected by several factors as expertise, previous experiences and base of knowledge, for example, how can someone drive another to walk through the same spiral, or at least stop by at the same check points, the semiotic signs? It seems even more difficult to answer this question, because this journey takes place in an abstract region, the mind of every person, and both are supposedly unable to be connected directly, so far. Figure 1. The convergency of two semiotic spirals TABLE I. PRIMITIVES OF ECOLIG PROTOCOL Categories Humanist Trans humanist Cognitive Vision; Hearing; Smell; Tact; Taste; Movement or Propriocep- tion; Balance. Magnetism; Radiation; Presence; Augmented- Vision Private codes defined by each person. From ECOLIG specifications (UNICAMP) ECOLIG is denominated a semiotic protocol due the possibility to redefine its primitives according to a cogni- tive process [20, 23]. That protocol was developed by scientists from UNICAMP (State University of Campinas, Brazil) and it is composed of Humanist and Trans- humanist categories of codes. This protocol allows ex- panding the range of human perception and action. There are primitives to allow a complete remote interaction, Ta- ble I. The ECOLIG protocol is defined for communication between two or more Sensorial Intelligent Systems (SIS) and/or Sensorial Operators (SO) [21]. The "SO" and "SIS" are defined as electronic, organic or mixed devices, capa- ble of capturing, measure, interpret and transmit sensorial signals. The SO, however, only act after receiving com- mands from any SIS. So the ability to make decisions based on these sensory inputs is what differentiates a SIS from SO. These sensorial devices, electronics, organic or mixed, are able to identify, classify and measure all or some of the feelings then known. When used with BCI (Brain Computer Interfaces) [17] and “Near to Eye” accessories, this protocol can transmit commands to remote devices and receive sensorial signals as well. Using semiotic concepts, it is a sign oriented pro- tocol. In this way, it can improve the relationship with the environment and other intelligent systems [10]. Capturing the aim of human thinking, ECOLIG is not mechanical actuators dependent and offers the possibility to learn with interactions in a semiotic spiral process [23]. The structure of ECOLIG protocol can be seen on the diagram shown in Fig. 2. 12 http://www.i-jim.org PAPER HOW TO IMPROVE THE ACCESSIBILITY AND REDUCE THE TOTAL COST OF OWNERSHIP WITH ECOLIG PROTOCOL AND ANDROID IN MOBILE LEARNING Figure 2. Layers of signals using ECOLIG protocol In order to use the concepts associated with semiotics, is very important to establish a relationship between changes, causes and effects, in the external space with signals perceived in the inner space [13]. This direct and controlled relationship can be the necessary link so you can encode cognitive processes and semiotic development [5]. Therefore, the primitives of ECOLIG protocol will be related to certain brain activities [14] through signals re- ceived, filtered and ranked by the BCI [17]. About the used BCI, these logic signals received are classified as Expressive, Cognitive and Emotive. The Expressive signs refer to common human actions as eye blinking and others. The Cognitive are configurable and generated from samples of signs that can be stored in the interface based on associations with thought, imagina- tion or other brain activity in a preliminary stage of train- ing. The Emotive signs are related to emotional feeling states of human being, as excitement or depression, for example. Signs of ECOLIG protocol will be identified and trans- formed into semiotic signs as the wished action to be promoted in the outer space [21]. The concept of a proto- col is usually associated with patterns that are used in processes of communication but, in this case, this concept goes beyond communication. This semiotic protocol is also associated with a set of symbols that are interpreted as semiotic signs by intelligent systems, which may be more complex commands or even meta-interpretations that may further evolve when processed by other intelli- gent systems [10, 11]. These meta-evolving interpreta- tions can be considered learning processes that occur in artificial or biological neural networks. Those new technologies can improve usability and ac- cessibility, giving alternatives to explore remote regions with security and lower cost projects than with usual pro- grams. The use of those new technologies with “Aug- mented Reality” solutions will open new possibilities for mobile applications and information technology systems. If humans can use ECOLIG and BCI to interact with electronic solutions, instead of keyboard and mouse e.g., it is supposed to be easier to move the electronic devices to Nano metric scale, i.e., with lower power consumption and better efficiency, at least [23]. In order to verify the applicability of these new para- digms, an implementation was made using ECOLIG, An- droid and a BCI. In this case, ECOLIG was used to com- municate and interact with some mobile features. Android is an operational system from OHA (Open Handset Alli- ance), in this case, used to control a simulated mobile de- vice [6, 20]. The Brain-Computer Interface was used to capture electric signals from brain activities. The implementation was made using Eclipse, a multi- language development tool with an IDE (Integrated De- velopment Environment) that uses a STP (Service Ori- ented Architecture Tool Platform). The results were collected from two cases over a mo- bile emulated environment. The first case was a naviga- tion test over “Google Maps” using a pointer and a virtual keyboard, both accessed by mind control. The second case did not use the pointer and virtual keyboard but semiotic signs interpreted from the ECOLIG protocol [21]. In the last case, the usability and accessibility could be explored to test the new paradigm of interaction with other intelli- gent systems through electronic world using brain signals and a semiotic protocol. The graphics and reports can demonstrate the new pos- sibilities using these technologies with “Near to Eye” de- vices to reduce cost, size and wasted material with wear- able solutions applied to learning systems. III. TRAINING SECTION Using the development environment and the conceptual structure a training procedure was created to familiarize some persons with the protocol, hardware interfaces and the training software that were used in cases to be studied. At this stage the individuals submitted to sessions of preparation and adaptation should be able to properly util- ize the BCI (Brain-Computer Interface) and repeat com- mands that are sent to the computer via a wireless com- munication interface using ECOLIG protocol [8, 22]. Fi- nally, it was verified the effectiveness of the training pro- cedure and the goals of usability with that emulated mo- bile device using the ECOLIG protocol. The procedure sought to ensure the physical and psychological safety of the people involved. Simultaneously, it tried to ensure minimum attention needed to obtain results that can be measure, structured and could be reproduced accurately over known and controlled conditions. The choice and preparation of people, training and test environment as well as the correct installation and attachment of equip- ment were also important. The persons were submitted to training sessions during 10 consecutive days, two sessions per day. The first daily session took 30 minutes in the morning and the second one took the same time frame in the afternoon, for each person. There was at least 6 hours of interval during each session used to recharge batteries of BCI as well. The pro- cedure to associate an electric signal, acquired from brain activity, with a code of ECOLIG protocol was repeated 30 times in 15 minutes. Each person tried to command an order during 15 seconds and then rested for 15 seconds before starting over again [21]. The number of positive answers was registered and plotted in a chart, Fig. 3 and 4. In order to analyze the behavior and the conformity with ECOLIG protocol, four types of Cognitive and Ex- pressive signals were tested with a respective code of ECOLIG protocol each one. iJIM ‒ Volume 5, Issue 4, October 2011 13 PAPER HOW TO IMPROVE THE ACCESSIBILITY AND REDUCE THE TOTAL COST OF OWNERSHIP WITH ECOLIG PROTOCOL AND ANDROID IN MOBILE LEARNING Figure 3. Cognitive learning curve Figure 4. Expressive learning curve IV. NAVIGATION CASE The proposal in this case was to verify if some previ- ously trained persons could navigate through Google Maps using ECOLIG and BCI. They sent commands to an emulated mobile device using only electric signals from the brain. Those persons could control a pointer in a stan- dard user interface using primitives of ECOLIG protocol that were associated to brain activities. Android was a good option since it is an open platform used with mobile devices. When using Android, some procedures could be easily implemented to improve the control with some primitives of ECOLIG protocol. In order to offer a flexible development environment, Eclipse was the IDE (Integrated Development Environ- ment) used to configure all tools used with those tests. One more reason to use a STP (Service Oriented Architec- ture Tools Platform) was to be able to program using sev- eral languages and using some already available library of tools. Therefore, the necessary environment was ready for the proposed test of navigation using ECOLIG-BCI [21]. Indeed, there were more in those tests using the pro- posed solution, e.g., which level of control a person could achieve over a usual device? How accurate could be the interaction between human and electronic systems using that kind of non-invasive BCI? Could a human being learn and use a new code to communicate with electronic world without a mechanic tool? Can a person keep enough atten- tion and share it with important actions simultaneously? The results were very positive and pointed to the benefits to invest even more in the ECOLIG with wireless non- invasive BCI interfaces [7]. The first positive answer came from the chosen tech- nology. With a sensorial protocol and a lightweight wire- less device, someone can feel free to express movements and emotions. After the training section described earlier, the persons could demonstrate some intimacy and good Figure 5. Two dimensonal GUI (Graphical User Interface) control over the mobile device. It could be seen with a high level of assertive answers, as well as demonstration of a good expertise to install and use the solution ECOLIG-BCI. The average time to action and reaction, within 3 seconds, was good for this kind of application. When using a pointer and a two dimensional GUI (Graphic User Interface) [16], the solution was used with excellent accuracy and simplicity, Fig. 5. But, since the protocol has powerful primitives, a new kind of GUI could offer better commands. An association of a coordi- nate with some specific symbol could be interpreted as a command to move the scenario to a specific geographic positioning, for instance. That symbol can be interpreted as a sign in a semiotic process that can be driven by a more powerful and fast mind control, since it does not have to move pointers and adjust maps with the hands. Despite of the benefits, a critical detail to answer those mentioned, and some other, questions is the resolution that is dependent on the frequency of signal and the sam- pling rate. In low frequency signals, during the EEG (Electroencephalogram) signal acquisition, a usual Time for Information Acquisition (TIA) is around 10ms. With this number is possible to suggest the applicability and some restrictions to use the ECOLIG-BCI technology. In spite of this time of acquisition, there are two others so important as well: The Time for Command (TFC) and Time for Interpretation (TFI). The total number of TIA cycles required to define a TFC is each person ability de- pendent and how well adapted to ECOLIG-BCI he or she is. Therefore, the total time to act is a result of TFC plus TFI since each command can be interpreted in a semiotic process to execute a high level instruction. To operate a standard GUI of a mobile device, several TIA cycles can be necessary to define each TFC. In this Navigation Case, where the commands act over a regular pointer in usual GUI, several commands will take place in order to execute a function. Indeed, several commands will move the pointer and select the function and a new sequence of commands will be necessary to coordinate the task in that selected function. Even in this situation the use of ECOLIG-BCI brought a great contribution since it eliminated the time and energy to move arms and hands in order to control the pointer and execute the same action, Fig. 6. But, what new contributions can be done with a new protocol that does not need to use pointers and some oth- ers graphical artifacts? Indeed, a great investment is a new interface that should use a new n-dimensional package of symbols which will be interpreted as semiotic signs. In fact, a new language can be created to communicate, us- ing a customizable sequence of codes that can be associ- ated to high level instructions, a semiotic protocol. 14 http://www.i-jim.org PAPER HOW TO IMPROVE THE ACCESSIBILITY AND REDUCE THE TOTAL COST OF OWNERSHIP WITH ECOLIG PROTOCOL AND ANDROID IN MOBILE LEARNING Figure 6. Access throught mind controlling a pointer V. THE CASE OF SEMIOTIC SIGNS The concepts of semiotics and intelligent systems are at least controversial [12]. One problem is how one can rep- resent a dynamic process of learning? Several models have been trying to explain those theories that, necessar- ily, have to use an idea of interaction to demonstrate a cognitive sequence. To make matters worse, the protocols used to support the interactions introduce some intermedi- ate steps that make it harder to understand. For example, to teach someone how to type a word on a keyboard is easier than to teach the same person how to handwrite the same word with a pen. In the manual process, the tool and the interface will introduce many more steps and situa- tions. In addition, it will require much more skill and training. A semiotic protocol can encapsulate some sequences of actions and so minimize the TFI (Time for Interpretation) since it will reduce the number of actions. This can be done using an appropriate language based on ECOLIG. The ECOLIG protocol is divided in three categories of code, as described earlier in this paper [21,23]. When us- ing the cognitive class, it is possible to associate some codes of protocol to some definitions in order to execute some complex commands, in a shorter time frame. In ad- dition to regular codes, in this case, some geographic co- ordinates and actions were dynamically associated to some cognitive codes of ECOLIG protocol. Therefore, the selections, movements and sequences of actions were executed just thinking in some previously defined images. Each brain activities, associated to each respective image, were identified by BCI and translated using ECOLIG to navigate with Google Maps over Android in an emulated mobile device, much faster than in the first case, Fig. 7. Figure 7. ECOLIG protocol is essential in this semiotic process by allowing the meanings to be redefined in a meta- interpretation. By observing a painting, for example, this process occurs in cycles of observation and redefinition until a satisfactory level of maturity is reached in the in- terpreter mind [23]. When using ECOLIG protocol to codify, it can be done redefining the meaning through a meta-language. Indeed, it is like selecting the same word in a “HTML” text, but that now leads the browser to another Internet page ad- dress, because its link has been modified. Although simi- lar to a meta-language, the power to trigger the new pro- cedures, routines and even other systems gives the solu- tion ECOLIG-ICC an even greater power. Figure 8. Direct access throught mind control It is not coincidence that this procedure has resem- blance to the method proposed by Walter Andrew She- whart in the 30's, the PDCA (Plan, Do, Check, Act), and subsequently developed by William Edwards Deming with much success, PDSA (Plan, Do, Study, Act) [19]. In summary, these procedures seek to respond, in a struc- tured way, to three fundamental questions for improve- ment of a process: What we intend to accomplish? How it is possible to know if that change is an improvement? What changes can be made that result in an improvement? VI. CONCLUSIONS The proposed design for the work achieved the goals originally stipulated allowing persons to control mobile devices using only brain activities and ECOLIG-BCI. The protocol was validated and applied to a simulation en- coded on a mobile platform into a development environ- ment (IDE) that uses service oriented architecture. The time frame associated to each step, since installation, con- figuration, setup and training were considered acceptable under the proposed application. Moreover, the adoption of an interface such as non-invasive BCI was a good alterna- tive since the aesthetics, autonomy, security, usability and reliability of information were critical to extending the application of these interfaces and ECOLIG protocol. De- spite of the good results, the tests should be exposed to adverse environment related to everyday urban life, where they can use a new profile and consequently a new learn- ing curve. The use of cognitive signals showed a greater precision to the identification of ECOLIG protocol, although they have to be customized to each user. Nevertheless, the brain signals of "Expression" were more standardized and their use for association with ECOLIG protocol, may ac- quire more precision with the use and the consequent im- provement of the selective capacity of users. The low se- lectivity of the signals can also be attributed to missing concentration on human activities, but is due mainly to the lack of common usage of these signs as a way of interac- tion. The use of ECOLIG, a semiotic protocol, with BCI will be a new paradigm in human-machine interaction. Since it makes possible to capture a semiotic sign directly from a brain activity, the access to high level instructions through electronic world will offer a possibility to improve the communication and to execute powered commands just thinking. Moreover, new GUI can be developed not lim- ited to bi-dimensional structure [16], but with a n- dimensional structure using hyperspace as a concept for a iJIM ‒ Volume 5, Issue 4, October 2011 15 PAPER HOW TO IMPROVE THE ACCESSIBILITY AND REDUCE THE TOTAL COST OF OWNERSHIP WITH ECOLIG PROTOCOL AND ANDROID IN MOBILE LEARNING new paradigm. In addition, the possibility to associate semiotic signs to feelings and senses will give to human beings the power of ubiquity, since they can send or re- ceive signals of senses from anywhere through electro- electronic world [21]. The ECOLIG-BCI solution means a new opportunity for M-Learning technology which can be integrated to NTE (Near to Eye) and Augmented Reality and offer new horizons to applications over a semiotic architecture. Since the electric devices and networks will interact with humans using a human protocol, it is possible to preserve the human learning and transfer to the electronic world the adaptive task when the technology changes. Especially when used in some conceptions of Singularity or nanosys- tems , where the human and machines will be one part of the other and the communication in between cannot con- sider a keyboard, a mouse or even a regular screen. REFERENCES [1] A. Meystel. “Intelligent Systems - A Semiotic Perspective” – International Journal of Intelligent Control and System - Vol. 1 - No. 1 - 1996 - pp. 31- 57. - 1996 [2] A. Meystel. “Semiotic Modeling and Situation Analysis: An In- troduction” - Bala Cynwyd, AdRem Inc. - 1995. [3] C. Morris. “Writings on the General Theory of Signs” - The Hague: Mouton - 1971. [4] C. Peirce. “Collected Papers of Charles Sanders Peirce” - 1960. [5] D. Pospelov. “Situational Control: Theory and Practice” – Nauka Publishers - Moscow - 1986 - tradução não publicada do original em russo - 1991. [6] Developer Android Group. ADT. Technical report, OHA. http://developer.android.com/sdk/eclipse-adt.html. [7] F. Cincotti, D. Mattia, F. Aloise,S. Bufalari,G. Schalk, G. Oriolo,A. Cherubini, M. Grazia, F. Babiloni. “Non-invasive brain–computer interface system: Towards its application as assis- tive technology”, Brain Research Bulletin 75 (2008) 796–803. http://dx.doi.org/10.1016/j.brainresbull.2008.01.007 [8] IEEE Standard for Information Technology. Part 802.15.4: Wire- less medium access control (MAC) and physical layer (PHY) specifications for low-rate wireless personal area net-works (LR- WPANs). 2003. [9] J. Albus, A. Lacaze, A. Meystel. “Autonomous Learning via Nested” Clustering. Proc. of the 34th IEEE Conference on Deci- sion and Control, 3:3034-3039, September 1995. [10] J. Albus, A. Lacaze, A. Meystel. “Behavior Generation in Intelli- gent System” - Departament of Electrical & Computer Engeneer- ing - Philadelphia - 1997 - pp. 2 - 25. [11] J. Albus, A. Meystel. “A reference model arquitecture for design and implementation of intelligent control in large and complex systems” - International Journal of Intelligent Control and System - Vol. 1 - No 1 - 1996 - pp. 15 - 30. [12] J. Albus. “Outline for a Theory of Intelligence” - IEEE Transac- tions on System, Man, Cybernetics - Vol 21 - No.3 - May/June 1991 - pp. 473 - 481. [13] J. Albus. “The NIST Real-time Control System (RCS): an ap- proach to intelligent system research”, J. Expt. Theor. Artif. Intell - 1997 - pp.157 -162. [14] J. Haynes. “Theory and Analysis of Large-Scale Brain Signals”. Bernstein Center for Computational Neuroscience. Berlin, De- cember 2009. [15] J. Uexkül. “An Introduction to Umwelt” - 2001. [16] J. Wolpaw, D. McFarland. “Control of a two-dimensional move- ment signal by a noninvasive brain–computer interface in hu- mans”, Proc. Natl. Acad. Sci. U.S.A. 51 (2004) 17849–17854. http://dx.doi.org/10.1073/pnas.0403504101 [17] J. Wolpaw, N. Birbaumer, W. Heetderks, D. McFarland, H. Peckham, G. Schalk, E. Donchin, L. Quatrano, C. Robinson, T. Vaughan. “Brain–computer interface technology: a review of the first international meeting”, IEEE Trans. Rehabil. Eng. 8 (2000) 161–163. http://dx.doi.org/10.1109/TRE.2000.847807 [18] M. Heidegger. “Sein und Zeit” - Translated as “Being and Time” by John Macquarrie and Edward Robinson (Oxford: Basil Black- well, 1978). [19] M. Ron; N. Clif. Evolution of the PDSA Cycle. Deming Elec- tronic Network Web Site, December 2009. [20] Open Handset Alliance. Android Documentation. Technical re- port, OHA, 2010. http://www.android.com/. [21] P. Miguel. “ECOLIG – The Semiotic Protocol for Human- Machine Communication that uses Brain-Computer Interfaces”. Thesys of Doctorade. School of Electrical and Computer Engi- neering State University of Campinas – UNICAMP. Campinas, Brazil. [22] P. Miguel, G. Barreto. “The Core of a Semiotic Laboratory”. AACE – Association for the Advancement of Computing in Edu- cation. E-Learn 2008, World Conference on E-Learning in Corpo- rate,Government, Healthcare and Higher Education, Las Vegas - Nevada - USA, Novembro 2008. [23] P. Miguel, S. Ismail, G. Barreto. “Ecolig – an E-Learning Proto- col”. IEEE Multidiciplinary Engineering Eduaction Magazine, Vol.4,No.4, December, 2009. AUTHORS Samira M. Ismail is a Network Manager with UNICAMP and MSc. Student at School of Electrical and Computer Engineering State University of Campinas. She has Bachelor in Computer Science with UNICAMP. She was Development and Network Project Manager with Itautec, EMBRAPA and CTI-CNPQ. Paulo V. O. Miguel is a Professor with UNICAMP and developes projects at Control and Intelligent Systems Lab - LCSI - School of Electrical and Computer Engineering - at State University of Campinas. At the Academy he got PhD and Master degree in Electrical Engineering with UNICAMP - State University of Campinas, as well as Bachelor degree in Computer Science with the same uni- versity. At the Industry he used to be a Development and Project Manager with IBM, Itautec, Solectron and Giant Technologies. Gilmar Barreto was born on May 26, 1958. He re- ceived M.S. degree in electrical engineering by work in electrical vehicles, from Campinas University , UNICAMP, in 1986 and Ph.D. degree in electrical engi- neering by work in theoretical foundations in analysis, development and implementation of algorithms for state space modeling of time series and dynamic systems data, in 2002, from the School of Electrical and Computer En- gineering (FEEC-UNICAMP). He has worked in several areas including state space computational data modeling, multivariable systems modeling and the control of multi- variable systems, system identification, estimation theory and electrical machines. Today is ahead of the Department of Machines, Devices and Intelligent Systems of the School of Electrical and Computer Engineering (DMCSI- FEEC-UNICAMP). This article is an extended version from a paper presented at the In- ternational Conference IEEE EDUCON2011, held at Princess Sumaya University for Technology in Amman, Jordan, 04-06 April 2011. Re- ceived June 8th, 2011. Published as resubmitted by the authors September 27th, 2011. 16 http://www.i-jim.org http://developer.android.com/sdk/eclipse-adt.html http://dx.doi.org/10.1016/j.brainresbull.2008.01.007 http://dx.doi.org/10.1073/pnas.0403504101 http://dx.doi.org/10.1109/TRE.2000.847807 http://www.android.com/ Miguel_iJIM_1648-5783-1-CE_edited_ssr.pdf I. Introduction II. A Semiotic Protocol III. Training Section IV. Navigation Case V. The Case of Semiotic Signs VI. Conclusions References Authors Mileva_iJIM_1692-5786-1-CE_edited_ssr.pdf Nguyen_iJIM_1789-6220-1-CE_edited_ssr.pdf Redd_iJIM_1683-5787-1-CE_edited_ssr.pdf Khraisat_iJIM_1781-6094-1-CE_edited_ssr.pdf Lee_iJIM_1823-6253-1-CE_edited_ssr.pdf