Layout Desember 2008 414 Web Usability of Public Organization Websites: The Case of Indonesian Ministry Websites http://dx.doi.org/10.18196/jgp.2012.0022 Ali Rokhman Director, Public Administration, Jenderal Soedirman University, Indonesia. Email: Darmanto Sahat Satyawan Public Administration, Jenderal Soedirman University, Indonesia ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ABSTRACT As a consequence of the development of Information and Communication Technologies (ICT), nowadays almost all governments around the world, included Indonesian govern- ment have official websites to provide information and services for their citizen. In the second period of President Susilo Bambang Yudhoyono administration has thirty two min- istries and each ministries have an official website. However implementation of the ministry websites have not been measured yet on usability aspect. The objective of this research is to examine the usability of ministry websites of Indonesian Government. Eleven websites was taken as sample in this study. Respondents are 128 Internet users who have compe- tency for assessing web usability. Usability of websites were measured by several indicators were adapted from E-Government Toolkit for Developing Countries that was prepared by the National Informatics Centre and UNESCO. The main indicators consist of navigation architecture, layout design, and content. Keywords: Government website, Indonesian government, web usability, public organiza- tion ABSTRAK Sebagai konsekuensi dari perkembangan Teknologi Informasi dan Komunikasi (TIK), saat ini hampir semua pemerintah di seluruh dunia, termasuk Pemerintah Indonesia memiliki 415 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ website resmi untuk memberikan informasi dan pelayanan bagi warga negara mereka. Pada periode kedua Pemerintahan Presiden Susilo Bambang Yudhoyono secara adminis- tratif memiliki tiga puluh dua kementerian dan masing-masing kementerian memiliki website resmi. Namun pada implementasinya website kementerian ini belum diukur secara pasti aspek kegunaannya. Tujuan dari penelitian ini adalah untuk menguji kegunaan dari situs kementerian Pemerintah Indonesia. Sebelas website diambil sebagai sampel dalam penelitian ini. Responden adalah 128 pengguna internet yang memiliki kompetensi untuk menilai kegunaan web. Kegunaan website ini diukur dengan beberapa indikator yang diadaptasi dari E-Government Toolkit untuk Negara Berkembang yang disiapkan oleh National Centre Informatika dan UNESCO. Indikator utama terdiri dari navigasi arsitektur, desain tata letak, dan konten. Kata kunci: Pemerintah website, pemerintah Indonesia, kegunaan web organisasi, masyarakat INTRODUCTION Recently creating a website is relatively easy and some instant tech- nologies and tools are available in the market. Main purpose of an orga- nization when develop a website t is to attract users in order to visit and take many benefits from their websites. But in fact, many websites are developed less attention to this issue. Website developers tend to empha- size on the technology and ignored the needs of their users. As a result, website developments are unsuccessful to get visitors and the website is not be used by target users. Some research on web usability in the various aspects have been car- ried out by many experts, both in web usability level measurements and concerning how to develop a measurement of the web usability (Chou and Chou 2010); (Al-Radaideh, Abu-Shanab and Hama 2011); (Nivala, Brewster and Sarjakoski 2008); (Lobo, et al. 2011). However these re- searches are still far to explore about usability of public organization’s websites. Web usability for public organizations is very important be- cause the main orientation of public organizations is public services, and in this digital era public service are not limited to the brick and mortal or traditional model, but have been transforming to public service digital models through a website of which was called as e-government. This pa- per reported on study of web usability from the Indonesian government ministries. This study is very important because there had been no stud- ies on this subject so there were no explanation regarding web usability of their websites but in fact all of the ministries in Indonesia has been Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022 416 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ providing web-based services. This research is just the beginning of the study and can be proceed to further study with wider scope not only at the ministerial level but also for various levels of public organization from the central government to the local government and its units. There are many perspectives concerning definition of web usability. In the recent decade an expert who very concern on web usability is Jakob Nielson. According to Nielson usability is a quality attribute that assesses how easy user interfaces are to use. The word “usability” also refers to methods for improving ease-of-use during the design process. On the web, usability is a necessary condition for survival. If a website is difficult to use, people leave. If the homepage fails to clearly state what a company offers and what users can do on the site, people leave. If users get lost on a website, they leave. If a website’s information is hard to read or doesn’t answer users’ key questions, they leave. Note a pattern here? There’s no such thing as a user reading a website manual or otherwise spending much time trying to figure out an interface. There are plenty of other websites available; leaving is the first line of defence when users encounter a difficulty (Nielson 2012). Web usability also can be defined as the ease with which visitors are able to use a website. Website usability is not just about making sure everything on the site works, but how quickly and easily visitors are able to make use of the site. Usability is a concern for marketers because of its potential impact, positive or negative, on marketing metrics such as con- version rates, which in turn affect profitability (Marketing Terms 2012). Usability is the process of making a website easy for customers to use. It encompasses the heuristics of the site as well as the methods that people use to manipulate the site. A website is considered usable if the custom- ers coming to that site can find what they need and accomplish their goals (About.com 2012). Chittenden, another expert of web usability suggested that web us- ability is the degree to which your website is usable and useful to visitors. Your website is the front door and reception room of your business. Increasingly, it is the first place prospective customers look before decid- ing to do business with you. And you know about first impressions. All things being equal, managers that actively engage with their sites will en- Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022 417 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ gage more customers (Chittenden and Wright 2012). In another perspective web site usability is the quality of a user’s inter- action with a web site or, in other words, how usable a web site is to the user. Ultimately, users want to be able to easily access a web site and determine how to use it within seconds. Usability influences whether many users will return to a web site, how often they will use the web site, and how happy they are with their overall experience at the web site. There are millions of sites on the Internet and they are all in competition for users’ time and attention. Users get their expectations for usability from the best of all of these other sites (Tuscaloosa City School 2002). Web usability has some attributes. This attributes very important for measuring the degree of usability of a website. The following table showed attribute of web usability of which have developed by some researcher. TABEL 1 ATTRIBUTES OF WEB USABILITY Source: Adopted from (Dubey 2010) This study used three attributes from Unesco due to Indonesia is a developing country. Unesco has developed web usability attributes based on their research in developing countries. Originally the attributes from Unesco consist of five attributes but this study did not used accessibility and reliability attributes. Accessibility refers to the extent to which the portal and its contents are available to a wide range of users with varied levels of physical capabilities/skills and technologies. This attributes was eliminated from this study since this study has homogen respondent, there are no far differences in skill and capability. Reliability refers to the extent of trust, which a citizen can impose on the government website Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022 418 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ with respect to security and legal requirements. Government web sites must raise citizens’ confidence by abiding by the law and explaining their terms and conditions clearly to the users. Reliability attribute also was eliminated in this research because this attribute can be measured in con- tent attribute. RESEARCH METHODS This study was conducted by descriptive quantitive study. Respon- dents in this study were 123 students of Public Administration Science Department, Jenderal Soedirman who participated in a lecture on man- agement information system. Data collected during lecture period in odd semester academic year 2011/2012, September 2011 until January 2012. These students were competent to assess the ministry sites in Indonesia because the lecture has topic regarding web usability and before they fill in the questionnaire there was a special briefing to explain how to asses web usability level of a website. In the second period of the President Yudhoyono administration has thirsty two (32) ministries and each ministries have an official website. From thirsty two websites, this study has taken eleven websites (35%) as sample of which were taken by random technique. Sample of the study consist of (1) the National Development Planning Agency, (2) Women Empowerment and Child Protection (3) Ministry of Manpower and Transmigration, (4) Home Affairs, (5) Education and Culture, (6) For- estry (7) Justice and Human Rights, (8) Tourism and Creative Economy, (9) Youth and Sports Affairs, (10) Industry, (11) Research and Technol- ogy. This study consisted of three variables (attributes) namely navigation architecture, layout design, and content. Data analyzed by descriptive statistical techniques such as frequency distribution and mean. Output of the data analyzing will be exposed by table and diagram. Description and indicator of all variables can be explained in the following table. Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022 419 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ TABLE 2. DESCRIPTION AND INDICATOR OF THE VARIABLE RESULT AND ANALYSIS Based on data collection and then were analyzed by descriptive analy- sis techniques, web usability of eleven ministries can be shown in a figure below. FIGURE 1. FREQUENCY DISTRIBUTION OF WEB USABILITY This study found that all ministries have good level on web usability. They have more than 60 %. The diagram above showed the Ministry of Tourism and Creative Economy has the highest web usability level (91%) followed by the Ministry of Home Affairs (90%) and The National De- velopment Planning Agency (86%). Otherwise the Ministry of Industry has the lowest level of web usability (64%) followed by the Ministry of Women Empowerment and Child Protection. Average or mean of web usability for all ministries are 79.45%. Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022 420 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ FIGURE 2. FREQUENCY DISTRIBUTION OF WEB USABILITY VARIABLES Figure above showed this study used three variables of web usability namely navigation architecture, layout design and content. The best at- tribute is content (85%) and followed by layout design 78% and naviga- tion architecture 77%. This finding indicated that respondents more sat- isfy on the web content than layout design and navigation architecture. This findings consistent with (Chi, et al. 2003) who stated according to usability experts, the top user issue for websites is difficult navigation. As for more detail about frequency distribution for eleven ministries which be explained in each variables can be found in the following table. TABLE 3. FREQUENCY DISTRIBUTION OF WEB USABILITY FOR EACH MINISTRIES Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022 421 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ Based on the finding of this study, content of website is the first rank of web usability and followed by layout design then navigation architec- ture. This finding indicated that website development of the Indonesian Ministries is on the right track. Response of majority of the respondent that described by frequency distribution analysis showed all of web us- ability variables have more than 77 percent. This findings was consistent with previous research in similar area also consistent with relevant theories that found the most important aspect or critical factor in a website development is website content. Other pre- vious researches also found that navigation architecture still as top user issue in web usability. User still difficult to navigate a website. Several researches reported that content is the most critical element of a website and more important than navigation, visual design, functionality, and interactivity (Badre 2002); (Nielsen and Tahir 2002); (Spyridakis 2000); (Rosmaini, et al. 2009). This study can be used as a comparison from previous research of which conducted by Rokhman (2008) that responsiveness level from government website administrator was very low, indicated by only a few of website administrator who have good responded when their users send question or requirements. This result differences can be explained by development e-government level where Indonesian e-government still in the beginning level namely publish level while in this level do not neces- sary to interactive with the user. CONCLUSION This study found some significant findings that Indonesian public organization website have good level on web usability. However this study is only preliminary study and need to be continued in wider scope and more big number of heterogenic respondent. Attribute that will be used in the next study consider to be more complete. Level of public organiza- tion website also need to be extend not only for central government but toward the lowest level of public organization units, therefore result of the study can be used by the government especially when they develop and manage their website. Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022 422 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ REFERENCES About.com. 2012. http://webdesign.about.com/od/usability/g/ usability.htm accessed March 29. Al-Radaideh, Qasem A., Emad Abu-Shanab, and Shaima Hama. 2011. “Usability Evaluation of Online News Websites: A User Perspective Approach.” International Journal of Human and Social Sciences 6, No. 2. Arms, William. 2000. Digital libraries. Cambridge, Massachusetts: USA, MIT Press,. Badre, A.N. 2002. Shaping Web Usability: Interaction Design in Con- text. Boston: MA: Addison Wesley Professional,. Bass, L, and B.E John. 2003. “Linking usability to software architecture patterns through general scenarios.” Journal of Systems and and Soft- ware 66, No. 3. Brinck, T, D Gergle, and S.D Wood. 2002. Designing Web sites that work: Usability for the Web. San Francisco: Morgan Kaufmann. Campbell, K, and R Aucoin. 2003. “Value-based design of learning por- tals as new academic spaces.” In Designing Portals: Opportunities and Challenges, by A Jafari and M Sheehan, 162–185. Hershey: IRM Press. Capple, James. J, and Zhenyu Huang. 2007. “A Usability Analysis of Company Websites.” Journal of Computer Information Systems Fall. Chi, Ed H, et al. 2003. “The Bloodhound Project: Automating Discov- ery of Web Usability Issues using the InfoScent™ Simulator.” Chi Letters 5, No. 1 April. Chittenden, Harry, and Michael Wright. 2012. Chittenden Communica- tions.. http://chittendencommunications.com/category/internet- marketing-glossary/usability accessed April 11. Donyaee, M, and A Seffah. 2001. “QUIM: An Integrated Model for Specifying and Measuring Quality in Use.” Eighth IFIP Conference on. Tokyo. Dubey, Sanjay Kumar. 2010. “Analytical Roadmap to Usability Defini- tions and Decompositions.” International Journal of Engineering Sci- ence and Technology 2, No. 9. Lobo, Desmond, , Kerem Kaskaloglu, Cha Young Kim, and Sandra Herbert. 2011. “Web Usability Guidelines For Smartphones: A Syn- Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022 423 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ergic Approach.” International Journal of Information and Electron- ics Engineering 1, No. 1 July. Lucey, Terry. 2012. Management Information Systems. 8. London: Con- tinuum,. Marketing Terms. http://www.marketingterms.com/dictionar y/ web_site_usability accessed April 5. Nielsen, J, and M Tahir. 2002. Homepage Usability: 50 Sites Deconstructed. Indianapolis: IN: New Riders Publishing. Nielson, Jakob. 2012. Usability 101: Introduction to Usability. http:// www.useit.com/ alertbox/20030825.html accessed April . Nivala, Annu-Maria, Stephen Brewster, and L. Tiina Sarjakoski. 2008. “Usability Evaluation of Web Mapping Sites.” The Cartographic Jour- nal (The British Cartographic Society) 45, No. 2. Oulanov, A, and F.Y.P Edmund. 2002. “CUNY+ Web: Usability study of the Web-based GUI version of the bibliographic database of the City University of New York (CUNY).” The Electronic Library 20, No. 6. Rokhman, Ali. 2008. “Customer Service of Government through E- Government.” The 2nd of National Conference of Faculty of Eco- nomics Widya Manadala Catholic University . Surabaya. Rosmaini, Siti, Mohd Ariff, Muhd Kamil, and Dawson R Hancock. 2009. “Business Reporting on the Internet: Development of a Disclosure Quality Index.” International Journal of Business and Economics 8, No. 1. Sauro, J, and J.R Lewis. 2009. “Correlations among Prototypical Usabil- ity Metrics: Evidence for the Construct of Usability.” Human Factors in Computing Systems. Boston. Shneiderman, Ben. 2003. Research-Based Web Design & Usability Guide- lines. Washington DC: the U.S. Department of Health and Human Services (HHS) and the U.S. General Service Administration (GSA). Spyridakis, J.H. 2000. “Guidelines for authoring comprehensible web pages and evaluating their success. Technical Communication.” Tech- nical Communication 47, No. 3. Tuscaloosa City School. 2012. Online Technology Learning Center. http:/ Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022 424 Journal of Government and Politics Vol.3 No.2 August 2012 ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ ○ /www.online.tusc.k12.al.us/tutorials/webuse/webuse.htm#webuse accessed April 1. UNESCO. 2005. E-Government Toolkit for Developing Countries. New Delhi: UNESCO Asia Pacific Regional Buareu For Coomunication and Information, and National Informatics Centre Department of Information Technology Ministry of Communication & IT Govern- ment of India. Web Usability Of Public Organization Websites: The Case of Indonesian Ministry Websites / ALI ROKHMAN, DARMANTO SATYAWAN / http://dx.doi.org/10.18196/jgp.2012.0022