Creating virtual communities of practice for learning technology in higher education: issues, challenges and experiences Jacqueline A. Dempster,* Helen Beetham,** Peter Jackson* and Steven Richardson*** *University of Warwick, **University of Bristol, ***University of Manchester email: jay.dempster@warwick.ac.uk The need for a Web portal to support the rapidly growing field of learning technology has been well established through a number of national surveys and scoping studies over recent years. The overarching vision has been the provision of a virtual environment to assist in informing and developing professional practice in the use of learning technologies. This paper outlines the issues and challenges in creating such a portal through the experiences of developing the RESULTs Network. In the paper, design and participation issues are considered within the wider context of online and networked approaches to supporting practice and professional development. User participation methodologies and technical developments for RESULTs are described in relation to a review of existing representations of practice and a comprehensive survey amongst the learning technology users' community. An outline of key achievements and experiences is presented, followed by some conclusions regarding the cultural and political issues in creating a viable and sustainable facility and suggestions for possible future direction in national provision. Introduction Most higher education institutions have taken seriously the recommendations in the Dearing Report concerning greater use of technology for learning and teaching (National Committee of Inquiry into Higher Education (NCIHE), 1997). Each year, more teaching staff are making use of Information and Communication Technology (ICT) tools and environments with their students, or integrating digital resources into their courses. It is increasingly evident (Armitage, Rothery and Jenkins, 1999; Beetham, 2000; Beetham, Jones and Gornall, 2001) that nearly all universities and colleges now provide some form of specific support for learning technology, indicated in the number of new posts and support units created for this area. The result is a rapidly growing group of multi-skilled 103 Jacqueline A. Dempster et al Creating virtual communities of practice for learning technology in higher education professionals, employed both within institutions and/or nationally funded learning technology programmes and services, which have been such a key feature of the United Kingdom experience. As well as 'learning technologists', other categories of staff, such as librarians and IT developers, teaching support staff, educational developers and institutional managers, are developing new capabilities and understanding in learning technology (Gornall, 1999; Gibbs, 2000; Beetham et al., 2001). Many such staff also have responsibility for brokerage of information and networking (Oliver, 2002). It is notable that in a growing number of institutions and in national programmes, a major theme appears to be to capture lessons learned on the use of ICT and, in particular, to improve the dissemination and transfer of good practice. The abundance of new academic conferences and journals for learning technology is testimony to the high value placed on communication with others working in the field. However, learning technology roles and practices are diverse and poorly differentiated from one another and both the professional practice and the academic field of knowledge remain emergent (Conole, 2003). Supporting a learning technology community of practice A wide range of strategies is being used to support learning technology practice, including national support agencies, institutional initiatives and via professional development programmes (see review by Lally and McConnell, undated). There remains a feeling, however, that learning technology support staff, and the academics they work with, do not • have easy online access to high-quality information and resources which, thanks to the JISC and other initiatives, are now available. A number of national studies (notably TALiSMAN, 1999; Armitage et al., 1999; Gibbs, 2000) have identified significant gaps in provision of resources to assist staff involved with promoting and supporting the use of ICT in teaching and learning. Access to information and resources is felt to be patchy and finding materials is serendipitous and time-consuming. Those working in the field of learning technology benefit enormously from collaboration and exchange of expertise with colleagues in similar roles in other institutions. It was therefore believed that the creation of a national portal to facilitate sharing and discussion of materials and methods used in learning technology practice would be beneficial. This requires interoperability across the relevant professional and subject networks, but this takes several forms - technical, semantic, cultural, educational and political, and any portal developed would need to address this. While this paper focuses on users of learning technologies, most of the factors, debates and outcomes overlap with other disciplines and are equally applicable to any educational portal supporting diverse communities of practice. Creating an online resource exchange and support network The RESULTS Network project was devised by Jay Dempster and Clive Young under the JlSC-funded 5/99 programme to provide a learning technology portal for United Kingdom higher education. The portal aimed to offer a focus for professional exchange and discussion and to fill the gap in information, resources and communication identified by 104 ALT-] Volume \ I Number 3 the sector. RESULTs is the portal (www.resiilts.ac.iik) and the RESULTS Network its wider community of users. Providing a portal service that will support and help transform practice must be subject to an understanding and appreciation of the variety of identities and roles that practitioners take on, and the ways in which professional learning and teaching practice is changing. The research underpinning much of the theoretical and overview materials was commissioned early on and carried out by Beetham. Many of the key foundations of RESULTS stems from the findings of this user needs study (Beetham, 2001a) which included a literature review, an online survey, structured interviews and focus groups. The research instruments, survey methodology and study findings are described in detail in the full report (Beetham, 2001a). The study set out to identify the potential users of a learning technology portal, the nature of their practice, and the kinds of resource and service that can support them in developing their practice effectively. Factors motivating participation were explored in depth. The research findings strongly indicated that the users wanted a community-orientated approach to contribution and annotation of resources. RESULTs was built on the vision of a rich information environment for user-defined resource submission, access and dis- covery coupled with facilities that encourage exchange and networking amongst communities of learning technology practice. The project overall was led by Jay Dempster, and essentially has meant the development of a database-driven Web architecture, undertaken by Steven Richardson using specifications identified from the user participation studies and drawn up by Peter Jackson. The RESULTs portal enables users to link to, categorize (and interlink) resources on the Web, directly integrated with discussion areas, as well as providing personalization features and user profiling. No such facility previously existed in any single and coherent sense. The portal aimed to tackle the multidisciplinary nature of learning technology. It enables and encourages cross-fertilization across diverse categories of users in the sector and supports a community approach to categorization and, as such, organic development of a consensus- driven taxonomy for learning technology. Representations of practice for a virtual community The theoretical and methodological touchstones for the user needs study and in turn for the RESULTs Network development arise from a number of existing educational frameworks for developing virtual communities of practice (Beetham, 2002). Lave and Wenger (1991) are the authors most closely identified with the idea of 'community of practice', which they describe as 'a set of relationships among persons, activity and world, over time, and in relation with other tangential and overlapping communities of practice'. It is evident from experiences of knowledge modelling (Stefik, 1995) that procedural and tacit knowledge of practice and expertise can be difficult to capture and are strongly biased towards subject knowledge and traditional modes of pedagogical practice in particular disciplines. The ASTER project, for example, has found that terms such as 'seminar' or 'tutorial' are open to interpretation and can relate to completely different sets of pedagogical practices in different subject areas (ASTER, 1999). 105 Jacqueline A. Dempster et al Creating virtual communities of practice for learning technology in higher education In analysing online professional development networks, Foster, Bowskill, Lally and McConnell (2000) found that they have several prerequisites: facilities for asynchronous discussion, shared information resources, tools (for collaboration itself, and to support aspects of off-line practice), and investment of time and resource, both from the 'centre' and from participants. Action learning (Beaty and McGill, 1995) is likely to be a factor in motivating participation in such networks, since all members will be novices in some aspects of learning technology work but experts in others, and all will benefit from peer support in dealing with the 'real problems' of their practice. The idea of organizing a professional network around specific shared activities brings in another series of possible models from the literature on computer-supported collaborative (or cooperative) work (CSCW: for example McConnell, 2000; Kollock and Smith, 2000; Baecker, 1992) and the investigation of groupware systems. CSCW is usually seen as involving two interlinked activities: peer-to-peer communication and the development of shared artefacts. The Virtual Learning Space (http://www.vls.scotcit.ac.uk), a Scottish universities service, has used frequent real-time chat sessions and access to subject experts as a successful drive for participation. Another example is the Virtual Teacher Centre (http:llvtc.ngfl.gov.uk), a professional practice community, which includes a Teacher Resource Exchange (http:llcontribitte.ngfl.gov.uk) designed to help teachers develop and share ideas for activities in the classroom. Finally, online professional development networks will have some features of an academic research community or subject portal as learning technologies become an object of academic study in their own right. Examples of good practice in United Kingdom higher education include SOSIG(http://www.sosig.ac.uk) and the Learning and Teaching Support Network (LTSN) Engineering portal (http://www.ltsneng.ac.uk). SOSIG offers a one-stop gateway to scholarly resources for students and academics in the social sciences. SOSIG uses 'Harvester' technology to automatically gather new resources from the Web, based on URLs from the existing SOSIG catalogue. The LTSN Engineering portal exists to enhance learning and teaching practice and is based not around content resources but orientated far more towards engagement with their end users. User engagement The RESULTS user needs study (Beetham, 2001a) suggested that on visiting the portal, academic teaching staff will have different needs from intermediaries such as educational developers, learning technologists, IT developers, librarians, managers, project staff or researchers. One way to view the needs of potential users is to identify questions that the various types of user are likely to ask. Three original areas of interest for developing RESULTs were addressed in the study. Key findings are presented here for each area. Developing artefacts for sharing practice knowledge Artefacts that are most effective in helping to transfer practice knowledge from one context to another were explored with a view to identifying resource types and availability of these within the community. The user study distinguished resources that informed practice from those that were most likely to be adopted in practice. The gap between encountering an idea and making practical use of it was smallest in the case of interactive resources, such as frameworks, 106 ALT-] Volume 11 Number 3 guidelines and tools (Beetham, 2001b). While academic staff preferred materials with an exact fit to their own needs, intermediaries wanted adaptable resources. In theory, many of the stated requirements could be met by materials currently used in practice, re-purposed for local support needs, such as guidance notes and workshops. This was precisely the approach taken by a ScotCIT project, SeSDL {http:llwww.sesdl.scotcit.ac.uk), in developing a Web-based resource centre to encourage sharing and reuse of staff development materials. In this case, it might be argued that the most effective materials are those that are most readily adaptable and usable by other staff and educational developers, rather than those which are most directly accessible for academics (Beetham, 2001b). In reality, the difficulties in terms of user participation are with regard to metadata description and the conflict of interest between user needs for rich descriptions and provider requirements, including expertise and the time to create informative metadata. Developing forums for discussion Forms of online dialogue that can support effective sharing of practice and the role and integration of local (offline) dialogue were explored. Learning technology specialists are required to undertake continuous learning as their area of expertise moves on. Normal practice could be described as 'peer supported experimentation'. Collaborative online communities of practice and virtual play spaces are seen as valuable opportunities to engage in this. Academic staff also needed dialogues, but favoured face-to-face relationships in their own context of practice. All those surveyed emphasized the value of examples and experiences from practice and opportunities for communication: discussion, reflection, networking and peer learning, from their desktop, and as needed. Networking is regarded as a high priority by all staff, though given the choice they prioritize contacts, events and discussion forums over access to materials and resources. Users emphasized the need for easy-to-use tools for engaging with the online community: finding, contributing and commenting on resources and for locating other people with relevant expertise. Good examples include the SOSIG 'grapevine' facility for contacting other people with similar interests and the Amazon intelligent search results with links to reviews. Users valued push forms of information dispersal for current information providing it could be filtered for relevance. Developing networks and communities of practice It was important to identify the potential users of, and contributors to, the portal and their requirements and motivations to participate. Previous user needs analyses for the Resource Discovery Network (RDN) portals have been able to focus on a specific subject community, and its need for discipline- and content-based resources in relation to a relatively well-established set of academic practices - teaching and learning. Learning technology users were likely to be found from both this set and from those in a multitude of roles across discipline and institutional communities, engaged in poorly defined, yet often innovative, practices, and requiring support that is practice- rather than content-focused. There were debates over whether a potential RESULTS community was really a fairly small inner core of learning technology specialists, or the large periphery of casual and potential learning technology users, including academic staff and educational researchers. We explored how practitioners collaborate with one another offline and how active online participations can be encouraged and supported so that it is integrated and self-sustaining 107 Jacqueline A. Dempster et al Creating virtual communities of practice for learning technology in higher education within an overall professional development activity. The study revealed an apparent conflict between the problem-solving culture of much learning and teaching practice - the 'instant gratification' of a tip or trick discovered from the academic desktop, or the more considered solutions arrived at by collective brainstorming and the long-term habits of reflective practice and professional scholarship. A portal that focused only on this problem-solving culture would be doing little to raise the status and scholarship of teaching. Those surveyed felt that a national service to support communities of practice in learning technology might best focus on direct, personal participation by its core community, but work towards indirect participation (for example, via LTSN subject portals or institutional VLEs) by a much broader community of users. It is likely that many users will continue to seek peer exchange, services and benefits through offline networks, and many people are likely to turn to online support only when avenues of face-to-face help have been unproductive. The survey identified a desire for national updates via a briefing service, calendar of events, news service and integration of face-to-face workshops. A directory of expertise and various types of discussion areas were also specified. Development of the RESULTS network Bringing together the above elements was a key aim of RESULTS. Three main structural lists were identified for use in RESULTs: user types, resource types and interaction types (Beetham, 2001a, 2001b; but see also Goodyear and Steeples, 1998, and Oliver and Conole, 2001). Functionally, professional development networks might usefully be grouped into two broad areas: facilities for interaction with artefacts; facilities for interaction with individuals/groups; with a third hybrid area of facilities for developing or enriching artefacts (Mulholland, Domingue, Zdrahal and Hatala, 2000), which is in itself a form of indirect communication with others. For RESULTS, it was felt that these different facilities needed to be seamlessly integrated to support the full representations of practice identified. They also needed to be capable of evolution as users discover new ways of interacting with one another and with their shared resources. The RESULTs environment comprises three areas: 'MyRESULTs', 'Resources' and 'Communities'. Visually, these appear separate on the site (Figure 1) but are functionally integrated through associations between resources, users and practice. However, the distinction serves as a reminder that RESULTs is not concerned principally with resources but with resources that relate to practice. Resource metadata is kept to a minimum taking into account the conflict between the needs of contributors and users identified in the study area concerned with developing artefacts for sharing practice knowledge. The focus of description is on their use in practice. It is intended that resources are constantly com- mented upon, updated, contextualized, organically developed - in fact, resources should simply be contingent traces of the community process, rather than ends in themselves. The RESULTs portal is based on a LAMP (Linux, Apache, MySQL, PHP) architecture and demonstrates a wide range of user-orientated, practice-centred functionality and interoperable Web technologies (Richardson and Powell, 2003; Richardson, Childs and Dempster, in preparation; for more information, see the CETIS Website) and an integrated discussion board (Phomm) on which a narrative of RESULTs design and development can be found.) 108 ALT-] Volume 11 Number 3 ' 5 Result Home Page • Microsoft Internet EHplorcr piavidcd by the Uriivcnsil? DF Warwick Fie i : i : Vfe™ Hefc ::• : - ,-!.< » S-.,i i • 2 In nl S I-J >• • ^ H I in S l t i l - i l - Hi-l W*lco in « Jay D*m p »t« r i:l. • flil ui ii-lnli i n " l_i M ,ri,. M .L .C-i yf i i > . i l las \1VF £E1 , Ili "f*1 < Pi ulti: ^ . I L T ik. I l l I . I ••. . • _ , - . 3 Resources: .whc LI r-T ".-•'=• . B l C T U M R I..K fjt-nlt tllJI i-*ii r.n * :••-• o • I I I T '1 " '•'J d l 1 ! ' JK4, Conimuniti'.-'J C . p y r i j l i Ci200Q PESULTv S«l\i-w I tei In-nw* Figure I: The RESULTs welcome page (arrived at after registration or login) User features - the visual environment Resources and the category tree The category tree (Figure 2) forms only an initial taxonomy for learning technology (Browse by Topic), comprised of a 'Learning and Teaching' classification suggested by the ILTHE/LTSN (Sally Brown and Brenda Smith) and a 'Learning Technology' classification suggested by Beetham (2001a). A Guided Tour (Figure 1) provides a section of introductory materials, case studies and frameworks: written by expert practitioners for new practitioners, commissioned by national agencies or developed by research projects. RESULTs demonstrates the integration of a number of key areas of need identified in the research study (Beetham, 2001a). Figure 3 shows the relationship between user 109 Jacqueline A. Dempster etol Creating virtual communities of practice for learning technology in higher education 511 wne- P'-aqc- - Uicioscft ImtcmH ucplorerpiovided by t t e Uniw'ersitp ol W-sr j Fie Ed: Vt~ ' F;«ios "331 Via Learning and Teaching Technology Strategies Viii am linns Cdtvuui we; FiVrtVr; M o r i if 1 m-Tlt h l - y - r r f r t . r r f r v*re*i:ni j j - H r v * J Mirny l c < u i i I>:I ris-Hi: HI *iti n :• -rii if," il II nVA.iwii T.l vRA i :=•«• riictlNv ft pr^n-ft-—i r i frrvunvifF itTs^rtft^vJ 1" rt-1.-*!^ ?«•-(* Date: . PijttMtf ,,M»i.,i.l ?nt> IM ins Ancle IDtM>?-i^ nj !•:•» - i i:ii-, i.n 1 i n !'•• i f iii.i j : :i iTI 1: v Mris Attc*ii\r n1-irflTinJ T^rr"i*;rfi;rnjfrt-f ,tfi''J''.T| 11 bjj.<.ji:: -vj.