Article Information Authors: Harry Biggs1 Charles Breen2 Rob Slotow3 Stefanie Freitag1 Marc Hockings4 Affiliations: 1South African National Parks, Skukuza, South Africa 2Centre for Environment, Agriculture and Development, University of KwaZulu-Natal, South Africa 3School of Biological and Conservation Sciences, University of KwaZulu-Natal, South Africa 4School of Geography, Planning and Environmental Management, University of Queensland, Australia Correspondence to: Harry Biggs Email: biggs@sanparks.org Postal address: Private Bag X402, Skukuza 1350, South Africa Dates: Received: 10 May 2010 Accepted: 17 Dec. 2010 Published: 13 May 2011 How to cite this article: Biggs, H., Breen, C., Slotow, R., Freitag, S. & Hockings, M., 2011, ‘How assessment and reflection relate to more effective learning in adaptive management’, Koedoe 53(2), Art. #1001, 13 pages. doi:10.4102/koedoe.v53i2.1001 Copyright Notice: © 2011. The Authors. Licensee: OpenJournals Publishing. This work is licensed under the Creative Commons Attribution License. ISSN: 0075-6458 (print) ISSN: 2071-0791 (online) How assessment and reflection relate to more effective learning in adaptive management In This Essay... Open Access • Abstract • Introduction • Methods • Initial analysis of how adaptive management has been assessed and reflected upon • Moving towards improved learning • Assessment, reflection and the learning dualities • Discussion of the learning duality approach as applied to the case studies • Is the Kruger National Park good at learning in adaptive ecosystem management? • Conclusion • Acknowledgements • References Abstract (Back to top) Assessment (an immediate evaluation of significance or performance) and reflection (a lengthy, deep consideration) should be important components of adaptive management leading to learning. In this paper we use a prototype adaptive cycle and feedback framework, which are related to some aspects of learning theory, to examine the extent to which assessment and reflection were applied in a series of studies and initiatives in the Kruger National Park. In addition to evaluating assessment and reflection, we also considered how the various contributing components of each case were inter-related to provide a holistic view of each initiative. Two other studies in the Kruger National Park, which have examined learning specifically, are also discussed. One of them suggests that in a complex environment, learning necessarily has a dual nature, with each component of seven contrasting pairs of the aspects of learning in partial tension with the other. We use these dualities to further probe assessment, reflection, inter-relatedness and learning in the cases presented. Each contrasting aspect of a ‘learning duality’ turns out to emphasise either assessment or reflection, which reinforces the idea that both are needed to facilitate sufficient learning for successful adaptive management. We hope this analysis can act as a springboard for further study, practice and reflection on these important and often underrated components of adaptive management. Conservation implications: The better understanding of assessment and reflection as being largely separate but complementary actions will assist adaptive management practitioners to give explicit attention to both, and to relate them better to each other. Introduction (Back to top) South African National Parks (SANParks) formally adopted an adaptive management paradigm (Walters 1986) in the form of strategic adaptive management (SAM) (Roux & Foxcroft 2011) in the Kruger National Park (KNP) in the 1990s. The park has become widely known for this initiative, which has now also spread to other protected areas and other natural resource management situations (Freitag, Biggs & Breen, in review). It is therefore fitting to determine the extent to which adaptive management performance in the KNP has been assessed and/or reflected upon, and how this has contributed to further learning in a management context that typically embraces spatial and temporal variation and socioecological linkages. This paper examines whether adaptive management, designed for decision making in uncertain environments, is being implemented in a rote, mechanistic way or supported with effective assessment, reflection and learning. Evidence-based policy and decision making processes and the theory of learning are used in a wide range of fields (e.g. healthcare, see Gray [1997]). It is reasonable and more generic to see the adaptive management processes discussed in this paper as a particular (albeit more unpacked and iterative) form of the construct called the ‘policy cycle’, as exemplified by the well-cited Australian Policy Cycle (Bridgman & Davis 2004). Although the latter has been criticised for simplicity and linearity, broad parallels with several of the sequential steps of adaptive management emerge (Roux & Foxcroft 2011). It is likely that each has drawn on the other’s underlying thought processes and may continue to do so. From an examination of fundamental references on learning (e.g. Kolb 1984; Schön 1983) it is clear that such processes are linked to learning; indeed, individuals and organisations adapt (and therefore often survive or prosper) based on re-conceptualisation following reflective observation of past experiences. It is therefore appropriate that this paper frames learning as the central goal of assessment and reflection in adaptive management. After examining assessment and reflection specifically, we draw directly on other learning work (the interviews for which were conducted on KNP staff) to examine the relationship between six learning dualities (Roux, Murray & Van Wyk 2008) and assessment and reflection, respectively. Assessment generally means to ‘evaluate or estimate the nature, quality, ability, extent, or significance of’ whilst reflection is viewed as ‘a calm, lengthy, intent consideration’ (wordnetweb.princeton.edu/perl/webwn). Although the words ‘assessment’ and ‘reflection’ are sometimes used interchangeably in the conservation literature, we shall use the definitions as described above (recognising limited overlap), except when citing. In the context of adaptive management, assessment is commonly intuitively thought to lead to reflection. Such reflective behaviour should specifically be carried out in the full context of the system under consideration, observing and modifying its own attributes and behaviour, with a view to learn for future action. An organisation that practices such reflective behaviour can be considered an adaptive learning organisation (Garvin 1993) in which creating opportunities for reflection through a process of consistent and structured review of past performance can be a critical factor. Argouridas and Race (2007) have argued for the importance of evidence-based reflection in learning and knowledge management within higher education. However, too narrow a focus on (often limited) evidence may also hide the controlling influence of context. Such reflective aspects are widely underemphasised, often as a result of an incentive to progress with implementation and so be seen as ‘doing something’ (Allan & Curtis 2005) or because the organisational culture does not promote learning and adaptation (Fazey & Schultz 2009). It is therefore important to consider the prominence given to reflection in the broader learning literature (Schön 1983). Literature regarding effective management of protected areas describe assessment and evaluation cues in a sequential, iterative and adaptive process at different points in the management life cycle (Figure 1), which is itself a version of an adaptive cycle (described as the adaptive review cycle of SAM by Rogers [2005]). Hockings, Stolton and Dudley (2004) emphasise the need to assess and evaluate continuously during the cycle, rather than only after the outcomes step (Figure 1). We specifically avoid the term ‘evaluation’ onwards, except where explicitly used by others (e.g. Hockings et al. 2004). We regard ‘evaluation’ to be closer in meaning to ‘assessment’, although it can include the important additional aspect of passing judgement, which suggests some reflection, according to our definition. Experience and learning provide improved understanding of the complexity and changing context, which, in turn, allows for refinement or revision of different steps in the cycle. By following all six evaluation cues (the straight solid arrows radiating from the centre) and considering them in relation to one another participants can view the overall process holistically, for example, as applies to park management (Hockings et al. 2009). Also, it is regarded to be diagnostically useful to ‘step back through the process’ so that each component can be considered with regard to its preceding input. If the actions represented by feedback arrows in Figure 1 are ignored, assessment and/or reflection will not occur in appropriate contexts, and hence opportunities for meaningful and holistic learning will be missed. If assessment and reflection are considered to be fundamentally distinct processes, lumping them together may lead to practitioners subsequently acting without one or the other consciously having taken place. This may lead to poorly considered action in a complex, changing setting such as management of a park or natural resources and negate learning opportunities or effectiveness. Another characteristic depiction of SAM is a series of well-defined nested feedbacks as shown in Figure 2a. (‘Nested’ means feedback is contained conceptually within another feedback, in a logical sequence.) Such nested feedbacks are usually shown most usefully as arising from the postoperationalisation learning opportunity of the cycle (i.e. once things on the ground start happening), but they could be drawn from any step in the cycle (as shown in Figure 2b). Indeed, the recommended diagnostic approach of sequentially stepping backward, as shown in Figure 1, can be considered nested. In the context of the process steps of SAM (Rogers 2005) there are several opportunities for ‘advance reflection’ or ‘stepping forward’ in the early forward planning components, specifically when predicting consequences of potential management options or the societal acceptability of these, before the specific management action is selected. Such nesting for attempted prediction or scenario planning occurs through a process of ‘thought experimentation’ (Figure 2b) or even explicit modelling (Starfield & Bleloch 1991). Figure 2 contains a key decision point (‘select options’) and although other decisions are taken at other points, this decision point gives rise to the most direct ‘action on the ground’. An analogous point can be inferred between ‘process’ and ‘outputs’ in Figure 1. A combination of Figures 1 and 2 hence clarifies opportunities to facilitate structured forms of both assessment and reflection. Nevertheless, we need not be bound by only these pathways, as additional unstructured assessment (i.e. without any obvious direct reference to particular heuristics depicted in Figures 1 and 2) and particularly unstructured reflection, may add further value. Checking that each nested step is being performed constitutes one way of verifying that adaptive management is indeed being practiced, or that it is at least procedurally sound. Yet the context in which different situations are assessed or reflected upon varies a great deal and usually changes over time, which makes iterations, including explicit reflection on the changing context itself, essential. Furthermore, the subcontexts (e.g. fire management, surface water source management, etc.) that constitute any particular context (e.g. the management of the park as a whole) change differentially and it is the aim of management actions to alter some of these subcontexts. As the context becomes more confined, management influence increases. However, as the context grows and becomes more related to governance, management influence usually decreases (Nkhata & Breen 2010). The appropriate scale(s) and/or organisational levels at which an assessment or reflection initiative should focus should thus be considered. Levels often correspond to the different levels of park objectives. As such, scale of selection may determine whether different contexts or subcontexts are appropriately and fairly assessed and reflected upon and, hence, whether these have been wisely chosen as a basis for thinking about management action. As one proceeds along the cycle in Figure 1 (from planning onwards), the scale of reflection usually increases in both space and time. There is a move from specific objectives, as defined through planning and implementation, to more general goals as the process approaches the scale of re-visioning. Accordingly, there is a move away from considering only some parts at particular scales towards a more holistic, integrated and systems-based consideration. If processes are institutionally embedded and aligned with the context, within an enabling organisational culture (see Growcock, Sutherland & Stathis 2009; Stirzaker, Roux & Biggs 2011), adaptive management can be improved. On the other hand, organisations typically have several procedures and approaches, many of which are not adaptive in nature (and are even designed not to be), and it can be challenging to dovetail these with adaptive assessment and reflection. In addition to the adaptive processes outlined earlier (and depicted graphically in Figures 1 and 2), this paragraph provides a brief history of adaptive management in KNP as a backdrop for understanding where assessment and reflection, as described in this paper, fit in. Mabunda, Pienaar and Verhoef (2003) described, before the advent of explicit adaptive management in KNP in the 1990s, a series of different management eras, each with a particular style. These eras set favourable precursor conditions (such as regular interaction between scientists and managers and joint responsibility) for explicit adaptive management to be accepted once the opportunity arose (see Biggs & Rogers 2003, Box 1). Freitag et al. (in review) describe how adaptive management practice, after expanding from the KNP Rivers Research Programme to the general management of the park, spread to influence other aspects of conservation management in South Africa during the first decade of this century. Examples include drafting guidelines for protected areas and catchment management and planning conservation initiatives, which co-evolved with evaluations of park effectiveness (Belokurov et al. 2009) and reporting of the state of biodiversity (Knight 2008), both of which had a culture of assessment. FIGURE 1: Framework for assessing effectiveness of management of protected areas (adapted from Hockings, M., Stolton, S. & Dudley, N., 2004, ‘Management effectiveness: assessing management of protected areas’, Journal of Environmental Policy and Planning 6(2), 157-174). FIGURE 2: Schematic representation of nested adaptive management feedback loops as (a) described by Pollard, S.R. & Du Toit, D.R., 2007, Guidelines for Strategic Adaptive Management. Experiences from managing the rivers of the Kruger National Park. Guidelines for management and field staff of protected areas, Ecosystems, Protected Areas and People (EPP) Project (UNEP GEF No. GF/27-13-03-4679), Regional Protected Areas Programme of IUCN–World Conservation Union in Asia; and (b) adapted from the same source. Methods (Back to top) We reviewed as many earlier initiatives that had focused on the operation or performance of adaptive management in the KNP as possible. These were mostly in qualitative or narrative form, although some had semiquantitative ‘scores’. Some of the initiatives were internal (part of the prescribed procedures in the adaptive management protocols), whilst others had been subjected to previous external review (as one would expect in an independent audit). However, this distinction actually translates to a continuum spanning ‘designed as internal’ to ‘initially mainly external’, because (1) feedbacks are intrinsic to adaptive management and contribute to defining a wider system boundary and (2) implementation of the initiatives often involved the same people who initially advised on the operation of the system, possibly owing to their existing knowledge. These initiatives were subjectively rated for their emphasis on assessment, reflection and inter-relatedness, independent of impression of the study quality (Table 1). Inter-relatedness pertains to the holistic approach of the initiative and considered how the different levels of adaptive feedbacks are related and considered jointly, given that they can be viewed as nested within one another. We regarded inter-relatedness to enhance assessment and reflection, thereby facilitating more effective learning. We scored the respective columns in Table 1 based on our impressions of the extent to which each initiative dealt with assessment, reflection and inter-relatedness. We did not consider the interpretations of how these aspects contributed to the study system, but simply whether the aspects could have been noticed and discussed. Cross-correlation results we report in Table 2 may therefore partly reflect differential study designs of the various initiatives. However, our interim conclusions of this initial analysis include conclusions based on actual findings of particular studies (as in a literature review), shown as numbered references in Table 1. Following this initial analysis, which serves as a potential bridge to the issue of learning, we describe two further studies that dealt explicitly with learning in the KNP in or close to the context of ecosystem management. One of these studies produced a set of dualities, which we thought could support our own exploration into assessment and reflection. The third leg of the method involved mapping examples of assessment and reflection in adaptive ecosystem management in the KNP onto these paired strategy options (Roux et al. 2008) or dualities (Table 3) and then exploring how assessment and reflection appeared to be related to each other and to learning, respectively (Table 4). The dualities are presented as sharply dichotomous (binary), whereas they can, in reality form more of a continuum in some of the cases (e.g. learning cf. unlearning). TABLE 1: Studies or initiatives that involved adaptive management in or around the Kruger National Park, rated for their degree of assessment, reflection and interrelatedness of the particular analysis. TABLE 2: Spearman’s rank correlations between ten ordered individual scores for assessment, reflection and inter-relatedness in Table 1. TABLE 3: The two facets of each learning duality as aligned with assessment and reflection. Each case is related to adaptive processes through pointing to phases in Figure 1 (context, planning, inputs, process, outputs, and outcomes) and process linkages in Figure 2. (The phrase ‘bottom loops’ refers to loops marked 1–3 and ‘upper loops’ to those marked 4–7 in Figure 2a). All themes used here are discussed in detail in one or more of the references given in Table 1. TABLE 4: The relationship between assessment and reflection for each paired case in Table 3, with comments on overall learning and the relationship to adaptive management. Initial analysis of how adaptive management has been assessed and reflected upon (Back to top) The KNP has explicitly attempted to implement strategic adaptive management, at least in the sphere of ecosystem management, for 15 years, and the methods and intentions have been documented in publications, reports and brochures (e.g. Biggs & Rogers 2003; IUCN Freshwater Task Force and Skukuza Group [in prep.]; Pollard & Du Toit 2005; SANParks 2008). This has attracted the attention of scholars and managers, with several initiatives or studies aimed at meaningfully looking directly or indirectly at this drive (Table 1). The studies and initiatives listed in Table 1 provide a useful idea of how well (1) the defined adaptive management processes, and/or (2) actual management outcomes (the ultimate goals of SAM) have performed. These are invariably presented in narrative form in the originals, although some do include semiquantitative scores. Our general summary after reviewing the findings of these studies follows below. Numbers in square brackets refer to the studies listed in Table 1 that most clearly support each point: • Adaptive planning has progressed and produced a more shared rationale (i.e. more overlap in underlying mental models) amongst most key stakeholder groups, seemingly greater than we can perceive prior to this from documented history (over 100 years). [3, 5, 6, 10] • Explicit objectives seem to be well accepted by relevant parties, which results in their commitment. However, prioritisation of objectives remains problematic (comparative risk assessment [Box 1, Gaylard & Ferreira 2011] is currently being tested for prioritisation). [1, 5, 7] • Explicit feedbacks now exist at various scales. For example, feedback from monitoring thresholds of potential concern (Biggs & Rogers 2003) are nested within park-wide state of biodiversity reports. [2, 8, 9] • Implementing adaptive processes took time but they are now fairly widespread (but not universally used) in the KNP. These processes spread from one theme (rivers) to several others within KNP, and then more widely to park planning and river management domains in South Africa. [4, 5, 6] • General implementation of adaptive management itself remains variable and somewhat messy, with some distinct ‘pockets of hope’ appearing between barriers that still need to be overcome. These impressions were gleaned from the more recent studies reviewed, which have had the benefit of longer hindsight than is probably the norm. The extent of progress is thought to relate to personal attitudes and institutional issues rather than lack of biophysical understanding. [5, 6, 8] • A better grasp of social-ecological interactions in these systems is still needed, including threshold behaviour. [5, 6, 8] • Social capital amongst actors and within networks and enthusiasm for action are critical underlying success factors. [6, 10] Table 1 also aimed to examine assessment, reflection and inter-relatedness within each initiative. Our generating scores across all the examples provides a subjective and relative idea of the amount of assessment, reflection and inter-relating in each. With ten pairs for comparison (8 d.f.), none of the correlations between columns proved significant (Table 2). The relationships are nevertheless informative, with deeper assessment and reflection apparently interfering with rather than potentiating each other; deeper reflection and inter-relation of feedbacks appear positively associated. Any possible significant cross-correlations which may arise with the use of greater sample sizes in future, may also reflect differential study design of the various initiatives. This could be considered equally informative, in the sense that the overall system of study and action is in some cases less geared to picking up on or producing, say, actual reflection. Moving towards improved learning (Back to top) Our fundamental premise is that assessment, reflection and their thorough inter-relation create a foundation of shared understanding (amongst all the relevant stakeholders associated with a national park) that directs and shapes deliberations and creates the basis for adaptive learning. How can we then assess whether this learning, in the context of adaptive management, takes place effectively? A learning organisation (Garvin 1993) is one skilled at creating, acquiring, and transferring knowledge and is able to modify its behaviour to reflect new knowledge and insights. Schön (1983) provides a theoretical understanding of learning and Michael (1995) specifically lists criteria to assess learning organisations, illustrated by questions such as whether (1) error is accepted, and fear of error is offset, in participating individuals, (2) group or social learning takes place, with facilitation rather than chairing of meetings, and (3) crises are leveraged as opportunities for learning. These kinds of question are mirrored by broadly similar ones for benchmarking adaptive management (Stankey, Clark & Bormann 2005), determining effective environmental administration (Paehlke & Torgerson 1990), assessing resilience and sustainability of socioecological systems (Walker & Salt 2006) and managing businesses sufficiently ‘mindfully’ to sense emergent signals and their meaning in a currently uncertain and complex world (Weick & Sutcliffe 2001). It would thus appear that these fields are all strongly influenced by the way learning is enabled in individuals and across organisations and by whether or not behaviours have been modified in response to growth in understanding as per the reflection stage of the experiential learning cycle (Kolb 1984). A recent consultation delivered to SANParks Scientific Services staff (Narrative Lab 2009) deals with factors enabling performance in the SANParks work environment, which staff consider to be complex and dynamic, after having worked through responses to questions of a similar genre to these above. Key recommendations, such as more regular use of probes (small, adaptive experiments, mainly in the organisational milieu), to help structure learning emerged. KNP staff were interviewed in two studies to probe their learning experiences after the inception of adaptive management. As part of an IUCN study, Pollard and Du Toit (2005, 2007) interviewed rangers whose sections included perennial rivers to establish their attitudes towards the adaptive management of rivers. The results showed good, but not universal, uptake of river objectives amongst participants and an understanding that their own inputs guided these objectives as part of a holistic vision (S. Pollard, pers. comm.). Rangers were aware of, and to an extent also participating in influencing, the changing context (e.g. cultural, legal, climatic and water use context). Long-serving participants regarded this as an improvement compared to previous such initiatives. There was fair buy-in for the overall goal to plan and manage actively for river-related objectives and the majority of interviewees appreciated that they had been involved actively. They understood their roles in the process and, moreover, that their behaviour had changed to include more concern for and action on river issues. Several mentioned other administrative systems as competing for valuable time when it came to executing the river objectives. The results of the study suggest that rangers participated in a nested way in assessments, were partly involved in reflection, and subsequently learnt in a meaningful way. Roux, Murray and Van Wyk (2009) interviewed eight SANParks scientists of KNP Scientific Services to examine the extent to which their department could be considered a learning organisation. Interviewees considered 11 learning principles derived from literature and regarded statements reflecting application of nine of these as being ‘largely true’. Scores reflecting organisational capability and information and data processing were far lower, suggesting caveats in understanding and/or implementation, perhaps relative to the growth in other learning areas which placed higher demands on these. With reference to the institutional model of Anderies, Janssen and Ostrom (2004), Roux et al. (2009:49) found that although the internal learning system (in this specific context referring mainly to within Scientific Services in the KNP) works fairly well, the greater encompassing learning systems (e.g. catchment management agencies) do not necessarily do so. Links from the subsystem to these bigger systems may also have been unclear: ‘Good knowledge workers [within KNP] must step outside of their usual domain to engage issues within the larger learning system and to deal with complexity and response scenarios across a range of organisations and scales’ (Roux et al. 2009:49). However, organisational context and ethics sometimes complicate moving beyond the usual domain and functioning effectively, even for those who are willing and keen to do so. This study targeted learning, and although reflection was explicitly probed and found to be taking place to some extent within the organisation, the report did not deal directly with assessment and inter-relatedness as discrete or traceable topics. Self-evaluation within the mentioned project suggested limitations of such mechanistic analyses. This led to a more nuanced articulation in which each action was seen as a paradox, of which facets of both components needed simultaneous consideration, similar to the seven paired strategy options described by Roux et al. (2008) and which we describe here as learning dualities. They include: • considering both prior knowledge and new evidence • practicing conceptual as well as practical learning • acquiring breadth and depth of knowledge • learning and unlearning • applying single-loop, double-loop and triple-loop learning • learning though patient reflection and rapid responses • focussing on individual and extended group learning. The maturity, purpose and operating realities of an organisation will cause the balance between these dual needs to change over time. Without this tension, it is unlikely that adaptive learning can take place effectively and, as such, adaptive management itself should be expected to lead to conscious or subconscious shifts in this balance. Assessment, reflection and the learning dualities (Back to top) Roux et al. (2008) found that these paired dualities, if discussed in depth amongst stakeholders to determine how effective they were at practicing adaptive learning, were extremely useful in eliciting improved understanding of the learning process. Using these dualities as a framework against which assessment and reflection (and the relationship between them) in the studies mentioned in Table 1 can be compared should help us to gain knowledge of what was learnt, and how this learning relates to adaptive management. We propose that the opposite endpoints of each duality appear to represent an emphasis towards either assessment or reflection (Table 3) as defined in this paper. We have intentionally selected examples (from sources in Table 1) to illustrate this from a wide range of themes. We use one theme for each duality so that assessment and reflection for the specific duality can be juxtaposed. Although assessment is commonly thought of as a precondition for reflection, we try to examine the relationship between the two critically in the narration in Table 4. We also comment on how the authors gauged overall learning to have proceeded and the inferred links to adaptive management. This helps cover the full organisational perspective of the cycles represented in Figures 1 and 2, including assessment, reflection and integration, and their influence on and from decision making. In this way we hope to illustrate whether, through decision making, learning leads to improved action, and action to further learning, as described by Kolb (1984). From Tables 3 and 4 it becomes clear that cycles of both assessment and reflection are asserted to have led to learning, albeit at different scales and paces and with varying time frames for decision making and management implementation. Effective adaptive management, however, does require a timely response to learning. This has not always been the case in the KNP examples, and assessment, reflection, and response times have often been decoupled. This led to reduced effectiveness, which is probably related to either lagged learning or lagged responses to learning. However, not all lags are undesirable; in fact, they can allow for adequate reflection (Cilliers 2006). Discussion of the learning duality approach as applied to the case studies (Back to top) The examples illustrating the learning dualities highlight circumstances which emphasised assessment or reflection, how they appeared to inter-relate, and allude to some obvious gaps (Tables 3 and 4). This strongly suggests that it is meaningful to distinguish between assessment and reflection, because they appear to have different roles and can lead to different outcomes and are apparently often decoupled. Inter-relatedness of feedbacks appears to augment and/or be the result of deeper reflection, although such evidence is limited at present. In addition, the intuitive impression that assessment precedes reflection seems not to be well supported by these narratives. We believe that in order to span the various needs of the complex challenges in natural resource management, both assessment and reflection are needed, perhaps concurrently. Intuitively, we seem to want them to be complementary or even synergistic, although our case material suggests they do not often tend to feature‘naturally’ in the same initiative. The relationship between them is often complex (Tables 3 and 4) and it may require explicit effort to create any such synergy or complementarity. It seems that assessment is often linked to acting on the answers that emerge, whilst reflection may generate more depth by asking more questions. The challenges we face may need both action and concurrent contemplation if we are to stay both responsive and resilient in future. Is it possible that reflection is meant more to consider our actions and interventions, whilst assessment is meant to trigger more immediate interventions? Assessment and reflection can be considered to constitute an overarching duality required for effective learning and, where they lead to decision making, also then for adaptive management. Kolb’s (1984) learning cycle refers to observations and reflections following from experiences, with reflections then being distilled into abstract concepts for re-testing in reality. He details different learning styles, of which a rework by Honey and Mumford (as cited in Businessballs [n.d.]), describes activists, reflectors, theorists and pragmatists. We suggest that assessment may be something carried out more by activists and pragmatists, whilst reflection is an activity more related to reflectors and theorists. Importantly, these four styles together constitute a full learning cycle of Kolb (1984), possibly implying that what we interpret as a duality between assessment and reflection could also (and perhaps better) be expressed as assessment and reflection complementing each other in a dovetailed way. This might also explain why we interpret the preliminary data (Table 2) as suggesting a disjunct between assessment and reflection. One likely explanation is that if they are not executed together in the right dovetailed way – that is, if there is an imbalance between them (as there often seems to be in our case studies) – learning is in some sense incomplete. We accept that under the circumstances that unfold in the situations we normally deal with there may be a need for later studies to try to re-align the correct balance between them, and hope that this paper may have contributed in this way. Conversely, we suggest that if one can design complementary use of assessment and reflection appropriately from the outset, learning may be more effective. As with the learning dualities, or in the same way that learning styles (Kolb 1984) are seen as mutually exclusive at one instant, there is a necessary tension between assessment and reflection (Roux et al. 2009). Presumably, shifts in emphasis between them over time are, or should be, adaptive. A generalised schematic of the inter-relationship of key elements of assessment and reflection, supported by our analysis, is presented in Figure 3. Whilst this represents the existing tensions, striving for an improved relationship should also include issues of scaling. With some exceptions, reflection conventionally tends to involve coarse-scale issues and assessment finer-scale issues, as seen in our examples. Challenging this ‘convention of scale’ by also reflecting at finer scales and assessing at coarser scales, and interlinking assessment and reflection across these scales, could lead to more useful feedbacks. If better understood and linked, a well-conceptualised and tailored combination of assessment and reflection (i.e. for the particular situation at a particular time) may support enhanced purposeful learning. Perhaps we have not made the differences between them sufficiently explicit to be able to exploit the opportunities of this fuller learning. This paper illustrates that they do not have a fixed, linear or unidirectional relationship. Even when used independently, but particularly when used together, they appear to underpin learning and, when they result in decision making, also adaptive management. Emphasis on one or the other leads to different types of learning (duality 5, Table 3) and evoke different adaptive management feedback loops (highlighting loops 1–3 and 5 for assessment, and loops 4, 6 and 7 for reflection; Figure 2a). So, there appears to be a need for both to complete the adaptive management cycle, similar to how different learning styles produce a full Kolb (1984) learning cycle. Our impression is that assessment tends to provide, broadly, the basis for the inputs through output stages, and reflection the basis for the outcome through inputs stages (Figure 1). This may be a consequence of managerial and scientific groups in the KNP being more involved in the implementation and planning phases, respectively, although older staff recall an era (of the so-called ‘House 31’ meetings and the first adaptively planned management plan in the late 1990s) when managers and scientists appeared to share assessment and reflection more equitably than after the staff restructuring of 2001. Our challenge appears to be, for each case, to couple assessment and reflection more productively by ensuring enough of each (there is often too little reflection) at scales appropriate to the case, and ensuring that they complement each other in the most useful way. The outcome stage (Figure 1) is a particularly critical step at which considerable reflection is possible. This leads to consequences for implementation, which may, through re-visioning, influence planning in the next iteration. Examples where the feedback loop is thought to have been completed, such as rivers and fire management in the KNP, share a key bridge that allows for learning from doing. Reflection at implementation and output stages, shown in elephant management and TPC examples, is also helpful but more to refine technical aspects of management. In addition, thought experiments (depicted in Figure 2b) and modelling can help identify and improve options and enhance the possibility of successfully learning from anticipated doing. In particular, thought experiments that involve both scientific and managerial stakeholders and include elements of both planning and implementation, may assist in coupling assessment and reflection at multiple stages and scales of the cycle. This should lead to more purposeful reflection and learning. Decoupling of operational and conceptual issues highlights a known tension in natural resource management. This is illustrated in the threatened species example (Tables 3 and 4), where specific knowledge and a lobby for a particular aspect, in this case an individual species, oppose the need to conceptualise ecological frameworks into new management paradigms, which in this case refers to management for overall ecosystem heterogeneity. Assessment at the level of managing an individual iconic species was translated into objectives that were not necessarily in line with the overall park vision. No persistent holistic reflection emanated from either the outcomes phase or the emerging changes in context such as climate change. The reflection that did take place, on the other hand, resulted in an abstract conceptualisation of heterogeneity, which was unacceptable or disconnected from on-the-ground-realities in that it appeared to undermine preservation goals for charasmatic species. The examples show that when multidisciplinary, multi-institutional teams come together to reflect in the outcomes stage (in the fire and rivers management programmes and also to some extent in the elephant and alien species invasion programmes) and fully connect the adaptive management cycle though decision making, both learning and adaptive management are deemed more successful. However, these should be accompanied by sufficient assessment. Such perceived success is partly lacking in the current relatively inert threatened species programme and the ‘stop-go’ artificial water provision programmes, although impressive individual initiatives may have contributed a great deal (e.g. SANParks 2010). Adaptive learning seems to have been deeper and easier when a clear and jointly agreed goal was set, without other conflicting goals, which enabled decision making and implementation. This has not been the case for the threatened species programme in the KNP. Neither was it the case for the artificial water provisioning programme until fairly recently, when a re-evaluation of context and principles (including acknowledged overriding importance of the heterogeneity paradigm and of climate change) led to consensus for implementation (SANParks 2010). FIGURE 3: General schematic of the existing relationships between learning, adaptive management, context specificity and the duality between assessment and reflection, as evident from analyses in this paper and learning theory in terms of the Honey and Mumford modification of the Kolb learning cycle concept (Businessballs n.d.). Is the Kruger National Park good at learning in adaptive ecosystem management? (Back to top) Whilst it is encouraging to note that many narratives in this paper suggest this to be the case, there appear to be major gaps and opportunities. The evidence presented suggests that assessment-type learning predominates and is inadequately linked to reflection. Assessment appears amenable to, and can even be effectively driven by, codification, which enables some stability for decision making. This may be appropriate under conditions of relatively unchanging, or assumed unchanging, contexts, but could result in ‘blind-siding’ and a ‘dulling of the senses’ when confronted with changing and newly emerging contexts. Reflection, on the other hand, is often spontaneous or emergent, although, clearly, some structured processes can also be enabling and can lead to more fundamental changes in decision making. The KNP may be guilty of often falling back into a narrowly defined version of adaptive management, which may tend to assume a given context. The KNP may even have become trapped in a fixed context, which has become inappropriate over time. This is akin to the way in which attitudes around elephant management (eds. Scholes & Mennel 2008) persisted for decades before a change in thinking was accepted, all the while showing welcome technical improvements and refinements within the particular culling context, which proved unsustainable, as ‘the only answer’. On the other hand, there is generally also an urgent need for effective assessment processes, as depicted on the left side of Figure 3. The way forward appears to be, as the dualities suggest, that assessment and reflection should coexist with their complementary function playing out at various scales and with varying strengths. Recognition of dynamic complexity, linked to a system that supports policy-oriented decisions, seems crucial. Such interlinking requires diverse teams working together on problems holistically. For example, in SANParks this could include, in a stereotypic or conventional interpretation, (1) managers who often tend to focus on finer-scale implementation and assessment issues, (2) scientists who tend to have a broad, theoretical view, focus on planning and outcomes and, intuitively, like to reflect, and (3) ‘bridging’ regional ecologists who have an understanding of both planning and implementation components. It has been stressed before that more shared functionality across these cadres results in better integration. The prescription should therefore also include stretching, within the reasonable capability of people, these stereotypes outside of their immediate operational comfort zones and promoting engagement by at least some individual team members across all aspects of the adaptive management process as illustrated in Figure 1. This, in itself, will lead to enhanced achievement of the original dualities or paired options (Roux et al. 2008). Given the paucity of quantitative empirical evidence (Cook, Hockings & Carter 2009), is it the reality of complex systems that we should expect a mix of fact-based and expert-based evidence and changing ideology to drive management, rather than imagining the trajectory to develop solely on hard factual evidence? How should scientists respond to this? This paper describes that, in reality, several different classes of feedback exist, of which only some are based on hard evidence. This suggests that a mix of these change drivers is inevitable (even if hard evidence plays an increasing role) and that reflection at different scales may help improve decision making and learning amidst this uncertainty, with changing ideology often (but not exclusively) manifesting itself through policy option choice. Our case histories showed some examples of assessment patterns being driven by decisions made subsequent to reflection, often after a lag period, which may not always be undesirable (Cilliers 2006). These reflections appear, in turn, to have been driven mainly by changing paradigms. The changing paradigm itself is a consequence of primarily, but not entirely, scientists’ reflection and these changed paradigms prompt further management reflection. We have also described how assessment contributes to further reflection, but individually these effects seem to reach triple-loop standing only occasionally (Roux et al. 2009). Thus, a combination of altered expert opinion (including that of managers) and changing values, in some cases together with the appearance of a certain amount of new evidence, appears to lead to change. All three these drivers may co-evolve or be brought together in a more conscious process. Is the overlap of striving for the same goal, although perhaps for different reasons, a key element of practical progress in many cases? A way forward may be to target several key questions: • What influences the balance between assessment and reflection in particular cases? • Is assessment more prevalent because it is easier for organisations to implement and/or codify? • What is the trade-off between tedious, detailed assessment and a more practical intervention that is not overly simplistic? • Should all systems strive to include and promote personal thoughtfulness and vibrancy, along with other strategies, to prevent becoming rote? • How can we promote more reflection and its meaningful relationship with assessment? These may be addressed in an enlightened way by using one or multiple approaches to evaluate our success at adaptation and learning, as discussed by several others (e.g. Michael 1995; Narrative Lab 2009; Paehlke & Torgerson 1990; Stankey et al. 2005; Walker & Salt 2006; Weick & Sutcliffe 2001), and incorporating these into wider fundamental learning theory (Kolb 1984). Such initiatives could even re-use the case data mentioned in Table 1. Although they have much in common, each of these approaches also has a unique slant. We propose that sufficient reflection on one or more of these approaches (perhaps emphasising their commonalities) and not only the learning dualities on which this paper has focused, may yield startling and useful consolidations in our particular context of natural resource management. Conclusion (Back to top) We have shown that both mindful assessment and reflection are necessary for purposeful learning and adaptive management, and that there is much scope for improvement throughout this interacting system. Consideration to both learning theory and the correct contextualisation of adaptive management helps to determine the dynamic coupling we observe in natural resource management: complex social-ecological systems are embedded in extensive dynamic contexts. With this paper we have made a start by looking at empirical evidence available after more than a decade of adaptive management in a park, and relating the patterns to meaningful theory. We hope the review can serve as a springboard for more exact work of this kind and hence further enhance learning. Acknowledgements (Back to top) We thank Alice Schwarz Brunold (Office of Marketing and Communications, University of Queensland) for professional assistance with compiling Figure 1, Eureta Rosenberg for insightful discussions after reading an earlier draft of the manuscript, and the two reviewers for their painstaking efforts to help us generate a clear, well-grounded and useful product. References (Back to top) Allan, C. & Curtis, A., 2005, ‘Nipped in the bud: Why regional scale adaptive management is not blooming’, Environmental Management 36(3), 414−425. Anderies, J.M., Janssen, M.A. & Ostrom, E., 2004, ‘A framework to analyze the robustness of social-ecological systems from an institutional perspective’, Ecology and Society 9(1), 18, viewed 28 April 2011, from http://www.ecologyandsociety.org/vol9/iss1/art18/ Argouridas, V. & Race, P., 2007, ‘Enhancing knowledge management in design education through systematic reflection practice’, Concurrent Engineering: Research and Applications 15(1), 63−76. Belokurov, A., Besançon, C., Burgess, N.D., Dudley, N., Hockings, M., Leverington, F., et al., 2009, ‘New resources for assessing the effectiveness of management in protected areas’, Oryx 43(1), 14. Biggs, H.C. & Rogers, K.M., 2003, ‘An adaptive system to link science, monitoring and management in practice’, in J. du Toit, K.M. Rogers and H.C. Biggs (eds.), The Kruger Experience: Ecology and management of savanna heterogeneity, pp. 59−80, Island Press, Covelo. Biggs, H. & Van Wyk, A., 2000, ‘How far are we with our stated goals and how should we modify them along the way?’, presented at Annual General Meeting of Conservation Section, Kruger National Park, Skukuza, 9–10 Nov 2000. Businessballs n.d., Kolb learning styles, featuring Honey and Mumford’s variation, viewed 28 March 2011, from http://www.businessballs.com/kolblearningstyles.htm Bridgman, P. & Davis, G., 2004, The Australian Policy Handbook, Allen & Unwin, Sydney. Cilliers, F.P., 2006, ‘On the importance of a certain slowness. Stability, memory and hysteresis in complex systems’, Emergence: Complexity and Organisation 8(3), 106−113. Cook, C., Hockings, M. & Carter, R.W., 2009, ‘Conservation in the dark: the information used to support decisions’, Frontiers in Ecology and the Environment 8(4), 181–186. Du Toit, J., Rogers, J.K. & Biggs, H.C. (eds.), 2003, The Kruger Experience: Ecology and management of savanna heterogeneity, Island Press, Covelo. Duff, J., 2002, ‘An assessment of adaptive management practices in South Africa National Parks and Ezemvelo KwaZulu Natal Wildlife’, MSc dissertation, Centre of Environment and Development, Faculty of Science and Agriculture, University of Natal. Fazey, I. & Schultz, L., 2009, ‘Adaptive people for adaptive management’ in C. Allen & G. Stankey (eds.), Adaptive environmental management: a practitioner’s guide, pp. 323−338, Springer, Dortrecht and CSIRO, Collingwood. Freitag, S., Biggs, H. & Breen, C., in review, ‘Fifteen years of the spread and maturation of adaptive management in South African National Parks: organisational learning in systems perspective’, in W. Freimund, S. McCool & C.M. Breen (eds.), Engaging complexity in protected area management: challenging Occam’s razor, University of KwaZulu-Natal Press, Pietermaritzburg. Gaylard, A. & Ferreira, S.M., 2011, ‘Modification and maturation of SANPark’s adaptive planning process – making critical linkages between conservation objectives and actions’, Koedoe 53(2), Art. #1005, 8 pages. doi:10.4102/koedoe.v53i2.1005 Garvin, D.A., 1993, ‘Building a learning organization’. Harvard Business Review 71(4), 78–91. Gray, J.A. Muir, 1997, Evidence-based health care, Churchill Livingstone, Edinburgh. Growcock, A.J., Sutherland, E.F. & Stathis, P.T., 2009, ‘Challenges and experiences in implementing a management effectiveness evaluation program in a protected area system’, Australasian Journal of Environmental Management 16, 30−38. Hockings, M., Cook, C., Carter, R.W. & James, R., 2009, ‘Accountability, reporting or management improvement? Development of a State of the Parks Assessment System in New South Wales’, Environmental Management 43, 1013–1025. Hockings, M., Stolton, S. & Dudley, N., 2004, ‘Management effectiveness: assessing management of protected areas’, Journal of Environmental Policy and Planning 6(2), 157−174. IUCN Freshwater Task Force and Skukuza Group, in prep., ‘Adaptive management guidelines for effective conservation of freshwater ecosystems in and around protected areas of the world’, Australian Wetlands and Rivers Centre, Sydney. Kingsford, R.T., Biggs, H.C. & Pollard, S.R., 2011, ‘Strategic Adaptive Management in freshwater protected areas and their rivers’, Biological Conservation 144, 1194–1203. Knight, M.H., 2008, ‘SANParks: State of Biodiversity report: Comparisons of 2008 & 2007 scores’, Internal SANParks document, Park Planning & Development, Port Elizabeth. Kolb, D., 1984, Experiential learning, Prentice Hall, Englewood Cliffs, NJ. Mabunda, D., Pienaar, D.J. & Verhoef, J., 2003, ‘The Kruger National Park: A Century of Management and Research’, in J. du Toit, K.M. Rogers and H.C. Biggs (eds.), The Kruger Experience: Ecology and management of savanna heterogeneity, pp. 3−21, Island Press, Covelo. Michael, D.N., 1995, Barriers and bridges to learning in a turbulent human ecology, Columbia University Press, New York. Narrative Lab, 2009, ‘Investigating appropriate performance measures. South African National Parks, Conservation Services Division. Final Consolidated Report to SANParks’, Internal report, SANParks, Pretoria (available from SANParks Archives). Nkhata, B.A. & Breen, C., 2010, ‘A framework for exploring integrated learning systems for the governance and management of public protected areas’, Environmental Management 45(2), 403−413. Paehlke, R. & Torgerson, D., 1990, Managing Leviathan: environmental politics and the administrative state, Broadview Press, Peterborough. Pollard, S.R. & Du Toit, D.R., 2005, ‘Recognizing heterogeneity and variability as key characteristics of savannah systems: The use of Strategic Adaptive Management as an approach to river management within the Kruger National Park, South Africa’, Report of UNEP/GEF Project No. GF/2713-03-4679, Ecosystems, Protected Areas and People Project. IUCN, Gland, viewed 28 March 2011, from http://www.parksnet.org/files/1/2/65777_documents_document_file_1267.pdf Pollard, S.R. & Du Toit, D.R., 2007, Guidelines for Strategic Adaptive Management. Experiences from managing the rivers of the Kruger National Park. Guidelines for management and field staff of protected areas, Ecosystems, Protected Areas and People (EPP) Project (UNEP GEF No. GF/27-13-03-4679), Regional Protected Areas Programme of IUCN–World Conservation Union in Asia. Rebelo, T., Freitag-Ronaldson, S., Cheney, C. & McGeoch, M., 2011, ‘Prioritizing species of special concern in the Table Mountain National Park for monitoring: the challenge of a species-rich, threatened ecosystem’, Koedoe 53(2), Art. #1019, 14 pages. doi:10.4102/koedoe.v53i2.1019 Rogers, K.H., 2005, Biodiversity custodianship in SANParks: a protected area management planning framework, South African National Parks, Pretoria. Roux, D.J. & Foxcroft, L.C., 2011, ‘The development and application of Strategic Adaptive Management (SAM) within South African National Parks’, Koedoe 53(2), Art. #1049, 5 pages.doi:10.4102/koedoe.v53i2.1049 Roux, D.J., Murray, K. & Van Wyk, E., 2008, ‘Learning to learn for socio-ecological resilience. Balancing strategy options in public sector organizations’, in M. Burns & A. Weaver (eds.), Exploring Sustainability Science: a Southern African perspective, pp. 599–625, African Sun Media, Stellenbosch. Roux, D.J., Murray, K. & Van Wyk, E., 2009, Enabling effective learning in catchment management agencies: Research Report. Report No 1689/1/09, Water Research Commission, Pretoria. SANParks, 1999–2011, Conservation Services Management committee, minutes of [regular] meetings, SANParks archive, Skukuza. SANParks, 2008, ‘A framework for developing and implementing management plans for South African National Parks’, viewed 15 April 2009, from http://www.sanparks.org/parks/kruger/conservation/scientific/key_issues/plans/adaptive/default.php SANParks, 2010, Kruger National Park MANCO Meeting minutes (March 2010), Kruger National Park Archives, Skukuza. Scholes, R.J. & Mennell, K.G. (eds.), 2008, Elephant management. a scientific assessment for South Africa, Wits University Press, Johannesburg. Schön, D., 1983, The reflective practitioner: how professionals think in action, Temple Smith, London. Stankey, G.H., Clark, R.N. & Bormann, B.T., 2005, Adaptive management of natural resources: theory, concepts, and management institutions, General Technical Report PNW-GTR-654, US Department of Agriculture, Forest Service, Pacific Northwest Research Station, Washington DC. Starfield, A.M. & Bleloch, A.L., 1991, ‘Building models for conservation and wildlife management’, 2nd ed., Burgess International, Edina. Stirzaker, R., Roux, D.J. & Biggs, H.C., 2011, ‘Learning to bridge the gap between adaptive amangement and organisational culture’, Koedoe 53(2), Art. #1007, 6 pages. doi:10.4102/koedoe.v53i2.1007 Van Wilgen, B.W. & Biggs, H.C., 2011, ‘A critical assessment of adaptive ecosystem management in a large savanna protected area in South Africa’, Biological Conservation 144, 1179–1187. Walker, B. & Salt, D., 2006, Resilience thinking: sustaining ecosystems and people in a changing world’, Island Press, Washington DC. Walters, C., 1986, Adaptive management of renewable resources, Macmillan, New York. Water Research Commission, n.d., Report under Project K5/1711, Principal investigator: S. Pollard, Water Research Commission, Pretoria. Water Research Commission, n.d., Report under Project K5/1797, Principal investigator: C. McLoughlin, Water Research Commission, Pretoria. Weick, K.E. & Sutcliffe, K.M., 2001, Managing the unexpected: assuring high performance in an age of complexity, Jossey-Bass, San Francisco.