360 PERFORMANCE FEEDBACK: APPRAISAL VS. ASSESSMENT Developments In Business Simulation & Experiential Learning, Volume 24, 1997 360 PERFORMANCE FEEDBACK: APPRAISAL VS. ASSESSMENT Michael D. Crino, Clemson University H.C. (Dick) Comer, DuPont/ Forum Partnership Kathy J. Shingleton, University of Texas at Galveston Walter P. Smith, Energy Technology Services International Precha Thavikulwat, Towson State University John K. Butler, Jr. Clemson University INTRODUCTION The purpose of this session is to discuss the issues involved in assessing the performance of individuals who have many constituents. The presenters include a management consultant, a practicing manager, a director of human resources at a university, and three professors. They will focus on the expectations and perceptions held by an individual’s superiors, peers, subordinates, and other constituents / stakeholders. They will also discuss learning benefits to managers and employees, teachers and students. An experiential exercise, The 360 Performance Evaluation / Feedback Exercise, will be summarized. This exercise is intended to facilitate students’ learning about 360 performance appraisal, in general, and about the multiple constituencies served by college professors, in particular. STIMULI I. Trust and Employees’ Perceptions about the 360-Degree Feedback Process Kathy Shingleton A. Meaning of 360-degree feedback: Multiple- rater feedback systems B. Use of the data: Pay, promotions, development C. Research results: Need for trust: effects on employees’ perceptions II. A Consultant’s Viewpoint Walter Smith A. Feedback on preliminary results during the wrap-up - Client’s disbelief of potential benefits: “Are these savings real?” - Consultant’s credibility (Trust in consultant) B. Follow-up: Motivation to implement - Slam dunks and hail Marys C. Pinwheel 360 diagram - Improving the process consultant’s own process III. A Manager’s Viewpoint Dick Corner A. Two distinct aspects of performance, contribution and accomplishment - Appraisal versus assessment B. How 360 feedback works in business organizations - Need at least four constituents (self, boss, peers, customers). IV. A 5-Day Exercise on 360 Performance Evaluation / Feedback. The Professor’s Job Michael Crino A. Lecture on the logic of 360 B. Development of a plan for a 360 system for university professors C. An in-depth look at one segment of the 360 system (teaching) as evaluated by one group (students). - Interviews with professors and students regarding performance responsibilities and expectations for teaching - Analysis of expectation sets (students and professors) for similarities and differences, and the likely performance consequences of both. - The development of an expectations- based instrument for the evaluation of faculty teaching performance by students - The critical comparison of the student developed instrument and the current form used in the College of Business. D. A question-and-answer session with the chair of the Department of Management regarding the evaluation of the teaching faculty 304 Developments In Business Simulation & Experiential Learning, Volume 24, 1997 V. Appraisal Versus Assessment Precha Thavikulwat Whereas appraisal is the measurement of performance, assessment is the measurement of accomplishment. In the educational context, appraisals measure the quality the teaching, assessment, the quality of learning. The standard tool for appraisal is rating; the standard tool for assessment is examination. Each has its advantages and its imperfections. In my work, I study the use of gaming simulations as a means of assessing what business students are able to do. I have created business gaming simulations that encourage participants to work in teams while allowing each participant to work towards an individual objective and get an objective individual score. I have examined ways in which participants might cheat in a gaming simulation through collusive and end-gaming tactics to get scores they do not deserve. And I have developed computer-assisted methods to automate the administration of gaming simulations so that administrative costs and possibilities of administrative errors are minimized. I have found this area of work to be productive. Although problems in using gaming simulations for assessment remain, I have not yet encountered one that could not be eliminated or controlled. I look with anticipation towards advances in Intranet-accessing technology that will permit gaming simulations administered from one location to be played virtually anywhere. By isolating administrative problems to a single location, assessors may be completely relieved of the administrative burden that today hinders widespread acceptance of gaming simulations as the ideal tool for assessing business education. DISCUSSION After the presenters have briefly introduced their individual perspectives, there will be an open discussion with a mutual attempt to relate and apply the concepts to learning in the business and educational arenas. 305 Table of Contents Volume 24, 1997 Incorporating Computer Telephony into the MIS Course A Learner Oriented Infrastructure for videoconferencing Based Distance Education Courses The Identification of Temporally Related Structural Elements of the Experiential Component of Electronic Spreadsheet Tasks Does Involvement Influence Learning from Simulation Participation? Some Relationships with Helpfulness and Performance Outcomes Musings on Business Garne Performance Evaluation Performance on a TE Simulation: What does it represent? The Business Policy Game: An International Simulation - An Assessment Tool Students in Free Enterprise as Experiential Learning The Role of Computer Models in Wargames: A Practitioner's view Using Focus Groups as a Tool to Research Learning: A Demonstration and a Discussion Using Medical Simulations to Teach Multi-Cultural Diversity Using the World Game to Internationalize International Exchange Game Community Services Needs Assessment: An Innovative Approach Introducing Students to Potential Total Quality Management Ethical Dilemmas Privacy in the Workplace: A Situational Analysis Antecedents of Learning in Simulations Demonstrating the Learning Effectiveness of Simulation: Where we are and Where we need to go The Use of Computer Simulations as a Pedagogical Aid in Teaching Management Information Systems Evaluating Simulation Learning in a Distant Learning Instructional Model Financial Engineering of Global Investments The Labor History Game: Playing with the Past Perks Participation Assessing Negotiator's Proficiency with a Negotiation role-play The Art of Negotiating Enhancing Learning and Employee Development through the Assessment of Learning Pedagogy Preferences across selected Dimensions of Culture: A Preliminary Investigation Cooperative Learning: What are we Learning? Effective Use of Mastery Based Experiential learning in a Project Course to improve skills in system analysis and Design Simulations and Learning: Can we prove a relationship? (Seminar) Predicting and Reviewing NYSE Stock Prices by use of Basic Statistical Analysis and Logic Toy Car Depreciation Exercise ABSEL as Home Community: An Interactive Exploration Service Learning: Linking Academic Study to Community Development and Business Enhancement Ability of Efficient Evaluation of Knowledge-Based Management Strategies Corporate Ethics Training Programs Modeling Attributes in Demand Functions of Computerized Business Simulations: An Extension of Teach's Gravity Flow Algorithm Expert Systems Combined with Neutral Networks: Tools to Benefit the Marketing Researcher Computer Game Design: New Directions for Intercultural Simulation Game Designers Consistency in Simulation Performance over Time and Across Simulation Games The Impact of an Artificial Market Leader on Simulation Competitor's Strategies Business Plans, Case Studies, and Total Enterprise Simulations: A Natural Co-existence An Exploration into the Non-Use of Business Simulations The Market Game: Interactive Learning Through Market Simulation Plotting Brand Trajectories with the COMPLETE PPM package: A Market Segmentation Analysis and Positioning Tool Me and Mine Inc: An Exercise in Management Theory Learning to Differentiate Leadership from Managerial Position Business Ethics Survey: A Perspective from the Retail Industry Experiential Learning in Demand Analysis for an Agricultural Commodity Marketing on the Internet: A Pedagogical Exercise College Students Need Simple Computer Simulations, Especially for International Business Courses An Analysis of Student Attitudes, Performance, and Strategies in a Simulation Competition Based on a Controlled Product-Market-Entry Game Structure The Crystal Enterprise: Application of a Non-Computerized Simulation Model in a Process of Organizational Change Threshold: A Windows-Based Behaviorally Oriented Total Enterprise Simulation Coaching Business Game Teams Using a Decision Variable Optimizer Rock and Roll is here to Stay: Enhancing Experiential Pedagogy with Musical Exercises An Example of Business Process Analysis Simulation for Customer Software Support The Use of Business Gaming in Hong Kong Academic Institutions Using the Integrative International Simulation INTOPIA Mark 2000 in a Concentrated MBA Curriculum A Group Experience as an Integrated Part of the Core Management Course Empowered Learning in the Classroom The Inter-Group Interaction: An Innovative Approach to Cooperative Learning Courses that Utilize Student Team: An Approach to enhancing their Effectiveness Thoughts about the Measurement of Learning: The Case for Guided Learning and Associated Measurement Issues Measuring Student Learning Using Business Simulations: A Theory Based Perspective On the Use of PC Fingame in an Undergraduate Finance Course How Managers get Things Done: A Virtual Soundbite Internet Experiential learning in the Principals of Marketing Classroom: A Pedagogical Approach Current Student Perceptions Relative to Business Simulations Beyond Capitalism: Designing Business Policy and Social Justice The Use of Boards of Directors to Evaluate Reports and Presentations in an Undergraduate Business Policy Course Beacon Lumber: An Experiential Introduction to Financial Accounting The Application of Organizational Motivation Principles: The Experiential Business Simulation Motus Manufacturing Avoiding a Bogey: Grading Case Discussions Scientifically Communicating Consumer Behavior II: A Modified Exercise Using Personal Consumption Journals in Condensed Courses Designing Instruments for Assessing the Effectiveness of Simulations, (Seminar) 360º Performance Feedback: Appraisal vs. Assessment The Cafeteria Approach to Managing an Academic Career: Remaining Non-Perishable while Doing Your Own Thing An Experiential Exercise Related to Person-Organization Fit and it's Consequences For Today's Dynamic and Changing World, Business Simulations need to be expanded to encompass Much Greater Complexity: A Demonstration The Incident Process: A Case in Reverse Contextually-Anchored Business Simulations The Energy Factor: Building Motivation in the Simulation Gaming Environment The Design of an Internet Game