360-degree feedback: Difference between revisions
Added an image containing an example of 360-degree feedback. Added Information to the Accuracy section to expand on the factors which may affect the accuracy of 360-degree feedback. |
DocWatson42 (talk | contribs) m →top: Added a carriage return. |
||
(38 intermediate revisions by 25 users not shown) | |||
Line 1: | Line 1: | ||
{{Short description|Feedback process}} |
|||
{{Advert|date=March 2019}} |
|||
{{Format footnotes|date=September 2024}} |
|||
A '''360-degree feedback''' (also known as '''multi-rater feedback''', '''multi source feedback''', or '''multi source assessment''') is a process through which feedback from an employee's subordinates, colleagues, and supervisor(s), as well as a self-evaluation by the employee themselves is gathered. Such feedback can also include, when relevant, feedback from external sources who interact with the employee, such as customers and suppliers or other interested stakeholders. 360-degree feedback is so named because it solicits feedback regarding an employee's behavior from a variety of points of view (subordinate, lateral, and supervisory). It therefore may be contrasted with "downward feedback" (traditional feedback on work behavior and performance delivered to subordinates by supervisory or management employees only; see traditional [[performance appraisal]]), or "upward feedback" delivered to supervisory or management employees by subordinates only. |
|||
'''360-degree feedback''' (also known as '''multi-rater feedback''', '''multi-source feedback''', or '''multi-source assessment''') is a process through which feedback from an employee's colleagues and associates is gathered, in addition to a self-evaluation by the employee. |
|||
<!-- Deleted image removed: [[File:Image Man In Circle Web.jpg|thumb|alt=An individual is surrounded by his immediate circle.|In a 360-degree evaluation, an individual is given feedback by everyone in his/her circle.]] --> |
|||
⚫ | Organizations |
||
360-degree feedback can include input from external sources who interact with the employee (such as customers and suppliers), subordinates, peers, and supervisors. It differs from traditional [[performance appraisal]], which typically uses ''downward feedback'' delivered by supervisors employees, and ''upward feedback'' delivered to managers by subordinates. |
|||
There is a great deal of debate as to whether 360-degree feedback should be used exclusively for development purposes<ref>Bracken & Rose, 2011; Maylett 2009</ref> or for evaluation purposes as well.<ref>Waldman et al., 1998</ref> This is due primarily to feedback providers' subjectivity and motivations, inter-rater variations, and whether feedback providers have the ability to fairly evaluate attainment of work and organizational objectives. While these issues exist when 360-degree feedback is used for development, they are more prominent when employers use them for performance evaluation purposes, as they can unfairly influence employment decisions, and even lead to legal liability. |
|||
⚫ | Organizations most commonly use 360-degree feedback for developmental purposes. Nonetheless, organizations are increasingly using 360-degree feedback in performance evaluations and administrative decisions, such as in payroll and promotion. When 360-degree feedback is used for performance evaluation purposes, it is sometimes called a '''360-degree review'''. The use of 360-degree feedback in evaluation is controversial, due to concerns about the subjectivity and fairness of feedback providers. |
||
==History== |
==History== |
||
One of the earliest recorded uses of surveys to gather information about employees occurred in the 1950s at the [[Esso]] Research and Engineering Company.<ref>Bracken, Dalton, Jako, McCauley, & Pollman, 1997</ref> From there, the idea of 360-degree feedback gained momentum |
The origins of 360-degree feedback date back to around 1930, with the German [[Reichswehr]], when the [[Military psychology|military psychologist]] [[:de:Johann_Baptist_Rieffert|Johann Baptist Rieffert]] developed a selection methodology for [[officer candidate]]s. One of the earliest recorded uses of surveys to gather information about employees occurred in the 1950s at the [[Esso]] Research and Engineering Company.<ref>Bracken, Dalton, Jako, McCauley, & Pollman, 1997</ref> From there, the idea of 360-degree feedback gained momentum. |
||
Online evaluation tools led to increased popularity of multi-rater feedback assessments, due to the ease of use compared to physical pen-and-paper tools.<ref>Atkins & Wood, 2002</ref> The [[outsourcing]] of human resources functions has also created a market for 360-degree feedback products from consultants.<ref name=":0">{{Cite journal|last=Johnson|first=Lauren Keller|date=January 2004|title=The Ratings Game: Retooling 360s for Better Performance|journal=Harvard Management Update}}</ref> Today, studies suggest that over one-third of U.S. companies use some type of multi-source feedback,<ref>Bracken, Timmereck, & Church, 2001a</ref> including 90% of all Fortune 500 firms.<ref>Edwards & Ewen, 1996</ref> In recent years, multi-source feedback has become a best practice in human resources due to online tools such as multiple language options, comparative reporting, and aggregate reporting.<ref>Bracken, Summers, & Fleenor, 1998</ref> |
|||
== Guidelines == |
|||
Today, studies suggest that over one-third of U.S. companies use some type of multi-source feedback.<ref>Bracken, Timmereck, & Church, 2001a</ref> Others claim that this estimate is closer to 90% of all Fortune 500 firms.<ref>Edwards & Ewen, 1996</ref> In recent years, this has become encouraged as Internet-based services have become standard in corporate development, with a growing menu of useful features (e.g., multiple language options, comparative reporting, and aggregate reporting).<ref>Bracken, Summers, & Fleenor, 1998</ref> However, issues abound regarding such systems' validity and reliability, particularly when used in performance appraisals. |
|||
Certain guidelines emphasise establishing trust between raters and ratees to improve rater accountability and feedback accuracy.<ref name=":3">{{Cite book |last=Fleenor |first=John W. |url=https://www.worldcat.org/oclc/1159679868 |title=Leveraging the impact of 360-degree feedback |others=Taylor, Sylvester; Chappelow, Craig |year=2020 |isbn=978-1-5230-8835-5 |edition=Second |location=Oakland, CA |oclc=1159679868}}</ref> At the same time, anonymous participation has also been found to result in more accurate feedback, in which case confidentiality among human resources staff and managers should be preserved.<ref name=":3" /> The standardisation and optimisation of rating scales and data collection also affects assessment accuracy, including such factors like the time of day.<ref name=":3" /><ref name=":1">{{Cite journal |last1=Bracken |first1=David W. |last2=Rose |first2=Dale S. |last3=Church |first3=Allan H. |date=December 2016 |title=The Evolution and Devolution of 360° Feedback |journal=Industrial and Organizational Psychology |language=en |volume=9 |issue=4 |pages=761–794 |doi=10.1017/iop.2016.93 |issn=1754-9426 |doi-access=free}}</ref><ref name=":2">{{Cite book |author=Ainsworth, Elva R. |url=https://www.worldcat.org/oclc/1031336375 |title=360° feedback : a transformational approach |date=12 April 2016 |isbn=978-1-78452-244-5 |location=St Albans |oclc=1031336375}}</ref> |
|||
[[File:360-degree feedback.svg|thumb|360-Degree Feedback Example]] |
|||
== Issues == |
== Issues == |
||
Using 360-degree feedback tools for appraisal purposes has been criticised over concerns of performance criteria validity, ability of peers to give accurate feedback, and manipulation of these systems by feedback providers.<ref>{{Cite journal|last=Bracken|first=David R.|date=September 1994|title=Straight Talk about Multirater Feedback|journal=Training & Development}}</ref><ref>Bracken & Rose, 2011; Maylett 2009</ref><ref>Waldman et al., 1998</ref> Employee manipulation of feedback ratings has been reported in some companies who have utilized 360-degree feedback for performance evaluation, including GE,<ref>(Welch 2001)</ref> IBM,<ref>(Linman 2011)</ref> and Amazon.<ref>(Kantor and Streitfeld 2015)</ref> |
|||
⚫ | The amount and level of training in 360-degree feedback for both the rater and ratee can affect the level of accuracy of the feedback. If no guidance is given, individual bias may affect the rater's ratings and the ratee's interpretation of the feedback.<ref name=":1" /> However, even with training measures in place, unconscious bias may still occur due to factors such as the cultural influences or relationship quality between the rater and ratee.<ref name=":2" /> Additionally, if there are potential consequences from rater feedback, rater motivation may shift from providing accurate feedback to providing feedback based on self-motivated reasons such as promoting or harming a particular individual.<ref name=":1" /><ref>{{Cite journal |last1=Bracken |first1=David W. |last2=Rose |first2=Dale S. |date=June 2011 |title=When Does 360-Degree Feedback Create Behavior Change? And How Would We Know It When It Does? |url=http://link.springer.com/10.1007/s10869-011-9218-5 |journal=Journal of Business and Psychology |language=en |volume=26 |issue=2 |pages=183–192 |doi=10.1007/s10869-011-9218-5 |issn=0889-3268 |s2cid=145745127}}</ref> |
||
⚫ | Some members of the U.S. military have criticized its use of 360-degree feedback programs in employment decisions because of problems with validity and reliability.<ref>{{Cite journal|last=Lee|first=Gregory G.|date= July–August 2015|title=Caution Required: Multirater Feedback in the Army |
||
⚫ | Some members of the U.S. military have criticized its use of 360-degree feedback programs in employment decisions because of problems with validity and reliability.<ref>{{Cite journal|last=Lee|first=Gregory G.|date= July–August 2015|title=Caution Required: Multirater Feedback in the Army|journal=Military Review}}</ref> Other branches of the U.S. government have questioned 360-degree feedback reviews as well.<ref>{{Cite journal|last=Bent|first=William|date=September 2015|title=Speaking Out: The State Department Needs to Reevaluate Its Use of 360-Degree Reviews|journal=The Foreign Service Journal}}</ref> Still, these organizations continue to use and develop their assessments in developmental processes.<ref>Cerella, A. (2020). Multi-Source Feedback in the U. S. Army: An Improved Assessment, ProQuest Dissertations and Theses.</ref> |
||
==Accuracy== |
|||
Adopting the 360-degree review approach is purported to be superior to other traditional forms of evaluation and feedback for evaluating employee performance. When successfully implemented, this method initiates a vast positive change and provides a more efficient, thorough, and accurate assessment of performance reviews. Participants must feel the survey instruments are reliable and valid otherwise this multi-source approach can be viewed as problematic. Management has to ensure their employees are aware of the context in the survey to maximize accuracy and minimize bias in responses. Several inconsistencies and errors can arise in the feedback depending on whether or not: |
|||
A study on the patterns of rater accuracy shows that the length of time that a rater has known the individual being evaluated generally correlates with positive review favorability and lower accuracy of a 360-degree review, apart from raters who have known the individual for less than a year.<ref>Eichinger, 2004</ref> |
|||
* The rater interacts with the employee regularly |
|||
⚫ | It has been suggested that multi-rater assessments often generate conflicting opinions and that there may be no way to determine whose feedback is accurate.<ref>Vinson, 1996</ref> Studies have also indicated that self-ratings are generally significantly higher than the ratings given from others.<ref>Lublin, 1994; Yammarino & Atwater, 1993; Nowack, 1992</ref> |
||
* The rater lets their emotions influence their judgement |
|||
⚫ | |||
* The employee reveals themselves to the rater honestly and completely |
|||
Several studies indicate that the use of 360-degree feedback helps to improve employee performance because it helps the evaluated see different perspectives of their performance.<ref>Hazucha et al., 1993; London & Wohlers, 1991; Walker & Smither, 1999</ref> |
|||
⚫ | In a 5-year study, no improvement in overall rater scores was found from the 1st year to the 2nd, but scores rose with each passing year from 2nd to 4th.<ref>Walker & Smither, 1999</ref> A 1996 study found that performance increased between the 1st and 2nd administrations, and sustained this improvement 2 years later.<ref>Reilly et al. (1996)</ref> Additional studies show that 360-degree feedback may be predictive of future performance.<ref>Maylett & Riboldi, 2007</ref> |
||
* The rating has been retained confidentially (if not the rater may not provide an honest rating) |
|||
Some authors maintain, however, that there are too many [[confounding variable]]s related to 360-degree evaluations to reliably generalize their effectiveness,<ref>Bracken, Timmreck, Fleenor, & Summers, 2001b; Smither, London, & Reilly, 2005.</ref> arguing that process features are likely to have major effects on creating behavior change.<ref>Bracken et al. (2001b) and Bracken and Timmreck (2001)</ref> A 1998 study has found that the category of rater affects the reliability of feedback, with direct reports generally the least reliable.<ref>Greguras and Robie (1998)</ref> |
|||
* The rater has a high level of confidence tin the accuracy of their rating |
|||
Multiple pieces of research have demonstrated that the scale of responses can have a major effect on the results, and that some response scales are better than others.<ref>Bracken & Paul, 1993; Kaiser & Kaplan, 2006; Caputo & Roch, 2009; English, Rose, & McClellan, 2009</ref> The evaluated individual following up with raters to discuss their results, which cannot be done when feedback is anonymous, often has a profound impact on results.<ref>Goldsmith and Underhill (2001)</ref> Other potentially powerful factors affecting behavior change include how raters are selected, manager approval, instrument quality, rater training and orientation, participant training, supervisor training, coaching, integration with HR systems, and accountability.<ref>Bracken et al., 2001b</ref> |
|||
* There is a personal relationship between the employee and rater<ref>{{Cite journal|last=Qureishi Humera|date=2020-04-16|title=360 Degree Performance Effects on Employee Attitude, Professional Effectiveness and General Work Performance|url=https://zenodo.org/record/3822217|doi=10.5281/ZENODO.3822217}}</ref> |
|||
One group of studies proposed four paradoxes that explain why 360-degree evaluations do not elicit accurate data: |
|||
⚫ | The amount and level of training in 360-degree feedback for both the rater and ratee can affect the level of accuracy of the feedback. If no guidance is given, individual bias may affect the |
||
# The Paradox of Roles, in which an evaluator is conflicted by being both peer and the judge |
|||
Furthermore, it is important to recognize who will receive the data collected and who will maintain the confidentiality of that data. The manager or HR employee who manages the collection of data will need to ensure its confidentiality. When participants remain anonymous, they are more likely to provide more accurate feedback because their fear of being reprimanded is eliminated thereby strengthening the accuracy of the review. Moreover, the data should only be available to the employee who has been reviewed and the manager who will be facilitating the feedback for developmental purposes.<ref name=":3" /> |
|||
# The Paradox of Group Performance, which admits that the vast majority of work done in a corporate setting is done in groups, not individually |
|||
# The Measurement Paradox, which shows that qualitative, or in-person, techniques are much more effective than mere ratings in facilitating change |
|||
⚫ | # The Paradox of Rewards, which shows that individuals evaluating their peers care more about the rewards associated with finishing the task than the actual content of the evaluation itself.<ref>{{Cite journal | url = http://hbr.org/2001/01/getting-360-degree-feedback-right/ar/1 | title = Getting 360-Degree Feedback Right | last = Peiperl | first = Maury | journal = Harvard Business Review | date = January 2001 | access-date = 6 April 2012 }}</ref> |
||
⚫ | Additional studies found no correlation between an employee's multi-rater assessment scores and performance appraisal scores provided by supervisors.<ref>Maylett, 2005</ref> They advise that although multi-rater feedback can be effectively used for appraisal, care needs to be taken in its implementation or results will be compromised.<ref>Maylett, 2009</ref> This research suggests that 360-degree feedback and performance appraisals get at different outcome, leading some executives to argue that traditional performance appraisals and 360-degree feedback should be used in evaluating overall performance.<ref>{{cite thesis | url = http://gradworks.umi.com/32/13/3213345.html | title = The relationship of multi-rater feedback to traditional performance appraisals | last = Maylett | first = Tracy M. | degree = EdD | publisher = Pepperdine Univ| date = 2005 | at = Abstract | access-date = 15 May 2009 }}</ref> |
||
It is also vital to standardize how information is collected during the review process. 360-degree feedback may be susceptible to decreased accuracy based on the style of survey used. Research has shown that feedback results may change based on the rating scale used in the survey<ref name=":1" /> as well as the length of the survey.<ref name=":3" /> Furthermore, rater feedback may change based on the time they completed the survey.<ref name=":2" /> |
|||
A study on the patterns of rater accuracy shows that the length of time that a rater has known the individual being evaluated has the most significant effect on the accuracy of a 360-degree review. The study shows that subjects in the group "known for one to three years" are the most accurate, followed by those "known for less than one year," followed by those "known for three to five years" and the least accurate being those "known for more than five years." The study concludes that the most accurate ratings come from those who have known the individual being reviewed long enough to get past the first impression, but not so long that they begin to generalize favorably.<ref>Eichinger, 2004</ref> |
|||
⚫ | It has been suggested that multi-rater assessments often generate conflicting opinions and that there may be no way to determine whose feedback is accurate.<ref>Vinson, 1996</ref> Studies have also indicated that self-ratings are generally significantly higher than the ratings given from others.<ref>Lublin, 1994; Yammarino & Atwater, 1993; Nowack, 1992</ref> |
||
⚫ | |||
⚫ | |||
Some authors maintain, however, that there are too many [[confounding variable]]s related to 360-degree evaluations to reliably generalize their effectiveness.<ref>Bracken, Timmreck, Fleenor, & Summers, 2001b; Smither, London, & Reilly, 2005.</ref> Bracken et al. (2001b) and Bracken and Timmreck (2001) focus on process features that are likely to also have major effects on creating behavior change. Greguras and Robie (1998) tracked how the number of raters used in each particular category (direct report, peer, manager) affects the reliability of the feedback. Their research showed that direct reports are the least reliable and, therefore, more participation is required to produce a reliable result. Multiple pieces of research<ref>Bracken & Paul, 1993; Kaiser & Kaplan, 2006; Caputo & Roch, 2009; English, Rose, & McClellan, 2009</ref> have demonstrated that the scale of responses can have a major effect on the results, and some response scales are better than others. Goldsmith and Underhill (2001) report the powerful influence of the evaluated individual following up with raters to discuss their results, which cannot be done when feedback is anonymous. Other potentially powerful factors affecting behavior change include how raters are selected, manager approval, instrument quality, rater training and orientation, participant training, supervisor training, coaching, integration with HR systems, and accountability.<ref>Bracken et al., 2001b</ref> |
|||
Some researchers claim that the use of multi-rater assessment does not improve company performance. One 2001 study found that 360-degree feedback was associated with a 10.6 percent decrease in market value, and concludes that "there is no data showing that [360-degree feedback] actually improves productivity, increases retention, decreases grievances, or is superior to forced ranking and standard performance appraisal systems."<ref>Pfau & Kay, 2002</ref> |
|||
⚫ | |||
⚫ | Additional studies |
||
==References== |
==References== |
||
Line 60: | Line 49: | ||
== Further reading == |
== Further reading == |
||
{{Columns-list| |
|||
{{cmn| |
|||
*Atkins, P., & Wood, R. (2002). Self-versus others' ratings as predictors of assessment center ratings: Validation evidence for 360-degree feedback programs. ''Personnel Psychology, 55''(4), 871–904. |
*Atkins, P., & Wood, R. (2002). Self-versus others' ratings as predictors of assessment center ratings: Validation evidence for 360-degree feedback programs. ''Personnel Psychology, 55''(4), 871–904. |
||
*Bracken, D.W., and Paul, K.B. (1993). The effects of scale type and demographics on upward feedback. Paper presented at the Society for Industrial and Organizational Society Annual Conference, May, San Francisco, CA. |
*Bracken, D.W., and Paul, K.B. (1993). The effects of scale type and demographics on upward feedback. Paper presented at the Society for Industrial and Organizational Society Annual Conference, May, San Francisco, CA. |
||
*Bracken, D.W., Dalton, M.A., Jako, R.A., McCauley, C.D., & Pollman, V.A. (1997). ''Should 360-degree feedback be used only for developmental purposes?'' Greensboro, NC: Center for Creative Leadership. |
*Bracken, D.W., Dalton, M.A., Jako, R.A., McCauley, C.D., & Pollman, V.A. (1997). ''Should 360-degree feedback be used only for developmental purposes?'' Greensboro, NC: Center for Creative Leadership. |
||
*Bracken, D.W., Summers, L., & Fleenor, J.W. (1998) High tech 360. |
*Bracken, D.W., Summers, L., & Fleenor, J.W. (1998) High tech 360. ''Training & Development'', August. |
||
*Bracken, D.W., Timmereck, C.W., & Church, A.H. (2001a). ''The handbook of multisource feedback.'' San Francisco: Jossey-Bass. |
*Bracken, D.W., Timmereck, C.W., & Church, A.H. (2001a). ''The handbook of multisource feedback.'' San Francisco: Jossey-Bass. |
||
*Bracken, D.W., Timmreck, C.W., Fleenor, J.W., & Summers, L. (2001b). 360 degree feedback from another angle.''Human Resource Management'', 40 (1), 3–20. |
*Bracken, D.W., Timmreck, C.W., Fleenor, J.W., & Summers, L. (2001b). 360 degree feedback from another angle.''Human Resource Management'', 40 (1), 3–20. |
||
*Bracken, D.W., and Timmreck, C.W. (2001) Guidelines for multisource feedback when used for decision making. In Bracken, D.W., Timmreck, C.W., and Church, A.H. ''The Handbook of Multisource Feedback.'' San Francisco: Jossey-Bass. |
*Bracken, D.W., and Timmreck, C.W. (2001) Guidelines for multisource feedback when used for decision making. In Bracken, D.W., Timmreck, C.W., and Church, A.H. ''The Handbook of Multisource Feedback.'' San Francisco: Jossey-Bass. |
||
*Bracken, D.W., Rose, D.S. (2011) "When does 360-degree Feedback create behavior change? And How would we know when it does?", |
*Bracken, D.W., Rose, D.S. (2011) "When does 360-degree Feedback create behavior change? And How would we know when it does?", |
||
*Cannon, M.D., & Witherspoon, R. (2005). |
*Cannon, M.D., & Witherspoon, R. (2005). Actionable feedback: Unlocking the power of learning and performance improvement. Academy of Management Executive, 19(2): 120-134. |
||
*Caputo, P. and Roch, S. (2009) Rating formats and perceptions of performance appraisal fairness. Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, April, New Orleans, LA. |
*Caputo, P. and Roch, S. (2009) Rating formats and perceptions of performance appraisal fairness. Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, April, New Orleans, LA. |
||
*DeNisi, A., & Kluger, A. (2000). |
*DeNisi, A., & Kluger, A. (2000). Feedback effectiveness: Can 360-degree appraisals be improved? Academy of Management Executive, 14(1): 129-139. |
||
*DeNisi, A., & Kluger, A. (1996). |
*DeNisi, A., & Kluger, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2): 254-284. |
||
*Edwards, Mark R., & Ewen, Ann J. (1996). ''360° Feedback: The powerful new model for Employee Assessment & performance improvement''. New York: AMACOM American Management Association. |
*Edwards, Mark R., & Ewen, Ann J. (1996). ''360° Feedback: The powerful new model for Employee Assessment & performance improvement''. New York: AMACOM American Management Association. |
||
*Eichinger, Robert. (2004). Patterns of Rater Accuracy in 360-degree Feedback. ''Perspectives'', 27, 23–25. |
*Eichinger, Robert. (2004). Patterns of Rater Accuracy in 360-degree Feedback. ''Perspectives'', 27, 23–25. |
||
Line 80: | Line 69: | ||
*Greguras, G.J., & Robie, C. (1998). A new look at within-source interrater reliability of 360-degree feedback ratings. ''Journal of Applied Psychology'', 83, 960–968. |
*Greguras, G.J., & Robie, C. (1998). A new look at within-source interrater reliability of 360-degree feedback ratings. ''Journal of Applied Psychology'', 83, 960–968. |
||
*Hazucha, J. F., Hezlett, S. A., & Schneider, R. J. (1993). The impact of 360-degree feedback on management skills development. ''Human Resource Management, 32''(2–3), 325–351. |
*Hazucha, J. F., Hezlett, S. A., & Schneider, R. J. (1993). The impact of 360-degree feedback on management skills development. ''Human Resource Management, 32''(2–3), 325–351. |
||
*Johnson, L.K. (2004). |
*Johnson, L.K. (2004). The Ratings Game: Retooling 360s for Better Performance. Harvard Management Update, Vol. 8(1). Retrieved May 7, 2016 at http://hbswk.hbs.edu/archive/3935.html. |
||
*Kaiser, R.B., and Kaplan, R.E. (2006). Are all scales created equal? Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, May, Dallas, TX. |
*Kaiser, R.B., and Kaplan, R.E. (2006). Are all scales created equal? Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, May, Dallas, TX. |
||
*Lee, G.G. (2015). |
*Lee, G.G. (2015). Caution Required: Multirater Feedback in the Army. Military Review, July–August 2015, 58-67. |
||
*Maylett, T. M., & Riboldi, J. (2007). Using 360° Feedback to Predict Performance. ''Training + Development, September'', 48–52. |
*Maylett, T. M., & Riboldi, J. (2007). Using 360° Feedback to Predict Performance. ''Training + Development, September'', 48–52. |
||
*Maylett, Tracy (2005). ''The Relationship Of Multi-rater Feedback To Traditional Performance Appraisal''. Doctoral Dissertation, Pepperdine University, Los Angeles, California. |
*Maylett, Tracy (2005). ''The Relationship Of Multi-rater Feedback To Traditional Performance Appraisal''. Doctoral Dissertation, Pepperdine University, Los Angeles, California. |
||
*Maylett, Tracy (2009). 360-Degree Feedback Revisited: The transition from development to appraisal. |
*Maylett, Tracy (2009). 360-Degree Feedback Revisited: The transition from development to appraisal. ''Compensation and Benefits Review, September/October 41(5),'' 52–59. |
||
*Nooravi, S. Sherry (2010) Transforming high-silo, low-feedback organizational cultures: Using 360-degree feedback and coaching to maximize potential in individuals, groups, and cultures. "Dissertation Abstracts International" 70(12-B). |
*Nooravi, S. Sherry (2010) Transforming high-silo, low-feedback organizational cultures: Using 360-degree feedback and coaching to maximize potential in individuals, groups, and cultures. "Dissertation Abstracts International" 70(12-B). |
||
*Pfau, B. & Kay, I. (2002). Does 360-degree feedback negatively affect company performance? Studies show that 360-degree feedback may do more harm than good. What's the problem? ''HRMagazine'', Jun 2002. 47, ''6''; 54–60. |
*Pfau, B. & Kay, I. (2002). Does 360-degree feedback negatively affect company performance? Studies show that 360-degree feedback may do more harm than good. What's the problem? ''HRMagazine'', Jun 2002. 47, ''6''; 54–60. |
||
Line 91: | Line 80: | ||
*Seifert, C., Yukl, G., & McDonald, R. (2003). Effects of multisource feedback and a feedback facilitator on the influence of behavior of managers toward subordinates. ''Journal of Applied Psychology, 88''(3), 561–569. |
*Seifert, C., Yukl, G., & McDonald, R. (2003). Effects of multisource feedback and a feedback facilitator on the influence of behavior of managers toward subordinates. ''Journal of Applied Psychology, 88''(3), 561–569. |
||
*Smither, J.W., London, M., and Reilly, R.R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis and review of empirical findings. ''Personnel Psychology'', 58, 33–66. |
*Smither, J.W., London, M., and Reilly, R.R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis and review of empirical findings. ''Personnel Psychology'', 58, 33–66. |
||
*Theron, D. & Roodt, G. (1999). |
*Theron, D. & Roodt, G. (1999). Variability in multi-rater competency assessments. Journal of Industrial Psychology, 25(2): 21-27. |
||
*Vinson, M. (1996, April). The pros and cons of 360-degree feedback: Making it work. ''Training and Development, April'', 11–12. |
*Vinson, M. (1996, April). The pros and cons of 360-degree feedback: Making it work. ''Training and Development, April'', 11–12. |
||
*Waldman, A. D., Atwater, L. E., & Antonioni, D. (1998). Has 360-degree feedback gone amok? ''The Academy of Management Executive'', 12(2), 86–94. |
*Waldman, A. D., Atwater, L. E., & Antonioni, D. (1998). Has 360-degree feedback gone amok? ''The Academy of Management Executive'', 12(2), 86–94. |
||
*Walker, A., & Smither, J.W. |
*Walker, A., & Smither, J.W. (1999). A five-year study of upward feedback: What managers do with their results matters. ''Personnel Psychology, 52''(2), 393–423. |
||
*Wilkie, D. (2016). |
*Wilkie, D. (2016). "Are Anonymous Reviews Destructive?" Society of Human Resources Management Online. Retrieved May 7, 2016 at www.shrm.org/hrdisciplines/employeerelations/articles/pages/360-degree-reviews-.aspx. |
||
*Yammarino, F. J., & Atwater, L. E. (1993). Self-perception accuracy: Implications for human resource management. ''Human Resource Management, 32''(2&3), 231–235. |
*Yammarino, F. J., & Atwater, L. E. (1993). Self-perception accuracy: Implications for human resource management. ''Human Resource Management, 32''(2&3), 231–235. |
||
}} |
}} |
||
{{Authority control}} |
|||
[[Category:Job evaluation]] |
[[Category:Job evaluation]] |
Latest revision as of 15:16, 28 September 2024
360-degree feedback (also known as multi-rater feedback, multi-source feedback, or multi-source assessment) is a process through which feedback from an employee's colleagues and associates is gathered, in addition to a self-evaluation by the employee.
360-degree feedback can include input from external sources who interact with the employee (such as customers and suppliers), subordinates, peers, and supervisors. It differs from traditional performance appraisal, which typically uses downward feedback delivered by supervisors employees, and upward feedback delivered to managers by subordinates.
Organizations most commonly use 360-degree feedback for developmental purposes. Nonetheless, organizations are increasingly using 360-degree feedback in performance evaluations and administrative decisions, such as in payroll and promotion. When 360-degree feedback is used for performance evaluation purposes, it is sometimes called a 360-degree review. The use of 360-degree feedback in evaluation is controversial, due to concerns about the subjectivity and fairness of feedback providers.
History
[edit]The origins of 360-degree feedback date back to around 1930, with the German Reichswehr, when the military psychologist Johann Baptist Rieffert developed a selection methodology for officer candidates. One of the earliest recorded uses of surveys to gather information about employees occurred in the 1950s at the Esso Research and Engineering Company.[1] From there, the idea of 360-degree feedback gained momentum.
Online evaluation tools led to increased popularity of multi-rater feedback assessments, due to the ease of use compared to physical pen-and-paper tools.[2] The outsourcing of human resources functions has also created a market for 360-degree feedback products from consultants.[3] Today, studies suggest that over one-third of U.S. companies use some type of multi-source feedback,[4] including 90% of all Fortune 500 firms.[5] In recent years, multi-source feedback has become a best practice in human resources due to online tools such as multiple language options, comparative reporting, and aggregate reporting.[6]
Guidelines
[edit]Certain guidelines emphasise establishing trust between raters and ratees to improve rater accountability and feedback accuracy.[7] At the same time, anonymous participation has also been found to result in more accurate feedback, in which case confidentiality among human resources staff and managers should be preserved.[7] The standardisation and optimisation of rating scales and data collection also affects assessment accuracy, including such factors like the time of day.[7][8][9]
Issues
[edit]Using 360-degree feedback tools for appraisal purposes has been criticised over concerns of performance criteria validity, ability of peers to give accurate feedback, and manipulation of these systems by feedback providers.[10][11][12] Employee manipulation of feedback ratings has been reported in some companies who have utilized 360-degree feedback for performance evaluation, including GE,[13] IBM,[14] and Amazon.[15]
The amount and level of training in 360-degree feedback for both the rater and ratee can affect the level of accuracy of the feedback. If no guidance is given, individual bias may affect the rater's ratings and the ratee's interpretation of the feedback.[8] However, even with training measures in place, unconscious bias may still occur due to factors such as the cultural influences or relationship quality between the rater and ratee.[9] Additionally, if there are potential consequences from rater feedback, rater motivation may shift from providing accurate feedback to providing feedback based on self-motivated reasons such as promoting or harming a particular individual.[8][16]
Some members of the U.S. military have criticized its use of 360-degree feedback programs in employment decisions because of problems with validity and reliability.[17] Other branches of the U.S. government have questioned 360-degree feedback reviews as well.[18] Still, these organizations continue to use and develop their assessments in developmental processes.[19]
A study on the patterns of rater accuracy shows that the length of time that a rater has known the individual being evaluated generally correlates with positive review favorability and lower accuracy of a 360-degree review, apart from raters who have known the individual for less than a year.[20]
It has been suggested that multi-rater assessments often generate conflicting opinions and that there may be no way to determine whose feedback is accurate.[21] Studies have also indicated that self-ratings are generally significantly higher than the ratings given from others.[22]
Results
[edit]Several studies indicate that the use of 360-degree feedback helps to improve employee performance because it helps the evaluated see different perspectives of their performance.[23]
In a 5-year study, no improvement in overall rater scores was found from the 1st year to the 2nd, but scores rose with each passing year from 2nd to 4th.[24] A 1996 study found that performance increased between the 1st and 2nd administrations, and sustained this improvement 2 years later.[25] Additional studies show that 360-degree feedback may be predictive of future performance.[26]
Some authors maintain, however, that there are too many confounding variables related to 360-degree evaluations to reliably generalize their effectiveness,[27] arguing that process features are likely to have major effects on creating behavior change.[28] A 1998 study has found that the category of rater affects the reliability of feedback, with direct reports generally the least reliable.[29]
Multiple pieces of research have demonstrated that the scale of responses can have a major effect on the results, and that some response scales are better than others.[30] The evaluated individual following up with raters to discuss their results, which cannot be done when feedback is anonymous, often has a profound impact on results.[31] Other potentially powerful factors affecting behavior change include how raters are selected, manager approval, instrument quality, rater training and orientation, participant training, supervisor training, coaching, integration with HR systems, and accountability.[32]
One group of studies proposed four paradoxes that explain why 360-degree evaluations do not elicit accurate data:
- The Paradox of Roles, in which an evaluator is conflicted by being both peer and the judge
- The Paradox of Group Performance, which admits that the vast majority of work done in a corporate setting is done in groups, not individually
- The Measurement Paradox, which shows that qualitative, or in-person, techniques are much more effective than mere ratings in facilitating change
- The Paradox of Rewards, which shows that individuals evaluating their peers care more about the rewards associated with finishing the task than the actual content of the evaluation itself.[33]
Additional studies found no correlation between an employee's multi-rater assessment scores and performance appraisal scores provided by supervisors.[34] They advise that although multi-rater feedback can be effectively used for appraisal, care needs to be taken in its implementation or results will be compromised.[35] This research suggests that 360-degree feedback and performance appraisals get at different outcome, leading some executives to argue that traditional performance appraisals and 360-degree feedback should be used in evaluating overall performance.[36]
References
[edit]- ^ Bracken, Dalton, Jako, McCauley, & Pollman, 1997
- ^ Atkins & Wood, 2002
- ^ Johnson, Lauren Keller (January 2004). "The Ratings Game: Retooling 360s for Better Performance". Harvard Management Update.
- ^ Bracken, Timmereck, & Church, 2001a
- ^ Edwards & Ewen, 1996
- ^ Bracken, Summers, & Fleenor, 1998
- ^ a b c Fleenor, John W. (2020). Leveraging the impact of 360-degree feedback. Taylor, Sylvester; Chappelow, Craig (Second ed.). Oakland, CA. ISBN 978-1-5230-8835-5. OCLC 1159679868.
{{cite book}}
: CS1 maint: location missing publisher (link) - ^ a b c Bracken, David W.; Rose, Dale S.; Church, Allan H. (December 2016). "The Evolution and Devolution of 360° Feedback". Industrial and Organizational Psychology. 9 (4): 761–794. doi:10.1017/iop.2016.93. ISSN 1754-9426.
- ^ a b Ainsworth, Elva R. (12 April 2016). 360° feedback : a transformational approach. St Albans. ISBN 978-1-78452-244-5. OCLC 1031336375.
{{cite book}}
: CS1 maint: location missing publisher (link) - ^ Bracken, David R. (September 1994). "Straight Talk about Multirater Feedback". Training & Development.
- ^ Bracken & Rose, 2011; Maylett 2009
- ^ Waldman et al., 1998
- ^ (Welch 2001)
- ^ (Linman 2011)
- ^ (Kantor and Streitfeld 2015)
- ^ Bracken, David W.; Rose, Dale S. (June 2011). "When Does 360-Degree Feedback Create Behavior Change? And How Would We Know It When It Does?". Journal of Business and Psychology. 26 (2): 183–192. doi:10.1007/s10869-011-9218-5. ISSN 0889-3268. S2CID 145745127.
- ^ Lee, Gregory G. (July–August 2015). "Caution Required: Multirater Feedback in the Army". Military Review.
- ^ Bent, William (September 2015). "Speaking Out: The State Department Needs to Reevaluate Its Use of 360-Degree Reviews". The Foreign Service Journal.
- ^ Cerella, A. (2020). Multi-Source Feedback in the U. S. Army: An Improved Assessment, ProQuest Dissertations and Theses.
- ^ Eichinger, 2004
- ^ Vinson, 1996
- ^ Lublin, 1994; Yammarino & Atwater, 1993; Nowack, 1992
- ^ Hazucha et al., 1993; London & Wohlers, 1991; Walker & Smither, 1999
- ^ Walker & Smither, 1999
- ^ Reilly et al. (1996)
- ^ Maylett & Riboldi, 2007
- ^ Bracken, Timmreck, Fleenor, & Summers, 2001b; Smither, London, & Reilly, 2005.
- ^ Bracken et al. (2001b) and Bracken and Timmreck (2001)
- ^ Greguras and Robie (1998)
- ^ Bracken & Paul, 1993; Kaiser & Kaplan, 2006; Caputo & Roch, 2009; English, Rose, & McClellan, 2009
- ^ Goldsmith and Underhill (2001)
- ^ Bracken et al., 2001b
- ^ Peiperl, Maury (January 2001). "Getting 360-Degree Feedback Right". Harvard Business Review. Retrieved 6 April 2012.
- ^ Maylett, 2005
- ^ Maylett, 2009
- ^ Maylett, Tracy M. (2005). The relationship of multi-rater feedback to traditional performance appraisals (EdD thesis). Pepperdine Univ. Abstract. Retrieved 15 May 2009.
Further reading
[edit]- Atkins, P., & Wood, R. (2002). Self-versus others' ratings as predictors of assessment center ratings: Validation evidence for 360-degree feedback programs. Personnel Psychology, 55(4), 871–904.
- Bracken, D.W., and Paul, K.B. (1993). The effects of scale type and demographics on upward feedback. Paper presented at the Society for Industrial and Organizational Society Annual Conference, May, San Francisco, CA.
- Bracken, D.W., Dalton, M.A., Jako, R.A., McCauley, C.D., & Pollman, V.A. (1997). Should 360-degree feedback be used only for developmental purposes? Greensboro, NC: Center for Creative Leadership.
- Bracken, D.W., Summers, L., & Fleenor, J.W. (1998) High tech 360. Training & Development, August.
- Bracken, D.W., Timmereck, C.W., & Church, A.H. (2001a). The handbook of multisource feedback. San Francisco: Jossey-Bass.
- Bracken, D.W., Timmreck, C.W., Fleenor, J.W., & Summers, L. (2001b). 360 degree feedback from another angle.Human Resource Management, 40 (1), 3–20.
- Bracken, D.W., and Timmreck, C.W. (2001) Guidelines for multisource feedback when used for decision making. In Bracken, D.W., Timmreck, C.W., and Church, A.H. The Handbook of Multisource Feedback. San Francisco: Jossey-Bass.
- Bracken, D.W., Rose, D.S. (2011) "When does 360-degree Feedback create behavior change? And How would we know when it does?",
- Cannon, M.D., & Witherspoon, R. (2005). Actionable feedback: Unlocking the power of learning and performance improvement. Academy of Management Executive, 19(2): 120-134.
- Caputo, P. and Roch, S. (2009) Rating formats and perceptions of performance appraisal fairness. Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, April, New Orleans, LA.
- DeNisi, A., & Kluger, A. (2000). Feedback effectiveness: Can 360-degree appraisals be improved? Academy of Management Executive, 14(1): 129-139.
- DeNisi, A., & Kluger, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2): 254-284.
- Edwards, Mark R., & Ewen, Ann J. (1996). 360° Feedback: The powerful new model for Employee Assessment & performance improvement. New York: AMACOM American Management Association.
- Eichinger, Robert. (2004). Patterns of Rater Accuracy in 360-degree Feedback. Perspectives, 27, 23–25.
- English, A.E, Rose, D.S. & McClellan (2009). Rating scale label effects on leniency bias in 360-degree feedback.Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, April, New Orleans, LA.
- Fleenor, J. W., & Prince, J. M. (1997). Using 360-degree feedback in organizations: An annotated bibliography. Greensboro, NC: Center for Creative Leadership.
- Goldsmith, M., & Underhill, B.O. (2001). Multisource feedback for executive development. In Bracken, D.W., Timmreck, C.W., and Church, A.H. The Handbook of Multisource Feedback. San Francisco: Jossey-Bass.
- Greguras, G.J., & Robie, C. (1998). A new look at within-source interrater reliability of 360-degree feedback ratings. Journal of Applied Psychology, 83, 960–968.
- Hazucha, J. F., Hezlett, S. A., & Schneider, R. J. (1993). The impact of 360-degree feedback on management skills development. Human Resource Management, 32(2–3), 325–351.
- Johnson, L.K. (2004). The Ratings Game: Retooling 360s for Better Performance. Harvard Management Update, Vol. 8(1). Retrieved May 7, 2016 at http://hbswk.hbs.edu/archive/3935.html.
- Kaiser, R.B., and Kaplan, R.E. (2006). Are all scales created equal? Paper presented at the Society for Industrial and Organizational Psychology Annual Conference, May, Dallas, TX.
- Lee, G.G. (2015). Caution Required: Multirater Feedback in the Army. Military Review, July–August 2015, 58-67.
- Maylett, T. M., & Riboldi, J. (2007). Using 360° Feedback to Predict Performance. Training + Development, September, 48–52.
- Maylett, Tracy (2005). The Relationship Of Multi-rater Feedback To Traditional Performance Appraisal. Doctoral Dissertation, Pepperdine University, Los Angeles, California.
- Maylett, Tracy (2009). 360-Degree Feedback Revisited: The transition from development to appraisal. Compensation and Benefits Review, September/October 41(5), 52–59.
- Nooravi, S. Sherry (2010) Transforming high-silo, low-feedback organizational cultures: Using 360-degree feedback and coaching to maximize potential in individuals, groups, and cultures. "Dissertation Abstracts International" 70(12-B).
- Pfau, B. & Kay, I. (2002). Does 360-degree feedback negatively affect company performance? Studies show that 360-degree feedback may do more harm than good. What's the problem? HRMagazine, Jun 2002. 47, 6; 54–60.
- Reilly, R., Smither, J.W., & Vasilopoulos, N. (1996). A longitudinal study of upward feedback. Personnel Psychology, 49(3), 599–612.
- Seifert, C., Yukl, G., & McDonald, R. (2003). Effects of multisource feedback and a feedback facilitator on the influence of behavior of managers toward subordinates. Journal of Applied Psychology, 88(3), 561–569.
- Smither, J.W., London, M., and Reilly, R.R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis and review of empirical findings. Personnel Psychology, 58, 33–66.
- Theron, D. & Roodt, G. (1999). Variability in multi-rater competency assessments. Journal of Industrial Psychology, 25(2): 21-27.
- Vinson, M. (1996, April). The pros and cons of 360-degree feedback: Making it work. Training and Development, April, 11–12.
- Waldman, A. D., Atwater, L. E., & Antonioni, D. (1998). Has 360-degree feedback gone amok? The Academy of Management Executive, 12(2), 86–94.
- Walker, A., & Smither, J.W. (1999). A five-year study of upward feedback: What managers do with their results matters. Personnel Psychology, 52(2), 393–423.
- Wilkie, D. (2016). "Are Anonymous Reviews Destructive?" Society of Human Resources Management Online. Retrieved May 7, 2016 at www.shrm.org/hrdisciplines/employeerelations/articles/pages/360-degree-reviews-.aspx.
- Yammarino, F. J., & Atwater, L. E. (1993). Self-perception accuracy: Implications for human resource management. Human Resource Management, 32(2&3), 231–235.