User:Hwd3400/Amazon Rekognition
| Developer(s) | Amazon, Amazon Web Services |
|---|---|
| Initial release | 30 November 2016[1] |
| Type | Software as a service |
| Website | aws |
Amazon Rekognition is a cloud-based Software as a service (SaaS) computer vision platform that was launched in 2016.
Capabilities
[edit]Rekognition provides a number of computer vision capabilities, which can be divided into two categories: Algorithms that are pre-trained on data collected by Amazon or its partners, and algorithms that a user can train on their own data.
As of July 2019, Rekognition provides the following computer vision capabilities.[1][2]
Pre-trained algorithms
[edit]- Celebrity recognition in images[3][4]
- Facial attribute detection in images, including gender, age range, emotions (e.g. happy, calm, disgusted), whether the face has a beard or mustache, whether the face has eyeglasses or sunglasses, whether the eyes are open, whether the mouth is open, whether the person is smiling, and the location of several markers such as the pupils and jaw line.[5][6]
- People Pathing enables tracking of people through a video. An advertised use-case of this capability is to track sports players for post-game analysis.[7][1]
- Text detection and classification in images[8][9]
- Unsafe visual content detection[10]
Algorithms that a user can train on their own data
[edit]- SearchFaces enables users to import a database of images with pre-labeled faces, to train a machine learning model on this database, and to expose the model as a cloud service with an API. Then, the user can post new images to the API and receive information about the faces in the image. The API can be used to expose a number of capabilities, including identifying faces of known people, comparing faces, and finding similar faces in a database.[11][12]
- Face-based user verification[1]
Uses
[edit]- In late 2017, the Washington County, Oregon Sheriff's Office began using Rekognition to identify suspects' faces. Rekognition was marketed as a general-purpose computer vision tool, and an engineer working for Washington County decided to use the tool for facial analysis of suspects.[12][13]
- In April 2018, it was reported that FamilySearch is using Rekognition to enable their users to "see which of their ancestors they most resemble based on family photographs."[14]
- In May 2018, it was reported that Orlando, Florida was running a pilot using Rekognition for facial analysis in law enforcement.[15] That pilot ended in July 2019.[16]
- In September 2018, it was reported that Mapillary is using Rekognition to read the text on parking signs (e.g. no stopping, no parking, or specific parking hours) in cities.[9]
Controversy regarding facial analysis
[edit]Racial and gender bias
[edit]In 2018, researchers Joy Buolamwini and Timnit Gebru published a study called Gender Shades.[17][18] In this study, a set of images was collected, and faces in the images were labeled with face position, gender, and skin tone information. The images were run through SaaS facial recognition platforms from Megvii Face++, IBM, and Microsoft. In all three of these platforms, the classifiers performed best on male faces (with error rates on female faces being 8.1% to 20.6% higher than error rates on male faces), and they performed worst on dark female faces (with error rates ranging from 20.8% to 30.4%). The authors hypothesized that this discrepancy is due principally to Megvii, IBM, and Microsoft having more light males than dark females in their training data, i.e. dataset bias.
In January 2019, researchers Inioluwa Deborah Raji and Joy Buolamwini published a follow-up paper that ran the experiment again a year later, on the latest versions same three SaaS facial recognition platforms, plus two additional platforms: Kairos, and Amazon Rekognition.[19][20] While the systems' overall error-rates improved over the previous year, all five of the algorithms again demonstrated better than average error-rates for male faces, and significantly worse than average error-rates for dark female faces.
Gender classification of transgender and nonbinary individuals
[edit]Rekognition's gender identification technology categorizes faces as only male or female, with no other options. Critics have identified a number of disadvantages of this approach. First, there is no category for individuals nonbinary gender.[21] Second, in an experiment conducted by a journalist, it was found that Rekognition is less accurate at identifying the gender of transgender individuals than of cisgender individuals.[22]
See also
[edit]- Amazon Lex
- Amazon Mechanical Turk
- Amazon Polly
- Amazon SageMaker
- Amazon Web Services
- Timeline of Amazon Web Services
References
[edit]- ^ a b c d Lardinois, Frederic (2016-11-30). "Amazon launches Amazon AI to bring its machine learning smarts to developers". Retrieved 2019-07-21.
- ^ "What Is Amazon Rekognition?". Amazon Rekognition Developer Guide. Retrieved 2019-07-21.
- ^ "What is the Celebrity Recognition API? Is that the same or different than doing a face search?". AWS. Retrieved 2019-07-21.
- ^ Lardinois, Frederic (2016-06-08). "Amazon Rekognition can now recognize celebrities". TechCrunch. Retrieved 2019-07-21.
- ^ "Detecting Faces in an Image". Amazon Rekognition Developer Guide. Retrieved 2019-07-21.
- ^ "Amazon Rekognition launches enhanced face analysis". Planet Biometrics. 2019-03-19. Retrieved 2019-07-21.
- ^ "People Pathing". Amazon Rekognition Developer Guide. Retrieved 2019-07-21.
- ^ "Detecting Text". Amazon Rekognition Developer Guide. Retrieved 2019-07-21.
- ^ a b O'Brien, Chris (2018-09-13). "Mapillary will use Amazon Rekognition in effort to ease urban parking crunch". Venture Beat. Retrieved 2019-07-21.
- ^ "Detecting Unsafe Content". Amazon Rekognition Developer Guide. Retrieved 2019-07-21.
- ^ "Searching Faces in a Collection". Amazon Rekognition Developer Guide. Retrieved 2019-07-21.
- ^ a b "Amazon's facial-recognition technology is supercharging Washington County police". Oregon Live. Retrieved 2019-07-21.
- ^ "Amazon Rekognition Customers". AWS. Retrieved 2019-07-21.
- ^ "Amazon Rekognition Improves Accuracy of Real-Time Face Recognition and Verification". AWS. 2018-04-02. Retrieved 2019-07-21.
- ^ Brandom, Russell (2018-05-22). "Amazon is selling police departments a real-time facial recognition system". The Verge. Retrieved 2019-07-21.
- ^ Statt, Nick (2019-07-18). "Orlando police once again ditch Amazon's facial recognition software". The Verge. Retrieved 2019-07-21.
- ^ Buolamwini, Joy; Gebru, Timnit (2018). "Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification" (PDF). Proceedings of Machine Learning Research.
- ^ Quach, Katyanna (2018-02-13). "Facial recognition software easily IDs white men, but error rates soar for black women". The Register. Retrieved 2019-07-21.
- ^ Raji, Inioluwa Deborah; Buolamwini, Joy (2019-01-27). "Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products" (PDF). AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society.
- ^ Wiggers, Kyle (2019-01-24). "MIT researchers: Amazon's Rekognition shows gender and ethnic bias (updated)". Venture Beat. Retrieved 2019-07-21.
- ^ Johnson, Khari (2019-04-24). "A transgender AI researcher's nightmare scenarios for facial recognition software". Venture Beat. Retrieved 2019-07-21.
- ^ Merlan, Anna; Mehrotra, Dhruv (2019-06-27). "Amazon's Facial Analysis Program Is Building A Dystopic Future For Trans And Nonbinary People". Jezebel. Retrieved 2019-07-21.