Tag: fairness

21 links

ai.googleblog.com > Candice Schumann and Susanna Ricco
A Step Toward More Inclusive People Annotations in the Open Images Extended Dataset
15 jun. 2021 - In 2016, we introduced Open Images, a collaborative release of ~9 million images annotated with image labels spanning thousands of object categories and bounding box annotations for 600 classes. Since then, we have made several updates, including the release of crowdsourced data to the Open Images Extended collection to improve diversity of object annotations. While the labels provided with these datasets were expansive, they did not focus on sensitive attributes for people, which are critically important for many machine learning (ML) fairness tasks, such as fairness evaluations and bias mitigation. In fact, finding datasets that include thorough labeling of such sensitive attributes is difficult, particularly in the domain of computer vision.
 · fairness · gender · google-streetview · machine-learning · responsible-ai

arxiv.org > Bogdan Kulynych, Carmela Troncoso, Ero Balsa, Rebekah Overdorf and Seda Gürses
Questioning the assumptions behind fairness solutions
27 nov. 2018 - In addition to their benefits, optimization systems can have negative economic, moral, social, and political effects on populations as well as their environments. Frameworks like fairness have been proposed to aid service providers in addressing subsequent bias and discrimination during data collection and algorithm design. However, recent reports of neglect, unresponsiveness, and malevolence cast doubt on whether service providers can effectively implement fairness solutions. These reports invite us to revisit assumptions made about the service providers in fairness solutions. Namely, that service providers have (i) the incentives or (ii) the means to mitigate optimization externalities. Moreover, the environmental impact of these systems suggests that we need (iii) novel frameworks that consider systems other than algorithmic decision-making and recommender systems, and (iv) solutions that go beyond removing related algorithmic biases. Going forward, we propose Protective Optimization Technologies that enable optimization subjects to defend against negative consequences of optimization systems.
 · fairness · not-read

phenomenalworld.org > Cosmo Grant
Is it impossible to be fair?
23 aug. 2019 - This post is about fairness. In particular, it's about some interesting recent results, which came out of attempts to check whether particular automated prediction tools were fair, but which seem to have a more general consequence: that in a wide variety of situations it's impossible to make fair predictions. As Kleinberg et al. put it in their abstract: "These results suggest some of the ways in which key notions of fairness are incompatible with each other."
 · algorithmic-bias · compas · fairness · machine-learning · prediction · probability · statistics

www.californialawreview.org > Andrew D. Selbst and Solon Barocas
Big Data’s Disparate Impact
1 jun. 2016 - Advocates of algorithmic techniques like data mining argue that these techniques eliminate human biases from the decision-making process. But an algorithm is only as good as the data it works with. Data is frequently imperfect in ways that allow these algorithms to inherit the prejudices of prior decision makers. In other cases, data may simply […]
 · algorithmic-bias · black-struggle · data-mining · fairness · project-hva · racist-technology · recruitment

www.kevindorst.com > Brian Hedden
How (Not) to Test for Algorithmic Bias
Predictive and decision-making algorithms are playing an increasingly prominent role in our lives. They help determine what ads we see on social media, where police are deployed, who will be given a loan or a job, and whether someone will be released on bail or granted parole. Part of this is due to the recent rise of machine learning. But some algorithms are relatively simple and don’t involve any AI or ‘deep learning.’
 · algorithmic-bias · black-struggle · compas · fairness · justice · philosophy · polarization · project-hva · racist-technology