The Problem with a "one size fits all" Assessment List

Together with the Danish Business Authority, I am personally developing the Danish equivalent of the Trustworthy AI Assessment List.

Initially, I was appointed by the government to a work group that was to provide the Danish government with recommendations on Data Ethics. As an AI specialist, the recommendation I envisioned and championed, was that AI developers were given a toolbox, that could help them develop ethical solutions: 

This Data Ethical Toolbox is what I am developing now. This means that together with the Danish Business Authority, I am devising an assessment list targeting AI developers. We are putting together a scoring system inspired by the Canadian model, where the AI solution will be scored on the parameters (or main focus areas): "Bias", "Personal Data" and "Transparency/Explainability", targeting AI-developers specifically. 

In short, the questions/answers will lead to a profile and actual recommendations on what to do in practice.

I just completed the Survey on the Trustworthy AI Assessment List 2.0 (Developer and deployer questionnaire) and it seemed apparent that the assessment list tries to address all issues regarding all levels of an AI solution being developed and

deployed. The problem with this, is that it has to address technical and non-technical project participants in the same wording and context. I believe a version focused on the Programmers and developers is needed.

Programmers and developers are the people actually shaping the solutions and much of their ethical fabric 

My own experiences as a AI project manager, AI-Architect and AI-developer has taught me that guidelines and good intentions from a managerial perspective are easily diluted and have little impact. It is better utilized as tools and references aimed at the people actually making these AI- and data-driven solutions that we keep talking about. I would love to engage in further discussions on I see this being done, so feel free to reach out.

Tags
AI Dataethics inpractice Best Practice Trustworthy AI

Kommentare

Antwort auf von faiz ikramulla

Profile picture for user n002u7st
Von Erik David Johnson am Do., 31/10/2019 - 16:30

I am happy to - I sent you a message

Profile picture for user n002yhrz
Von faiz ikramulla am Do., 31/10/2019 - 16:22

hi, i would also love to engage in further discussion on your last paragraph: "Programmers and developers are the people actually shaping the solutions and much of their ethical fabric".  ethics can easily be overlooked, forgotten, or mistakes made, yet solutions build on these oversights are deployed and potentially (at least slightly) flawed as a result.  how can oversight and guidelines play into the AI development world, from a technical perspective?  it is one of my interest area, and i am interesting in discussing and learning from others experiences.