Why AI Owners and AI Users Have Conflicting Interests?

If you make and commercialize high quality #AI, you are also likely to have conflicting interests with users. Here’s why. #MachineLearning #AIeconomics #incentives #economics pic.twitter.com/J8oorXo1dh
— ivanjureta (@ivanjureta) February 22, 2018
If an AI is not predictable by design, then the purpose of governing it is to ensure that it gives the right answers (actions) most of the time, and that when it fails, the consequences are negligible, or that it can only fail on inconsequential questions, goals, or tasks.
“Objective”, as in, for example, “what I’m saying is objective”, or “that statement is objective”, or “we need objective criteria when making these decisions”, is a complicated term. It takes a lot of effort to make sure it is understood as intended (or closely enough). It is therefore a costly word to use. Why is…
In a firm, what is the relationship between transparency of information and specialization of work? Increasing specialization means that individuals over time deepen a relatively narrow set of skills and knowledge required for these, in response to the opportunities and problems they are responsible for. There are organizational structures that evidently encourage specialization, such as…
If we know who the stakeholders are, when designing decision governance, then we need to know their interests, so that we can make sure these are met through the decision process.
The short answer is “No”, and the reasons for it are interesting. An AI system is opaque if it is impossible or costly for it (or people auditing it) to explain why it gave some specific outputs. Opacity is undesirable in general – see my note here. So this question applies for both those outputs…
Decision rights will be exercised, and decision obligations discharged only if there are incentives to do so. If you need to make a decision and bear the consequences, i.e., exercise decision rights and discharge obligations, the only reason to do so is if you see how it makes sense with regards to what you want….