You wouldn't normally expect to come across a reference to deontic logic in a Bloomberg opinion piece but a recent article on the perceived dangers and possible downside of artificial intelligence cites a paper [PDF] which, drawing on formal logical and ethical theory, proposes a method for creating an 'artificial conscience' for a military-oriented robotic agent.
The paper, by Ronald C. Arkin, "provides representational and design recommendations for the implementation of an ethical control and reasoning system potentially suitable for constraining lethal actions in an autonomous robotic system so that they fall within the bounds prescribed by the Laws of War and Rules of Engagement." *
What interested me particularly was seeing basic logical and ethical theory being seriously discussed and applied in such a context.
Arkin sees virtue-based approaches as not being suitable for his purposes because they are heavily reliant on interpretation and on cultural factors and so are not amenable to formalization. Utilitarian approaches may be amenable to formalization but, because they are not geared to utilize the concept of human rights, do not easily accommodate the sorts of values and outcomes upon which the research is particularly focussed (e.g. protecting civilians or not using particular types of weapon).
So Arkin opts for a basically deontological approach, but a scaled-down version which does not purport to derive its rules or guidelines from first principles or from a universal principle like Kant's Categorical Imperative.
Arkin's recommended design would incorporate and implement sets of specific rules based on the just war tradition and various generally accepted legal and moral conventions and codes of behavior pertaining to warfare.
He points out that machines programmed on such a basis would be likely to be more reliably moral than human agents partly because they would be unemotional, lacking, for example, the strong sense of self-preservation which can sometimes trigger the use of disproportionate force in human agents.
The main problem as I see it is that, in general terms, the more morally constrained the robot is, the less effective it will be purely as a fighting machine and so there will be an ever-present temptation on the part of those who are deploying such machines to scale back – or entirely eliminate – the artificial conscience.
Although the need to maintain the support of a public very sensitive to moral issues relating to such matters as torture and the safety of non-combatants would lesson such temptations for the U.S. military and its traditional allies, it would be foolish to imagine that other players and forces less committed to applying ethical principles to the conduct of war would not get access to these technologies also.
* Arkin is based at Georgia Tech, and the research is funded by the U.S. Army Research Office.
Showing posts with label ethics. Show all posts
Showing posts with label ethics. Show all posts
Saturday, August 16, 2014
Tuesday, May 21, 2013
The view from Nagel-land
I said I would follow up on Thomas Nagel's views. The first twenty minutes or so* of the video inserted below is a talk in which Nagel summarizes and critiques his friend Ronald Dworkin's view of morality. Nagel speaks (as he writes) with great clarity and seriousness. (I realize that many will find the content a bit dry, but there is interest also in the style of delivery, in the very manner of the man. Ivy League and very 20th century!)
Dworkin wants ethics to be objective, and has a clever argument which appears to demonstrate that moral claims can indeed be seen as objectively true or false even within the context of a naturalistic world view.
Nagel – correctly in my view – sees our current naturalistic world view (he refers specifically to evolutionary theory) as being "difficult to square with" the objectivity of moral claims. But, as he is not willing – for moral reasons, apparently – to give up on the objectivity of right and wrong, he rejects the current naturalistic world view.
This last move is a grievous mistake, in my opinion. He is saying, in effect, that it would be just too awful if right and wrong did not have an objective basis – and so they do have an objective basis, and the scientists must have got things seriously wrong.
I respect Nagel's honesty and directness. He goes with his moral intuitions, but I would say that they take him out of the secular mainstream.
Nagel's move in this talk, by the way, needs to be seen in the context of his long-standing insistence that science, which aspires to an objective 'view from nowhere', is incomplete for it cannot encompass or explain the reality and the realities of the first-person point of view.
This idea is associated with (because it can be used to justify) what I see as the main problem with Nagel's thinking: that he lacks, and shows little interest in, scientific knowledge.
This may not matter for certain kinds of intellectual enquiry, but scientific issues (especially relating to evolutionary biology and physics) are crucial to many of the questions Nagel addresses.
In fact, his obvious (and self-confessed) lack of knowledge in these areas makes it difficult to take his reflections on human psychology or human evolutionary or cosmic history (most recently expressed in his book Mind and Cosmos) seriously.
I don't want to posit a simplistic contrast between scientifically-trained thinkers and those with little or no scientific training, however, and suggest that only the former are worth listening to. The scientifically trained can be just as stupid and irrational as anyone else.
But it does seem reasonable to expect anyone dealing in a serious way with questions pertaining to a particular area of science to have a thorough grounding in that area, or at least in a related area of science.
* The most interesting bit, in my opinion, starts at the 14:20 mark.
Dworkin wants ethics to be objective, and has a clever argument which appears to demonstrate that moral claims can indeed be seen as objectively true or false even within the context of a naturalistic world view.
Nagel – correctly in my view – sees our current naturalistic world view (he refers specifically to evolutionary theory) as being "difficult to square with" the objectivity of moral claims. But, as he is not willing – for moral reasons, apparently – to give up on the objectivity of right and wrong, he rejects the current naturalistic world view.
This last move is a grievous mistake, in my opinion. He is saying, in effect, that it would be just too awful if right and wrong did not have an objective basis – and so they do have an objective basis, and the scientists must have got things seriously wrong.
I respect Nagel's honesty and directness. He goes with his moral intuitions, but I would say that they take him out of the secular mainstream.
Nagel's move in this talk, by the way, needs to be seen in the context of his long-standing insistence that science, which aspires to an objective 'view from nowhere', is incomplete for it cannot encompass or explain the reality and the realities of the first-person point of view.
This idea is associated with (because it can be used to justify) what I see as the main problem with Nagel's thinking: that he lacks, and shows little interest in, scientific knowledge.
This may not matter for certain kinds of intellectual enquiry, but scientific issues (especially relating to evolutionary biology and physics) are crucial to many of the questions Nagel addresses.
In fact, his obvious (and self-confessed) lack of knowledge in these areas makes it difficult to take his reflections on human psychology or human evolutionary or cosmic history (most recently expressed in his book Mind and Cosmos) seriously.
I don't want to posit a simplistic contrast between scientifically-trained thinkers and those with little or no scientific training, however, and suggest that only the former are worth listening to. The scientifically trained can be just as stupid and irrational as anyone else.
But it does seem reasonable to expect anyone dealing in a serious way with questions pertaining to a particular area of science to have a thorough grounding in that area, or at least in a related area of science.
* The most interesting bit, in my opinion, starts at the 14:20 mark.
Labels:
ethics,
morality,
naturalism,
objectivity,
science,
Thomas Nagel
Sunday, April 14, 2013
Descriptive and normative approaches to ethics
[This piece is a substantially-revised version of an earlier post, 'Ethics in a nutshell'.]
Meta-ethical questions are a bit like questions in the philosophy of mathematics, where various forms of platonism or realism do battle with more mundane interpretations. The key difference, I would suggest, is that the philosophy of mathematics has very little impact on the way mathematics is done, whereas meta-ethical disputes do impinge on normative (or prescriptive) ethics as practised by philosophers (though not, it must be said, on most ordinary ethical decision-making).
Unfortunately, meta-ethical disputes (which are often driven by deeply-felt convictions about the nature of human life and reality) are not readily resolvable, posing problems not only for meta-ethics but also for normative ethics.
Moral reasoning is complex and difficult enough, even if one is working – like many religious thinkers – within a generally accepted broader framework. But if there is no agreed-upon framework then conclusions are going to be – to say the least – very contestable.
And what of science? Science can, I believe, change the way we see the world in a way that philosophy can't. Though there is an important distinction to be maintained between the descriptive and the normative, between scientific and value-based judgements, science can undoubtedly offer new insights into value-based questions.
Our evolving understanding of the natural world and our place in it has a profound impact not only on how we see particular moral issues but also on how we frame and respond to general questions about human values, responsibility and freedom.
For example, 'ought' implies 'can', and the findings of science have a lot to say on what is realistically possible in terms of human behavior and what is not.
More generally, as our knowledge of human psychology has advanced, there have been – and there will continue to be – changes, both subtle and profound, in the way we think about right and wrong and conscience and guilt – and also changes to institutional mechanisms for dealing with anti-social and criminal behavior.
One approach to descriptive ethics which is not strictly scientific but which complements more rigorous approaches involves looking at how adjectives like 'ethical' and 'moral', auxiliaries like 'should' and nouns like 'obligation' or 'duty' are actually used in ordinary day-to-day contexts, and attempting to discern the implicit social rules and expectations which underlie the use of such expressions.
Every society, every social group, incorporates implicit rules of behavior. These rules (some relating to etiquette or manners, others to morality) can be studied and described like any other aspect of social life, though such descriptions will of necessity be incomplete and somewhat interpretive.
These systems of implicit moral rules coexist, of course, with explicit rules, as exemplified in systems of law and regulation. Though my focus here is on the former, it's important to be aware of the subtle, complex and often contentious relations between the two.
Just as the law is a system of enforceable explicit rules, so morality can be seen as a system of implicit rules. And just as the law outlines legal responsibilities and confers certain legal rights, so moral systems can be seen to assign responsibilities and confer certain moral rights. If you break society's explicit laws and are discovered, formal mechanisms of enforcement and justice are set in train. Similarly, if you break implicit moral rules, informal mechanisms (like disapproval and ostracism) will likely be triggered. The basic principle (hard-wired into our brains, perhaps) is that if you flout the rules you forfeit your right to the benefits and protections those rules might potentially provide.
Normative, as distinct from descriptive, approaches to ethics involve the individual actually becoming ethically engaged (rather than just describing what is). This will involve making or accepting or rejecting particular moral judgements or affirming or endorsing or arguing for particular judgements or values. It inevitably involves interpreting social rules, sometimes criticizing, and sometimes rejecting them.
Deontic logic traditionally divides behaviors into three broad classes: obligatory, impermissible and optional. ('Optional', by far the most appealing, is also, plausibly, by far the largest of the three classes.)
It's a complex branch of logic, but the real complications and challenges of practical moral thinking are not so much logical as contextual. Because, obviously, the general situation and the specific position(s) of the individual(s) involved need to be taken fully into account.
Times have changed since F.H. Bradley wrote his famous essay, 'My station and its duties' [a chapter, actually, of his book Ethical Studies (1876)], but the basic principle of the contextuality of ethics still applies. A person's duties or obligations derive in large part from (or at least cannot be assessed without taking into account) his or her positions in complex societal, professional and familial structures.
The key question in ethics is a situated-first-person question: what should I – in a particular situation at a particular time – do (or refrain from doing)? I say this is the key question in ethics, but such a question (and this is reflected in the ambiguity of the word 'should') often goes beyond ethics or morality, and merges with questions of prudence or etiquette or other areas or dimensions of life.
Unacceptable behavior causing serious harm to others, however, is clearly an issue in which ethical (and probably also legal) considerations will dominate.
What of ethical subjectivism? Is it a threat or a problem? My view is that, if normative ethics is seen as something theoretical, as an area of study to be compared and contrasted with descriptive (psychological or sociological) approaches, the former will inevitably suffer from the comparison, especially concerning claims to having an objective basis.
But if, on the other hand, normative ethics is seen in a more practical light, seen as an integral part of actually living and choosing rather than in purely academic or epistemic terms, then questions of objectivity versus subjectivity may not even arise.
The fact is, we are all forced to make ethical and other value-based decisions all the time. And, while empirical knowledge, reason and rational discourse can play an important part in these decisions, other more obscure elements are also inevitably in play.
Meta-ethical questions are a bit like questions in the philosophy of mathematics, where various forms of platonism or realism do battle with more mundane interpretations. The key difference, I would suggest, is that the philosophy of mathematics has very little impact on the way mathematics is done, whereas meta-ethical disputes do impinge on normative (or prescriptive) ethics as practised by philosophers (though not, it must be said, on most ordinary ethical decision-making).
Unfortunately, meta-ethical disputes (which are often driven by deeply-felt convictions about the nature of human life and reality) are not readily resolvable, posing problems not only for meta-ethics but also for normative ethics.
Moral reasoning is complex and difficult enough, even if one is working – like many religious thinkers – within a generally accepted broader framework. But if there is no agreed-upon framework then conclusions are going to be – to say the least – very contestable.
And what of science? Science can, I believe, change the way we see the world in a way that philosophy can't. Though there is an important distinction to be maintained between the descriptive and the normative, between scientific and value-based judgements, science can undoubtedly offer new insights into value-based questions.
Our evolving understanding of the natural world and our place in it has a profound impact not only on how we see particular moral issues but also on how we frame and respond to general questions about human values, responsibility and freedom.
For example, 'ought' implies 'can', and the findings of science have a lot to say on what is realistically possible in terms of human behavior and what is not.
More generally, as our knowledge of human psychology has advanced, there have been – and there will continue to be – changes, both subtle and profound, in the way we think about right and wrong and conscience and guilt – and also changes to institutional mechanisms for dealing with anti-social and criminal behavior.
One approach to descriptive ethics which is not strictly scientific but which complements more rigorous approaches involves looking at how adjectives like 'ethical' and 'moral', auxiliaries like 'should' and nouns like 'obligation' or 'duty' are actually used in ordinary day-to-day contexts, and attempting to discern the implicit social rules and expectations which underlie the use of such expressions.
Every society, every social group, incorporates implicit rules of behavior. These rules (some relating to etiquette or manners, others to morality) can be studied and described like any other aspect of social life, though such descriptions will of necessity be incomplete and somewhat interpretive.
These systems of implicit moral rules coexist, of course, with explicit rules, as exemplified in systems of law and regulation. Though my focus here is on the former, it's important to be aware of the subtle, complex and often contentious relations between the two.
Just as the law is a system of enforceable explicit rules, so morality can be seen as a system of implicit rules. And just as the law outlines legal responsibilities and confers certain legal rights, so moral systems can be seen to assign responsibilities and confer certain moral rights. If you break society's explicit laws and are discovered, formal mechanisms of enforcement and justice are set in train. Similarly, if you break implicit moral rules, informal mechanisms (like disapproval and ostracism) will likely be triggered. The basic principle (hard-wired into our brains, perhaps) is that if you flout the rules you forfeit your right to the benefits and protections those rules might potentially provide.
Normative, as distinct from descriptive, approaches to ethics involve the individual actually becoming ethically engaged (rather than just describing what is). This will involve making or accepting or rejecting particular moral judgements or affirming or endorsing or arguing for particular judgements or values. It inevitably involves interpreting social rules, sometimes criticizing, and sometimes rejecting them.
Deontic logic traditionally divides behaviors into three broad classes: obligatory, impermissible and optional. ('Optional', by far the most appealing, is also, plausibly, by far the largest of the three classes.)
It's a complex branch of logic, but the real complications and challenges of practical moral thinking are not so much logical as contextual. Because, obviously, the general situation and the specific position(s) of the individual(s) involved need to be taken fully into account.
Times have changed since F.H. Bradley wrote his famous essay, 'My station and its duties' [a chapter, actually, of his book Ethical Studies (1876)], but the basic principle of the contextuality of ethics still applies. A person's duties or obligations derive in large part from (or at least cannot be assessed without taking into account) his or her positions in complex societal, professional and familial structures.
The key question in ethics is a situated-first-person question: what should I – in a particular situation at a particular time – do (or refrain from doing)? I say this is the key question in ethics, but such a question (and this is reflected in the ambiguity of the word 'should') often goes beyond ethics or morality, and merges with questions of prudence or etiquette or other areas or dimensions of life.
Unacceptable behavior causing serious harm to others, however, is clearly an issue in which ethical (and probably also legal) considerations will dominate.
What of ethical subjectivism? Is it a threat or a problem? My view is that, if normative ethics is seen as something theoretical, as an area of study to be compared and contrasted with descriptive (psychological or sociological) approaches, the former will inevitably suffer from the comparison, especially concerning claims to having an objective basis.
But if, on the other hand, normative ethics is seen in a more practical light, seen as an integral part of actually living and choosing rather than in purely academic or epistemic terms, then questions of objectivity versus subjectivity may not even arise.
The fact is, we are all forced to make ethical and other value-based decisions all the time. And, while empirical knowledge, reason and rational discourse can play an important part in these decisions, other more obscure elements are also inevitably in play.
Friday, January 18, 2013
Ethics in a nutshell
[Note: I am no longer happy with this, and intend to post a revised version soon. April 4]
Ethics and morality are important topics, but much ethical discussion and debate is unenlightening and unproductive.
I have serious reservations about philosophical ethics. Whilst a knowledge of some of the rudiments of ethical theory may be useful for articulating issues and problems, there is no clear way of solving problems or deciding between alternative approaches. The academic study of ethics soon becomes (in my experience) an area of rapidly diminishing returns.
Different people have very different ideas about the scope and nature of ethics, often talking at cross purposes or seeking to promote a cherished agenda by any means, including personal abuse.*
Rather than elaborating ambitious theories or contributing to the revival of Aristotelian or other classical approaches, I am drawn simply to look at how adjectives like 'ethical' and 'moral', auxiliaries like 'should' and nouns like 'obligation' or 'duty' are actually used in ordinary day-to-day contexts, and the implicit social rules with which such expressions are associated.
Every society, every social group incorporates implicit rules of behavior. These rules (some relating to etiquette or manners, others to morality) can be studied and described like any other aspect of social life.
Prescriptive (as distinct from descriptive) approaches involve the individual actually making or accepting or rejecting moral judgements or using or applying moral language or concepts.
Deontic logic traditionally divides behaviors into three broad classes: obligatory, impermissible and optional. It's a complex branch of logic, but the real complications and challenges of moral thinking are not so much logical as contextual. Because, obviously, the general situation and the specific position(s) of the individual(s) involved need to be taken into account.
Times have changed since F.H. Bradley wrote his famous essay, 'My station and its duties' [included in his Ethical Studies (1876)], but the basic principle of the contextuality of ethics still applies. A person's duties or obligations derive in large part from (or at least cannot be assessed without taking into account) his or her positions in complex societal, professional and familial structures.
Kant talked about a categorical imperative, but I don't think we can get beyond hypothetical imperatives. In other words, if you (in such and such a situation) want such and such an outcome, do this or that. With respect to social relations, this way of thinking is never straightforward or foolproof, and requires judgement and insight to be applied successfully.
The kind of (implicit) rule-based approach to ethical thinking and manners which I am advocating is consistent with a very modest view of rights. If you break society's implicit rules whenever it suits you, you forfeit your right to the benefits and protections those rules might potentially provide.
The key question in ethics is a first-person question: what should I do (or refrain from doing)? I say this is the key question in ethics, but such a question (and this is reflected in the ambiguity of the word 'should') transcends ethics or morality.
Ethical or moral questions often merge into questions of etiquette, aesthetics and prudence as well as other areas or dimensions of life. There are no clearcut divisions between ethical and other considerations, in other words, and a certain type of (marginally unacceptable) behavior may be condemned by some as immoral, while others might prefer to call it ugly, unwise or just bad form. Others may see it in a positive light.
Even very serious moral transgressions (like the indiscriminate killing of civilians) are sometimes seen by people in the grip of certain ideologies or belief-systems as praiseworthy.
Most of us, of course, will condemn such ideologies as noxious and depraved. I certainly do. It is not really a problem that we can't prove our view correct and its converse incorrect in some objective, theoretical sense (though many think it is). Ethics is just not like that.
Quite simply, there is no absolute or objective ethical authority, and nor is there any objective method of determining 'moral truths'.
* Here is a summary of a recent controversy involving some very silly and intemperate assertions on the part of one of the protagonists.
Ethics and morality are important topics, but much ethical discussion and debate is unenlightening and unproductive.
I have serious reservations about philosophical ethics. Whilst a knowledge of some of the rudiments of ethical theory may be useful for articulating issues and problems, there is no clear way of solving problems or deciding between alternative approaches. The academic study of ethics soon becomes (in my experience) an area of rapidly diminishing returns.
Different people have very different ideas about the scope and nature of ethics, often talking at cross purposes or seeking to promote a cherished agenda by any means, including personal abuse.*
Rather than elaborating ambitious theories or contributing to the revival of Aristotelian or other classical approaches, I am drawn simply to look at how adjectives like 'ethical' and 'moral', auxiliaries like 'should' and nouns like 'obligation' or 'duty' are actually used in ordinary day-to-day contexts, and the implicit social rules with which such expressions are associated.
Every society, every social group incorporates implicit rules of behavior. These rules (some relating to etiquette or manners, others to morality) can be studied and described like any other aspect of social life.
Prescriptive (as distinct from descriptive) approaches involve the individual actually making or accepting or rejecting moral judgements or using or applying moral language or concepts.
Deontic logic traditionally divides behaviors into three broad classes: obligatory, impermissible and optional. It's a complex branch of logic, but the real complications and challenges of moral thinking are not so much logical as contextual. Because, obviously, the general situation and the specific position(s) of the individual(s) involved need to be taken into account.
Times have changed since F.H. Bradley wrote his famous essay, 'My station and its duties' [included in his Ethical Studies (1876)], but the basic principle of the contextuality of ethics still applies. A person's duties or obligations derive in large part from (or at least cannot be assessed without taking into account) his or her positions in complex societal, professional and familial structures.
Kant talked about a categorical imperative, but I don't think we can get beyond hypothetical imperatives. In other words, if you (in such and such a situation) want such and such an outcome, do this or that. With respect to social relations, this way of thinking is never straightforward or foolproof, and requires judgement and insight to be applied successfully.
The kind of (implicit) rule-based approach to ethical thinking and manners which I am advocating is consistent with a very modest view of rights. If you break society's implicit rules whenever it suits you, you forfeit your right to the benefits and protections those rules might potentially provide.
The key question in ethics is a first-person question: what should I do (or refrain from doing)? I say this is the key question in ethics, but such a question (and this is reflected in the ambiguity of the word 'should') transcends ethics or morality.
Ethical or moral questions often merge into questions of etiquette, aesthetics and prudence as well as other areas or dimensions of life. There are no clearcut divisions between ethical and other considerations, in other words, and a certain type of (marginally unacceptable) behavior may be condemned by some as immoral, while others might prefer to call it ugly, unwise or just bad form. Others may see it in a positive light.
Even very serious moral transgressions (like the indiscriminate killing of civilians) are sometimes seen by people in the grip of certain ideologies or belief-systems as praiseworthy.
Most of us, of course, will condemn such ideologies as noxious and depraved. I certainly do. It is not really a problem that we can't prove our view correct and its converse incorrect in some objective, theoretical sense (though many think it is). Ethics is just not like that.
Quite simply, there is no absolute or objective ethical authority, and nor is there any objective method of determining 'moral truths'.
* Here is a summary of a recent controversy involving some very silly and intemperate assertions on the part of one of the protagonists.
Subscribe to:
Posts (Atom)