Oct 23rd 2013

Measure for Mismeasure

by Esther Dyson

Esther Dyson, CEO of EDventure Holdings, is an active investor in a variety of start-ups around the world. Her interests include information technology, health care, private aviation, and space travel.

ISTANBUL – I recently used Uber (an online service for ordering a car and driver) and did not have the usual pleasant experience. The driver did not know the area, and, worse, he did not follow his navigator’s instructions, turning left instead of right. When Uber asked me, as usual, to rate the driver, I did not hesitate to give him two out of five. I was not being vindictive; I wanted to save other passengers from an unpleasant experience, and I hoped that maybe feedback would encourage him to improve or find another line of work.

But what does two out of five mean? It obviously means worse than average, which would be three. But, while I would always pick an average driver over a driver with a rating of two, given the choice between a two driver and a blind pick, I might pick the two, because the fear of someone even worse would keep me from taking a risk. This is a well-known phenomenon known as loss aversion: the risk of a one outweighs the hope of a five.

Just last week, I was engaged in ranking proposals for the Knight News Challenge; to simplify things, they had a three-point ranking: three for yes, two for consider, one for reject. The idea was to pick the easy winners, reject the losers, and focus on distinguishing among the maybes. That makes sense in the context of focusing attention where a decision is needed.

Ranking exercises, like the things they rank, are not all the same; different approaches fit different situations. We live in a world where everything is being rated, whether you are a professional judge or an individual trying to make sense of modern life. Indeed, while we rate the Uber drivers, they are rating us.

Consider a business plan or a foundation grant proposal. One proposal might be ranked nine out of ten, while another is eight out of 20; the first is pretty good but with limited upside, while the second is not so good, but has the potential to be great. The two cannot really be compared: One is a safe choice, but not likely to have a huge impact; the other is riskier, but ultimately may be more worthwhile. If you are a customer buying a product that should work, you want the nine out of ten; if you are a venture capitalist who thinks she can add value, you want the eight out of 20.

Helping people to think clearly about these numbers is important. People want simplicity, yet at the same time, in a world of targeted marketing, customization, and precision, in which vendors struggle to give consumers exactly what they want, people can help themselves by thinking clearly and specifying their preferences.

Imagine that you have cancer. The doctor says that you probably have two years to live, or a 50% expected improvement in “survival” (medical terminology for living another five years) if you undergo chemotherapy. In other words, you can have two years of gradual decline with some pain, or three years of nauseating treatments, “chemo brain,” loss of hair, and diminished dignity.

If you think those numbers are not quite comparable, you are right; that is part of the problem. (And the numbers may be based on a limited sample of people who do not quite resemble you.) But, while the timing is uncertain, the trade-offs are pretty clear. What you really want, of course, is a cure, not merely a minimal extension of life expectancy, but nothing is certain. The choice sounds easy, but then perhaps you just want to survive to see your daughter graduate, or your son get married. It would be nice to understand those numbers better.

Even on the population level, we are facing some of the same complexities at HICCup (the Health Initiative Coordinating Council), a startup that I founded. How do you measure health improvement? It is not, as one benighted analyst suggested, “A 20% improvement (reduction) in heart attacks plus a 30% improvement (reduction) in diabetes incidence equals a 50% improvement.” You need to average the improvements to get a figure somewhere between 20% and 30%. But how do you weight diabetes versus heart attacks, life extension versus quality of life?

There is also, in any sector, the issue of what the data really mean. One of my favorite (sad) stories concerns consumer credit ratings in Russia. A retail banker once told me that in making credit decisions in Russia, his analysts had faced a shortage of data and had assumed that a criminal record would be one easy way to weed out the bad eggs.

But when the bank ran the numbers, they discovered that although about half of the people applying for low-end, high-interest-rate credit had a police record, this did not seem to reflect on payment outcomes. I suspect the reason was that the people with no police record were the middle 50%. At the bottom were 25% who had a police record for some kind of bad behavior. At the top were 25% who had a police record for exceptionally good behavior, like refusing to pay bribes or to overlook corruption.

The moral of this story is that numbers do not tell us everything. Do we end up focusing on price because we can measure it, to the exclusion of other things that matter? This phenomenon has rendered the airline business largely unprofitable – and customers increasingly unhappy. Quality used to be included in the price of a ticket; now, with surcharges for seat selection, meals, and the like, customers are charged for it separately.

In short, the paradox of choice (as elegantly described in an eponymous book by Barry Schwartz) is that too many choices confuse us and raise the possibility of regret; how can we be sure that we are getting just what we want, and that something else would not be better?

Or it may be that the greatest happiness of all comes from not having to worry about stuff like this.



Copyright: Project Syndicate, 2013.
www.project-syndicate.org

 


This article is brought to you by Project Syndicate that is a not for profit organization.

Project Syndicate brings original, engaging, and thought-provoking commentaries by esteemed leaders and thinkers from around the world to readers everywhere. By offering incisive perspectives on our changing world from those who are shaping its economics, politics, science, and culture, Project Syndicate has created an unrivalled venue for informed public debate. Please see: www.project-syndicate.org.

Should you want to support Project Syndicate you can do it by using the PayPal icon below. Your donation is paid to Project Syndicate in full after PayPal has deducted its transaction fee. Facts & Arts neither receives information about your donation nor a commission.

 

 

Browse articles by author

More Current Affairs

Sep 8th 2022
EXTRACT: "In 1950, a team of sociologists, including the philosopher Theodor Adorno, conducted an empirical study, later published as The Authoritarian Personality, which ....... “If a potentially fascistic individual exists, what, precisely, is he like? What goes to make up antidemocratic thought? What are the organizing forces within the person?... what have been the determinants and what is the course of his development?”
Aug 29th 2022
EXTRACT: "Russian aggression certainly poses a threat; but it is a familiar one that we know how to deal with. Rising temperatures, dry riverbeds, parched landscapes, falling crop yields, acute energy shortages, and disruptions to industrial production are something else."
Aug 25th 2022
EXTRACTS: "As the revolutionary founder of a new Chinese state, Mao emphasized ideology over development. For Deng and his successors, it was the opposite: De-emphasis of ideology was viewed as necessary to boost economic growth through market-based 'reform and opening up.' Then came Xi. Initially, there was hope that his so-called 'Third Plenum Reforms' of 2013 would usher in a new era of strong economic performance. But the new ideological campaigns carried out under the general rubric of Xi Jinping Thought, including a regulatory clampdown on once-dynamic Internet platform companies and associated restrictions on online gaming, music, and private tutoring, as well as a zero-COVID policy that has led to never-ending lockdowns, have all but dashed those hopes." ----- "With the upcoming 20th Party Congress likely to usher in an unprecedented third five-year term for Xi, there is good reason to believe that China’s growth sacrifice has only just begun."
Aug 23rd 2022
EXTRACTS: "Less widely noted, however, is that the prices of many commodities fell this summer. The price of oil decreased by about 30% between early June and mid-August. The politically sensitive price of gasoline in the United States fell by 20% over the same period, from $5 per gallon to $4 per gallon. The overall index fell 12%." ---- "There are two macroeconomic reasons to think that commodity prices in general will fall further. The level of economic activity is a self-evidently important determinant of demand for commodities and therefore of their prices. Less obviously, the real interest rate is another key factor. And the current outlook for both global growth and real interest rates suggests a downward path for commodity prices."
Aug 22nd 2022
EXTRACT: "How Trump planned to use the classified documents remains a question that investigators presumably have made a high priority. Depending on the answer and the resulting charges, if any, one thing is certain: Trump will play hardball, including by amplifying his claims of victimhood at the hands of the fictional Deep State, and denying any wrongdoing in purloining the documents. His lies and hyperbole, however, don’t preclude seeking a plea deal. In his previous tangles with the law, such as his Trump University scam, he agreed to compensate the victims (in that case $25 million) after his prevarications were exhausted."
Aug 21st 2022
"On one side, there is the foreign secretary, Liz Truss, for whom all but the most partisan Tory would struggle to count many successes during her lengthy cabinet career." ---- "Rishi Sunak, whose proposed policies appear more attuned to the imperative of tackling inflation and the hardship it is causing. But on the big issues of the past few years, Sunak has been wrong. He backed Brexit from the beginning, denies the damage it is doing, and enthusiastically supported Johnson’s bid for the premiership." ---- " Which of these two can offer honesty to the British people, who deserve to be treated like grown-ups? To paraphrase the US Democratic politician Adlai Stevenson, the average man and woman are better than average."
Aug 10th 2022
EXTRACT: "Central banks are thus locked in a “debt trap”: any attempt to normalize monetary policy will cause debt-servicing burdens to spike, leading to massive insolvencies, cascading financial crises, and fallout in the real economy. ---- With governments unable to reduce high debts and deficits by spending less or raising revenues, those that can borrow in their own currency will increasingly resort to the “inflation tax”: relying on unexpected price growth to wipe out long-term nominal liabilities at fixed rates."
Jul 29th 2022
EXTRACT: ".... the likelihood is that Biden, who spent his life as a senator, played a central behind-the-scenes role in turning Manchin around and keeping the Democratic Party Senators together on this pared-down version of Build Back Better. Biden’s legislative accomplishments, not to mention his administrative ones, will likely end up being very impressive for the first two years of his presidency. ------ In matters of climate, every ton of CO2 you don’t put into the atmosphere is a decrease in how hard life will be for our grandchildren. They will have reason to be grateful to President Biden and the Democratic Party if this bill becomes law."
Jul 29th 2022
EXTRACTS: "Right-wing media outlets including Fox News, One America News (OAN), Newsmax, and talk radio are grossly abusing the right to free speech and are causing profound, if not irreparable damage to our country at home and abroad. They have been engaged in these deliberate practices of spreading poisonous misinformation all in the name of free speech." ---- "A team at MIT, analyzing propaganda techniques in the news, underscores the use of logical fallacies – such as strawmen (the misrepresentation of the other’s position), red herrings (the provision of irrelevancies), false dichotomies (offering two alternatives as the only possibilities), and whataboutism (a diversionary tactic to avoid directly addressing an issue). ---- Whataboutism is worth considering more closely because it is becoming ubiquitous among Republicans – perhaps this is not surprising given that it is certainly Trump’s “favorite dodge.” It is one of the fundamental rules by which he operates: when you are criticized, say that someone else is worse. In an interview with Trump, Bill O’Reilly states the obvious fact that “Putin is a killer,” and who can forget Trump’s response: “There are a lot of killers. You got a lot of killers. What, you think our country is so innocent?” That is classic whataboutism. And it is also of course all over Fox News’ most popular line-up."
Jul 24th 2022
EXTRACTS: "For three hours, against the unequivocal advice of his counsel, friends, and family, Trump purposefully and steadfastly declined to give the mob he had summoned any signal to disperse, to exit the building peacefully, or to simply cease threatening the life of his vice president or other members of Congress." ------ "Trump is corrupt to the core, a traitor who deserves nothing but contempt and to spend the rest of his life behind bars because he remains a menace to this country and an existential threat to our democratic institutions."
Jul 21st 2022
EXTRACT: "For some countries, diasporas also are not new. Just ask the Russians. For three-quarters of a century, Stalin’s NKVD and its successor, the KGB, kept close tabs on expatriate Russians, constantly worrying about the threat they might pose. And now, Russian President Vladimir Putin’s security service, the FSB, is continuing the tradition. According to recent FSB estimates, almost four million Russians left the country in the first three months of this year. Obviously, FSB statistics are hard to verify. But the sheer magnitude of this year’s departures is striking."
Jul 20th 2022
EXTRACTS: "We need leaders who will be honest about our problems in the short, medium, and long term. We are becoming poorer than our neighbors, with our per capita growth and productivity lagging behind theirs. We confront surging energy prices, soaring inflation, and public-sector strikes. Our fiscal deficit is uncomfortably high. Our influence is diminished. Far from recognizing these challenges, let alone proposing sensible solutions, the candidates to succeed Johnson are trying to win votes with reckless proposals like ever-larger tax cuts." ----- "There is one exception. Former Chancellor of the Exchequer Rishi Sunak refuses to abandon the notion that expenditure should bear some relationship to revenue. "
Jul 13th 2022
EXTRACT: "Looking ahead, five factors could make today’s energy crisis even worse. First, Putin has opened a second front in the conflict by cutting back on the contracted volumes of natural gas that Russia supplies to Europe. The goal is to prevent Europeans from storing enough supplies for next winter, and to drive prices higher, creating economic hardship and political discord. In his speech in June at the St. Petersburg International Economic Forum, Putin made his reasoning clear: “Social and economic problems worsening in Europe” will “split their societies” and “inevitably lead to populism … and a change of the elites in the short term.” ...... As it is, Germany is now anticipating the need for gas rationing, and its minister for economic affairs, Robert Habeck, warns of a “Lehman-style contagion” (referring to the 2008 financial crisis) if Europe cannot manage today’s energy-induced economic disruptions."
Jul 5th 2022
EXTRACT: "Fortunately, I am not alone in claiming that the survival of democracy in the US is gravely endangered. The American public has been aroused by the decision overturning Roe. But people need to recognize that decision for what it is: part of a carefully laid plan to turn the US into a repressive regime. We must do everything we can to prevent that. This fight ought to include many people who voted for Trump in the past."
Jul 2nd 2022
EXTRACT: "The Israeli philosopher Avishai Margalit described this succinctly in his book On Compromise and Rotten Compromises. In “politics as economics,” material interests are “subject to bargaining, everything is negotiable, whereas in the religious picture, centered on the idea of the holy, the holy is non-negotiable.” This, then, is why politics in the US is now in such a perilous state. More and more, the secular left and the religious right are engaged in a culture war, revolving around sexuality, gender, and race, where politics is no longer negotiable. When that happens, institutions start breaking down, and the stage is set for charismatic demagogues and the politics of violence."
Jul 2nd 2022
EXTRACT: "...EU enlargement is essentially a political decision by member states, based on a multitude of considerations that sometimes include dramatic events. Russia’s war of aggression against Ukraine is such a turning point."
Jun 29th 2022
EXTRACT: "Most market analysts seem to think that central banks will remain hawkish, but I am not so sure. I have argued that they will eventually wimp out and accept higher inflation – followed by stagflation – once a hard landing becomes imminent, because they will be worried about the damage of a recession and a debt trap, owing to an excessive build-up of private and public liabilities after years of low interest rates." ----- "There is ample reason to believe that the next recession will be marked by a severe stagflationary debt crisis. As a share of global GDP, private and public debt levels are much higher today than in the past, having risen from 200% in 1999 to 350% today (with a particularly sharp increase since the start of the pandemic). Under these conditions, rapid normalization of monetary policy and rising interest rates will drive highly leveraged zombie households, companies, financial institutions, and governments into bankruptcy and default."
Jun 28th 2022
EXTRACT: "It is tempting to conclude that today’s central bankers are damned if they do and damned if they don’t. Maybe if they sit tight, they will ride out the storm. Then-Fed Chair Paul Volcker was Public Enemy Number One in the United States in the early 1980s, when he squeezed post-oil-shock inflation out of the system with double-digit interest rates. But in his later years he was revered, and became a national treasure, called on to advise successive presidents in any financial emergency. ----- But central bankers would be wise not to assume that their reputations will automatically recover, and that the status quo ante will be restored. We live in a more disputatious age than the 1980s. Public institutions are more regularly challenged and held to account by far less reverential legislators." ----- "Moreover, former central bankers have joined the chorus of critics. Former Fed Chair Ben Bernanke, breaking the unwritten rule not to reproach one’s successors, has said that today’s Fed made “a mistake” by responding slowly to inflation. And Bailey’s immediate predecessors, Mervyn King and Mark Carney, have weighed in, too, with challenges to the BOE’s policy. The fabric of the central banking fraternity is fraying."
Jun 25th 2022
EXTRACT: "Public opinion in Belarus remains firmly against involvement into the war with Ukraine. Moreover, according to a Chatham House survey, 40% of Belarusians do not support Russia’s war, compared to 32% who do, while around half of those questioned see predominately negative consequences of the war for Belarus (53%) and for themselves (48%). The Belarusian military and security services are also aware of the determined and skilful resistance that Ukrainian forces have put up against Russia and the risks that they would therefore be running if they entered the war against Ukraine. This, in turn, means that the risk to Lukashenko himself remains that he might lose his grip on power, a grip which depends heavily on the loyalty of his armed forces." ---- "Ultimately, Belarus may not be on the brink of being plunged into war quite yet, but its options to avoid such a disaster are narrowing."
Jun 20th 2022
EXTRACT: "Russification (the policy of enforcing Russian culture on populations) appears to be being reinforced by ethnic cleansing. Last month the Ukrainian parliament’s commissioner for human rights, Liudmyla Denisova, informed the United Nations’ High Commissioner for Refugees, Filippo Grandi, that 1.3 million Ukrainians, including 223,000 children, had been forcibly deported to Russia."