Monday, June 17, 2019

Human's can "read" a computer's "mind"

Read the whole thread:

Here's the article's abstract:
Does the human mind resemble the machine-learning systems that mirror its performance? Convolutional neural networks (CNNs) have achieved human-level benchmarks in classifying novel images. These advances support technologies such as autonomous vehicles and machine diagnosis; but beyond this, they serve as candidate models for human vision itself. However, unlike humans, CNNs are “fooled” by adversarial examples—nonsense patterns that machines recognize as familiar objects, or seemingly irrelevant image perturbations that nevertheless alter the machine’s classification. Such bizarre behaviors challenge the promise of these new advances; but do human and machine judgments fundamentally diverge? Here, we show that human and machine classification of adversarial images are robustly related: In 8 experiments on 5 prominent and diverse adversarial imagesets, human subjects correctly anticipated the machine’s preferred label over relevant foils—even for images described as “totally unrecognizable to human eyes”. Human intuition may be a surprisingly reliable guide to machine (mis)classification—with consequences for minds and machines alike.
This is a fascinating and, I believe, important result.

From the tweet stream

Sunday, June 16, 2019

Headstones and red flowers

How things end, or not – A problem of form [#QualityTV | Media Notes 3]

Consider what we might call the “traditional” one-hour TV drama, such as any in the Star Trek franchise. Each episode is a story independent of the others, with the end tied more or less “tightly” (whatever that means) to the beginning. This is true of, say, NCIS as well, and of Bonanza, a much older show that I watched in my youth. Occasionally we would have a story-line that is tightly linked across two episodes, but this is relatively unusual – sometimes this device would be used to link the end of one season to the beginning of the next. And occasionally we would have a loose story “arc” over several consecutive episodes. But there is no strong causal relationship between the first and final episodes in such a series. The last episode is simply the last episode.

And of course, in many cases the series is terminated because of poor ratings. In more fortunate cases the produces choose to end the show because, perhaps they see the audience disappearing, or because, you know, enough is enough. But in either case, there is no strong causal connection more or less directly between the first episode in the series and the last one. Each episode is an independent story and the first and last episodes are not exceptions. Except in the cases of double-episodes, and perhaps a story arc or three, one could watch the episodes in any order.

The Sopranos is different. It premiered in January, 1999, and ran for 86 episodes over six seasons and it told a more or less continuous story over the whole series. The final episode, Made in America, aired on June 10, 2007. During the season Tony had killed his nephew Christopher, whom he had been grooming to take over the operation, and the conflict between the New Jersey the New York mobs had reached a crisis point, with top men on both sides being murdered. Tony is alone and hunted. He gathers his family, his wife and two children, at a diner to have dinner, the screen goes black, and it’s over. The story just stopped.

And because of that the ending was controversial. Nothing was resolved. But what could resolution have possibly been in this story? It had long been clear that Tony was Tony and, despite his years of therapy, he wasn’t going to change. If he gets killed in the mob war, so what? If he wins and takes over New York, so what? If the FBI corrals them all, so what? And, yes, we have his wife an children, but so what?

Given the importance that eating has in the series – family dinner on Sunday, meals on ceremonial occasions, eating in the office at the back of the Bada Bing club, and so forth – one can see a loose kind of closure in the fact that the family was gathering for a meal. But that’s it. It resolves nothing. It just brings the ongoing narrative to a halt.

As such its quite different from the plotting we’re used to in novels, where we get one story from beginning to end with the end and beginning more or less tightly coupled to one another. The end resolves a conflict or closes a gap that existed at the beginning. And yet I found the ending of The Sopranos to be satisfying.

Why? Or, if you will, given that I’ve read many novels, and even written about a few of them, why is it that I find this rather different disposition of narrative energies to be satisfying. But then, I’ve watched a long of TV as well.

This, it seems to me, is a formal issue, though somewhat different from the formal issues that have most concerned me. How do we evaluate how tightly episodes are coupled with one another? How do we describe and examine the causal structure of a narrative?

An exercise for the reader: Consider The Wire, which had five seasons between January, 2002, and June, 2008. Like The Sopranos it consists of one-hour episodes with a continuous story over the episodes. But it introduces a new element with each season. The first season establishes a basic narrative of police vs. drug dealers; this continues throughout the season. But the second season focuses on the port, and the desperate attempt of a union boss to keep it alive. In the third season an imaginative police commander experiments with zones in which drug dealing will be permitted, thus freeing his men to deal with other crimes. The fourth episodes moves to the school system and the fifth and final system looks at The Baltimore Sun, a (once?) distinguished paper that had H. L. Mencken on staff.

The final episode concludes with a montage that shows us (some of the) the fate of at least some of the characters. But conclusion? Baltimore will keep on keeping on, there will be drugs, the police and the government will remain corrupt, the school system struggling, the port empty, and the newspaper dying. So, the action didn’t just stop, as in The Sopranos. But this hardly counts as a resolution. It’s just a different want to stop moving forward.

For extra credit: What about Deadwood? The show was simply dropped after three seasons (2004-2006), with no chance to plan a last season and a last episode. What happened? How does that halting feel different from those in The Sopranos and The Wire?

But then David Milch (creator, producer, and writer) was able to talk HBO into letting him do a two-hour movie to bring things to a more satisfying close. I’ve not seen it, but for those who have, how satisfying was it?

What does Stanford want from the human sciences going forward?

Cynthia Haven has a post about a recent meeting of Standford's Faculty Senate concerning the future of Stanford University Press.
He [graduate student Jason Beckman] referred to meeting some graduate students had with Provost Drell on May 2, about how to interpret the standing of the humanities and social sciences at Stanford in the wake of her decision to effectively defund the press. He said she discussed on the two types of degrees that she believes will serve our society going forward. “First, social science degrees buttressed by data proficiency and computer science skills, and second, humanities degrees, which are the ‘best equipped’ to deal with post-human concerns in a world of proliferating robotics and artificial intelligence. Far from assuaging our concerns, such a response only reaffirmed that this institution does indeed marginalize the humanities and social sciences—which seem to have value only insofar as they support STEM fields. A university that stands behind and supports all of its scholars and students, and that values scholarship itself, should not position itself as openly hostile or indifferent to certain kinds of scholarship. We find that bias clearly manifest in the Provost’s initial decision to decline the budget request from SUP, a decision that would devastate the press. ”

One step for a man, one gialnt leap for mankind – 50 years later

Jill Lepore reviews seven new books on the moon landing, Why Did the Moon Landing Matter? (NYTimes). She concludes:
One small step for man, one giant leap for mankind. The lasting legacy of the voyage to the moon lies in the wonder of discovery, the joy of knowledge, not the gee-whizzery of machinery but the wisdom of beauty and the power of humility. A single photograph, the photograph of Earth taken from space by William Anders, on Apollo 8, in 1968, served as an icon for the entire environmental movement. People who’ve seen the Earth from space, not in a photograph but in real life, pretty much all report the same thing. “You spend even a little time contemplating the Earth from orbit and the most deeply ingrained nationalisms begin to erode,” Carl Sagan once described the phenomenon. “They seem the squabbles of mites on a plum.” This experience, this feeling of transcendence, is so universal, among the tiny handful of people who have ever felt it, that scientists have a term for it. It’s called the Overview Effect. You get a sense of the whole. Rivers look like blood. “The Earth is like a vibrant living thing,” the Chinese astronaut Yang Liu thought, when he saw it. It took Alan Shepard by surprise. “If somebody’d said before the flight, ‘Are you going to get carried away looking at the Earth from the moon?’ I would have said, ‘No, no way.’ But yet when I first looked back at the Earth, standing on the moon, I cried.” The Russian astronaut Yuri Artyushkin put it this way: “It isn’t important in which sea or lake you observe a slick of pollution or in the forests of which country a fire breaks out, or on which continent a hurricane arises. You are standing guard over the whole of our Earth.”

That’s beautiful. But here’s the hitch. It’s been 50 years. The waters are rising. The Earth needs guarding, and not only by people who’ve seen it from space. Saving the planet requires not racing to the moon again, or to Mars, but to the White House and up the steps of the Capitol, putting one foot in front of the other.

Friday, June 14, 2019

Network – and four decades later Trump becomes President [Media Notes 2]

I don’t know whether or not I saw Network when it was originally released in 1976, nor for that matter, whether I watched it in whole or in part on TV sometime during the intervening four decades. Whatever the case, I watched it last night on Netflix. WOW. I can see why it won four Oscars, three for acting and one for Paddy Chayefsky’s screenplay.

And is plays interestingly against the current Trump and social media era.

The news anchor for UBS, Howard Beale, is to be dropped because of declining ratings. So he goes on air the promises that we will commit suicide on air in a subsequent broadcast. The network brass decide to drop him immediately rather than allow him to finish out his two weeks. Until...they learn that ratings went through the roof. They decide to bring him back and let him rant. He delivers a line that becomes his catchphrase and which has broken free of the film itself to enter pop culture if only in a minor way: “I’m as mad as hell, and I'm not going to take this anymore!” [Cue Trump and his promise to make American great again.]

It takes awhile to get things adjusted, but the result is The Howard Beale Show, which includes on segment where Beale goes ballistic in front of a stained glass window and then slumps to the floor, but also features a segment involving a fortune teller, and so forth. The news has now been explicitly transformed into entertainment. At one point Beale discovers that CCA (Communications Corporation of America), the conglomerate which bought UBS, is itself going to be bought out by Saudi Arabians. [Remember, OPEC (Organization of Arab Petroleum Exporting Countries) had declared an oil embargo in 1973 in retaliation for the Yom Kippur War, and that put the Arab nations on the media radar screen in a big way. For that embargo hiked the cost of gas, killing the gas guzzler, and so reached directly into people’s pockets.] He goes on air, rants against the deal, and urges his listeners to send telegrams to the White House expressing opposition to the deal. Which they do.

This sends the UBS and CCA brass into a panic because they need the deal to go through for financial reasons. Arthur Jensen, chairman of CCA, sits Beale down and lectures him on his vision of the world. “describing the interrelatedness of the participants in the international economy and the illusory nature of nationality distinctions” (from the Wikipedia article). This is a world in which the interests of multi-national corporations rule over all – the world of globalization that would become US foreign policy in subsequent years? Beale buys in, hook, line, and sinker, but his audience doesn’t like his dehumanizing globalist message. Ratings begin to drop.

UBS wants to drop him, but Jensen insists on keeping him on the air. So, the network brass are caught between a rock, declining ratings, and a hard place, orders to keep the source of those ratings on the air. What to do?

Well, they decide to get tricky. Back when they were hatching The Howard Beale Show they also hatched The Mao Tse-Tung Hour, a docudrama featuring footage in which the Ecumenical Liberation Army commits terrorist acts – recall that Patty Hearst was abducted by the Symbionese Liberation Army in 1974, an event mentioned in the film. The brass go through back channels to arrange Beale’s on-air assassination by the Ecumenicals. And that more or less ends the film.

[And now we live in a world where people get killed on social media.]

That’s not quite all there is to the film. These media transgressions and divagations play out against the backdrop of a June-October romance (she’s no starlet and he’s no rich old banker) between two executive, the young woman who helms the transformation of the news into entertainment and the middle-aged man who used to run the news.

An exercise for the reader: The elements from this pre-internet pre-social media world and translate them into the world political and media environment. Interesting, sure. Prescient? Scary?

Games – Star Trek DS9 S1 E10: Move Along Home [Media Notes 1]

Note: This is episode 9 on Netflix, where the first two episodes are combined into a single numbered episode.
Broadcast March 9, 1993

I’ve been watching a lot of episodes from Star Trek franchises in the last few months, most of them in fact. And I’ve watched a great deal else besides. It’s my impression that, more than any other series or franchise, Star Trek presents many episodes as puzzles or games, with more or less explicit conventions or even rules. These conventions/rules always have an element of explicit logic to them.

One type of episode is one in which some of the continuing characters become pieces in a game played or manipulated by characters specific to the episode. Move Along Home is one such episode.

The episode is set on the space station, DS9, as it is visited by the Wade, the first species from the Gamma Quadrant to visit DS9. Upon boarding DS9 the Wadi head straight for Quark’s casino where Quark engages them in Dabo, which they master and then proceed to clean Quark out. They catch him and force them to play a game they brought with them, Chula.

They refuse to tell Quark the rules. FWIW the game appears to be played on a pyramidal set of layers and involves four game pieces which move about the layers according to Quark’s through of dice-like counters. Once the game is under way we learn that four senior officers of DS9 have been transported into an abstract world that seems rather game like.

Which it is. What they do in this world is motivated by/constrained by the moves Quark makes at Chula. The episode moves back an forth between Quark playing Chula and the officers (Sisko, Kira, Dax, and Bashir) in their abstract world. The four slowly figure out they’re in a game and Quark comes to realize that the moves he makes in the game are being played out by those four officers, who have apparently left the station without a trace. And then things collapse. The game is over and the four officers appear in Quarks. The Wadi leave and Sisko has a talk with Quark.

I have, of course, omitted all the details of gameplay etc. My purpose here is simply to register this as one example of a type of episode the occurs in Star Trek. What’s the point, if I may, of this kind of episode? What's it trying to achieve? By way of comparison, mysteries are also explicitly about puzzle solving – who done it? But they’re quite different in construction and import, no?

Addendum 6.15.19: I’m thinking I probably short-changed Quark. When he finally realizes that his game’s play may well cost the lives of the players he begs for their lives and pledges that he’ll never again cheat if they’re spared. Odo hears this pledge and at the end, tells Sisko to talk with Quark about what he’d said, though Odo doesn’t mention the pledge itself. We don’t year the pledge and, of course, we know the Quark will go on cheating. These is, of course, a sense in which the Wadi are dishonest as well, for they didn’t indicate the ‘dark side’ of their game when they brought it out.

White irises

Thursday, June 13, 2019

Basics of neural networks and deep learning


A set of four animations explaining neural networks using a basic example, recognizing handwritten digits with a four-layer network.

Is cognitive science washed up?

Rafael Núñez, Michael Allen, Richard Gao, Carson Miller Rigoli, Josephine Relaford-Doyle and Arturs Semenuks, What happened to cognitive science?, Nature Human Behaviour (2019)
Abstract

More than a half-century ago, the ‘cognitive revolution’, with the influential tenet ‘cognition is computation’, launched the investigation of the mind through a multidisciplinary endeavour called cognitive science. Despite significant diversity of views regarding its definition and intended scope, this new science, explicitly named in the singular, was meant to have a cohesive subject matter, complementary methods and integrated theories. Multiple signs, however, suggest that over time the prospect of an integrated cohesive science has not materialized. Here we investigate the status of the field in a data-informed manner, focusing on four indicators, two bibliometric and two socio-institutional. These indicators consistently show that the devised multi-disciplinary program failed to transition to a mature inter-disciplinary coherent field. Bibliometrically, the field has been largely subsumed by (cognitive) psychology, and educationally, it exhibits a striking lack of curricular consensus, raising questions about the future of the cognitive science enterprise.
While I hopped on board cognitive science during my graduate years – I filed a dissertation on Cognitive Science and Literary Theory in 1978 – I can't say I find this surprising.

From the discussion:
The cognitive science enterprise faced, from the start, substantial challenges to integration. Over the decades, things became ever more elusive. Steady challenges to the fundamental tenets of the field, failures in classical artificial intelligence handling common sense and everyday language, major difficulties in integrating cultural variation and anthropology, as well as developments in brain research, genomics and evolutionary sciences seem to have gradually turned the enthusiastic initial common effort into a rather miscellaneous collection of academic practices that no longer share common goals and paradigms. Indeed, in scientometrics, unlike successful cases of interdisciplinary integration such as biochemistry, cognitive science has been referred to as the textbook case of failed interdisciplinarity and disappearance.

This failed integration has also been aggravated by the fact that over the years the term ‘cognitive’ has become highly polysemous and theoretically loaded, even in inconsistent ways. For instance, in cognitive psychology it primarily denotes information-processing psychology, following influential work in the 1960s76 that saw cognitive science as essentially the marriage between psychology and artificial intelligence, in which neuroscience and the study of culture played virtually no role. Thus, cognitive psychology doesn’t just designate a subfield of psychology that studies cogni-tion and intelligence. Rather, it usually refers to a specific theoretical approach and research program in psychology. As a consequence, research on thought, language and reasoning based on, say, the work of Jean Piaget or Lev Vygotsky—who studied the psychology of thought, reasoning, and language—is normally not considered cognitive psychology. Indeed, in recent cognitive psychology textbooks, the work of these great pioneers is not even mentioned. When attached to linguistics, ‘cognitive’ denotes an entirely different thing. ‘Cognitive linguistics’ refers to a specific field that emerged in the 1980s as an explicit alternative to Chomskian linguistics, defending the view that language is not a special-purpose module but is governed by general principles of cognition and conceptualization. Thus, the term ‘cognitive’ in cognitive linguistics designates a school in linguistics that it is fundamentally opposed to—and inconsistent with—Chomskian linguistics, which, with its formal treatment of language, had appealed to the computer scientists, anti-behaviourist psychologists and analytic philosophers of the 1950s and earned it a privileged founding role in cognitive science in the first place.

Another founding role was played by psychology, which, according to previous findings and the indicators analyzed here, has become decidedly overrepresented in cognitive science. But rather than being a “conquest” of the field, there seems to be a progressive disinterest on the part of other disciplines in investigating the mind in terms of the computationalist–representationalist tenets defined by the cognitive revolution.
Addendum, from my notes a couple of years ago: 

So what do the cognitive sciences know, really?

On the one hand, there’s nothing uniting them like evolution unites the biological sciences. So one might say that they know nothing. But, a lot of work’s been done in the last half to three-quarters of a century and, really, it’s not nothing. There’s something there; in fact, quite a lot. So we have to hold these two things in the mind at the same time: At one and the same time we know a lot and we know nothing.

Our brains are made for music

In the eternal search for understanding what makes us human, scientists found that our brains are more sensitive to pitch, the harmonic sounds we hear when listening to music, than our evolutionary relative the macaque monkey. The study, funded in part by the National Institutes of Health, highlights the promise of Sound Health, a joint project between the NIH and the John F. Kennedy Center for the Performing Arts that aims to understand the role of music in health.

"We found that a certain region of our brains has a stronger preference for sounds with pitch than macaque monkey brains," said Bevil Conway, Ph.D., investigator in the NIH's Intramural Research Program and a senior author of the study published in Nature Neuroscience. "The results raise the possibility that these sounds, which are embedded in speech and music, may have shaped the basic organization of the human brain."
The original research:
Norman-Haignere et al., fMRI Responses to Harmonic Tones and Noises Reveal Divergence in the Functional Organization of Human and Macaque Auditory Cortex. Nature Neuroscience, June 10, 2019 DOI: 10.1038/s41593-019-0410-7

Wednesday, June 12, 2019

Fully automated luxury communism


Tuesday, June 11, 2019