AlphaGo

I'm still trying to digest the news of AlphaGo's win against a Go (Baduk, Weqi) professional. I read the Nature paper - which is not to say I understand it. Of course the paper is not meant to be a full explanation that I would understand of how the software works ;-) Todays is a triply off day - carnaval in Brazil, my official vacation at USP, and a snow day in Boston - so I'll take the opportunity to jot down some thoughts.

The jump in strength from what was previously achieved by Go machines was enormous. An 8-stone improvement (800 Elo, whatever) over the best programs. Incredible. That's very much unlike what happened in chess - then everybody could see the progress of machines and knew that the champion's defeat was coming.

The main questions is: what is a "convolutional" neural network, and how is it so different from a garden-variety neural network that it can learn to evaluate positions? Positional evaluation had not been achieved in any significant way by any algorithm before. Convolutional neural networks, also called "deep learning", are said to be suited for pattern recognition - although they still have to deal with the standard issues of neural networks, namely, the need for enormous training sets, and the problem of local minima in gradient search. Although there are claims that deep learning deals with local minima effectively. The main question though is more subtle - who expected that Go positional evaluation is amenable to pattern recognition? What is the topology of a winning Go board? How did AlphaGo figure it out, as it is clear that no human did?

There are 3 hypothesis:

1 - Go turns out to be significantly easier that we had thought. That rhymes with the idea that chess books are (used to be, before machines) a lot better - more fun - than Go books. Chess books used to talk about real strategic insights - until all the insights became available: then they devolved into a morass of listings of 30 move long openings which are almost like exhaustive searches. Lasker wrote "Chess must not be memorized... You should keep in mind no names, nor numbers, nor isolated incidents, not even results, but only methods." That worked 100 years ago, but it turns out that memorizing works better now.

Go books range from the soft, metaphysical, to the exhaustive lists of josekis and tsumegos. Now this might be explained away by saying that "we don't understand the mysterious ways of Asian culture" but this explanation is nonsense. Conceivably chess had found the deep tactical insights which are halfway between the vague and the overly concrete, and Go was still jumping from one extreme to the other. Is that because chess had been better studied? Or because Go is more complex, less structured, and thus less amenable to literary description?

Chances are we will never know. The most likely explanation is that the secrets of Go are hidden more deeply than those of chess, yet not so deep that computers cannot find them. But there are others.

2 - Artificial intelligence is advancing faster now. After 50 years of having been the technology of the future for now and all ages. Maybe. This is the 1st AI (defined in broad terms) advance that is unexpected. Do you remember another one? I don't.

Of course Go WAS more complex than chess and took a while longer to solve; but now computers are more powerful and the advances come faster. I don't much believe this line of reasoning but we cannot discount that the pace of advancement in artificial intelligence will quicken. This hypothesis is testable: just wait 5 years and see if other, bigger problems fall. The technological singularity folks would be happy, but don't really think it will happen.

3 - Least likely explanation: well, most published research findings are false. The disagreement is on the meaning of most - my favorite estimate is 92%. Every field has its way of being false - outright fraud is rare except in the medical sciences. In engineering, false tends to mean that the conditions assumed in the paper never happen in the situation to which it wants itself applicable. But I digress.

The reason this alternative is unlikely is because if there is something false in the publication it will get checkmated, just as Lasker said of hypocrites (he actually meant anti-semites) on the chessboard. Now again I cannot evaluate the publication, and I much doubt that it is meant to be evaluated the way mathematicians check proofs in peer review. But I did look at a commented game - again I cannot compete with the pros - and one cannot imagine how the computer was playing if it wasn't running a very good algorithm.

So hypothesis 3 is the least likely - not that I put it above any scientists to punish false results, or that science depends on individual honesty or competence - but it's the most easily testable. Pity, because at some level it would be the most satisfying - another 10 or 20 years of gradual improvement in Go playing would have been fun to watch.

Jeb!

Half of the 6 of you may know of my habit of blogging votes. It is a form of expressing confidence in our freedoms. So: I plan to vote for Jeb Bush in the Republican presidential primaries in Massachusetts for the following reason.

I judge that the remaining Republican presidential candidates are a clear and present danger to the welfare of this country, to the freedom and liberty we enjoy, and to peace among our allies around the world. Not only the most talked about candidates, who do not deserve to be mentioned by name, but also the ones who supposedly are more acceptable to the conservative establishment. The absentee governor of N Jersey, a mean, incompetent, and vindictive fellow who would quarantine my daughter after a trip to Brazil. The pretty boy who skips Senate votes so as not to be on record as supporting anything but boilerplate blurbs. (How come it has taken so long for the pundits to declare his suit is empty?) The executive who destroyed the 2 greatest technology companies of the 20th century, but is excluded from debates for being female. Any of the vice-presidential candidates going to debates for the airtime. The crazies.

It is not at all likely that I would vote for Jeb against Hillary Clinton. However that would be a reasonable election in which they would have to express and defend their opinions. This is good for the country and the voter would have a chance to decide. Between repealing Obamacare because it goes to far, and repealing Obamacare because it doesn't go far enough, am I still more likely to vote for Sanders? Perhaps, but in either case it will be a question of who has the better proposals, not of absolute dread. Bush is not crazy, nor racist. He was a reasonable governor - I may disagree with his priorities and note that he surfed a real estate bubble, but the voters were happy. Sanders is to the left as Bush is to the right; you can agree or disagree with them depending on your positions. The alternatives to these 3 are mean and insane.

As 3 diferenças entre Brasil e EUA

A 1a diferença é a Constituição. Os representantes nos EUA são muito mais acessíveis. É muito mais fácil eu contatar meu deputado aqui, e receber uma resposta, do que no Brasil, onde eu nem bem sei quem é o meu representante, nem eles se importam em responder. Em parte é por causa do voto distrital, em parte por causa da cultura política - seja como for, é uma diferença interessante.

A 2a diferença são os liberal arts colleges. Nos EUA o estudante entra na universidade, e não num curso específico, enquanto no Brasil o estudo universitário é voltado para treinamento em profissões específicas - algumas delas nem são profissões que realmente existem de forma bem definida, ou não oferecem empregos. Então o aluno entra, sai, reprova, desiste, presta vestibular novamente... enquanto nos EUA o jovem passa 4 anos buscando seus interesses com ajuda da universidade e dos professores.

A 3a grande diferença são os parques nacionais, que nos EUA existem para serem visitados, e têm infra estrutura para turistas; enquanto no Brasil raramente há estrutura e os parques servem para impedir a visitação, ficando mais expostos aos palmiteiros, motoserras, e outros devastadores.

Fora essas 3 diferenças Brasil e EUA são iguais - só muda a bitola do papel higiênico que nos EUA é mais larga.

Votação para o C Universitário da USP

A USP enviou 2 dúzias de mensagens sobre "Eleição do representante dos Professores Associados junto ao Conselho Universitário, conforme Portaria GR...." Não vou entrar em detalhes - procedimentos técnicos, senhas, métodos eletrônicos, testes, contagens. Daí quando chega a hora da votação tem as 3 opções, e nenhuma dica de quem são os candidatos. Sou eleitor compulsivo - voto em todas as sociedades profissionais. Sempre junto com a cédula vem uma biografia e a proposta de cada candidato. Sem isso, como o eleitor vai saber em uma votar? Acho que veio email dos candidatos em algum momento, mas não estou localizando. As informações não estão disponíveis nos sites da USP - ao menos não de forma fácil de encontrar. Uma das chapas de professores doutores tem um blog - as dos associados, não encontrei. Então votei nulo.