Those close to him tell the story of a man whose journey took him from being a "double refugee" to scholar to political prisoner.