Welcome!

Microservices Expo Authors: Liz McMillan, Derek Weeks, LeanTaaS Blog, Pat Romanski, Elizabeth White

Related Topics: Wearables, Java IoT, Industrial IoT, Mobile IoT, Microservices Expo, ColdFusion, IBM Cloud, PowerBuilder, Weblogic, Microsoft Cloud, Linux Containers, Adobe Flex, Symbian, Open Source Cloud, SYS-CON MEDIA, Eclipse, Cognitive Computing , Machine Learning , PHP, Agile Computing

Wearables: Article

New Column: A Geek's Bookshelf

Book Review: A Demon of Our Own Design: Markets, Hedge Funds, and the Perils of Financial Invocation

Geeks like to read – and not only programming books. Most of us read incessantly. Whether it’s popular science, sci-fi or fantasy, a good thriller or an occasional popular history book or biography, it’s a rare geek who isn’t in love with books. And I am no exception, although I have to confess I am rather an extreme case since my love of books and eclectic tastes borders on the “gentle madness” aka “bibliomania.” 

What I am going to do in this regular column is feed my habit by highlighting some of the books I am reading, and (mostly) enjoying. (I will only rarely write negative reviews; it’s a rare book that I “do not put down gently but throw across the room with great force” after all.)

Finally, since I remain involved with Apress (www.apress.com), the publishing company for IT professionals I helped found, is there any potential for a conflict of interest? I don’t think so nor do the kind people at SYS-CON; the kind of books I will be reviewing are the books I read “non-professionally” –for fun – in my spare time. It is only these books, rather than professional books, that I will review.

Title: A Demon of Our Own Design: Markets, Hedge Funds, and the Perils of Financial Invocation
Author: by Richard Bookstaber
Publisher: John Wiley 2007, ISBN 978-0-471-22727-4.
Price: $27.95

Talk about prescience, this amazingly relevant book, 10 years in the making, was actually published in April of 2007 – four months before the market meltdown that was caused by subprime mortgage-backed instruments going very, very south. Yet, in this extremely interesting, extraordinarily well-written book, Bookstaber essentially predicted this, and also (alas) he predicts more crises to come. The first paragraph of the book sets the stage:

“While it is not strictly true that I caused the two great financial crisis of the late 20th century – the 1987 stock market crash and the Long-Term Capital Management (hedge fund debacle)…”

Who is Bookstaber? He was one of the early “quants” on Wall Street. These are the physicists, mathematicians, statisticians, and mathematical who revolutionized trading on Wall Street by trying to search out hidden patterns and values. The foremost among them, the great mathematician James Simon, made a mere $1.7 billion last year by apparently doing exactly this.

The idea, roughly speaking, of most of these strategies is: can you find two (seemingly) equivalent securities that should trade in parallel but are currently not? Buy one and sell short the other, wait (hope) for a regression to the mean and make a bundle. Only you won’t make a bundle unless you use a lot of leverage because the anomalies are small at best. And leverage, as the old Wall Street adage has it, cuts both ways. If something really strange happens (a “black swan event,” in the words of best-selling author Nicolas Taleb whose very interesting book I’ll review soon) that makes the divergence greater than historical norms, your billions upon billions of leveraged investments often leads to catastrophic losses. And they did. What’s worse, there is a Heisenberg quality to this kind of historical/statistical arbitrage. As Bookstaber puts it: “Predicated on their conviction that the relationship had long-term stability, they would take positions based on the assumption that it would return, or converge, back to its historical value. What they did not appreciate was that they had changed history. There had never been someone trading hundreds of billions of dollars in the middle of this relationship before.”

Of course, it isn’t only about statistical arbitrage affected by the size of the investments made by people playing the game. As Bookstaber often points out, there is a certain amount of stupidity, cupidity, and outright deceit at work here. For example, the Enron-related transactions of Citigroup were described by the then head of risk management at CitiBank as: “[our] accounting is aggressive and a franchise risk to us if there is publicity,” which Bookstaber translates beautifully as: “we’re making this up and if anyone finds out, we’re in trouble.” Of course, Enron was found out and billions upon billions were lost and some of the people who went beyond merely aggressive accounting actually went to jail. (He has a wonderful suggestion about how to handle financial reporting by the way – one that will appeal to programmers: replace a lot of the hocus pocus in financial reports by requiring that the raw data be made available in basically XML form, and thus let smart data miners make sense of it without it being filtered through high-priced accounting firms with potential stakes in the matter.)

As this book is just filled with interesting information and great anecdotes, I could go on for a long time describing its virtues. For example, there’s a wonderful discussion of what portfolio insurance is and how it (inevitably with hindsight) led to the crash of 1987, for example. In the end, however, the whole point of this book can be summed up by the following passage:

“The danger to the system is the system…despite all the risks we can control, the greatest ones remain beyond our control. Those are the risks we do not see, things beyond the veil…”

Combine this inescapable fact with the amazing leverage that modern hedge funds can use, throw in the usual amounts of human stupidty and cupidity, the speed with which things happen in our modern era, the interconnections of everything with everything and Bookstaber has convinced me at least that more and more disasters await the financial system.

Before I leave this review though I do want to point out some parts of the book that will be especially interesting to programmers. Here is an amusingly scary one that occurred in the past and perhaps is not so relevant anymore; however, it remains of vital importance to everything we do. He describes how one early crisis (1995) was caused by the use of a now exotic programming language called APL (“A Programming Language”) created by Turing award-winner Ken Iverson. APL was an amazingly fun language for math types. You could invert a matrix with a single key stroke and write the most amazing one-liners. But let’s forget about the maintenance problems of a language that makes PERL seem like COBOL in it lucidity; the real problem was that APL was interpreted in an era when JITs were still a decade away and computers were hundreds of times slower. But many financial calculations require zillions of iterative calculations to compute prospective values, and APL, since it was not compiled in those days, simply couldn’t do them. So oddball situations weren’t well modeled in the financial models built with APL, and, once upon a time, this failure to use a compiled language led to a loss of between 100 and 250 million dollars to UBS – and this was back when a quarter of a billion dollars was real money.  

But more important is his stressing that the worst nightmare of financial machinations is our worse nightmare as well: the effects of tight coupling on systems. OOP was designed to solve this problem but it hasn’t proven the panacea its early proponents had hoped for. And, as anyone who was on the Vista team can testify (for example), tight coupling remains the biggest problem we face for large software projects.

In sum, get this book. Read it and learn. It’s beautifully written and full of insights that apply not only to financial management but to “life, the universe, and everything.”

More Stories By Gary Cornell

Gary Cornell has a PHD in mathematics from Brown University. At various times and among other things he has been a professor, a program director at the National Science Foundation, and a visiting scientist at IBM's Watson Labs. He has written or co-written numerous best-selling and award-winning computer books. Most recently he co-founded Apress (www.apress.com), which under his leadership became one of the largest publishers of books for IT professionals in the world. And he did all this while simultaneously having a truly serious case of the 'gentle madness,' AKA bibliomania.

Comments (4) View Comments

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Most Recent Comments
Debbie Moynihan 10/15/07 01:52:26 PM EDT

Interesting review, I love the idea of a geek book review column. The suggestion to make raw financial data available in XML would be interesting. It would be cool to be able to grab data from various companies and do interesting things with it, but that might be a bit scary to some people...

Jane 10/11/07 04:39:13 PM EDT

Nice start to your new column, Gary. Great review of an interesting sounding book.

Paul E. Hanson 10/11/07 04:48:04 AM EDT

I did get a laugh (on a morbid level) that the blame for LTCM debacle does not lay where popularly thought. I will not give away the source for future readers.

Rajat Bhatia 10/11/07 04:28:17 AM EDT

Derivatives, trading and hedge funds are here to stay. They perform a valuable service to the financial markets, though Warren Buffet will disagree with me.

Nevertheless, it is the mis-use of derivatives and the excessive use of leverage that leads to financial disasters. This book provides an excellent insight into why we witness financial turmoil in some of the most liquid markets.

@MicroservicesExpo Stories
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that's no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, explored how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He expla...
Some people are directors, managers, and administrators. Others are disrupters. Eddie Webb (@edwardawebb) is an IT Disrupter for Software Development Platforms at Liberty Mutual and was a presenter at the 2016 All Day DevOps conference. His talk, Organically DevOps: Building Quality and Security into the Software Supply Chain at Liberty Mutual, looked at Liberty Mutual's transformation to Continuous Integration, Continuous Delivery, and DevOps. For a large, heavily regulated industry, this task ...
The notion of improving operational efficiency is conspicuously absent from the healthcare debate - neither Obamacare nor the newly proposed GOP plan discusses the impact that a step-function improvement in efficiency could have on access to healthcare (through more capacity), quality of healthcare services (through reduced wait times for patients) or cost (through better utilization of scarce, expensive assets).
"WineSOFT is a software company making proxy server software, which is widely used in the telecommunication industry or the content delivery networks or e-commerce," explained Jonathan Ahn, COO of WineSOFT, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that Synametrics Technologies will exhibit at SYS-CON's 22nd International Cloud Expo®, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Synametrics Technologies is a privately held company based in Plainsboro, New Jersey that has been providing solutions for the developer community since 1997. Based on the success of its initial product offerings such as WinSQL, Xeams, SynaMan and Syncrify, Synametrics continues to create and hone inn...
In a recent post, titled “10 Surprising Facts About Cloud Computing and What It Really Is”, Zac Johnson highlighted some interesting facts about cloud computing in the SMB marketplace: Cloud Computing is up to 40 times more cost-effective for an SMB, compared to running its own IT system. 94% of SMBs have experienced security benefits in the cloud that they didn’t have with their on-premises service
There is a huge demand for responsive, real-time mobile and web experiences, but current architectural patterns do not easily accommodate applications that respond to events in real time. Common solutions using message queues or HTTP long-polling quickly lead to resiliency, scalability and development velocity challenges. In his session at 21st Cloud Expo, Ryland Degnan, a Senior Software Engineer on the Netflix Edge Platform team, will discuss how by leveraging a reactive stream-based protocol,...
The past few years have seen a huge increase in the amount of critical IT services that companies outsource to SaaS/IaaS/PaaS providers, be it security, storage, monitoring, or operations. Of course, along with any outsourcing to a service provider comes a Service Level Agreement (SLA) to ensure that the vendor is held financially responsible for any lapses in their service which affect the customer’s end users, and ultimately, their bottom line. SLAs can be very tricky to manage for a number ...
The dynamic nature of the cloud means that change is a constant when it comes to modern cloud-based infrastructure. Delivering modern applications to end users, therefore, is a constantly shifting challenge. Delivery automation helps IT Ops teams ensure that apps are providing an optimal end user experience over hybrid-cloud and multi-cloud environments, no matter what the current state of the infrastructure is. To employ a delivery automation strategy that reflects your business rules, making r...
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...
The past few years have brought a sea change in the way applications are architected, developed, and consumed—increasing both the complexity of testing and the business impact of software failures. How can software testing professionals keep pace with modern application delivery, given the trends that impact both architectures (cloud, microservices, and APIs) and processes (DevOps, agile, and continuous delivery)? This is where continuous testing comes in. D
Admiral Calcote - also known as Lee Calcote (@lcalcote) or the Ginger Geek to his friends - gave a presentation entitled Characterizing and Contrasting Container Orchestrators at the 2016 All Day DevOps conference. Okay, he isn't really an admiral - nor does anyone call him that - but he used the title admiral to describe what container orchestrators do, relating it to an admiral directing a fleet of container ships. You could also say that they are like the conductor of an orchestra, directing...
Our work, both with clients and with tools, has lead us to wonder how it is that organizations are handling compliance issues in the cloud. The big cloud vendors offer compliance for their infrastructure, but the shared responsibility model requires that you take certain steps to meet compliance requirements. Which lead us to start poking around a little more. We wanted to get a picture of what was available, and how it was being used. There is a lot of fluidity in this space, as in all things c...
The goal of Microservices is to improve software delivery speed and increase system safety as scale increases. Microservices being modular these are faster to change and enables an evolutionary architecture where systems can change, as the business needs change. Microservices can scale elastically and by being service oriented can enable APIs natively. Microservices also reduce implementation and release cycle time and enables continuous delivery. This paper provides a logical overview of the Mi...
Gaining visibility in today’s sprawling cloud infrastructure is complex and laborious, involving drilling down into tools offered by various cloud services providers. Enterprise IT organizations need smarter and effective tools at their disposal in order to address this pertinent problem. Gaining a 360 - degree view of the cloud costs requires collection and analysis of the cost data across all cloud infrastructures used inside an enterprise.
"I focus on what we are calling CAST Highlight, which is our SaaS application portfolio analysis tool. It is an extremely lightweight tool that can integrate with pretty much any build process right now," explained Andrew Siegmund, Application Migration Specialist for CAST, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
DevOps promotes continuous improvement through a culture of collaboration. But in real terms, how do you: Integrate activities across diverse teams and services? Make objective decisions with system-wide visibility? Use feedback loops to enable learning and improvement? With technology insights and real-world examples, in his general session at @DevOpsSummit, at 21st Cloud Expo, Andi Mann, Chief Technology Advocate at Splunk, explored how leading organizations use data-driven DevOps to close th...
"We started a Master of Science in business analytics - that's the hot topic. We serve the business community around San Francisco so we educate the working professionals and this is where they all want to be," explained Judy Lee, Associate Professor and Department Chair at Golden Gate University, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Gone are the days when application development was the daunting task of the highly skilled developers backed with strong IT skills, low code application development has democratized app development and empowered a new generation of citizen developers. There was a time when app development was in the domain of people with complex coding and technical skills. We called these people by various names like programmers, coders, techies, and they usually worked in a world oblivious of the everyday pri...
The “Digital Era” is forcing us to engage with new methods to build, operate and maintain applications. This transformation also implies an evolution to more and more intelligent applications to better engage with the customers, while creating significant market differentiators. In both cases, the cloud has become a key enabler to embrace this digital revolution. So, moving to the cloud is no longer the question; the new questions are HOW and WHEN. To make this equation even more complex, most ...