“The current run could go on longer than anyone expects, but when it ends it will be a bigger crash than all of them. And by then it will be too late.”

How did we get here? Ex-lawyer, financial commentator and author Jim Rickards has arrived here via a 50-year career at some of the most famous financial institutions in history. And the CIA.

I meet him in the drawing room of the elegant Greenwich Hotel in downtown New York, owned by a certain Robert de Niro. Rickards is thoughtful and polite, and looks like your average finance professor.

He is in New York to promote his new book, Aftermath: Seven Secrets of Wealth Preservation in the Coming Chaos, which shot to the top of the Amazon wealth management book charts even before it was released last month. The ominous title is a reflection of the last ten years of crisis, which Rickards says has never resolved itself. But more importantly, it is a severe warning of what is to come.

Rickards studied international economics at the Paul Nitze School of Advanced International Studies in Washington, whose ex-students include Madeleine Albright and Tim Geithner, then shifted to law in the 1970s which led to his first job as tax counsel for Citigroup. He followed this by becoming general counsel at Greenwich Capital Markets which was at the time one of the biggest bond dealers in the US. It was a good time to be in finance, coinciding with the rise of the derivatives market and the money splurge that came on the back of this.

After ten years, he decided to leave for a “start-up” in 1993, he says. It is a little disingenuous to call his new company that. In fact, the start-up was no less than Long Term Capital Management (LTCM), perhaps the most famous hedge fund of its era, run by the best bond derivative trader in the world at that time, John Meriwether, backed by the bosses of modern financial theory, Myron Scholes and Robert Merton, all garnished with ex- and future finance luminaries including former vice-chairman of the Fed David Mullins, and Matt Zames, once touted as successor to JP Morgan chief, Jamie Dimon.

I was already in the big leagues so for me it was like going from the Mets to the Yankees

Rickards says he was confident enough – “I was already in the big leagues so for me it was like going from the Mets to the Yankees.” Indeed, the first three years were wildly successful: LTCM posted returns of 21%, 43% and 41%, growing its assets to $7bn.

Rickards himself was involved in deep financial tinkering – he lays claim to having laid out the legal structure of the world’s first sovereign credit default swap (CDS) while at LTCM – much before Blythe Masters ran with the idea at a JP Morgan offsite weekend in Boca Raton in the mid-1990s.

“We did the first CDS,” says Rickards. “My job was to figure out what it meant for a country to default. Basically I had to sit with a blank sheet of paper and think of every way a country could steal your money. It was a rosy time. And then, in 1998, the Russian crisis hit and things went a little sour.”

With multi-billions of losses and running the prospect of ruining the financial system LTCM was bailed out by the Federal Reserve and a consortium of dealers – the first and only time in history that a hedge fund has had to be bailed out by the US’s supreme financial authority.

So what went wrong? Was it Meriwether? Hubris? Bad luck? In fact, none of the three. Meriwether, indeed, appears to have been a good guy: “When you’re that successful people build up myths around you – the Master of the Universe thing,” says Rickards. “Meriwether is a very nice guy but kind of quiet, not bombastic at all and his decision making was consensus driven.”

The weakness at LTCM was the lack of cognitive diversity. Running on pure talent was not enough. The men behind LTCM had studied at the same schools, learned or taught each other the same theories and shared the same blind spots. Rickards says LTCM would have done better to fire a couple of partners and hire a landscape gardener for an opposing point of view.

Jim Rickards in New York

“All these guys had 160 IQs – it was like a meeting of the fathers of financial theory. But they were all the same. We were missing the dissenting point of view.”

By 1998, the company had equity of $4.7bn but was running off-balance sheet derivative positions with a notional value of $1.25trn over 106 different strategies. Statistically speaking, they could not all fail. In the event they all failed at the same time.

“With leverage we were getting brilliant returns on equity and it was impossible to lose money on all of the strategies at the same time,” says Rickards. “Statistically that was true. But there was a thread that ran through all of them and created a conditional correlation. The thread was they were all short volatility.”

When the market moved against it the whole thing shifted at once. Its lack of diverse thinking was its weakness – and it came up against a ruthless market. There was no denying Wall Street’s piranhas.

“At some point word gets out and people know you’re in distress – at that point the market systematically trades against you,” says Rickards. “You can’t turn that around because Wall Street is like a great shoal of fish devouring you, they won’t finish until the last morsel is gone. Why should they do you any favours?”

The magnitude of the position was revealed in a meeting with the Fed on 20 September where Rickards and the company founders ran through termsheet after termsheet outlining the fund’s positions. By the end of it, the Fed’s number two man Peter Fisher was white.

All these guys had 160 IQs – it was like a meeting of the fathers of financial theory. But they were all the same: we were missing the dissenting point of view

“He said I knew you’d destroy the bond market but didn’t know you’d destroy the equity market as well,” Rickards recounts. “I could have slept in the next day because there was nothing left to do but the entire world would have collapsed.” It was an education in mismanagement, says Rickards, but luckily he wasn’t the risk manager.

His career took a different turn not long after when he was tapped by the CIA to help them with counter terrorism post-9/11. This is where the story gets highly conspiratorial. Rickards says there was massive insider trading in the two days before 9/11 – “it’s not rumour or science fiction – it happened” – when the market saw 286 times the average daily volume of puts traded on American Airlines and United Airlines, the companies whose airplanes were used in the attack.

The CIA wanted to see how it could use similar information to prevent future attacks. I ask him why the insider trading story didn’t get more attention at the time.

“People don’t want to talk about it. And the government didn’t want to talk about it,” he says simply.

Rickards and his team got funding from In-Q-Tel, the CIA’s shadowy in-house venture capital department. It allowed them to create a machine based on predictive analytics to analyse market data, which the CIA called ‘Project Prophecy’. The results sound startling.

The Fed should be raising interest rates to prepare for the next recession and normalising interest rate policy but they can’t

On 10 August, 2006, Rickards received a phone call from his business partner who said they had a bright red indicator on American Airlines.

“We escalated that,” he says. “For a couple of days nothing happened, no hijack, nothing. Then, the day after, I have CNN on and suddenly there is Scotland Yard breaking down doors on the news – it was foiling the liquid bomb plot. We got that five days in advance.”

It is a quite breathtaking claim. In fact, Rickards says the machine worked so well they were giving referrals to the SEC until they got “yelled at” by the CIA that it was not a police agency and had to stop talking to the financial regulators.

But there is more. In June 2016, Rickards gave an interview where he said he believed the UK would leave Europe and advised viewers to short sterling and go long gold based on the machine’s information which was now under a private venture, Raven by Meraglim. “Those who listened – it put their kids through college,” he says.

In October 2016, days to go before the US election, he said Trump would win. “Everyone was shocked but that is what happened – that was not a guess.”

These are hard claims to deny. But despite his Nostradamus-like powers of prophecy, Rickards has got things wrong. Indeed, he has been predicting the imminent arrival of a market crash for at least three years now. So far, nothing. But Rickards is convinced.

“Recessions are very hard to predict, but expansions do die,” he says. “We don’t have markets anymore because the Fed is manipulating everything. Their interest rate policy is being driven by the stock market – nothing could be more obvious.”

The Fed should be plotting an even path between the Scylla and Charybdis of higher interest rates and the market’s insatiable appetite for expansion, but so far it seems to have taken its course according to the whims of the latter. Rickards says the stock market is like a little kid – give it some candy and it will stop misbehaving. But it will soon want more candy.

“The Fed should be raising interest rates to prepare for the next recession and normalising interest rate policy but they can’t, not without sinking the stock market,” he says. “They’ve clearly decided that markets come first. But what do you do as an investor bidding up stocks when the only thing propping them up is the Fed policy?”

It’s a big house of cards ready to come crashing down at any moment – and the longer it goes the worse the conclusion. Rickards has warned us, at least.

James Rickards’ new book, ‘Aftermath: Seven secrets of wealth preservation in the coming chaos’ is out now (Penguin Business, £14.99).