| current_article |
App\Entity\Article {#1094
-id: 4177
-title: "AI Struggles to Beat Financial Markets, But Could It Beat Cryptocurrency Markets?"
-slug: "ai-struggles-to-beat-financial-markets-but-could-it-beat-cryptocurrency-markets"
-introtext: "<p><span style="color: #000000;">Financial market data sets present complex challenges for AI and Deep Learning, so how could they possibly work in cryptocurrency markets?</span></p>\r\n"
-content: """
\r\n
<figure id="71bd" class="graf graf--figure graf-after--h4" style="text-align: center;">\r\n
<div class="aspectRatioPlaceholder is-locked">\r\n
<div class="aspectRatioPlaceholder-fill"> <img class="progressiveMedia-image js-progressiveMedia-image" src="https://cdn-images-1.medium.com/max/1600/1*HTYXB-7p1Q0PgNEvx_IK2w.jpeg" alt="" width="1035" height="731" data-src="https://cdn-images-1.medium.com/max/1600/1*HTYXB-7p1Q0PgNEvx_IK2w.jpeg" /></div>\r\n
</div>\r\n
<figcaption class="imageCaption"><span style="color: #808080;"><strong><br />The AP Calc class sizes kept getting smaller. (Image by DarkWorkX from Pixabay)<br /><br /></strong></span></figcaption></figure>\r\n
<p id="2767" class="graf graf--p graf--hasDropCapModel graf--hasDropCap graf-after--figure"><span class="graf-dropCap">In</span>the spring of 2010, James Tyler, a doctor of mathematics from the University of Cambridge, was studying the behavior of some of his automated trading algorithms from a nondescript office on Wall Street, with increasing alarm.</p>\r\n
<p id="c53c" class="graf graf--p graf-after--p">Tyler had been running simulations of market events to judge the response time of his algorithmic trading programs and was starting to grow concerned that under certain market conditions, the algorithms could flag false signals leading to a feedback loop that would have unintended and catastrophic effects for the fund he worked at.</p>\r\n
<p id="2247" class="graf graf--p graf-after--p">The high frequency trading (HFT) fund that Tyler worked at was one of a plethora of HFT funds clustered around the New York Stock Exchange (NYSE) in Wall Street, to gain nanosecond advantages by reducing the time required for trading orders to travel through high speed fiber-optic cables to the NYSE.</p>\r\n
<p id="7bbc" class="graf graf--p graf-after--p">Tyler was his HFT fund’s chief risk officer and it was his job to monitor the algorithms which fed off market data in order to execute high speed trades, scalping basis points on every trade to deliver profits to the fund’s investors.</p>\r\n
<p id="3054" class="graf graf--p graf-after--p">But in the spring of 2010, Tyler had discovered a co-dependency between what ostensibly looked like uncorrelated algorithms, one that had the potential to create a self-perpetuating feedback loop of market signals that would flood the markets with a rush of sell orders, despite there being otherwise no fundamental reasons to sell a particular security.</p>\r\n
<p id="d962" class="graf graf--p graf-after--p">And because many of the algorithms which Tyler worked with relied on what traders refer to as “technical” indicators\u{200A}—\u{200A}objective market data such as price, volume and trade size\u{200A}—\u{200A}under certain market “triggers” many of the fund’s automated trading programs would simply execute sell orders in quick succession, which is what they were designed to do, to protect the fund’s portfolio.</p>\r\n
<p id="16af" class="graf graf--p graf-after--p">In other words, if an algorithm “discovered” that a sell order was being made, it would then automatically place a “sell” order as well, but this consequent “sell” order would also trigger another algorithm to place another “sell” order and so on and so forth, until the programs imploded the market.</p>\r\n
<p id="11ed" class="graf graf--p graf-after--p">And despite HFT strategies assuring regulators that the odds of such an event ever occurring were close to zero, that is precisely what happened in the spring of 2010\u{200A}—\u{200A}the Flash Crash. </p>\r\n
<figure id="be04" class="graf graf--figure graf-after--p" style="text-align: center;">\r\n
<div class="aspectRatioPlaceholder is-locked">\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*70_q8MR8qiLonVrWTv1Ijw.jpeg" data-width="1280" data-height="856" data-action="zoom" data-action-value="1*70_q8MR8qiLonVrWTv1Ijw.jpeg" data-scroll="native"><canvas class="progressiveMedia-canvas js-progressiveMedia-canvas" width="75" height="50"></canvas>\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*70_q8MR8qiLonVrWTv1Ijw.jpeg" data-width="1280" data-height="856" data-action="zoom" data-action-value="1*70_q8MR8qiLonVrWTv1Ijw.jpeg" data-scroll="native"><img class="progressiveMedia-image js-progressiveMedia-image" src="https://cdn-images-1.medium.com/max/1600/1*70_q8MR8qiLonVrWTv1Ijw.jpeg" alt="" width="1038" height="694" data-src="https://cdn-images-1.medium.com/max/1600/1*70_q8MR8qiLonVrWTv1Ijw.jpeg" /></div>\r\n
</div>\r\n
</div>\r\n
<figcaption class="imageCaption"><span style="color: #808080;"><strong><br />The numbers are made up, but the problems are real. (Image by skeeze from Pixabay)<br /><br /></strong></span></figcaption></figure>\r\n
<p id="e09d" class="graf graf--p graf-after--figure">On May 6, 2010, on a particularly pleasant and sunny New York afternoon, the S&P500, Dow Jones Industrial Average (DJIA)and the Nasdaq Composite collapsed and rebounded over 36 heart attack-inducing minutes beginning from 2.32 pm.</p>\r\n
<p id="1171" class="graf graf--p graf-after--p">The DJIA had its second biggest intraday point drop (from opening) in its history, plunging almost 1,000 points (about 9%) within minutes before rebounding very rapidly to make up most of the losses.</p>\r\n
<p id="10b5" class="graf graf--p graf-after--p">While the actual cause of the Flash Crash is still debated and debatable to this very day, the U.S. Department of Justice (DOJ) pinned most of the blame on Navinder Singh Sarao, a 36-year-old small-time trader who worked from his parents’ modest stucco house in suburban west London.</p>\r\n
<p id="b5c3" class="graf graf--p graf-after--p">According to the Commodity Futures Trading Commission (CFTC) investigation, Sarao “was at least significantly responsible for the order imbalances” in the derivatives market which affected stock markets and exacerbated the Flash Crash.</p>\r\n
<p id="14a8" class="graf graf--p graf-after--p">Sarao began his alleged market manipulation as far back as 2009 with commercially available trading software, modifying the code “so he could rapidly place and cancel orders automatically.”</p>\r\n
<p id="665b" class="graf graf--p graf-after--p">According to the DOJ indictment, Sarao had placed orders amounting to some “US$200 million worth of bets that the market would fall,” replacing or modifying them some 19,000 times before they were ultimately cancelled.</p>\r\n
<p id="5926" class="graf graf--p graf-after--p">Some of the practices which Sarao employed at the time were perfectly legal, including spoofing (entering and quickly canceling large buy or sell orders on an exchange to create false impressions of market conditions), layering (similar to spoofing, layering is a HFT strategy where a trader makes and then cancels orders that they never intended to have executed in the hopes of influencing price) and front running (dealing on advance, non-public information knowing that the information will affect the price of a security)\u{200A}—\u{200A}strategies which have since been banned.</p>\r\n
<p id="5c80" class="graf graf--p graf-after--p">But Sarao’s orders were by no means large.</p>\r\n
<p id="a79a" class="graf graf--p graf-after--p">In a market which trades trillions of dollars a day, US$200 million is barely enough to move the needle.</p>\r\n
<p id="b6a6" class="graf graf--p graf-after--p">Some analysts suggest that the <em class="markup--em markup--p-em">real </em>reason for the Flash Crash was erroneous signals, picked up by algorithmic trading programs, which automatically scanned the market and then acted autonomously on such signals.</p>\r\n
<p id="08fd" class="graf graf--p graf-after--p">Which is why there was a flurry of sell orders, causing the market to crash, followed by signals that the market had been oversold, causing a flurry of buy orders to bring the market back to its original equilibrium.</p>\r\n
<p id="6433" class="graf graf--p graf-after--p">And the lessons from the financial markets in 2010 (as well as a subsequent flash crash in 2015), may also provide some lessons for what happened with Bitcoin prices last week.</p>\r\n
<h2 id="10c8" class="graf graf--h4 graf-after--p">Bitcoin Trading is A Lot More Automated Than Anticipated</h2>\r\n
<p id="4bb0" class="graf graf--p graf-after--h4">Beginning the year, Bitcoin had been trading within a relatively tight band (tight by Bitcoin standards), bouncing between US$3,000 and US$4,000.</p>\r\n
<p id="fae6" class="graf graf--p graf-after--p">When Bitcoin did break out above US$4,000 towards the end of February, that rally was short lived as automated trading in the cryptocurrency markets quickly brought Bitcoin back down below US$4,000 about 24 hours later.</p>\r\n
<p id="b30d" class="graf graf--p graf-after--p">During the entire period, the volume of Bitcoin traded was relatively consistent\u{200A}—\u{200A}consisting primarily of market-making bots and other algorithmic trading programs that kept Bitcoin volumes more or less within a zone of equilibrium.</p>\r\n
<p id="fab6" class="graf graf--p graf-after--p">Things changed dramatically however towards the end of April.</p>\r\n
<p id="4649" class="graf graf--p graf-after--p">Bitcoin trading volumes more than doubled across all cryptocurrency exchanges\u{200A}—\u{200A}this increased flurry of activity changed the trading band for Bitcoin, between US$4,000 and US$5,500\u{200A}—\u{200A}a level that stayed consistent until late April.</p>\r\n
<p id="d5b9" class="graf graf--p graf-after--p">It was roughly around this time, when court documents dated April 24, 2019, revealed that the New York Attorney General was building a case against Bitfinex, for misusing funds belonging to Tether to cover over losses of some US$850 million at the cryptocurrency exchange.</p>\r\n
<p id="6ab8" class="graf graf--p graf-after--p">The news of potential malfeasance at Bitfinex, far from putting a damper on Bitcoin prices actually put a shot in the arm of the world’s biggest cryptocurrency by market cap, pushing Bitcoin well beyond US$6,000 in the following weeks.</p>\r\n
<p id="2653" class="graf graf--p graf-after--p">On the back of a significant increase in volume, automated trading programs went into action, feeding off market signals and pushing Bitcoin even higher.</p>\r\n
<p id="0108" class="graf graf--p graf-after--p">The signals of increased trading volume from <em class="markup--em markup--p-em">both</em> automated trading programs as well as human traders led to more automated trading programs being activated and by mid-May, trading in Bitcoin was 8 times the amount it had been in January.</p>\r\n
<p id="d1e3" class="graf graf--p graf-after--p">Because of the feedback loop created, automated trading programs, buoyed by human traders then proceeded to push Bitcoin even further, all the way up beyond US$7,000, a level not seen since the middle of 2018.</p>\r\n
<p id="d140" class="graf graf--p graf-after--p">As Bitcoin started to test the US$8,000 level, that was sufficient signal for automated trading programs to start exiting their Bitcoin positions and almost overnight, Bitcoin plummeted back to the US$7,000 level on the back of heavy volume. <br /><br /><img class="progressiveMedia-image js-progressiveMedia-image" style="display: block; margin-left: auto; margin-right: auto;" src="https://cdn-images-1.medium.com/max/1600/1*mNl0d8-8HndtRRK_SYqlmw.jpeg" alt="" width="1112" height="834" data-src="https://cdn-images-1.medium.com/max/1600/1*mNl0d8-8HndtRRK_SYqlmw.jpeg" /></p>\r\n
<figure id="8e36" class="graf graf--figure graf--startsWithDoubleQuote graf-after--p" style="text-align: center;"><figcaption class="imageCaption"><span style="color: #808080;"><strong><br />“Computer says no.” (Image by Thomas Meier from Pixabay)<br /><br /></strong></span></figcaption></figure>\r\n
<p id="4c56" class="graf graf--p graf-after--figure">As volume started to stabilize, Bitcoin once again settled into a trading band, between US$8,000 towards the end of May.</p>\r\n
<p id="7eb7" class="graf graf--p graf-after--p">But in the last few days of May, Bitcoin, having tested the US$8,000 barrier on several occasions in the previous weeks, powered through to push well beyond US$8,000, leading some to claim that the “crypto winter” was finally over.</p>\r\n
<p id="3ba5" class="graf graf--p graf-after--p">But celebrating the spring thaw for Bitcoin may have been premature, as automated trading would once again keep Bitcoin within a band of between US$8,000 and US$9,000, never actually touching the US$9,000 level and never ever breaching it.</p>\r\n
<p id="8b89" class="graf graf--p graf-after--p">These signals were sufficient to rattle automated trading programs which then proceeded to sell-down Bitcoin collapsing it through the US$8,000 level towards the first week of June, a level where it continues to hover within a band of between US$7,500 and US$8,000.</p>\r\n
<h2 id="24e4" class="graf graf--h4 graf-after--p">Automated Is As Automation Does</h2>\r\n
<p id="a48b" class="graf graf--p graf-after--h4">Unlike financial markets, cryptocurrency markets run 24/7 and because there are few human traders capable of that level of performance and concentration, a large part of cryptocurrency trading is performed by automated trading programs.</p>\r\n
<p id="6894" class="graf graf--p graf-after--p">Unlike financial markets though, HFT is not possible on any of the major cryptocurrency exchanges\u{200A}—\u{200A}with rates deliberately limited so as not to crash the exchange itself.</p>\r\n
<p id="a5d6" class="graf graf--p graf-after--p">However, on decentralized exchanges (as well as some centralized exchanges), many of the behaviors prohibited in the financial markets are not only evident, but prevalent.</p>\r\n
<p id="5246" class="graf graf--p graf-after--p">Behaviors like front running, spoofing and layering are all commonplace on cryptocurrency exchanges.</p>\r\n
<p id="de3e" class="graf graf--p graf-after--p">Such manipulation in cryptocurrency markets where the bulk of the trading is already so highly automated means that the quality of the data which automated trading programs consume and act in response to is extremely prone to feedback loops.</p>\r\n
<p id="cebb" class="graf graf--p graf-after--p">But unlike in the financial markets, these feedback loops take longer to manifest because of the lack of HFT.</p>\r\n
<p id="206c" class="graf graf--p graf-after--p">So while cryptocurrency markets may not exhibit the flash crash susceptibility that regulated financial markets are at risk of experiencing, cryptocurrency markets are still susceptible to the erroneous, self-perpetuating feedback loops that define automated market behavior.</p>\r\n
<p id="bd44" class="graf graf--p graf-after--p">Trading bots detect increased volume which activate new trading programs which detect increased volume and so on and so forth.</p>\r\n
<h2 id="bf76" class="graf graf--h4 graf-after--p">But What Were We Expecting?</h2>\r\n
<p id="1123" class="graf graf--p graf-after--h4">Because we’ve become so used to artificial intelligence or AI auto-populating search fields for us, recommending us books to buy or clothes to wear, reading our faces and (eventually) driving our cars, we’ve come to expect a lot from the technology.</p>\r\n
<p id="39b5" class="graf graf--p graf-after--p">But if there’s one arena which AI has yet to conquer, it’s the financial markets.</p>\r\n
<p id="ab23" class="graf graf--p graf-after--p">Thus far, a computerized stock picker or investment robot has yet to consistently outsmart the financial markets, but it’s not for lack of trying.</p>\r\n
<p id="e10e" class="graf graf--p graf-after--p">In the mid-80s, a concerted push was made by some of the brightest technical minds, to scientifically model markets, as opposed to say, find a cure for cancer.</p>\r\n
<figure id="52e4" class="graf graf--figure graf-after--p" style="text-align: center;">\r\n
<div class="aspectRatioPlaceholder is-locked">\r\n
<div class="aspectRatioPlaceholder-fill"> </div>\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*lf7LkOmu8NNw7lcdn_3b9g.png" data-width="960" data-height="599" data-action="zoom" data-action-value="1*lf7LkOmu8NNw7lcdn_3b9g.png" data-scroll="native"><canvas class="progressiveMedia-canvas js-progressiveMedia-canvas" width="75" height="46"></canvas><img class="progressiveMedia-image js-progressiveMedia-image" src="https://cdn-images-1.medium.com/max/1600/1*lf7LkOmu8NNw7lcdn_3b9g.png" alt="" data-src="https://cdn-images-1.medium.com/max/1600/1*lf7LkOmu8NNw7lcdn_3b9g.png" /></div>\r\n
</div>\r\n
<figcaption class="imageCaption"><span style="color: #808080;"><strong><br />This is what happens when you leave your Roomba alone for too long. (Photo: Studio Canal | Carolco Pictures)<br /><br /></strong></span></figcaption></figure>\r\n
<p id="a6ee" class="graf graf--p graf-after--figure">Many of these efforts to create the ultimate trading robot absorbed some of the top graduates in fields such as math, computer science and even rocket propulsion.</p>\r\n
<p id="d205" class="graf graf--p graf-after--p">Secretive hedge funds like Renaissance Technologies, D.E. Shaw and PDT Partners plied the trade, carving out extraordinary returns in the latter half of the 20th century.</p>\r\n
<p id="38ce" class="graf graf--p graf-after--p">And part of the reason that many of these “robo” hedge funds with their “black boxes” were able to deliver extraordinary returns was the state of computing technology at the time.</p>\r\n
<p id="8f1c" class="graf graf--p graf-after--p">During a period when computers were relatively slow (by today’s standards) and information did not travel as quickly or as freely, the early algorithmic trading outfits were better able to find, preserve and exploit profitable trading strategies for longer periods than today.</p>\r\n
<p id="33f4" class="graf graf--p graf-after--p">But as computers evolved and with the advent of the internet, once profitable strategies which regularly delivered in excess of 30% annualized returns were no longer able to perform to their previous levels.</p>\r\n
<p id="4558" class="graf graf--p graf-after--p">Top flight quant funds such as James Simon’s Renaissance Technologies tweaked their algorithms and to be sure, Simon’s trading strategies were never <em class="markup--em markup--p-em">purely</em> algorithmically driven anyway, with a fair measure of human oversight and discretion initiating and leading trades.</p>\r\n
<p id="bf78" class="graf graf--p graf-after--p">And as it turns out, investing is not like trying to predict your next Amazon purchase.</p>\r\n
<p id="cac6" class="graf graf--p graf-after--p">Ciamac Moallemi, a professor at Columbia Business School and a principal at Bourbaki LLC sums it up best,</p>\r\n
<p style="padding-left: 30px;">“It’s one of the most difficult problems in applied machine learning.”</p>\r\n
<p id="ffbe" class="graf graf--p graf-after--blockquote">For the same reasons that self-driving cars have a tendency to end up in car crashes, AI-driven investing also has a tendency to result in flash crashes.</p>\r\n
<h2 id="6a8b" class="graf graf--h4 graf-after--p">Keep Still So I Can Shoot You</h2>\r\n
<p id="be89" class="graf graf--p graf-after--h4">There are simply too many variables and unknown unknowns as well as unknowable unknowns in the financial markets, for AI in its current state of development to deal with.</p>\r\n
<p id="fe50" class="graf graf--p graf-after--p">In quantspeak, data of the sort that AI has to deal with in the financial markets is “non-stationary.”</p>\r\n
<p id="2a88" class="graf graf--p graf-after--p">An example of stationary data might be the distance of say, your driveway from your door. Short of an earthquake or remodel, that distance is likely to remain constant and if a machine is fed hundreds of pictures of your driveway and your door, it will in all probability be able to identify your home.</p>\r\n
<p id="c566" class="graf graf--p graf-after--p">But financial markets are charged with data that can change dramatically in unprecedented and unforeseeable ways\u{200A}—\u{200A}for instance when Russia defaulted on its sovereign debt in the 90s.</p>\r\n
<p id="d485" class="graf graf--p graf-after--p">Not so with cryptocurrencies.</p>\r\n
<p id="2e98" class="graf graf--p graf-after--p">As an unconstrained asset, with limited correlation to other assets, the data sets that need to be considered when it comes to trading cryptocurrencies are far fewer\u{200A}—\u{200A}many of which are speculative and many of which are co-dependent, resulting in far more predictable patterns then say in the financial markets. <br /><br /><img class="progressiveMedia-image js-progressiveMedia-image" style="display: block; margin-left: auto; margin-right: auto;" src="https://cdn-images-1.medium.com/max/1600/1*xGPCAx1OhR574Yp2GSMebA.jpeg" alt="" width="1019" height="679" data-src="https://cdn-images-1.medium.com/max/1600/1*xGPCAx1OhR574Yp2GSMebA.jpeg" /></p>\r\n
<figure id="87bf" class="graf graf--figure graf-after--p" style="text-align: center;"><figcaption class="imageCaption"><span style="color: #808080;"><strong><br />There’s a divinity that shapes our ends, rough hew them how we will. (Image by Lorenzo Cafaro from Pixabay)<br /><br /></strong></span></figcaption></figure>\r\n
<p id="dcaf" class="graf graf--p graf-after--figure">Stocks on the other hand move all the time and not always for any discernible reason, with most market moves what economists term “noise” trading.</p>\r\n
<p id="1eb7" class="graf graf--p graf-after--p">Returning to the analogy of your door and your driveway, imagine if a computer was instead trying to identify your home based on pictures of your home taken both day and night and in varying lighting conditions.</p>\r\n
<p id="9547" class="graf graf--p graf-after--p">Most of the data in those pictures would be “noise” and worse, the light in some of those pictures at least could lead to “false positives,” which could induce the computer to mistake someone else’s home for yours.</p>\r\n
<p id="a889" class="graf graf--p graf-after--p">And as data sets go, historical stock price data is not particularly voluminous, meaning that what may appear to be a significant data point may actually be insignificant if a larger amount of data were available\u{200A}—\u{200A}sort of the way jagged peaks and troughs on a chart tend to smooth out with more data over a longer period of time.</p>\r\n
<p id="dfa1" class="graf graf--p graf-after--p">To illustrate this difficulty, say you’re trying to predict how stocks will perform over a one-year horizon. Because there’s only reliable stock information from 1900 onward, there are only 118 non-overlapping one-year periods usable for examination purposes.</p>\r\n
<p id="8264" class="graf graf--p graf-after--p">In contrast, Facebook, which has a virtually endless supply of data with which to work with, processes no fewer than 350 million pictures a day.</p>\r\n
<p id="6e0b" class="graf graf--p graf-after--p">And unlike examining financial data (which can be manipulated or misrepresented), examining photos is a lot easier for computers because simple tricks such as rotating the images or adjusting contrast can increase the amount of data available with which to make assessments\u{200A}—\u{200A}financial data unfortunately, can’t be digitally enhanced by AI.</p>\r\n
<h2 id="e2b3" class="graf graf--h4 graf-after--p">Limited Data & Limited Edges</h2>\r\n
<p id="d625" class="graf graf--p graf-after--h4">Obvious signals, say buying stocks on the first day of every month, are of limited value and even if they worked in the past are probably more a product of coincidence, than reflective of any predictive skill.</p>\r\n
<p id="f08c" class="graf graf--p graf-after--p">And even if it wasn’t just luck that discovered these “obvious signals,” thanks to the relative transparency with which financial markets trade with, such advantages will be quickly discovered and any profits, traded away.</p>\r\n
<p id="f9b2" class="graf graf--p graf-after--p">So instead of trying to find “obvious signals,” many analysts have turned to divining the subtle\u{200A}—\u{200A}ones that predict the future price with only 51% certainty.</p>\r\n
<p id="b7d5" class="graf graf--p graf-after--p">While that may not sound like a lot of confidence, consider that in casinos, a 51% advantage is the average house advantage for most table (card) games such as Blackjack and Baccarat and more than sufficient to ensure that over the long run, the house always wins.</p>\r\n
<p id="03aa" class="graf graf--p graf-after--p">The same goes for hedge funds deploying such strategies.</p>\r\n
<p id="5991" class="graf graf--p graf-after--p">By taking a large number of very small bets with a small advantage such as 51% and juicing those bets with leverage, mangers can make outsize returns in relation to the actual size of the funds invested.</p>\r\n
<p id="b966" class="graf graf--p graf-after--p">In cryptocurrency markets, a 51% advantage is not only possible, it’s relatively pedestrian. </p>\r\n
<figure id="a29b" class="graf graf--figure graf--startsWithDoubleQuote graf-after--p" style="text-align: center;">\r\n
<div class="aspectRatioPlaceholder is-locked">\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*RYhuXeJv0xmduiadzn6uPA.jpeg" data-width="1920" data-height="1280" data-action="zoom" data-action-value="1*RYhuXeJv0xmduiadzn6uPA.jpeg" data-scroll="native"><canvas class="progressiveMedia-canvas js-progressiveMedia-canvas" width="75" height="50"></canvas>\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*RYhuXeJv0xmduiadzn6uPA.jpeg" data-width="1920" data-height="1280" data-action="zoom" data-action-value="1*RYhuXeJv0xmduiadzn6uPA.jpeg" data-scroll="native"><img class="progressiveMedia-image js-progressiveMedia-image" src="https://cdn-images-1.medium.com/max/1600/1*RYhuXeJv0xmduiadzn6uPA.jpeg" alt="" width="1122" height="748" data-src="https://cdn-images-1.medium.com/max/1600/1*RYhuXeJv0xmduiadzn6uPA.jpeg" /></div>\r\n
</div>\r\n
</div>\r\n
<figcaption class="imageCaption"><span style="color: #808080;"><strong><br />“What you do speaks so loud, I can’t hear what you’re saying.” (Image by SeppH from Pixabay)<br /><br /></strong></span></figcaption></figure>\r\n
<p id="0492" class="graf graf--p graf-after--figure">Because there are far fewer signals to monitor and because the “noise” is far easier to identify and isolate, trading advantages can be far larger than 51%.</p>\r\n
<p id="71c1" class="graf graf--p graf-after--p">And unlike financial markets where there are minimum order sizes and minimum brokerage fees regardless of the size of the trade, cryptocurrency markets generally work on a percentage of every trade, regardless of the size of the trade.</p>\r\n
<p id="f421" class="graf graf--p graf-after--p">What this means is that even cryptocurrency traders who trade relatively small amounts can still yield alpha as if he or she were a large-sized hedge fund, availing themselves of trade fees of a few basis points regardless of the trade size.</p>\r\n
<p id="bf3d" class="graf graf--p graf-after--p">Not so in the financial markets, which is why many mangers look to improve returns by reducing transaction costs. Because, as mentioned, in financial markets each transaction regardless of size attracts a minimum cost.</p>\r\n
<p id="d301" class="graf graf--p graf-after--p">The other way that managers can cut costs is to reduce slippage, which is the actual cost paid for buying a specific security, as opposed to the target price.</p>\r\n
<p id="c662" class="graf graf--p graf-after--p">Say for instance the price of a share of General Motors is US$100, but only 100 shares are available at that price and if you wanted to buy 1,000 shares of GM, you’d need to bid up the price, which may result in the average cost of your shares being US$105 or even more\u{200A}—\u{200A}a 5% premium on your target price.</p>\r\n
<p id="7537" class="graf graf--p graf-after--p">The thing about slippage is that it’s difficult to predict the actual price or cost of a security without transacting in the market.</p>\r\n
<p id="4e4c" class="graf graf--p graf-after--p">For instance, even if the sell queue seems to be laden with sellers, a sudden move, for instance buying a large amount of a till then illiquid stock, might make sellers think that they can fetch a better price for their stock or automated trading programs might immediately withdraw their sell orders, forcing the price to surge upwards, despite there being no <em class="markup--em markup--p-em">significant </em>reason for prices to rise other than the withdrawal of liquidity.</p>\r\n
<h2 id="ac73" class="graf graf--h4 graf-after--p">The Tricky Business of Liquidity</h2>\r\n
<p id="3931" class="graf graf--p graf-after--h4">The same market behavior is observable in cryptocurrency markets.</p>\r\n
<p id="633a" class="graf graf--p graf-after--p">Take Bitcoin for instance.</p>\r\n
<p id="c336" class="graf graf--p graf-after--p">Depending on which cryptocurrency exchange you intend to buy your Bitcoin from and how much Bitcoin you buy, <em class="markup--em markup--p-em">you</em> could be the market for Bitcoin, with your moves affecting the overall price of Bitcoin.</p>\r\n
<p id="0ffd" class="graf graf--p graf-after--p">Which is why when investor are seeking to acquire large amounts of Bitcoin, they tend to spread their purchases across a variety of cryptocurrency exchanges, with many also using over-the-counter or OTC transactions that are off-market and do not affect the price of Bitcoin in the open market.</p>\r\n
<p id="eeb5" class="graf graf--p graf-after--p">And while many use CoinMarketCap (a website) to determine the price of Bitcoin, it is far from authoritative, using a closely guarded algorithm to determine the blended price of Bitcoin from various undisclosed sources\u{200A}—\u{200A}hardly the stuff of transparency.</p>\r\n
<p id="bf2b" class="graf graf--p graf-after--p">But fortunately, computers <em class="markup--em markup--p-em">can </em>be taught to anticipate transaction costs and this helps traders in two ways.</p>\r\n
<p id="1399" class="graf graf--p graf-after--p">First, if an algorithm can effectively predict the likely slippage based on the order size and historical liquidity, the edge required for a trading signal could come down from say 51% to 50.5%, meaning more trades can be made, yielding more opportunities for profit.</p>\r\n
<p id="e82e" class="graf graf--p graf-after--p">And more trades also means, according to the law of large numbers, better chances at achieving target odds. </p>\r\n
<figure id="17fb" class="graf graf--figure graf-after--p" style="text-align: center;">\r\n
<div class="aspectRatioPlaceholder is-locked">\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*K-LSIZleIQLiHA4Bq3TKuw.jpeg" data-width="1920" data-height="1280" data-action="zoom" data-action-value="1*K-LSIZleIQLiHA4Bq3TKuw.jpeg" data-scroll="native"><canvas class="progressiveMedia-canvas js-progressiveMedia-canvas" width="75" height="50"></canvas>\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*K-LSIZleIQLiHA4Bq3TKuw.jpeg" data-width="1920" data-height="1280" data-action="zoom" data-action-value="1*K-LSIZleIQLiHA4Bq3TKuw.jpeg" data-scroll="native"><img class="progressiveMedia-image js-progressiveMedia-image" src="https://cdn-images-1.medium.com/max/1600/1*K-LSIZleIQLiHA4Bq3TKuw.jpeg" alt="" width="1115" height="743" data-src="https://cdn-images-1.medium.com/max/1600/1*K-LSIZleIQLiHA4Bq3TKuw.jpeg" /></div>\r\n
</div>\r\n
</div>\r\n
<figcaption class="imageCaption"><span style="color: #808080;"><strong><br />The house always wins because it doesn’t have to go home, you do. (Image by Linda72 from Pixabay)<br /><br /></strong></span></figcaption></figure>\r\n
<p id="0bff" class="graf graf--p graf-after--figure">The second way reducing slippage helps is that more profit can be squeezed from existing opportunities.</p>\r\n
<p id="e0a4" class="graf graf--p graf-after--p">Say for instance a widely known model identifies Bitcoin as 1% undervalued.</p>\r\n
<p id="2690" class="graf graf--p graf-after--p">Without understanding transaction costs, a trader might purchase only 100 Bitcoins, lest it risk too much slippage and push the price of Bitcoin above the 1% spread that it’s looking to capture.</p>\r\n
<p id="97aa" class="graf graf--p graf-after--p">But another trader armed with an algorithm that can predict the transaction cost with perhaps an 80% probability might know that 500 Bitcoins could be purchased without pushing the price of Bitcoin beyond 1%.</p>\r\n
<p id="5f08" class="graf graf--p graf-after--p">The trader who is able to effectively predict and price transaction cost could boost their returns by 500%\u{200A}—\u{200A}a huge advantage in any market and significantly affecting long-run returns.</p>\r\n
<p id="4a88" class="graf graf--p graf-after--p">In order to squeeze transaction costs further, some quant managers build their own high-frequency trading operations, in which they can act as market makers, making profits by matching buyers and sellers.</p>\r\n
<p id="accf" class="graf graf--p graf-after--p">In the cryptocurrency markets, market makers (of which my firm is but one of many) also employ market making algorithms that provide constant liquidity for cryptocurrency exchanges and match buyers and sellers.</p>\r\n
<p id="de78" class="graf graf--p graf-after--p">Running these market making operations does not just contribute to bottom lines, it also provides deep insight into market behavior.</p>\r\n
<p id="f546" class="graf graf--p graf-after--p">It’s a bit like having your own people on the floor of the New York Stock Exchange as opposed to using a brokerage.</p>\r\n
<p id="b40a" class="graf graf--p graf-after--p">The level of intimacy of interaction and immediacy of information is unparalleled.</p>\r\n
<h2 id="4fc3" class="graf graf--h4 graf-after--p">Looking for Alpha Between Sofa Cushions</h2>\r\n
<p id="0198" class="graf graf--p graf-after--h4">Some quant managers who struggle with market data are finding other kinds of information to mine instead of just what the market tells them.</p>\r\n
<p id="8c51" class="graf graf--p graf-after--p">Whether it’s commodities traders using satellite photos of feed lots or social media feeds, alternative data may provide some help especially where the classical data is either cumbersome or unreliable.</p>\r\n
<p id="7dd8" class="graf graf--p graf-after--p">To that end, many cryptocurrency traders monitor Twitter, Medium, Telegram and Reddit to mine information about potential cryptocurrency movements to gain an edge in their trading.</p>\r\n
<p id="b0dd" class="graf graf--p graf-after--p">But as such data becomes easier and easier to find, the advantage that such data provides typically suffers from a lack of longevity.</p>\r\n
<p id="e18c" class="graf graf--p graf-after--p">Rob Arnott of Research Affiliates and Campbell Harvey, a professor at the Fuqua School of Business, North Carolina\u{200A}—\u{200A}two of the best known experts in quant investing\u{200A}—\u{200A}have warned investor against using machine learning to derive investment strategies from data sets that lack sufficient depth. </p>\r\n
<figure id="88cd" class="graf graf--figure graf-after--p" style="text-align: center;">\r\n
<div class="aspectRatioPlaceholder is-locked">\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*A6d-Gb0qBXal9np-SY8toA.jpeg" data-width="1920" data-height="1282" data-action="zoom" data-action-value="1*A6d-Gb0qBXal9np-SY8toA.jpeg" data-scroll="native"><canvas class="progressiveMedia-canvas js-progressiveMedia-canvas" width="75" height="50"></canvas>\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*A6d-Gb0qBXal9np-SY8toA.jpeg" data-width="1920" data-height="1282" data-action="zoom" data-action-value="1*A6d-Gb0qBXal9np-SY8toA.jpeg" data-scroll="native"><img class="progressiveMedia-image js-progressiveMedia-image" src="https://cdn-images-1.medium.com/max/1600/1*A6d-Gb0qBXal9np-SY8toA.jpeg" alt="" width="1045" height="698" data-src="https://cdn-images-1.medium.com/max/1600/1*A6d-Gb0qBXal9np-SY8toA.jpeg" /></div>\r\n
</div>\r\n
</div>\r\n
<figcaption class="imageCaption"><span style="color: #808080;"><strong><br />Looking for alpha means you need to go where no one else is prepared to. (Image by skeeze from Pixabay)<br /><br /></strong></span></figcaption></figure>\r\n
<p id="261c" class="graf graf--p graf-after--figure">Arnott and Harvey have even proposed a checklist for applying deep learning techniques, with a specific focus on the depth of specific data sets, because the alternative Arnott suggests, is akin to driving a Ferrari on a dirt track.</p>\r\n
<p id="383e" class="graf graf--p graf-after--p">But even if specific catering for thin data sets is made, there are still considerable risks when applying alternative data sources towards deep learning.</p>\r\n
<p id="8281" class="graf graf--p graf-after--p">Because even a minor bias in a data set has the potential to be picked up by a trading model, leading to extraordinary returns, future decisions made by such trading models may be based on a series of false positives or confirmation bias\u{200A}—\u{200A}the algorithms see more of what your they’ve been trained to notice.</p>\r\n
<p id="9031" class="graf graf--p graf-after--p">For example, if in your mind you’ve decided to buy a red Ferrari, you may suddenly find yourself seeing the car you want to buy everywhere you go, when in fact, the statistical likelihood is that the instances of the car appearing is exactly the same as it was before, you simply have started taking notice of it.</p>\r\n
<p id="8174" class="graf graf--p graf-after--p">So the combination of new data and powerful data mining tools is a potentially dangerous mix\u{200A}—\u{200A}because deep learning tools can very easily and inadvertently be designed with existing biases\u{200A}—\u{200A}leading to conclusions or predictions based on patchy or misconstrued data.</p>\r\n
<h2 id="afa2" class="graf graf--h4 graf-after--p">Keep It Simple Stupid</h2>\r\n
<p id="5822" class="graf graf--p graf-after--h4">Because of the complexity of data and the amount of “noise” in both cryptocurrency and financial markets, there is tremendous merit in keeping models as simple as possible.</p>\r\n
<p id="24e9" class="graf graf--p graf-after--p">According to Nick Patterson, a former researcher who spent a decade at Renaissance Technologies,</p>\r\n
<p style="padding-left: 30px;">“One tool that Renaissance uses is linear regression, which a high school student could understand.”</p>\r\n
<p id="b2e7" class="graf graf--p graf-after--blockquote">Granted not just <em class="markup--em markup--p-em">any</em> high school student would get linear regression\u{200A}—\u{200A}probably the ones doing AP Calc would —the technique is simply a way to find the relationship between two variables.</p>\r\n
<p id="a6cf" class="graf graf--p graf-after--p">While linear regression may be difficult to determine between the dollar and say Bitcoin, it is interestingly enough, a lot easier to determine within cryptocurrencies themselves, in particular between Ethereum and Bitcoin.</p>\r\n
<p id="07a3" class="graf graf--p graf-after--p">But in the financial markets, linear regression gets more tricky.</p>\r\n
<p id="a308" class="graf graf--p graf-after--p">Because of the non-stationary nature of data sets in financial markets, even where linear regression is “discovered,” it may be based on a set of false positives or quickly evolve into a different relationship.</p>\r\n
<p id="a1f5" class="graf graf--p graf-after--p">Which is why AI still struggles with pattern determination and predictive models in financial markets\u{200A}—\u{200A}there are simply too many moving parts.</p>\r\n
<h2 id="df5a" class="graf graf--h4 graf-after--p">Autonomous Alpha</h2>\r\n
<p id="8e03" class="graf graf--p graf-after--h4">Although hedge funds continue to pour resources into creating the Skynet (a fictional artificial neural network-based conscious group mind and artificial general intelligence system from the <em class="markup--em markup--p-em">Terminator</em> movies) of trading, finding new market signals is still very much a human endeavor.</p>\r\n
<p id="c2b9" class="graf graf--p graf-after--p">Some of the top quant funds still employ hundreds of Ph.D.s in subjects such as mathematics, computer science and even rocket propulsion.</p>\r\n
<p id="638b" class="graf graf--p graf-after--p">The fundamental core of discerning patterns in a highly random universe is still very much akin to rocket science.</p>\r\n
<p id="8e14" class="graf graf--p graf-after--p">To build the Skynet of investing, one that perhaps won’t threaten to destroy the financial world in its wake, will require researchers to crack the code of causation.</p>\r\n
<p id="58d5" class="graf graf--p graf-after--p">Because correlation does not imply causation, such an autonomous investing system would for example, not only need to detect that a rise in a particular stock is accompanied by a rise in interest rates, it would also need to come up with a good reason for it.</p>\r\n
<p id="f604" class="graf graf--p graf-after--p">For now at least, humans still have an advantage over machines at this sort of critical thinking and analysis, but AI is starting to make inroads.</p>\r\n
<p id="be03" class="graf graf--p graf-after--p">Deep learning in particular has driven recent advances in AI such as image recognition and speech translation, two notoriously complex data sets.</p>\r\n
<figure id="f34b" class="graf graf--figure graf-after--p" style="text-align: center;">\r\n
<div class="aspectRatioPlaceholder is-locked">\r\n
<div class="aspectRatioPlaceholder-fill"> </div>\r\n
<div class="progressiveMedia js-progressiveMedia graf-image is-canvasLoaded is-imageLoaded" data-image-id="1*P8F2sO8l7fveihva3cXtQw.jpeg" data-width="770" data-height="531" data-action="zoom" data-action-value="1*P8F2sO8l7fveihva3cXtQw.jpeg" data-scroll="native"><canvas class="progressiveMedia-canvas js-progressiveMedia-canvas" width="75" height="51"></canvas><img class="progressiveMedia-image js-progressiveMedia-image" src="https://cdn-images-1.medium.com/max/1600/1*P8F2sO8l7fveihva3cXtQw.jpeg" alt="" data-src="https://cdn-images-1.medium.com/max/1600/1*P8F2sO8l7fveihva3cXtQw.jpeg" /></div>\r\n
</div>\r\n
<figcaption class="imageCaption"><span style="color: #808080;"><strong><br />T-800 was unimpressed at attempts to school it. ( Photo: <em class="markup--em markup--figure-em">Warner Bros. via CNET/CBS Interactive.)<br /><br /></em></strong></span></figcaption></figure>\r\n
<p id="1d23" class="graf graf--p graf-after--figure">And though deep learning’s use in finance is limited, that hasn’t stopped researchers from trying to use it.</p>\r\n
<p id="b2bf" class="graf graf--p graf-after--p">Zachary Lipton, a professor at Carnegie Mellon University, co-authored a paper with John Alberg of Euclidean Technologies, an investment management firm, attempting to demonstrate one possible approach to addressing the “noise” problem inherent in financial market data sets\u{200A}—\u{200A}track company fundamentals like revenue or profit margins that ultimately drive company returns instead of stock prices.</p>\r\n
<p id="032c" class="graf graf--p graf-after--p">But even Lipton and Alberg’s approach has its limitations.</p>\r\n
<p id="a19a" class="graf graf--p graf-after--p">First, it assumes that the quality of the data is impeccable. Given the variety and complexity of valuation models and accounting standards, the quality of inputs in financial markets varies greatly.</p>\r\n
<p id="aa97" class="graf graf--p graf-after--p">Second, because financial markets are constantly adaptive and data sets are generally not deep nor long enough, enduring trends are barely discernible if they exist at all.</p>\r\n
<p id="22aa" class="graf graf--p graf-after--p">Speaking to the <em class="markup--em markup--p-em">Financial Times, </em>Andrew Lapthorne, head of quantitative equity research at Société Générale, an investment bank, cautions,</p>\r\n
<p style="padding-left: 30px;">“The machine has no idea in 2007 that a financial crisis is on the way when it is building its model in 2006.”</p>\r\n
<p id="8081" class="graf graf--p graf-after--blockquote">Simply put, while computers may be able to discern patterns based on what <em class="markup--em markup--p-em">has</em> happened, they’re generally not as good as predicting what <em class="markup--em markup--p-em">may</em> happen\u{200A}—\u{200A}things like the invention of the internet, the evolution of mobile computing and self-driving cars\u{200A}—\u{200A}these are predictions that AI generally struggles with as they require absorbing a large amount of highly generalized data to divine trends\u{200A}—\u{200A}in other words, critical, “out-of-the-box” thinking.</p>\r\n
<p id="99cf" class="graf graf--p graf-after--p">One of the reasons why AI and deep learning struggle so much in the financial markets is because two of the most unpredictable human emotions of greed and fear are made manifest in this highly competitive arena.</p>\r\n
<p id="f576" class="graf graf--p graf-after--p">And financial markets determine so much of what it means to be human\u{200A}—\u{200A}everything we do is directly or indirectly dictated by the financial markets\u{200A}—\u{200A}that the factors which influence market prices are as varied as the humans that are influenced by them.</p>\r\n
<p id="c4f2" class="graf graf--p graf-after--p">The amount we pay on our mortgages, how much our food costs, whether we drive to work or walk, everything routes back to the financial markets, making predictive models that much more difficult when left purely to automatons.</p>\r\n
<p id="41ce" class="graf graf--p graf-after--p">But because cryptocurrency markets (for now) have limited influence in actual daily life, the factors involved are far fewer and more determinate.</p>\r\n
<p id="c801" class="graf graf--p graf-after--p">Because most of cryptocurrency trading is autonomously and algorithmically driven, patterns are more easily discernible and human trading behavior often sticks out in stark contrast to established market behavior.</p>\r\n
<p id="6cad" class="graf graf--p graf-after--p">This means that if relatively small advantages, in the region of 51% to 55% are sought out in the cryptocurrency markets, they can <em class="markup--em markup--p-em">almost</em> be guaranteed.</p>\r\n
<p id="39b8" class="graf graf--p graf-after--p">The issue of course is not the opportunity to profit\u{200A}—\u{200A}it’s the magnitude of such profits.</p>\r\n
<p id="02a8" class="graf graf--p graf-after--p">Currently, cryptocurrencies simply do not have the volume and liquidity necessary for autonomous trading strategies to be deployed in large quantums.</p>\r\n
<p id="7515" class="graf graf--p graf-after--p">Percentage returns for algorithmic cryptocurrency trading may be significant, but beyond certain volumes, especially when assets under management start approaching the hundreds of millions of dollars, traders need to get far more creative and circumspect in deploying funds as the opportunities are far fewer at larger order sizes.</p>\r\n
<p id="ebd7" class="graf graf--p graf-after--p">For now at least, AI and machine learning are still some ways away from consistently beating the financial markets, but with a bit of tweaking they may be a lot closer to beating the cryptocurrency markets.</p>\r\n
<p id="038d" class="graf graf--p graf-after--p graf--trailing">And while the prospect of searching for phantom signals that eventually disappear could dissuade some people from working in finance or cryptocurrency trading\u{200A}—\u{200A}the lure of solving tough problems coupled with the potential to make some serious money means that there will always be more than enough people who will try.</p>
"""
-user: Proxies\__CG__\App\Entity\User {#1092 …}
-createdAt: DateTime @1560434420 {#1145
date: 2019-06-13 14:00:20.0 UTC (+00:00)
}
-updatedAt: DateTime @1560434882 {#1150
date: 2019-06-13 14:08:02.0 UTC (+00:00)
}
-deletedAt: null
-category: App\Entity\Category {#445 …}
-status: "published"
-imageCard: Proxies\__CG__\App\Entity\File {#1184 …}
-ImageHeader: Proxies\__CG__\App\Entity\File {#1184 …}
-featured: false
-mainView: false
-clicks: 4098
-comments: Doctrine\ORM\PersistentCollection {#1125 …}
-reviewed_at: DateTime @1560434418 {#1148
date: 2019-06-13 14:00:18.0 UTC (+00:00)
}
-metakey: ""
-metadesc: "Financial market data sets present complex challenges for AI and Deep Learning, so how could they possibly work in cryptocurrency markets?"
-robots: null
-publishedAt: DateTime @1560434418 {#1147
date: 2019-06-13 14:00:18.0 UTC (+00:00)
}
-canonical: null
-superTag: null
} |