Ep.8 \u00a0Back, back, back, it up (Backtesting)<\/strong><\/p>\nListeners! This is possibly going to be one of the most useful episodes for you all whether or not you know what backtesting is. The reason? This is something I spent many many years trying to hone in and understand and was blessed to be mentored by some of the most fantastic people in trading who know this subject well. So this episode is going to be a combination of the past 8 years of my failures, trials, and eventual success in backtesting. Even if you\u2019ve never backtested, or you\u2019re a data scientist and think you know what this is, trust me \u2013 this will shape the way you think about the investing and trading.<\/p>\n
So briefly? What is backtesting? You\u2019ve actually seen backtesting not only on CNBC, which hopefully you watch sparingly, but also on ESPN! So if you think you it\u2019s too complicated, trust me \u2013 you\u2019ve already been exposed to it.<\/p>\n
So backtesting is simply taking an investing or trading strategy, forming it into rules, then seeing how those rules performs historically. A simple example you may see on TV is, \u201cwhen the S&P was down 3 days in a row, it was also down on the 4th<\/sup> day.\u201d Or on ESPN it may be \u201ca 1st<\/sup> round seed has never lost in the first round in NCAA basketball.\u201d Just a heads up: I\u2019m making these numbers up.<\/p>\nSo what\u2019s the rule in the first example? You want to see if it\u2019s worthwhile to buy an S&P ETF since it\u2019s been down 3 days in a row and you think it\u2019s time for it to comeback. So you want to see historically if this has worked out in the past. Typically, somebody would make a test that looks back every time the S&P has been down 3 days in a row and then measure if it would go up the fourth day. There are a lot more fun nuances we\u2019ll get into this and how to properly test it.<\/p>\n
In the ESPN example, the backtest\u2019s rule is simple: has any #1 seed ever lost in the first round? You go through all the data historically and test to see if that\u2019s ever happened.<\/p>\n
Before you shut off the podcast, know that you don\u2019t have to be a programmer anymore to do stuff like this, you can now use things that look very simple. Tiingo actually has tools to do this, and we\u2019re building more, but this is becoming a trend. This podcast episode will discuss some resources where you can backtest things, whether or not you are a programmer or not a programmer. We will also walk through a backtest example that you can do in excel.<\/p>\n
I made this episode also because I see backtests in news articles and the media, and often they do it wrong. The tools are becoming much more accessible, even for hardcore programmers, but we still need to learn how to use them. Likewise, having a hammer, nails, and wood wont build a new house. We still gotta learn how to use the tools!<\/p>\n
Tiingo Announcements:<\/strong><\/p>\nAnd before we deep dive into this, just want to take a quick break to describe some Tiingo announcements. The magazine issue of Modern Trader featuring Tiingo in the cover story is available at moderntrader.com or Barnes and Noble as the July issue. If the issue is out of print by the time you\u2019re listening, ask me and I\u2019ll send you a scan of the Tiingo page so you can listen it J It was a huge honor and we are incredibly thankful for it.<\/p>\n
Secondly Tiingo.com is now available in a mobile version, so check it out on your device! It\u2019s pretty surreal to think people now have a high-end financial app in their pockets. I realized I took this for granted, the fact that I can access google, my E-mail, or Facebook right in my pocket\u2026but it really is extraordinary! And now you can access awesome data and a portfolio risk system in your pocket. This wraps up the major UI overhaul and now changes will be more incremental.<\/p>\n
Thirdly, Tiingo is now using modern cryptography, so when using Tiingo, your data is encrypted using the latest security measures.<\/p>\n
And finally, the fundamental data has received a massive, massive update. We now have structured fundamental data for over 4,300 companies, including companies that no longer trade and very small microcap companies. Not only that, but you can see annual statements in addition to quarterly that goes back over ten years. Annnd to make It even sweeter, you can now see what fundamental data the company reported when they filed, and also see any restatements they made. This is all structured on Tiingo, so it\u2019s pure data, you don\u2019t have to dig through documents anymore.<\/p>\n
If you like what Tiingo\u2019s doing, whether it\u2019s the podcast, the website, mission, or so on, we ask that you pay what you can on Tiingo.com\/support,\u00a0 that\u2019s Tiingo.com\/support (spell out).<\/p>\n
That concludes the announcements so let\u2019s get back into it!<\/p>\n
So let\u2019s walk through a tradeable backtest and how we can create one. This will be the foundation for the rest of the podcast. You may notice, I\u2019m going to spend a lot more time discussing how to test a backtest and the problems with backtests, rather than how to create one. This is because there are so many traps you can make as a data scientist in finance and unlearning then re-learning is so much harder than learning it properly the first time. <\/strong><\/p>\nFirst, to continue we need to define a backtest study vs a tradeable backtest. Previously we gave examples of two backtests, but if we think back to them, they are not tradeable. If the S&P falls the past 3 days on noticing what happens the next day is an interesting study, but not tradeable. In order for a backtest to be tradeable we need to meet two conditions<\/p>\n
\n- There has to be a buy condition<\/li>\n
- There has to be a sell condition<\/li>\n<\/ul>\n
Another markets example would be, \u201cwhat would happen if I bought a stock after it fell 5% in one week?\u201d This is an incomplete back test because it gives us the condition for buying a stock but not selling it. A complete rule would be, \u201cIf a stock falls 5% in 5 days, I will buy and hold the stock for 10 days and then sell shares.\u201d Here we have both a buy and sell condition. I\u2019m going to use this example for the rest of the episode.<\/p>\n
To test an idea like this, we can simply do this in Excel or Google spreadsheets. In the blog, blog.tiingo.com, I attached a link to this backtested strategy in Google spreadsheets. Before of the feedback from you all, I\u2019ve learned it\u2019s not very effective to walk through a spreadsheet via podcast haha. So we\u2019re going to skip over, but the spreadsheet document on the blog is well-annotated. It also goes through very simply why we use log returns instead of simple returns when doing backtests. We discussed this in a prior episode, so I won\u2019t repeat it here as to what the differences are. The spreadsheet does a much better job than I could do over voice.<\/p>\n
Anyway, with the idea of a tradeable backtest established, I want to dig into something else. I want to now dig into the problems I see all the time in both the news media and publications sent out to hedge funds, banks, and so on. And that\u2019s the topic of poor data science in markets.<\/p>\n
A quick story before we move on: There is a general rule in financial backtests and that\u2019s \u201cif it\u2019s too good to be true, it probably is.\u201d A few months ago I had a company come to me trying to pitch me their product. Generally when people do this, I always listen because as a guy trying to grind out a new business himself, I totally empathize. In fact, I\u2019ll often give advice back to the owners and spend an insane amount of time crafting the advice. Many of my users and listeners do that for me, so I will do that for others! It\u2019s the golden rule.
\nAnyway, this company comes to me and pitches me a product with innnnsane performance. I mean the performance of this strategy was mind-blowing. And as soon as I saw it, I asked them a few questions and realized they didn\u2019t understand the mechanics of backtesting. That\u2019s okay, because if you\u2019re new to markets, why would you expect anybody to understand backtesting? Heck, this is kind of embarrassing but I only knew what the Louve was 3 years ago. I never grew up around art or was exposed to it. Sometimes what seems so obvious to us is not so much for others.<\/p>\n
But this is kind of an unintuitive concept isn\u2019t it? A strategy performs so well that you know it can\u2019t be real? This company then told us they went to many quant funds and they haven\u2019t won any contracts. And it hit me, it\u2019s because the people who backtest for a living know something is up. My friend who works at a big fund these days saw the company\u2019s business card on my desk and said, \u201cAh, they spoke to us too. What did you think?\u201d I responded with, \u201cthe same thing your company thought.\u201d<\/p>\n
My hope is that for all my listeners listening, that by the end of this episode you will know the gotchyas to backtesting. My goal is that if you were the company presenting, you would be able to defend your performance and thesis from people like me. Or if you have a theory on how markets work,\u00a0 you will be able to test it.<\/p>\n
The problem with a poorly formed backtest is that you will lose money. Your backtest will work historically, but fail miserably in the future for reasons we\u2019ll get into. You will trade the strategy with confidence when it only loses you money.<\/p>\n
Often, even discretionary traders back-test ideas. If you\u2019re a discretionary trader, a back-test will help you understand how much value baselines give you. For example, you may try to look for stocks that are undervalued, so you may look at a P\/E ratio\u2026basically what a stock\u2019s price is to how much money it makes. A low p\/e ratio typically means undervalued, but if you backtest it you can see if buying low p\/e stocks actually works. Also, if it does work, you can see how often it works. Maybe it works only 55% of the time? That makes it a much lower conviction trade. So this is why even gut traders like backtests, it puts their view and ideas in the context of how they\u2019ve performed in the past.<\/p>\n
I make this argument many times, but even if you are a data scientist who doesn\u2019t focus in finance, I believe you will find good value in this episode. The reason is that data science in tech is becoming a hot topic, but finance was forced to innovate and explore this topic long ago. The truth is that in trading, if your backtest or study is even the slightest bit off, you will know pretty soon when you lose money and you will be out of a job. This has made finance approach studies and data science with an intense rigor, and because of the incentives of trading, it\u2019s often beneifical to keep these a secret as you\u2019re competing with others.<\/p>\n
So, let me reveal some of those secrets to you all J<\/p>\n
The main issues I have found are overfitting and model robustness, the dual in-sample problem, and product knoweldge<\/strong><\/p>\nSo what is overfitting? Well taking the above example that if a stock drops 5% in 5 days, we will buy the stock and hold it for 10 days, it\u2019s very clear why we chose some of those numbers. 5 days are the number of business days in a week. It\u2019s another way of saying 1 week. 10 days is 2 weeks.\u00a0 5% is also a nice round number.<\/p>\n
What if that above strategy returns, on average, a 2% return a year? But we think, \u201cwhat only 2% a year? That\u2019s nothing, I want more\u201d<\/p>\n
So we start tweaking our model parameters. A parameter is something in our model that we can change. In the example backtest, we have 3 parameters:<\/p>\n
\n- How much a stock drops , the 5%<\/li>\n
- How many days do we measure that drop? In this case we\u2019re measuring the 5% drop in 5 days<\/li>\n
- And how long do we hold the stock for before we sell it? In this case it\u2019s 10 days, or 2 weeks.<\/li>\n<\/ul>\n
After our tinkering we find that we can get the strategy to return an average of 9% a year if we do the following:<\/p>\n
If a stock drops 7.62% in 12 days, we buy and hold the stock for 16 days.<\/p>\n
But looking at these numbers, what do they all mean? We chose 5% in the original backtest because it was a nice round number and a multiple of 5. But what Is 7.6%? Where does that number come from. And why are we measuring the drop in 12 days? Where does 12 come from? It\u2019s not really 1 week or 2 weeks, it\u2019s 2 weeks and 2 days. And why did we choose 16 days? That\u2019s not 3 weeks, it\u2019s 3 weeks and 1 day.<\/p>\n
All of the parameters above were just randomly chosen. And that is the dangerous part.<\/p>\n
But you may be wondering, \u201cRishi, why does that even matter? Who cares, it results in the best performance.\u201d And this is why the problem is so dangerous. With enough tinkering, any model can be made profitable or predictive.<\/p>\n
Let\u2019s take a look at example that may make this more obvious. Every week, on a Thursday at 8:30am, the government releases numbers with the number of people filing for unemployment. This is called the initial jobless claims. Many researchers and wall street analysts try to predict this number as it can sometimes move markets. After the 2008 recession, traders watched this release because it helped guide the economic recovery. If the economy was healing faster than people thought, markets would rise. If it was healing slower than people thought, markets would fall \u2013 generally speaking.<\/p>\n
So Google has a tool called google correlate. What it does is that it allows you to submit Google data, and it tells you what search results were correlated to that timeseries. So I fed Google a timeseries of these unemployment claims. When we do that, we see initial jobless claims correlated to the search word \u201cload modification\u201d with a correlation of 96%. This could make sense, maybe people want to modify their loans because of foreclosure. But we were also going through a housing crises? What would\u2019ve happened in 2001 where it was a tech bubble bursting rather than the housing bubble?<\/p>\n
Also, all of the other correlated search results are nonsense. \u201claguna beach jeans\u201d correlated 95% with unemployment claim data. Does the search result of laguna beach jeans predict initial jobless claims or is that a statistical artifiact?<\/p>\n
I\u2019ll let you play with Google\u2019s data for this. It\u2019s fun stuff and Google actually has a paper out that shows how correlate could be a useful tool for predicting economic data. Wow I\u2019ve plugged google like 3 times in this podcast\u2026. Google google google, use google yay. It\u2019s like when I was watching the terminator 2 the other day and I noticed pepsi cans and vending machines.<\/p>\n
Just like our correlation example, if we keep digging into data long enough, we find random relationships. This is called overfitting, modifying the data until we get the result that we want. If you\u2019re reading a financial article or speaking to people on wall street, they may refer to overfitting as \u201cdata mining.\u201d For anybody in tech or somebody interested in statistics, this is confusing as data mining means something entirely different. In finance though, data mining is almost always used negatively to mean overfitting. That\u2019s just a quick semantical aside.<\/p>\n
But even if the relationship makes sense, it may be so specific that it doesn\u2019t work outside of the timeframe. For example, \u201cload modification\u201d may work for a crises related to the mortgage crises, but what about if it was a tech bubble bursting?\u00a0 Are people googleing for \u201cloan modification\u201d really a good indicator? Also is that data even applicable today? As Google in 2000 was a far different company than today. Will Google search results be an indicator of the future?<\/p>\n
So how do we counter overfitting? How do we measure model robustness?<\/strong><\/p>\nSo we just described overfitting and model robustness.<\/p>\n
\u00a0<\/strong><\/p>\nAs a data scientist you have to question every single one of your inputs and model parameters. Not just the results, but why everything was chosen.<\/p>\n
<\/p>\n
With overfitting, we really have to practice self-discipline. \u00a0This is the tough answer. We as people can always torture and twist data to get us to tell us what we want it to. You can see this all the time when political issues where two lobbying groups will use data to support their idea even though they are polar opposites.\u00a0 How can both parties use data to prove something? Because they take a some truth and use the statistics they want to tell their side of the story.<\/p>\n
Unfortunately for us, if we do that in markets, the markets will take our money. We have to find the truth and be real with ourselves. If we are dishonest, we will lose our own money. This is harder than you think and there are trading psychology books that go into this. To combat overfitting, we have to hold ourselves accountable.<\/p>\n
And to hold ourselves accountable, all\u00a0 – and yes I say all – successful traders \u2013 both discretionary and quantitative, have a journal or a process in place. These are individually crafted rules that hold ourselves accountable. Here are a few processes and rules I have that let me make sure I am being honest with myself. Maybe some will work for you, and some may not. And noticehow I don\u2019t include any statistical tests below. Those are my last-stage tests because like I said, we can use statistics to tell us the picture we want. I first like to make sure my ideas have grounding before getting stats involved as it prevents me from twisting data and overfitting.<\/p>\n
If you ask any experienced trader, all \u2013 yes all – \u00a0will tell you simplicity is favored over complexity. You absolutely should specific statistical tests like t-tests, p values, distributions and so on, but that\u2019s beyond the scope of this episode and there are really nice simple visualizations online of them.<\/p>\n
Also, if you read the papers published by AQR, the 2nd<\/sup> largest quantitative hedge fund, you will find much of their research is totally accessible and their math does not really get any more complex than calculus, much of it can be done with algebra.<\/p>\nThe truth is, and this is something I see often, that machine learning, advanced statistical analysis, and so on do not make a better trader. In fact, it gives you more creative ways to part with your money. I see it all the time, and you would be surprised with how simple many quantitative trading strategies can be. I\u2019ll add some links to AQRs papers if you don\u2019t believe me in the blog \u2013 blog.tiingo.com<\/p>\n
And an aside for those of you who hear about machine learning: right now machine learning in markets is sexy and sells, but remember it very rarely makes money by itself. It\u2019s not the holy grail of trading. In fact, every quantitative trader I know who uses machine learning, uses it after many years of getting their models working without using it. The ones that do use it, often use it as a last optimization. And even the traders I know who use it, I can count on one hand. Their profitability did not drastically change once they used machine learning. \u00a0The blog will contain papers by big hedge funds just to show you how simple the math can be.
\nAnyway, here are some of my snippets I use to hold myself accountable and make sure my models are flexible and robust. The accountability and overfitting really go hand in hand.<\/p>\n
\n- Why would this idea work? What is the current research and conditions out there that support why this would and wouldn\u2019t work<\/li>\n
- What is my hypothesis, or null hypothesis \u2013 what am I testing?<\/li>\n
- Are there any relevant research papers out there? Can I replicate them? My trading mentor told me he\u2019s only been able to replicate 20-30% of papers, and I have found about the same to be true. Some of the errors in research papers out there are horrible<\/li>\n
- Should this theory or idea work across markets and\/or across stocks? Or does it only work for one stock or one asset class? If it only works for one why? This is a huge warning sign for me. If looking at stocks, it should at the very very least work in the sector.<\/li>\n
- What is the risk adjusted return of this model? Basically what is the average return and volatility of this model?<\/li>\n
- How many times did I run this model and change parameters? How many times did these changes result in better performance? Keeping a tally of how many times you tweaked parameters is a good way to be honest with yourself about how much you tortured the data<\/li>\n
- Does the model trade all stocks equally or is the majority of returns driven by a couple stocks<\/li>\n
- For all the big gains and losses in the strategy, check them manually for data errors<\/li>\n
- When will this strategy fail? This is such an important question. If you don\u2019t know when or why this strategy fails, then you don\u2019t really know the strategy or all or why it makes money.<\/li>\n
- How does the profitability of a strategy change if I slightly tweak a parameter? Is there a relationship between how much I tweak the parameter, how much the profitability changes?<\/li>\n<\/ul>\n
<\/p>\n
This is an incomplete list, but I think it\u2019s a good starting point.<\/p>\n
One thing that people do to help prevent overfitting in the in-sample and out-of-sample\u00a0 backtest. But I\u2019ve found this often results in something I call the dual-in-sample error.<\/strong><\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":" In this Podcast the following material will help you follow along: Here is a Google Spreadsheet of a backtest where we buy a stock after it falls 5% in 5 days, and then hold the stock for 10 days. The stock is an S&P 500 ETF (SPY). We use this strategy as an example […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"osom_blocks_metabox":"","inline_featured_image":false,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[11],"tags":[],"class_list":["post-84","post","type-post","status-publish","format-standard","category-podcasts","entry"],"yoast_head":"\n
Tiingo Podcast: Ep.8 - Backtesting<\/title>\n<meta name=\"description\" content=\"We share with you 8 years of experience in making quantitative models successfully and our thought processes behind what we consider when running studies\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Podcast: Ep.8 Back, Back, Back it Up (Backtesting)\" \/>\n<meta property=\"og:description\" content=\"We share with you 8 years of experience in making quantitative models successfully and our thought processes behind what we consider when running studies\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/\" \/>\n<meta property=\"og:site_name\" content=\"Tiingo Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/tiingofinance\/\" \/>\n<meta property=\"article:published_time\" content=\"2015-07-22T13:30:52+00:00\" \/>\n<meta name=\"author\" content=\"Rishi S.\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@tiingofinance\" \/>\n<meta name=\"twitter:site\" content=\"@tiingofinance\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Rishi S.\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"21 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/\"},\"author\":{\"name\":\"Rishi S.\",\"@id\":\"https:\/\/www.tiingo.com\/blog\/#\/schema\/person\/54fc93e1626ed221a37fcfddb597c3d6\"},\"headline\":\"Podcast: Ep.8 Back, Back, Back it Up (Backtesting)\",\"datePublished\":\"2015-07-22T13:30:52+00:00\",\"dateModified\":\"2015-07-22T13:30:52+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/\"},\"wordCount\":4159,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.tiingo.com\/blog\/#organization\"},\"articleSection\":[\"Podcasts\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/\",\"url\":\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/\",\"name\":\"Tiingo Podcast: Ep.8 - Backtesting\",\"isPartOf\":{\"@id\":\"https:\/\/www.tiingo.com\/blog\/#website\"},\"datePublished\":\"2015-07-22T13:30:52+00:00\",\"dateModified\":\"2015-07-22T13:30:52+00:00\",\"description\":\"We share with you 8 years of experience in making quantitative models successfully and our thought processes behind what we consider when running studies\",\"breadcrumb\":{\"@id\":\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.tiingo.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Podcast: Ep.8 Back, Back, Back it Up (Backtesting)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.tiingo.com\/blog\/#website\",\"url\":\"https:\/\/www.tiingo.com\/blog\/\",\"name\":\"Tiingo API Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.tiingo.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.tiingo.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.tiingo.com\/blog\/#organization\",\"name\":\"Tiingo.com\",\"url\":\"https:\/\/www.tiingo.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.tiingo.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/api.tiingo.com\/blog\/wp-content\/uploads\/2023\/05\/purple-for-light-bg.svg\",\"contentUrl\":\"https:\/\/api.tiingo.com\/blog\/wp-content\/uploads\/2023\/05\/purple-for-light-bg.svg\",\"width\":\"1024\",\"height\":\"1024\",\"caption\":\"Tiingo.com\"},\"image\":{\"@id\":\"https:\/\/www.tiingo.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/tiingofinance\/\",\"https:\/\/twitter.com\/tiingofinance\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.tiingo.com\/blog\/#\/schema\/person\/54fc93e1626ed221a37fcfddb597c3d6\",\"name\":\"Rishi S.\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.tiingo.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/28ae16ae1fe9df62492ab4b742241b19a6a12395109570074a7b8194c6709ec4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/28ae16ae1fe9df62492ab4b742241b19a6a12395109570074a7b8194c6709ec4?s=96&d=mm&r=g\",\"caption\":\"Rishi S.\"},\"description\":\"Rishi Singh is the CEO of Tiingo.com. A prior algorithmic and quant researcher, Rishi started Tiingo.com to modernize the financial data vertical by focusing on data acquisition, cleansing, aggregation, innovation, and distribution of data.\",\"sameAs\":[\"http:\/\/www.tiingo.com\"],\"url\":\"https:\/\/www.tiingo.com\/blog\/author\/rishi-s\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Tiingo Podcast: Ep.8 - Backtesting","description":"We share with you 8 years of experience in making quantitative models successfully and our thought processes behind what we consider when running studies","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/","og_locale":"en_US","og_type":"article","og_title":"Podcast: Ep.8 Back, Back, Back it Up (Backtesting)","og_description":"We share with you 8 years of experience in making quantitative models successfully and our thought processes behind what we consider when running studies","og_url":"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/","og_site_name":"Tiingo Blog","article_publisher":"https:\/\/www.facebook.com\/tiingofinance\/","article_published_time":"2015-07-22T13:30:52+00:00","author":"Rishi S.","twitter_card":"summary_large_image","twitter_creator":"@tiingofinance","twitter_site":"@tiingofinance","twitter_misc":{"Written by":"Rishi S.","Est. reading time":"21 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/#article","isPartOf":{"@id":"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/"},"author":{"name":"Rishi S.","@id":"https:\/\/www.tiingo.com\/blog\/#\/schema\/person\/54fc93e1626ed221a37fcfddb597c3d6"},"headline":"Podcast: Ep.8 Back, Back, Back it Up (Backtesting)","datePublished":"2015-07-22T13:30:52+00:00","dateModified":"2015-07-22T13:30:52+00:00","mainEntityOfPage":{"@id":"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/"},"wordCount":4159,"commentCount":0,"publisher":{"@id":"https:\/\/www.tiingo.com\/blog\/#organization"},"articleSection":["Podcasts"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/","url":"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/","name":"Tiingo Podcast: Ep.8 - Backtesting","isPartOf":{"@id":"https:\/\/www.tiingo.com\/blog\/#website"},"datePublished":"2015-07-22T13:30:52+00:00","dateModified":"2015-07-22T13:30:52+00:00","description":"We share with you 8 years of experience in making quantitative models successfully and our thought processes behind what we consider when running studies","breadcrumb":{"@id":"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.tiingo.com\/blog\/podcast-ep-8-back-back-back-it-up-backtesting\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.tiingo.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Podcast: Ep.8 Back, Back, Back it Up (Backtesting)"}]},{"@type":"WebSite","@id":"https:\/\/www.tiingo.com\/blog\/#website","url":"https:\/\/www.tiingo.com\/blog\/","name":"Tiingo API Blog","description":"","publisher":{"@id":"https:\/\/www.tiingo.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.tiingo.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.tiingo.com\/blog\/#organization","name":"Tiingo.com","url":"https:\/\/www.tiingo.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.tiingo.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/api.tiingo.com\/blog\/wp-content\/uploads\/2023\/05\/purple-for-light-bg.svg","contentUrl":"https:\/\/api.tiingo.com\/blog\/wp-content\/uploads\/2023\/05\/purple-for-light-bg.svg","width":"1024","height":"1024","caption":"Tiingo.com"},"image":{"@id":"https:\/\/www.tiingo.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/tiingofinance\/","https:\/\/twitter.com\/tiingofinance"]},{"@type":"Person","@id":"https:\/\/www.tiingo.com\/blog\/#\/schema\/person\/54fc93e1626ed221a37fcfddb597c3d6","name":"Rishi S.","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.tiingo.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/28ae16ae1fe9df62492ab4b742241b19a6a12395109570074a7b8194c6709ec4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/28ae16ae1fe9df62492ab4b742241b19a6a12395109570074a7b8194c6709ec4?s=96&d=mm&r=g","caption":"Rishi S."},"description":"Rishi Singh is the CEO of Tiingo.com. A prior algorithmic and quant researcher, Rishi started Tiingo.com to modernize the financial data vertical by focusing on data acquisition, cleansing, aggregation, innovation, and distribution of data.","sameAs":["http:\/\/www.tiingo.com"],"url":"https:\/\/www.tiingo.com\/blog\/author\/rishi-s\/"}]}},"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":"Rishi S.","author_link":"https:\/\/www.tiingo.com\/blog\/author\/rishi-s\/"},"_links":{"self":[{"href":"https:\/\/www.tiingo.com\/blog\/wp-json\/wp\/v2\/posts\/84","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tiingo.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tiingo.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tiingo.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tiingo.com\/blog\/wp-json\/wp\/v2\/comments?post=84"}],"version-history":[{"count":0,"href":"https:\/\/www.tiingo.com\/blog\/wp-json\/wp\/v2\/posts\/84\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.tiingo.com\/blog\/wp-json\/wp\/v2\/media?parent=84"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tiingo.com\/blog\/wp-json\/wp\/v2\/categories?post=84"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tiingo.com\/blog\/wp-json\/wp\/v2\/tags?post=84"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}