ctrl-c, command-v
Friends,
I saw a fun riddle this week. To get you in the right mindset before sharing it I’ll introduce the so-called secretary problem. I first came across this concept when I was a trainee at SIG from the John Allen Paulos’ Innumeracy in the context of choosing a mate.
From Wikipedia:
The basic form of the problem is the following: imagine an administrator who wants to hire the best secretary out of n rankable applicants for a position. The applicants are interviewed one by one in random order. A decision about each particular applicant is to be made immediately after the interview. Once rejected, an applicant cannot be recalled. During the interview, the administrator gains information sufficient to rank the applicant among all applicants interviewed so far, but is unaware of the quality of yet unseen applicants.
The question is about the optimal strategy (stopping rule) to maximize the probability of selecting the best applicant. If the decision can be deferred to the end, this can be solved by the simple maximum selection algorithm of tracking the running maximum (and who achieved it), and selecting the overall maximum at the end. The difficulty is that the decision must be made immediately.
The shortest rigorous proof known so far is provided by the odds algorithm. It implies that the optimal win probability is always at least 1/e or about 37%. The reason the secretary problem has received so much attention is it's the optimal policy for the problem, the stopping rule is simple and selects the single best candidate about 37% of the time, irrespective of whether there are 100 or 100 million applicants.
Key Insights
[These are a mix of my thoughts and Llama 3.1, the LLM you can chat with from Whatsapp]
- 37% provides sufficient information about the distribution of quality.
- Maximizes probability of selecting the best option.
- Balances exploration and exploitation (this should remind you of the multi-armed bandit problem — a problem so diabolical that the Allies considered “dropping†it on German scientists as the ultimate nerdsnipe — to distract them from the more urgent matter of developing weapons. See my notes from Algorithms To Live By author Brian Christian)
Real-World Applications
- Job Searching: Interview 37% of candidates before making an offer.
- Dating: Meet 37% of potential partners before committing.
- Shopping: Research 37% of options before purchasing.
- Recruitment: Screen 37% of applicants before inviting for interviews.
Assumptions
- Random arrival: Options arrive randomly and independently.
- No recall: Previously rejected options cannot be revisited.
- No additional information: No new information becomes available after observing an option.
Limitations
- Small sample size: With few options, the 37% Rule may not provide accurate results.
- Non-uniform distribution: If options are not uniformly distributed (e.g., clustered), the rule may fail.
- Correlated options: If options are correlated (e.g., similar), the rule may not account for this.
Practical Considerations
- Difficulty in estimating 37%: Real-world applications may make it challenging to determine the exact 37% mark.
- Time constraints: The rule assumes unlimited time for observation and decision-making.
- Multiple criteria: The rule focuses on a single criterion; real-world decisions often involve multiple factors.
Contextual Limitations
- Irreversible decisions: The rule may not apply to irreversible decisions (e.g., marriage).
- High-stakes decisions: The rule may not suffice for critical decisions (e.g., life-or-death).
- Dynamic environments: The rule assumes a static environment; changing circumstances may require adjustments.
Application to financial options
With that background, you can see how American-style options are a specific instance of “optimal stopping time problemsâ€. That’s because they can be exercised any time before expiration, unlike European options, which can only be exercised at expiration. The holder of the option must decide the best time to exercise, if at all, to maximize their payoff.
This is why American-style options are priced by simulations such as tree methods while European-style options have closed-form equations.
In the simulations, the value of the option is computed by looking at the value at the next time step (i.e., whether to exercise now or wait). A backward induction process unravels from the expiration date back to the present. The model calculates the optimal decision at each point in time based on the payoff of immediate exercise versus the expected value of holding the option.
With ALL that said, you are ready for the riddle!
Flip 100 coins, labeled 1 through 100.
Alice checks the coins in order (1, 2, 3, …) while Bob checks the odd-labeled coins, then the even-labeled ones (so 1, 3, 5, …, 99, 2, 4, 6, …)
Who is more likely to see two heads first?
- Alice
- Bob
- Equally likely
The riddle is neat because it works the same muscles as pricing an option. In fact, the riddle doesn’t even require math!
Welcome to 2024…
The cost to learn is COLLAPSING if your eyes are open. Culturally I can sense (and anticipate much more) hand-wringing over what this means for society but right now I cannot emphasize enough how you should at least be taking advantage of all the consumer surplus LLMs are dumping in your lap. Earlier this week I mentioned that I screenshotted a spreadsheet of futures data and asked ChatGPT to write the formulas I’d need to arrange it the way I wanted. It spelled out exactly what helper column I needed and where to place all the formulas. It even stepped through the method so I can understand why its solution works.
Now consider that riddle.
- I prompted ChatGPT to give me the Python code to simulate the question many times to so I could validate my answer.
- I ran the code in Google Colab (cloud-based Jupyter notebook)
This entire process takes seconds not minutes.
Here are the steps you follow upon seeing the riddle on twitter:
- open 2 tabs — ChatGPT & Google Colab
- ctrl-c from twitter
- ctrl-v into ChatGPT
- type “what code that simulates thisâ€
- ctrl-c the response
- ctrl-v into Google Colab
- ctrl-enter to run the script
[And yes I use a PC…loving my new Surface laptop btw]
In 5 years, an AI agent implanted in your reading glasses will know you wanted to do that when you scrolled over the tweet and a tooltip will simply be projected over the tweet with the simulation results.
Just kidding.
Twitter will be gone by then.
If interested here’s my Google Colab link:
[Not to get into the weeds but I had to have a couple back-and-forths with the LLM because it made the mistake of thinking that the position that the head is found in determines if Alice or Bob won but it’s actually which ordinal observation that determines the winner. The process took more like 5 minutes as I had to prompt a specific debug and explanation. It doesn’t take away from the point — we are talking about orders of magnitude decreases in the time to code up this simulation for someone whose coding skills are as soft as mine.]
Money Angle
Fake Songs Made Real Money (5 min read) by Matt Levine
This was a killer issue with 2 great stories:
- The Spotify bot listening arbitrage
- Polymarket manipulation of derivatives on derivatives. This story reminds me of other derivative on derivative manipulations: Libor, VIX, energy contracts that settle to survey data, and the fact that you can simply affect the price of an optionable index with sloppy trading in the components.
领英推è
??A gift for moontower readers
PiQSuite is a dashboard for investors built on a dynamic grid where you can add various widgets and feeds. Mine:
I’ve been chatting with their team about the features present and upcoming. I’m stoked about the roadmap…and who knows…maybe there’s going to be some moontower stuff inside :-)
There’s a free tier but I sent a fella with a Jersey accent over there…
Now YOU get 12 months of PiQ premium access to the Hi-IQ tier with the code 'MOONTOWER'.
Just apply it at checkout:
Money Angle For Masochists
???Flirting with Models: Corey Hoffstein Interviews Giuseppe Paleologo (90 min)
The subtitle of this interview is Multi-Manager Hedge Funds & Thinking Deeply About Simple Things. It’s outstanding and I say that as someone who doesn’t understand all of it — it covers technical topics around factors and quant methods outside my experience. The interview shines beyond the content itself. Paleologo has a dry wit and a great professor’s mix of clarity and precision that is gracefully tuned for the demands of pragmatism. He couches ideas with a sense of proportion that anticipates practitioner concerns rather than trifling over ephemera (which he is clearly qualified to do).
I’m philosophically aligned with his message — risk management and honest attribution are not clubs to bludgeon bettors with a bonus-reducing “you were lucky†dataset but the tools of improvement, no different than a stopwatch to a sprinter.
When I was at the tide pools at Shell Beach a few months ago, I asked the kids if they knew why there are tides. I wasn’t surprised they knew, tides are one of those science topics like volcanoes and dinosaurs — elementary school canon.
That knowledge is so common yet we, as in the royalest of “we’sâ€, humanity had to know about astronomy AND gravity to possess it. It’s a testament to collective human learning and the methods of scientific inquiry (it also makes you wonder what phenomenon we think we know but haven’t even unlocked the prereqs to their explanation!)
Advances in the rubric of performance attribution in investing feel like the explanation of the tides. Pick your metaphor — maritime navigation, surfing, fishing — understanding the tides is key to improving trading/investing outcomes.
I went on 2 podcasts recently. Both dropped this week.
???Talking Options with Dean Curnutt of Alpha Exchange (54 min)
Dean’s firm Macro Risk Advisors is a full-service institutional options broker. The audience is professional and the convo is oriented in that direction. Dean’s description:
But what about insights on the nitty gritty of getting into option trades, being a liquidity provider to the Street and then risk managing those positions? ?Enter, Kris Abdelmessih, who spent well more than a decade doing just that. Now the author of the Moontower Substack and the founder of Moontower.ai, Kris looks back at his time on the market making front, starting with his formative experience in the renowned Susquehanna training program and ultimately trading volatility at Parallax. We talk about how he sought micro-edge by maintaining sell-side relationships, getting into positions as cleanly as possible and then having a dispassionate process for unwinding trades for which the vol profile was no longer suitable to own.
We also gain his insights on perils of trading off-the-run ETFs like those on natural gas and crude oil, with the April 2020 meltdown in the latter, an important case study.
???Moontower on The Trade Busters Podcast (83 min)
I’ve known David Sun for a few years. I first came across him when went on Corey Hoffstein’s pod. David runs his own fund and and cultivated a smart Discord of traders (It’s free to join, but there is a test!).
David and I turned the mic on as he hit me with questions. This one is super raw — it was published an hour after we hopped off the call. I didn’t listen to it afterward (I’d rather snort cayenne than hear myself) but I don’t thiiiink I said anything I shouldn't have.
I took on some sticky questions. Just a smattering:
- the difference between vol trading and risk premia and why I think retail isn’t built for the former — and yes I answer this with arithmetic and option greeks
- secrecy
- conspiracy theories around market-makers and “stop-hunting†and a heuristic for assessing the likelihood of funny business
This chat also veers into stories and tangents about work in general, parenting, and how I think about some of the things I do.
And as far as being on 2 podcast in one week, sorry for the moontower overexposure but consider it a gift that it keeps me from starting my own podcast. (Kidding — we have an amazing podcaster in my house as it is and I see what goes into it. I have no appetite for climbing that skill tree.)
Stay Groovy
??
Moontower Weekly Recap
Need help analyzing a business, investment or career decision?
Book a call with me.
It's $500 for 60 minutes. Let's work through your problem together. If you're not satisfied, you get a refund.
Let me know what you want to discuss and I’ll give you a straight answer on whether I can be helpful before we chat.
I started doing these in early 2022 by accident via inbound inquiries from readers. So I hung out a shingle through the Substack Meetings beta. You can see how I’ve helped others:
Moontower On The Web
??About Me
Specific Moontower Projects
Curations
??Moontower’s Favorite Posts By Others ??Guides To Reading I Enjoyed ???Investment Blogs I Read ??Book Ideas for Kids
Fun