Learnin' Good All This AI Stuff for Product Management
Mark Cramer
Product Management @ Meta | artificial intelligence, machine learning | entrepreneur | discovering product/market fit | shipping AI-powered applications | building and training ML models for fun | Stanford, Harvard, MIT
How product managers can learn what they need to know about AI to be at peak effectiveness
The most frequent question I get about AI from colleagues, product managers and others, is,
"What do I need to know about AI and what's the best way to learn it?"
I've invested a considerable amount of time taking numerous courses, so I dug into my emails to collect some of the suggestions I've doled out.
Is this necessary?
First, it's worth addressing the extent to which a product manager even needs to understand how AI works in order to be effective. There is an endless stream of business articles about what AI is, what it does and how it is going to disrupt this and that, all of which is great, but I am talking about understanding how it works (e.g. stochastic gradient descent, convolutional neural networks, tree search, supervised vs unsupervised learning, and all the other mumbo jumbo that sounds complicated until you know what it is).
As Marty Cagan pointed out in Inspired (a must-read), product managers can come from a variety of different vertical disciplines, including those that are not necessarily technical, such as marketing or sales. Can these individuals, or even product managers who come from engineering but don't necessarily have a background in AI, be successful managing AI products?
In his article Behind Every Great Product, Marty says,
While you don’t need to be able to invent or implement the new technology yourself in order to be a strong product manager, you do need to be comfortable enough with the technology that you can understand it and see its potential applications.
With this, I could not agree more. As mentioned in my last post, if a product manager's two key responsibilities are assessing opportunities and defining products to be built, these become particularly challenging without an understanding of the underlying technology.
AI, however, is raising the bar. Almost 3 years ago Jon Evans welcomed everyone to the era of "hardtech" by comparing beginner tutorials for Android and TensorFlow. (I program in both and the latter is much more difficult.) Things have not gotten easier in the intervening years. For those who want to product manage in AI (which I highly recommend), at this very early stage of AI commercialization, it is critical to understand how it works in order to grasp what it cannot yet do and envision what is possible. You might be able to bumble around in PowerPoint for a while, but whether you are technical or not, it is important to learn the technology in order to be able to understand it and see its potential, not to mention communicate credibly with engineering.
If you are still skeptical, allow me to also offer a comprehensive list of all the associated costs with learning AI:
- a little time
If you don't think you have what it takes to learn AI, whatever you imagine that to be, you are probably mistaken. Read on or jump to the bottom for some inspiration (then come back).
How to get there
First, if you don't know how already, learn to code (a little).
There has always been a lot of discussion about whether or not founders need to know how to code. TechCrunch had an article many years ago about "The Trouble with Non-Tech Co-founders" and then Steve Blank (required reading) opined on "Why Founders Should Know How to Code." More recently TechCrunch implored people to "Please Don't Learn to Code" before posting an article on how the CEO of Auth0 still codes. Recognizing that product managers and founders are different things, although running product is most always one of the responsibilities of a founder, the relationship here is apt. Regardless, discussions around whether or not these people need to know how to code is complicated.
The good news is that, the amount of coding skill you need to be able to get what you need out of your AI studies is relatively easy. You are not going to write production code, or any code that will go into the products you manage; you are just going to write enough to get through the classes. Take an online introduction to Python class (I have never taken one so cannot make a recommendation), get yourself an account on Stack Overflow (check out that juicy rep) and you should be good to go.
Once you have the programming basics, then what? While no one could ever explore every AI class under the sun, here is the list of some MOOCs that I recommend, with a little commentary:
- Udacity Deep Learning Nanodegree: This is the first one I took, without ever having written a line of Python. (Not recommended, but I was already proficient in Java and R.) I was in the first group that ever went through this course, so it was more than a little rough, but it was fun and amazing. I was instantly hooked. Udacity now also has an AI Nanodegree, but I'm unfamiliar with that.
- Coursera Machine Learning offered by Stanford: I took this one, too, and it's fantastic. Prof. Andrew Ng is a wonderful instructor and the way he organizes the concepts to cascade one into the next is beautiful. It uses Matlab (you can use Octave for free) which puts some people off, but it is worth it.
- Coursera Deep Learning Specialization offered by Stanford: I took this one, although as part of Stanford's CS230 course (see below), again with Prof. Andrew Ng. Like his ML course, it is marvelous.
- Coursera Machine Learning Foundations offered by University of Washington: I have not taken this one, but it comes highly recommend from my good friend Anthony Stevens, Global Enterprise AI Architect at IBM.
- fast.ai: I have not taken this, but I've heard it is outstanding, and it is free. They tout not requiring any advanced math prerequisites. Leave a comment if you have any opinions.
- EdX Artificial Intelligence offered by Columbia University: I haven't taken this one either, but I've heard great things.
- Udacity AI Product Manager Nanodegree: This one certainly sounds like it is in the bullseye, and I'm a fan of the Udacity Deep Learning Nanodegree, but this one is non-technical (no programming required), so I'm skeptical for the reasons described above. I haven't taken it, and nobody else has yet either, because it was only announced yesterday. If you want to do it for real, which I am sure you do, then I'd recommend one of the courses above. (They are hard, but not that hard.) As soon as I learn something about this one I'll report back here.
Going all the way
I am not recommending this for product managers because it is overkill, a ton of work with deadlines, and expensive, but I am in the middle of Stanford's 4-course, 16-unit Graduate Certificate in Artificial Intelligence. These are not MOOCs or continuing education (I've done those, too), but rather 200-level, master's degree classes, with serious prerequisites and full-time students, at Stanford, in the lecture hall, with TAs and exams and team projects and the rest of the ball of wax. Having completed CS230 and CS221, I don't know which two courses I'll take next (I want to take all of them), but I'm aiming to finish in March 2020.
Many friends have asked me, "Why?" It was a bit impulsive, but upon reflection I have a few answers:
- It makes me better at my job. In my product management role at PARC, helping Xerox launch AI-powered applications, I want to explore every possibility to bring value to the team.
- I can see Hoover Tower from my office window. Proximity to campus isn't a reason for anything, but it is motivational.
- The classes are excellent. AI is amazing. The assignments are fun. In CS221 we developed AI to play Pacman. The class had a competition to see whose AI could generate the highest average score and I placed 11th out of ~350 students, so not too bad.
- As an electrical engineer before getting an MBA, this feels a little like I am getting "back to my roots."
- You can potentially go on to get a Stanford master's degree in CS! If accepted into the program, you can roll over the units from the Graduate Certificate, which means you are already a third of the way there. Apparently there are department emails that refer to these classes as "tryouts," so if I do well enough (I have heard it very challenging to get in even with straight As) I'll apply.
- Learning is awesome.
Bringing it home
As Rachel Thomas, deep learning researcher and co-founder of fast.ai, said recently during a talk about AI,
"It's natural to feel like if you're not a math genius or you don't have a PhD from Stanford that you couldn't possibly hope to understand what's going on, much less to get involved. I'm here to tell you that is false."
Agreed! Sure, there is a bit of math, but this isn't string theory. Rachel goes on to talk about Melissa Fabros, an English literature Ph.D. (almost literally a poet) who took the fast.ai course and went on to win a grant to work in computer vision. With some determination and perseverance, almost everyone can learn the basics of how AI works, and then some.
If you are a product manager, or would like to become one, who wants to work in AI, or is perhaps there already, then there is no reason not to learn a little Python and get going with the MOOCs. If you are passionate about the technology, which frankly you better be if this is what you want to do, then you will get there.
So get pumped, sign yourself up for a class, start cranking and let me know how it goes in the comments below. Good luck!
Update:
I have another article with some thoughts on email newsletters and podcasts that you may follow to stay up on the latest developments. It also includes some suggestions for non-technical AI courses.
Senior Product Manager Amazon | Product Roadmaps | Data Analytics & Insights | Business Consulting
1 年Hi Mark, this list is really great. Would you say this list is still current for someone starting off or would you recommend any other courses please?
Building a Network for MIT & Harvard Founders | Engineer | Designer | Investor | MIT + Parsons + U of T
2 年Thank you very much Mark Cramer! During the MBA I took a few analytics classes and loved the subject (like you, I did engineering before my MBA). I wanted to continue learning AI and I was looking for advice on which of the million courses out there to take! This article is what I have been looking for.
Product @ Paradox
2 年I went through the AI Product Manager course Udacity offers about a year ago. I really don't have an extensive technical background. Through my internship, I was seeing a lot of startups that were using AI so I figured this was a great place to start learning. Up until that point my only exposure to AI was through my past job selling a tool for sales that used AI and a few books that explained the basics of machine learning. My expectations for the course weren't high going in. The course walks you through the creation of an image classification models which looks at chest x-rays. It teaches you how to label datasets with Appen. You then train the model in Google AutoML and work on improving its efficiency. Working hands on in their platform makes it easy to understand the notion of "garbage in, garbage out". The final project was to think through the capabilities of artificial intelligence and submit a business proposal for a new product that could be built. This required identifying a problem, outlining how you'd get the data to train the model, and the impact it would drive. For people looking to get an introduction to AI I'd recommend this course. It approaches it from the framework a traditional PM would go through.
VP - Technical Product Manager @ JPMC | Ex-Amazon
4 年Hey Mark, I wanted to follow up from a our prior conversation about Udacity's AI Product Manager Nanodegree course. Now that I've completed it, I figure others might find a quick review useful too! Overall, I enjoyed the course, and the projects were challenging (in a good way) for me, despite a lack of any true programming requirements in them.?The course did a really good job in focusing on how to be a successful PM owning AI products. It really just leverages standard PM principles such as: "are we doing the right thing?" or more importantly, "Is there a business problem that warrants solving with AI?" The course also does a great job in highlighting the differences between model performance success and business success metrics. Another thing I appreciated was the detail it provided on bias that exists in AI products, and the different types. Lastly, I really enjoyed the second project which required me to build a model with Google's AutoML. It was interesting to get the exposure to what goes into creating a very simplistic classification model and some of the challenges ML scientists face; e.g. dirty training, unbalanced data. However, the course was lacking in other areas, namely that it was little bit 'all over the place'. There's extremely high level touchpoints that provide you with only a definition for everything from: the "three main types of ML algorithms" to what a Leaky ReLU activation function is. The course also briefly touches on when Supervised vs Unsupervised learning is applicable, but in a very simplistic way e.g. "If output is discrete and a classification, then supervised".?Knowing some of the vernacular is obviously great, but I felt there could be more on these subjects. It's supposed to be a 2 month course, but it really won't take you more than 3-4 weeks to finish everything, so I think there's some room for more material. Since I did not take any programming/CS courses through college, I don't really have any programming skills beyond a SQL basics under my belt to this point. Hence, I chose this course since it didn't require programming skills. Ultimately, I felt the course was worthwhile for me as I'm new-ish to Product Management (started in Feb 2020), so it helped drive home some of the core principles of what it means to be a PM, but with specific applications to an area of my keen interest: AI products. However, I think if an experienced technical product manager is interested in transitioning into an AI or Data Science PM role, this course will likely leave them wanting.?
Product Management @ Meta | artificial intelligence, machine learning | entrepreneur | discovering product/market fit | shipping AI-powered applications | building and training ML models for fun | Stanford, Harvard, MIT
5 年Top 10 Best Artificial Intelligence Courses You Must Try (https://www.lunaticai.com/2019/04/best-artificial-intelligence-courses.html) offers a pretty good list of courses. I did the Deep Learning Specialization as part of cs230 (it was amazing), but there are more and more popping up every day.