What is a recovering data scientist?

“What is a recovering data scientist?” This question arrives in my LinkedIn messages at least once a week. It’s easy to see why, since my LinkedIn title says “recovering data scientist”. While “recovering data scientist” is admittedly a bit clickbaity, there’s also considerable truth to the moniker.

The “recovering data scientist” schtick started several years ago as an inside joke with some data scientist friends. Working as data scientists, we’d grown tired of seeing data science projects (mostly machine learning related) fail over and over again. At the time, data science was touted as “The Sexiest Job of the 21st Century”. It seemed like every company wanted to “do data science”, and people were jumping head first into the field. Today, the field of data science has matured somewhat, but it’s much the same – lots of interest, and a white hot euphoria about how data’s going to change the world.

Why don’t I feel the same level of euphoria about data science right now? Simply put, reality and expectations don’t often align. There’s a belief that data science will magically, instantly, and painlessly transform a business. While there are some success stories, most data science projects fail. Failure is good if you can learn from your mistakes. My problem is that several years later, the same mistakes still happen over and over again.

What’s going on here? There’s a lot of cargo cult data science. Simpler (and proven) approaches are often ignored because they’re “not machine learning”. Many data scientists I’ve seen get the order of operations wrong. All too often, a data science project starts without understanding the data, the domain, or building the proper infrastructure to support production machine learning. Instead, data scientists simply leap head first into machine learning. The result is usually a giant graveyard of data science projects stuck on someone’s laptop, never seeing the light of day in the broader business.

What’s the solution? In short – get back to basics with data. Be realistic. Set proper expectations. Develop a plan with data science, and take the time to build the right foundation for success. Good things take time. I firmly believe that data science can yield amazing benefits for companies when it’s executed correctly. And personally, I’d love to stop being a “recovering data scientist”.

Hardik Zaveri

Innovative & Visionary Technology Leader | Architect of Data-Driven Solutions | Data Engineering & Spark Enthusiast | Databricks Specialist | ML & AI Visionary | AWS Cloud Advocate | SAFe Agile Scrum Practitioner

5 个月

Very nice article

回复
Zahra Nikdel

Postdoctoral Fellow

5 个月

Can't agree more. Thanks for the note!

回复
Merweska A.

Quality Assurance Automation Engineer | (SDET) Software Development Engineer in Test | UI & Backend Testing Specialist

5 个月

Your work is truly inspiring! Thank you for brightening our future, especially for the younger generation.

回复
Tim Cortinovis

I inspire your business event audience and make them feel fantastic | ?? Global Keynote Speaker on AI | Top Voice | Top 100 Thought Leader Artificial Intelligence | Bestselling Author of Four Books

7 个月

Joe, thanks for sharing!

回复
Robert M. Dayton

MBA, Engineer | Enterprise AI | Advanced Analytics | GTM Strategy | World's First Arbor Essbase Post-Sales Consultant

11 个月

Thank you for sharing Joe!

回复

要查看或添加评论,请登录

Joe Reis的更多文章

  • Tips for running a virtual meetup

    Tips for running a virtual meetup

    The coronavirus pandemic has suddenly changed quite a few things with respect to meetups and how people network. Having…

    4 条评论
  • Networking From Home (NFH)

    Networking From Home (NFH)

    In the last few weeks, we’ve suddenly found ourselves in a brand new world. Some might rightfully call it a hellscape.

  • Should you get a tech certification? It depends.

    Should you get a tech certification? It depends.

    Are IT certifications a waste of time? An article about the worthlessness of IT certifications recently made the rounds…

    10 条评论
  • Building A Pile Of Reputational Capital

    Building A Pile Of Reputational Capital

    What’s more important when starting a business? Making a pile of money quickly, or building a great reputation for the…

    8 条评论

社区洞察

其他会员也浏览了