登录查看更多内容

You're a Machine Learning Scientist. How do you decide which algorithms are most important?

由人工智能和领英社区提供技术支持

As a machine learning scientist, you are constantly faced with the challenge of choosing the best algorithms for your projects. Algorithms are the core of machine learning, as they define how data is processed, analyzed, and transformed into insights and predictions. But how do you decide which algorithms are most important for your goals, data, and domain? In this article, we will explore some of the factors that can help you make informed and effective decisions about your algorithm selection.

此文章中的业界达人

由社区从 6 条内容中精选。了解更多

Souvik Ghosh

Associate Data Scientist V4C.AI
Alex Kalinin
Ashutosh Kumar S.

DevOps Engineer | Ex - Kredifi | Ex - Teqfocus | Microsoft Certified: Az-900, Ai -900, Dp-900 | Oracle cloud…

1 Goals and metrics

The first step in choosing an algorithm is to define your goals and metrics. What are you trying to achieve with your machine learning project? What are the desired outcomes and how will you measure them? Depending on your objectives, you may need different types of algorithms, such as supervised, unsupervised, or reinforcement learning. You may also need to consider the trade-offs between accuracy, speed, complexity, and interpretability of your algorithms. For example, if you need a fast and simple solution, you may prefer a linear regression over a neural network. If you need a high accuracy and a complex problem, you may opt for a deep learning model over a decision tree.

添加您的观点

Souvik Ghosh

Associate Data Scientist V4C.AI
(已编辑)
举报内容
(A) Understanding the Problem: Determining the type of problem correctly is essential as it determines the algorithm to use: regression, clustering, or classification. (B) Requirements for Resources: Determining the memory and hardware requirements is essential to make sure the chosen algorithm can work within the limits of the computer. (C) Business Goals: Matching algorithmic decisions to business objectives guarantees that the models put into use significantly contribute to the company's aims.

已翻译

赞

2 Data and domain

The second step in choosing an algorithm is to understand your data and domain. What are the characteristics of your data, such as size, quality, format, and distribution? What are the features and labels of your data, and how are they related to your goals? What are the assumptions and constraints of your domain, such as ethics, regulations, and domain knowledge? Depending on your data and domain, you may need different algorithms that can handle the specific challenges and opportunities of your problem. For example, if you have a large and noisy data set, you may need an algorithm that can reduce dimensionality and handle outliers, such as PCA or K-means. If you have a small and structured data set, you may need an algorithm that can exploit prior knowledge and handle uncertainty, such as Bayesian inference or SVM.

添加您的观点

Ashutosh Kumar S.

DevOps Engineer | Ex - Kredifi | Ex - Teqfocus | Microsoft Certified: Az-900, Ai -900, Dp-900 | Oracle cloud infrastructure certified fundamental 2022 | Aviatrix certified DevOps cloud engineer |
举报内容
Testing and Validation: Use cross-validation or holdout validation. Comparison Metrics: Evaluate accuracy, precision, recall, or F1-score. Algorithm Selection: Opt for algorithms based on optimization criteria. Overfitting Prevention: Choose regularization or ensemble methods. Dynamic Adaptability: Consider online learning or multi-armed bandit algorithms for A/B testing.

已翻译

赞
Souvik Ghosh

Associate Data Scientist V4C.AI
举报内容
(A) Nature of Problem: Problem type guides to algorithm selection (B) Data Complexity: Understand the complexity of the data. Some algorithms perform better with linear relationships, while others have the capability to capture non-linear patterns. (C) Large dataset: For large datasets, scalable algorithms like stochastic gradient descent may be preferred (D) Deep Learning vs. Traditional ML: Think about your data's intricacy and volume. If the dataset is tiny, deep learning could be overkill, but it works best with huge, complicated datasets.

已翻译

赞

3 Evaluation and comparison

The third step in choosing an algorithm is to evaluate and compare your options. How will you test and validate your algorithms on your data and domain? How will you compare the performance and suitability of your algorithms against each other and against a baseline? Depending on your evaluation and comparison methods, you may need different algorithms that can optimize your criteria and metrics. For example, if you use cross-validation, you may need an algorithm that can avoid overfitting and generalize well, such as regularization or ensemble methods. If you use A/B testing, you may need an algorithm that can adapt to changing environments and feedback, such as online learning or multi-armed bandit.

添加您的观点

Souvik Ghosh

Associate Data Scientist V4C.AI
举报内容
(A) Performace Metrics: Choosing the correct performance indicators to help your project's objectives would be best. For example, precision may be more crucial in some use cases than accuracy. (B) Cross Validation: Cross-validation aids in evaluating a model's ability to generalize to fresh data. Ensuring reliable performance evaluation entails dividing the dataset into several folds and training the model on several subsets. (C)Ensemble Methods: Combining the advantages of several models into one ensemble method, such as Random Forests or Gradient Boosting, frequently improves prediction performance.

已翻译

赞

4 Experimentation and iteration

The final step in choosing an algorithm is to experiment and iterate on your solutions. How will you implement and deploy your algorithms on your platform and infrastructure? How will you monitor and improve your algorithms over time and with new data? Depending on your experimentation and iteration processes, you may need different algorithms that can scale and evolve with your needs and expectations. For example, if you use cloud computing, you may need an algorithm that can leverage distributed and parallel computing, such as MapReduce or Spark. If you use agile development, you may need an algorithm that can support rapid prototyping and testing, such as scikit-learn or TensorFlow.

Choosing the most important algorithms for your machine learning projects is not a one-time decision, but an ongoing process that requires careful planning, analysis, and refinement. By considering your goals, data, domain, evaluation, comparison, experimentation, and iteration, you can select the algorithms that best fit your problem and deliver the results you want.

添加您的观点

Alex Kalinin
举报内容
The key to algorithm selection lies in a layered approach. First, ensure a broad toolbox – fluency in generalized linear models, tree ensembles, and both shallow and deep neural networks. Second, assess the domain's existing solutions – are pre-trained models available? This can jumpstart the process. Finally, establish a baseline – human performance, a heuristic, or even an older model. Prioritize easily interpretable models like linear models or decision trees. These are quicker to build and iterate on, allowing to measure progress and identify areas for improvement. Only if these simpler models hit a ceiling introduce more complex solutions. To summarize: start simple, iterate, then add complexity.

已翻译

赞

5 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?

添加您的观点

Kayhan Eritmen

Lifelong Learner | Co-founder & COO at Pusula.ai & Kaizen Intelligence Inc. | Making machines think about lowering the expenses, increasing the profit and combating climate change | Fighting Mediocrity
举报内容
You can use the lazypredict library to quickly see what results the models will give in Classification and Regression problems. You can see the values of metrics such as ROC-AUC, F1 Score, R-Squared, RMSE and understand which model works better on your data.

已翻译

赞

Machine Learning

+ 关注

给文章评分

我们借助人工智能创建了此文章。您认为这篇文章怎么样？

很棒不太好

举报此文章

查看全部

You're a Machine Learning Scientist. How do you decide which algorithms are most important?

1

2

3

4

5

1 Goals and metrics

2 Data and domain

3 Evaluation and comparison

4 Experimentation and iteration

5 Here’s what else to consider

Machine Learning

给文章评分

感谢您的反馈

更多Machine Learning相关文章

更多相关阅读内容

You're a Machine Learning Scientist. How do you decide which algorithms are most important?

1

2

3

4

5

1 Goals and metrics

2 Data and domain

3 Evaluation and comparison

4 Experimentation and iteration

5 Here’s what else to consider

Machine Learning

给文章评分

感谢您的反馈

查看其他技能