[Technical Seminar] Review of Open LLM Leaderboard

[Technical Seminar] Review of Open LLM Leaderboard


At the end of January, the AI team at Blockchain Labs recently created a new LLM model, 'alnrg2arg/test2_4', which achieved a high score of 75.28 points on the Hugging Face Open LLM Leaderboard, placing it at the top globally! ??


To showcase this success, the AI team organized a technical seminar for their in-house developers to discuss and learn about the model listed on the Open LLM Leaderboard.

This platform allows for comparison of AI model performance, with over 3,600 models currently registered. Models are evaluated based on various criteria such as inference, common sense ability, and prevention of hallucination phenomena, with immediate updates to the rankings.


The seminar began with an introduction to Johann's project and a brief overview of the model. The 'alnrg2arg/test2_4' is a Merge model that was developed to create a lightweight on-device model. This technique of combining multiple models into one is becoming increasingly popular in LLMs as it leverages the strengths of different models and improves performance without the need for training.


The seminar also included a hands-on exercise for developers to gain a better understanding of the entire pipeline and model development. They were able to create their own lightweight model using the same code used in the original model development.


Throughout the session, there were lively Q&A sessions about AI models. The developers also uploaded their own model, 'blockchainlabs_test3_seminar', to the Hugging Face Open LLM Leaderboard. The AI team concluded the seminar by sharing their future development plans.


Exciting news that the model card created during the seminar also ranked well on the leaderboard! ??

Blockchain Labs' strategists, planners, developers, and designers are creating a healthy culture of knowledge sharing by holding seminars in various fields based on a deep understanding of the latest technology trends. We look forward to the next seminar review, sharing experiences and challenges as Blockchain Labs members continue to grow together!


?? View the LLM Technical Documentation (KOR)

要查看或添加评论,请登录

Newnal的更多文章

社区洞察

其他会员也浏览了