The Open Source Summer for LLMs
David Norris
I am a creator and train generative AI models ?? | Generative AI Developer & Consultant ???? | Founder Bold Crow AI ?? | Founder Proofpact ? | Former Marketing Agency Owner
???????? ???????? ???? ???? ???????? - ?????? ????????: July 2 - July 8, 2023
Welcome to the Future Frontier?- your weekly AI news update.?This week we cover open source large language models.
The Open Source Summer for Large Language Models
Falcon, Llama, Vicuna, Alpaca, Orca, Guanaco, WizardLM (and more)... These are all large language models accessible through Hugging Face. Each one has a purpose, strengths, and potential weaknesses. Some are overall solid models. The best part is, they are free. The process of creating these models varies and Hugging Face makes it easier than ever to train models using transformers and tokenizers.
Models with as few as 7B or 13B parameters trained on curated datasets can be reasonable models for many tasks and purposes. Generally speaking, the higher the parameter count the better the model (such as Falcon-40b). The best part is that you can host your own models on Hugging Face with endpoints that you can call via their API. This puts Open Source models at your fingertips including your own. Similarly, models can be downloaded and hosted locally.
As these models continue to make improvements, another potential benefit is that users can more easily build fine-tuned versions of the base models. Some models are truly uncensored in that you can and would have to start from the ground up building in your own setting parameters and removal of things like bias. You could of course always fine-tune a model with your own curated censorship datasets.
OpenAI Announces Code Interpreter to Plus Members
OpenAI announced in a tweet that:
"Code Interpreter will be available to all ChatGPT Plus users over the next week.
It lets ChatGPT run code, optionally with access to files you've uploaded. You can ask ChatGPT to analyze data, create charts, edit files, perform math, etc."
领英推荐
StarCoder & StarChat (Open Source Code Interpretation + Chat)
This came at a time when I was quite literally in my code editor working on finishing up some development with StarChat-β. StarChat is a series of language models that are trained to act as helpful coding assistants. StarChat-β is the second model in the series and is a fine-tuned version of?StarCoderPlus?that was trained on an?"uncensored"?variant of the?openassistant-guanaco?dataset.
Check out Chat Saver on the Chrome Web Store!
Chat Saver is a simple and free Chrome extension that speeds up your ChatGPT experience. It provides instant access to your most important chats, right in your browser.
------- ?? -------
Hey, I'm Dave! I'm a former digital agency owner, now co-founder of Bold Crow. I'm all about helping businesses implement customized AI solutions in a responsible and ethical way. I've built cool tools for nonprofits too, helping them gather and leverage social proof. Let's connect:?Dave Norris
Nonprofit Website Strategist | Spark that "aha" moment behind your mission & grow your community
1 年Giddy up, 'pardner. ??
Founder @ Just Be Cause Consulting | Empowering Positive Impact | ??? Host of the Just Be Cause Podcast
1 年Your opening line... I'm dying ??
Realtor Associate @ Next Trend Realty LLC | HAR REALTOR, IRS Tax Preparer
1 年Thanks for Posting.
Fixer | Thinker | Community Builder
1 年Thank you for the info!