Integrating a Hugging Face Model with Google Colab

Integrating models from Hugging Face with Google Colab.

Install Hugging Face Transformers

• Install required libs

!pip install transformers
!pip install accelerate
!pip install bitsandbytes        

Authenticate with Hugging Face

• Get Hugging Face Token:Go to Hugging Face, create an account if you don't have one, and navigate to the Settings > Access Tokens to create a new token.

Authenticate in Colab:

from huggingface_hub import login

login(token="YOUR_HUGGING_FACE_TOKEN")        

Load the Model and Tokenizer: Take an example we are trying to use gpt2 model.

from transformers import AutoTokenizer, AutoModelForCausalLM

model_name = "gpt2"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)