Steps to Install Lit-Parrot In Your Own Environment

Lit-Parrot, is an open-source language model repository powered by Lightning Fabric and built upon the Lit-LLaMA and nanoGPT.

It supports LLMs like:

• EleutherAI Pythia
• TII UAE Falcon
• StabilityAI StableLM
• Together RedPajama-INCITE

Steps to Install Lit-Parrot:

Clone the Repo in SageMaker notebook by clicking on git menu:

git clone https://github.com/Lightning-AI/lit-parrot  

Run following commands one by one in notebook cells:

cd lit-parrot

!pip install --index-url https://download.pytorch.org/whl/nightly/cu118 --pre 'torch>=2.1.0dev'

!pip install -r requirements.txt

!pip install huggingface_hub

!python scripts/download.py --repo_id EleutherAI/pythia-70m

!python scripts/convert_hf_checkpoint.py --checkpoint_dir checkpoints/EleutherAI/pythia-70m

!python generate/base.py --prompt "Here are some popular boy name in Australia: " --checkpoint_dir checkpoints/EleutherAI/pythia-70m