notes.billmill.org / AI / LLMs /

PaLM-rlhf on colab

Oct 20, 2023

Messing around with this repository

  1. Start a new colab notebook
  2. switch the runtime to GPU by going to Runtime -> Change Runtime Type
    1. You can create a cell with !nvidia-smi if you want to check that you have a GPU; it will fail if you don't
  3. !pip install palm_rlhf_pytorch

I set up a Colab based on this file but I couldn't train it because it took too long

↑ up