Show HN: Mistral NeMo finetuning fits in Colab https://ift.tt/qnT1iN0

Show HN: Mistral NeMo finetuning fits in Colab Managed to make Mistral NeMO 12b https://ift.tt/NE8UH3M fit in a free Google Colab with a Tesla T4 GPU (16GB) for 4bit QLoRA finetuning! Managed to shave 60% VRAM usage and made it 2x faster as well! It should work in under 12GB of VRAM as well! https://ift.tt/MjWARa8 July 19, 2024 at 10:06PM