We’re on a journey to advance and democratize artificial intelligence through open source and open science.

<p>While working through the basic examples in the <a href="https://huggingface.co/docs/transformers/quicktour#pretrained-models">Transformers Quickstart documentation</a>, I’ve got an error telling me that the proposed model “meta-llama/Llama-2-7b-hf” is a gated model. No big thing, I’ve simply selected a different, non-gated one to continue with the Quickstart examples. But I would have expected a hint in the Quickstart documentation that the examples only work after disclosing personal data to Meta Platforms, Inc. Alternatively, proposing different models to use in the Quickstart examples would be a nice thing.</p>

I believe if you configure accelerate using `accelerate config` and then start the training run using `accelerate run code.py` then the configuration yaml file is picked from default location and starts distributed training. Check here - Quicktour

YouTube video by Journey with Ryan

YouTube video by Journey with Ryan