ROCm/docs/how-to/rocm-for-ai/training/index.rst

.. meta::
   :description: How to use ROCm for training models
   :keywords: ROCm, LLM, training, GPUs, training model, scaling model, usage, tutorial

=======================
Use ROCm for training
=======================

Training models is the process of teaching a computer program to recognize patterns in data. This involves providing the computer with large amounts of labeled data and allowing it to learn from that data, adjusting the model's parameters. 

The process of training models is computationally intensive, requiring specialized hardware like GPUs to accelerate computations and reduce training time. Training models on AMD GPUs involves leveraging the parallel processing capabilities of these GPUs to significantly speed up the model training process in machine learning and deep learning tasks.  

Training models on AMD GPUs with the ROCm™ software platform allows you to use the powerful parallel processing capabilities and efficient compute resource management, significantly improving training time and overall performance in machine learning applications.
 
The ROCm software platform makes it easier to train models on AMD GPUs while maintaining compatibility with existing code and tools. The platform also provides features like multi-GPU support, allowing for scaling and parallelization of model training across multiple GPUs to enhance performance. 

The AI Developer Hub contains `AMD ROCm tutorials <https://rocm.docs.amd.com/projects/ai-developer-hub/en/latest/>`_ for
training, fine-tuning, and inference. It leverages popular machine learning frameworks on AMD GPUs.

In this guide, you'll learn about:

- Training a model

  - :doc:`With Primus (Megatron-LM backend) <benchmark-docker/primus-megatron>`

  - :doc:`With Megatron-LM <benchmark-docker/megatron-lm>`

  - :doc:`With PyTorch <benchmark-docker/pytorch-training>`

  - :doc:`With JAX MaxText <benchmark-docker/jax-maxtext>`

  - :doc:`With LLM Foundry <benchmark-docker/mpt-llm-foundry>`

- :doc:`Scaling model training <scale-model-training>`