Small language model trained from scratch; exploring efficient training on AMD Instinct GPUs with ROCm.