You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
2.**Run the Conversion Script:** Execute the following command that downloads the specified Hugging Face model and converts its weights into the MaxText format. The conversion script only supports official versions of models from Hugging Face. To see the specific models and versions currently supported for conversion, please refer to the `HF_IDS` dictionary in the MaxText utility file [here](https://github.com/AI-Hypercomputer/maxtext/blob/main/src/MaxText/utils/ckpt_conversion/utils/utils.py).
@@ -106,7 +107,7 @@ The above will download the c4 dataset to the GCS BUCKET.
106
107
107
108
## Sample Full Fine tuning script
108
109
109
-
Below is a sample training script with an existing MaxText checkpoint (Option 1: Using an existing MaxText checkpoint).
110
+
Below is a sample training script.
110
111
111
112
```sh
112
113
python3 -m MaxText.train \
@@ -122,22 +123,6 @@ python3 -m MaxText.train \
122
123
steps=10 per_device_batch_size=1
123
124
```
124
125
125
-
Below is a sample training script with a converted a Hugging Face checkpoint (Option 2: Converting a Hugging Face checkpoint).
0 commit comments