load_model
Load a pretrained model with Unsloth optimizations, including 4-bit quantization and gradient checkpointing, for efficient large language model fine-tuning and deployment.
Instructions
Load a pretrained model with Unsloth optimizations
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| load_in_4bit | No | Whether to load the model in 4-bit quantization | |
| max_seq_length | No | Maximum sequence length for the model | |
| model_name | Yes | Name of the model to load (e.g., "unsloth/Llama-3.2-1B") | |
| use_gradient_checkpointing | No | Whether to use gradient checkpointing to save memory |