runtime error

Exit code: 1. Reason: ��█████████| 3.07k/3.07k [00:00<00:00, 16.4MB/s] tokenizer.json: 0%| | 0.00/7.03M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 7.03M/7.03M [00:00<00:00, 47.9MB/s] config.json: 0%| | 0.00/679 [00:00<?, ?B/s] config.json: 100%|██████████| 679/679 [00:00<00:00, 4.09MB/s] model.safetensors: 0%| | 0.00/3.55G [00:00<?, ?B/s] model.safetensors: 1%| | 21.0M/3.55G [00:02<06:06, 9.63MB/s] model.safetensors: 1%| | 31.5M/3.55G [00:04<08:40, 6.77MB/s] model.safetensors: 13%|█▎ | 472M/3.55G [00:05<00:24, 125MB/s]  model.safetensors: 30%|██▉ | 1.06G/3.55G [00:06<00:09, 254MB/s] model.safetensors: 40%|███▉ | 1.42G/3.55G [00:08<00:09, 223MB/s] model.safetensors: 48%|████▊ | 1.71G/3.55G [00:09<00:08, 228MB/s] model.safetensors: 68%|██████▊ | 2.40G/3.55G [00:11<00:04, 287MB/s] model.safetensors: 82%|████████▏ | 2.90G/3.55G [00:12<00:01, 336MB/s] model.safetensors: 100%|█████████▉| 3.55G/3.55G [00:13<00:00, 257MB/s] generation_config.json: 0%| | 0.00/181 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 181/181 [00:00<00:00, 1.05MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 103, in <module> model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4323, in from_pretrained dispatch_model(model, **device_map_kwargs) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 498, in dispatch_model raise ValueError( ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.

Container logs: