Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
950 commits
Select commit Hold shift + click to select a range
b321ada
Merge branch 'main' into nightly
danielhanchen Mar 6, 2024
9b3dd3e
Merge branch 'main' into nightly
danielhanchen Mar 8, 2024
58d1f1e
Update chat_templates.py
danielhanchen Mar 9, 2024
f0a3c05
Update save.py
danielhanchen Mar 9, 2024
e6c3cdf
Update save.py
danielhanchen Mar 9, 2024
5c9629f
Update save.py
danielhanchen Mar 9, 2024
457b7ba
Update chat_templates.py
danielhanchen Mar 9, 2024
daba749
Update llama.py
danielhanchen Mar 9, 2024
14f0638
model_name
danielhanchen Mar 9, 2024
1c1461a
Update loader.py
danielhanchen Mar 9, 2024
f887080
Tokenizer overwritten
danielhanchen Mar 9, 2024
91877f5
Merge branch 'main' into nightly
danielhanchen Mar 10, 2024
c0d9516
Update llama.py
danielhanchen Mar 10, 2024
baf8e4c
Update llama.py
danielhanchen Mar 10, 2024
6d2bc97
Update llama.py
danielhanchen Mar 10, 2024
35c6d77
Update save.py
danielhanchen Mar 10, 2024
74fc5ca
Accuracy
danielhanchen Mar 10, 2024
1e8922a
Revert
danielhanchen Mar 10, 2024
08da057
Update save.py
danielhanchen Mar 10, 2024
c1f3e70
Update fast_lora.py
danielhanchen Mar 10, 2024
7e3abd1
Update fast_lora.py
danielhanchen Mar 10, 2024
c192ce3
Update fast_lora.py
danielhanchen Mar 10, 2024
c1728a9
Update fast_lora.py
danielhanchen Mar 10, 2024
23b7a57
Update fast_lora.py
danielhanchen Mar 10, 2024
8be91b0
Update chat_templates.py
danielhanchen Mar 10, 2024
b5d3d63
Update save.py
danielhanchen Mar 10, 2024
133097d
Update save.py
danielhanchen Mar 10, 2024
aba595d
Update llama.py
danielhanchen Mar 10, 2024
93d88ad
Merge branch 'main' into nightly
danielhanchen Mar 10, 2024
2e87755
Update llama.py
danielhanchen Mar 10, 2024
cb0d937
Account for DoRA
danielhanchen Mar 10, 2024
63b1f58
Update llama.py
danielhanchen Mar 10, 2024
252a38a
Merge branch 'main' into nightly
danielhanchen Mar 11, 2024
029d588
Update save.py
danielhanchen Mar 11, 2024
684eaae
GGUF incorrect
danielhanchen Mar 11, 2024
a0c18c9
Update save.py
danielhanchen Mar 11, 2024
4a794dd
Update pyproject.toml
danielhanchen Mar 11, 2024
98573e8
kaggle new
danielhanchen Mar 11, 2024
4d77c32
Update pyproject.toml
danielhanchen Mar 11, 2024
b7c3190
Update pyproject.toml
danielhanchen Mar 11, 2024
d6ac9b5
upcasting
danielhanchen Mar 12, 2024
eb61377
Fix Colab
danielhanchen Mar 14, 2024
8fa0aab
Update pyproject.toml
danielhanchen Mar 14, 2024
1f4c625
Update pyproject.toml
danielhanchen Mar 14, 2024
0ed19ec
Update pyproject.toml
danielhanchen Mar 14, 2024
77edfb1
Update pyproject.toml
danielhanchen Mar 14, 2024
6809846
Update pyproject.toml
danielhanchen Mar 14, 2024
341b5f4
Update pyproject.toml
danielhanchen Mar 14, 2024
6841a30
Update pyproject.toml
danielhanchen Mar 14, 2024
5c4241a
Update pyproject.toml
danielhanchen Mar 14, 2024
ec73a77
Update chat_templates.py
danielhanchen Mar 14, 2024
5dfe582
Update chat_templates.py
danielhanchen Mar 14, 2024
fe0e2d7
Update chat_templates.py
danielhanchen Mar 14, 2024
c3e0e51
Update chat_templates.py
danielhanchen Mar 14, 2024
a12e4ea
Update chat_templates.py
danielhanchen Mar 14, 2024
9d6c9c9
Merge branch 'main' into nightly
danielhanchen Mar 14, 2024
9c9ede4
Update pyproject.toml
danielhanchen Mar 15, 2024
385c6d4
Update pyproject.toml
danielhanchen Mar 15, 2024
718a6a1
Update pyproject.toml
danielhanchen Mar 15, 2024
82d80e9
Merge branch 'main' into nightly
danielhanchen Mar 15, 2024
3e93a78
Update rope_embedding.py
danielhanchen Mar 15, 2024
51c2484
Update rope_embedding.py
danielhanchen Mar 15, 2024
d8e98be
Merge branch 'main' into nightly
danielhanchen Mar 15, 2024
80cfe13
Fix bugs
danielhanchen Mar 15, 2024
e5bcab2
Update fast_lora.py
danielhanchen Mar 15, 2024
cef733a
Update fast_lora.py
danielhanchen Mar 15, 2024
f342425
Update README.md
danielhanchen Mar 15, 2024
338b2c9
Update README.md
danielhanchen Mar 15, 2024
815202f
GGUF
danielhanchen Mar 16, 2024
64d954b
Update save.py
danielhanchen Mar 16, 2024
d58fa31
Update save.py
danielhanchen Mar 16, 2024
e3efca8
Update save.py
danielhanchen Mar 16, 2024
7e9f092
Update save.py
danielhanchen Mar 16, 2024
fd729a7
Update README.md
danielhanchen Mar 16, 2024
5c24a3b
Update README.md
danielhanchen Mar 16, 2024
14717be
Merge branch 'main' into nightly
danielhanchen Mar 17, 2024
2a9d4fb
Bugs
danielhanchen Mar 17, 2024
6edc35f
Update fast_lora.py
danielhanchen Mar 17, 2024
9c35a2c
Update pyproject.toml
danielhanchen Mar 17, 2024
d38cf53
Update fast_lora.py
danielhanchen Mar 17, 2024
f024ce2
Update __init__.py
danielhanchen Mar 17, 2024
61d45c6
Merge branch 'main' into nightly
danielhanchen Mar 17, 2024
e507f74
Merge branch 'main' into nightly
danielhanchen Mar 17, 2024
5cc3722
Update fast_lora.py
danielhanchen Mar 17, 2024
353deb6
dtype
danielhanchen Mar 17, 2024
9032334
Update llama.py
danielhanchen Mar 17, 2024
0c44948
Update llama.py
danielhanchen Mar 17, 2024
b283a6b
Update llama.py
danielhanchen Mar 17, 2024
bc17468
dtype
danielhanchen Mar 17, 2024
4ed12fe
Update mistral.py
danielhanchen Mar 17, 2024
e6a758d
trust_remote_code
danielhanchen Mar 17, 2024
670aef8
Merge branch 'main' into nightly
danielhanchen Mar 18, 2024
daf2679
lm_head
danielhanchen Mar 18, 2024
0748896
Update llama.py
danielhanchen Mar 18, 2024
f5189b2
save_pretrained_settings
danielhanchen Mar 18, 2024
14c6daa
Update save.py
danielhanchen Mar 18, 2024
57e450f
Update save.py
danielhanchen Mar 18, 2024
f039eee
Update save.py
danielhanchen Mar 18, 2024
f117819
Update save.py
danielhanchen Mar 18, 2024
8abac6d
Update save.py
danielhanchen Mar 18, 2024
2f357fe
Update save.py
danielhanchen Mar 18, 2024
1ada180
Update save.py
danielhanchen Mar 18, 2024
1663248
Update save.py
danielhanchen Mar 18, 2024
0d80335
Update save.py
danielhanchen Mar 18, 2024
b1b31c9
Update save.py
danielhanchen Mar 18, 2024
85875a5
Update save.py
danielhanchen Mar 18, 2024
3679c50
Update save.py
danielhanchen Mar 18, 2024
def91f0
state_dict
danielhanchen Mar 19, 2024
74e9855
Update save.py
danielhanchen Mar 19, 2024
30ddeca
whoami
danielhanchen Mar 19, 2024
fad6c2d
Update llama.py
danielhanchen Mar 19, 2024
fa5cd5f
Update save.py
danielhanchen Mar 19, 2024
7bd7aa0
Merge branch 'main' into nightly
danielhanchen Mar 19, 2024
663737d
Merge branch 'main' into nightly
danielhanchen Mar 19, 2024
2200c79
Update llama.py
danielhanchen Mar 19, 2024
a8d7a86
Merge branch 'main' into nightly
danielhanchen Mar 21, 2024
8d1490a
Patch tokenizer
danielhanchen Mar 21, 2024
04b2890
Update chat_templates.py
danielhanchen Mar 22, 2024
a330a53
Heal tokenizers
danielhanchen Mar 23, 2024
06c4424
Update chat_templates.py
danielhanchen Mar 24, 2024
396ca51
Update mapper.py
danielhanchen Mar 24, 2024
c66fe0c
Merge branch 'main' into nightly
danielhanchen Mar 24, 2024
7e1f911
Update tokenizer_utils.py
danielhanchen Mar 24, 2024
e08784b
Update tokenizer_utils.py
danielhanchen Mar 24, 2024
8634a57
Update tokenizer_utils.py
danielhanchen Mar 24, 2024
4e43875
Update tokenizer_utils.py
danielhanchen Mar 24, 2024
ba92dbb
Update tokenizer_utils.py
danielhanchen Mar 24, 2024
3f605a5
Update chat_templates.py
danielhanchen Mar 24, 2024
5350c71
tokenizer patching
danielhanchen Mar 25, 2024
56bb441
patch_tokenizer
danielhanchen Mar 25, 2024
a8914e0
Update chat_templates.py
danielhanchen Mar 25, 2024
3764543
Update tokenizer_utils.py
danielhanchen Mar 25, 2024
3566ec6
Update chat_templates.py
danielhanchen Mar 25, 2024
8fc66ad
Update chat_templates.py
danielhanchen Mar 25, 2024
cc8b11b
Update chat_templates.py
danielhanchen Mar 25, 2024
49e782a
Update tokenizer_utils.py
danielhanchen Mar 26, 2024
13d1620
Edit
danielhanchen Mar 27, 2024
aa86abc
Merge branch 'main' into nightly
danielhanchen Mar 28, 2024
254c2e4
Update mistral.py
danielhanchen Mar 30, 2024
0fce5ba
Update mistral.py
danielhanchen Mar 30, 2024
cf8de7e
Stats
danielhanchen Mar 31, 2024
18a0dc7
Update mistral.py
danielhanchen Mar 31, 2024
3fbb0cb
Merge branch 'main' into nightly
danielhanchen Apr 1, 2024
7a473f5
attention_mask
danielhanchen Apr 1, 2024
79f76ad
Update llama.py
danielhanchen Apr 1, 2024
e697184
Update llama.py
danielhanchen Apr 1, 2024
9a322bc
batch
danielhanchen Apr 1, 2024
a3b4675
Temp fix batch inference
danielhanchen Apr 1, 2024
4182c15
Update llama.py
danielhanchen Apr 1, 2024
e65d44d
Update gemma.py
danielhanchen Apr 1, 2024
89a3f1b
Merge branch 'main' into nightly
danielhanchen Apr 2, 2024
cd411c8
Fix inference
danielhanchen Apr 2, 2024
40604f5
swiglu
danielhanchen Apr 2, 2024
b01335d
Update llama.py
danielhanchen Apr 2, 2024
5404da5
Update llama.py
danielhanchen Apr 2, 2024
8fa57b2
Update llama.py
danielhanchen Apr 2, 2024
d621374
Update llama.py
danielhanchen Apr 2, 2024
2fc38bb
Update mistral.py
danielhanchen Apr 2, 2024
a2f9f82
Update llama.py
danielhanchen Apr 2, 2024
07268d6
fast inference
danielhanchen Apr 2, 2024
d98c788
model
danielhanchen Apr 2, 2024
5424a83
Update llama.py
danielhanchen Apr 2, 2024
368dae7
Update llama.py
danielhanchen Apr 2, 2024
6038861
Update llama.py
danielhanchen Apr 2, 2024
37b2e4c
Update llama.py
danielhanchen Apr 2, 2024
424be79
Update llama.py
danielhanchen Apr 2, 2024
44cac78
Update llama.py
danielhanchen Apr 2, 2024
b299629
Update llama.py
danielhanchen Apr 2, 2024
e34c98e
Update llama.py
danielhanchen Apr 2, 2024
8909301
Update llama.py
danielhanchen Apr 2, 2024
993596a
Update llama.py
danielhanchen Apr 2, 2024
8de777a
Update llama.py
danielhanchen Apr 2, 2024
7e91343
Update llama.py
danielhanchen Apr 2, 2024
231aead
Update llama.py
danielhanchen Apr 2, 2024
2160554
Update utils.py
danielhanchen Apr 2, 2024
2ef9580
Update llama.py
danielhanchen Apr 2, 2024
b38d26f
Update utils.py
danielhanchen Apr 2, 2024
69597ab
inference
danielhanchen Apr 2, 2024
e7d9f5f
Update llama.py
danielhanchen Apr 2, 2024
5e6c82a
Update llama.py
danielhanchen Apr 2, 2024
9b3f1c5
Update llama.py
danielhanchen Apr 2, 2024
03f8477
overhead
danielhanchen Apr 2, 2024
b6a179d
Update llama.py
danielhanchen Apr 2, 2024
5f556ee
Update llama.py
danielhanchen Apr 2, 2024
47304c5
compile
danielhanchen Apr 2, 2024
b37012f
Update gemma.py
danielhanchen Apr 2, 2024
6cc0be1
Update llama.py
danielhanchen Apr 2, 2024
ee66c77
Update llama.py
danielhanchen Apr 2, 2024
b9fda2d
Update llama.py
danielhanchen Apr 2, 2024
ffa4aff
Update llama.py
danielhanchen Apr 2, 2024
d8ce640
Update utils.py
danielhanchen Apr 2, 2024
db31e61
Update utils.py
danielhanchen Apr 2, 2024
b370b0e
lora mamtul
danielhanchen Apr 2, 2024
eb7d4b0
Merge branch 'main' into nightly
danielhanchen Apr 2, 2024
ca778bf
Merge branch 'main' into nightly
danielhanchen Apr 3, 2024
c9bc280
Update llama.py
danielhanchen Apr 3, 2024
d1873dd
Update llama.py
danielhanchen Apr 3, 2024
10bcc1d
Update llama.py
danielhanchen Apr 3, 2024
bb06f23
offloaded checkpointing
danielhanchen Apr 3, 2024
80dacf6
Update llama.py
danielhanchen Apr 3, 2024
6b74b39
Update llama.py
danielhanchen Apr 3, 2024
3d9b143
Update _utils.py
danielhanchen Apr 3, 2024
3fe9c9c
Update _utils.py
danielhanchen Apr 3, 2024
98a5694
Update _utils.py
danielhanchen Apr 3, 2024
e0164ea
Update llama.py
danielhanchen Apr 3, 2024
f71b445
Update llama.py
danielhanchen Apr 3, 2024
c68b59b
Update gemma.py
danielhanchen Apr 4, 2024
5666b96
Revert "Update gemma.py"
danielhanchen Apr 4, 2024
fa0c381
Merge branch 'main' into nightly
danielhanchen Apr 4, 2024
1b5ea57
Merge branch 'main' into nightly
danielhanchen Apr 4, 2024
61bc536
Update _utils.py
danielhanchen Apr 5, 2024
0ac9c9b
Update _utils.py
danielhanchen Apr 5, 2024
aa55f08
Update _utils.py
danielhanchen Apr 5, 2024
0e7775a
Saving
danielhanchen Apr 5, 2024
3fc0bc7
sentencepiece_model_pb2
danielhanchen Apr 5, 2024
a528833
Update llama.py
danielhanchen Apr 5, 2024
f78cbde
Update save.py
danielhanchen Apr 5, 2024
a4787d7
Update llama.py
danielhanchen Apr 5, 2024
a722bdb
padding side
danielhanchen Apr 5, 2024
297f59e
Update tokenizer_utils.py
danielhanchen Apr 6, 2024
432e0c9
Merge branch 'main' into nightly
danielhanchen Apr 6, 2024
f6684e8
cache dir
danielhanchen Apr 6, 2024
ab305a7
Update tokenizer_utils.py
danielhanchen Apr 6, 2024
ceb5ad6
Update tokenizer_utils.py
danielhanchen Apr 6, 2024
7509f01
Update pyproject.toml
danielhanchen Apr 6, 2024
4245120
Update pyproject.toml
danielhanchen Apr 6, 2024
5fc9bdb
Update tokenizer_utils.py
danielhanchen Apr 6, 2024
b165ecf
Update tokenizer_utils.py
danielhanchen Apr 6, 2024
c126eef
Update llama.py
danielhanchen Apr 6, 2024
c42cb8e
Update save.py
danielhanchen Apr 7, 2024
c0238aa
Merge branch 'main' into nightly
danielhanchen Apr 7, 2024
5e7ac22
Update save.py
danielhanchen Apr 7, 2024
bc28cef
checkpoint
danielhanchen Apr 7, 2024
92a96b2
Gemma 1.1
danielhanchen Apr 7, 2024
6ca8593
more models
danielhanchen Apr 7, 2024
8ad4f40
Merge branch 'main' into nightly
danielhanchen Apr 7, 2024
4290028
Update llama.py
danielhanchen Apr 8, 2024
380a587
Update llama.py
danielhanchen Apr 8, 2024
561b1f6
Update llama.py
danielhanchen Apr 8, 2024
f5c88b2
Update llama.py
danielhanchen Apr 8, 2024
5ca6198
Update llama.py
danielhanchen Apr 8, 2024
874459e
Update llama.py
danielhanchen Apr 8, 2024
8e43c24
Update llama.py
danielhanchen Apr 8, 2024
7854c9d
Update llama.py
danielhanchen Apr 8, 2024
aa4efcd
Update llama.py
danielhanchen Apr 8, 2024
e4bfd99
Update llama.py
danielhanchen Apr 8, 2024
1db50bd
Update llama.py
danielhanchen Apr 8, 2024
982f50c
Update llama.py
danielhanchen Apr 8, 2024
6b98ef3
Update llama.py
danielhanchen Apr 8, 2024
dad664e
dtype
danielhanchen Apr 8, 2024
File filter

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
model_name
  • Loading branch information
danielhanchen committed Mar 9, 2024
commit 14f063819acf40392c6678143048b3904e610dd6
2 changes: 2 additions & 0 deletions unsloth/models/llama.py
Original file line number Diff line number Diff line change
Expand Up @@ -986,8 +986,10 @@ def from_pretrained(
)

print(tokenizer)
print(tokenizer.chat_template)
model, tokenizer = patch_tokenizer(model, tokenizer)
print(tokenizer)
print(tokenizer.chat_template)
model = model_patcher.post_patch(model)

# Patch up QKV / O and MLP
Expand Down
1 change: 1 addition & 0 deletions unsloth/models/loader.py
Original file line number Diff line number Diff line change
Expand Up @@ -118,6 +118,7 @@ def from_pretrained(
)
pass

print(model_name)
model, tokenizer = dispatch_model.from_pretrained(
model_name = model_name,
max_seq_length = max_seq_length,
Expand Down