Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
66430ff
more metrics printing
garrett361 Jan 15, 2025
7ba31b9
padding-free path
garrett361 Jan 15, 2025
a795dc4
configurable wandb project name
garrett361 Jan 15, 2025
e482182
project name arg fix
garrett361 Jan 15, 2025
86316d7
TensorDataCollatorWithFlattening
garrett361 Jan 15, 2025
a4c1714
missing attn_mask fix
garrett361 Jan 15, 2025
5ed6285
remove print test
garrett361 Jan 15, 2025
75e7773
print model
garrett361 Jan 15, 2025
f76476f
track avg tok/batch
garrett361 Jan 16, 2025
79aac74
dtype check
garrett361 Jan 16, 2025
a7ae4f3
dtype check fix
garrett361 Jan 16, 2025
8dfc719
remove dtype check
garrett361 Jan 16, 2025
dc1930c
report avg tok/batch with padding
garrett361 Jan 16, 2025
aa7e2c8
print fsdp plugin
garrett361 Jan 16, 2025
8bbae66
refactor TensorDataCollatorWithFlattening
garrett361 Jan 17, 2025
7365706
print args
garrett361 Jan 18, 2025
925b8dc
update collator for llama
garrett361 Apr 15, 2025
70d0602
print args
garrett361 Apr 16, 2025
f54a20a
more prints
garrett361 Apr 16, 2025
2240d57
try_auto_save_to_beaker=False
garrett361 Apr 16, 2025
5d60b82
istensor -> is_tensor
garrett361 Apr 16, 2025
b67a52d
accelerator.print
garrett361 Apr 16, 2025
44684e0
get tok count from cu_seq_lens_q
garrett361 Apr 16, 2025
4b12e2e
print batch
garrett361 Apr 16, 2025
a049088
fix concat
garrett361 Apr 16, 2025
1b536d1
return to old collator
garrett361 Apr 16, 2025
0fe7585
more accelerator.print
garrett361 Apr 16, 2025
a13041b
rm batch print
garrett361 Apr 16, 2025
b300092
log mem stats
garrett361 Apr 16, 2025
08b404e
print approx time remaining
garrett361 Apr 16, 2025
3f3a647
flash kwargs in collator
garrett361 Apr 16, 2025
fc89696
truncate wandb name to 64 chars
garrett361 Apr 16, 2025
1bb79dd
fix err msg
garrett361 Apr 16, 2025
359be09
no date in run name
garrett361 Apr 16, 2025
f5648a2
turn off final ckpt cleanup by default
garrett361 Apr 18, 2025
35ddff7
turn off early checkpoint cleanup by default
garrett361 Apr 18, 2025
e780d3e
main process load dset first
garrett361 Apr 18, 2025
a23aa8b
fix sum loss reporting
garrett361 Apr 21, 2025
31abc92
report per-batch loss when reduce_loss="sum"
garrett361 Apr 21, 2025
4760d4c
local main process
fabianlim May 8, 2025
79990e9
grad accum
fabianlim May 8, 2025
d5f5a24
proper grad accumulation for sum loss
garrett361 May 9, 2025
42a19a0
comments
garrett361 May 12, 2025
766e2b2
skip_final_ckpt option
garrett361 May 13, 2025
d43a5f5
extra print statements upon restart
garrett361 May 19, 2025
0e08ca6
more printing
garrett361 May 20, 2025
290d6cf
fix sec_per_step after restart
garrett361 May 20, 2025
761442d
final ckpt print check
garrett361 May 21, 2025
79f26cc
more prints and fix skipping logic
garrett361 May 21, 2025
b1f2c2d
fix: return position_ids in collator
garrett361 May 21, 2025
3bfe27a
intermediate ckpt print
garrett361 May 24, 2025
0c2f33e
final_lr_ratio
garrett361 May 30, 2025
5d227a3
reverted formatting changes
fabianlim Jun 24, 2025
2387a5e
revert formatting changes
fabianlim Jun 24, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading