Skip to content

Pull requests: karpathy/llm.c

New pull request New
72 Open 355 Closed
72 Open 355 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Overlap computation and communication V2
#574 opened Jun 9, 2024 by ngc92 Loading…
Dataloader - introducing randomness
#573 opened Jun 7, 2024 by gordicaleksa Loading…
Model Export to Hugging Face format and optionally upload
#571 opened Jun 7, 2024 by rhys101 Loading…
1
Consolidate memory
#565 opened Jun 7, 2024 by ngc92 Loading…
3
Fix the compiler warnings and errors
#561 opened Jun 6, 2024 by lancerts Loading…
1
Utilities for cuda streams + disk IO
#556 opened Jun 5, 2024 by ngc92 • Draft
added reading checkpoint files
#554 opened Jun 5, 2024 by morphpiece Loading…
1
[attension.cuh] Move assert outside of attn kernel to launcher
#545 opened Jun 4, 2024 by lancerts Loading…
[layernorm.cuh] Minor fix with 32 replaced by WARP_SIZE
#544 opened Jun 4, 2024 by lancerts Loading…
3
Adds simplified way to download the already tokenized tinyshakespeare dataset and gpt2 weights
#542 opened Jun 3, 2024 by ChrisDryden Loading…
Add master weights to resume state
#522 opened Jun 2, 2024 by gordicaleksa Loading…
5
Replaced parameter B with the total parameters calculated outside of the kernel
#521 opened Jun 2, 2024 by ChrisDryden Loading…
1
Removing B in encoder and replacing with calculated N in kernel
#520 opened Jun 2, 2024 by ChrisDryden Loading…
add edu fineweb support, with 10B and 100B version
#517 opened Jun 2, 2024 by eliebak Loading…
5
Added packed layernorm_forward
#513 opened Jun 2, 2024 by ChrisDryden Loading…
2
Benchmark modal script revamped - profiling and external libraries (Issue #504)
#510 opened Jun 1, 2024 by vyom1611 Loading…
10
adding wsd schedule with (1-sqrt) decay
#508 opened Jun 1, 2024 by eliebak Loading…
6
Added script to download all of the tokenized fineweb100B data from huggingface
#507 opened May 31, 2024 by ChrisDryden Loading…
3
Added additional layernorm forward kernel that does not recalculate mean and rstd
#506 opened May 31, 2024 by ChrisDryden Loading…
Added constexpr for blocksizes to optimize compilation
#505 opened May 31, 2024 by ChrisDryden Loading…
Add DockerFile
#501 opened May 30, 2024 by banyan-god Loading…
Realtime training visualization using wandb
#489 opened May 29, 2024 by chinthysl Loading…
6
Added kernel development file for permute_backwards
#477 opened May 27, 2024 by ChrisDryden Loading…
1
train_gpt2.c: Add gpt2_write_to_checkpoint method
#467 opened May 26, 2024 by faxe1008 Loading…
.gitignore: ignore more for windows devs
#466 opened May 26, 2024 by nietras Loading…
ProTip! Mix and match filters to narrow down what you’re looking for.