FlashPy

Implementation and Comparision of FlashAttention (Dao et. al.) algorithm with Standard Attention algorithm

Name		Name	Last commit message	Last commit date
Latest commit History 26 Commits
assets		assets
experiment_scripts		experiment_scripts
hellaswag		hellaswag
train_logs		train_logs
README.md		README.md
dataset_info.txt		dataset_info.txt
fineweb.py		fineweb.py
hellaswag.py		hellaswag.py
input.txt		input.txt
play.ipynb		play.ipynb
train_gpt2_fineweb_dataset.py		train_gpt2_fineweb_dataset.py

Provide feedback