Add improvements and fixes to upstream#223

Closed

sskalnik wants to merge 15 commits into

Stability-AI:mainfrom

sskalnik:sat-pr-v1

Commits on Sep 14, 2025

Commits on Sep 25, 2025

Initial commit of working SAO-1.0 and SAO-small training configs and scripts. Update .gitignore to ignore raw audio file dataset folder and outputs folder.
sskalnik
committed
Create TRAINING_FOR_NOOBS.md
sskalnik
authored
Update TRAINING_FOR_NOOBS.md for clarity regarding /rawfiles.
sskalnik
authored

Commits on Sep 29, 2025

Add support for AdamW8bit from bitsandbytes. Improve custom metadata module logic. Fix issue with FutureWarning about torch.cuda.amp.autocast() vs torch.amp.autocast("cuda").
sskalnik
committed

Commits on Oct 5, 2025

Add experimental support for google/t5gemma-b-b-ul2. Remove spurious whitespace from TRAINING_FOR_NOOBS.md.
sskalnik
committed

Commits on Oct 6, 2025

Change learning rate to 5e-5 (still experimenting with SAO-small). Use StatefulDataLoader from torchdata so we can resume from mid-epoch checkpoints.
sskalnik
committed

Commits on Oct 8, 2025