theonlyengine
/

flash-attention

Model card Files Files and versions Community

flash-attention / adamw-apex.yaml

theonlyengine's picture

Upload 421 files

3f9c425 verified 6 months ago

history blame contribute delete

81 Bytes

	# @package train.optimizer
	_target_: apex.optimizers.FusedAdam
	adam_w_mode: True