Skip to content

fix: use ReLU² instead of SiLU in BitNet FFN (fixes #588) - #604

Open
Pranesh Nikhar (praneshnikhar) wants to merge 1 commit into
microsoft:mainfrom
praneshnikhar:fix/588-ffn-relu2
Open

fix: use ReLU² instead of SiLU in BitNet FFN (fixes #588)#604
Pranesh Nikhar (praneshnikhar) wants to merge 1 commit into
microsoft:mainfrom
praneshnikhar:fix/588-ffn-relu2

Commits

Commits on Aug 9, 2026