[feat] Support swa for npu - #135

Open

POI-WX wants to merge 9 commits into

mainfrom

support_swa_for_npu

Commits on Oct 21, 2024

fix bug of rope for npu and support the interleaved option
POI-WX
committed
49d1a9d

Commits on Oct 22, 2024

optimize when interleaved is True
POI-WX
committed
0eebc4b
use fused rope op from mindspeed
POI-WX
committed
d69d17b

Commits on Oct 23, 2024

optimize
POI-WX
committed
6681c0a

Commits on Jan 8, 2025

using fused rms norm op with 8.0 RC3 software stack on npu
wangxing2
committed
ee0baeb

Commits on Jan 9, 2025

optimize
wangxing2
committed
5565fbc
modify atol and rtol
wangxing2
committed
c39b8c5

Commits on Jan 21, 2025

use the global attention mask and support sliding window local attention
wangxing2
committed
a346f6c
optimize code for npu
wangxing2
committed
4b133df