[Cherry-Pick][Feature] use phi permute/unpermute & rm swiglu (#6361) - #6808

[Cherry-Pick][Feature] use phi permute/unpermute & rm swiglu (#6361)#6808

yuanlehome merged 4 commits into

PaddlePaddle:release/2.5PaddlePaddle/FastDeploy:release/2.5from

fxyfxy777:cherry-pick/phi-permute-swiglufxyfxy777/FastDeploy:cherry-pick/phi-permute-swigluCopy head branch name to clipboard