why informer call a Fullattnetion but not a ProbAttention layer?

[aanxud888]

❔Question

why informer call a Fullattnetion but not a ProbAttention layer?

Additional context

为什么probAttention自定义层木有实现呀，还是我木有找到

[LongxingTan]

Because I think it's just an efficiency setup for better training. Do you have scenario to use ProbAttanetion, if so, I can add it.

[aanxud888]

yes,thanks.感谢大佬

[LongxingTan]

@aanxud888

prob attention implementation is here

But the test only covers the layer yet, not the informer model
可以参考

[aanxud888]

感谢