About transformer prediction results

[dingchaoyue]

I hope to get your suggestions on how to solve the problem about transformer prediction. I used the transformer model in the code to predict the data and got the results shown in the following figure. The transformer predicted results are horizontal and cannot fit the original upward sloping data.

[sauradefy99]

Just a guess but looks like the transformer is trying to predict the trend-removed data?

[dingchaoyue]

May be so, thank you for your reply.

[deshanej]

I am also getting 'constant' values for predictions (ie no time variation,)anybody had any luck with a good prediction?

[helloworld-wu]

hello, did you solved this problem?

[helloworld-wu]

I am also getting 'constant' values for predictions (ie no time variation)

[djph29]

Yes, increasing the number of epochs, and changing the input_sequence_length helped.

[MyLinChi]

I have this same problem too.And increasing the number of epochs or changing the input_sequence_length doesn't work.