I arch my back when I horseback ride?

[Horse and Hamster girl!]

For some reason I arch/dish my back when I ride my horse
How can I fix it to make it more straight?
Thank you