Can Klarna be turned off?

No, all enabled payment methods appear by default to provide customers with consistent choice.