Yes! You have to actively choose your spouse and direct your mind. It's normal for humans to be attracted to newness. We can be temptd even if we are married to wonderful people.