I've played it about 2 dozen times in one campaign. Your one time is probably not going to give the best window into how it works out. Complications do occur frequently but were you and your teammates taking stress to add more dice? Did you guys get enough XP to increase dice? Oh wait, one session so no.