So I've figured out that you get a collective stat boost from all badges you have, and when going into battle you select a badge and get its abilities, but still get stat boosts from all other badges...