Unsolicited advice: fractals are just a tiny piece of the math landscape, so only do a math double major if you enjoy a lot of other math too. For example, to get serious about fractals you need to take advanced calculus and then real analysis, which are tough but to me utterly delightful subjects - and much bigger than fractals in the grand scheme of things.