The CVT is the weak point of the Legacy, but it isn't any worse than having an outdated 4-speed automatic transmission. So in that sense, it balances out. But yeah, I would have to decide if the rest of the Legacy is a strong enough vehicle to outweigh the CVT issue. At least Subaru as their excellent AWD system to counter-balance the CVT. The Altima doesn't offer anything to counter-balance the CVT. For that alone, I wouldn't consider the Altima.
So, yes, CVT is definitely a 'minus' in my opinion, and it's going to be a while before I consider a CVT a 'plus' or even just be indifferent towards it, like I do towards 5-speed autos nowadays.