It's not a matter of how they're driven by consumers, but what they're built for. Ferrari has long built cars for the track: they're driver's cars, which were engineered to go fast - they are supercars. Lambos, until recently perhaps, went fast, but they were built to be seen: consider the insane bodywork of a Countach or Diablo, or even the Reventon.
That is not to say a Lambo is not a fun car to drive, but if you want a pure, proper driving experience, the Ferrari is likely the better car.