It's like when you hit a pot hole on the 400 series highway. You'll hear it louder than you'll feel it. In fact, because of inertia, your car goes right over the pot hole because it doesn't have time to descend into it. It's a lot better than s-l-o-w-l-y driving over a hole.
Well, I've explained why you don't feel it as much and why it's possibly very damaging to your car. If you "hear" it, then your car felt it. I don't believe your car "goes right over it". Your wheel still begins to drop into the pothole. It may not reach the bottom of it, but I'll be it sure slams hard into the trailing edge of the pothole lip. That's when the suspension gets shoved up to and into the bump stop. Something takes the punishment so you don't feel it. So no, I don't believe it's a lot better than slowly driving over a hole. However, if you're happy doing this and you don't believe the car suffers anything bad, well, it's your car. "Put in new di-lithium crystals, Scotty! Give me all she's got!"
PS. Driving over a hole is not quite the same as driving over a speed bump. One allows the wheel to drop, then get pushed up. The other just pushes up. One might eve say that the pothole is far worse. Those have been known to put alignments out.