The Hebrew name is Kalev, not Kaleb, where you have a B within or at the end of an English name of Hebrew origin, in Hebrew that B would be a V. Only exception is when B is in the initial letter, so Benjamin = Binyamin in Hebrew.
Kaleb is actually the direct English form of Kalev, but it's not the official form, that would be Caleb (the official Biblical spelling). Caleb is now accepted as the English spelling, whereas Kaleb is seen as being creative (although technically it isn't).
Caleb isn't the only English name of Hebrew origin where the accepted English form isn't the direct English form. Elizabeth is the accepted English form of Elisheva, but the direct English form is Elisheba (see the V has became a B again?!)
So it wouldn't be wrong to use Kaleb, but because so many people these days do get creative with C names and spell them with a K instead, sadly that's what people think Kaleb is. Therefore, while it's technically a legit spelling, it does cry out as being Kardashian-esque right now.