That's more history than language, really. The more pure a language is, the fewer spelling things like that you'll get. Those sorts of quirks are mostly the result of smashing multiple languages together and making one language out of whatever survives. English is probably the language that's done this the most.