Afaik all Germanic languages except English¹ (and close relatives) have the same thing. Ie this stuff is the same in Dutch, German, Swedish, Danish², etc.
We don't say "Twenty-three" but "Three-and-twenty". So far so good, but we do the hundreds, thousands etc just like English does. Thus, 123 is pronounced "hundred-three-and-twenty", i.e. precisely as nuts as what Americans do with dates.
¹) I assume that English fixed this at some point along the way (maybe due to French influences?), because the special number names between 10 and 20 do follow continental Germanic rules, eg compare "sixteen" and "twenty-one". We mainland Europeans like to mock the English speaking world for their insane unit systems, but at least their numbers make sense.
²) Danish has it worse. They have the same insane number ordering plus insane number names.
3 is "tre", 30 is "tredive". 4 is "fire", 40 is "fyrre". So far so good. Like in many languages, 10x sounds a bit like x.
But 6 is "seks", and 60 is "treds" (!). To make matters worse, 5 is "fem" but 50 is.. "halvtreds" (!!). Similarly 9 is "ni" and 90 is "halvfems". In Danish, for x <= 5 < 10, 10x sounds like ["", "halv"][x mod 2] + ceil(x / 20). I tried mocking the language by saying "fems" instead of "hundrede" but I just got blank stares.
And I'm lucky enough to have grown up on the same insane middle endianness as the Danes. I can't imagine how impossible Danish numbers must be to learn for eg an English speaker. Every time my wife says a number in Danish I spend half a minute doing the math, "she said something with 'tre' in it, so threes, but it ended with an s, so three times twenty, oh but wait there was 'halv' in front of it so subtract 10, ah, fifty". But she didn't say that, she said "to-hundrede-tre-og-halvtreds". By the time I'm done with the math I already forgot the other digits :-)
(And you didn't even mention how "tredive" is pronounced.)
Swedish and Norwegian (and English for that matter) used to count the Germanic way, but swapped to the modern way for 20 onwards at various points.
There's an English nursery rhyme "Four and Twenty Blackbirds" which has the old way as its title. English also used to use the vigesimal system. My great-grandfather was supposedly a bit of a traditionalist even amongst his rural friends, who poked fun at him for saying things like "two score nine? I'm not paying that!".
