'Former' was formed by combining Middle English 'forme' ("first") and '-er', so at the time it literally meant "firster".
'Foremost' is peculiar too: it used to be 'formest' - 'forme' plus '-est', so literally "firstest" - but the part '-mest' was replaced by unrelated 'most'.
