Ok I looked a bit further, the evidence for the first inhabitants of the region being ancestors of the Sami is based on linguistic studies with other Uralic languages. But it’s far from direct evidence. I always assumed it was based on archeological evidence.