He tapped into all his potential with the training and golden form ,nothing suggests he'd keep improving at the same extreme pace
Look at Goku and Vegetas steady improvement in base before they became ssjs
It was nearly as ridiculous as freezas gains but slowed when they got transformations
As far as we know freeza just had a reserve of power that could be quickly unlocked
Not an unlimited potential
Beerus forever superior to freeza but goku and vegeta constantly are shattering their limits so if freeza trAined longer than Goku and Vegeta would have more time to catch uo with golden freeza so even without freezas stamina issue hed lose at that point
Also instant transmission kamehameha and final flash shit on freeza