The High Cost of a Low Training Budget