We show that dark matter abundance and inflationary energy scale could be intimately related. Standard Model extensions with Higgs mediated couplings to new physics typically contain extra scalars whose excursions at the end of inflation can be very large. If their coupling to the Standard Model is weak, they will not thermalize and may easily constitute too much dark matter. As an example we consider Standard Model extended by a real singlet scalar and a singlet fermion. We discuss the field dynamics during inflation together with the post-inflationary dark matter production mechanisms and derive stringent constraints on viable mass scales and coupling values.