A game will only count toward your history/average/records if you finish it - so just letting a saved game lapse until it disappears from your recent...