Well that is a matter for you to judge. As I described the method of seeing if it is ripe, so too much you become familiar with your starter as it ages. I tend to recommend that you only really have about two hours. Truthfully you have more time, it is actually about personal preference and is a question of flavour and volume preferences, the enzyme activity of your flour and the ambient temperature.
