For what camera, Simon?
I assume that the 20 - 24mm you mention is the 35mm equivalent. You'll find there is quite a difference between 20mm and 24mm, including the price, especially if it's a zoom and not a primary lens. You might consider going even wider, say 16-18mm, so that the lens is not being used at its extremity when it is most likely to give the most distortion.
Don't forget the cost of filters, if they can be fitted!