Horses for courses really...
If you want to get into photography proper take Barney's advice and get an DSLR.
If you want to take good photos but you want something small and light take RJV's advice and get a pocket compact.
I would seriously consider the little waterproof Panasonic Lumix (and Canon) models. They'll survive dunking and (to an extent) bashing. I've snorkled with my little Panasonic, it can be put on a tripod and whilst it doesn't have a bulb setting it can do 15 and 30 second exposures.
Start small and reasonably inexpensive is my advice. Couple of hundred on a good compact, tenner on a cheap tripod (you will get fed up of replacing them so eventually you'll buy a better one) and a bright torch for light painting or back lighting.
Get into flashes, slaves and DSLRs if you find you really enjoy photography.
my orders are to sit here and watch the world go by