Can I delete the directory MAMP_xxxx?

The installer will rename your existing "/Applications/MAMP" to "/Applications/MAMP_current_date". This folder can later be deleted. You may however keep it, so you can fall back to your original setup.