Find the guide here https://help.ubuntu.com/community/Joomla

First, download the latest Joomla release 1.5.8 from http://www.joomla.org/download.html