You can download a copy of them first:
tick the top right checkbox so a tick appears next to all the messages. At the bottom of the page where it says 'Selected Messages: ' pick one of the download options. Click go and save the file on your computer.
To delete:
tick the boxes next to the messages you want to delete then select the delete option.