To delete the chat, swipe the conversation to the left and click the bin button. You can only delete the whole conversation and not individual messages.