Travelling in Italy by bus or train.?

What is the easiest and cheaoest way to travel in Italy from one city to another? We are planning to go for 2 weeks to cities like Rome, Florence, Venice, Milan, Pompeii, Capri, Amalfi Coast. Thanks in advance