Quickstart uploaded to ftp but site remains the same

I've probably done something wrong but here's the steps I've taken:

1. Installed Joomla 2.5 with database and all that jazz.
2. downloaded quick start file and uploaded / overwrote everything in joomla folder
3. went to site and nothing has updated...

I'm bound to be missing quite a bit so please help! I remember that's how I used to do it a while back but couldn't figure out how to now... thanks again.

Yes, you did it in wrong way. When you use quickstart you don't need to install Joomla before becuase quickstart package contains latest Joomla. Please look at this tutorial where we've described whole process step by step » How to install the GK Quickstart package with Joomla! 3.x – GavickPro Documentation

Thanks! I knew I had done something silly.

Now another silly question is how do I go back? I've got it configured to the database so do I have to make a new one or is there something that I can just update or something? Thanks!

The best way is to create new one or just clean the old one to avoid some further problems.