Hi
Try use template's css and javascript compression. You may need to exclude some of the files when You see site loosing functionality.
Than I advice to use jotCache component. This is the strongest cache solution I know and will improve the speed greatly.