You have a pretty decent spec and can run SU fine as it is if you are a little more careful with you method of modelling.
As modelhead mentioned though, the graphics card is possibly causing you a slight slowdown.
I have the same problem with my workstation at work, good processor and memory, but a 64mb graphics card!!
I really have to carefully use layers and scenes to keep different components on which helps tremendously.