4
XOOPS.org has about 7000 unique visitors a day, and runs at about 20% server load. Try some cache settings (although this site doesn't use them, only on a few blocks), they might enhance your site speed. Try to find out what is the bottleneck. This site runs on a dedicated server as well, with 1 gb ram, processor is less then yours.
Herko