2
Depends on the modules you have installed and what blocks your using on your start page, less is more when it comes right down to it.
If your using the Headlines block with RSS feed, it may slow your site down when fetching new news. The more localised your site is, the faster it renders.(ie no external scripts linking news to your site, etc) Also, your theme will have an effect. Keep your logo under a few kilobytes as with most of your graphics. Clean up loose html in custom pages, tighten the table usage and all that sort of thing.
If many people are having problems accessing your site, it may be a separate issue. But lets not jump the gun on that.
Currently, my site load time is pretty reasonable, except my headlines do slow it down some on occasion.