2
goto Administration->System->Edit Groups, click on the Anonymous group, and check/uncheck each module and block that you want anonymous users to have access to. be careful what you give them access to, read carefully.
goto Administration->System->Blocks, you can edit each block to specify on what Module pages it should display, which column it should display in, etc etc.