2
Block Admin
Create a custom leftblock containing all your links.
make it Visible In "All Pages"
Group Admin
Assign anonymous access right to the block
(it should be defaulted to, just in case, double-check if registered users have the access right)
Back to Block Admin Again
Make the block visible and you will have to play with the block weight a bit to place where you want it.