I wouldn't remove it, you will will be prone to errors. But you can edit how it appears by going to system admin>templates.
Make a clone of the default template, then edit your clone. In the cloned copy, you can edit system_redirect.html in the system files.
An edited redirect an look really nice once it's changed. Theme developers should included a new redirect file, but thats just an opinion and an option I would use if I were releaseing themes. (I'm not knocking theme devs, it's easily overlooked!)
*EDIT*
Here is a code snip I use for my site:
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=<{$charset}>" />
<meta http-equiv="Refresh" content="<{$time}>; url=<{$url}>" />
<title><{$sitename}></title>
<style type="text/css">
body { font-family: Tahoma, taipei, sans-serif;
font-weight: normal;
color: #222222;
font-size: 12px;
}
hr { color: #8CA9C1;
height: 1px;
width: 95%;
}
.redirect { width: 100%; margin: 110px; text-align: center; padding: 15px; }
.redirect a:link { text-decoration: none; font-weight: bold; color: #466884;}
.redirect a:visited {text-decoration: none; font-weight: bold;}
.redirect a:hover { tect-decoration: underline; font-weight: bold; color: #FF9966;}
</style>
</head>
<body>
<div align="center">
<div class="redirect">
<span style= align="center" "font-size: 14px; font-weight: bold;"></span>
<div align="center"><img src="/insert/path/to/image.jpg"></div>
<h4><{$message}></h4>
<hr>
<p><{$lang_ifnotreload}></p>
</div>
</div>
</body>
</html>
*Shoves the dirty code under the carpet as the guests walk in*
Don't mind the mess...
Hope you find it useful