You can go into the history folder and delete the files inside
C:\Documents and Settings\Your Name\Local Settings\History\History.IE5
Might be different for Vista
Or if you are using a different browser then Internet Explorer, then you will have to go to the Tools or options menu in the respective browser and tell it to clear history.