I highlighted the URL (either in the History sidebar or in the address bar drop-down) and pressed Shift+Delete but it's not permanent.
I click on the down-arrow of my address history bar, and the "deleted" url is back again.
I already know how to disable it with the "about:config" option...