It sounds like the handle broke on the inside. In any case you'll have to take the interior door panel off and examine the situation. If you don't care about the way it looks go ahead, but i must warn you, when you get done, more often than not some piece of trim won't fit right and it looks bad.