Your gears are synchronized by what are called synchros. If you match the rpms to the transmission correctly you could shift without using the clutch. This is how most transmissions in semis work. If the rpms are not meshed up correctly the transmission will grind. Since most people would have great difficulty doing this in their passenger cars, synchros were invented. In a nutshell, you have a bad synchro.
