I don't believe they should ever be let out. But, for those who are -- castration (of all parts), tattoo on the forehead that states what they are example: "child rapist" and a tracking device which anyone could access online to see exactly where they are.
If I sound mean, I've worked in prisons, currently work in law enforcement and I'm a parent. Too bad.