You need to check yourself why you feel insecure to be with him in the first place just because he is arrested... If it's really a stupid reason to get arrested, I don't see why you can't be with him...
You might need to trust him more, that should be it when you are truly in love... In fact I think he needs your support right now, it is not a happy thing to be arrested...