You initially mentioned you want a spiritual soft art, but also want a truly effective hand to hand combat technique.
Although some will disagree, the most effective forms of self defense focus primarily on just that, not spirituality.
Muay Thai
Kick Boxing
Brazilian Jiu Jitsu
Combat Sambo...