I like how the Malfoys, who always talked big, were so unhappy with the return of Voldemort. Lucius was 26 at the end of the war and it's not a huge jump to say that he'd have joined young (war been going 13 years) and wasn't really into the Death Eater idea. His life was great after Voldemort fell and he was very happy. When Voldemort goes off him (OOTP debacle and finding out about the destroyed Horcrux) and takes over his house, leaves him in Azkaban and sets his son up to die.. well it's pretty clear in Book 7 that all three of them want out.