I think they should have made the films true to the books and kept more in than they did, but I agree that they would end up at about five hours long if they did this.
Before they made GOF I read somewhere that it had been suggested that they split it into two halves and have it as two seperate...