A problem is that most of the intellectuals they get in are from the Oxbridge brigade. I'm not saying that is a problem in itself but maybe it is a consious decision not to overload the program with them and have a broader range of guests.
Saying that, David Mitchell seems to not go the same...