Yes, and so can the President.
We're not talking about constitutional matters here, we're talking about reality. Constitutionally, Congress can do all sorts of things to Courts - impeach Justices, ignore decisions, shut down courts, etc. That doesn't happen today though (unless some Justice is impeached for clear corruption; beyond that, impeachment is never done).