Physics, the Big Bang.

As I understand it, it is common to say that the universe has been expanding since the Big Bang. Not that matter is expanding in a vacuum, but that space itself is growing.
If I understand correctly, it’s because the galaxies are moving away from each other.
What I don’t understand is why not claim that matter expands in a vacuum? I hope the question is clear.