Mach's principle and other ways out.
Now, I don't know about you, but when I found out about inertial frames, I found it distinctly odd. What do the distant galaxies have to do with my throwing a ball here on Earth? And why should the universe on a large scale have no rotation? I puzzled for years over this. I remember bugging the teacher about it thus:
The reason why the moon doesn't fall into the Earth is because of the moon's tangential motion. We can see it travelling across the sky, advancing roughly 14 degrees ahead of the stars each day. Now let's imagine, that we take away the sun, the other planets and all the stars, leaving only the Earth and the moon. What does it mean to say that the moon has tangential motion any more? With respect to what? Would the moon fall into the Earth?
Successive teachers declined to recognise this as a serious question and it wasn't until I went to university and had easy access to a better library that I found out that the philosopher Ernst Mach had tried to answer this question, and that his solution was called Mach's principle. According to which, the Earth, the sun and all else acquire their inertia from the distant galaxies.
So we have a name for it. But that doesn't help. Mach and others since have tried to quantify this. But the problem is that any effect has to be a very weak function of distance: only the very distant galaxies can have an appreciable effect, for reasons of symmetry. And what would that effect be and how would it propagate? Most importantly (as a scientific question), how could you look to see if it were there?
Cosmic inflation is one possible, partial answer. Many cosmologists think that, in the extremely young universe, there was a brief period of very rapid expansion (whimsically called inflation). Because the young universe is very homogeneous (it is small enough that the various bits are close to equilibrium with each other), a rapid expansion would give a universe much more homogeneous than would be expected from quantum mechanical fluctations and the influence of gravity, and thus explain the observed near homogeneity of the microwave background. Now angular momentum (a measurement of how much something is spinning, which we can quantify by multiplying the mass of something by the area per second it sweeps out about the centre of rotation) is conserved. If it were conserved during inflation, then any initial angular momentum of the universe would be extremely diluted afterwards: the radius of any motion would be large, so to sweep out any area would require only a very tiny angular motion. Which would explain why the universe as a whole is not spinning.
But with respect to what? To explain why the frame of the distant galaxies is an inertial frame, we really need either Mach's principle or another postulate. And physicists are very parsimonious with postulates.