Once you drop the idea that we're expaning through 3D space but recognise it is through higher dimensions (which, frankly, doesn't take a genius to accept is possible) then you have both satisfied - all points in space are expanding uniformly with respect to each other AND we're expanding from a single point (which is a point no longer in our 3-space). Seems self-evidently the most satisfactory answer to me.
Again, a common misconception. There are three "large" dimensions which have been unfurling since the Big Bang. Space is not expanding "into" anything, it is just expanding.
What is the universe expanding into?
The universe is not expanding into anything, almost by definition; there is simply more space at later times than at earlier times. It may be that the size of the universe is infinite, which is easy to conceptualize.
But even if the universe is finite, it is possible to make more space without having any "outside" space. A common analogy is to consider that it is possible to increase the surface area of a balloon by inflating it, without needing any additional balloons to facilitate the expansion. However, a balloon is a two-dimensional surface expanding into a three-dimensional space. There is not theorized to be a higher-dimensional space which three-dimensional space is expanding into; more of it simply appears as if by stretching.[7]
http://en.wikipedia.org/wiki/Expansion_of_the_universe
The higher dimensions, as best we can theorize, are furled in a Calabi-Yau shape and give rise to matter and energy (according to string theory).
Either way, the upshot is that special relativity is only locally valid. Two points can be separating much faster than c in three dimensions.
According to the equivalence principle of general relativity, the rules of special relativity are locally valid in small regions of spacetime that are approximately flat. In particular, light always travels locally at the speed c; in our diagram, this means that light beams always make an angle of 45° with the local grid lines. It does not follow, however, that light travels a distance ct in a time t, as the red worldline illustrates. While it always moves locally at c, its time in transit (about 13 billion years) is not related to the distance traveled in any simple way. In fact the distance traveled is inherently ambiguous because of the changing scale of the universe. Nevertheless, we can single out two distances which appear to be physically meaningful: the distance between the Earth and the quasar when the light was emitted, and the distance between them in the present era. The former distance is about 4 billion light years, much smaller than ct. The latter distance (shown by the orange line) is about 28 billion light years, much larger than ct. Note that the light took much longer than 4 billion years to reach us though it was emitted from only 4 billion light years away. In fact, we can see from the diagram that the light was moving away from the Earth when it was first emitted, in the sense that the metric distance to the Earth increased with cosmological time for the first few billion years of its travel time. None of this surprising behavior originates from a special property of metric expansion, but simply from local principles of special relativity integrated over a curved surface.