Could Numpy be made into an optional dependecy?
For many applications one can perform all computations in Postgres so the vectors are essentially opaque data and there should be no need to install a large binary dependency (also, I guess some people might be using a different numeric library, although all the ones I know of interoperate with Numpy).