Concatenate sparse matrices in Python using SciPy/Numpy

Question

What would be the most efficient way to concatenate sparse matrices in Python using SciPy/Numpy?

Here I used the following:

>>> np.hstack((X, X2))
array([ <49998x70000 sparse matrix of type '<class 'numpy.float64'>'
        with 1135520 stored elements in Compressed Sparse Row format>,
        <49998x70000 sparse matrix of type '<class 'numpy.int64'>'
        with 1135520 stored elements in Compressed Sparse Row format>], 
       dtype=object)

I would like to use both predictors in a regression, but the current format is obviously not what I'm looking for. Would it be possible to get the following:

    <49998x1400000 sparse matrix of type '<class 'numpy.float64'>'
     with 2271040 stored elements in Compressed Sparse Row format>

It is too large to be converted to a deep format.

Saullo G. P. Castro · Accepted Answer · 2020-08-12T15:02:45.250

83

You can use the scipy.sparse.hstack to concatenate sparse matrices with the same number of rows (horizontal concatenation):

from scipy.sparse import hstack
hstack((X, X2))

Similarly, you can use scipy.sparse.vstack to concatenate sparse matrices with the same number of columns (vertical concatenation).

Using numpy.hstack or numpy.vstack will create an array with two sparse matrix objects.

edited Aug 12 '20 at 15:02

answered Oct 31 '13 at 15:30

Saullo G. P. Castro

56,802
26
179
234

2

Seems hstack is quite slow, check this post out on a similar question [link](https://stackoverflow.com/a/33259578/6485667) – simeon Jun 19 '17 at 05:23
1

@simeon interesting that Scipy's dev team hasn't adopted such efficient solution – Saullo G. P. Castro Jun 19 '17 at 09:44
1

For the horizontal concatenation hstack() and for the vertical concatenation vstack() can be used. – mgokhanbakal Aug 12 '20 at 13:33

Concatenate sparse matrices in Python using SciPy/Numpy

1 Answers1

Linked

Related