Stacking/Concatenating/Combining two vector space models

I have two vector-space models, with different dimensions.

The number of vectors in one model is the same as the number of vectors in the other. I.E: if I have vector representation for a car in one model, I have vector representation for a car in the other model, but the number of dimensions can be different.

I want to combine these models (and then cluster using the combined model), I cannot average (BoW) or add these models together as stated earlier they have different dimensions.

I was going to simply concatenate the vectors. Is this valid or is there better way to do this?

Also before you concatenate should you normalize?

Topic vector-space-models nlp machine-learning

Category Data Science

1
answered at

It is perfectly valid to concatenate the vectors from two different models. It will be necessary however to experiment with the two approaches, i.e. either using individual vectors from one of the models or concatenating the vectors, before you can determine which method will produce better clustering results. It is also valid to normalize word vectors, but again requires experimentation to determine whether this approach will provide superior results.

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.