In linear algebra class, the cross product of matrix is not mainly discussed, and actually, as we all known, cross product will introduce a new dimension.
Please see what VC dimension is talking about.
Max pooling is not differentiable, but mean pooling is, and so does P-norm
