Well, this is because in the matrix it is possible not so much columns as many rows (or vice versa). For example.
library(caret)
train <- cor(mtcars)
findCorrelation(train, cutoff = .50, verbose = FALSE)
# works
findCorrelation(train[, -1], cutoff = .50, verbose = FALSE)
# Error in findCorrelation_exact(x = x, cutoff = cutoff, verbose = verbose) :
# correlation matrix is not symmetric
dim(train[, -1])
# [1] 11 10
( , .)