He could be saying that as long as we are loving and caring, doctrine is not really important.
Or he could be saying you can have 100% iron clad correct doctrine, but if your heart is black, it doesnt do you any good.
I would agree with the second thought.
I think you should ask the pastor what he meant by that. You visited one time, and there may be some history there that you're not aware of.
But if he doesnt emphasize correct Biblical doctrine... keep looking.
Be sure you clarify what he meant before you write him off.
Krispy