I agree with this statement, but the corollary is (this one’s mine):

Any problem can be made more complex than it needs to be.

I have no issue with complex solutions, indeed sometimes they are absolutely required. The art is in finding the simplest form of the problem.