The claim that every belief should be based on evidence is not logical and is the least controversial. There are many beliefs that are considered “basic beliefs,” beliefs that are inherent in the person's psyche and consciousness, and each person accepts these identified truths as axioms, without the need for further internal or personal justification. Among them, the belief in the existence of an external world (and not that reality is a dream that exists in our heads); the belief in the existence of other consciousnesses or universal consciousness (and not that the people we meet are just unconscious robots); the belief in the existence of moral values; of legality in nature; of our intellect's ability to know reality; and so on.
None of these general beliefs can be proved, and indeed some philosophers like to have fun trying to challenge such basic beliefs. In the end, however, except for a handful of lunatics and radical philosophers, people believe these assumptions.
If so, then one can also attach the belief in GOD to the list of basic beliefs, and see in it something that is imprinted in the soul of man.