If you take the supernatural gods out of the equation then you come to understand that everything MUST have a logical, reasonable, and very natural answer, even if we don't yet know what that answer is yet.
You wrote: "Everything that has a beginning has a cause. We would all agree with that." If you mean something caused something else, then yes. But, you don't get to toss in a magical being and then say, this being didn't have a cause or a beginning. EVERYTHING that ever was, is or will be, must have a beginning.