There is an excellent article by Edward Feser on the false dichotomie of Science and God published by The Witherspoon Institute here
The point for present purposes is just this: From the point of view of the main arguments for God’s existence, it is a mistake to think that the place to look for evidence of God is within the domain investigated by science. Rather, the place to look is somewhere more fundamental—at what any possible science must itself presuppose.
The Rules of the Game
Think of it this way: you can’t find out why checkers boards exist by looking at the rules of checkers themselves, which concern only what goes on within the game. The rules tell you how each piece moves, how the game is won, and so forth. But why are the pieces governed by these rules, specifically, rather than others? Why do any checkers boards exist at all in the first place? No scrutiny of the rules can answer those questions. It is impossible to answer them, or indeed even to understand the questions, unless you take a vantage point from outside the game and its rules.
Similarly, what science uncovers are, in effect, the “rules” that govern the “game” that is the natural world. Its domain of study is what is internal to the natural order of things. It presupposes that there is such an order, just as the rules of checkers presuppose that there are such things as checkers boards and game pieces. For that very reason, though, science has nothing to say about why there is any natural order or laws in the first place, any more than the rules of checkers tell you why there are any checkers boards or checkers rules in the first place.
Thus, science cannot answer the question why there is any world at all, or any laws at all. To answer those questions, or even to understand them properly, you must take an intellectual vantage point from outside the world and its laws, and thus outside of science. You need to look to philosophical argument, which goes deeper than anything mere physics can uncover.
Krauss’s argument is as inept as that of someone who thinks that checkers game boards have no cause, because we can find no reference to such a cause in the rules of checkers. Such a person is looking in the wrong place, just as Krauss is looking in the wrong place when he confines himself to science to find some reason to affirm a divine uncaused cause.