Well, basic and simple kinda sums your post up really.
That isn't an atheist's "starting point". In that essence, someone who doesn't believe in the likelihood of a deity isn't 'rejecting the existence of the creator', they don't believe that it's likely that there's one to reject.
I could...