This paper formally explores the common ground between mild versions of epistemological coherentism and infinitism; it proposes—and argues for—a hybrid, coherentist–infinitist account of epistemic justification. First, the epistemological regress argument and its relation to the classical taxonomy regarding epistemic justification—of foundationalism, infinitism and coherentism—is reviewed. We then recall recent results proving that an influential argument against infinite regresses of justification, which alleges their incoherence on account of probabilistic inconsistency, cannot be maintained. Furthermore, we prove that the Principle of Inferential Justification has rather unwelcome consequences—formally resembling the Sorites paradox—as soon as it is iterated and combined with a natural Bayesian perspective on probabilistic inferences. We conclude that strong versions of foundationalism and infinitism should be abandoned. Positively, we provide a rough sketch for a graded formal coherence notion, according to which infinite regresses of epistemic justification will often have more than a minimal degree of coherence.