Infinite Regress
Plato in the Theatetus (200D-201C) defined knowledge as justified true belief. Justification was providing some reasons (λόγος or συλλογισμῶ), a rational explanation for the belief. True opinion accompanied by reason is knowledge. (δόξαν ἀληθῆ μετὰ λόγου ἐπιστήμην εἶναι) (202C)

The infinite regress arises when we ask what are the justifications for the reasons themselves.

If the reasons count as knowledge, they must be justified with reasons for the reasons.

The problem of the infinite regress was a critical argument of the Skeptics in ancient philosophy.

Sextus Empiricus tells us there are two basic Pyrrhonian modes or tropes that lead the skeptic to suspension of judgment (ἐποχῆ):

They [skeptics] hand down also two other modes leading to suspension of judgement. Since every object of apprehension seems to be apprehended either through itself or through another object, by showing that nothing is apprehended either through itself or through another thing, they introduce doubt, as they suppose, about everything. That nothing is apprehended through itself is plain, they say, from the controversy which exists amongst the physicists regarding, I imagine, all things, both sensibles and intelligibles; which controversy admits of no settlement because we can neither employ a sensible nor an intelligible criterion, since every criterion we may adopt is controverted and therefore discredited.

And the reason why they do not allow that anything is apprehended through something else is this: If that through which an object is apprehended must always itself be apprehended through some other thing, one is involved in a process of circular reasoning or in regress ad infinitum. And if, on the other hand, one should choose to assume that the thing through which another object is apprehended is itself apprehended through itself, this is refuted by the fact that, for the reasons already stated, nothing is apprehended through itself. But as to how what conflicts with itself can possibly be apprehended either through itself or through some other thing we remain in doubt, so long as the criterion of truth or of apprehension is not apparent, and signs, even apart from demonstration, are rejected.
(Outlines of Pyrrhonism, Loeb Library, R.G.Bury tr., 1.178-79)

The skeptic can always ask a philosopher for justifying reasons. When those reasons are given, he can demand their justification, and this in turn leads to an infinite regress of justifications.

The endless controversy and disagreement of all philosophers cautions us against accepting any of their arguments as knowledge.

Second only to Kant 's "scandal" that philosophers cannot logically prove the existence of the external world, it is scandalous that professional philosophers to this day are in such profound disagreement about what it means to know something.

Epistemologists may not all be wrong, but how many of them are likely to be right?

This is especially dismaying for those epistemologists who still see a normative role for philosophy that could provide a foundation, perhaps even a priori, for scientific or empirical a posteriori knowledge.

In recent years, professional epistemologists have been reduced to quibbling over "Gettier problems" - clever sophistical examples and counterexamples that defeat the reasoned justifications for true beliefs.

Following some unpublished work of Gregory O'Hair, David Armstrong identifies and diagrams several possible ways to escape Plato's infinite regress, including:

For Teachers
For Scholars

Chapter 3.7 - The Ergod Chapter 4.2 - The History of the Knowledge Problem
Part Three - Value Part Five - Problems