Frequency probability Totally Explained

Everything about Frequentism totally explained

Frequency probability is the interpretation of probability that defines an event's probability as the limit of its relative frequency in a large number of trials. The problems and paradoxes of the classical interpretation motivated the development of the relative frequency concept of probability.
Most of the mathematics commonly used to make statistical estimates or tests are developed by statisticians who subscribe to this view of probability. They are usually called frequentists, and their position is called frequentism.
This school is often associated with the names of Jerzy Neyman and Egon Pearson who described the logic of statistical hypothesis testing. Other influential figures of the frequentist school include John Venn, R.A. Fisher, and Richard von Mises.

Definition

Frequentists talk about probabilities only when dealing with well-defined random experiments. The set of all possible outcomes of a random experiment is called the sample space of the experiment. An event is defined as a particular subset of the sample space that you want to consider. For any event only one of two possibilities can happen; it occurs or it doesn't occur. The relative frequency of occurrence of an event, in a number of repetitions of the experiment, is a measure of the probability of that event.
Thus, if

n_t

is the total number of trials and

n_x

is the number of trials where the event

x

occurred, the probability

P(x)

of the event occurring will be approximated by the relative frequency as follows:
ť

P(x) cong frac

One objection to this is that we can only ever observe a finite sequence, and thus the extrapolation to the infinite involves unwarranted metaphysical assumptions. This conflicts with the standard claim that the frequency interpretation is somehow more "objective" than other theories of probability.

Scope

This is a highly technical and scientific definition and doesn't claim to capture all connotations of the concept 'probable' in colloquial speech of natural languages. Compare how the concept of force is used by physicists in a precise manner despite the fact that force is also a concept in many natural languages, used in religious texts for example. However, this seldom causes problems or confusion, as the context usually reveals if it's the scientific concept that's intended or not.
As William Feller noted: ť There is no place in our system for speculations concerning the probability that the sun will rise tomorrow. Before speaking of it we should have to agree on an (idealized) model which would presumably run along the lines "out of infinitely many worlds one is selected at random..." Little imagination is required to construct such a model, but it appears both uninteresting and meaningless.

Etymology

According to the Oxford English Dictionary, the term 'frequentist' was first used by M. G. Kendall (External Link

) in 1949, who observed ť It might be thought that the differences between the frequentists and the non-frequentists (if I may call them such) are largely due to the differences of the domains which they purport to cover. (External Link

).

and went on to say ť I assert that this isn't so ... The essential distinction between the frequentists and the non-frequentists is, I think, that the former, in an effort to avoid anything savouring of matters of opinion, seek to define probability in terms of the objective properties of a population, real or hypothetical, whereas the latter do not. [emphasisin original]

Alternative views

Bayesianism

The main alternative view, Bayesianism is more popular among decision theorists. Frequentists can't assign probabilities to things outside the scope of their definition. In particular, frequentists attribute probabilities only to events while Bayesians apply probabilities to arbitrary statements. For example, if one were to attribute a probability of 1/2 to the proposition that "there was life on Mars a billion years ago" one would violate frequentist canons, because neither an experiment nor a sample space is defined here. However, such degree-of-belief assignments of probability to statements are the basis of Bayesian probability theory.

Further Information

Get more info on 'Frequentism'.

External Link Exchanges

Do you know how hard it is to get a link from a large encyclopaedia? Well we're different and will prove it. To get a link from us just add the following HTML to your site on a relevant page:

<a href="http://frequency_probability.totallyexplained.com">Frequency probability Totally Explained</a>

Then simply click through this link from your web page. Our crawlers will verify your link, extract the title of your web page and instantly add a link back to it. If you like you can remove the words Totally Explained and embed the link in article text.
As long as your link remains in place, we'll keep our link to you right here. Please play fair - our crawlers are watching. Your site must be closely related to this one's topic. Any kind of spamming, dubious practises or removing the link will result in your link from us being dropped and, potentially, your whole site being banned.