Skip to content
VidiMaster it, module by module
Module 7/Common Distributions

Continuous Distributions: The Uniform and the Standard Normal

These are the first two continuous distributions of the course, and both compute probabilities as areas under a density curve rather than by summing point masses. The continuous uniform distribution X∼Unif(a,b)X\sim\mathrm{Unif}(a,b) (Definition 12.11) spreads probability evenly over an interval [a,b][a,b]: its density is the constant 1b−a\frac{1}{b-a}, so the chance of landing in a subinterval is just its length ratio, P{c≤X≤d}=d−cb−aP\{c\le X\le d\}=\frac{d-c}{b-a}. The standard normal (Gaussian) distribution Z∼N(0,1)Z\sim N(0,1) (Definition 12.12) is the famous bell curve, with density φ(x)=12πe−x2/2\varphi(x)=\frac{1}{\sqrt{2\pi}}e^{-x^2/2} symmetric about 00. Its cumulative distribution function Φ\Phi has no closed form, so we read Φ\Phi from a standard-normal table or technology and assemble every probability from P{a≤Z≤b}=Φ(b)−Φ(a)P\{a\le Z\le b\}=\Phi(b)-\Phi(a) together with the symmetry rule Φ(−x)=1−Φ(x)\Phi(-x)=1-\Phi(x). We close with Example 12.11, computing P(−1≤Z≤1.5)≈0.7745P(-1\le Z\le 1.5)\approx 0.7745, and record the landmark values P(−1≤Z≤1)≈0.683P(-1\le Z\le1)\approx0.683 and P(−2≤Z≤2)≈0.954P(-2\le Z\le2)\approx0.954.

Before you start — give these a try

Attempting first primes your brain for the lesson — even if you miss. Nothing is graded or saved; it's just a warm-up.

Let X∼Unif(0,20)X\sim\mathrm{Unif}(0,20). Find P{5≤X≤11}P\{5\le X\le 11\}. Give your answer as a decimal to 33 places.

True or false: the standard normal distribution N(0,1)N(0,1) is symmetric about 00, and consequently P{Z≤0}=0.5P\{Z\le 0\}=0.5.

What you’ll be able to do

  • State Definition 12.11: a uniform variable X∼Unif(a,b)X\sim\mathrm{Unif}(a,b) has density f(x)=1b−af(x)=\frac{1}{b-a} for a<x<ba<x<b (and 00 outside), with cumulative distribution function F(x)=x−ab−aF(x)=\frac{x-a}{b-a} on a≤x<ba\le x<b.
  • Compute uniform probabilities as length ratios, P{c≤X≤d}=d−cb−aP\{c\le X\le d\}=\frac{d-c}{b-a}, and recognise that P{X=c}=0P\{X=c\}=0 for any single value (so ≤\le and << give the same probability).
  • State Definition 12.12: the standard normal Z∼N(0,1)Z\sim N(0,1) has density φ(x)=12πe−x2/2\varphi(x)=\frac{1}{\sqrt{2\pi}}e^{-x^2/2}, symmetric about 00, with c.d.f. Φ(x)=12π∫−∞xe−s2/2 ds\Phi(x)=\frac{1}{\sqrt{2\pi}}\int_{-\infty}^{x}e^{-s^2/2}\,ds.
  • Use the standard-normal table to evaluate P{a≤Z≤b}=Φ(b)−Φ(a)P\{a\le Z\le b\}=\Phi(b)-\Phi(a), applying the symmetry identity Φ(−x)=1−Φ(x)\Phi(-x)=1-\Phi(x) and the facts Φ(0)=12\Phi(0)=\tfrac12 and Φ(x)→1\Phi(x)\to1 as x→∞x\to\infty.
  • Reproduce Example 12.11 (P(−1≤Z≤1.5)≈0.7745P(-1\le Z\le1.5)\approx0.7745) and the empirical values P(−1≤Z≤1)≈0.683P(-1\le Z\le1)\approx0.683 and P(−2≤Z≤2)≈0.954P(-2\le Z\le2)\approx0.954.

In your course

· MATH2015 · Linear Algebra & Probability
§12.3 Common Probability Distributions
  • Definition 12.11Uniform distribution
    X∼Unif(a,b)X\sim\mathrm{Unif}(a,b) (for a<ba<b) is equally likely over [a,b][a,b]: density f(x)=1b−af(x)=\frac{1}{b-a} on a<x<ba<x<b (else 00), and c.d.f. F(x)=x−ab−aF(x)=\frac{x-a}{b-a} on a≤x<ba\le x<b (with 00 below aa and 11 at or above bb).
  • Definition 12.12Standard normal (Gaussian) distribution
    Z∼N(0,1)Z\sim N(0,1) has density φ(x)=12πe−x2/2\varphi(x)=\frac{1}{\sqrt{2\pi}}e^{-x^2/2} on R\mathbb{R} and c.d.f. Φ(x)=12π∫−∞xe−s2/2 ds\Phi(x)=\frac{1}{\sqrt{2\pi}}\int_{-\infty}^{x}e^{-s^2/2}\,ds, with the symmetry Φ(−x)=1−Φ(x)\Phi(-x)=1-\Phi(x).
  • Example 12.11P(−1≤Z≤1.5)P(-1\le Z\le1.5) via the standard-normal table
    P(−1≤Z≤1.5)=Φ(1.5)−(1−Φ(1))≈0.9332−(1−0.8413)=0.7745P(-1\le Z\le1.5)=\Phi(1.5)-\bigl(1-\Phi(1)\bigr)\approx0.9332-(1-0.8413)=0.7745.
Values of Φ\Phi have no closed form and are read from a standard-normal table or obtained from technology; the parameters 00 and 11 in N(0,1)N(0,1) (the mean and variance) are explained in the next chapter.
1

The continuous uniform distribution on $[a,b]$

A uniform variable X∼Unif(a,b)X\sim\mathrm{Unif}(a,b) models a point dropped completely at random on [a,b][a,b], with no part of the interval favoured over any other (Definition 12.11). Because a continuous variable takes uncountably many values, we cannot give each a positive probability; instead probability is described by a density ff, and the probability of an event is the area under ff over that event. 'Equally likely across [a,b][a,b]' forces ff to be constant there, and for the total area to equal 11 that constant must be the reciprocal of the width: f(x)={1b−a,a<x<b,0,otherwise.f(x)=\begin{cases}\dfrac{1}{b-a},& a<x<b,\\[2pt] 0,&\text{otherwise.}\end{cases} The graph is a rectangle of width b−ab-a and height 1b−a\frac{1}{b-a}, whose area is exactly 11. This generalises the familiar Unif(0,1)\mathrm{Unif}(0,1) (height 11 on [0,1][0,1]) to any interval. Note that the density value 1b−a\frac{1}{b-a} is not a probability and may even exceed 11 on a short interval; only areas are probabilities.

2

Uniform probabilities are length ratios, and single points have probability zero

For a uniform variable the area over a subinterval [c,d]⊆[a,b][c,d]\subseteq[a,b] is a rectangle of height 1b−a\frac{1}{b-a} and width d−cd-c, so P{c≤X≤d}=d−cb−a,P\{c\le X\le d\}=\frac{d-c}{b-a}, the fraction of the interval's length that [c,d][c,d] occupies. The c.d.f. accumulates this area from the left: F(x)=P{X≤x}=0F(x)=P\{X\le x\}=0 for x<ax<a, rises linearly as F(x)=x−ab−aF(x)=\frac{x-a}{b-a} for a≤x<ba\le x<b, and equals 11 for x≥bx\ge b; indeed P{c≤X≤d}=F(d)−F(c)=d−cb−aP\{c\le X\le d\}=F(d)-F(c)=\frac{d-c}{b-a}. A defining feature of every continuous distribution appears here: a single point has zero width, so P{X=c}=0.P\{X=c\}=0. Consequently the endpoints never matter, P{c≤X≤d}=P{c<X<d}P\{c\le X\le d\}=P\{c<X<d\}, a convenience we exploit throughout.

3

The standard normal distribution $N(0,1)$

The standard normal (or Gaussian) variable Z∼N(0,1)Z\sim N(0,1) (Definition 12.12) has the bell-shaped density φ(x)=12π e−x2/2,x∈R.\varphi(x)=\frac{1}{\sqrt{2\pi}}\,e^{-x^2/2},\qquad x\in\mathbb{R}. Several features are visible in the formula. It is symmetric about 00, since φ(−x)=φ(x)\varphi(-x)=\varphi(x) (the exponent depends only on x2x^2); it peaks at x=0x=0 with height 12π≈0.399\frac{1}{\sqrt{2\pi}}\approx0.399; and it decays extremely fast in both tails because of the e−x2/2e^{-x^2/2} factor, yet stays strictly positive for every real xx. The constant 12π\frac{1}{\sqrt{2\pi}} is the normalising factor that makes the total area equal 11. Unlike the uniform, the normal spreads probability over the whole real line, concentrating it near 00. The meaning of the parameters 00 and 11 (the mean and variance) is taken up in the next chapter; for now, N(0,1)N(0,1) is simply the standard bell curve.

4

The standard normal c.d.f. $\Phi$ and its symmetry

Probabilities for ZZ come from its cumulative distribution function Φ(x)=P{Z≤x}=12π∫−∞xe−s2/2 ds,\Phi(x)=P\{Z\le x\}=\frac{1}{\sqrt{2\pi}}\int_{-\infty}^{x}e^{-s^2/2}\,ds, the area under the bell curve to the left of xx. This integral has no closed-form antiderivative, so values of Φ\Phi are obtained from a standard-normal table or from technology, never by elementary integration. Three facts make the table go a long way. First, any interval probability is a difference, P{a≤Z≤b}=Φ(b)−Φ(a)P\{a\le Z\le b\}=\Phi(b)-\Phi(a). Second, by symmetry of φ\varphi about 00, Φ(−x)=1−Φ(x),\Phi(-x)=1-\Phi(x), so a table listing only positive xx covers negative arguments too; in particular Φ(0)=12\Phi(0)=\tfrac12, i.e. P{Z≤0}=0.5P\{Z\le0\}=0.5. Third, Φ(x)→1\Phi(x)\to1 as x→+∞x\to+\infty and Φ(x)→0\Phi(x)\to0 as x→−∞x\to-\infty. Together these yield the landmark values P(−1≤Z≤1)≈0.683P(-1\le Z\le1)\approx0.683 and P(−2≤Z≤2)≈0.954P(-2\le Z\le2)\approx0.954.

Definition 12.11 — Uniform distribution

Let a<ba<b. A random variable XX has the uniform distribution on [a,b][a,b], written X∼Unif(a,b)X\sim\mathrm{Unif}(a,b), if it is equally likely to take any value in that interval. Its probability density function is f(x)=1b−af(x)=\frac{1}{b-a} for a<x<ba<x<b and f(x)=0f(x)=0 otherwise, and its cumulative distribution function is F(x)={0,x<a,x−ab−a,a≤x<b,1,x≥b.F(x)=\begin{cases}0,& x<a,\\[2pt] \dfrac{x-a}{b-a},& a\le x<b,\\[2pt] 1,& x\ge b.\end{cases}

Intuition. 'Equally likely across [a,b][a,b]' means the density must be flat, and the one height that makes the rectangle's area equal 11 is 1b−a\frac{1}{b-a}. The c.d.f. is the accumulated area from the left: zero until aa, a straight ramp of slope 1b−a\frac{1}{b-a} across [a,b][a,b], and flat at 11 once the whole interval has been passed.
Definition 12.12 — Standard normal (Gaussian) distribution

A random variable ZZ has the standard normal distribution, written Z∼N(0,1)Z\sim N(0,1), if it has density φ(x)=12π e−x2/2,x∈R.\varphi(x)=\frac{1}{\sqrt{2\pi}}\,e^{-x^2/2},\qquad x\in\mathbb{R}. Its cumulative distribution function is Φ(x)=12π∫−∞xe−s2/2 ds\Phi(x)=\frac{1}{\sqrt{2\pi}}\int_{-\infty}^{x}e^{-s^2/2}\,ds, which has no closed-form expression and is evaluated from tables or technology.

Intuition. The density depends on xx only through x2x^2, so it is a symmetric bell centred at 00: highest in the middle and vanishing quickly in the tails, with the 12π\frac{1}{\sqrt{2\pi}} out front providing exactly the area 11. Because the antiderivative of e−x2/2e^{-x^2/2} is not elementary, Φ\Phi must be looked up rather than integrated by hand.
Symmetry of the standard normal c.d.f.

For Z∼N(0,1)Z\sim N(0,1) the c.d.f. satisfies Φ(−x)=1−Φ(x)\Phi(-x)=1-\Phi(x) for every real xx. In particular Φ(0)=12\Phi(0)=\tfrac12 (so P{Z≤0}=12P\{Z\le0\}=\tfrac12), while Φ(x)→1\Phi(x)\to1 as x→+∞x\to+\infty and Φ(x)→0\Phi(x)\to0 as x→−∞x\to-\infty.

Intuition. The bell curve is a mirror image about the vertical axis, so the area to the left of −x-x equals the area to the right of +x+x, namely 1−Φ(x)1-\Phi(x). This single identity lets a table of non-negative arguments handle negative ones, and it pins the centre at Φ(0)=12\Phi(0)=\tfrac12.
Interval probabilities for continuous distributions

For a continuous random variable, P{X=c}=0P\{X=c\}=0 for any single value cc, so ≤\le and << may be used interchangeably. For X∼Unif(a,b)X\sim\mathrm{Unif}(a,b) with a≤c≤d≤ba\le c\le d\le b, P{c≤X≤d}=F(d)−F(c)=d−cb−a.P\{c\le X\le d\}=F(d)-F(c)=\frac{d-c}{b-a}. For Z∼N(0,1)Z\sim N(0,1), P{a≤Z≤b}=Φ(b)−Φ(a)P\{a\le Z\le b\}=\Phi(b)-\Phi(a).

Intuition. A probability over an interval is the area under the density there, which the c.d.f. delivers as a difference F(right)−F(left)F(\text{right})-F(\text{left}). A single point spans zero width, hence zero area and zero probability. For the uniform this difference is a length ratio; for the normal it is a difference of table values of Φ\Phi.

Worked examples

Example 1

A uniform variable. Let X∼Unif(2,10)X\sim\mathrm{Unif}(2,10). Find (a) the value of the density f(x)f(x) on the interval, (b) P{4≤X≤7}P\{4\le X\le 7\}, and (c) P{X=5}P\{X=5\}.

  1. 1

    Identify aa and bb. Here a=2a=2 and b=10b=10, so the width of the interval is b−a=10−2=8b-a=10-2=8.

  2. 2

    (a) Density value (Definition 12.11). On 2<x<102<x<10 the density is the constant f(x)=1b−a=18=0.125f(x)=\frac{1}{b-a}=\frac{1}{8}=0.125 (and f(x)=0f(x)=0 outside). This is a density, not a probability.

  3. 3

    (b) Interval probability as a length ratio. P{4≤X≤7}=d−cb−a=7−410−2=38=0.375P\{4\le X\le 7\}=\frac{d-c}{b-a}=\frac{7-4}{10-2}=\frac{3}{8}=0.375. Equivalently, it is the rectangle of height 18\frac18 and width 33.

  4. 4

    (c) A single point. Since XX is continuous, a single value has zero width and hence zero area: P{X=5}=0P\{X=5\}=0. (So P{4≤X≤7}=P{4<X<7}P\{4\le X\le7\}=P\{4<X<7\}.)

Answer. (a) f(x)=18=0.125f(x)=\frac18=0.125 on (2,10)(2,10); (b) P{4≤X≤7}=38=0.375P\{4\le X\le7\}=\frac38=0.375; (c) P{X=5}=0P\{X=5\}=0.
Example 2

Example 12.11. Let Z∼N(0,1)Z\sim N(0,1). Find P(−1≤Z≤1.5)P(-1\le Z\le 1.5) using the standard-normal c.d.f. Φ\Phi.

Example 3

The one-sigma probability. Let Z∼N(0,1)Z\sim N(0,1). Express P(−1≤Z≤1)P(-1\le Z\le1) in terms of Φ(1)\Phi(1) and give its decimal value.