Fourier transform

From Wikipedia the free encyclopedia

An example application of the Fourier transform is determining the constituent pitches in a musical waveform. This image is the result of applying a constant-Q transform (a Fourier-related transform) to the waveform of a C major piano chord. The first three peaks on the left correspond to the frequencies of the fundamental frequency of the chord (C, E, G). The remaining smaller peaks are higher-frequency overtones of the fundamental pitches. A pitch detection algorithm could use the relative intensity of these peaks to infer which notes the pianist pressed.

In mathematics, the Fourier transform (FT) is an integral transform that takes a function as input then outputs another function that describes the extent to which various frequencies are present in the original function. The output of the transform is a complex-valued function of frequency. The term Fourier transform refers to both this complex-valued function and the mathematical operation. When a distinction needs to be made, the output of the operation is sometimes called the frequency domain representation of the original function. The Fourier transform is analogous to decomposing the sound of a musical chord into the intensities of its constituent pitches.

The Fourier transform relates the time domain, in red, with a function in the domain of the frequency, in blue. The component frequencies, extended for the whole frequency spectrum, are shown as peaks in the domain of the frequency.

Functions that are localized in the time domain have Fourier transforms that are spread out across the frequency domain and vice versa, a phenomenon known as the uncertainty principle. The critical case for this principle is the Gaussian function, of substantial importance in probability theory and statistics as well as in the study of physical phenomena exhibiting normal distribution (e.g., diffusion). The Fourier transform of a Gaussian function is another Gaussian function. Joseph Fourier introduced sine and cosine transforms (which correspond to the imaginary and real components of the modern Fourier transform) in his study of heat transfer, where Gaussian functions appear as solutions of the heat equation.

The Fourier transform can be formally defined as an improper Riemann integral, making it an integral transform, although this definition is not suitable for many applications requiring a more sophisticated integration theory.[note 1] For example, many relatively simple applications use the Dirac delta function, which can be treated formally as if it were a function, but the justification requires a mathematically more sophisticated viewpoint.[note 2]

The Fourier transform can also be generalized to functions of several variables on Euclidean space, sending a function of 3-dimensional 'position space' to a function of 3-dimensional momentum (or a function of space and time to a function of 4-momentum). This idea makes the spatial Fourier transform very natural in the study of waves, as well as in quantum mechanics, where it is important to be able to represent wave solutions as functions of either position or momentum and sometimes both. In general, functions to which Fourier methods are applicable are complex-valued, and possibly vector-valued.[note 3] Still further generalization is possible to functions on groups, which, besides the original Fourier transform on R or Rn, notably includes the discrete-time Fourier transform (DTFT, group = Z), the discrete Fourier transform (DFT, group = Z mod N) and the Fourier series or circular Fourier transform (group = S1, the unit circle ≈ closed finite interval with endpoints identified). The latter is routinely employed to handle periodic functions. The fast Fourier transform (FFT) is an algorithm for computing the DFT.

Definition

[edit]

The Fourier transform of a complex-valued (Lebesgue) integrable function on the real line, is the complex valued function , defined by the integral[1]

Fourier transform

Evaluating the Fourier transform for all values of produces the frequency-domain function, and it converges at all frequencies to a continuous function tending to zero at infinity. If decays with all derivatives, i.e., then converges for all frequencies and, by the Riemann–Lebesgue lemma, also decays with all derivatives.

First introduced in Fourier's Analytical Theory of Heat.,[2][3][4][5] the corresponding inversion formula for "sufficiently nice" functions is given by the Fourier inversion theorem, i.e.,

Inverse transform

The functions and are referred to as a Fourier transform pair.[6]  A common notation for designating transform pairs is:[7]   for example  

By analogy, the Fourier series can be regarded as an abstract Fourier transform on the group of integers. That is, the synthesis of a sequence of complex numbers is defined by the Fourier transform such that are given by the inversion formula, i.e., the analysis for some complex-valued, -periodic function defined on a bounded interval . When the constituent frequencies are a continuum: [8][9][10] and .[11]

In other words, on the finite interval the function has a discrete decomposition in the periodic functions . On the infinite interval the function has a continuous decomposition in periodic functions .

Lebesgue integrable functions

[edit]

A measurable function is called (Lebesgue) integrable if the Lebesgue integral of its absolute value is finite: If is Lebesgue integrable then the Fourier transform, given by Eq.1, is well-defined for all .[12] Furthermore, is bounded, uniformly continuous and (by the Riemann–Lebesgue lemma) zero at infinity.

The space is the space of measurable functions for which the norm is finite, modulo the equivalence relation of equality almost everywhere. The Fourier transform on is one-to-one. However, there is no easy characterization of the image, and thus no easy characterization of the inverse transform. In particular, Eq.2 is no longer valid, as it was stated only under the hypothesis that decayed with all derivatives.

While Eq.1 defines the Fourier transform for (complex-valued) functions in , it is not well-defined for other integrability classes, most importantly the space of square-integrable functions . For example, the function is in but not and therefore the Lebesgue integral Eq.1 does not exist. However, the Fourier transform on the dense subspace admits a unique continuous extension to a unitary operator on . This extension is important in part because, unlike the case of , the Fourier transform is an automorphism of the space .

In such cases, the Fourier transform can be obtained explicitly by regularizing the integral, and then passing to a limit. In practice, the integral is often regarded as an improper integral instead of a proper Lebesgue integral, but sometimes for convergence one needs to use weak limit or principal value instead of the (pointwise) limits implicit in an improper integral. Titchmarsh (1986) and Dym & McKean (1985) each gives three rigorous ways of extending the Fourier transform to square integrable functions using this procedure. A general principle in working with the Fourier transform is that Gaussians are dense in , and the various features of the Fourier transform, such as its unitarity, are easily inferred for Gaussians. Many of the properties of the Fourier transform, can then be proven from two facts about Gaussians:[13]

  • that is its own Fourier transform; and
  • that the Gaussian integral

A feature of the Fourier transform is that it is a homomorphism of Banach algebras from equipped with the convolution operation to the Banach algebra of continuous functions under the (supremum) norm. The conventions chosen in this article are those of harmonic analysis, and are characterized as the unique conventions such that the Fourier transform is both unitary on L2 and an algebra homomorphism from L1 to L, without renormalizing the Lebesgue measure.[14]

Angular frequency (ω)

[edit]

When the independent variable () represents time (often denoted by ), the transform variable () represents frequency (often denoted by ). For example, if time is measured in seconds, then frequency is in hertz. The Fourier transform can also be written in terms of angular frequency, whose units are radians per second.

The substitution into Eq.1 produces this convention, where function is relabeled Unlike the Eq.1 definition, the Fourier transform is no longer a unitary transformation, and there is less symmetry between the formulas for the transform and its inverse. Those properties are restored by splitting the factor evenly between the transform and its inverse, which leads to another convention: Variations of all three conventions can be created by conjugating the complex-exponential kernel of both the forward and the reverse transform. The signs must be opposites.

Summary of popular forms of the Fourier transform, one-dimensional
ordinary frequency ξ (Hz) unitary
angular frequency ω (rad/s) unitary
non-unitary
Generalization for n-dimensional functions
ordinary frequency ξ (Hz) unitary
angular frequency ω (rad/s) unitary
non-unitary

Background

[edit]

History

[edit]

In 1822, Fourier claimed (see Joseph Fourier § The Analytic Theory of Heat) that any function, whether continuous or discontinuous, can be expanded into a series of sines.[15] That important work was corrected and expanded upon by others to provide the foundation for the various forms of the Fourier transform used since.

Complex sinusoids

[edit]
The red sinusoid can be described by peak amplitude (1), peak-to-peak (2), RMS (3), and wavelength (4). The red and blue sinusoids have a phase difference of θ.

In general, the coefficients are complex numbers, which have two equivalent forms (see Euler's formula):

The product with (Eq.2) has these forms: which conveys both amplitude and phase of frequency Likewise, the intuitive interpretation of Eq.1 is that multiplying by has the effect of subtracting from every frequency component of function [note 4] Only the component that was at frequency can produce a non-zero value of the infinite integral, because (at least formally) all the other shifted components are oscillatory and integrate to zero. (see § Example)

It is noteworthy how easily the product was simplified using the polar form, and how easily the rectangular form was deduced by an application of Euler's formula.

Negative frequency

[edit]

Euler's formula introduces the possibility of negative   And Eq.1 is defined Only certain complex-valued have transforms (See Analytic signal. A simple example is )  But negative frequency is necessary to characterize all other complex-valued found in signal processing, partial differential equations, radar, nonlinear optics, quantum mechanics, and others.

For a real-valued Eq.1 has the symmetry property (see § Conjugation below). This redundancy enables Eq.2 to distinguish from   But of course it cannot tell us the actual sign of because and are indistinguishable on just the real numbers line.

Fourier transform for periodic functions

[edit]

The Fourier transform of a periodic function cannot be defined using the integral formula directly. In order for integral in Eq.1 to be defined the function must be absolutely integrable. Instead it is common to use Fourier series. It is possible to extend the definition to include periodic functions by viewing them as tempered distributions.

This makes it possible to see a connection between the Fourier series and the Fourier transform for periodic functions that have a convergent Fourier series. If is a periodic function, with period , that has a convergent Fourier series, then: where are the Fourier series coefficients of , and is the Dirac delta function. In other words, the Fourier transform is a Dirac comb function whose teeth are multiplied by the Fourier series coefficients.

Sampling the Fourier transform

[edit]

The Fourier transform of an integrable function can be sampled at regular intervals of arbitrary length These samples can be deduced from one cycle of a periodic function which has Fourier series coefficients proportional to those samples by the Poisson summation formula:

The integrability of ensures the periodic summation converges. Therefore, the samples can be determined by Fourier series analysis:

When has compact support, has a finite number of terms within the interval of integration. When does not have compact support, numerical evaluation of requires an approximation, such as tapering or truncating the number of terms.

Units

[edit]

The frequency variable must have inverse units to the units of the original function's domain (typically named or ). For example, if is measured in seconds, should be in cycles per second or hertz. If the scale of time is in units of seconds, then another Greek letter is typically used instead to represent angular frequency (where ) in units of radians per second. If using for units of length, then must be in inverse length, e.g., wavenumbers. That is to say, there are two versions of the real line: one which is the range of and measured in units of and the other which is the range of and measured in inverse units to the units of These two distinct versions of the real line cannot be equated with each other. Therefore, the Fourier transform goes from one space of functions to a different space of functions: functions which have a different domain of definition.

In general, must always be taken to be a linear form on the space of its domain, which is to say that the second real line is the dual space of the first real line. See the article on linear algebra for a more formal explanation and for more details. This point of view becomes essential in generalizations of the Fourier transform to general symmetry groups, including the case of Fourier series.

That there is no one preferred way (often, one says "no canonical way") to compare the two versions of the real line which are involved in the Fourier transform—fixing the units on one line does not force the scale of the units on the other line—is the reason for the plethora of rival conventions on the definition of the Fourier transform. The various definitions resulting from different choices of units differ by various constants.

In other conventions, the Fourier transform has i in the exponent instead of i, and vice versa for the inversion formula. This convention is common in modern physics[16] and is the default for Wolfram Alpha, and does not mean that the frequency has become negative, since there is no canonical definition of positivity for frequency of a complex wave. It simply means that is the amplitude of the wave    instead of the wave   (the former, with its minus sign, is often seen in the time dependence for Sinusoidal plane-wave solutions of the electromagnetic wave equation, or in the time dependence for quantum wave functions). Many of the identities involving the Fourier transform remain valid in those conventions, provided all terms that explicitly involve i have it replaced by i. In Electrical engineering the letter j is typically used for the imaginary unit instead of i because i is used for current.

When using dimensionless units, the constant factors might not even be written in the transform definition. For instance, in probability theory, the characteristic function Φ of the probability density function f of a random variable X of continuous type is defined without a negative sign in the exponential, and since the units of x are ignored, there is no 2π either:

(In probability theory, and in mathematical statistics, the use of the Fourier—Stieltjes transform is preferred, because so many random variables are not of continuous type, and do not possess a density function, and one must treat not functions but distributions, i.e., measures which possess "atoms".)

From the higher point of view of group characters, which is much more abstract, all these arbitrary choices disappear, as will be explained in the later section of this article, which treats the notion of the Fourier transform of a function on a locally compact Abelian group.

Properties

[edit]

Let and represent integrable functions Lebesgue-measurable on the real line satisfying: We denote the Fourier transforms of these functions as and respectively.

Basic properties

[edit]

The Fourier transform has the following basic properties:[17]

Linearity

[edit]

Time shifting

[edit]

Frequency shifting

[edit]

Time scaling

[edit]

The case leads to the time-reversal property:

The transform of an even-symmetric real-valued function is also an even-symmetric real-valued function The time-shift, creates an imaginary component, (see § Symmetry.

Symmetry

[edit]

When the real and imaginary parts of a complex function are decomposed into their even and odd parts, there are four components, denoted below by the subscripts RE, RO, IE, and IO. And there is a one-to-one mapping between the four components of a complex time function and the four components of its complex frequency transform:[18]

From this, various relationships are apparent, for example:

  • The transform of a real-valued function is the conjugate symmetric function Conversely, a conjugate symmetric transform implies a real-valued time-domain.
  • The transform of an imaginary-valued function is the conjugate antisymmetric function and the converse is true.
  • The transform of a conjugate symmetric function is the real-valued function and the converse is true.
  • The transform of a conjugate antisymmetric function is the imaginary-valued function and the converse is true.

Conjugation

[edit]

(Note: the ∗ denotes complex conjugation.)

In particular, if is real, then is even symmetric (aka Hermitian function):

And if is purely imaginary, then is odd symmetric:

Real and imaginary parts

[edit]

Zero frequency component

[edit]

Substituting in the definition, we obtain:

The integral of over its domain is known as the average value or DC bias of the function.

Uniform continuity and the Riemann–Lebesgue lemma

[edit]
The rectangular function is Lebesgue integrable.
The sinc function, which is the Fourier transform of the rectangular function, is bounded and continuous, but not Lebesgue integrable.

The Fourier transform may be defined in some cases for non-integrable functions, but the Fourier transforms of integrable functions have several strong properties.

The Fourier transform of any integrable function is uniformly continuous and[19][20]

By the Riemann–Lebesgue lemma,[21]

However, need not be integrable. For example, the Fourier transform of the rectangular function, which is integrable, is the sinc function, which is not Lebesgue integrable, because its improper integrals behave analogously to the alternating harmonic series, in converging to a sum without being absolutely convergent.

It is not generally possible to write the inverse transform as a Lebesgue integral. However, when both and are integrable, the inverse equality holds for almost every x. As a result, the Fourier transform is injective on L1(R).

Plancherel theorem and Parseval's theorem

[edit]

Let f(x) and g(x) be integrable, and let (ξ) and ĝ(ξ) be their Fourier transforms. If f(x) and g(x) are also square-integrable, then the Parseval formula follows:[22] where the bar denotes complex conjugation.

The Plancherel theorem, which follows from the above, states that[23]

Plancherel's theorem makes it possible to extend the Fourier transform, by a continuity argument, to a unitary operator on L2(R). On L1(R) ∩ L2(R), this extension agrees with original Fourier transform defined on L1(R), thus enlarging the domain of the Fourier transform to L1(R) + L2(R) (and consequently to Lp(R) for 1 ≤ p ≤ 2). Plancherel's theorem has the interpretation in the sciences that the Fourier transform preserves the energy of the original quantity. The terminology of these formulas is not quite standardised. Parseval's theorem was proved only for Fourier series, and was first proved by Lyapunov. But Parseval's formula makes sense for the Fourier transform as well, and so even though in the context of the Fourier transform it was proved by Plancherel, it is still often referred to as Parseval's formula, or Parseval's relation, or even Parseval's theorem.

See Pontryagin duality for a general formulation of this concept in the context of locally compact abelian groups.

Convolution theorem

[edit]

The Fourier transform translates between convolution and multiplication of functions. If f(x) and g(x) are integrable functions with Fourier transforms (ξ) and ĝ(ξ) respectively, then the Fourier transform of the convolution is given by the product of the Fourier transforms (ξ) and ĝ(ξ) (under other conventions for the definition of the Fourier transform a constant factor may appear).

This means that if: where denotes the convolution operation, then:

In linear time invariant (LTI) system theory, it is common to interpret g(x) as the impulse response of an LTI system with input f(x) and output h(x), since substituting the unit impulse for f(x) yields h(x) = g(x). In this case, ĝ(ξ) represents the frequency response of the system.

Conversely, if f(x) can be decomposed as the product of two square integrable functions p(x) and q(x), then the Fourier transform of f(x) is given by the convolution of the respective Fourier transforms (ξ) and (ξ).

Cross-correlation theorem

[edit]

In an analogous manner, it can be shown that if h(x) is the cross-correlation of f(x) and g(x): then the Fourier transform of h(x) is:

As a special case, the autocorrelation of function f(x) is: for which

Differentiation

[edit]

Suppose f(x) is an absolutely continuous differentiable function, and both f and its derivative f′ are integrable. Then the Fourier transform of the derivative is given by More generally, the Fourier transformation of the nth derivative f(n) is given by

Analogously, , so

By applying the Fourier transform and using these formulas, some ordinary differential equations can be transformed into algebraic equations, which are much easier to solve. These formulas also give rise to the rule of thumb "f(x) is smooth if and only if (ξ) quickly falls to 0 for |ξ| → ∞." By using the analogous rules for the inverse Fourier transform, one can also say "f(x) quickly falls to 0 for |x| → ∞ if and only if (ξ) is smooth."

Eigenfunctions

[edit]

The Fourier transform is a linear transform which has eigenfunctions obeying with

A set of eigenfunctions is found by noting that the homogeneous differential equation leads to eigenfunctions of the Fourier transform as long as the form of the equation remains invariant under Fourier transform.[note 5] In other words, every solution and its Fourier transform obey the same equation. Assuming uniqueness of the solutions, every solution must therefore be an eigenfunction of the Fourier transform. The form of the equation remains unchanged under Fourier transform if can be expanded in a power series in which for all terms the same factor of either one of arises from the factors introduced by the differentiation rules upon Fourier transforming the homogeneous differential equation because this factor may then be cancelled. The simplest allowable leads to the standard normal distribution.[24]

More generally, a set of eigenfunctions is also found by noting that the differentiation rules imply that the ordinary differential equation with constant and being a non-constant even function remains invariant in form when applying the Fourier transform to both sides of the equation. The simplest example is provided by which is equivalent to considering the Schrödinger equation for the quantum harmonic oscillator.[25] The corresponding solutions provide an important choice of an orthonormal basis for L2(R) and are given by the "physicist's" Hermite functions. Equivalently one may use where Hen(x) are the "probabilist's" Hermite polynomials, defined as

Under this convention for the Fourier transform, we have that

In other words, the Hermite functions form a complete orthonormal system of eigenfunctions for the Fourier transform on L2(R).[17][26] However, this choice of eigenfunctions is not unique. Because of there are only four different eigenvalues of the Fourier transform (the fourth roots of unity ±1 and ±i) and any linear combination of eigenfunctions with the same eigenvalue gives another eigenfunction.[27] As a consequence of this, it is possible to decompose L2(R) as a direct sum of four spaces H0, H1, H2, and H3 where the Fourier transform acts on Hek simply by multiplication by ik.

Since the complete set of Hermite functions ψn provides a resolution of the identity they diagonalize the Fourier operator, i.e. the Fourier transform can be represented by such a sum of terms weighted by the above eigenvalues, and these sums can be explicitly summed:

This approach to define the Fourier transform was first proposed by Norbert Wiener.[28] Among other properties, Hermite functions decrease exponentially fast in both frequency and time domains, and they are thus used to define a generalization of the Fourier transform, namely the fractional Fourier transform used in time–frequency analysis.[29] In physics, this transform was introduced by Edward Condon.[30] This change of basis functions becomes possible because the Fourier transform is a unitary transform when using the right conventions. Consequently, under the proper conditions it may be expected to result from a self-adjoint generator via[31]

The operator is the number operator of the quantum harmonic oscillator written as[32][33]

It can be interpreted as the generator of fractional Fourier transforms for arbitrary values of t, and of the conventional continuous Fourier transform for the particular value with the Mehler kernel implementing the corresponding active transform. The eigenfunctions of are the Hermite functions which are therefore also eigenfunctions of

Upon extending the Fourier transform to distributions the Dirac comb is also an eigenfunction of the Fourier transform.

Inversion and periodicity

[edit]

Under suitable conditions on the function , it can be recovered from its Fourier transform . Indeed, denoting the Fourier transform operator by , so , then for suitable functions, applying the Fourier transform twice simply flips the function: , which can be interpreted as "reversing time". Since reversing time is two-periodic, applying this twice yields , so the Fourier transform operator is four-periodic, and similarly the inverse Fourier transform can be obtained by applying the Fourier transform three times: . In particular the Fourier transform is invertible (under suitable conditions).

More precisely, defining the parity operator such that , we have: These equalities of operators require careful definition of the space of functions in question, defining equality of functions (equality at every point? equality almost everywhere?) and defining equality of operators – that is, defining the topology on the function space and operator space in question. These are not true for all functions, but are true under various conditions, which are the content of the various forms of the Fourier inversion theorem.

This fourfold periodicity of the Fourier transform is similar to a rotation of the plane by 90°, particularly as the two-fold iteration yields a reversal, and in fact this analogy can be made precise. While the Fourier transform can simply be interpreted as switching the time domain and the frequency domain, with the inverse Fourier transform switching them back, more geometrically it can be interpreted as a rotation by 90° in the time–frequency domain (considering time as the x-axis and frequency as the y-axis), and the Fourier transform can be generalized to the fractional Fourier transform, which involves rotations by other angles. This can be further generalized to linear canonical transformations, which can be visualized as the action of the special linear group SL2(R) on the time–frequency plane, with the preserved symplectic form corresponding to the uncertainty principle, below. This approach is particularly studied in signal processing, under time–frequency analysis.

Connection with the Heisenberg group

[edit]

The Heisenberg group is a certain group of unitary operators on the Hilbert space L2(R) of square integrable complex valued functions f on the real line, generated by the translations (Ty f)(x) = f (x + y) and multiplication by eiξx, (Mξ f)(x) = eiξx f (x). These operators do not commute, as their (group) commutator is which is multiplication by the constant (independent of x) eiξyU(1) (the circle group of unit modulus complex numbers). As an abstract group, the Heisenberg group is the three-dimensional Lie group of triples (x, ξ, z) ∈ R2 × U(1), with the group law

Denote the Heisenberg group by H1. The above procedure describes not only the group structure, but also a standard unitary representation of H1 on a Hilbert space, which we denote by ρ : H1B(L2(R)). Define the linear automorphism of R2 by so that J2 = −I. This J can be extended to a unique automorphism of H1:

According to the Stone–von Neumann theorem, the unitary representations ρ and ρj are unitarily equivalent, so there is a unique intertwiner WU(L2(R)) such that This operator W is the Fourier transform.

Many of the standard properties of the Fourier transform are immediate consequences of this more general framework.[34] For example, the square of the Fourier transform, W2, is an intertwiner associated with J2 = −I, and so we have (W2f)(x) = f (−x) is the reflection of the original function f.

Complex domain

[edit]

The integral for the Fourier transform can be studied for complex values of its argument ξ. Depending on the properties of f, this might not converge off the real axis at all, or it might converge to a complex analytic function for all values of ξ = σ + , or something in between.[35]

The Paley–Wiener theorem says that f is smooth (i.e., n-times differentiable for all positive integers n) and compactly supported if and only if (σ + ) is a holomorphic function for which there exists a constant a > 0 such that for any integer n ≥ 0, for some constant C. (In this case, f is supported on [−a, a].) This can be expressed by saying that is an entire function which is rapidly decreasing in σ (for fixed τ) and of exponential growth in τ (uniformly in σ).[36]

(If f is not smooth, but only L2, the statement still holds provided n = 0.[37]) The space of such functions of a complex variable is called the Paley—Wiener space. This theorem has been generalised to semisimple Lie groups.[38]

If f is supported on the half-line t ≥ 0, then f is said to be "causal" because the impulse response function of a physically realisable filter must have this property, as no effect can precede its cause. Paley and Wiener showed that then extends to a holomorphic function on the complex lower half-plane τ < 0 which tends to zero as τ goes to infinity.[39] The converse is false and it is not known how to characterise the Fourier transform of a causal function.[40]

Laplace transform

[edit]

The Fourier transform (ξ) is related to the Laplace transform F(s), which is also used for the solution of differential equations and the analysis of filters.

It may happen that a function f for which the Fourier integral does not converge on the real axis at all, nevertheless has a complex Fourier transform defined in some region of the complex plane.

For example, if f(t) is of exponential growth, i.e., for some constants C, a ≥ 0, then[41] convergent for all τ < −a, is the two-sided Laplace transform of f.

The more usual version ("one-sided") of the Laplace transform is