home page http://rubiola.org
The Magic of Correlation Measurements
- Statistics
- Spectral measure and estimation
- Theory of the cross spectrum
- Applications
Contents MTT-S & AP-S
29th Ann. Symp & Mini Show Hanover Manor, NJ, Oct. 2, 2014
The Magic of Correlation Measurements 29th Ann. Symp & Mini - - PowerPoint PPT Presentation
The Magic of Correlation Measurements 29th Ann. Symp & Mini Show Enrico Rubiola Hanover Manor, NJ, Oct. 2, 2014 MTT-S & AP-S FEMTO-ST Institute, Besancon, France Contents Statistics Spectral measure and estimation Theory
home page http://rubiola.org
The Magic of Correlation Measurements
Contents MTT-S & AP-S
29th Ann. Symp & Mini Show Hanover Manor, NJ, Oct. 2, 2014
Correlation measurements
2 single-channel correlation frequency Sφ(f) 1/√m a(t), b(t) –> instrument noise c(t) –> DUT noise Two separate instruments measure the same DUT. Only the DUT noise is common noise measurements DUT noise, normal use a, b c instrument noise DUT noise background, ideal case a, b c = instrument noise no DUT background, real case a, b c ≠ c is the correlated instrument noise Zero DUT noiseΣ
x = a + c c(t) dual-channel FFT analyzer y = b + c a(t)Σ
b(t) input signal instrument A instrument B DUTStatistics
3Boring but necessary exercises
Vocabulary of statistics
4E{ }
Example: thermal noise of a resistor of value RA theorem states that
there is no a-priori relation between PDF1 and spectral measure
For example, white noise can originate from
A relevant property of random noise
5 (1) PDF = Probability Density FunctionWhy Gaussian White Noise?
noise tends to be Gaussian (central-limit theorem)
sense (often, they are more disturbing than noise)
whitened, analyzed, and un-whitened
Properties of Gaussian White noise with zero mean
7x(t) <=> X(ıf) = X’(ıf)+ ıX”(ıf)
2N degrees of freedom X' f1 f2 X" statistically independent f0 fN–1/2 statistically independent statistically independentProperties of parametric noise
x(t) <=> X(ıf) = X’(ıf)+ ıX”(ıf)
The process has N … 2N degreesRayleigh x = √(x12+x22)
Children
Bessel K0 x = x1 x2 Chi-square χ2 = ∑i xi2
Spectral measure1 and estimation
10(1) Engineers call it Power Spectral Density (PSD)
The Spectral Measure
11 Autocovariance Improperly referred to as the correlation and denoted with Rxx(τ) for stationary random process x(t) For ergodic process, interchange ensemble and time average process x(t) –> realization x(t) Spectral measure (two-sided) autocorrelation function Rxx(τ) = 1 σ2 E n [x(t) − µ][x(t − τ) − µ]SI(f) = 2SII(ω/2π) , f > 0 S(ω) = lim
T →∞1 T XT (ω) X∗
T (ω) = lim T →∞1 T |XT (ω)|2
µ = ES(ω) = F
= Z ∞
−∞C(τ) e−iωτdτ C(τ) = E
C(τ) = lim
T →∞Z T/2
−T/2[x(t) − µ][x(t − τ) − µ]∗ dt
Fourier transform FSum of random variables
12 PDF = Probability Density FunctionProduct of independent zero-mean Gaussian-distributed random variables
13 x1 and x2 are normal distributed with zero mean and variance σ12, σ22 x has Bessel K0 distribution with variance σ = σ12 σ22f(x) = 1 πσ K0 ✓ −|x| σ ◆ E{f(x)} = 0 E{|f(x) − E{f(x)}|2} = σ2
x = x1 x2
Thanks to the central limit theorem, the average <X>m = (X1+X2+…+Xm)/m
Spectral Measure Sxx(ƒ)
(Power Spectral Density)
14 Normalization: in 1 Hz bandwidth var{X}= 1, and var{X’}= var{X”}= 1/2 Spectrum white, Gaussian, avg = 0, var = 1/2 X is white Gaussian noise Take one frequency, S(f) –> S. Same applies to all frequencies white, χ2, with 2m degrees of freedom avg = 1, var = 1/m the Sxx track on the FFT-SA shrinks as 1/m1/2 dev avg =hSxxim = 1
T hXX⇤im= 1
T h(X0 + iX00) ⇥ (X0 iX00)im= 1
T⌦ (X0)2 + (X00)2↵
mEstimation of |Sxx(ƒ)|
15 Running the measurement, m increases and Sxx shrinks => better confidence level 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=1 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=2 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=4 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=8 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=16 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=32 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=64 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=128 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=256 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=512 frequency 50 100 150 200 0.001 0.01 0.1 1 10 |Sxx| m=1024 frequency 50 100 150 200 0.001 0.01 0.1 1 10 File spectraseq1110240316absSxx Sourcexsp.mn E.Rubiola, mar 2010 frequencyCross Spectrum Theory
16Getting close to the real game
Σ
x = a + c c(t) dual-channel FFT analyzer y = b + c a(t)Σ
b(t) input signal instrument A instrument B DUTSyx with correlated term (1)
17 Cross-spectrum Expand using A, B = instrument background C = DUT noise channel 1 X = A + C channel 2 Y = B + C A, B, C are independent Gaussian noises Re{ } and Im{ } are independent Gaussian noises Split Syx into three sets Normalization: in 1 Hz bandwidth var{A} = var{B} = 1, var{C}=κ2 var{A’} = var{A”} = var{B’} = var{B”} = 1/2, and var{C’} = var{C”} = κ2/2Syx⇥m = Syx⇥m
... and work it out !!! hSyxim =
1 T hY X⇤im=
1 T h(Y 0 + iY 00) ⇥ (X0 iX00)im X = (A0 + iA00) + (C0 + iC00) and Y = (B0 + iB00) + (C0 + iC00)Syx with correlated term κ≠0 (2)
18 Gaussian, avg = 0, var = 1/2m Gaussian, avg = 0, var = κ2/2m white, χ2 2m deg. of freedom avg = κ2, var = κ4/m A, B, C are independent Gaussian noises Re{ } and Im{ } are independent Gaussian noises Bessel K0, avg=0, var=κ2/4 Gaussian, avg = 0, var = κ2/2m white, χ2, 2 DF avg = κ2, var = κ4 Gaussian, avg = 0, var = 1/2m Gaussian, avg = 0, var = κ2/2m Bessel K0, avg = 0, var = 1/4 Bessel K0, avg = 0, var = κ2/4 Gaussian, avg = 0, var = κ2/2m Normalization: in 1 Hz bandwidth var{A} = var{B} = 1, var{C}=κ2 var{A’} = var{A”} = var{B’} = var{B”} = 1/2, and var{C’} = var{C”} = κ2/2 Gaussian, avg = 0, var = (1+2κ2)/2m Gaussian, avg = 0, var = (1+2κ2)/2m var=1/2 var= κ2/2 var=1/2 var= κ2/2 Bessel K0, avg=0, var=1/4 Note: DF < 2m See vol.XVI p.56 Set A Set C Set B var= κ2/2 var=1/2 All the DUT signal goes in Re{Syx}, Im{Syx} contains only noise <Estimator Ŝ = |<Syx>m|
19 | hSyxim | = 1 T q [< {hY X∗im}]2 + [= {hY X∗im}]2 = 1 T q [hA im + h ˜ C im]2 + [hBim]2 . κ → 0 Rayleigh distribution hZ im = q [hA im]2 + [hBim]2 . E{hZ im} = r π 4m = 0.886 pm V{hZ im} = 1 m ⇣ 1 π 4 ⌘ = 0.215 m dev{| hSyxim |} E{| hSyxim |} = r 4 π 1 = 0.523 2.5 2.0 1.5 1.0 0.5 0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 Gauss sigma^2=1/2 Rayleigh sigma^2=1/2 Probability density f(x) figure: xspGaussRayleighpdf sourcealmostallplotsThe instrument default
background Im DUT background ReEstimator Ŝ = Re{<Syx>m}
20 0 dB SNR requires that m=1/2κ4. Example κ=0.1 (DUT noise 20 dB lower than single-channel background) averaging on 5x103 spectra is necessary to get SNR = 0 dB.⌅Z ⇧m = ⌅A ⇧m + ⌅ ˜ C ⇧m
E {⌅Z ⇧m} = κ2 V {⌅Z ⇧m} = 1 + 2κ2 + 2κ4 2m dev {⌅Z ⇧m} =Best (unbiased) estimator
background, Re DUTErgodicity
21 Ergodicity allows to interchange time statistics and ensemble statistics, thus the running index i of the sequence and the frequency f. The average and the deviation calculated on the frequency axis are the same as the average and the deviation of the sequence of spectra. 80 2 y −10 −20 −30 4 dB 3 100 x 60 1 40 20 File: xsp-ergodicity-3d frequency realization |<Syx(f)>32|, dBLet’s collect a sequence of spectra
Example: Measurement of |Syx|
22 20 40 60 80 100 120 140 160 180 200 0.001 0.01 0.1 1 10 file mce!syx!32 E.Rubiola, apr 2008 Sxx Syx m=32 μ = √(π/4m) 5 log(m) – 0.52 dB μ – √[(1-π/4)/m] μ – 3.21 dB μ + √[(1-π/4)/m] μ + 1.83 dB frequency | S y x | C = 0 m, 20 ... 210 frequency |<Syx>m|, dB C ≠ 0 frequency |<Syx>m|, dB m, 20 ... 210Measurement (C≠0), |Syx|
23 Running the measurement, m increases Sxx shrinks => better confidence level Syx decreases => higher single-channel noise rejectionApplications
24The real fun starts here
Applications
25Radio-astronomy
26X(ıf) X(ıf) Y(ıf) eıθ
Cassiopeia A (Harvard) Cygnus A (Harvard)DUT
Thermal noise compensation
27 DUT g g k T0 B k T0 B resistive terminations CP2 interferometer isolation isolation Correlation-and-averaging rejects the thermal noise E . R u b iRadiometry & Johnson thermometry
28correlation and anti-correlation noise comparator
0º 0º 0º 180º T2 A B X = A + B Y = A – B T1 Syx = k (T2 – T1) / 2Re-definition of the Kelvin?
29 shot noise thermal noiseS = kT S = 2qIavgR
high accuracy of Iavg with a dc instrument Poisson process μ = σ2 Thermal noise N = kT DC voltmeter Allred noise comparator Josephson effect VDC = hν / 2e null Boltzmann constant Planck constant Electron charge Second (Cesium)Property of the Poisson process
µ = σ2
Noise calibration
30S = kT S = 2qIavgR
high accuracy of Iavg with a dc instrument Compare shot and thermal noise with a noise bridge This idea could turn into a re- definition of the temperatureEarly implementations
31 Spectral analysis at the single frequency f0, in the bandwidth B Need a filter pair for each Fourier frequency X–Y X+Y P = X2–2XY+Y2 P = X2+2XY+Y2 ∆P = 4XY thermocouple V ~ 4XY Analog multiplier Analog correlator 1940-1950 technology f0, B f0, B X'(f0)cos(2πf0t) – X"(f0)sin(2πf0t) Y'(f0)cos(2πf0t) – Y"(f0)sin(2πf0t) (Y'X' + Y"X")/2 <Y'X' + Y"X"> / 2 x(t) y(t) Rice representation of noiseMeasurement of the frequency noise of a H-maser
32Phase noise measurement
33 F .L. Walls & al, Proc. 30th FCS pp.269-274, 1976 More popular after W. Walls, Proc. 46th FCS pp.257-261, 1992 (relatively) large correlation bandwidth provides low noise floor in a reasonable time F .L. Walls & al, Proc. 30th FCS pp.269-274, 1976 F .L. Walls & al, Proc. 30th FCS pp.269-274, 1976Phase noise measurement
34Phase noise
35 dc dc DUT REF REF RF RF LO LO y x arm b arm a FFT analyzer dc dc phase lock phase lock device 2−port Σ Σ FFT analyzer dc dc µw µw FFT analyzer device 2−port phase phase dc dc REF DUT REF RF RF LO LO y x arm a arm b phase and ampl. (ref) ∆ ∆ DUT phase and ampl. bridge b bridge a y x LO LO RF RF meter output (noise only) DUT (ref) (ref) RF RF LO LO x y arm a arm b FFT analyzerEffect of amplitude noise
36Dual-delay-line method
37 A.L. Lance, W.D. Seal, F . Labaar ISA Transact.21 (4) p.37-84, Apr 1982 Original idea:Optical version of the dual-delay-line method
38 splitter F F TFrequency stability of a resonator
39Now obsolete, 3E–16 stability from cryogenic oscillator
Amplitude noise & laser RIN
40Basic ideas
B Pc Rc Pa va Ra Pb vb RbMeasurement of the detector noise
Grop & RubiolaNoise in chemical batteries
42Noise in semiconductors
43Electro-migration in thin films
44Sud(f) = 1 2
⇥
Hanbury Brown - Twiss effect
451/2 Source 1/2
in single-photon regime, anti-correlation shows up Also observed at microwave frequenciesConclusions
without a reference low-noise source
The cross spectrum method is magic Correlated noise sometimes makes magic difficult
home page http://rubiola.org