Data
Processing
Chapter 3
As a science major, you will all eventually have to deal with
data.
All data has noise
Devices do not give useful measurements; must convert data
The better you can handle data, the more employable you will be
Wavelength and Fourier Analysis
A Simple Example
The granite produces a
negative gravity
anomaly
Variations in the
sediment cover cause
noise in the data
The noise and the
anomaly have different
wavelength scales
Fourier analysis
Separates signals by
wavelength
2 x
General Wave Terms
a
0.5a
0.5a
Amplitude
y a sin
0.5
Wavelength ()
-a
Amplitude (a) =
Wavelength () =
Frequency =
Period =
1.5
nx
y a sin
Harmonic Analysis
1st 5 harmonics
1
0.5
0
0.5
-1
nx
y a sin
0.2 L
0.4 L
0.6 L
0.8 L
Harmonics: multiples of a signals half
wavelength, L
Why use harmonics?
Found in nature and music
Like a guitar!
Any wiggly line can be mathematically reproduced
by adding together a series of waves
Exact match requires waves
Fourier Analysis
A type of harmonic
analysis where wiggly
data are separated into
various harmonics of
differing amplitude
Adjusts the amplitudes
of each harmonic
Can isolate dominant
frequencies/wavelength
s in data and remove
unwanted ones
Sum of harmonics
reproduces data exactly
Data Separated by Wavelength
Sum of same harmonics, but with different amplitudes
What to Remove?
In this tide data, what type of wavelengths
(short or long) should we remove?
What causes each?
Caveats of
Fourier Analysis
Requires a complete
signal
Starts and ends at
same value
Only analyzes
wavelengths that are
multiples of the signal
length
Geologic targets likely
have multiple
wavelengths and may
share some
Digital Filtering
An alternative way to remove unwanted
wavelengths/frequencies: Filtering
Usually applied to regularly space data
If data not regular, interpolation can be used
E.g. A simple 3-point filter :: 1/3 (y n-1 + yn + yn+1)
Also called
3-point running average
3-point moving window
Time or
Distance
Valu
e
Filtered
Value
1
18
X3
2
09
2 13
3
510
5
6
4
4
5
9
6
4
7
2
There are also 5-point, 7-point, and n-point filters.
Some are weighted to remove certain wavelengths
Effects of Digital Filters
Low-pass filter
Also called
Smoothing filter
Allows low freq
to pass through
High-pass filter
Allows high freq
To pass through
Band-pass filter
Constructed to only let certain
bands or frequencies through
A subwoofer
in a
bandpass
box
Effects of Digital Filters
A given filter
may have a very
different effect
on data
depending on:
Wavelength
Sampling Rate /
Resolution
A filter can
completely
decimate a
signal
Aliasing
If sampling rate
(resolution) approaches
wavelength of signal
May see false patterns
If sampling rate is less
than signals
wavelength
May see false long
wavelength signals
Aliasing: Discrete
(non-continuous) data
can suggest patterns
that are not real
Nyquist wavelength
= half the signals
wavelength.
This is the minimum
sampling rate to avoid
aliasing
Gridded Data Processing
All of the data processing techniques discussed here can
also be applied to gridded or even three-dimensional data
Can filter directional noise
Highlights directional features
Geologists should pay attention in multivariable calculus class!
E.g. MAT 2130 - CALCUL ANALY GEOM III
Do not rely on black box computer programs
E.g. Arc GIS
Filtering in 2D :: Gridded Data
Filters can be created
to filter all types of
data
No technique is perfect
Great care must be
given when creating a
filter or processing data
in general