CSE328 Fundamentals of Computer

Graphics: Concepts, Theory,

Algorithms, Techniques, & Applications
Hong Qin
Rm 366, NEW CS Building
Department of Computer Science
Stony Brook University (SUNY at Stony Brook)
Stony Brook, New York 11794-2424
Tel: (631)632-8450; Fax: (631)632-8334
qin@[Link]; or qin@[Link]
[Link]
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Course Website
• [Link]

• At the same time, we are ALSO using the Bright

Space for publishing additional course lecture
materials

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Course Prerequisites
• Mathematical skills: fundamental knowledge
on linear algebra, calculus, analytic geometry,
etc. (basic mathematical training at the
undergraduate level, Appendix A Mathematics
for Computer Graphics is a good starting point
to refresh our memory)
• Computer science background: programming
skills at the basic undergraduate level (C/C++,
OpenGL (graphics library))

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Course Prerequisites
• You need to speak to Hong if you are not
sure about your background knowledge and
course prerequisites
• Essentially, you need to have an
undergraduate education (the first two
years’ learning experiences) in computer
science or engineering or information
science with basic knowledge on computer
programming

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Grading Schemes (SPRING26)
• TWO exams (two midterms, NO final exam!): 20%
= 10% (first one) + 10% (second one)
• Class attendance: 20%
• THREE assignments/homeworks (non-programming
+ programming components): 20% + 20% + 20%
• Homework bonus: up to 15% (5% per assignment,
only allocated for the programming components)
• There is a FINAL PROJECT option (details to be
discussed in my first lecture)!
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Grading Schemes (SPRING26)
• TWO exams (two midterms, NO final exam): 30%
= 10% (first one) + 10% (second one)
• In classroom tests
• Open-book, Open-lecture-notes, Open-internet
• The first exam: 3/11 (tentative)
• The second exam: 4/29 (tentative)

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Grading Schemes (SPRING26)
• THREE assignments/homeworks (non-
programming + programming components): 20% +
20% + 20%
• Homework-1: (non-programming part) 10% +
(programming part) 10%, due at 11:59pm on 3/1
• Homework-2: (non-programming part) 10% +
(programming part) 10%, due at 11:59pm on 3/29
• Homework-3: (programming part ONLY) 20%,
due at 11:59pm on 5/3
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Grading Schemes (SPRING26)
• FINAL PROJECT option/track, project worth up to 40%
• Project proposal (half a page, 5%): due at 11:59pm on 3/25
• Demo+report (5%)+ project codes (30%): due at 11:59pm
on 5/10
• NOTE THAT, ff you choose FINAL PROJECT option,
you do NOT need to work on Homework-3!!!
• Possible bonus: 5% for HW1, 5% for HW2, and 5% for
HW3!
• Students (who choose the FINAL PROJECT track) could
get 130 out of 100 (5 + 5 + 20 =30)!
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Lecture and Office Hours
• WHEN: MW 6:30pm – 7:50pm
• WHERE: Rm 301 FREY HALL
• OFFICE HOURS: TBA (tentatively MW
afternoons/evenings before or after the lectures), or
by appointment!
• Teaching Assistant(s): TBA (Hong’s senior PhD
student); email: TBA
• TA office hours: TBA, or by appointment!!!
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Xi Han’s Web Link

• [Link]
• At the bottom of that page, please click on TA
Help Page (via link)
• You should be able to access them from the course
website easily!
• Xi is my senior PhD student, and this semester he
is going to help our students by serving as the
course TA
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Learn NEW Knowledge
• Your course works should be your OWN!
• NEVER share codes with your fellow student or debug
codes together, ONLY INDIVIDUAL project is
permitted, NO GROUP project is allowed!
• Reference examples from the internet is an effective
way to learn (take advantage of the internet!)
• When using open sources, you should explicitly point
them out
• NOT a course about graphic/game design, NOT using
graphics packages like PhotoShop / Maya
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 My Expectations
• First of all, you should enjoy participating the lectures and reading
course materials
• I like to see both time and efforts (at your side) dedicated to this
course, you should spend time on reading the textbooks / reference
books (most of the references are available online), reviewing notes,
attending my lectures, discuss/consulting with the instructor and his
TA team, working on your assignments and homeworks, and taking
exams.
• Interaction with Hong, TA, and your fellow students, etc.
• The bottomline - Problem-solving skills: what are the right and most
effect approaches, critical thinking about the underlying problems and
their motivations, taking advantages of online resources, asking
questions about existing challenges, etc.
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Computer Graphics Course
Not about!
Paint and Imaging packages (Adobe Photoshop)
Cad packages (AutoCAD)
Rendering packages (Lightscape)
Modeling packages (3D Studio MAX)
Animation packages (Digimation)
Not about!
Game programming and/or Graphic design courses!!!

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 OpenGL Tutorials
• Tutorials for Modern OpenGL (3.3+ or newer versions)

• [Link]

• [Link]

• [Link]
• Many other online resources are also available
• My TA will also have a designated website on OpenGL

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 The Course Load and Learning
Strategies
• Reading our textbook / reference book(s) (we will be
covering about 70-90% contents of this book during this
semester) and learn knowledge about background, theory,
algorithms, techniques, system components and architecture,
software tools and hardware elements, applications, etc.
• Practice on exercises documented at the end of each chapters
(two types of exercises: problem-solving questions, and
graphics programming examples)
• Many online resources are available (including reading
materials and codes on the internet)

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 The Course Load and Learning
Strategies
• All concepts, theories, algorithms, techniques,
system matters and architecture, software and
hardware elements, and applications relevant to
computer graphics are well within the boundary of
our textbook, so please DO read the book and
practice on exercises
• At the same time, many programming examples
throughout this book (in C and with the help of
OpenGL, graphics library), so practice on those
programming examples as well
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 The Course Objectives
• Provide our undergraduate students a comprehensive
knowledge on fundamentals of computer graphics, including
basic concepts, foundational theory, algorithms, techniques,
software tools, and applications for modeling, simulation,
rendering, animation, human-computer interactions, and
other key elements of graphics-centric visual computing
• Demonstrate the significance of these mathematical and
computational tools and graphics algorithms in visual
computing and relevant areas (e.g., visualization, vision, VR,
Augmented/mixed Reality, image processing, image
synthesis, etc.)
• Emphasize a ``hands-on'' approach to both the better
understanding of graphics concept/theory/algorithms and the
effective use of graphics techniques in various applications
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Main Concentrations
• Mathematical concepts, modeling and rendering theory,
and computational tools
• Fundamental algorithms in representation, modeling,
simulation, rendering, animation, etc.
• Geometric (and graphical, visual) modeling and simulation
techniques, and geometric processing and analysis tools
• A large variety of applications in graphics and
visualization as well as other visual computing areas
• Several advanced topics and they are all research-oriented,
representing the most sophisticated ones
• Expect a balanced approach between breadth and depth
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Key Components
• Computer graphics pipeline, basic concepts, theory,
algorithms, and techniques
• Modeling: representation choices of different models
• Rendering: simulating light and shadow, camera
control, visibility, discretization of models
• HCI (human-computer interface): specialized I/O
devices, graphical user interfaces
• Animation: lifelike characters, natural phenomena,
surrounding virtual environments
• Advanced topics, if time permits
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Our Course
• A subset of key concepts, theory, algorithms, techniques,
and applications
• Extensive topics with the primary concentration on our
unique course mission
• Comprehensive lectures (focusing on geometric and
physical intuition, good ideas, and application needs)
• Numerous slides, figures, images, and videos for easy
understanding (after all, this is the nature of graphics and
visual computing)
• Active students’ involvements and interactions
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Course Facts
• This is a undergraduate course for both CSE and ISE
students!!!
• Can I take this course? YES, if YOU
– are a undergraduate student with CS background, have
basic mathematical skills in linear algebra, calculus,
and analytic geometry, have BASIC knowledge on
computer programming, or talk to the instructor
• One required textbook, several suggested references
• Lecture notes are important! Class attendance is a
must!
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 My Contact Information
Hong Qin
Room 366, NEW CS Building (My office)
Department of Computer Science
Stony Brook University (SUNY at Stony Brook)
Tel: (631)632-8450; Fax: (631)632-8334
qin@[Link]; or qin@[Link]
[Link]
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Computer Graphics Components

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Earlier Days of Computer Graphics
• Visual display of data (graphs and charts)

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Mathematical Function Plots

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 What is Computer Graphics
The creation of, manipulation of, analysis of, and
interaction with pictorial representations of
objects and data using computers
- Dictionary of Computing
Computer Graphics is also called Image Synthesis
A picture is worth a thousand words
- Chinese Proverb

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Computer Graphics
• (Realistic) pictorial synthesis of real and/or imaginary
objects from their computer-based models (datasets)
• It typically includes modeling, rendering (graphics
pipeline), and human-computer interaction
• So, we are focusing on computer graphics hardware,
software toolkits, and mathematical foundations
• Computer Graphics is computation
– A new method of visual computing
• Why is Computer Graphics useful and important?
• Course challenges: more mathematics oriented,
programming requirements, application-driven, inter-
disciplinary in nature, etc.
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Basic Elements of Computer Graphics
• Graphics modeling: representation choices and
their advantages/disadvantages
• Graphics rendering: geometric transformation,
visibility, discretization, simulation of light,
special visual effects, etc.
• Graphics interaction: input/output devices,
interface design, and interaction tools
• Animation: lifelike characters, their interactions,
surrounding virtual environments
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Computer Graphics Components

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Primary Topics
• Overview, applications
• Basic components, history development
• Hardware, system architecture, raster-scan graphics
• Line drawing, scan conversion
• 2D transformation and viewing
• 3D transformation and viewing
• Hierarchical modeling
• Interface
• Geometric models
• Color representations
• Hidden object removal
• Illumination models
• Advanced topics (time permitting)
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Mathematical Background
• Computer Graphics has a strong 2D/3D geometry
component
• Emphasize geometry and physics intuition
throughout the semester
• Basic linear algebra training is extremely helpful –
matrices, vectors, dot products, cross products, etc.
• Much more continuous math (vs. discrete math)
than in other typical computer science courses
• Function plots, curves, and surfaces
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 A Very Good Textbook for General
Issues in Computer Graphics
• Computer Graphics with OpenGL, 4th Edition,
Donald Hearn, M. Pauline Baker, and Warren R.
Carithers, Prentice Hall, 2011.
• Strongly recommended, but NOT REQUIRED!!!

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 OpenGL Reference Books
1. OpenGL Programming Guide
2. OpenGL Reference Manual
3. OpenGL Superbible
4. These are for your references only
5. Many online resources, please take advantage
of them by searching for online materials (both
reading materials and codes)

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Digital Entertainment

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Architectural Engineering

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Computer-Aided Design

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Scientific Visualization/Simulation

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Digital Ocean

Department of Computer Science CSE528 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Geosciences/GIS

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Biology (Protein on DNA)

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Medicine and Healthcare

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Biomechanical Modeling of Human

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Graphic Arts

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Computer Art with Physical
Interface

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Why Graphics and Visualization
• Enable scientists (also engineers, physicians,
general users) to observe their simulation and
computation
• Enable them to describe, explore, and summarize
their datasets (models) and gain insights
• Offer a method of SEEING the UNSEEN
• Reason about quantitative information
• Enrich the discovery process and facilitate new
inventions
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 What is Visualization
Visualization is a method of extracting meaningful
information from complex or voluminous datasets
through the use of interactive graphics and imaging

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Why Graphics and Visualization
• Analyze and communicate information
• Revolutionize the way scientists/engineers/physicians
conduct research and advance technologies
• About 50% of the brain neurons are associated with
vision
• The gigabit bandwidth of human eye/visual system
permits much faster perception of visual information
and identify their spatial relationships than any other
modes
– Computerized human face recognition
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Graphics Examples

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 More Examples

Points
Images
Volumes
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Terrain Modeling and Rendering
• California Terrain

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Virtual Tourism

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 sensors, sampling/ computation/
super-
scanners, scanning
data simulation computers
cameras

polygonization
discretization

geometric computer image image

model graphics
(signal) processing
(structures) computer
vision

display film
device recorder

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Related Fields
• Computer graphics (image synthesis)
– Generate images from complex multivariate datasets
• Image processing, signal processing
• Image understanding (pattern recognition)
– Interpret image data
• Computational vision
• Human-computer interaction
– Mechanisms to communicate, use, perceive visual information
• Computer-aided (geometric) design
• Neurological/physiological studies on human brain and our visual
system
• Virtual Reality (VR) / Augmented Reality / Mixed Reality
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Computer Graphics Pipeline
• Data acquisition and representation
• Modeling data and their (time-varying) behaviors
(e.g., physical experiments or computational
simulations)
• Graphics system and software environments for
data rendering
• Image-based techniques

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 What Are Our Ultimate Goals?
• A large variety of datasets (acquired via scanning
devices, super-computer simulation, mathematical
descriptions, etc.)
• A pipeline of data processing that consists of data
modeling (reconstruction), representation, manipulation
(rigid transformation or deformation), classification
(segmentation), feature extraction, simulation, analysis,
visual display, conversion, storage, etc.
• Visual information processing in the intelligent way
(Intelligent Information Processing)
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 What Are Our Ultimate Goals?
• Datasets that are huge, multi-dimensional, time-
evolving, unstructured, multi-attributes
(geometric info. + material distributions),
scattered (both temporal and spatial)…
• We are investigating mathematical tools and
computational techniques for data modeling,
reconstruction, manipulation, simulation,
analysis, and display

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Challenges
• TOO MUCH data
• The number of data sources keeps increasing
• Sensor quality and resolution are increasing
• Existing instruments are still available
• The speed of supercomputer is faster than ever
• We must do something (besides collecting and storing
the datasets)
• We must deal with the huge datasets effectively
• Visual communication, improve our visual interaction
with data
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Challenges
• Data-driving, scientific computing to steer
calculations
• Real-time interaction with computer and data
experimentation
• Drive and gain insight into the scientific
discovery process

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Data Sources
• Scanned, computed, modeled data
• The first process is data-gathering
• Large variety of data sources and attributes
• Extremely large-scale datasets
• Require real-time processing

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Data Acquisition and Processing
• Pixels and voxels
• Regular & irregular grids
• Numerical simulations
• Surface or volumetric data
• Scalar, vector, tensor data with multiple attributes
• Higher-dimensional and/or time-varying data
• Popular techniques
– Contouring, iso-surfaces, triangulation, marching cubes, slicing,
segmentation, volume rendering, reconstruction
• Image-based processing techniques
– Sampling, filtering, anti-aliasing, image analysis and manipulation
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Information Domain
• Sciences (e.g., statistics, physics)
• Engineering (e.g., empirical observations for
quality control)
• Social events (e.g., population census)
• Economic activities (e.g., stock trading)
• Medicine (e.g., computed tomograph (CT),
magnetic resonance imaging (MRI), X-rays,
ultrasound, various imaging modalities)
• Geology
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Information Domain
• Biology (e.g., electronic microscopes, DNA sequences,
molecular models, drug design)
• Computer-based simulations (e.g., computational fluid
dynamics, differential equation solver, finite element
analysis)
• Satellite data (e.g., earth resource, military intelligence,
weather and atmospheric data)
• Spacecraft data (e.g., planetary data)
• Radio telescope, atmospheric radar, ocean sonar, etc.
• Instrumental devices recording geophysical and seismic
activities (e.g., earthquake)
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Graphics and Visualization
• Data acquisition, representation, and modeling
• Imaging processing
• Visualization (displaying) methods and
algorithms
• More advanced research topics

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Pathway to Success
• High-prepared, highly-motivated
• Hard-working, perseverance
• Start as soon as possible
• Communicate with Hong and his PhD students on a
regular basis
• Actively interact with your fellow students
• Visit libraries and internets frequently for papers and
software system
• Read as many papers as possible
• Work on your course project
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Computer Graphics
• “The purpose of scientific computing is insight,
not numbers,” by Richard Hamming many years
ago
• These fields are all within computer science and
engineering, yet computer graphics spans multi-
disciplines
• Computer Graphics (another definition)
– Application of computers to the disciplines of
sciences/engineering
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Computer Graphics
• Computer Graphics is application-driven, so
what are its applications?

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Applications
• Simulation and training: flight, driving
• Scientific visualization: weather, natural phenomena,
physical process, chemical reaction, nuclear process
• Science: Mathematics, physics (differential equations)
biology (molecular dynamics, structural biology)
• Environmental sciences
• Engineering (computational fluid dynamics)
• Computer-aided design/manufacturing (CAD/CAM):
architecture, mechanical part, electrical design (VLSI)

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Applications
• Art and Entertainment, animation, commercial advertising,
movies, games, and video
• Education, and graphical presentation
• Medicine: 3D medical imaging and analysis
• Financial world
• Law
• WWW: graphical design and e-commerce
• Communications, interface, interaction
• Military
• Others: geographic information system, graphical user interfaces,
image and geometric databases, virtual reality, etc.
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Key Components
• Modeling: representation choices of different
models and their pros/cons
• Rendering: simulating light and shadow, camera
control, visibility, discretization of models,
special visual effects
• HCI (human-computer interface): specialized I/O
devices, graphical user interfaces
• Animation: lifelike characters, natural
phenomena, surrounding virtual environments
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Course Projects
• Sampled course projects from previous years:
• Terrain rendering (rendering of heightmaps)
• Realistic animation of liquids
• Raytracing based on KD-trees
• SPH (Smoothed Particle Hydrodynamics) Simulation
of water
• Modeling and rendering of cloud
• Modeling plants with L-systems
• Subdivision surfaces in character animation
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Course Projects
• Shadow mapping techniques
• Modeling and rendering of seashells
• Particle-based modeling system for cloth animation
• 3D non-photorealistic rendering
• Hidden surface removal
• Particle-based fluid simulation for interactive
applications
• Interactive ray tracing

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Course Projects
• Procedural modeling for terrain generation
• Distributed ray tracer
• Teddy: A sketching interface for 3D freeform design
• As-rigid-as-possible shape manipulation
• Physical wave simulation
• Real-time shape illustration using Laplacian lines
• Cellular automata for cloud simulation
• Interactive technical illustration

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Course Projects
• 3D terrain design
• Image deformation based on moving least squares
• Shape sculpting system based on vector field
deformation
• Surface skinning techniques
• Video textures
• Simulating Chinese painting effects
• Digital inpainting and image restoration

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Flow Simulation (Navier-Stokes
Equation) for Natural Phenomena

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Fluid Simulation

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Natural Phenomena

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Simulation of Bubble Flow

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Geometry Synthesis of Human
Hair

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Facial Expression Acquisition and
Synthesis

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Tree Simulation

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Non-Photorealistic Rendering

Department of Computer Science CSE528 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Collision Handling

Department of Computer Science CSE528 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Shape Deformation and Editing

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Shape Deformation

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Motion Synthesis (Animation)

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Urban Structure and Modeling

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Architectural Geometry

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Organ Deformation

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Biomedical Applications

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Augmented Reality in
Neurosurgery

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Model Segmentation

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Building Reconstruction

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Geometry Texture Synthesis

Department of Computer Science CSE528 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 PDE-driven Texture Synthesis

Department of Computer Science

C CSE328 STNY BRK
Turk 91
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Generating New Models from
Examples

Department of Computer Science CSE328 STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 More Suggested Topics
• Realistic animation of clouds
• Multi-scale line drawings from 3D meshes for
shape abstraction
• Simulation of smoke
• Stylized rendering techniques for scalable real-
time 3D animation
• Image-based tree-modeling using particle flows
• Animation of fire
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Real-time 3D fluid simulation on GPU with
complex obstacles
• Real-time non-photorealistic rendering
• Volcano animation
• Real-time procedural terrain generation
• Real-time collision handling in graphics games
• Image quilting for texture synthesis and transfer
• Sketch-based user interface for procedural terrain
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Interactive 3D terrain sketching
• 3D concept sketches using cross-section curves
• Particle-based fluid simulation for interactive
graphics applications
• Automatic video texture synthesis
• Modeling and reconstructing objects with single
photo
• Practical model for light transport
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Automatic and interactive lighting preview
system
• Automatic generation of surface crack patterns
• Sketching solid models using blob trees
• Interactive architectural modeling using
procedural extrusions
• Mesh simplification
• Out-of-core ray casting and ray tracing
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Fluid surface simulator
• Double-sided 2.5D graphics
• Cloth simulation
• Interactive global illumination
• K-means algorithm for image and geometry shape
classification
• Fluid simulation with bubble generation
• Automatic construction of 3D models from line
drawings
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Liquid interaction with deformable models
• Fluid dynamics for games
• Multiresolution dynamic deformations
• Rendering heightmaps based on GPU
• SPH simulation for water in pool
• KD-tree based ray tracing
• An extended toon shader
• Interactive technical illustration
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Image segmentation
• Progressive refinement for rapid radiosity
• Crowd simulation for game development
• Feature-sensitive bas relief generation
• Fast façade acquisition using line arrangements
• 3D shape retrieval based on visual similarity
• Video face replacement
• Poisson vector graphics
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Real-time oil painting
• Modeling of clouds using single photograph
• A curved ray camera for handling occlusions
• Realistic animation of liquids
• Subdivision surfaces in character animation
• Teddy
• Facial animation
• Simulation of cloud dynamics on GPU
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Simulating and animating liquids
• Shadow mapping based on ray tracing
• Modeling snow fall and accumulation
• Modeling sea shells
• Particle system for cloth modeling
• Real-time hidden surface removal
• Non-photorealistic rendering
• Digital inpainting and image restoration
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Real-time ray tracing based on graphics
hardware
• Photon mapping and rendering
• Procedural modeling of cities
• 3d particle system for real-time video game
• Creation of maze art
• Real-time distributed ray tracing
• Procedural terrain based on scene voxelization
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • 3D lego modeling based on shape voxelization
• As-rigid-as-possible shape manipulation
• Physical wave simulation for ocean scene
production
• Real-time Eulerian water simulation
• Geometric skinning for human animation
• Video textures
• Real-time shape illustration using Laplacian lines
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • A procedural watercolor engine for polygons
• Simple data-driven modeling of brushes
• Discrete element textures
• Photo watercolorization
• Computer generated floral ornament
• Silhouettes and outlines of arbitrary 3D models
• Simulating and modeling lichen growth
• Modeling plants using L-systems
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Procedural generation of road network
• Texture mapping for hand-drawn cartoons
• Qsplat: a multiresolution point rendering system
for large meshes
• Image deformation using moving least squares
• Treakable light and shade for cartoon animation
• 3D mesh descriptors
• 3D model reconstruction from cross-sectional
curve drawings
CSE328 Lectures
Department of Computer Science STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Perlin noise generator
• 3D shape co-segmentation and clustering
• Extracting tree skeletal structures from point
clouds
• Urban scene reconstruction using raw LiDAR data
• Image retargeting
• Creation of the impossible
• Multiresolution volume rendering
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Cross-boundary brushes for interactive shape
segmentation
• Image color style transfer and colorization
• Photo-sketcher: Interactive sketch based image
synthesis
• Snow cover generation
• Real-time realistic ocean lighting
• Face sketch synthesis via sparse representation
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Mesh denoising and smoothing via anisotropic
diffusion of surfaces
• Adaptive ray-tracing
• Learning 3D model segmentation
• Graphical model simplification
• Multiscale rendering of 3D models
• Efficient image blending
• Synthesizing high-resolution smoke animation
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 • Large-scale sketch-based recognition

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Journals and Conferences
• Siggraph (also including Siggraph Asia)
• Eurographics
• Pacific Graphics
• Many specialized (smaller) conferences in animation,
rendering, graphics hardware, etc.
• ACM Transactions on Graphics
• IEEE Transactions on Visualization and Computer Graphics
• Computer Graphics Forum
• Computers & Graphics
• The Visual Computer
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 Related Fields
• Geometry-oriented journals and conferences
(GMP, SPM, SMI, SGP, Computer-aided Design,
CAGD, GMOD, Computers & Graphics)
• Computer Vision (CVPR, ICCV, ECCV)
• Image processing
• Virtual/Augmented/Mixed reality
• HCI, AI, Computer animation, Artificial life, etc.

Department of Computer Science CSE328 Lectures STNY BRK

Center for Visual Computing STATE UNIVERSITY OF NEW YORK
 My Contact Information
Hong Qin
Room 366, NEW CS Building (My office)
Department of Computer Science
Stony Brook University (SUNY at Stony Brook)
Tel: (631)632-8450; Fax: (631)632-8334
qin@[Link]; or qin@[Link]
[Link]
Department of Computer Science CSE328 Lectures STNY BRK
Center for Visual Computing STATE UNIVERSITY OF NEW YORK