Spectrum-Preserving Mesh Simplification
Spectrum-Preserving Mesh Simplification
Thibault Lescoat1 Hsueh-Ti Derek Liu2 Jean-Marc Thiery1 Alec Jacobson2 Tamy Boubekeur4,1 Maks Ovsjanikov3
1 LTCI, Télécom Paris, Institut Polytechnique de Paris, France 2 University of Toronto, Canada 3 École Polytechnique, France 4 Adobe
Figure 1: We propose to simplify a mesh using edge collapses while aiming to preserve the input eigenvectors and eigenvalues as much
as possible. While different strategies exist to reduce a mesh (here, from 25,727 vertices to 771 vertices, or 3% of its initial size), such as
enforcing uniform edge lengths or using the Quadric Error Metric [GH97], they do not focus on keeping the spectral properties of the mesh.
Reducing a mesh can be spectrally described using functional maps [OBCS∗ 12], shown here with the output meshes, and which should ideally
be diagonal. We also evaluate functional maps using two norms, the Laplacian commutativity k · kL and the orthogonality k · kD .
Abstract
The spectrum of the Laplace-Beltrami operator is instrumental for a number of geometric modeling applications, from processing
to analysis. Recently, multiple methods were developed to retrieve an approximation of a shape that preserves its eigenvectors
as much as possible, but these techniques output a subset of input points with no connectivity, which limits their potential
applications. Furthermore, the obtained Laplacian results from an optimization procedure, implying its storage alongside the
selected points. Focusing on keeping a mesh instead of an operator would allow to retrieve the latter using the standard cotangent
formulation, enabling easier processing afterwards. Instead, we propose to simplify the input mesh using a spectrum-preserving
mesh decimation scheme, so that the Laplacian computed on the simplified mesh is spectrally close to the one of the input mesh.
We illustrate the benefit of our approach for quickly approximating spectral distances and functional maps on low resolution
proxies of potentially high resolution input meshes.
1. Introduction The lack of a mesh limits the use of coarsening in many downstream
geometry processing tasks.
Triangle meshes remain a predominant representation of 3D sur-
We present the first mesh simplification method intentionally
faces. When the complexity of a given mesh exceeds computational
designed to preserve spectral properties. We propose adapting the
resources, we rely on mesh simplification methods to remove ver-
standard greedy edge-collapse mesh-simplification algorithm with a
tices, edges, and faces. In rendering, efficient simplification methods
novel cost function that measures spectral preservation of a given op-
can dramatically reduce the complexity of a mesh without affecting
erator (e.g., the cotangent Laplacian). Unlike algebraic methods that
its appearance. It is tempting to repurpose appearance-preserving
directly output a reduced operator (i.e., matrix), our method outputs
simplification methods for other geometry processing tasks.
a manifold triangle mesh with 3D vertex positions. Reconstructing
the operator on the output mesh will preserve both the eigenvalues
Unfortunately, appearance-based methods do not preserve the and eigenvectors of the operator on the input mesh.
spectral properties of the important differential operators upon which
much of modern geometry processing is built (see Figure 1). As a Confirmed by a series of experiments, our method preserves spec-
result, solutions computed on such a coarse mesh can be incorrect tral properties nearly as well as purely algebraic methods, while
or misleading. Alternatively, previous coarsening methods that do still outputting an embedded mesh like standard simplification algo-
preserve spectral properties work purely algebraically on the oper- rithms. We demonstrate our approach’s effectiveness for geodesic
ator matrices and do not produce a geometric mesh (see Figure 2). distance approximation and functional maps correspondence.
Ground truth Nasikun et al. 2018 Liu et al. 2019 Garland & Heckbert 1997 Ours
| |: 56,112
|| . ||L = 1.66 × 103 || . ||L = 8.02 × 103 || . ||L = 61.19 × 103 || . ||L = 1.71 × 103
|| . ||D = 2.62 × 100 || . ||D = 1.86 × 100 || . ||D = 42.25 × 100 || . ||D = 1.14 × 100
Figure 2: Reduction from 56,112 to 1,122 vertices (2% of input size). Nasikun et al. [NBH18] approximate the original Laplacian on a subset
of vertices obtained via Poisson-disk sampling. Liu et al. [LJO19] optimize the sampling and the operator, that they define on samples’ 3-rings.
Instead, by outputting a mesh, further processing can use a standard cotangent weighting scheme without knowledge of the reduction step.
input, | |: 20,212
Figure 3: While the very first eigenvectors from both our method (middle row) and QSlim [GH97] (bottom row) are very close to those of the
input (top row), following eigenvectors are more sensitive; badly preserved eigenvectors exhibit patterns dissimilar to their input counterpart.
e −1 LPF)k
ev k rowv (PZ − M e 2
E = ∑ Ev and Ev = M .
v
Both norms are valid in these cases. While Equations (2) & (4) are Nasikun et al. Liu et al. Garland & ~
Ours
not related, we have that if kCk 6= 0 then E = 0 ⇐⇒ kCkL = 0 2018 2019 Heckbert 1997 | |: 622
(proof in Appendix B).
Our goal is to show that C is orthonormal and commutes with
the Laplacians in the reduced basis if and only if it preserves corre-
sponding eigenfunctions and eigenvalues exactly. We do not assume
any constraints on C (e.g., association with a pointwise map).
|| . ||L seconds
Garland & Heckbert 1997 Liu et al. 2019
40000
40
Liu et al. 2019
20000
Ours
Nasikun et al. 2018 20
Ours
0
~
0% 20% 40% 60% | |/| | Nasikun et al. 2018
|| . ||D Garland & Heckbert 1997
20 0
~
Garland & Heckbert 1997 0% 20% 40% 60% | |/| |
Figure 8: One can see from these plots, k · kL and k · kD over the
output size relative to the input size, that most methods have the sim-
ilar behaviors, except for the method of Liu et al. [LJO19] for which
the optimization becomes harder with more output vertices. The
simplification of Garland & Heckbert [GH97] distort the spectrum
and thus exhibit higher norms.
i i
Figure 12: Both the shape (by removing small details) and the heat_kernel(u, v,t) = ∑ φi (u)φi (v)e −λi t
discretization (by avoiding slivers) impact the preservation of the i
spectrum (here we remove 90% of the vertices).
HKS(v,t) = heat_kernel(v, v,t) = ∑ φ2i (v)e−λi t
i
While heavily reducing the input mesh will decrease the quality of
that the output size should be at least 3x the number of eigenvectors these distances and signatures, our method preserves them better
to preserve (Figure 11), for a correct spectral preservation of the than the method of Garland & Heckbert [GH97]. In particular, dis-
Laplacian. From Figure 11, we also observe that Laplacian commu- tances on meshes reduced using their method exhibit a lot more
tativity has less variability than orthogonality for high ratios. spurious local optimums than on meshes reduced with our method
(see Figure 13). The Heat Kernel Signature tends to be more resis-
Factors of spectral properties. Both the shape and its discretiza- tant at small values of t, but is less conserved at large values of t
tion impact the spectral properties, especially when the number of (see Figure 14).
vertices is limited. Ideally, faces should be regular, to get a high
quality Laplacian operator [WMKG07]. As the method of Garland &
Heckbert [GH97] focuses on the shape, we also evaluated a remesh- Garland & Heckbert
Reference Ours (-96%) 1997 (-96%)
ing method that focuses on the discretization: Instant Field-aligned
Meshes (IFM) [JTPSH15]. On average, for the same mesh and
diffusion
5. Applications
Our simplification method was designed to enable faster computa-
tionally expensive shape analysis tasks, by replacing dense input | |: 23,570
meshes with coarser substitutes, yet optimized to carry on as much
as possible the original spectral properties onto which these task
commute
| |: 25,727
5.1. Spectral distances Figure 13: Spectral distance comparison: the source point is de-
We now show the preservation of spectral distances between vertices, picted in blue and the iso-lines in black, with t set to 0.01 for the
and evaluated several different distances. Noting φi the i-th eigen- diffusion distance. With 25x less vertices in these reduced meshes,
vector of the Laplacian operator on the mesh and λi its associated computing spectral distances is on average 18x faster.
50 50
Garland & Garland &
Heckbert 1997 Heckbert 1997
Figure 16: Reducing meshes from the TOSCA dataset from around
30K vertices to 600 vertices allowed to use BCICP [RPWO18] as it
would run out of memory on the fine meshes, and our method pro-
vides better correspondences than the simplification of Garland &
Heckbert [GH97]. On the reduced meshes, the BCICP computation
took on average 67s, from 16s to 142s (variance: 802).
Figure 14: Despite the high reduction, the heat kernel signature is
still similar between coarse and fine mesh when using our method.
Figure 15). This simplification is unaware of the spectrum to pre-
serve and can distort it, limiting the accuracy of the match. We show
5.2. Faster functional maps that we can use our method to enable robust matching, while still
As briefly shown before, functional maps are a powerful tool for find- being faster than without the reduction. This hierarchical scheme
ing correspondences between shapes, and are complemented with can be written in matrix form:
approaches to retrieve a point-to-point mapping. One can perform CX ,Ye = CY,Ye CX ,Y = CXe ,Ye CX ,Xe
shape matching using Product Manifold Filter (PMF) [VLB∗ 17] or
Bijective and Continuous ICP (BCICP) [RPWO18], with excellent where CX ,Y is the functional map from shape X to shape Y. We
results. Both methods are iterative: PMF solves a linear assignment retrieve CX ,Xe and CY,Ye from our mesh simplification method, and
problem at each iteration to determine a bijection between shapes, CXe ,Ye from either PMF [VLB∗ 17] or BCICP [RPWO18]. Then,
which is has a high algorithmic complexity and also needs the shapes CX ,Y can be computed by solving a least squares system. While
to have the same number of vertices. BCICP instead does not need the method of Liu et al. [LJO19] is also suitable for PMF but not
the shapes to have an equal number of vertices, and refines both for BCICP since the latter require a connectivity, we can use our
the functional map and the point-to-point maps at each iteration. method with both PMF and BCICP. We evaluated using BCICP
However these methods do not scale performance-wise when the in the hierarchical functional maps, and compare the results to a
number of vertices increases. reduction with the method of Garland & Heckbert [GH97]. As can
This performance problem can be circumvented by simplifying be observed in Figure 16, our method enable better matching, and is
the meshes prior to the matching, usually using the method of Gar- significantly faster than running BCICP on the fine shape. Indeed,
land & Heckbert [LRR∗ 17], yielding a hierarchical scheme (see while running BCICP on meshes with 600 vertices to 1 minute per
shape pair, BCICP on meshes with 1000 vertices took on average 2
minutes, and ran out of memory for mesh around 30K vertices. For
this application, we used binary restriction matrices.
6. Discussion
Edge flips. The cost of an edge col-
lapse and the preservation metric are
defined in such a way that we can
easily extend it to edge flips, keeping
only edge flips with a negative cost
in order to avoid cycles (Figure 17).
We tried this during the reduction pro- Figure 17: An edge flip
cess, but this always overfitted and will not change the Ew
Figure 15: One can accelerate the computation of functional maps generated poor results (Figure 18). corresponding to the
between detailed meshes by performing shape matching on simpli- Doing a post-process optimization us- 1-ring vertices (black)
fied shapes before upscaling the resulting functional maps. ing edge flips does indeed lead to a and beyond.
Figure 19: For large meshes, most of the time is spent in the eigen-
e = 10%|V|). After the setup step, the reduction
solver (left, with |V|
Figure 18: Allowing edge flips often results in whole parts missing. time (right) is linear in the number of collapsed edges.
Limitations. There are at least two main areas where our approach References
can further be developed, both related to time performance. First, [ASC11] AUBRY M., S CHLICKEWEI U., C REMERS D.: The wave kernel
the eigenvectors need to be computed at the beginning of the algo- signature: A quantum mechanical approach to shape analysis. In Proc.
rithm, while one may seek computing them at query time, when ICCV (2011). 7
needed. Second, our cost evaluation involves fairly large matrices, at [CBO∗ 19] C HEN J., B UDNINSKIY M., OWHADI H., BAO H., H UANG
each evaluation which could be optimized using an approximation J., D ESBRUN M.: Material-adapted refinable basis functions for elasticity
simulation. ACM Trans. on Graphics (2019). 2
scheme.
[CMO97] C OHEN J., M ANOCHA D., O LANO M.: Simplifying polygonal
models using successive mappings. In Proc. IEEE Vis (1997). 2
Scalability. By far, the most limiting factor when scaling to large
[CS18] C LAICI S., S OLOMON J.: Wasserstein coresets for Lipschitz costs.
meshes is the eigen solver, which can be seamlessly replaced by arXiv preprint arXiv:1805.07412 (2018). 2
a faster one (see Figure 19). Interestingly, one could use a fast
[CSAD04] C OHEN -S TEINER D., A LLIEZ P., D ESBRUN M.: Variational
approximation [NBH18] for this step. Lowering the number of shape approximation. ACM Trans. on Graphics (2004). 2
eigenvectors K would help for both the setup and the reduction, as
[CVM∗ 96] C OHEN J., VARSHNEY A., M ANOCHA D., T URK G., W E -
the matrices to manipulate would be smaller. It is also possible to BER H., AGARWAL P., B ROOKS F., W RIGHT W.: Simplification en-
partially reduce the input using the QEM [GH97] (e.g., down to velopes. In Proc. SIGGRAPH (1996). 2
100K or 200K vertices) before using our method: the impact of such [GH97] G ARLAND M., H ECKBERT P. S.: Surface simplification using
pre-processing on the spectrum would be limited. quadric error metrics. In Proc. SIGGRAPH (1997). 1, 2, 3, 5, 6, 7, 8, 9
[GH98] G ARLAND M., H ECKBERT P. S.: Simplifying surfaces with color
and texture using quadric error metrics. In Proc. IEEE Vis (1998). 2
7. Conclusion [HCB16] H UGGINS J., C AMPBELL T., B RODERICK T.: Coresets for
scalable Bayesian logistic regression. In Proc. NeurIPS (2016). 2
We have introduced a new mesh simplification algorithm which is
[HDD∗ 93] H OPPE H., D E ROSE T., D UCHAMP T., M C D ONALD J.,
designed to preserve, as much possible, the spectral properties of S TUETZLE W.: Mesh optimization. In Proc. SIGGRAPH (1993). 2
the input surface. Our method is built on a standard graph reduction
[Hop99] H OPPE H.: New quadric metric for simplifying meshes with
algorithm for which we introduced a custom metric driving a cost appearance attributes. In Proc. IEEE Vis (1999). 2
designed specifically to preserve the spectrum, together with a repo-
[JTPSH15] JAKOB W., TARINI M., PANOZZO D., S ORKINE -H ORNUNG
sitioning strategy for merged vertices. We illustrated the superior O.: Instant field-aligned meshes. ACM Trans. on Graphics (2015). 7
behavior of our decimation scheme compared to appearance preserv-
[KS16] K YNG R., S ACHDEVA S.: Approximate Gaussian elimination for
ing methods, for spectral distance computation and functional map Laplacians-fast, sparse, and simple. In Proc. FOCS (2016). 2
generation. Yet, we believe more spectrum-dependent applications
[LFJG17] L IU S., F ERGUSON Z., JACOBSON A., G INGOLD Y. I.: Seam-
may find immediate benefit from our approach. less: seam erasure and seam-aware decoupling of shape from mesh reso-
lution. ACM Trans. on Graphics (2017). 2
[LFZ15] L I D., F EI Y., Z HENG C.: Interactive acoustic transfer approxi-
Acknowledgments mation for modal sound. ACM Trans. on Graphics (2015). 2
[LJO19] L IU H.-T. D., JACOBSON A., OVSJANIKOV M.: Spectral coars-
Parts of this work were supported by the KAUST OSR Award ening of geometric operators. ACM Trans. on Graphics (2019). 2, 3, 4, 5,
No. CRG-2017-3426, the ERC Starting Grant No. 758800 6, 8, 10
(EXPROTEA), NSERC Discovery (RGPIN2017–05235, RG- [Lou19] L OUKAS A.: Graph reduction with spectral and cut guarantees.
PAS–2017–507938), the Ontario Early Research Award program, J. Machine Learning Research (2019). 2
the Canada Research Chairs Program, the Fields Centre for Quantita- [LRR∗ 17] L ITANY O., R EMEZ T., RODOLÀ E., B RONSTEIN A. M.,
tive Analysis and Modelling and gifts by Adobe Systems, Autodesk, B RONSTEIN M. M.: Deep functional maps: Structured prediction for
and MESH Inc. dense shape correspondence. In Proc. ICCV (2017). 8