Timezone: »
The Fourier Neural Operator (FNO) is a learning-based method for efficiently simulating partial differential equations. We propose the Factorized Fourier Neural Operator (F-FNO) that allows much better generalization with deeper networks. With a careful combination of the Fourier factorization, weight sharing, the Markov property, and residual connections, F-FNOs achieve a six-fold reduction in error on the most turbulent setting of the Navier-Stokes benchmark dataset. We show that our model maintains an error rate of 2% while still running an order of magnitude faster than a numerical solver, even when the problem setting is extended to include additional contexts such as viscosity and time-varying forces. This enables the same pretrained neural network to model vastly different conditions.
Author Information
Alasdair Tran (Australian National University)
Alexander Mathews (Australian National University)
Lexing Xie (Australian National University)
Cheng Soon Ong (Data61 and Australian National University)
Cheng Soon Ong is a principal research scientist at the Machine Learning Research Group, Data61, CSIRO, and is the director of the machine learning and artificial intelligence future science platform at CSIRO. He is also an adjunct associate professor at the Australian National University. He is interested in enabling scientific discovery by extending statistical machine learning methods.
More from the Same Authors
-
2021 : Gaussian Process Bandits with Aggregated Feedback »
Mengyan Zhang · Russell Tsuchida · Cheng Soon Ong -
2022 : When are equilibrium networks scoring algorithms? »
Russell Tsuchida · Cheng Soon Ong -
2023 Poster: Squared Neural Families: A New Class of Tractable Density Models »
Russell Tsuchida · Cheng Soon Ong · Dino Sejdinovic -
2022 Poster: Fair Wrapping for Black-box Predictions »
Alexander Soen · Ibrahim Alabdulmohsin · Sanmi Koyejo · Yishay Mansour · Nyalleng Moorosi · Richard Nock · Ke Sun · Lexing Xie -
2020 Poster: Quantile Propagation for Wasserstein-Approximate Gaussian Processes »
Rui Zhang · Christian Walder · Edwin Bonilla · Marian-Andrei Rizoiu · Lexing Xie -
2020 Tutorial: (Track1) There and Back Again: A Tale of Slopes and Expectations »
Marc Deisenroth · Cheng Soon Ong -
2019 Poster: Disentangled behavioural representations »
Amir Dezfouli · Hassan Ashtiani · Omar Ghattas · Richard Nock · Peter Dayan · Cheng Soon Ong -
2018 Poster: Representation Learning of Compositional Data »
Marta Avalos · Richard Nock · Cheng Soon Ong · Julien Rouar · Ke Sun -
2016 Poster: A scaled Bregman theorem with applications »
Richard Nock · Aditya Menon · Cheng Soon Ong -
2013 Workshop: Machine Learning Open Source Software: Towards Open Workflows »
Antti Honkela · Cheng Soon Ong -
2011 Poster: Contextual Gaussian Process Bandit Optimization »
Andreas Krause · Cheng Soon Ong -
2010 Workshop: New Directions in Multiple Kernel Learning »
Marius Kloft · Ulrich Rueckert · Cheng Soon Ong · Alain Rakotomamonjy · Soeren Sonnenburg · Francis Bach -
2010 Demonstration: mldata.org - machine learning data and benchmark »
Cheng Soon Ong -
2008 Workshop: Machine Learning Open Source Software »
Soeren Sonnenburg · Mikio L Braun · Cheng Soon Ong