Timezone: »
Verification is a serious bottleneck in the industrial hardware design cycle, routinely requiring person-years of effort. Practical verification relies on a "best effort" process that simulates the design on test inputs. This suggests a new research question: Can this simulation data be exploited to learn a continuous representation of a hardware design that allows us to predict its functionality? As a first approach to this new problem, we introduce Design2Vec, a deep architecture that learns semantic abstractions of hardware designs. The key idea is to work at a higher level of abstraction than the gate or the bit level, namely the Register Transfer Level (RTL), which is somewhat analogous to software source code, and can be represented by a graph that incorporates control and data flow. This allows us to learn representations of RTL syntax and semantics using a graph neural network. We apply these representations to several tasks within verification, including predicting what cover points of the design will be exercised by a test, and generating new tests that will exercise desired cover points. We evaluate Design2Vec on three real-world hardware designs, including an industrial chip used in commercial data centers. Our results demonstrate that Design2Vec dramatically outperforms baseline approaches that do not incorporate the RTL semantics, scales to industrial designs, and can generate tests that exercise design points that are currently hard to cover with manually written tests by design verification experts.
Author Information
Shobha Vasudevan (Google)
Wenjie (Joe) Jiang (Google Brain)
I am currently working in Google Brain, focused on applying deep reinforcement learning to design and optimize accelerator software and hardware systems. Before that, I worked in Google's network analysis and optimization team. I applied a variety of mathematical techniques to solving network optimization problems. I obtained my PhD from Princeton University, where my research focus was on distributed systems, and network optimization.
David Bieber (Google)
Rishabh Singh (Google Brain)
hamid shojaei (Google)
C. Richard Ho (Google)
Charles Sutton (Google)
More from the Same Authors
-
2021 : Type Inference as Optimization »
Eirini V. Pandi · Earl Barr · Andrew Gordon · Charles Sutton -
2021 Poster: A Bayesian-Symbolic Approach to Reasoning and Learning in Intuitive Physics »
Kai Xu · Akash Srivastava · Dan Gutfreund · Felix Sosa · Tomer Ullman · Josh Tenenbaum · Charles Sutton -
2020 : closing talk »
Augustus Odena · Charles Sutton -
2020 : Panel »
Augustus Odena · Charles Sutton · Roopsha Samanta · Xinyun Chen · Elena Glassman -
2020 : Satish Chandra Talk »
Satish Chandra · Augustus Odena · Charles Sutton -
2020 : Spotlight Session 2 »
Augustus Odena · Kensen Shi · David Bieber · Ferran Alet · Charles Sutton · Roshni Iyer -
2020 : Spotlight Session 1 »
Augustus Odena · Maxwell Nye · Disha Shrivastava · Mayank Agarwal · Vincent J Hellendoorn · Charles Sutton -
2020 Workshop: Workshop on Computer Assisted Programming (CAP) »
Augustus Odena · Charles Sutton · Nadia Polikarpova · Josh Tenenbaum · Armando Solar-Lezama · Isil Dillig -
2020 Poster: Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks »
David Bieber · Charles Sutton · Hugo Larochelle · Danny Tarlow -
2020 Poster: Learning Discrete Energy-based Models via Auxiliary-variable Local Exploration »
Hanjun Dai · Rishabh Singh · Bo Dai · Charles Sutton · Dale Schuurmans -
2019 : Contributed Talk: Neural-Guided Symbolic Regression with Asymptotic Constraints »
Rishabh Singh -
2019 Poster: Learning Transferable Graph Exploration »
Hanjun Dai · Yujia Li · Chenglong Wang · Rishabh Singh · Po-Sen Huang · Pushmeet Kohli -
2018 : Panel on research process »
Zachary Lipton · Charles Sutton · Finale Doshi-Velez · Hanna Wallach · Suchi Saria · Rich Caruana · Thomas Rainforth -
2018 : Charles Sutton »
Charles Sutton -
2018 Poster: Interpreting Neural Network Judgments via Minimal, Stable, and Symbolic Corrections »
Xin Zhang · Armando Solar-Lezama · Rishabh Singh -
2018 Poster: HOUDINI: Lifelong Learning as Program Synthesis »
Lazar Valkov · Dipak Chaudhari · Akash Srivastava · Charles Sutton · Swarat Chaudhuri -
2017 Poster: VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning »
Akash Srivastava · Lazar Valkov · Chris Russell · Michael Gutmann · Charles Sutton -
2016 Workshop: Towards an Artificial Intelligence for Data Science »
Charles Sutton · James Geddes · Zoubin Ghahramani · Padhraic Smyth · Chris Williams -
2015 Poster: Latent Bayesian melding for integrating individual and population models »
Mingjun Zhong · Nigel Goddard · Charles Sutton -
2015 Spotlight: Latent Bayesian melding for integrating individual and population models »
Mingjun Zhong · Nigel Goddard · Charles Sutton -
2014 Poster: Semi-Separable Hamiltonian Monte Carlo for Inference in Bayesian Hierarchical Models »
Yichuan Zhang · Charles Sutton -
2014 Poster: Signal Aggregate Constraints in Additive Factorial HMMs, with Application to Energy Disaggregation »
Mingjun Zhong · Nigel Goddard · Charles Sutton -
2012 Poster: Continuous Relaxations for Discrete Hamiltonian Monte Carlo »
Zoubin Ghahramani · Yichuan Zhang · Charles Sutton · Amos Storkey -
2012 Spotlight: Continuous Relaxations for Discrete Hamiltonian Monte Carlo »
Zoubin Ghahramani · Yichuan Zhang · Charles Sutton · Amos Storkey -
2011 Poster: Quasi-Newton Methods for Markov Chain Monte Carlo »
Yichuan Zhang · Charles Sutton