Skip to yearly menu bar Skip to main content


Poster

Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representations

Eirikur Agustsson · Fabian Mentzer · Michael Tschannen · Lukas Cavigelli · Radu Timofte · Luca Benini · Luc V Gool

Pacific Ballroom #133

Keywords: [ Deep Learning ] [ Representation Learning ] [ Optimization for Deep Networks ]


Abstract:

We present a new approach to learn compressible representations in deep architectures with an end-to-end training strategy. Our method is based on a soft (continuous) relaxation of quantization and entropy, which we anneal to their discrete counterparts throughout training. We showcase this method for two challenging applications: Image compression and neural network compression. While these tasks have typically been approached with different methods, our soft-to-hard quantization approach gives results competitive with the state-of-the-art for both.

Live content is unavailable. Log in and register to view live content