Write For Us

SENTINEL | Dynamics of Gradient Descent and its loss landscape | Deep Learning

E-Commerce Solutions SEO Solutions Marketing Solutions
139 İzlenme

  • Teşekkürler! Arkadaşlarınıza da önerin!

    Bu videoyu beğenmediniz. Dikkate alacağız!

admin
Published
SENTINEL visualizes the optimization process of a convnet in training mode, moving from a high loss value through the creation of an edge horizon to the final convexity and minimum. More details and related analysis about this and other visualizations will be published in the future.
Sentinel is a loss Landscape generated with real data: convnet, imagenette dataset, sgd-adam, bs=16, bn, lr sched, train mod, 100k pts, 0.5 w range, 20p-interp, log scaled (orig loss nums) & vis-adapted, trained with the awesome fast.ai library
In the intersection between research and art, the A.I LL project explores the morphology and dynamics of the fingerprints left by deep learning optimization training processes.
The project goes deep into the training phase of these processes and generates high quality visualizations, using some of the latest deep learning and machine learning research and producing inspiring animations that can both inform and inspire the community.
As the weight space changes through the optimization process, loss landscapes become alive, organic entities that challenge us to unlock the mysteries of learning.
How do these multidimensional entities behave and change as we modify hyperparameters and other elements of our networks?
How can we best tame these wild beasts as we cross their edge horizon on our way to the deepest convexity they hold?
losslandscape.com
Kategori
Belgesel
Yorum yazmak için Giriş yap ya da Üye ol .
Henüz yorum yapılmamış. İlk yorumu siz yapın.