Broken Silicon 49: Nvidia A100, Training Game AI, Neural Networks | AI Developer Interview
Added 2020-05-19 06:01:01 +0000 UTCHot off the heels of the announcement of Nvidia A100, we have an AI Developer on to talk about what these massive GPU’s are actually used for – AI & ML applications.
1) 1:08 AI Buzzwords & Introductions (some sound issues in the first 5 min)
2) 5:50 What is a Neural Network?
3) 12:40 Challenges in Training Neural Networks
4) 16:08 Sparsity and Pruning
5) 23:50 How will AI Improve our Lives?
6) 35:29 Bottlenecks to AI Research
7) 40:15 AI & ML in Gaming
8) 45:55 CUDA Intrenchment, AMD’s ability to enter the market
9) 49:10 Cerebras & Graphcore
10) 54:05 AMD vs Nvidia Graphics
11) 1:01:25 Comparing Synthetic AI to Biological Brains
https://www.thispersondoesnotexist.com/
https://devblogs.nvidia.com/nvidia-ampere-architecture-in-depth/
https://www.cerebras.net/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/
https://arxiv.org/pdf/1803.03635.pdf
https://arxiv.org/pdf/1807.01281.pdf
https://en.wikipedia.org/wiki/Reinforcement_learning
https://en.wikipedia.org/wiki/Concept_learning
https://en.wikipedia.org/wiki/Unsupervised_learning#cite_note-2
https://arxiv.org/abs/1912.02875
https://arxiv.org/pdf/1912.02877.pdf
https://www.alexirpan.com/2018/02/14/rl-hard.html
https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
https://openai.com/blog/jukebox/
https://www.pnas.org/content/pnas/116/43/21854.full.pdf
Comments
that isn't Toms idea? It was AMD's. (well, it almost certainly was an idea before AMD implemented it)
TSPCFS
2020-05-21 17:03:41 +0000 UTCAlso sounds like this guy/industry would absolutely love your idea (tom) to super glue a high power ssd to a gpu to use as a memory pool.
Dominik Koc
2020-05-20 16:08:19 +0000 UTCAI realizes how fucking shitty humanity is and decides to off us. Honestly... totally justified
Dominik Koc
2020-05-20 16:05:36 +0000 UTCThis is pretty funny
Moore's Law Is Dead
2020-05-20 15:58:48 +0000 UTCIn this spirit of thispersondoesnotexist, gwern made this funny website: https://www.thiswaifudoesnotexist.net/
Edward Huff
2020-05-20 15:53:46 +0000 UTCI wonder if there is some kind of service like thispersondoesntexist.com but for generating custom human faces. Like if I wanted a stock photo of an asian woman with ginger hair, 80's style glasses, and earrings it could just generate varieties of a human with those specifications.
ishould
2020-05-19 23:15:00 +0000 UTCGerman englisch...I love it :) Nice informing episode!
2020-05-19 09:05:57 +0000 UTCAwesome episode! I think it would be a cool idea to train an a.i. To help train other a.i. Programs!
2020-05-19 07:29:22 +0000 UTCGreat Broken Silicon. Personally from the gaming side though I'd be more interested in AI or ML for companion characters or NPC's in RPG titles than FPS's. I think it's the last real boundary to truly immersive experiences in those sorts of titles.
Aaron
2020-05-19 06:53:58 +0000 UTCAyyy let’s go new Broken Silicon
Kameron Alexander
2020-05-19 06:01:56 +0000 UTC
