robertskmiles

robertskmiles

Computerphile Video: ChatGPT

Added 2023-02-01 16:44:05 +0000 UTC

I made a new video with Computerphile, about ChatGPT!

https://www.youtube.com/watch?v=viJt_DXTfwA

Language Models, Simulacra, Reinforcement Learning from Human Feedback, Scaling and Inverse Scaling, Sycophancy and Deception and Instrumental Convergence!

Computerphile Video: ChatGPT

Comments

Thanks for your response. Much appreciated. I’m not sure I understand all of it, but after reading several times, I’m assuming the way I’m trying to keep all this simple, so I can explain it to my kids and some friends is not totally off. Thanks again. Simplifying without being completely wrong is not easy. Especially, when I barely know what I’m talking about. :) The little I’ve read from academic research about LLMs was enough to convince me that I should stick to Youtube tutorials. On finetuning, you might be interested in what David Shapiro says about it. It starts at 7:50 of his presentation. This was posted four months ago, so might be already obsolete. :). https://youtu.be/9qq6HTr7Ocw

2023-06-03 19:08:52 +0000 UTC

To add to what Boris said: "Prompt engineering" vectors towards terms like "clarity of composition, relevance of words, completeness, consistency in style, simplicity of composition and variety of examples." It was something that I targeted in my first two weeks of working with LLMs (ChatGPT) and working to build my understanding of the strengths and weaknesses of particular prompts, and how to use that knowledge to achieve token economy. To support the other things he said: RE: 4 - Fine tuning is, as I understand it, training the AI with additional domain specific examples. Variety of examples can be very helpful in reducing the token requirements for achieving desirable output consistently. RE: 3 - Self reflection papers have been written on how the model is forward-only text prediction, and feedback back its text prediction into reflection can improve the overall quality of the final output. (e.g., Just because it is statistically probable that a human will make a logic mistake, does not mean that the logic mistake is desirable output. Self reflection encourages a model to self assess its own output for desirability and to refine it output based on training.) RE: 1 - A statistical prediction engine is not thinking. ChatGPT lacks several other attributes commonly associated with intelligence. It has no executive function. Projects like AutoGPT want to mitigate some of these deficiencies. Someone I do not respect suggested that ChatGPT is little more than a stochastic parrot. While the analogy has flaws, I find it amusing enough that I like to share the idiom.

2023-05-28 22:01:09 +0000 UTC

Related Creators

snickelsox

snickelsox

patreon

Marco Sanasi Photography

Marco Sanasi Photography

patreon

sp3dresources

sp3dresources

patreon

ノノリリン

ノノリリン

fanbox

ximm

ximm

patreon

Chroneco

Chroneco

gumroad

LuckyLynx

LuckyLynx

patreon

Lewdopod

Lewdopod

gumroad

SynKyactus

SynKyactus

gumroad

CybroArt

CybroArt

patreon

OhGosh!

OhGosh!

patreon

Allbadbadgers Emporium

Allbadbadgers Emporium

gumroad

MartyZ

MartyZ

patreon

MonoManiac

MonoManiac

patreon

Maggiescappies

Maggiescappies

patreon

Derek Patrick Ngo

Derek Patrick Ngo

gumroad

Unique_Writer

Unique_Writer

patreon

cosmelucero

cosmelucero

patreon

ゔぇのむとかげ

ゔぇのむとかげ

fanbox

ADDD123

ADDD123

patreon

kurominehiraya

kurominehiraya

fanbox

aromasensei

aromasensei

patreon

ニート社長 / CEO NEET

ニート社長 / CEO NEET

gumroad

CyukiUWU

CyukiUWU

patreon

Jennifer -Jennisims

Jennifer -Jennisims

patreon

DANEZ

DANEZ

gumroad

HoneyHappy

HoneyHappy

patreon

JADEAI

JADEAI

patreon

Lazy Bloodlines

Lazy Bloodlines

patreon

Navillus Studio Store

Navillus Studio Store

gumroad

樹画祭(シュハジ)🔞

樹画祭(シュハジ)🔞

fanbox

breeze123

breeze123

patreon

Kirill Grivenyuk

Kirill Grivenyuk

patreon

白い箪笥

白い箪笥

fanbox

ΣΛοΠε

ΣΛοΠε

fanbox

RuhisuART

RuhisuART

patreon

TeamK4L

TeamK4L

patreon

dreamertooth

dreamertooth

patreon

Sandishee

Sandishee

patreon

InDarkWaters

InDarkWaters

patreon

tingly

tingly

patreon

MarkusJones

MarkusJones

patreon

高円寺☆ゴロー

高円寺☆ゴロー

fantia

kanibiimu

kanibiimu

fanbox

doctorsoul

doctorsoul

patreon

Siggy_Atrox

Siggy_Atrox

patreon

ayanami00menasu7

ayanami00menasu7

fanbox

enterfurryworld

enterfurryworld

patreon

NIXXXBOT

NIXXXBOT

patreon

Kadath

Kadath

gumroad