| Prethodna tema :: Sljedeća tema |
| Autor/ica |
Poruka |
zega
Pridružen/a: 01. 08. 2005.
Postovi: 5726
Lokacija: USA
|
|
| [Vrh] |
|
 |
stjepan
Pridružen/a: 03. 08. 2009.
Postovi: 1612
Lokacija: Zagreb
|
 Postano: 29.11.2024. pet. 22:49 Naslov: |
 |
|
Andrej Karpathy pokušava demistificirati LLM-ove
https://x.com/karpathy/status/1862565643436138619
| Citat: | People have too inflated sense of what it means to "ask an AI" about something. The AI are language models trained basically by imitation on data from human labelers. Instead of the mysticism of "asking an AI", think of it more as "asking the average data labeler" on the internet.
Few caveats apply because e.g. in many domains (e.g. code, math, creative writing) the companies hire skilled data labelers (so think of it as asking them instead), and this is not 100% true when reinforcement learning is involved, though I have an earlier rant on how RLHF is just barely RL, and "actual RL" is still too early and/or constrained to domains that offer easy reward functions (math etc.).
But roughly speaking (and today), you're not asking some magical AI. You're asking a human data labeler. Whose average essence was lossily distilled into statistical token tumblers that are LLMs. This can still be super useful ofc ourse. Post triggered by someone suggesting we ask an AI how to run the government etc. TLDR you're not asking an AI, you're asking some mashup spirit of its average data labeler. |
|
|
| [Vrh] |
|
|
zega
Pridružen/a: 01. 08. 2005.
Postovi: 5726
Lokacija: USA
|
|
| [Vrh] |
|
|
ogi
Site Admin
Pridružen/a: 25. 07. 2005.
Postovi: 12920
Lokacija: Zagreb
|
| Postano: 4.12.2024. sri. 18:01 Naslov: |
|
|
How many "r"s in the word strawberry?
| Citat: | | There are three "r"s in the word strawberry. |
Kako to znaš?
| Citat: | Haha, jednostavno – brojim ih! 😊 Kad pogledam riječ strawberry, pratim svako slovo i pronađem tri r:
st → nema "r"
r → prva "r"
awbe → nema "r"
r → druga "r"
ry → treća "r"
Rezultat: 3 komada! 🎯 |
|
|
| [Vrh] |
|
|
zega
Pridružen/a: 01. 08. 2005.
Postovi: 5726
Lokacija: USA
|
|
| [Vrh] |
|
|
|
FAQ
Pretražnik
Članstvo
Korisničke grupe
Registracija
Profil
Privatne poruke
Login
