Avi sits down with Illia Polosukhin at Token2049 in Singapore — co-author of “Attention Is All You Need,” the paper every modern AI model is built on, and co-founder of NEAR. Illia starts with his grandparents’ Sberbank savings book going worthless overnight and bread going up a hundredfold in a year in post-Soviet Ukraine, then walks through how transformers actually work: why recurrent models were too slow, what the attention mechanism really does, and why the aliens in Arrival are the right analogy. He left Google while the paper was being written to build a company that would let computers write code. What stopped him wasn’t the compute — it was that he couldn’t pay the students labeling his training data. That detour became NEAR.
From there: the consensus protocols they broke on camera, a standing bounty for fixing Solana, how NEAR went from blockchain to fintech app running four billion a month, why Illia says you should not give your AI agent a private key, the twenty trillion dollar agent commerce thesis, and the full story of the $3.8M exploit — including how they found the attacker, got all the money back, and got an apology on chain.
--
Follow Arthur: https://x.com/CryptoHayes
Follow Avi: https://x.com/AviFelman
Follow Jonah: https://x.com/jvb_xyz
Follow 1000x: https://x.com/1000xPod
Join the 1000x Telegram: https://t.me/thousandxpod
Try the 1000x Terminal: https://1000x.money
--
Timestamps:
00:00 Coming Up on 1000x...
01:01 Ukraine, Hyperinflation, And Science Fiction
02:59 “A Machine Should Write This Code”
07:30 Joining Google, And Inventing The Transformer
16:07 Leaving Google, And Stumbling Into Crypto
20:35 The Protocols They Broke On A Whiteboard
23:29 Chain Abstraction, And Building NEAR.com
33:15 What AI x Blockchain Actually Means
39:42 The $3.8M Exploit, And The Apology
--
Disclaimer: Nothing said on 1000x is a recommendation to buy or sell securities or tokens. This podcast is for informational purposes only, and any views expressed by anyone on the show are solely our opinions, not financial advice. Avi, Jonah and our guests may hold positions in the companies, funds, or projects discussed.