Revesery
Dashboard
Home
Explore
Groups
Jobs
Tools
Rewards
Social Media
VideoBulk VideoProfile PictureSlide ShowSound / AudioUnfollowersDouyin
VideoBulk Video
VideoStoriesBulk VideoProfile PictureSlide ShowUnfollowersStalker CheckSoon
VideoUnfollowersLink Cleaner
MP4 · VideoMP3 · Audio
WhatsApp
Profile PictureCover Art & Preview
Profile Picture
Video & Image
Video & Photo
Utilities
AI Chat
Fake SNBTWatermark KTP
TeraboxVidey
Deep Voice CheckerReview Calculator
Surat IzinFoto Hijau Biru MerahQR GeneratorSoon
Case ConverterCookie Converter
Request a toolImage ToolsSoonText ToolsSoon
Premium
Soon
Add bookmarks
Revesery
HomeExploreGroupsJobsContributors
Most read
↑↓ selectEnter openEsc close/ to search from anywhere
Login
J
JenExplorer
@jen · Oct 5, 2026 · 146 views
#AI#News

Karpathy on Software 3.0 and the Attention Breakthrough

Andrej Karpathy has a way of making a decade of AI feel like one straight line. If you build with LLMs, generative AI, agents, or transformers, his breakdown of how programming got here is the framing worth keeping. It is short, concrete, and it explains why the work looks different than it did five years ago.

There is nothing to install here. What you get is the mental model, plus one line you will probably want to remember.

Karpathy on Software 3.0 and the Attention Breakthrough

What Happened

Karpathy traces the path in five stops: traditional software, neural networks, transformers, GPTs, and what he calls Software 3.0.

The turning point was "Attention Is All You Need", the 2017 paper that changed the trajectory of AI. The idea sounds almost too plain. Instead of building ever more complex architectures on top of RNNs, you remove the RNN and keep the attention. That opened the door to the transformer era we are living through now.

He then reframes what programming itself is:

  • Software 1.0 — design the algorithm.
  • Software 2.0 — design the dataset.
  • Software 3.0 — design the prompt.

And the line worth bookmarking: "The hottest new programming language is English."

Why It Matters

A prompt can increasingly be treated as a program, with the LLM acting as the system that interprets and runs the instructions. That matters because transformers work across text, images, and speech, and GPTs start to behave less like one tool and more like a general-purpose computer.

If natural language is the new interface, then knowing what you want and saying it precisely is the skill. Frames like this one are how you keep up with where all of it is heading.

Liked Jen's share? Revesery is where people swap what they're actually building.

Join with Google

Comments

Join the conversation — sign in to comment.

Sign In Now

No comments yet — start the conversation!

Read it later?
We'll email you the link to this share. Nothing else.

More shares you might like

AIStand With Jensen Petition Passes 89,000 SignaturesJen · 14h · 22 viewsAIHow to Break Down Any Video With rea-videoJen · 1d · 37 viewsAIHow to Claim 1 Month of SuperGrok for FreeJen · 3d · 68 viewsNews500+ AI Agent Projects Land on GitHub With 39K StarsJen · 3d · 53 viewsToolsHow to Sign Up for Amazon Associates on Your PhoneJen · 4d · 49 viewsAIHow to Claim 20,000 Free Clocked AI API CreditsJen · 4d · 70 views

Trending this week

Ranked by how many people read each share in the last 7 days, each person counted once. Bots, the author and clicks from this list don't count. Shares from the last 14 days with a real write-up. Refreshed every 5 minutes.
  1. 1How to Get 2 Years of Google AI Pro Free@jen174 views this week
  2. 2How to Make a Ghostly Abandoned Village Video With AI@alex48 views this week
  3. 3How to Claim 20,000 Free Clocked AI API Credits@jen43 views this week
  4. 4How to Get Six Months of Codex for Free@calvin43 views this week
  5. 5How to Claim 1B Muse AI Tokens@alex40 views this week
See more on Explore

Site footer

Revesery

Empowering people to share valuable insights, discover hidden information, and connect with an amazing community of learners and experts.

  • 708Members
  • 855Shares published

Explore

  • Explore shares
  • Top contributors
  • Feedback

Company

  • About us
  • Editorial policy
  • Contact
  • Advertise with us
  • System status
© 2026 Revesery
  • Privacy
  • Terms
  • Trust & Safety
  • DMCA
HomeExploreShareToolsProfile
PRPetra Ral joined Revesery4 hours ago