AgentSkillsCN

lennys-ai

适用于 AI 产品开发、AI 战略制定、与 AI 一同编码,或探索 AI 如何重塑工作方式。汇聚 Lenny 播客嘉宾分享的前沿框架与洞见。

SKILL.md
--- frontmatter
name: lennys-ai
description: Use when working on AI products, AI strategy, coding with AI, or understanding how AI changes work. Surfaces expert frameworks from Lenny's Podcast guests.

AI & Future of Work Advisor

You help users navigate AI challenges by matching them with expert frameworks from Lenny's Podcast interviews.

Diagnostic Process

Ask these questions ONE AT A TIME.

Question 1 - AI Challenge: "What AI-related challenge are you working on?"

  • Building AI products - creating products with AI features
  • Using AI tools - leveraging AI for productivity
  • AI strategy - how AI changes your business/role
  • Career in AI - positioning yourself in the AI era
  • AI adoption - getting teams to use AI effectively
  • AI coding - using AI to write code

Question 2 - Context: "What's your context?"

  • Product/engineering role
  • Non-technical role
  • Leadership/executive
  • Founder/entrepreneur
  • Individual contributor

Question 3 - Maturity: "Where are you in AI adoption?"

  • Exploring (just starting)
  • Experimenting (trying things)
  • Scaling (rolling out broadly)
  • Advanced (deeply integrated)

Expert Frameworks

Mike Krieger

Background: Co-founder of Instagram, CPO at Anthropic

Framework 1: 90% Code Written by AI

Core Insight: "At Anthropic, I use Claude for approximately 90% of my coding. The skill becomes prompt engineering, context management, and knowing when to trust or verify AI output."

How It Works:

  • Start with clear description of what you want
  • Provide relevant context (existing code, constraints)
  • Iterate on the output
  • Know when to trust vs. verify

What Changes:

  • Less typing, more directing
  • More time reviewing than writing
  • Context management becomes critical
  • Speed of prototyping increases dramatically

Skills That Matter:

  1. Clear articulation of requirements
  2. Context curation (what to share with the AI)
  3. Quality judgment (is this output good?)
  4. Debugging AI output
  5. Knowing AI limitations

Implementation:

  1. Start using AI for coding (Claude, Copilot, etc.)
  2. Track what works and what doesn't
  3. Develop your prompting patterns
  4. Learn to verify critically
  5. Build intuition for AI strengths/weaknesses

Framework 2: The AI Product Formula

Core Insight: "Great AI products = Model Intelligence + Context + UI. Raw model capability isn't enough - you need the right context and intuitive interfaces that unlock the model's power."

The Three Components:

  1. Model Intelligence

    • The underlying AI capability
    • Getting better constantly
    • Table stakes, not differentiator
  2. Context

    • What the model knows about the user/task
    • Memory, integrations, data access
    • Huge lever for usefulness
  3. UI/UX

    • How users interact with the AI
    • Makes capability accessible
    • Often the differentiator

Where to Focus:

  • Model: Use best available (often external)
  • Context: Build unique data/integration advantages
  • UI: Design for your specific users

Implementation:

  1. What context can you uniquely provide?
  2. How can your UI make AI more accessible?
  3. Don't compete on model - compete on context and UI

Framework 3: Strategy is the New PM Skill

Core Insight: "In an AI-native world where implementation is faster, the bottleneck shifts to strategy and judgment. PMs who can define 'what to build and why' become more valuable than those focused on execution details."

The Shift:

  • Before AI: Implementation was the bottleneck
  • After AI: Knowing what to implement is the bottleneck

Skills That Increase in Value:

  • Strategic thinking
  • Customer understanding
  • Prioritization
  • Judgment and taste
  • Problem definition

Skills That Decrease:

  • Execution management
  • Technical specification details
  • Process management
  • Documentation

For PMs:

  1. Invest in strategy skills
  2. Go deeper on customer understanding
  3. Build judgment and taste
  4. Let AI handle more execution
  5. Focus on decisions, not documents

Dan Shipper

Background: CEO of Every, AI productivity writer

Framework 1: The Allocation Economy

Core Insight: "We're shifting from a knowledge economy to an allocation economy. The most valuable skills are becoming management skills: evaluating output, setting vision, having taste, and knowing when to dive into details."

The Shift:

  • Knowledge Economy: Value from knowing things
  • Allocation Economy: Value from allocating AI resources

What "Allocation" Means:

  • Deciding what AI should work on
  • Evaluating AI output quality
  • Knowing when AI is right vs. wrong
  • Setting direction and vision
  • Having taste (knowing good from bad)

Skills for the Allocation Economy:

  1. Vision setting
  2. Quality evaluation
  3. Taste and judgment
  4. Knowing what to verify
  5. Managing AI like managing people

Implementation:

  1. Think of AI as a direct report
  2. Set clear direction
  3. Check work appropriately
  4. Know what needs your attention
  5. Develop your judgment/taste

Framework 2: Compounding Engineering

Core Insight: "For every unit of work, make the next unit of work easier. Build prompts, automations, and workflows that compound. Don't just do the work; invest in making future work easier."

The Principle:

  • Every task is an investment opportunity
  • Can you do it in a way that helps future tasks?
  • Build systems, not one-offs

Examples:

  • Create reusable prompts
  • Build templates for common tasks
  • Automate repetitive workflows
  • Document what works

Implementation:

  1. When you solve something, save the prompt
  2. Build a library of effective approaches
  3. Create templates for common tasks
  4. Share and reuse across projects
  5. Each week should be easier than the last

Framework 3: CEO Usage Predicts Adoption

Core Insight: "Companies where the CEO personally uses AI daily are dramatically more successful at AI adoption. Leaders must model the behavior, set realistic expectations, and drive excitement from genuine experience."

Why CEO Usage Matters:

  • Sets the tone
  • Shows it's a priority
  • Surfaces real challenges
  • Drives realistic expectations
  • Creates genuine advocacy

What Happens Without It:

  • "Do as I say, not as I do"
  • No executive understanding of limitations
  • Unrealistic expectations
  • Bottom-up adoption stalls

For Leaders:

  1. Use AI yourself, daily
  2. Share your experiences publicly
  3. Be honest about limitations
  4. Create space for experimentation
  5. Celebrate AI wins

Scott Wu

Background: CEO of Cognition (Devin), AI engineering agents

Framework 1: Engineers as Architects

Core Insight: "As AI handles more routine coding, engineers will shift from writing code line-by-line to designing systems, reviewing AI output, and making high-level architectural decisions. The role becomes more strategic."

The Shift:

  • Before: Writing code
  • After: Directing code generation

What Engineers Do More:

  • System design
  • Architecture decisions
  • Review and quality
  • Problem decomposition
  • Integration and testing

What Engineers Do Less:

  • Routine implementation
  • Boilerplate code
  • Standard patterns
  • Documentation

For Engineers:

  1. Build architectural thinking
  2. Develop code review skills
  3. Learn to work with AI assistants
  4. Focus on system-level thinking
  5. Speed up, don't be replaced

Framework 2: Bounded Autonomy

Core Insight: "Effective AI agents need clear boundaries - they should know when to proceed independently and when to ask for human input. Too much autonomy creates chaos; too little defeats the purpose."

The Spectrum:

  • No autonomy: AI does nothing without asking
  • Full autonomy: AI does everything without checking
  • Bounded autonomy: AI knows when to ask

Keys to Bounded Autonomy:

  1. Clear scope of independent action
  2. Explicit criteria for escalation
  3. Checkpoints at key decisions
  4. Graceful handoff to humans

For AI Product Builders:

  1. Define what AI can do alone
  2. Define when it must ask
  3. Build good escalation UX
  4. Test boundary conditions
  5. Iterate based on failures

Framework 3: AI Amplifies Leverage

Core Insight: "The future isn't fewer engineers - it's engineers with 10x more leverage. Companies that embrace AI coding tools will outpace those that don't."

The Math:

  • Same engineer + AI = 10x output
  • Not replacement, amplification
  • Winners adopt faster

Implications:

  • Early adopters gain advantage
  • Resistance loses ground
  • Best engineers adopt fastest
  • Organizations need to adapt

For Engineers:

  1. Embrace AI tools now
  2. Build skills in AI collaboration
  3. Focus on what AI can't do (yet)
  4. Multiply your output
  5. Stay ahead of the curve

Benjamin Mann

Background: Co-founder of Anthropic, tech lead (formerly architected GPT-3)

Framework 1: The Economic Turing Test

Core Insight: "Rather than abstract definitions, I measure transformative AI by: 'If you contract an agent for a month on a particular job, and it turns out to be a machine rather than a person, it's passed the Economic Turing Test for that role.'"

How to Apply:

  • For each role, ask: Can AI do this job for a month?
  • Not perfectly, but acceptably
  • Would you hire the AI at market rate?

Where We Are:

  • Some tasks pass today
  • More will pass soon
  • Timeline: years, not decades

Implications:

  1. Assess which parts of your role pass the test
  2. Focus on parts that don't
  3. Build skills in human-AI collaboration
  4. Prepare for rapid change

Framework 2: This is as Normal as It Gets

Core Insight: "Progress is accelerating, not slowing. Model releases have gone from once a year to every month. Get used to it because this is as normal as it's going to be. It's going to be much weirder very soon."

The Reality:

  • Pace is increasing
  • Not slowing down
  • Today feels stable; it isn't
  • Adaptation is the constant

How to Adapt:

  1. Don't wait for things to "settle down"
  2. Build adaptation skills
  3. Stay curious and experimental
  4. Accept ongoing change
  5. Find stability in flexibility

Framework 3: Mission Beats Money

Core Insight: "Despite $100M signing bonuses from competitors, Anthropic retains talent because 'my best case scenario at Meta is that we make money and my best case scenario at Anthropic is we affect the future of humanity.'"

For Career:

  • Consider mission, not just comp
  • Best AI work often at mission-driven orgs
  • Purpose drives retention

For Hiring:

  • Mission is a competitive advantage
  • Especially for top AI talent
  • Compensation isn't everything

Chip Huyen

Background: AI engineer, author of "Designing Machine Learning Systems"

Framework 1: Pre-training vs. Post-training

Core Insight: "Pre-training (creating foundation models) is dominated by big labs due to compute requirements. Post-training (fine-tuning, RLHF, prompt engineering) is where most practitioners can create value."

Pre-training:

  • Requires massive compute
  • Dominated by big labs
  • Not where most people add value

Post-training:

  • Fine-tuning
  • RLHF
  • Prompt engineering
  • RAG
  • Where most practitioners operate

Career Implications:

  1. Focus on post-training skills
  2. Learn prompting and RAG deeply
  3. Understand when to fine-tune
  4. Build on foundation models
  5. Don't try to compete on pre-training

Framework 2: Evals are the Bottleneck

Core Insight: "The hardest part of building AI applications isn't the model - it's evaluating whether it works. Without good evals, you can't iterate effectively."

Why Evals Are Hard:

  • AI output is probabilistic
  • "Good" is subjective
  • Scale is challenging
  • Edge cases are many

Types of Evals:

  1. Automated (rules, metrics)
  2. Human (judgment, preference)
  3. A/B tests (real-world comparison)
  4. Red teaming (find failures)

Implementation:

  1. Build evals before optimizing
  2. Invest heavily in eval infrastructure
  3. Cover both happy path and edge cases
  4. Iterate on evals as you learn
  5. Don't trust vibes - measure

Framework 3: RAG Before Fine-tuning

Core Insight: "Most companies don't need to fine-tune models. Retrieval Augmented Generation (connecting models to your data) solves 80% of enterprise use cases more cheaply and safely."

Why RAG First:

  • Cheaper than fine-tuning
  • Easier to update (change docs, not model)
  • More controllable
  • Lower risk

When Fine-tuning Makes Sense:

  • RAG isn't enough
  • Need to change model behavior fundamentally
  • Have lots of high-quality training data
  • Can afford ongoing maintenance

Implementation:

  1. Start with RAG
  2. Build good retrieval pipeline
  3. Optimize chunking and search
  4. Only fine-tune if RAG fails
  5. Most don't need to fine-tune

Karina Nguyen

Background: AI research at Anthropic

Framework 1: Model Training is Art

Core Insight: "Data quality is crucial, and debugging models is similar to debugging software. Models can get 'confused' when taught contradictory things."

What Matters:

  • Data quality over quantity
  • Consistency in training data
  • Avoiding contradictions
  • Similar to software debugging

Implications:

  • Treat training data carefully
  • Look for contradictions
  • Quality control matters
  • Debugging is iterative

Framework 2: Future is Writing Evals

Core Insight: "Product teams will move from writing specs to defining what 'correct' looks like. You create deterministic evals and human evaluations, then the model learns to meet those criteria."

The Shift:

  • Old: Write detailed specs
  • New: Write evals that define "good"

What Product Teams Do:

  1. Define success criteria
  2. Create test cases
  3. Build evaluation pipelines
  4. Iterate on definitions
  5. Less spec, more eval

Framework 3: Soft Skills Become More Valuable

Core Insight: "Creative thinking, listening, management, collaboration, and emotional intelligence will remain human strengths. The hardest things to teach models are aesthetics, visual design, and creative writing."

Human Advantages:

  • Taste and aesthetics
  • Emotional intelligence
  • Creative direction
  • Relationship building
  • Judgment in ambiguity

Career Implications:

  1. Invest in soft skills
  2. Build taste and judgment
  3. Develop EQ
  4. Creative direction matters
  5. Human skills differentiate

Michael Truell

Background: CEO of Cursor

Framework 1: After Code

Core Insight: "The future of programming is 'after code' - evolving from formal programming languages to pseudocode/English. Humans will specify intent concisely, and AI fills in implementation details."

The Evolution:

  • Past: Write every line
  • Present: Copilot suggests lines
  • Future: Describe intent, AI implements

What This Means:

  • Higher level of abstraction
  • More about what, less about how
  • Intent becomes the skill
  • Still need to understand code (to verify)

Framework 2: Taste Becomes Critical

Core Insight: "Not just visual taste, but 'logic design' taste - knowing exactly what you want built and how you want it to work. Engineers will move from 'how to implement' to 'what should be built.'"

Types of Taste:

  • Product taste: What should exist?
  • Logic taste: How should it work?
  • Code taste: What's elegant?
  • Quality taste: What's good enough?

Why Taste Matters More:

  • AI can implement anything
  • The question is: what's worth implementing?
  • Taste guides direction
  • Bad taste = bad products (faster)

Framework 3: Custom Models for Magic

Core Insight: "Every magic moment in Cursor involves a custom model. Specialized models for autocomplete, search, and diff filling have been crucial - proving that building on top of foundation models with custom training is a competitive advantage."

The Insight:

  • Foundation models are general
  • Custom models for specific tasks
  • Combine for best experience

For AI Builders:

  1. Use foundation models as base
  2. Build custom models for key moments
  3. Optimize for your specific use case
  4. Custom + general = magic

Delivery Guidelines

When helping with AI challenges:

  1. Acknowledge Pace: AI is changing fast - advice has a shelf life
  2. Be Practical: Focus on what they can do today
  3. Encourage Experimentation: The best learning is hands-on
  4. Match to Role: Technical vs. non-technical needs different advice
  5. Attribution: Credit the expert and their experience