Robot Wiki

The Pi Line

pi0 to pi0.7: flow-matching action experts, FAST tokenization, open-world generalization, and source-scoped checkpoint availability.

Last reviewed
Reading time
16 min
Citations
13

The VLA module ended on a bottleneck: discrete action tokens let a web-pretrained model emit actions with the machinery it already has, but autoregressive decoding caps the control rate an order of magnitude below what dexterous manipulation needs. Physical Intelligence's pi line answers it with a different split of labor. Keep the pretrained backbone, replace the token head with a flow-matching action expert, and then keep fixing what that first design got wrong. This module walks the line from π0 (October 2024) to π0.7 (April 2026), including what the pinned checkpoint catalogue actually lists.

The whole design rests on one empirical curve. Drag the integration steps slider below from 1 upward: at one or two steps the transported cloud misses the action modes badly, by five to ten it has concentrated on them, and pushing to 50 buys nothing measurable. That is why a flow-matching head can close a 50 Hz loop where an autoregressive token head cannot.

-3-2-10123action space (2 dims of the H x 14 chunk shown)mode Amode B

k = 10 Euler steps mean endpoint error 0.05

With 10 Euler steps the 48 samples travel near-straight from Gaussian noise toward the two action modes and finish at mean endpoint error 0.05; one step would cut the corner, 50 steps is more compute than a 50 Hz loop can spend.

Current flow-matching transport
Euler steps
10
samples
48
endpoint error
0.05
regime
on the modes

Illustrative model: 48 samples with a fixed seed, transported from Gaussian noise to two action modes along the near-straight paths of rectified flow matching. The learned field is slightly imperfect (the paths carry a small bend), so the step count trades accuracy against latency: one Euler step cuts the corner and lands short, 5-10 steps land on the modes, and 50 steps is compute a 50 Hz control loop cannot spend. pi0 shipped 10 steps; pi0.6 and pi0.7 run 5. The real expert integrates a whole 50-step action chunk jointly; this view shows 2 of its dimensions.

π0: the action expert

π0 grafts a second transformer onto a pretrained vision-language model Black 2024. The first set of weights handles image and text tokens and is initialized from PaliGemma. The second set, the action expert, handles robotics-specific tokens and has approximately 300M parameters in the paper’s implementation. The structural point matters for anyone implementing one: the action expert is not an MLP head but a second set of transformer weights inside a single model, in the paper's words "a single transformer with two sets of weights (also known as experts)." It is a full transformer whose 50 action tokens attend into the backbone's activations at every layer through shared self-attention, with a bidirectional mask among themselves. Observations are 2 or 3 RGB images, tokenized language, and proprioceptive state; the model predicts H = 50 actions. The paper’s UR5e and Franka setups run at 20 Hz and execute 16 actions before another inference; other tested robots run at 50 Hz and execute 25 Black 2024. Whether the system then runs all fifty of those actions is a separate question: this is the predicted horizon, and how much of it a π release actually commits before the next inference is what the later sections of this module track.

Where Diffusion Policy denoises with a DDPM, π0 trains the expert with conditional flow matching on a straight transport path. Sample noise εN(0,I)\varepsilon \sim \mathcal{N}(0, I), form the interpolant Atτ=τAt+(1τ)εA_t^\tau = \tau A_t + (1 - \tau)\varepsilon, and regress the network vθv_\theta onto the target vector field u=Atεu = A_t - \varepsilon, with the training timestep τ\tau drawn from a beta distribution weighted toward the noisy end. At inference, integrate from τ=0\tau = 0 to τ=1\tau = 1 with forward Euler in 10 steps; the image-text-state prefix is KV-cached once, so each step recomputes only the action-token suffix, which is what makes 10 steps affordable Black 2024.

~300M
action expert
PaliGemma-initialized VLM; no total asserted here
H = 50
predicted chunk
Executes 16 at 20 Hz or 25 at 50 Hz, by setup
10
Euler steps
KV-cached prefix
~10k h
demonstrations
7 robot configurations, 68 tasks; plus OXE data

Cross-embodiment training combines data from robot types with different configuration spaces and action representations, including single-arm, dual-arm and mobile manipulators Black 2024. The paper separates broad pre-training from task-specific post-training: the base model performs tasks at what the authors call “rudimentary proficiency,” while complex tasks such as laundry folding use curated post-training data Black 2024. Its v4 execution description commits 16 of the 50 predicted actions on UR5e/Franka and 25 on the other tested robots, rather than a universal 50-step commitment. The RTC paper later evaluates asynchronous execution against stopping between chunks using π0.5; that experiment is not evidence that every original π0 deployment executed all 50 predictions Black 2025.

Why ten steps is enough

Flow matching's selling point over diffusion is path geometry. A DDPM trajectory curves through noise space; the rectified flow path from noise to action is nearly a straight line, so a coarse Euler integration tracks it well. That is what the figure at the top of this module measures: samples start as Gaussian noise in a 2D action space and are transported toward two action modes under a fixed integration budget.

Each Euler step samples the field once and cuts the corner on everything the field does between samples, which is why one or two steps miss. The shape of that curve is the whole deployment argument. Every step costs a forward pass through the expert, and at 50 Hz the budget is fixed by physics, not by GPU spend: π0 uses 10 integration steps Black 2024. π0.6 reports five steps and 63 ms per chunk on one H100 with three cameras Physical Intelligence 2025. π0.7 also uses five denoising steps in its experiments Ai 2026. Those step counts and π0.6’s hardware-specific chunk latency do not measure a common robot-control frequency. The consistency and one-step distillation line covered in Diffusion Policy exists for the same reason.

π0-FAST: tokens done right

Pertsch 2025 FAST diagnoses a weakness of simple per-dimension, per-timestep binning: highly correlated action tokens can make next-token prediction too easy, for example by copying a previous token. In the paper’s evaluations, policies trained with this naïve tokenization make no progress on table bussing at 20 Hz or T-shirt folding at 50 Hz. This is a result for those training setups, not a claim that every discretization fails.

FAST normalizes each action dimension, applies a discrete cosine transform along time, scales and rounds the coefficients, and byte-pair-encodes their flattened sequence. Rounding trades reconstruction fidelity for compression; the BPE stage losslessly compresses the quantized integers. The universal FAST+ tokenizer is trained on approximately one million one-second action chunks, spanning different embodiments, action spaces and control frequencies. The abstract calls these trajectories, but Section V-C states the more precise chunk unit Pertsch 2025.

The paper trains π0-FAST on a 10k-hour cross-embodied robot-data mixture. In its generalist comparison, π0-FAST matches the compared π0 task performance with five times fewer GPU hours of training. The abstract summarizes the benefit as "up to 5x"; it is a training-compute result, not an inference speedup or a universal training-step ratio Pertsch 2025. Inference is a separate trade-off. The FAST paper reports approximately 750 ms per one-second action chunk on an NVIDIA 4090 for π0-FAST, versus within 100 ms for its diffusion π0 comparison; decoding typically requires 30 to 60 action tokens instead of ten diffusion steps. Separately, the Knowledge Insulation note reports that π0-FAST took twice as long to solve the single-embodiment table-bussing task in its comparison. That is task wall-clock time, not a generic twofold inference ratio Pertsch 2025 Driess 2025. The later KI recipe uses FAST tokens for backbone training while retaining continuous-action inference.

π0.5 and Knowledge Insulation

π0.5 targeted generalization rather than speed Black 2025. The architecture keeps the π0 skeleton, but the training mixture adds hybrid multimodal examples that interleave image observations, language commands, object detections, semantic subtask predictions, and low-level actions in a single sequence. The subtask prediction makes the model internally hierarchical: at inference it first predicts a high-level language subtask at low frequency ("pick up the plate"), then conditions the action expert on that subtask at high frequency. There is no separate planner. The paper evaluates long-horizon mobile manipulation in new home environments, and the paper's ablations show the heterogeneous mixture carries the result: removing either cross-embodiment data source significantly degrades the home-task scores, while web data, whose removal was not statistically significant there, has a large effect on language following and high-level subtask inference Black 2025.

Driess 2025 The Knowledge Insulation paper studies how a newly initialized continuous-action expert can interfere with pretrained VLM representations. Its Figure 2 shows π0 being instructed to bus a spoon into the bin but grasping trash instead. The authors extend the earlier two-stage π0.5 approach into a single-stage recipe that trains discrete and continuous actions together:

  1. Train the action expert with flow matching for continuous-action inference.
  2. Train the backbone with discrete FAST action tokens, vision-language data and robot-planning data.
  3. Stop expert gradients at the backbone keys and values. The expert attends to the image/language/state prefix, not the FAST action tokens; the backbone does not attend to the expert.

In the paper’s frozen-backbone ablation, shirt-folding performance is 0%. FAST supplies a robot-learning signal to adapt the backbone without updates from the action-expert loss. For the generalist table-bussing comparison, π0 needs 7.5 times as many training steps to reach similar performance. These results describe π0.5 + KI and the tested configurations, not every model carrying the π0.5 name Driess 2025.

The language-following evidence also has a qualification: vision-language co-training can give the joint-training baseline good language following without stop-gradient. The authors report improved but still imperfect language following, not complete immunity to interference Driess 2025.

Separate training tokens from runtime actions

In this recipe, FAST tokens supervise the backbone during training and the flow-matching expert generates continuous actions at inference. A comparison should record both roles for this model rather than infer the same architecture for every frontier VLA Driess 2025.

π0.6 and π*0.6: scaling and experience

The π0.6 model card is dated November 17, 2025 Physical Intelligence 2025. It initializes the backbone from Gemma3 4B; the architecture figure labels SigLIP 400M, and the action expert has approximately 860M parameters with the backbone’s layer count. Pre-training accepts up to four 448×448 images. Knowledge Insulation supervises the backbone with FAST tokens while the expert predicts continuous actions without sending gradients into it. With five denoising steps and three camera inputs, chunk inference takes 63 ms on one H100. In the card’s out-of-the-box evaluation without task-specific fine-tuning, π0.6 folds laundry reliably and fully assembles the box 20% of the time; the card says these tasks previously required fine-tuning to achieve non-zero success Physical Intelligence 2025.

π*0.6 uses Recap to learn from demonstrations, expert teleoperation corrections during rollouts, and autonomous experience. It begins with offline-RL pre-training, then task-specific demonstration fine-tuning and one or more rounds of collecting experience and retraining Amin 2025.

Its language-conditioned distributional value function predicts negative remaining steps for successful episodes and a large negative value for failures, normalized per task. Actions receive a binary improvement indicator from an advantage estimate and a task-dependent threshold; human corrections are forced positive. The policy learns from both good and bad data, and the default evaluation samples with the positive indicator. This is not simply a test of whether raw value increased Amin 2025. The companion blog illustrates credit assignment with a bad portafilter grasp that causes a later insertion failure; it does not give a measured twenty-second delay Amin 2025.

The report evaluates a static bimanual setup with two 6-DoF arms, parallel-jaw grippers, three cameras and 50 Hz joint-position control. Compared with offline RL plus task-specific demonstration fine-tuning, adding on-robot experience more than doubles successful completions per hour for double-shot espresso and the diverse-laundry evaluation. The espresso trial must complete all steps within 200 seconds without critical mistakes. Diverse-laundry training covers 11 item types, but the quantitative test uses a challenging button-up shirt, folded and stacked within 500 seconds Amin 2025.

Keep the report's qualifications with those results. Section VI-C describes failure reduction as “about a factor of two,” whereas Figure 8 says “more than 2×.” Its “90%+” success summary excludes diverse laundry. The easier laundry task is a T-shirt or shorts folded and stacked within 200 seconds; the box task has a 600-second limit. The box chart reports separate stages, and Section VI-C.2 describes about 90% success for folding and labeling while noting remaining failures, especially final placement. This does not establish strictly greater than 90% end-to-end success for every application Amin 2025.

The MEM report evaluates π0.6-MEM with two complementary memory scales. Its video encoder interleaves bidirectional spatial attention with causal-temporal attention across observations, while a high-level policy predicts updated natural-language summaries of earlier semantic events. Those summary predictions are trained using labels generated by an off-the-shelf language model; they are not an external agent writing the runtime notes Torne 2026.

The authors report tasks requiring up to fifteen minutes of memory, including recipe setup and kitchen cleanup, not a fifteen-minute dense-video input. Their separate adaptation experiments train on targeted corrections: adjusting chopstick grasp height after misses and changing which way a refrigerator door is opened. Both memory and memoryless policies receive correction data. Chopstick evaluation uses the lowest table-height setting after collecting data in the upper half of the height range; refrigerator success requires opening within four grasps. The reported in-context adaptation is therefore conditioned on this training and evaluation setup, not a claim of untrained, indefinite continual learning Torne 2026.

These sections cite the named model card and lab reports. Those document formats do not establish whether model weights are downloadable or what their licenses permit.

π0.7: generalization as a prompting problem

π0.7 (April 2026) reframes the generalization problem: the bottleneck is underspecified prompts, not model capacity Ai 2026. The skeleton is π0.6 plus MEM at about 5B parameters, with two architectural tweaks worth noting: the flow timestep is injected through adaptive RMSNorm, and proprioceptive state enters through a linear projection rather than discretized text tokens. During training, π0.7 simulates Real-Time Chunking delays of 0 to 12 timesteps, which the paper describes as corresponding to a maximum inference latency of 240 ms on a 50 Hz robot. This is a training setup, not a common latency benchmark; UR5e experiments run at 20 Hz while the other tested robots run at 50 Hz Ai 2026.

The paper expands the conditioning context while training the model to use different subsets. The dropout rules have an explicit exception: the control-mode label is not dropped Ai 2026.

  • Task and subtask language; the subtask comes from a learned high-level policy or a human supervisor at runtime.
  • Episode metadata for overall quality, overall speed and mistakes. The runtime configuration sets quality to 5, mistakes to false and speed from a task-specific episode-length percentile.
  • A control-mode label for joint or end-effector control, always retained during training.
  • Multi-view subgoal images from a BAGEL-initialized world model. Subgoal and subtask generation run in separate threads; VLA inference uses the latest available context rather than waiting for both.

The paper reports laundry-folding transfer to a bimanual UR5e with no laundry-folding training data on that embodiment. It describes task progress matching experienced teleoperators attempting this task on the UR5e for the first time, with improved performance when visual subgoals are used Ai 2026. In the air-fryer example, a zero-shot prompt produces only a partial attempt. Repeated language coaching supplies instructions used to fine-tune a high-level policy that then generates the subtasks autonomously, without additional teleoperation Ai 2026. Read the compositional claim with the authors' own hedge: they describe "early signs of compositional task generalization," and the zero-shot air fryer attempt does not finish the task without coaching Ai 2026. This capability account does not establish checkpoint availability or licensing.

Which checkpoints are listed

The pinned openpi README lists base checkpoints and download locations for π0, π0-FAST and π0.5. This is a catalogue observed in the retained September 7, 2026 retrieval, not a complete inventory of every later model or a statement about an unlisted model’s license Physical Intelligence 2026. Select a generation in the timeline to inspect its separately named primary source.

pinned catalogue ends at π0.54 model entries not in the pinned catalogue20252026π0Oct 2024π0-FASTJan 2025π0.5Apr 2025π0.6Nov 2025π*0.6Nov 2025π0.7Apr 2026

MEM is selectable below but not plotted: its source month is unverified. Downloadable means listed in the inspected openpi catalogue, not an open-source licence. Non-listing leaves availability unverified.

π0 Oct 2024 weights downloadable

PaliGemma 3B + 300M action expert

Flow-matching action expert grafted onto a pretrained VLM; 50-step action chunks at 50 Hz.

Source: Black 2024

The π line contains 7 generations, with established source months from Oct 2024 to Apr 2026. MEM has no established month and is not plotted. The divider after π0.5 marks the pinned checkpoint catalogue, not licensing; selected now is π0 (PaliGemma 3B + 300M action expert, weights downloadable) and 4 other entries have unverified availability.

Current π generation
selected
π0
source month
Oct 2024
weights
downloadable
generations
7
not in pinned catalogue
4

Check the named checkpoint

The pinned repository documents π0, π0-FAST and π0.5. It does not establish release or licensing terms for every later model. Match a capability claim to the model and source that actually report it rather than inferring it from repository membership Physical Intelligence 2026.

Across these named reports, the research questions shift from continuous-action generation and tokenization to heterogeneous co-training, Knowledge Insulation, learning from experience, memory and richer prompts. Those contributions are model- and experiment-specific; repository membership alone does not determine which capabilities a checkpoint has.

See also

  • Vision-Language-Action Models

    RT-1, RT-2, RT-X, Octo, and OpenVLA: web-scale pretraining meets robot control, and the cost of discrete action tokens.

  • Knowledge Insulation

    Training the VLM backbone on discrete tokens while a flow-matching expert learns actions behind a stop-gradient.

  • Real-Time Execution

    Temporal ensembling and real-time chunking: the latency budgets that decide whether the control loop closes.

  • Generalization

    What the pi0.5 and pi0.7 results demonstrate, and what they do not: the open-world gap.

Linked from

  • Action Chunking (ACT and ALOHA)

    Predicting action sequences instead of single steps: the CVAE structure, the chunk-size tradeoff, and temporal ensembling.

  • Diffusion Policy

    Visuomotor control as conditional denoising over action sequences, with receding-horizon execution.

  • Vision-Language-Action Models

    RT-1, RT-2, RT-X, Octo, and OpenVLA: web-scale pretraining meets robot control, and the cost of discrete action tokens.

  • Other Generalist Policies

    Gemini Robotics, GR00T, Helix, Skild, and GO-2: how to read closed-model vendor claims.

  • Comparison Matrix

    Every major policy across eight architectural axes: action representation, horizon, frequency, backbone, conditioning, cross-embodiment, hierarchy, openness.

  • RL Fine-Tuning of Policies

    DPPO, ConRFT, Recap, pi_RL, residual RL, and HIL-SERL: closing the reliability gap with on-policy experience.

  • Real-Time Execution

    Temporal ensembling and real-time chunking: the latency budgets that decide whether the control loop closes.

  • Knowledge Insulation

    Training the VLM backbone on discrete tokens while a flow-matching expert learns actions behind a stop-gradient.

  • Generalization

    What the pi0.5 and pi0.7 results demonstrate, and what they do not: the open-world gap.

References

  1. Kevin Black, Noah Brown, Danny Driess, Adnan Esmail, Michael Equi, Chelsea Finn, Niccolo Fusai, Lachy Groom, and 16 more, RSS 2025, 2024.

    https://arxiv.org/abs/2410.24164

  2. Karl Pertsch, Kyle Stachowicz, Brian Ichter, Danny Driess, Suraj Nair, Quan Vuong, Oier Mees, Chelsea Finn, and 1 more, 2025.

    https://arxiv.org/abs/2501.09747

  3. Physical Intelligence, Kevin Black, Noah Brown, James Darpinian, Karan Dhabalia, Danny Driess, Adnan Esmail, Michael Equi, and 28 more, 2025.

    https://arxiv.org/html/2504.16054v1

  4. Danny Driess, Jost Tobias Springenberg, Brian Ichter, Lili Yu, Adrian Li-Bell, Karl Pertsch, Allen Z. Ren, Homer Walke, and 3 more, 2025.

    https://arxiv.org/abs/2505.23705

  5. Danny Driess, Jost Tobias Springenberg, Brian Ichter, Lili Yu, Adrian Li-Bell, Karl Pertsch, Allen Z. Ren, Homer Walke, and 3 more, 2025.

    https://www.pi.website/research/knowledge_insulation

  6. Physical Intelligence, 2025.

    https://website.pi-asset.com/pi06star/PI06_model_card.pdf

  7. Ali Amin, Raichelle Aniceto, Ashwin Balakrishna, Kevin Black, Ken Conley, Grace Connors, James Darpinian, Karan Dhabalia, and 47 more, 2025.

    https://www.pi.website/download/pistar06.pdf

  8. Ali Amin, Raichelle Aniceto, Ashwin Balakrishna, Kevin Black, Ken Conley, Grace Connors, James Darpinian, Karan Dhabalia, and 47 more, 2025.

    https://www.pi.website/blog/pistar06

  9. Marcel Torne, Karl Pertsch, Homer Walke, Kyle Vedder, Suraj Nair, Brian Ichter, Allen Z. Ren, Haohuan Wang, and 9 more, 2026.

    https://www.pi.website/download/Mem.pdf

  10. Bo Ai, Ali Amin, Raichelle Aniceto, Ashwin Balakrishna, Greg Balke, Kevin Black, George Bokinsky, Shihao Cao, and 79 more, 2026.

    https://www.pi.website/download/pi07.pdf

  11. Bo Ai, Ali Amin, Raichelle Aniceto, Ashwin Balakrishna, Greg Balke, Kevin Black, George Bokinsky, Shihao Cao, and 79 more, 2026.

    https://www.pi.website/blog/pi07

  12. Physical Intelligence, 2026.

    https://github.com/Physical-Intelligence/openpi/blob/215abfb217dbac7d5f1273282331b9b1866c0479/README.md

  13. Kevin Black, Manuel Y. Galliker, Sergey Levine, 2025.

    https://arxiv.org/abs/2506.07339

Spot a factual error or missing qualification? Report a content correction.