Skip to content

Request for RoboTwin Table 3 configuration #2

Description

@minkyu7000

Hello, thank you for releasing AutoHorizon.

We are evaluating AutoHorizon on RoboTwin 2.0 using the public implementation. The paper reports prediction horizons p=10 and p=50 for the LIBERO experiments, but we could not find the prediction horizon used for RoboTwin Table 3. Could you confirm the value of p used there?

We would also appreciate information about the π0.5 checkpoint used for RoboTwin, including whether it was jointly trained or task-specific and whether it is publicly available. Please also confirm the sampling step, soft-pointer implementation, and hyperparameters used for Table 3, as well as the RoboTwin configuration and evaluation seeds. If the RoboTwin evaluation code or configuration can be shared, that would be very helpful.

We currently use a jointly trained RoboTwin π0.5 checkpoint with p=32. With the public AutoHorizon implementation, the selected execution horizon is almost always 32, making its behavior close to the fixed-horizon baseline. We would like to determine whether this difference comes from the checkpoint, prediction horizon, or AutoHorizon configuration.

Thank you for your help.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions