logo80lv
Articlesclick_arrow
Research
Talentsclick_arrow
Events
Workshops
Aboutclick_arrow
profile_loginLogIn

Researchers Propose Neural Whole-Body Controller for Humanoid Robots

HOVER's neural network has only 1.5 million parameters.

Researchers from NVIDIA, CMU, UC Berkeley, UT Austin, and UC San Diego presented HOVER, a "versatile neural whole-body controller for humanoid robots." This multi-mode policy distillation framework allows the robots to move all their limbs with just one model.

"HOVER enables seamless transitions between control modes while preserving the distinct advantages of each, offering a robust and scalable solution for humanoid control across a wide range of modes."

NVIDIA

NVIDIA's Senior Research Manager and Lead of Embodied AI Jim Fan revealed that the team trained a neural network with only 1.5 million parameters, which might sound like a lot, but some models have billions of those, so this is pretty impressive.

"We trained HOVER in NVIDIA Isaac, a GPU-powered simulation suite that accelerates physics by 10,000x faster than real time. To put the number in perspective, the robots undergo 1 year of intense training in a virtual 'dojo', but take only ~50 minutes of wall clock time on one GPU card. The neural net then transfers zero-shot to the real world without finetuning," he said.

NVIDIA

HOVER can perform several high-level motion tasks. Fan named a few of those "control modes":

  • Head and hand poses: can be captured by XR devices like Apple Vision Pro.
  • Whole-body poses: via MoCap or RGB camera.
  • Whole-body joint angles: exoskeleton.
  • Root velocity command: joysticks. 

NVIDIA

According to him, HOVER enables a unified interface to control a robot using "whichever input devices are convenient at hand," an easier way to collect whole-body teleoperation data for training, and an upstream Vision-Language-Action model to provide motion instructions, which HOVER translates into low-level motor signals at high frequency.

If you'd like to see the technical side of the research, find the project here.

Also, join our 80 Level Talent platform and our Telegram channel, follow us on InstagramTwitterLinkedInTikTok, and Reddit, where we share breakdowns, the latest news, awesome artworks, and more.

Improve your workflow with 112+ Hologram alphas/decals/brushes for 2D/3D concept art

Error
(2000-0001)

Join discussion

Comments 0

    You might also like

    A Week After "Basically Announcing" Minecraft 2, Notch Basically Cancels It

    Instead, he and his team will focus on the previously-announced retro-style roguelike.

    Discord Gets Sued Over Alleged Anti-Consumer Practices

    The plaintiffs claim the platform has intentionally made it overly difficult to cancel subscriptions.

    Rumor: Possible Release Date for Grand Theft Auto 6 Revealed

    A video game store from Uruguay appears to have disclosed the launch date for the gaming industry's most anticipated title.
    • Alien VDM Brush
      by Nicolas Swijngedau

      40 hand sculpted alien detail brushes all contained within one Multi-Alpha brush. Perfect for your aliens, mutant and otherworldly creatures.

      Error
      (2000-0001)
    • Metal Damage VDM Brush
      by Nicolas Swijngedau

      40 hand sculpted metal damage brushes all contained within one Multi-Alpha brush. Perfect to speed up your armors creation!

      Error
      (2000-0001)

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more

    ×