Perception Stack

Inferring the agent’s internal state from noisy sensor data.

Internal sensing of joint positions, velocities, and forces.

External sensing of surroundings (vision, audio, lidar).

Continuous loop adjusting actions based on state feedback.

AI systems that perceive and act in the physical world through sensors and actuators.

Field combining mechanics, control, perception, and AI to build autonomous machines.

Hardware components that execute physical actions.

Devices measuring physical quantities (vision, lidar, force, IMU, etc.).