Robotics Data Software & Dataset Architecture
BVP's proposed software workflow is based around widely adopted robotics technologies rather than proprietary video-production software. Our baseline stack can include:
ROS 2:
Used where integration with robotics middleware, sensors or client robotics systems is required.
MCAP:
Our preferred container format for timestamped multimodal robotics data.
MCAP can combine camera streams, timestamps, metadata, sensor information and other structured data into a format designed specifically for robotics workflows.
Foxglove:
Used for visual inspection, synchronized playback, troubleshooting and quality control of robotics data.
Foxglove allows technical teams to inspect multiple data streams against a common timeline and identify synchronization, camera, metadata or sensor problems before data is accepted.
LeRobot Dataset:
Where appropriate, accepted sequences can also be structured for compatibility with the Hugging Face LeRobot Dataset format. LeRobot is specifically designed for robot-learning datasets containing multiple camera observations, time-series data, actions, robot states and associated metadata.
Rerun:
Rerun can also be incorporated for local visualization and inspection of multimodal robotics datasets.
Client-Defined Formats:
The client's own engineering specification always takes priority. BVP can deliver according to a proprietary schema, folder structure, naming convention, metadata requirement, cloud-ingestion specification or machine-learning pipeline.
Proven Industry Adoption:
These technologies are already being used by major robotics and Physical AI organizations. Trossen Robotics produces MCAP data through its TRumi robot-learning data-collection pipeline.
NVIDIA Isaac ROS incorporates MCAP for multi-sensor robotics data recording.
Foxglove identifies robotics and Physical AI users including NVIDIA, Dexterity, ANYbotics, Wayve, Shield AI and Waabi. Hugging Face's LeRobot Dataset architecture has been developed specifically for large-scale robot-learning datasets, including synchronized multi-camera observations.
This allows BVP to build its acquisition workflow around technologies already being used within the robotics industry rather than developing a proprietary data format that clients must adapt to.