We support cloud and on-premise storage for sensor data like images, gps, lidar, radar, imu, time series, etc.
You can search in meta and measurment data with load, weight, force, torque, strain, etc.
You can train and eval AI models, anaylse your data, test and monitor.
Stop converting and splitting engineering data! Now you can load data natively in Spark for data preperation, exploration, and feature extraction with 80+ operators. Process your sensor data 100x faster using Java, Scala, Python, R, and SQL.
Load sensor data natively with TensorFlow and Keras for object detection, data fusion, trajectory prediction, and motion control.
# Load ROSbag data from HDFS in Spark
df = spark.read.rosbag("hdfs://test-drive.bag")
# Search in IMU data using SQL
imu = spark.sql("SELECT linear_acceleration
FROM rosbagFile
WHERE x > 1 AND z >= 10")
imu.plot()
# Load ROS bag data from HDFS in TensorFlow
files = tf.data.Dataset
.list_files("hdfs://dataset/bags-*.tfrecord")
# Train model on images
(train_images, train_labels),
(test_images, test_labels) = files.load_data()
...
model.fit(train_images, train_labels, epochs=5)
test_loss, test_acc = model.evaluate(test_images, test_labels)
print('Test accuracy:', test_acc)
Test accuracy: 0.8778
Parallel processing with fast serialization between nodes and clusters to support massive sensor data out of engineering data. Distributed machine learning on big data delivers speeds up to 100x faster with fine-grain parallelism.
Use Lidar, GPS, IMU raw data to perform map generation and point cloud alignment. You can use SLAM/pose estimation to derive the location. Add labels and semantic information to the grid map. Speed up iterative closest point operations and point cloud alignment.
# Load ROSbag data from S3 in TensorFlow
files = tf.data.Dataset
.list_files("s3://bags-*.tfrecord")
# Train model on images
...
# Load ROSbag data from HDFS in TensorFlow
files = tf.data.Dataset
.list_files("hdfs://bags-*.tfrecord")
# Train model on images
...
# Load ROSbag data Local FS in TensorFlow
files = tf.data.Dataset
.list_files("bags-*.tfrecord")
# Train model on images
...
Connect your data sources and get instant quality checks to easily rate sensor data and their quality. Now you can process data formats natively like ROS bag, MDF4, HDF5, and PCAP without converting and splitting. Save compute time and storage costs.