Overview

Flexiv AIDK enables the users to connect their own workstation PC to NoemaEdge App via Ethernet connection. Customized user programs can be created for AI service calling .

Compatibility

Supported OS	Supported processor	Supported language	Required compiler kit
Linux (Ubuntu 18/20/22 tested)	x86_64, arm64	C++, Python	build-essential

API access overview

The Linux C++ and Linux Python interface have full access to all APIs, while the other interfaces have partial access:

More details can be found in AIDK Library.

NoemaEdge App

NoemaEdge is a web-based edge deployment software of Flexiv general AI platform, which facilitates users to configure the environment, parameters and software, data collection, program scheduling, log analysis, information visualization and other operations of new AI devices. AIDK is aimed to help users utilize and test functions of NoemaEdge conveniently.

AI state

AI state is always published from the NoemaEdge App. It includes current status of NoemaEdge App, such as idle, model loading, error state, etc.

Example workflow of a complex user application

A complex customized user application usually combines various APIs. Below is an example workflow:

1. In one user program, one AIDK library is initialized to connect to NoemaEdge App and one RDK library instance is initialized to establish connection with robot. The camera is mounted in robot flange. The NoemaEdge App is configured to use GRASPNET project.

2. Get current camera pose using RDK. Camera pose of current robot configuration can be fetched using RDK.

3. Get grasp proposal using AIDK. Put camera pose fetched in config and get grasp proposal in world frame from NoemaEdge App using AIDK.

4. Command robot to grasp. The robot end-effector is commanded to the grasp proposal in world and grasp using RDK.