Within the dashboard, this guide will walk you through the steps to set up an edge device running Chooch models for CPU, NVDIA GPU, and Jetson Orin. The guide will explain how to install the Chooch Inference Engine on your device. It will also outline how to use the AI Vision Studio to create a device, add camera streams, and add AI models to the device.

You must have a Chooch Enterprise Account to install the Inference Engine. If you do not have one, please contact support@chooch.com to request one.

Hardware requirements

GPU (8.1.0)

CPU (8.0.0)

Installation guide

Many of the following command lines will require your system’s root or super user password. An Internet connection is needed to perform many of the following steps.

GPU (8.1.0) setup guide

Installation requirements for Ubuntu server for GPU

If Ubuntu has not been installed, please use the following link: https://releases.ubuntu.com/22.04/. If Ubuntu has been previously installed, please continue below.

Enter the following script to your terminal and follow the instructions.

This installation time may take approximately 60 minutes or more, based on your network upload speed.

#default GPU install (see below for other optional arguments)
#NOTE: API key MUST go after -k argument. Other optional argument appends to the end.

bash -c "$(curl https://get.chooch.ai/inference-engine-v8)" -s -k api_key

#NOTE: This command installs the necessary driver version and Nvidia Docker, deletes the oldest inference engine, and installs a new Chooch Inference Engine.

Optional arguments

api_key
API Key provided by Chooch can be found at the bottom of your Chooch AI Vision Studio Homepage.

CPU (8.0.0) setup guide

Installation requirements for Ubuntu Server for CPU

Please follow the docker installation instructions:
https://docs.docker.com/engine/install/ubuntu/

Enter the following script to your terminal and follow the instructions:

This installation time may take approximately 60 minutes or more, based on your network upload speed.

#default CPU install (see below for other optional arguments)
#NOTE: api key MUST go after -k argument. Other optional argument append to the end

bash -c "$(curl https://get.chooch.ai/inference-engine-v8-cpu)" -s -k api_key

Optional arguments

-d <install_dir>
install directory (defaults to $HOME if not specified)

api_key
API Key provided by Chooch can be found at the bottom of your dashboard’s Homepage.

Jetson Orin (8.0.0) setup guide

Chooch supports the NVIDIA JetPack SDK. JetPack installation is managed by NVIDIA SDK Manager. You will need to create a free NVIDIA account or use an existing one.

Please follow the NVIDIA SDK Manager installation instructions that explain how to install Jetpack OS 5.1.2, using a host device (host device requirements below).

Inference Engine setup instructions

1. Log in to your Chooch AI Vision Studio account.
2. Create a device
3. Add a stream to your device
4. Add Models to your stream
5. You can access your Chooch Inference Engine interface on your device from http://localhost:3000/.
6. Copy and paste the Device ID of the device you want to connect. The Device list can be found under the Devices tab of your dashboard.
7. Set a password to access the dashboard.
8. You can access your Chooch Inference Engine interface on the device after installation, from http://localhost:3000/.
   
   
9. Once you have finalized changes to your stream from https://app.chooch.ai dashboard, click onCloud Syncfrom the Inference Engine dashboard to sync the changes.
   • Note: If Cloud Sync doesn’t appear to finish, try refreshing the page.
10. Verify camera feed is showing and sending prediction data by clicking on Streams tab.
    
11. Now you can start using the system!

Some useful commands start, stop and restart the service on device.

Start the Chooch Inference Engine

docker-compose start