This course is an introductory leap into the world of the Advanced Peception Systems, throuout the newly launched Hazard Response Mission Pack.
What do we mean by “Advanced Perception Systems”?
Advanced Perception Systems refer to an integrated set of technologies designed to enable machines, software, and devices to perceive, interpret, and understand complex data from their surroundings much like the way humans do. These systems leverage a combination of sensors, algorithms, and artificial intelligence (AI) to process information from various sources, making sense of the environment in real-time. In this case, our Hazard Response Missions Pack is the mix of:
- A LoRaWAN gateway, allowing sensors to communicate with a node and broadcast their readings to SenseCAP Cloud or your favorite Cloud
- SenseCAP S2103 LoRaWAN® CO2, Temperature, and Humidity and SenseCAP S2105 – LoRaWAN® Soil Moisture, Temperature and EC Sensor
- Wio Tracker 1110 and several Grove Sensors to make your own tracking device.
- reComputer J3010-Edge AI Device with NVIDIA Jetson Orin™ Nano 4GB module with webcam and several pre-trainsed models, to bring TinyML machine learning to the edge
- Multiple SenseCAP T1000 LoRaWAN Trackers, able to monitor movements and activities on the field
- SenseCAP Indicator to visualize the data
Sensecraft AI
We’ll have the chance to play with SenseCraft AI, launched by Seeed early in September. This tool basically offers an open-source inference server and web UI to deploy any YOLOv8 to NVIDIA Jetson Orin devices and visualize captured streams, without any line of code.
Given the fact that the server hosts an MQTT broker as well, we are going to subscribe to each reading, besides going through the models and fine-tune it. We will test the datasets against some fire footages.
SenseCAP sensors, Trackers and Cloud
Another big chapter of the course is understanding the (easy) pairing process SenseCAP devices ties to the Cloud. We will create Custom Trackers or legacy ones, and we will interact with the data using SenseCap Cloud or Node-RED, subscribing to its instance.
