WP3-37

Video and data analytics

ID	WP3-37
Contributor	Aitek (AI)
Levels	Function
Require	Onboard camera
Provide
Input	Video streams collected by onboard cameras (optional) Other data collected by the drones (e.g. GPS position)
Output	Detection and localization of targets. Such targets will be defined in details according to the applicative requirements defined in UC5. Detection of relevant information about targets (e.g. size). Such information will be defined in details according to the applicative requirements defined in UC5.
C4D building block
TRL	6
Contact	Stefano Delucchi - sdelucchi@aitek.it

General Description

SW component that implements video analysis algorithms based on Deep Learning approaches. It will be used to process RGB (mainly) and infrared (eventually) images.

Definition, training and implementation of AI based algorithms for targets detection, localization and classification.

Such SW component is defined as much general as possible but its implementation and demonstration has been done in the scope of the Smart Agriculture use case for the detection of the individual artichoke plants, and of the relative production rows, in the different phases of the vegetative development of the plant (from the first weeks after sowing, up to the complete development of the plants and the first appearance of weeds).

Specification and contribution

Training and non-real-time actions

Real-time actions

Design and Implementation

Single Shot Detector (SSD) is a family of deep learning algorithms prone to identify and to classify objects in images. SSD are composed by a neural network for classification (backbone) and by a set of convolutional layers (head) for the features extraction. In this case of study, two networks have been implemented: a custom Feature Pyramid Network and the classic YOLOv5

• Feature Pyramid Network:
  • Grid Sizes: (4x4, 8x8, 16x16)
  • Priors Sizes: (1x1)
  • Input Size: (512x512)
  • Total params: 2.8 M

• YOLOv5n:
  • Input Size: (640x640)
  • Total params: 1.9 M