snapcon2022:presentation-notes
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
snapcon2022:presentation-notes [2022/08/01 15:41] – ali001 | snapcon2022:presentation-notes [2023/01/05 14:38] (current) – external edit 127.0.0.1 | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | =====Presentation | + | ====== Workshop |
- | ====Introduction==== | + | ===== Preparation / Prerequisits ===== |
- | -Image Classification | + | * Download ... |
+ | * Install ... | ||
+ | * Print ... | ||
- | -Object detection | + | ===== Introduction ===== |
- | -Mini drones with OD | + | * The work of the EOLab Team -> Current state of development |
+ | * Image Classification | ||
+ | * Object detection | ||
+ | * Mini drones with OD | ||
- | ====Hands On==== | + | ===== Hands On ===== |
- | -Connect SNAP to the server in Nvidia Jetson | + | * Connect SNAP to the server in Nvidia Jetson |
+ | * Image classification game | ||
+ | * Object Detection ?? | ||
- | -Image classification game | + | ===== Reflection ===== |
- | ====Reflection==== | + | |
+ | ====== | ||
+ | |||
+ | ===== SNAP! and Mini-Drone (Harley, 3 mins, live, with Alonzo pilot) ===== | ||
+ | |||
+ | * Tello SNAP Backend (Javascript backend, communication software interface, Wifi, client, binding to IP address), URL, eolab.de github | ||
+ | * One drone has a default IP, it is in " | ||
+ | * Tello AP mode (client to Wifi), necessary for more than one drone in network and/or interaction with Jetson | ||
+ | * Tello SNAP! category (collection of SNAP! Javascript blocks), websocket interaction with the interface talking to the drone | ||
+ | * https:// | ||
+ | |||
+ | ===== Jetbot and Object Detection with SNAP! (Ali, 3 mins, with Alonzo driver) ===== | ||
+ | |||
+ | * Object follower | ||
+ | * Jetbot Camera | ||
+ | * SNAP! is running remotely, could be running on Jetbot | ||
+ | * DetectNet (SSD-MobileNet V2, CoCo Dataset, 91 Classes) | ||
+ | * Closed Loop Control | ||
+ | * TODO: Short video! | ||
+ | |||
+ | |||
+ | ===== Object Detection: Follow an Object with Drone (Ilgar, 3 mins, with Alonzo pilot) ===== | ||
+ | |||
+ | * Based on Harley' | ||
+ | * New aspect: Object detection, Jetson | ||
+ | * Challenges | ||
+ | * Video stream from Tello drone to SNAP! (25 fps) | ||
+ | * Video stream from SNAP! to Jetson (extacting stage in base64 format, send message, wait response, sequential, 7 fps) | ||
+ | * Receive response from Jetson to SNAP! (bounding box, class label, coordinate transformation to the stage) | ||
+ | * Frame rate incl. analysis is 7 fps | ||
+ | * Problem (not serious): Realtime delay (latency) within the Tello drone video stream! | ||
+ | * TODO: Short video! | ||
snapcon2022/presentation-notes.1659361260.txt.gz · Last modified: 2023/01/05 14:38 (external edit)