snapcon2022:presentation-notes
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| snapcon2022:presentation-notes [2022/08/01 15:41] – ali001 | snapcon2022:presentation-notes [2023/01/05 14:38] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | =====Presentation | + | ====== Workshop |
| - | ====Introduction==== | + | ===== Preparation / Prerequisits ===== |
| - | -Image Classification | + | * Download ... |
| + | * Install ... | ||
| + | * Print ... | ||
| - | -Object detection | + | ===== Introduction ===== |
| - | -Mini drones with OD | + | * The work of the EOLab Team -> Current state of development |
| + | * Image Classification | ||
| + | * Object detection | ||
| + | * Mini drones with OD | ||
| - | ====Hands On==== | + | ===== Hands On ===== |
| - | -Connect SNAP to the server in Nvidia Jetson | + | * Connect SNAP to the server in Nvidia Jetson |
| + | * Image classification game | ||
| + | * Object Detection ?? | ||
| - | -Image classification game | + | ===== Reflection ===== |
| - | ====Reflection==== | + | |
| + | ====== | ||
| + | |||
| + | ===== SNAP! and Mini-Drone (Harley, 3 mins, live, with Alonzo pilot) ===== | ||
| + | |||
| + | * Tello SNAP Backend (Javascript backend, communication software interface, Wifi, client, binding to IP address), URL, eolab.de github | ||
| + | * One drone has a default IP, it is in " | ||
| + | * Tello AP mode (client to Wifi), necessary for more than one drone in network and/or interaction with Jetson | ||
| + | * Tello SNAP! category (collection of SNAP! Javascript blocks), websocket interaction with the interface talking to the drone | ||
| + | * https:// | ||
| + | |||
| + | ===== Jetbot and Object Detection with SNAP! (Ali, 3 mins, with Alonzo driver) ===== | ||
| + | |||
| + | * Object follower | ||
| + | * Jetbot Camera | ||
| + | * SNAP! is running remotely, could be running on Jetbot | ||
| + | * DetectNet (SSD-MobileNet V2, CoCo Dataset, 91 Classes) | ||
| + | * Closed Loop Control | ||
| + | * TODO: Short video! | ||
| + | |||
| + | |||
| + | ===== Object Detection: Follow an Object with Drone (Ilgar, 3 mins, with Alonzo pilot) ===== | ||
| + | |||
| + | * Based on Harley' | ||
| + | * New aspect: Object detection, Jetson | ||
| + | * Challenges | ||
| + | * Video stream from Tello drone to SNAP! (25 fps) | ||
| + | * Video stream from SNAP! to Jetson (extacting stage in base64 format, send message, wait response, sequential, 7 fps) | ||
| + | * Receive response from Jetson to SNAP! (bounding box, class label, coordinate transformation to the stage) | ||
| + | * Frame rate incl. analysis is 7 fps | ||
| + | * Problem (not serious): Realtime delay (latency) within the Tello drone video stream! | ||
| + | * TODO: Short video! | ||
snapcon2022/presentation-notes.1659361260.txt.gz · Last modified: 2023/01/05 14:38 (external edit)