snapcon2022:presentation-notes
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| snapcon2022:presentation-notes [2022/08/01 17:46] – [Presentation Notes] rolf001 | snapcon2022:presentation-notes [2023/01/05 14:38] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Workshop Notes ====== | ====== Workshop Notes ====== | ||
| - | ==== Preparation / Prerequisits ==== | + | ===== Preparation / Prerequisits |
| * Download ... | * Download ... | ||
| Line 7: | Line 7: | ||
| * Print ... | * Print ... | ||
| - | ==== Introduction ==== | + | ===== Introduction |
| * The work of the EOLab Team -> Current state of development | * The work of the EOLab Team -> Current state of development | ||
| Line 14: | Line 14: | ||
| * Mini drones with OD | * Mini drones with OD | ||
| - | Main Achievements -> Own talks | + | ===== Hands On ===== |
| + | * Connect SNAP to the server in Nvidia Jetson | ||
| + | * Image classification game | ||
| + | * Object Detection ?? | ||
| + | ===== Reflection ===== | ||
| + | |||
| + | |||
| + | ====== Main Achievements (internal discussion) ====== | ||
| + | |||
| + | ===== SNAP! and Mini-Drone (Harley, 3 mins, live, with Alonzo pilot) ===== | ||
| * Tello SNAP Backend (Javascript backend, communication software interface, Wifi, client, binding to IP address), URL, eolab.de github | * Tello SNAP Backend (Javascript backend, communication software interface, Wifi, client, binding to IP address), URL, eolab.de github | ||
| * One drone has a default IP, it is in " | * One drone has a default IP, it is in " | ||
| * Tello AP mode (client to Wifi), necessary for more than one drone in network and/or interaction with Jetson | * Tello AP mode (client to Wifi), necessary for more than one drone in network and/or interaction with Jetson | ||
| - | |||
| * Tello SNAP! category (collection of SNAP! Javascript blocks), websocket interaction with the interface talking to the drone | * Tello SNAP! category (collection of SNAP! Javascript blocks), websocket interaction with the interface talking to the drone | ||
| - | |||
| * https:// | * https:// | ||
| - | ====Hands On==== | ||
| - | | + | ===== Jetbot and Object Detection with SNAP! (Ali, 3 mins, with Alonzo driver) ===== |
| - | * Image classification game | + | |
| - | * Object Detection | + | * Object follower |
| + | * Jetbot Camera | ||
| + | | ||
| + | * DetectNet (SSD-MobileNet V2, CoCo Dataset, 91 Classes) | ||
| + | * Closed Loop Control | ||
| + | * TODO: Short video! | ||
| + | |||
| + | |||
| + | ===== Object Detection: Follow an Object with Drone (Ilgar, 3 mins, with Alonzo pilot) ===== | ||
| - | ====Reflection==== | + | * Based on Harley' |
| + | * New aspect: Object detection, Jetson | ||
| + | * Challenges | ||
| + | * Video stream from Tello drone to SNAP! (25 fps) | ||
| + | * Video stream from SNAP! to Jetson (extacting stage in base64 format, send message, wait response, sequential, 7 fps) | ||
| + | * Receive response from Jetson to SNAP! (bounding box, class label, coordinate transformation to the stage) | ||
| + | * Frame rate incl. analysis is 7 fps | ||
| + | * Problem (not serious): Realtime delay (latency) within the Tello drone video stream! | ||
| + | * TODO: Short video! | ||
snapcon2022/presentation-notes.1659368779.txt.gz · Last modified: 2023/01/05 14:38 (external edit)