snapcon2022:presentation-notes
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
snapcon2022:presentation-notes [2022/08/01 17:45] – [Introduction] rolf001 | snapcon2022:presentation-notes [2023/01/05 14:38] (current) – external edit 127.0.0.1 | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | =====Presentation | + | ====== Workshop |
- | ==== Preparation / Prerequisits ==== | + | ===== Preparation / Prerequisits |
* Download ... | * Download ... | ||
Line 7: | Line 7: | ||
* Print ... | * Print ... | ||
- | ==== Introduction ==== | + | ===== Introduction |
* The work of the EOLab Team -> Current state of development | * The work of the EOLab Team -> Current state of development | ||
Line 14: | Line 14: | ||
* Mini drones with OD | * Mini drones with OD | ||
- | Main Achievements -> Own talks | + | ===== Hands On ===== |
+ | * Connect SNAP to the server in Nvidia Jetson | ||
+ | * Image classification game | ||
+ | * Object Detection ?? | ||
+ | ===== Reflection ===== | ||
+ | |||
+ | |||
+ | ====== Main Achievements (internal discussion) ====== | ||
+ | |||
+ | ===== SNAP! and Mini-Drone (Harley, 3 mins, live, with Alonzo pilot) ===== | ||
* Tello SNAP Backend (Javascript backend, communication software interface, Wifi, client, binding to IP address), URL, eolab.de github | * Tello SNAP Backend (Javascript backend, communication software interface, Wifi, client, binding to IP address), URL, eolab.de github | ||
* One drone has a default IP, it is in " | * One drone has a default IP, it is in " | ||
* Tello AP mode (client to Wifi), necessary for more than one drone in network and/or interaction with Jetson | * Tello AP mode (client to Wifi), necessary for more than one drone in network and/or interaction with Jetson | ||
- | |||
* Tello SNAP! category (collection of SNAP! Javascript blocks), websocket interaction with the interface talking to the drone | * Tello SNAP! category (collection of SNAP! Javascript blocks), websocket interaction with the interface talking to the drone | ||
- | |||
* https:// | * https:// | ||
- | ====Hands On==== | ||
- | | + | ===== Jetbot and Object Detection with SNAP! (Ali, 3 mins, with Alonzo driver) ===== |
- | * Image classification game | + | |
- | * Object Detection | + | * Object follower |
+ | * Jetbot Camera | ||
+ | | ||
+ | * DetectNet (SSD-MobileNet V2, CoCo Dataset, 91 Classes) | ||
+ | * Closed Loop Control | ||
+ | * TODO: Short video! | ||
+ | |||
+ | |||
+ | ===== Object Detection: Follow an Object with Drone (Ilgar, 3 mins, with Alonzo pilot) ===== | ||
- | ====Reflection==== | + | * Based on Harley' |
+ | * New aspect: Object detection, Jetson | ||
+ | * Challenges | ||
+ | * Video stream from Tello drone to SNAP! (25 fps) | ||
+ | * Video stream from SNAP! to Jetson (extacting stage in base64 format, send message, wait response, sequential, 7 fps) | ||
+ | * Receive response from Jetson to SNAP! (bounding box, class label, coordinate transformation to the stage) | ||
+ | * Frame rate incl. analysis is 7 fps | ||
+ | * Problem (not serious): Realtime delay (latency) within the Tello drone video stream! | ||
+ | * TODO: Short video! | ||
snapcon2022/presentation-notes.1659368750.txt.gz · Last modified: 2023/01/05 14:38 (external edit)