HSRW EOLab Students Wiki

User Tools

Site Tools

Trace:
amc:ss2023:group-b:start

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
amc:ss2023:group-b:start [2023/07/20 15:14] – matsvei.yankouskiamc:ss2023:group-b:start [2023/07/24 21:23] (current) – stas.besliu
Line 16: Line 16:
 (Specifications could be found here: [[https://loboris.eu/ESP32/ESP32-CAM%20Product%20Specification.pdf#:~:text=Module%20Model%20ESP32-CAM%20Package%20DIP-16%20Size%2027%2A40.5%2A4.5%02%C3%84%C2%B10.2%02%C3%85mm%20SPI,Storage%20Environment%20-40%20%01%07~%2090%20%01%07%2C%20%3C%2090%25RH|link]]) (Specifications could be found here: [[https://loboris.eu/ESP32/ESP32-CAM%20Product%20Specification.pdf#:~:text=Module%20Model%20ESP32-CAM%20Package%20DIP-16%20Size%2027%2A40.5%2A4.5%02%C3%84%C2%B10.2%02%C3%85mm%20SPI,Storage%20Environment%20-40%20%01%07~%2090%20%01%07%2C%20%3C%2090%25RH|link]])
  
-{{ :amc:ss2023:group-b:image.jpg?200|}}+^{{ :amc:ss2023:group-b:image.jpg?200|}}^ 
 +|**Fig.1:** ESP32-CAM|
  
 The ESP32-CAM module is a versatile and compact development board that combines an ESP32 microcontroller with a camera module. It offers a wide range of functionalities, including Wi-Fi and Bluetooth connectivity, making it an excellent choice for projects that require image capture and transmission. With its built-in camera, the ESP32-CAM enables users to capture and stream images or videos in real-time, making it ideal for applications such as surveillance systems, IoT projects, or even remote monitoring. Its small form factor and rich feature set make it a popular choice among developers and enthusiasts alike. The ESP32-CAM module is a versatile and compact development board that combines an ESP32 microcontroller with a camera module. It offers a wide range of functionalities, including Wi-Fi and Bluetooth connectivity, making it an excellent choice for projects that require image capture and transmission. With its built-in camera, the ESP32-CAM enables users to capture and stream images or videos in real-time, making it ideal for applications such as surveillance systems, IoT projects, or even remote monitoring. Its small form factor and rich feature set make it a popular choice among developers and enthusiasts alike.
Line 22: Line 23:
 (Specifications could be found here: [[https://wiki.seeedstudio.com/UartSBee_v5/|link]]) (Specifications could be found here: [[https://wiki.seeedstudio.com/UartSBee_v5/|link]])
  
-{{ :amc:ss2023:group-b:uartsbee_v5_new.jpg?200|}}+^{{ :amc:ss2023:group-b:uartsbee_v5_new.jpg?200|}}^ 
 +|**Fig.2:** UARTSBee| 
  
 The UARTSBee v5.0 module is a handy and user-friendly communication module that facilitates serial communication between devices. Equipped with a USB-to-serial chip, it enables easy connection and data exchange between a computer and various electronic devices or microcontrollers. Its compact design and robust functionality make it an essential tool for debugging and programming microcontrollers, as well as for establishing reliable serial communication in DIY electronics projects. With its versatility and simplicity, the UARTSBee v5.0 module serves as a reliable bridge for transmitting data over UART interfaces, simplifying the process of communication in numerous applications. The UARTSBee v5.0 module is a handy and user-friendly communication module that facilitates serial communication between devices. Equipped with a USB-to-serial chip, it enables easy connection and data exchange between a computer and various electronic devices or microcontrollers. Its compact design and robust functionality make it an essential tool for debugging and programming microcontrollers, as well as for establishing reliable serial communication in DIY electronics projects. With its versatility and simplicity, the UARTSBee v5.0 module serves as a reliable bridge for transmitting data over UART interfaces, simplifying the process of communication in numerous applications.
 +
 +
 +
 === 4) USB A cable to micro USB cable === === 4) USB A cable to micro USB cable ===
 USB (Universal Serial Bus) is a widely used interface technology that enables the connection and communication between electronic devices. It simplifies the process of data transfer, device charging, and peripheral connectivity. The USB standard consists of various types of connectors, including Type-A, Type-B, and Type-C, each serving specific purposes. When a USB device is connected to a host device, such as a computer or smartphone, it establishes a communication link through a series of protocols. These protocols define the data transfer speed, power delivery, and the type of data being transferred. The USB interface provides a plug-and-play functionality, allowing devices to be hot-swapped without requiring a system restart. With its versatility, ease of use, and widespread compatibility, USB has become an indispensable technology in the modern digital ecosystem. USB (Universal Serial Bus) is a widely used interface technology that enables the connection and communication between electronic devices. It simplifies the process of data transfer, device charging, and peripheral connectivity. The USB standard consists of various types of connectors, including Type-A, Type-B, and Type-C, each serving specific purposes. When a USB device is connected to a host device, such as a computer or smartphone, it establishes a communication link through a series of protocols. These protocols define the data transfer speed, power delivery, and the type of data being transferred. The USB interface provides a plug-and-play functionality, allowing devices to be hot-swapped without requiring a system restart. With its versatility, ease of use, and widespread compatibility, USB has become an indispensable technology in the modern digital ecosystem.
Line 32: Line 38:
 ==== Our final setup looks like that: ==== ==== Our final setup looks like that: ====
  
-{{:amc:ss2023:group-b:screenshot_2023-07-16_170016.png?600X160|}} {{:amc:ss2023:group-b:photo_2023-07-16_17-06-17.jpg?200|}}+^{{:amc:ss2023:group-b:screenshot_2023-07-16_170016.png?600X160|}} {{:amc:ss2023:group-b:photo_2023-07-16_17-06-17.jpg?200|}}^ 
 +|**Fig.3:** Theoretical + Physical Setup|
  
-<imgcaption Picture 1|>Adds an ImageCaption tag</imgcaption> 
  
 For the setup we had to perform a couple of steps: For the setup we had to perform a couple of steps:
  
   *   Prepare the camera focus   *   Prepare the camera focus
-The initial setup of the camera had glue on the lens protector and on the lens rotator.{{ :amc:ss2023:group-b:photo_2023-07-19_15-53-00.jpg?150|}}+The initial setup of the camera had glue on the lens protector and on the lens rotator.^{{ :amc:ss2023:group-b:photo_2023-07-19_15-53-00.jpg?150|}}^  
 +|**Fig.4:** Broken camera filter|
 So to make a proper focus we had to remove this glue or simply just to loosen the rotator. We made it using a knife and pliers.  So to make a proper focus we had to remove this glue or simply just to loosen the rotator. We made it using a knife and pliers. 
 Unfortunately, the rotator is very easy to break so we broke it but it never bothered the focus. Unfortunately, the rotator is very easy to break so we broke it but it never bothered the focus.
Line 47: Line 54:
 For this step we used the AI-on-the-edge project from Jomjol: [[https://github.com/jomjol/AI-on-the-edge-device/|link to the github of Jomjol]] For this step we used the AI-on-the-edge project from Jomjol: [[https://github.com/jomjol/AI-on-the-edge-device/|link to the github of Jomjol]]
  
-{{ :amc:ss2023:group-b:idea.jpg?800 |}}+^{{ :amc:ss2023:group-b:idea.jpg?800 |}}^ 
 +|**Fig.5:** Working Principle| 
 + 
 +^{{ :amc:ss2023:group-b:screenshot_2023-07-19_161457.png?200|}}^ 
 +|**Fig.6:** SD Card HTML File configuration|
  
 The project gives us a possibility to make our own computer vision system to interact with the water meter. The key features of the project are: The project gives us a possibility to make our own computer vision system to interact with the water meter. The key features of the project are:
Line 61: Line 72:
   - REST API   - REST API
  
-{{ :amc:ss2023:group-b:screenshot_2023-07-19_161457.png?200|}}The initial step of the installation was to download the ZIP archive [[https://github.com/jomjol/AI-on-the-edge-device/|(the whole github repository)]]. Then we just had to simply follow the [[https://jomjol.github.io/AI-on-the-edge-device-docs/Installation/|instructions]]. + 
 +The initial step of the installation was to download the ZIP archive [[https://github.com/jomjol/AI-on-the-edge-device/|(the whole github repository)]]. Then we just had to simply follow the [[https://jomjol.github.io/AI-on-the-edge-device-docs/Installation/|instructions]]. 
 After downloading the repository we copied the SD card folder to our SD card that we used for the camera setup.  After downloading the repository we copied the SD card folder to our SD card that we used for the camera setup. 
 Inside we could find a WLAN.ini file where we had to insert our wifi credentials in order to have our camera connected to our wifi. The SD card we use should not be bigger then 16Gb and should have FAT32 format. Inside we could find a WLAN.ini file where we had to insert our wifi credentials in order to have our camera connected to our wifi. The SD card we use should not be bigger then 16Gb and should have FAT32 format.
Line 76: Line 88:
 Then we have to wait a little bit until the code will be transferred into the ESP32 cam: Then we have to wait a little bit until the code will be transferred into the ESP32 cam:
  
-{{ :amc:ss2023:group-b:screenshot_2023-07-19_163118.png?400 |}}+^{{ :amc:ss2023:group-b:screenshot_2023-07-19_163118.png?400 |}}^ 
 +|**Fig.7:** ESP32-CAM response|
  
 After performing these steps the ESP32 module should start to blink. If it blinks 4 times and then stops for a while then everything is ok and we can check it in Serial Monitor. After performing these steps the ESP32 module should start to blink. If it blinks 4 times and then stops for a while then everything is ok and we can check it in Serial Monitor.
Line 83: Line 96:
 After successfully installing the software we can move to the step of setting the camera up. For this purpose we use the ip address we can obtain from serial monitor info. For us it was 192.168.2.167, but it can differ from time to time. Immediately we had a problem of not showing the window: After successfully installing the software we can move to the step of setting the camera up. For this purpose we use the ip address we can obtain from serial monitor info. For us it was 192.168.2.167, but it can differ from time to time. Immediately we had a problem of not showing the window:
  
-{{ :amc:ss2023:group-b:screenshot_2023-07-19_165715.png?400 |}}+^{{ :amc:ss2023:group-b:screenshot_2023-07-19_165715.png?400 |}}^ 
 +|**Fig.8:** Welcome HTML Page|
  
 We figured out that we had a problem with our wifi connection and it was repeating from time to time. We found a solution and it is to connect the camera to the mobile hotspot but later the problem repeated. So we think that just reconnecting helps but not for a long time.  We figured out that we had a problem with our wifi connection and it was repeating from time to time. We found a solution and it is to connect the camera to the mobile hotspot but later the problem repeated. So we think that just reconnecting helps but not for a long time. 
Line 91: Line 105:
 Firstly we had to make a clear reference image. We can simply do this following the instructions. The image is needed for the system to know where to find the values. Firstly we had to make a clear reference image. We can simply do this following the instructions. The image is needed for the system to know where to find the values.
  
-{{ :amc:ss2023:group-b:aa92fb4f-9b2d-4037-83aa-d853fbddcf5b.jpeg?600 |}}+^{{ :amc:ss2023:group-b:aa92fb4f-9b2d-4037-83aa-d853fbddcf5b.jpeg?600 |}}^ 
 +|**Fig.9:** Reference image setting|
    
 The idea of the configuration is to align a proper box for the computer vision to work. By the box we mean that we have to indicate which field are suppose to be read. We can add or remove the boxes so finally we had to read the numbers and the analog indicator so just for test we made 3 number boxes and one analog indicator box. Then we can reboot the ESP32 module. The idea of the configuration is to align a proper box for the computer vision to work. By the box we mean that we have to indicate which field are suppose to be read. We can add or remove the boxes so finally we had to read the numbers and the analog indicator so just for test we made 3 number boxes and one analog indicator box. Then we can reboot the ESP32 module.
 The next step is to get the image of a water meter. We can check the status of the system in a serial monitor. There we can see that after rebooting and two failed attempts to connect to wifi we finally can start making photos (so-called “Rounds”). The round is a one time recognition.  The next step is to get the image of a water meter. We can check the status of the system in a serial monitor. There we can see that after rebooting and two failed attempts to connect to wifi we finally can start making photos (so-called “Rounds”). The round is a one time recognition. 
  
-{{ :amc:ss2023:group-b:screenshot_2023-07-19_165736.png?600 |}}+^{{ :amc:ss2023:group-b:screenshot_2023-07-19_165736.png?600 |}}^ 
 +|**Fig.10:** Loading page|
  
-{{ :amc:ss2023:group-b:69511b4b-89e4-47ee-b150-688bc4e9edaa.jpeg?600 |}}+^{{ :amc:ss2023:group-b:69511b4b-89e4-47ee-b150-688bc4e9edaa.jpeg?600 |}}^ 
 +|**Fig.11:** First reading|
  
  
 Initially, we had aligned our boxed with mistakes and we could clearly seen that the values are not correct. But after making proper boxes and making some improvements we finally got our recognised results. We then tried to recognise the analog values as well and we indeed got some results but we think that the system is not recognising the analog values properly. Also, it is clear that when the value is in between two states (between 8 and 9 for example) the system sometimes make mistakes. It should clearly see the value to get it so we think that it is useful to also check the photo of a water meter.  Initially, we had aligned our boxed with mistakes and we could clearly seen that the values are not correct. But after making proper boxes and making some improvements we finally got our recognised results. We then tried to recognise the analog values as well and we indeed got some results but we think that the system is not recognising the analog values properly. Also, it is clear that when the value is in between two states (between 8 and 9 for example) the system sometimes make mistakes. It should clearly see the value to get it so we think that it is useful to also check the photo of a water meter. 
  
-{{ :amc:ss2023:group-b:68c71fd2-931c-4d4c-8fee-a19806594d1a.jpeg?600 |}}+^{{ :amc:ss2023:group-b:68c71fd2-931c-4d4c-8fee-a19806594d1a.jpeg?600 |}}^ 
 +|**Fig.12:** Final reading|
  
 ====== Another setup ===== ====== Another setup =====
 As it was previously said a number recognition process could make some mistakes in a lot of situations. Also, it could be not very convenient to open the website and check the results. But we have a solution for that situation. As it was previously said a number recognition process could make some mistakes in a lot of situations. Also, it could be not very convenient to open the website and check the results. But we have a solution for that situation.
  
-{{ :amc:ss2023:group-b:7585b993-fb60-423b-96c3-d12a07731777.png?200|}}We made a telegram bot which could be used for checking the values of the water meter. The process is very simple because we used a ready project that gives us a possibility to send commands on the ESP32 module and receive photos of a water meter.+^{{ :amc:ss2023:group-b:7585b993-fb60-423b-96c3-d12a07731777.png?200|}}^ 
 +|**Fig.13:** Telegram Bot Overview| 
 +We made a telegram bot which could be used for checking the values of the water meter. The process is very simple because we used a ready project that gives us a possibility to send commands on the ESP32 module and receive photos of a water meter.
  
 We had to perform a couple of steps to make this bot usable:  We had to perform a couple of steps to make this bot usable: 
Line 263: Line 283:
 ===== Links ===== ===== Links =====
  
 +[[https://randomnerdtutorials.com/telegram-esp32-cam-photo-arduino/]]
  
 +[[https://www.youtube.com/watch?v=iUgxwbfkIqU]]
  
 +[[https://student-wiki.eolab.de/doku.php?id=start]]
  
  
amc/ss2023/group-b/start.1689858857.txt.gz · Last modified: 2023/07/20 15:14 by matsvei.yankouski