Differences

This shows you the differences between two versions of the page.

--- amc:ss2023:group-b:start [2023/07/20 14:36] – matsvei.yankouski
+++ amc:ss2023:group-b:start [2023/07/24 21:23] (current) – stas.besliu
@@ Line 16: / Line 16: @@
 (Specifications could be found here: [[https://loboris.eu/ESP32/ESP32-CAM%20Product%20Specification.pdf#:~:text=Module%20Model%20ESP32-CAM%20Package%20DIP-16%20Size%2027%2A40.5%2A4.5%02%C3%84%C2%B10.2%02%C3%85mm%20SPI,Storage%20Environment%20-40%20%01%07~%2090%20%01%07%2C%20%3C%2090%25RH|link]])
-{{ :amc:ss2023:group-b:image.jpg?200|}}
+^{{ :amc:ss2023:group-b:image.jpg?200|}}^
+|**Fig.1:** ESP32-CAM|
 The ESP32-CAM module is a versatile and compact development board that combines an ESP32 microcontroller with a camera module. It offers a wide range of functionalities, including Wi-Fi and Bluetooth connectivity, making it an excellent choice for projects that require image capture and transmission. With its built-in camera, the ESP32-CAM enables users to capture and stream images or videos in real-time, making it ideal for applications such as surveillance systems, IoT projects, or even remote monitoring. Its small form factor and rich feature set make it a popular choice among developers and enthusiasts alike.
@@ Line 22: / Line 23: @@
 (Specifications could be found here: [[https://wiki.seeedstudio.com/UartSBee_v5/|link]])
-{{ :amc:ss2023:group-b:uartsbee_v5_new.jpg?200|}}
+^{{ :amc:ss2023:group-b:uartsbee_v5_new.jpg?200|}}^
+|**Fig.2:** UARTSBee|
 The UARTSBee v5.0 module is a handy and user-friendly communication module that facilitates serial communication between devices. Equipped with a USB-to-serial chip, it enables easy connection and data exchange between a computer and various electronic devices or microcontrollers. Its compact design and robust functionality make it an essential tool for debugging and programming microcontrollers, as well as for establishing reliable serial communication in DIY electronics projects. With its versatility and simplicity, the UARTSBee v5.0 module serves as a reliable bridge for transmitting data over UART interfaces, simplifying the process of communication in numerous applications.
 === 4) USB A cable to micro USB cable ===
 USB (Universal Serial Bus) is a widely used interface technology that enables the connection and communication between electronic devices. It simplifies the process of data transfer, device charging, and peripheral connectivity. The USB standard consists of various types of connectors, including Type-A, Type-B, and Type-C, each serving specific purposes. When a USB device is connected to a host device, such as a computer or smartphone, it establishes a communication link through a series of protocols. These protocols define the data transfer speed, power delivery, and the type of data being transferred. The USB interface provides a plug-and-play functionality, allowing devices to be hot-swapped without requiring a system restart. With its versatility, ease of use, and widespread compatibility, USB has become an indispensable technology in the modern digital ecosystem.
@@ Line 32: / Line 38: @@
 ==== Our final setup looks like that: ====
-{{:amc:ss2023:group-b:screenshot_2023-07-16_170016.png?600X180|}} {{:amc:ss2023:group-b:photo_2023-07-16_17-06-17.jpg?200|}}
+^{{:amc:ss2023:group-b:screenshot_2023-07-16_170016.png?600X160|}} {{:amc:ss2023:group-b:photo_2023-07-16_17-06-17.jpg?200|}}^
+|**Fig.3:** Theoretical + Physical Setup|
-<imgcaption Picture 1|>Adds an ImageCaption tag</imgcaption>
 For the setup we had to perform a couple of steps:
   *   Prepare the camera focus
-The initial setup of the camera had glue on the lens protector and on the lens rotator.{{ :amc:ss2023:group-b:photo_2023-07-19_15-53-00.jpg?150|}}
+The initial setup of the camera had glue on the lens protector and on the lens rotator.^{{ :amc:ss2023:group-b:photo_2023-07-19_15-53-00.jpg?150|}}^
+|**Fig.4:** Broken camera filter|
 So to make a proper focus we had to remove this glue or simply just to loosen the rotator. We made it using a knife and pliers.
 Unfortunately, the rotator is very easy to break so we broke it but it never bothered the focus.
@@ Line 47: / Line 54: @@
 For this step we used the AI-on-the-edge project from Jomjol: [[https://github.com/jomjol/AI-on-the-edge-device/|link to the github of Jomjol]]
-{{ :amc:ss2023:group-b:idea.jpg?800 |}}
+^{{ :amc:ss2023:group-b:idea.jpg?800 |}}^
+|**Fig.5:** Working Principle|
+^{{ :amc:ss2023:group-b:screenshot_2023-07-19_161457.png?200|}}^
+|**Fig.6:** SD Card HTML File configuration|
 The project gives us a possibility to make our own computer vision system to interact with the water meter. The key features of the project are:
@@ Line 61: / Line 72: @@
   - REST API
-{{ :amc:ss2023:group-b:screenshot_2023-07-19_161457.png?200|}}The initial step of the installation was to download the ZIP archive [[https://github.com/jomjol/AI-on-the-edge-device/|(the whole github repository)]]. Then we just had to simply follow the [[https://jomjol.github.io/AI-on-the-edge-device-docs/Installation/|instructions]].
+The initial step of the installation was to download the ZIP archive [[https://github.com/jomjol/AI-on-the-edge-device/|(the whole github repository)]]. Then we just had to simply follow the [[https://jomjol.github.io/AI-on-the-edge-device-docs/Installation/|instructions]].
 After downloading the repository we copied the SD card folder to our SD card that we used for the camera setup.
 Inside we could find a WLAN.ini file where we had to insert our wifi credentials in order to have our camera connected to our wifi. The SD card we use should not be bigger then 16Gb and should have FAT32 format.
@@ Line 76: / Line 88: @@
 Then we have to wait a little bit until the code will be transferred into the ESP32 cam:
-{{ :amc:ss2023:group-b:screenshot_2023-07-19_163118.png?400 |}}
+^{{ :amc:ss2023:group-b:screenshot_2023-07-19_163118.png?400 |}}^
+|**Fig.7:** ESP32-CAM response|
 After performing these steps the ESP32 module should start to blink. If it blinks 4 times and then stops for a while then everything is ok and we can check it in Serial Monitor.
@@ Line 83: / Line 96: @@
 After successfully installing the software we can move to the step of setting the camera up. For this purpose we use the ip address we can obtain from serial monitor info. For us it was 192.168.2.167, but it can differ from time to time. Immediately we had a problem of not showing the window:
-{{ :amc:ss2023:group-b:screenshot_2023-07-19_165715.png?400 |}}
+^{{ :amc:ss2023:group-b:screenshot_2023-07-19_165715.png?400 |}}^
+|**Fig.8:** Welcome HTML Page|
 We figured out that we had a problem with our wifi connection and it was repeating from time to time. We found a solution and it is to connect the camera to the mobile hotspot but later the problem repeated. So we think that just reconnecting helps but not for a long time.
@@ Line 90: / Line 104: @@
 Firstly we had to make a clear reference image. We can simply do this following the instructions. The image is needed for the system to know where to find the values.
+^{{ :amc:ss2023:group-b:aa92fb4f-9b2d-4037-83aa-d853fbddcf5b.jpeg?600 |}}^
+|**Fig.9:** Reference image setting|
 The idea of the configuration is to align a proper box for the computer vision to work. By the box we mean that we have to indicate which field are suppose to be read. We can add or remove the boxes so finally we had to read the numbers and the analog indicator so just for test we made 3 number boxes and one analog indicator box. Then we can reboot the ESP32 module.
 The next step is to get the image of a water meter. We can check the status of the system in a serial monitor. There we can see that after rebooting and two failed attempts to connect to wifi we finally can start making photos (so-called “Rounds”). The round is a one time recognition.
+^{{ :amc:ss2023:group-b:screenshot_2023-07-19_165736.png?600 |}}^
+|**Fig.10:** Loading page|
+^{{ :amc:ss2023:group-b:69511b4b-89e4-47ee-b150-688bc4e9edaa.jpeg?600 |}}^
+|**Fig.11:** First reading|
 Initially, we had aligned our boxed with mistakes and we could clearly seen that the values are not correct. But after making proper boxes and making some improvements we finally got our recognised results. We then tried to recognise the analog values as well and we indeed got some results but we think that the system is not recognising the analog values properly. Also, it is clear that when the value is in between two states (between 8 and 9 for example) the system sometimes make mistakes. It should clearly see the value to get it so we think that it is useful to also check the photo of a water meter.
-The window should look like that if everything went good:
+^{{ :amc:ss2023:group-b:68c71fd2-931c-4d4c-8fee-a19806594d1a.jpeg?600 |}}^
+|**Fig.12:** Final reading|
+====== Another setup =====
+As it was previously said a number recognition process could make some mistakes in a lot of situations. Also, it could be not very convenient to open the website and check the results. But we have a solution for that situation.
+^{{ :amc:ss2023:group-b:7585b993-fb60-423b-96c3-d12a07731777.png?200|}}^
+|**Fig.13:** Telegram Bot Overview|
+We made a telegram bot which could be used for checking the values of the water meter. The process is very simple because we used a ready project that gives us a possibility to send commands on the ESP32 module and receive photos of a water meter.
+We had to perform a couple of steps to make this bot usable:
+  - Creating a new bot
+  - Using the credentials from the created bot
+  - Making the bot work
+  - Receiving photos and check
+After performing these operations we were able to get photos of the water meter directly onto our telegram account using /photos command and turning on the flash using /flash command.
+For this project we used the code:
+<file c# code.cs>
+#ifdef ESP32
+  #include <WiFi.h>
+#else
+  #include <ESP8266WiFi.h>
+#endif
+#include <WiFiClientSecure.h>
+#include <UniversalTelegramBot.h>   // Universal Telegram Bot Library written by Brian Lough: https://github.com/witnessmenow/Universal-Arduino-Telegram-Bot
+#include <ArduinoJson.h>
+// Replace with your network credentials
+const char* ssid = "REPLACE_WITH_YOUR_SSID";
+const char* password = "REPLACE_WITH_YOUR_PASSWORD";
+// Initialize Telegram BOT
+#define BOTtoken "XXXXXXXXXX:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"  // your Bot Token (Get from Botfather)
+// Use @myidbot to find out the chat ID of an individual or a group
+// Also note that you need to click "start" on a bot before it can
+// message you
+#define CHAT_ID "XXXXXXXXXX"
+#ifdef ESP8266
+  X509List cert(TELEGRAM_CERTIFICATE_ROOT);
+#endif
+WiFiClientSecure client;
+UniversalTelegramBot bot(BOTtoken, client);
+// Checks for new messages every 1 second.
+int botRequestDelay = 1000;
+unsigned long lastTimeBotRan;
+const int ledPin = 2;
+bool ledState = LOW;
+// Handle what happens when you receive new messages
+void handleNewMessages(int numNewMessages) {
+  Serial.println("handleNewMessages");
+  Serial.println(String(numNewMessages));
+  for (int i=0; i<numNewMessages; i++) {
+    // Chat id of the requester
+    String chat_id = String(bot.messages[i].chat_id);
+    if (chat_id != CHAT_ID){
+      bot.sendMessage(chat_id, "Unauthorized user", "");
+      continue;
+    }
+    // Print the received message
+    String text = bot.messages[i].text;
+    Serial.println(text);
+    String from_name = bot.messages[i].from_name;
+    if (text == "/start") {
+      String welcome = "Welcome, " + from_name + ".\n";
+      welcome += "Use the following commands to control your outputs.\n\n";
+      welcome += "/led_on to turn GPIO ON \n";
+      welcome += "/led_off to turn GPIO OFF \n";
+      welcome += "/state to request current GPIO state \n";
+      bot.sendMessage(chat_id, welcome, "");
+    }
+    if (text == "/led_on") {
+      bot.sendMessage(chat_id, "LED state set to ON", "");
+      ledState = HIGH;
+      digitalWrite(ledPin, ledState);
+    }
+    if (text == "/led_off") {
+      bot.sendMessage(chat_id, "LED state set to OFF", "");
+      ledState = LOW;
+      digitalWrite(ledPin, ledState);
+    }
+    if (text == "/state") {
+      if (digitalRead(ledPin)){
+        bot.sendMessage(chat_id, "LED is ON", "");
+      }
+      else{
+        bot.sendMessage(chat_id, "LED is OFF", "");
+      }
+    }
+  }
+}
+void setup() {
+  Serial.begin(115200);
+  #ifdef ESP8266
+    configTime(0, 0, "pool.ntp.org");      // get UTC time via NTP
+    client.setTrustAnchors(&cert); // Add root certificate for api.telegram.org
+  #endif
+  pinMode(ledPin, OUTPUT);
+  digitalWrite(ledPin, ledState);
+  // Connect to Wi-Fi
+  WiFi.mode(WIFI_STA);
+  WiFi.begin(ssid, password);
+  #ifdef ESP32
+    client.setCACert(TELEGRAM_CERTIFICATE_ROOT); // Add root certificate for api.telegram.org
+  #endif
+  while (WiFi.status() != WL_CONNECTED) {
+    delay(1000);
+    Serial.println("Connecting to WiFi..");
+  }
+  // Print ESP32 Local IP Address
+  Serial.println(WiFi.localIP());
+}
+void loop() {
+  if (millis() > lastTimeBotRan + botRequestDelay)  {
+    int numNewMessages = bot.getUpdates(bot.last_message_received + 1);
+    while(numNewMessages) {
+      Serial.println("got response");
+      handleNewMessages(numNewMessages);
+      numNewMessages = bot.getUpdates(bot.last_message_received + 1);
+    }
+    lastTimeBotRan = millis();
+  }
+}
+</file>
+====== Discussion ======
+Despite these systems being effective in taking photos of the water meter we think that we have to improve the system of recognition. Without the system we cannot make a proper data analysis and a long time analysis so the usage of systems is limited for now.
-{{:amc:ss2023:group-b:screenshot_2023-07-19_163350.png?400 |}}
+It was a difficult task to make the camera work and connect it to a wifi while maintaining the connection between a camera and computer. We faced a lot of struggles:
-{{:amc:ss2023:group-b:screenshot_2023-07-19_164430.png?400 |}}
+  - Camera focus was very difficult to unblock from glue
-{{:amc:ss2023:group-b:screenshot_2023-07-19_165659.png?400 |}}
+  - Connection between camera and WiFi was always interrupted
+  - Com port could not be found after a while so we had to restart the system and computer
+  - The Ai-on-the-edge project website was not working
+  - For telegram bot it was really hard to connect the number recognition system to a bot. There are some project on the internet, however, they use premade bots or paid ORS system. So we had to train the ai system by ourselves on a huge amount of data which was not possible due to a lack of data.
-{{:amc:ss2023:group-b:screenshot_2023-07-19_165736.png?400 |}}
+However, we made a big progress in maintaining the smart water meter system. A lot of improvements could be made but we proved that it is possible to extract data from the ESP32 module and use it to build smart solutions for easier life.
-===== Discussion =====
 ===== Links =====
+[[https://randomnerdtutorials.com/telegram-esp32-cam-photo-arduino/]]
+[[https://www.youtube.com/watch?v=iUgxwbfkIqU]]
+[[https://student-wiki.eolab.de/doku.php?id=start]]