amc:ss2024:groundwater_gauge:start
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
amc:ss2024:groundwater_gauge:start [2024/07/31 18:51] – 28057_students.hsrw | amc:ss2024:groundwater_gauge:start [2024/07/31 22:01] (current) – 28057_students.hsrw | ||
---|---|---|---|
Line 3: | Line 3: | ||
===== Introduction ===== | ===== Introduction ===== | ||
- | With the mining history of NRW and the impact it had on the soil, groundwater has always been a point of interest. Combined with the increased precipitation<sup>1)</ | + | With the mining history of NRW and the impact it had on the soil, groundwater has always been a point of interest. Combined with the increased precipitation |
+ | |||
+ | {{ : | ||
+ | | ||
These sample wells are not easily accessed and will not have an easy access to the electrical grid. Therefore, the measuring device should have its own power supply. The idea of this system is to make sure data can come in continuously without much physical labour from employees of the organisation that monitors the groundwater level (in the region of Kamp-Lintfort this would be LINEG). Measuring 24 hours a day would mean an immense capacity requirement for the batteries and would not make it a sustainable way of monitoring. Because the impact of precipitation on the groundwater level in the targeted region of Kamp-Lintfort, | These sample wells are not easily accessed and will not have an easy access to the electrical grid. Therefore, the measuring device should have its own power supply. The idea of this system is to make sure data can come in continuously without much physical labour from employees of the organisation that monitors the groundwater level (in the region of Kamp-Lintfort this would be LINEG). Measuring 24 hours a day would mean an immense capacity requirement for the batteries and would not make it a sustainable way of monitoring. Because the impact of precipitation on the groundwater level in the targeted region of Kamp-Lintfort, | ||
Line 11: | Line 14: | ||
In this section each component of the system will be highlighted, | In this section each component of the system will be highlighted, | ||
{{ : | {{ : | ||
+ | Fig. 2, Schematic of our Set Up by De Jong | ||
- | As seen in the schematic | + | As seen in Fig.2, |
* __Lithium Rechargeable Battery -> MC(SH1.25-2)__ | * __Lithium Rechargeable Battery -> MC(SH1.25-2)__ | ||
Line 66: | Line 70: | ||
==== 2.1 Microcontroller (MC) ==== | ==== 2.1 Microcontroller (MC) ==== | ||
- | As a microcontroller we use the Heltec CubeCell dev-6502. This MC has a LoRa data transfer option, known for its low power usage in sleep mode and for this specific project a direct photovoltaic connection, build in battery charge option and battery status check option. It includes a USB interface for easy programming, | + | We used the microcontroller from Heltec CubeCell dev-6502 |
{{ : | {{ : | ||
- | Source: https:// | + | Fig. 3, Heltec Microcontroller, |
==== 2.2 Current to Voltage converter. ==== | ==== 2.2 Current to Voltage converter. ==== | ||
- | For the MC to be able to use the output of the sensor, the sensor output signal needs ro be converted from current which ranges between 4 and 20 mA to a Voltage-range readable by the microcontroller. This process will be covered by a current to voltage converter. The converter in this system is the XY-IT0V (no specified brand). | + | For the MC to be able to use the output of the sensor, the sensor output signal needs ro be converted from current which ranges between 4 and 20 mA to a Voltage-range readable by the microcontroller. This process will be covered by a current to voltage converter |
This converter can be adjusted for different voltage ranges by the means of jumpers. 2 jumpers are present on the converter and with the right combination for “on” and “off” of these jumpers the required voltage output can be set. On this webpage more information concerning the convertor and how to calibrate can be found on the following webpage https:// | This converter can be adjusted for different voltage ranges by the means of jumpers. 2 jumpers are present on the converter and with the right combination for “on” and “off” of these jumpers the required voltage output can be set. On this webpage more information concerning the convertor and how to calibrate can be found on the following webpage https:// | ||
{{ : | {{ : | ||
- | Source: https:// | + | Fig.4, Current to Voltage Converter, |
==== 2.3 Sensor ==== | ==== 2.3 Sensor ==== | ||
Line 107: | Line 111: | ||
==== 2.6 Voltage step-up regulator ==== | ==== 2.6 Voltage step-up regulator ==== | ||
- | In order to get enough voltage for the sensor (12V was enough) a voltage | + | In order to get enough voltage for the sensor (12V was enough) a voltage |
{{ : | {{ : | ||
- | Source: https:// | + | |
==== 2.7 Real-Time Clock (RTC) ==== | ==== 2.7 Real-Time Clock (RTC) ==== | ||
- | For the MC to be as efficient as possible (by use of sleep mode) a RTC (ds3231 I2C) is connected to the the MC. The RTC will keep an accurate time so the MC can be in sleep mode and wake up at the appropriate time to preserve power. | + | For the MC to be as efficient as possible (by use of sleep mode) a RTC ds3231 I2C (as seen in Fig.6) is connected to the the MC. The RTC will keep an accurate time so the MC can be in sleep mode and wake up at the appropriate time to preserve power. |
{{ : | {{ : | ||
- | | + | Fig.6, RTC, Source: https:// |
==== 2.8 LoRaWAN & TTN ==== | ==== 2.8 LoRaWAN & TTN ==== | ||
LoRaWAN, which stands for Long Range Wide Area Network, is a communication protocol specifically designed for low-power, long-distance wireless data transmission. It is ideal for Internet of Things (IoT) applications where devices need to transmit small data packets over extended ranges while maintaining energy efficiency. Operating in sub-gigahertz frequency bands, LoRaWAN can achieve coverage of several kilometers in urban environments and even greater distances in rural areas. | LoRaWAN, which stands for Long Range Wide Area Network, is a communication protocol specifically designed for low-power, long-distance wireless data transmission. It is ideal for Internet of Things (IoT) applications where devices need to transmit small data packets over extended ranges while maintaining energy efficiency. Operating in sub-gigahertz frequency bands, LoRaWAN can achieve coverage of several kilometers in urban environments and even greater distances in rural areas. | ||
+ | For visualization as seen in Fig.7, LoRa modulation offers a much longer communication range at low bandwidths compared to other competing wireless data transmission technologies. | ||
{{: | {{: | ||
- | Source: https:// | + | |
The core advantage of LoRaWAN lies in its capability to provide long-range connectivity with minimal energy consumption. This is accomplished through chirp spread spectrum modulation, which enhances resistance to interference and extends communication ranges. The network structure of LoRaWAN is typically organized in a star topology, where end devices communicate directly with gateways. These gateways then forward the data to a central network server through a backhaul connection, which could be cellular, Ethernet, or other types of connectivity. | The core advantage of LoRaWAN lies in its capability to provide long-range connectivity with minimal energy consumption. This is accomplished through chirp spread spectrum modulation, which enhances resistance to interference and extends communication ranges. The network structure of LoRaWAN is typically organized in a star topology, where end devices communicate directly with gateways. These gateways then forward the data to a central network server through a backhaul connection, which could be cellular, Ethernet, or other types of connectivity. | ||
+ | In Fig. 8 the elements of a typical LoRaWAN network are visualized. | ||
+ | |||
+ | A typical LoRaWAN network consists of the following elements. | ||
{{: | {{: | ||
- | | + | Fig.8, Elements in a typical LoRaWAN network, |
LoRaWAN' | LoRaWAN' | ||
Line 145: | Line 153: | ||
NODE-RED | NODE-RED | ||
- | Node-RED is a flow-based development tool for visual programming that facilitates the connection of hardware devices, application programming interfaces (APIs) and online services, especially in IoT applications.(1) . | + | Node-RED is a flow-based development tool for visual programming that facilitates the connection of hardware devices, application programming interfaces (APIs) and online services, especially in IoT applications.<sup>1)</ |
{{ : | {{ : | ||
- | | + | |
- | Node-red is use to put together data processing logic and send the processed data to advanced systems, like a central data collector or cloud-based service, within minutes or show it right away. Node-red includes nodes that offer functions such as MQTT broker, debug, InfluxDB out ,etc. and the Created processes are stored using JSON objects as shown figure | + | Node-red is use to put together data processing logic and send the processed data to advanced systems, like a central data collector or cloud-based service, within minutes or show it right away. Node-red includes nodes that offer functions such as MQTT broker, debug, InfluxDB out ,etc. and the Created processes are stored using JSON objects as shown figure |
INFLUXDB | INFLUXDB | ||
- | InfluxDB is an open source time-series database optimised for real-time data management and analysis(2). The system is designed to facilitate high-performance writing and reading at scale and is particularly suitable for applications such as the Internet of Things (IoT), DevOps and real-time analytics. InfluxDB' | + | InfluxDB is an open source time-series database optimised for real-time data management and analysis<sup>2)</ |
{{ : | {{ : | ||
- | | + | |
- | The underlying data model is based on measurements, | + | The underlying data model is based on measurements, |
GRAFANA | GRAFANA | ||
- | Grafana is an open source monitoring and observation platform, it provides an easy-to-use interface for visualising complex metrics and log data from a variety of data sources, including InfluxDB, Prometheus and Graphite(3). In addition to visualisations, | + | Grafana is an open source monitoring and observation platform, it provides an easy-to-use interface for visualising complex metrics and log data from a variety of data sources, including InfluxDB, Prometheus and Graphite<sup>3)</ |
{{ : | {{ : | ||
- | FIG. 12, Grafana dashboard by Henrydon. | + | FIG. 11, Grafana dashboard by Henrydon. |
| | ||
- | Grafana provides a variety of visualisation options, including graphs, tables, heatmaps and histograms as shown in the figure | + | Grafana provides a variety of visualisation options, including graphs, tables, heatmaps and histograms as shown in the figure |
{{ : | {{ : | ||
- | FIG.13, Diagram to illustrate the connection of the NIG environment by Henrydon | + | FIG.12, Diagram to illustrate the connection of the NIG environment by Henrydon |
| | ||
- | Node-RED performs the functions of data collection and preprocessing. Data from various sources is transformed as required and then transferred to InfluxDB. InfluxDB stores time series data in a structured format, optimized for high write and read performance. Grafana retrieves data from InfluxDB and presents it in visually appealing dashboards and graphs as seen in figure | + | Node-RED performs the functions of data collection and preprocessing. Data from various sources is transformed as required and then transferred to InfluxDB. InfluxDB stores time series data in a structured format, optimized for high write and read performance. Grafana retrieves data from InfluxDB and presents it in visually appealing dashboards and graphs as seen in figure |
| | ||
Line 386: | Line 394: | ||
- | | + | |
- | The figure | + | The figure |
{{ : | {{ : | ||
- | FIG. 15, Time series data logged in InfluxDB by Henrydon | + | FIG. 14, Time series data logged in InfluxDB by Henrydon |
| | ||
- | The data displayed in figure | + | The data displayed in figure |
{{ : | {{ : | ||
- | FIG. 16, Data visualization in Grafana dash board by Henrydon | + | FIG. 15, Data visualization in Grafana dash board by Henrydon |
| | ||
- | The visualisation of the data was clearly seen on the grafana dashboard as shown in figure | + | The visualisation of the data was clearly seen on the grafana dashboard as shown in figure |
Line 407: | Line 415: | ||
In this project, we investigated the development of a sensor-based data logging system that integrates various components. These included the MC Heltec CubeCell dev-6502 microcontroller, | In this project, we investigated the development of a sensor-based data logging system that integrates various components. These included the MC Heltec CubeCell dev-6502 microcontroller, | ||
- | Scientific research supports the effectiveness of using microcontrollers like the Heltec CubeCell dev-6502 for low-power, long-range communication in IoT applications | + | Scientific research supports the effectiveness of using microcontrollers like the Heltec CubeCell dev-6502 for low-power, long-range communication in IoT applications |
- | The integration of renewable energy sources, such as photovoltaic panels, with energy storage solutions like lithium rechargeable batteries, has been shown to enhance the sustainability of IoT systems | + | The integration of renewable energy sources, such as photovoltaic panels, with energy storage solutions like lithium rechargeable batteries, has been shown to enhance the sustainability of IoT systems |
- | However, the integration of LoRaWAN and TTN presented significant challenges. LoRaWAN is known for its capabilities in providing wide-area network connectivity for IoT devices, and its integration with TTN can offer robust data transmission solutions | + | However, the integration of LoRaWAN and TTN presented significant challenges. LoRaWAN is known for its capabilities in providing wide-area network connectivity for IoT devices, and its integration with TTN can offer robust data transmission solutions |
**4.1 System Overview** | **4.1 System Overview** | ||
Line 419: | Line 427: | ||
**4.2 Challenges and Limitations** | **4.2 Challenges and Limitations** | ||
- | A major hurdle was the integration of LoRaWAN and TTN for data transmission over long distances. Despite considerable efforts, we were unable to complete this integration within the timeframe of the project. As a result, the system could not transmit data remotely or interface with broader network applications as initially planned. | + | A major hurdle was the integration of LoRaWAN and TTN for data transmission over long distances. Despite considerable efforts, we were unable to complete this integration within the timeframe of the project. As a result, the system could not transmit data remotely or interface with broader network applications as initially planned |
- | A second issue was not being able to get the correct date and time set up with the RTC, which made it impossible to finalize the deep sleep with wakeup function of the MC. For this to work correctly a WiFi module would need to be added to the system, that way the RTC can be synchronized and from there on used for the wake up function. | + | A second issue was not being able to get the correct date and time set up with the RTC, which made it impossible to finalize the deep sleep with wakeup function of the MC. For this to work correctly a WiFi module would need to be added to the system, that way the RTC can be synchronized and from there on used for the wake up function. |
Due to these limitations, | Due to these limitations, | ||
Line 428: | Line 436: | ||
While the RTC was not the primary focus of the project, it played a crucial role in ensuring that each data point collected was accurately timestamped. This feature enables precise time-series analysis when reviewing data later. Accurate time-stamping is essential for tracking trends and understanding patterns over time. | While the RTC was not the primary focus of the project, it played a crucial role in ensuring that each data point collected was accurately timestamped. This feature enables precise time-series analysis when reviewing data later. Accurate time-stamping is essential for tracking trends and understanding patterns over time. | ||
- | **4.4 NIG environment** | ||
- | The NIG environment(node-red, | ||
Line 440: | Line 446: | ||
* Testing and Calibration: | * Testing and Calibration: | ||
* Power Management: Improving power management strategies could enhance the system’s reliability and extend its operational time, particularly in locations with limited power sources | * Power Management: Improving power management strategies could enhance the system’s reliability and extend its operational time, particularly in locations with limited power sources | ||
- | * The NIG environment could have serve as a data transmission and visualization purpose if properly connected to the sensor. | + | * The NIG environment could have serve as a data transmission and visualization purpose if properly connected to the data source |
* Adding a WiFi module for date-time synchronization of the RTC. | * Adding a WiFi module for date-time synchronization of the RTC. | ||
* Deep dive in the libraries since the various libraries for different components are conflicting (might even be better to see if all/most components can come from the same manufacturer). | * Deep dive in the libraries since the various libraries for different components are conflicting (might even be better to see if all/most components can come from the same manufacturer). | ||
Line 446: | Line 452: | ||
====REFERENCE==== | ====REFERENCE==== | ||
- | |||
- | 1.https:// | ||
- | |||
- | |||
- | 2.https:// | ||
- | |||
- | |||
- | 3.https:// | ||
- | |||
- | |||
- | 4.https:// | ||
- | |||
- | |||
- | 5.https:// | ||
- | 6.https://www.robotics.org.za/XY-ITOV | + | 1. https://nodered.org |
+ | 2. https:// | ||
- | 7.https://www.pololu.com/product/4945 | + | 3. https://grafana.com/docs/ |
+ | 4. Katalin, F. & Jozsef, D. (2020). Using Node-RED platform in an industrial environment. | ||
- | 8.https://www.amazon.de/AZDelivery-RTC-Batterie-inklusive-Arduino/dp/B01M2B7HQB? | + | 5. https://medium.com/@schuerch_sarah/ |
+ | 30/07/2024). | ||
+ | 6. Sunil, K.,S., H.& Saravanan C. (2019). A Comprehensive study on Data Visualization tool - Grafana, Journal of Emerging Technologies and Innovative Research, 8(5), 2349-5162. | ||
- | 2.Wendt, J., & Thompson, S. (2017). " | ||
- | 3.Candelieri, A., Archetti, F., & Kofjač, D. (2018). "Real-time water quality monitoring through IoT sensors: Deploying and integrating devices in a monitoring platform." | + | 7. Wendt, J., & Thompson, S. (2017). "Low-power wide-area networks: An overview." |
- | 4.Smith, J., Jones, R., & Brown, L. (2016). "Industrial applications of hydrostatic level measurement." | + | 8. Candelieri, A., Archetti, F., & Kofjač, D. (2018). "Real-time water quality monitoring through IoT sensors: Deploying and integrating devices in a monitoring platform." |
- | 5.Kim, Y., Park, S., & Jung, J. (2020). "Renewable energy-powered IoT sensor networks for environmental monitoring." | + | 9. Smith, J., Jones, R., & Brown, L. (2016). "Industrial applications of hydrostatic level measurement." |
- | 6.Gupta, R., Sharma, V., & Saxena, P. (2019). "Voltage regulation in IoT systems using step-up regulators." | + | 10. Kim, Y., Park, S., & Jung, J. (2020). "Renewable energy-powered |
- | 7. Adams, P., Johnson, T., & Williams, D. (2017). "The importance of real-time clock (RTC) in embedded | + | 11. Gupta, R., Sharma, V., & Saxena, P. (2019). "Voltage regulation |
- | 8.Sinha, R. S., Wei, Y., & Hwang, S. H. (2017). "A survey on LPWA technology: LoRa and NB-IoT." | + | 12. Adams, P., Johnson, T., & Williams, D. (2017). "The importance of real-time clock (RTC) in embedded systems." |
+ | 24(4), 40-45. | ||
- | 9. Sunil, K.,S., H.& | + | 13. Sinha, R. S., Wei, Y., & Hwang, S. H. (2017). "A survey |
- | 10. https:// | ||
- | 11. Nasar, M., & Abu Kausar, M. (2019). Suitability Of Influxdb Database For IoT Applications, | ||
amc/ss2024/groundwater_gauge/start.1722444711.txt.gz · Last modified: 2024/07/31 18:51 by 28057_students.hsrw