Sensors in Schools - User contributions [en]

BirdNET-Pi Bencheng

2023-09-13T00:36:11Z

Bencheng: /* Configure the UR41 Router from Milesight */

= Introduction =
For help just search for '''mediawiki formatting'''

== Configuration of Raspberry Pi ==

To include photo - just click on '''Upload file''' on the left
Upload file / image
Then copy file name and place here using following format...

* Step 1: Download the Raspberry Pi Imager
Download link: https://www.raspberrypi.com/software/

[[File:Step_1.png |center| 450px]]
* Step 2: Insert the '''sim card''' into the '''adapter''' and plug it into the computer.
[[File:Step_2.1.jpg |center| 250px]]
[[File:Step_2.2.jpg |center| 250px]]
[[File:Step_2.3.jpg |center| 250px]]

* Step 3: Choose '''Raspberry Pi OS Lite(64-bit)''' as the Operating System.

[[File:Rasp_Step_3.png |center| 450px]]

* Step 4: Choose storage space

(If nothing is available it’s because the sim wasn’t recognized. Unplug it and insert again.)

[[File:Rasp_Step_4.png |center| 450px]]

* Step 5: Advanced Options

Click the gear icon at the right bottom of the interface.

[[File:Rasp_Step_5.png |center| 450px]]

- Step 5.1 Set username and password

Here we set the username and password of the Raspberry Pi. They will be used in later steps so remember to take notes of them lest you forget.

- Step 5.2 Configure wireless LAN

[[File:Rasp_Step_5.2.png |center| 450px]]

This is where you specify the WIFI that is going to be connected to Raspberry Pi. These specifications can be altered later.
(Note that you must choose the '''Wireless LAN country''' to be the country you are currently in.)

- Step 5.3 Set locale settings

[[File:Rasp_Step_5.3.png |center| 450px]]

Choose the right time zone and set the Keyboard layout as “us”.

* Step 6: Once the above steps are finished, click “write” on the right of the interface.

[[File:Rasp_Step_6.1.png |center| 250px]]
[[File:Rasp_Step_6.2.png |center| 250px]]

The writing and verification process takes a few minutes.

* Step 7:
Unplug the adapter, pull out the sim card and gently place it into the Raspberry Pi board;

Then connect the keyboard and monitor to the Raspberry Pi;

Turn on the monitor and then plug in the power cable.

When the starting process is over, you will be able to see the interface shown below:

'''Insert Picture Later'''

Now the Raspberry Pi computer is ready to use!

= Extracting Data from MPPT =

<syntaxhighlight lang="python">
tar -xvf arduino-1.8.19-linuxarm.tar.xz
The first thing to do is using crontab
The password of Raspberry Pi has been changed to techschool.
</syntaxhighlight>

In this section, we'll go through the procedure of reading data from MPPT.

== What is MPPT ==
[[File:MPPT.jpg |center| 500px]]
MPPT stands for Maximum Power Point Tracking, which is a technique used in photovoltaic (solar) systems to optimize the power output from solar panels or arrays. MPPT is particularly important in situations where the amount of available solar energy varies, such as when clouds pass over the panels or when the angle of sunlight changes throughout the day.

Solar panels have what's known as a "maximum power point," which is the voltage and current combination that results in the highest power output from the panel. However, this point can shift based on factors like temperature, shading, and the angle of the sunlight. MPPT algorithms and controllers continuously adjust the electrical load on the solar panel to keep it operating at or near this maximum power point, thus maximizing the energy harvest from the available sunlight.

Here's how MPPT works:

Measuring Inputs: MPPT systems constantly monitor the output voltage and current of the solar panel or array.

Calculating Power: By multiplying the output voltage and current, the system calculates the instantaneous power being produced by the panel.

Adjusting Load: The MPPT algorithm compares the calculated power to previous readings and adjusts the electrical load on the panel. It does this by varying the voltage at which the solar panel operates, typically by adjusting a DC-DC converter. This process is done in a way that tries to keep the panel's output at or close to its maximum power point.

Optimizing Harvest: By dynamically adjusting the load, the MPPT system allows the solar panel to operate at its optimal voltage and current levels, even as external conditions change. This maximizes the power output of the panel and, consequently, the amount of energy harvested from the sunlight.

MPPT technology is widely used in solar power systems, from small off-grid setups to large-scale solar farms. It increases the efficiency of energy conversion and ensures that as much energy as possible is extracted from the available sunlight, leading to greater overall system efficiency and improved energy production.

== Connect MPPT to the battery and Raspberry Pi ==

[[File:Battery12V-8AH.jpg |center| 300px]]
At the bottom left of the MPPT, you will be able to see two wires under the label '''BATT'''. You should carefully connect the red wire and black wire to the positive and negative of the battery respectively. Then, use ''' VE. Direct to USB interface''' to connect the MPPT to the Raspberry Pi.

* Find the port to read data from.
Since we have connected the MPPT to Raspberry Pi through a USB portal, we can use the following command to find the address of the USB portal:

As is shown in the above image, there's a USB portal "/dev/ttyUSB0" at the right bottom of the interface in the red frame. This is where we shall extract reading from the MPPT.

After this step is finished, we are all set to read in data from MPPT.

== Extract and Process Data ==

In this section, we shall write a Python program to extract, process and save the readings from MPPT.

* The data that needs to be extracted.

https://www.victronenergy.com/upload/documents/VE.Direct-Protocol-3.33.pdf

We can view all the units used by the serial interface from the VEDirect Protocol. However, in this project, we are only interested in the below quantities/states:

1. Main voltage (V)

2. Panel voltage (VPV)

3. Panel power (PPV)

4. Load current (IL)

5. Load output state (LOAD)

6. Yield total (H19)

7. Yield today (H20)

8. Maximum power today(H21)

9. Yield yesterday (H22)

10. Maximum power yesterday (H23)

11. Error code (ERR)

12. State of operation (CS)

13. Firmware version (FW)

14. Product ID (PID)

15. Serial number (SER#)

16. Day sequence number (HSDS)

17. Tracker operation mode (MPPT)

* Step 1: Read the state of the MPPT

Use the below code:
<syntaxhighlight lang="python">
import datetime
from vedirect import VEDirect
port=
</syntaxhighlight>

= Secure Shell =
A Raspberry Pi is a small, affordable, single-board computer. We can configure and interact with it if we connect it to a keyboard and monitor.
'''Insert a picture '''

However, it's usually more convenient to access the Raspberry Pi from a remote PC. To this end, we need to use a secure shell(SSH) to connect the Raspberry Pi and the remote PC.

== Enabling SSH on the Raspberry Pi ==
* Type the command '''sudo raspi-config ''' in the terminal and the following interface will appear:
''' Insert a picture '''

* Choose ''' 3 Interface Options ''' and press enter.
''' Insert a picture '''
* Select SSH (Secure Shell) and then select Enable SSH.

Now the SSH has been enabled.

== Connect the PC to Raspberry Pi ==

= Use VE. Direct Bluetooth Smart Dongle to Configure and Monitor the Components =
== Basics about VE.Direct Bluetooth Smart Dongle==
Some introductions are to be included.
''' Insert a picture here. '''

== Key Parameters ==

* Battery voltage

* Max charge current

* Absorption voltage

* Float voltage

* Equalization voltage

= Extract and Visualize Data from Database =
== DB Browser for SQLite ==

DB Browser for SQLite is an open-source graphical user interface (GUI) tool that allows users to manage and interact with SQLite databases. This software provides a user-friendly interface for performing tasks such as creating, editing, and deleting tables, indexes, views, and triggers within SQLite databases. It enables users to run SQL queries against their databases, view and modify data, and perform various database management operations without needing to use the command-line interface.

Step 1: Download DB Browser for SQLite
Download link:
https://sqlitebrowser.org/dl/

Step 2: Familiarize with the interface of the DB Browser for SQLite
* Open the '''bird.db''' file in the database, and then the below interface will be shown.
[[File:Interface_1.PNG |center| 600px]]
* As is shown above, the database contains two parts: '''Tables''' and '''Indices'''.

* Click on the '''Browse Data''' highlighted in the red box and the following interface will show.

[[File:DB_Browser_Interface.PNG |center| 600px]]

* Demonstrated above are the contents of the table "detections".

* Each row is a record of one bird detection while each column contains distinct information of the records such as Date, Time, name of the Species, etc.

== Structured Query Language ==

Step 3: Learning the basics of SQL
SQL, which stands for Structured Query Language, is a domain-specific programming language used for managing and manipulating relational databases.
Here is a link for a brief tutorial for SQL language: https://www.w3schools.com/sql/default.asp

Step 4: Understand some relevant Python libraries

* '''sqlite3''' is a

<syntaxhighlight lang="python">
pip
</syntaxhighlight>

= Adding an SSD to improve performance =

* USB 3.0
USB 3.0 ports, also known as SuperSpeed USB ports, are considered unique due to their significantly improved data transfer speeds and enhanced capabilities compared to previous USB standards. One of the most salient features is its faster data transfer speed.

'''Tip''': You can quickly identify a USB 3.0 port by remembering this:
''' The USB 3.0 port is blue.'''

[[File:USB_3.jpg |center| 600px]]

* Kington A400S Series
Due to the large volume of data involved, we need to attach an ''' SSD(Solid-State Drive)''' to the Raspberry Pi. It is a type of data storage device used in computers and other electronic devices. In this project, we chose the '''SA400S37/480G''' model.

[[File:Kingston_SSD.jpg |center| 600px]]

The product specifications can be found in the link below:

https://www.scorptec.com.au/product/hard-drives-&-ssds/solid-state-drives-(ssd)/71426-sa400s37-480g?gclid=Cj0KCQjw0bunBhD9ARIsAAZl0E3uxry4rd_yIg2gIJG1NaU3FaXsMTMprgEl4MVEWMaWSeJv-Mz61i0aAiQxEALw_wcB

* Configuring the SSD
Step 1: Download the '''Raspberry Pi imager software''': https://downloads.raspberrypi.org/imager/imager_latest.exe

Step 2: Connect the SSD enclosure to your PC, then run the imager software.

Step 3: Select "Raspberry Pi OS (Other)". Then choose "Raspberry Pi OS (64-bit)".
[[File:Raspberry_1.png |center| 600px]]
[[File:Raspberry_2.png |center| 600px]]

Step 4: Click '''Write''' and wait for it to download, flash and verify.
If everything clicks, you will see the interface shown below:
[[File:Raspberry_3.png |center| 600px]]

Step 5: Unplug the SSD drive, set up the Raspberry Pi 4, and plug in the SSD to one of the blue USB3 ports.
'''Important: Always remember to remove the microSD card from the Raspberry Pi. The Pi needs to boot from the SSD inserted in the USB 3.0 port'''
If you forgot to do so, the new Kingston SSD won't take effect and you are left with the microSD card.

Step 6: Connect your Raspberry Pi to the Internet and open a terminal.

Step 7: Run <code>sudo apt update</code> then <code>sudo apt upgrade</code> in the terminal. This will do a full update of do a full update of all software.

Step 8: Open up a new terminal and run <code>lsusb -t</code>.
You should see '''Driver=uas''' among the results.
[[File:Scrot_2.png |center| 600px]]

Step 9: Check TRIM: Run the code <code>sudo fstrim -v /</code>. If you see the below message in the red box, then the TRIM isn't enabled for the drive and you need to enable it.
[[File:Scrot_3.png |center| 600px]]

Step 10: Run the command <code>lsblk -D</code>. Have a look for the 'sda' drive, and the two columns 'DISC-GRAN' and 'DISC-MAX'. If both of these are NOT zero, then your drive is capable of TRIM.

Step 11: If both the column "DISC-GRAN" and "DISC-MAX" under the 'sda' drive is zero as shown below:
[[File:Scrot_4.png |center| 600px]]
One possible cause is you didn't remove the microSD card from the Raspberry Pi as mentioned in Step 5. Shut down Raspberry Pi, remove the microSD card and reboot.

Step 12: Enable TRIM support: run the command <code>sudo su</code>. Until you close this terminal, everything from now on will be run as "super user" (admin). The command prompt should have also changed to show "root@raspberrypi".
[[File:Scrot_5.png |center| 600px]]

Step 13: Copy and paste the following command to the terminal and run it:
<code>find /sys/ -name provisioning_mode -exec grep -H . {} + | sort</code>.

Step 14: At the end of the result, there should be "provisioning_mode". It's likely to be set to "full", but we need it set to "unmap". If yours shows "unmap" already, you can skip this next step.

Step 15: Run the following command: <code>echo unmap > /sys/devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb2/2-1/2-1:1.0/host0/target0:0:0/0:0:0:0/scsi_disk/0:0:0:0/provisioning_mode</code>.

Step 16: After running the above command, run the "find" command in step 13 again. You should see the "provisioning_mode" has been changed to "unmap".

Step 17: Run the command <code>sudo fstrim -v /</code> again and you should see the below message:

[[File:Scrot_6.png |center| 600px]]

Step 18: If you get a similar output, then TRIM is working on the drive. However, when you reboot the Pi, it will revert back. To set the TRIM setting permanently, there are a few more steps we need to do.

Step 19: Run the command <code>lsusb</code> in the terminal. This will list all attached USB devices. Find the one associated with the SSD.(For me it's the first one in the red box.)
[[File:Scrot_7.png |center| 600px]]

Step 20: Take note of the two codes separated by a colon (:) after "ID", they will be important to later steps.
[[File:Scrot_8.png |center| 600px]]

Step 21: Run the following command <code>mousepad /etc/udev/rules.d/10-trim.rules</code> in the terminal. A text editor shown below should pop up.
[[File:Scrot_9.png |center| 600px]]

Step 22: Copy and paste this line into the empty text file: '''ACTION=="add|change", ATTRS{idVendor}=="174c", ATTRS{idProduct}=="1153", SUBSYSTEM=="scsi_disk", ATTR{provisioning_mode}="unmap"'''

Step 23: Replace "idVendor" and "idProduct" in the above line with the two codes we took note of in '''Step 20''' respectively. They should both have a length of 4. Close the mousepad and save the file.

Step 24: This code will enable TRIM by changing the provisioning mode to "unmap", just like we did manually earlier. Now we just need to schedule the TRIM process to be run periodically. Type <code>sudo systemctl enable fstrim.timer</code> into the terminal. This will enable a weekly timer, which is the preferred way to TRIM SSDs on Linux distributions (as opposed to continuous TRIM).

Step 25: At the end, we can type the command <code>sudo curl https://raw.githubusercontent.com/TheRemote/PiBenchmarks/master/Storage.sh | sudo bash</code>. This will give your drive a performance score, and if you fill in the prompts at the end, it will be published publicly on pibenchmarks.com.
[[File:Scrot_10.png |center| 600px]]

= Configure the UR41 Router from Milesight =
When you receive a new router, you need to configure it.

There are two ways of doing that: '''Wired Access''' and '''Wireless Access'''.

As the model we use in this project is UR41, which lacks a Wi-Fi Antenna, the '''Wireless Access''' approach isn't viable.
[[File:Guide_1.jpg |center| 300px]]

Here we used Raspberry Pi to configure the router via the '''Wired Access''' approach:

Step 1: Find an Ethernet cable and connect the router to the Raspberry Pi.
<gallery mode="packed">
File:Guide_2.jpg
File:Guide_3.jpg
</gallery>

Step 2: Open up Raspberry Pi and set the IP Address, Username and Password using the default setting. (You can find them in the '''Quick Start Guide'''.)
[[File:Guide_4.jpg |center| 500px]]

Step 3: Open a browser type the default IP address in the Address bar and press enter. The following interface should show up.
[[File:Login_0.png |center| 500px]]

Step 4: Enter the username and password then press enter. You'll see the following interface.

[[File:Login_1.png |center| 500px]]
Congratulations! The configuration is completed.

= Additional Tips and Tricks =

== Using Crontab to Schedule Events ==
Once the BirdNET-Pi system is deployed in the field, we expect it to upload data on a regular basis. To achieve this goal, we need to utilize Crontab to schedule the uploading. Crontab is a time-based job scheduler in Unix-like operating systems. It allows you to schedule tasks or commands to run automatically at specific intervals or times. These scheduled tasks are often referred to as "cron jobs."

'''INSERT A FEW PICTURES HERE'''

== Using Only Keyboard to Switch Tab==
To move to tab selection, press '''Ctrl + Tab'''.

== Taking a Delayed Screenshot Using Scrot==
'''Insert a Picture here'''

BirdNET-Pi Bencheng

2023-09-13T00:35:32Z

Bencheng: /* Configure the UR41 Router from Milesight */

= Introduction =
For help just search for '''mediawiki formatting'''

== Configuration of Raspberry Pi ==

To include photo - just click on '''Upload file''' on the left
Upload file / image
Then copy file name and place here using following format...

* Step 1: Download the Raspberry Pi Imager
Download link: https://www.raspberrypi.com/software/

[[File:Step_1.png |center| 450px]]
* Step 2: Insert the '''sim card''' into the '''adapter''' and plug it into the computer.
[[File:Step_2.1.jpg |center| 250px]]
[[File:Step_2.2.jpg |center| 250px]]
[[File:Step_2.3.jpg |center| 250px]]

* Step 3: Choose '''Raspberry Pi OS Lite(64-bit)''' as the Operating System.

[[File:Rasp_Step_3.png |center| 450px]]

* Step 4: Choose storage space

(If nothing is available it’s because the sim wasn’t recognized. Unplug it and insert again.)

[[File:Rasp_Step_4.png |center| 450px]]

* Step 5: Advanced Options

Click the gear icon at the right bottom of the interface.

[[File:Rasp_Step_5.png |center| 450px]]

- Step 5.1 Set username and password

Here we set the username and password of the Raspberry Pi. They will be used in later steps so remember to take notes of them lest you forget.

- Step 5.2 Configure wireless LAN

[[File:Rasp_Step_5.2.png |center| 450px]]

This is where you specify the WIFI that is going to be connected to Raspberry Pi. These specifications can be altered later.
(Note that you must choose the '''Wireless LAN country''' to be the country you are currently in.)

- Step 5.3 Set locale settings

[[File:Rasp_Step_5.3.png |center| 450px]]

Choose the right time zone and set the Keyboard layout as “us”.

* Step 6: Once the above steps are finished, click “write” on the right of the interface.

[[File:Rasp_Step_6.1.png |center| 250px]]
[[File:Rasp_Step_6.2.png |center| 250px]]

The writing and verification process takes a few minutes.

* Step 7:
Unplug the adapter, pull out the sim card and gently place it into the Raspberry Pi board;

Then connect the keyboard and monitor to the Raspberry Pi;

Turn on the monitor and then plug in the power cable.

When the starting process is over, you will be able to see the interface shown below:

'''Insert Picture Later'''

Now the Raspberry Pi computer is ready to use!

= Extracting Data from MPPT =

<syntaxhighlight lang="python">
tar -xvf arduino-1.8.19-linuxarm.tar.xz
The first thing to do is using crontab
The password of Raspberry Pi has been changed to techschool.
</syntaxhighlight>

In this section, we'll go through the procedure of reading data from MPPT.

== What is MPPT ==
[[File:MPPT.jpg |center| 500px]]
MPPT stands for Maximum Power Point Tracking, which is a technique used in photovoltaic (solar) systems to optimize the power output from solar panels or arrays. MPPT is particularly important in situations where the amount of available solar energy varies, such as when clouds pass over the panels or when the angle of sunlight changes throughout the day.

Solar panels have what's known as a "maximum power point," which is the voltage and current combination that results in the highest power output from the panel. However, this point can shift based on factors like temperature, shading, and the angle of the sunlight. MPPT algorithms and controllers continuously adjust the electrical load on the solar panel to keep it operating at or near this maximum power point, thus maximizing the energy harvest from the available sunlight.

Here's how MPPT works:

Measuring Inputs: MPPT systems constantly monitor the output voltage and current of the solar panel or array.

Calculating Power: By multiplying the output voltage and current, the system calculates the instantaneous power being produced by the panel.

Adjusting Load: The MPPT algorithm compares the calculated power to previous readings and adjusts the electrical load on the panel. It does this by varying the voltage at which the solar panel operates, typically by adjusting a DC-DC converter. This process is done in a way that tries to keep the panel's output at or close to its maximum power point.

Optimizing Harvest: By dynamically adjusting the load, the MPPT system allows the solar panel to operate at its optimal voltage and current levels, even as external conditions change. This maximizes the power output of the panel and, consequently, the amount of energy harvested from the sunlight.

MPPT technology is widely used in solar power systems, from small off-grid setups to large-scale solar farms. It increases the efficiency of energy conversion and ensures that as much energy as possible is extracted from the available sunlight, leading to greater overall system efficiency and improved energy production.

== Connect MPPT to the battery and Raspberry Pi ==

[[File:Battery12V-8AH.jpg |center| 300px]]
At the bottom left of the MPPT, you will be able to see two wires under the label '''BATT'''. You should carefully connect the red wire and black wire to the positive and negative of the battery respectively. Then, use ''' VE. Direct to USB interface''' to connect the MPPT to the Raspberry Pi.

* Find the port to read data from.
Since we have connected the MPPT to Raspberry Pi through a USB portal, we can use the following command to find the address of the USB portal:

As is shown in the above image, there's a USB portal "/dev/ttyUSB0" at the right bottom of the interface in the red frame. This is where we shall extract reading from the MPPT.

After this step is finished, we are all set to read in data from MPPT.

== Extract and Process Data ==

In this section, we shall write a Python program to extract, process and save the readings from MPPT.

* The data that needs to be extracted.

https://www.victronenergy.com/upload/documents/VE.Direct-Protocol-3.33.pdf

We can view all the units used by the serial interface from the VEDirect Protocol. However, in this project, we are only interested in the below quantities/states:

1. Main voltage (V)

2. Panel voltage (VPV)

3. Panel power (PPV)

4. Load current (IL)

5. Load output state (LOAD)

6. Yield total (H19)

7. Yield today (H20)

8. Maximum power today(H21)

9. Yield yesterday (H22)

10. Maximum power yesterday (H23)

11. Error code (ERR)

12. State of operation (CS)

13. Firmware version (FW)

14. Product ID (PID)

15. Serial number (SER#)

16. Day sequence number (HSDS)

17. Tracker operation mode (MPPT)

* Step 1: Read the state of the MPPT

Use the below code:
<syntaxhighlight lang="python">
import datetime
from vedirect import VEDirect
port=
</syntaxhighlight>

= Secure Shell =
A Raspberry Pi is a small, affordable, single-board computer. We can configure and interact with it if we connect it to a keyboard and monitor.
'''Insert a picture '''

However, it's usually more convenient to access the Raspberry Pi from a remote PC. To this end, we need to use a secure shell(SSH) to connect the Raspberry Pi and the remote PC.

== Enabling SSH on the Raspberry Pi ==
* Type the command '''sudo raspi-config ''' in the terminal and the following interface will appear:
''' Insert a picture '''

* Choose ''' 3 Interface Options ''' and press enter.
''' Insert a picture '''
* Select SSH (Secure Shell) and then select Enable SSH.

Now the SSH has been enabled.

== Connect the PC to Raspberry Pi ==

= Use VE. Direct Bluetooth Smart Dongle to Configure and Monitor the Components =
== Basics about VE.Direct Bluetooth Smart Dongle==
Some introductions are to be included.
''' Insert a picture here. '''

== Key Parameters ==

* Battery voltage

* Max charge current

* Absorption voltage

* Float voltage

* Equalization voltage

= Extract and Visualize Data from Database =
== DB Browser for SQLite ==

DB Browser for SQLite is an open-source graphical user interface (GUI) tool that allows users to manage and interact with SQLite databases. This software provides a user-friendly interface for performing tasks such as creating, editing, and deleting tables, indexes, views, and triggers within SQLite databases. It enables users to run SQL queries against their databases, view and modify data, and perform various database management operations without needing to use the command-line interface.

Step 1: Download DB Browser for SQLite
Download link:
https://sqlitebrowser.org/dl/

Step 2: Familiarize with the interface of the DB Browser for SQLite
* Open the '''bird.db''' file in the database, and then the below interface will be shown.
[[File:Interface_1.PNG |center| 600px]]
* As is shown above, the database contains two parts: '''Tables''' and '''Indices'''.

* Click on the '''Browse Data''' highlighted in the red box and the following interface will show.

[[File:DB_Browser_Interface.PNG |center| 600px]]

* Demonstrated above are the contents of the table "detections".

* Each row is a record of one bird detection while each column contains distinct information of the records such as Date, Time, name of the Species, etc.

== Structured Query Language ==

Step 3: Learning the basics of SQL
SQL, which stands for Structured Query Language, is a domain-specific programming language used for managing and manipulating relational databases.
Here is a link for a brief tutorial for SQL language: https://www.w3schools.com/sql/default.asp

Step 4: Understand some relevant Python libraries

* '''sqlite3''' is a

<syntaxhighlight lang="python">
pip
</syntaxhighlight>

= Adding an SSD to improve performance =

* USB 3.0
USB 3.0 ports, also known as SuperSpeed USB ports, are considered unique due to their significantly improved data transfer speeds and enhanced capabilities compared to previous USB standards. One of the most salient features is its faster data transfer speed.

'''Tip''': You can quickly identify a USB 3.0 port by remembering this:
''' The USB 3.0 port is blue.'''

[[File:USB_3.jpg |center| 600px]]

* Kington A400S Series
Due to the large volume of data involved, we need to attach an ''' SSD(Solid-State Drive)''' to the Raspberry Pi. It is a type of data storage device used in computers and other electronic devices. In this project, we chose the '''SA400S37/480G''' model.

[[File:Kingston_SSD.jpg |center| 600px]]

The product specifications can be found in the link below:

https://www.scorptec.com.au/product/hard-drives-&-ssds/solid-state-drives-(ssd)/71426-sa400s37-480g?gclid=Cj0KCQjw0bunBhD9ARIsAAZl0E3uxry4rd_yIg2gIJG1NaU3FaXsMTMprgEl4MVEWMaWSeJv-Mz61i0aAiQxEALw_wcB

* Configuring the SSD
Step 1: Download the '''Raspberry Pi imager software''': https://downloads.raspberrypi.org/imager/imager_latest.exe

Step 2: Connect the SSD enclosure to your PC, then run the imager software.

Step 3: Select "Raspberry Pi OS (Other)". Then choose "Raspberry Pi OS (64-bit)".
[[File:Raspberry_1.png |center| 600px]]
[[File:Raspberry_2.png |center| 600px]]

Step 4: Click '''Write''' and wait for it to download, flash and verify.
If everything clicks, you will see the interface shown below:
[[File:Raspberry_3.png |center| 600px]]

Step 5: Unplug the SSD drive, set up the Raspberry Pi 4, and plug in the SSD to one of the blue USB3 ports.
'''Important: Always remember to remove the microSD card from the Raspberry Pi. The Pi needs to boot from the SSD inserted in the USB 3.0 port'''
If you forgot to do so, the new Kingston SSD won't take effect and you are left with the microSD card.

Step 6: Connect your Raspberry Pi to the Internet and open a terminal.

Step 7: Run <code>sudo apt update</code> then <code>sudo apt upgrade</code> in the terminal. This will do a full update of do a full update of all software.

Step 8: Open up a new terminal and run <code>lsusb -t</code>.
You should see '''Driver=uas''' among the results.
[[File:Scrot_2.png |center| 600px]]

Step 9: Check TRIM: Run the code <code>sudo fstrim -v /</code>. If you see the below message in the red box, then the TRIM isn't enabled for the drive and you need to enable it.
[[File:Scrot_3.png |center| 600px]]

Step 10: Run the command <code>lsblk -D</code>. Have a look for the 'sda' drive, and the two columns 'DISC-GRAN' and 'DISC-MAX'. If both of these are NOT zero, then your drive is capable of TRIM.

Step 11: If both the column "DISC-GRAN" and "DISC-MAX" under the 'sda' drive is zero as shown below:
[[File:Scrot_4.png |center| 600px]]
One possible cause is you didn't remove the microSD card from the Raspberry Pi as mentioned in Step 5. Shut down Raspberry Pi, remove the microSD card and reboot.

Step 12: Enable TRIM support: run the command <code>sudo su</code>. Until you close this terminal, everything from now on will be run as "super user" (admin). The command prompt should have also changed to show "root@raspberrypi".
[[File:Scrot_5.png |center| 600px]]

Step 13: Copy and paste the following command to the terminal and run it:
<code>find /sys/ -name provisioning_mode -exec grep -H . {} + | sort</code>.

Step 14: At the end of the result, there should be "provisioning_mode". It's likely to be set to "full", but we need it set to "unmap". If yours shows "unmap" already, you can skip this next step.

Step 15: Run the following command: <code>echo unmap > /sys/devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb2/2-1/2-1:1.0/host0/target0:0:0/0:0:0:0/scsi_disk/0:0:0:0/provisioning_mode</code>.

Step 16: After running the above command, run the "find" command in step 13 again. You should see the "provisioning_mode" has been changed to "unmap".

Step 17: Run the command <code>sudo fstrim -v /</code> again and you should see the below message:

[[File:Scrot_6.png |center| 600px]]

Step 18: If you get a similar output, then TRIM is working on the drive. However, when you reboot the Pi, it will revert back. To set the TRIM setting permanently, there are a few more steps we need to do.

Step 19: Run the command <code>lsusb</code> in the terminal. This will list all attached USB devices. Find the one associated with the SSD.(For me it's the first one in the red box.)
[[File:Scrot_7.png |center| 600px]]

Step 20: Take note of the two codes separated by a colon (:) after "ID", they will be important to later steps.
[[File:Scrot_8.png |center| 600px]]

Step 21: Run the following command <code>mousepad /etc/udev/rules.d/10-trim.rules</code> in the terminal. A text editor shown below should pop up.
[[File:Scrot_9.png |center| 600px]]

Step 22: Copy and paste this line into the empty text file: '''ACTION=="add|change", ATTRS{idVendor}=="174c", ATTRS{idProduct}=="1153", SUBSYSTEM=="scsi_disk", ATTR{provisioning_mode}="unmap"'''

Step 23: Replace "idVendor" and "idProduct" in the above line with the two codes we took note of in '''Step 20''' respectively. They should both have a length of 4. Close the mousepad and save the file.

Step 24: This code will enable TRIM by changing the provisioning mode to "unmap", just like we did manually earlier. Now we just need to schedule the TRIM process to be run periodically. Type <code>sudo systemctl enable fstrim.timer</code> into the terminal. This will enable a weekly timer, which is the preferred way to TRIM SSDs on Linux distributions (as opposed to continuous TRIM).

Step 25: At the end, we can type the command <code>sudo curl https://raw.githubusercontent.com/TheRemote/PiBenchmarks/master/Storage.sh | sudo bash</code>. This will give your drive a performance score, and if you fill in the prompts at the end, it will be published publicly on pibenchmarks.com.
[[File:Scrot_10.png |center| 600px]]

= Configure the UR41 Router from Milesight =
When you receive a new router, you need to configure it.

There are two ways of doing that: '''Wired Access''' and '''Wireless Access'''.

As the model we use in this project is UR41, which lacks a Wi-Fi Antenna, the '''Wireless Access''' approach isn't viable.
[[File:Guide_1.jpg |center| 300px]]

Here we used Raspberry Pi to configure the router via the '''Wired Access''' approach:

Step 1: Find an Ethernet cable and connect the router to the Raspberry Pi.
<gallery mode="packed">
File:Guide_2.jpg
File:Guide_3.jpg
</gallery>

Step 2: Open up Raspberry Pi and set the IP Address, Username and Password using the default setting. (You can find them in the '''Quick Start Guide'''.)
[[File:Guide_4.jpg |center| 300px]]

Step 3: Open a browser type the default IP address in the Address bar and press enter. The following interface should show up.
[[File:Login_0.png |center| 300px]]

Step 4: Enter the username and password then press enter. You'll see the following interface.

[[File:Login_1.png |center| 300px]]
Congratulations! The configuration is completed.

= Additional Tips and Tricks =

== Using Crontab to Schedule Events ==
Once the BirdNET-Pi system is deployed in the field, we expect it to upload data on a regular basis. To achieve this goal, we need to utilize Crontab to schedule the uploading. Crontab is a time-based job scheduler in Unix-like operating systems. It allows you to schedule tasks or commands to run automatically at specific intervals or times. These scheduled tasks are often referred to as "cron jobs."

'''INSERT A FEW PICTURES HERE'''

== Using Only Keyboard to Switch Tab==
To move to tab selection, press '''Ctrl + Tab'''.

== Taking a Delayed Screenshot Using Scrot==
'''Insert a Picture here'''

2023-09-13T00:20:30Z

Bencheng:

File:Guide 2.jpg

2023-09-13T00:20:03Z

Bencheng:

File:Guide 1.jpg

2023-09-13T00:19:43Z

Bencheng:

BirdNET-Pi Bencheng

2023-09-13T00:05:39Z

Bencheng: /* Configure the UR41 Router from Milesight */

= Introduction =
For help just search for '''mediawiki formatting'''

== Configuration of Raspberry Pi ==

To include photo - just click on '''Upload file''' on the left
Upload file / image
Then copy file name and place here using following format...

* Step 1: Download the Raspberry Pi Imager
Download link: https://www.raspberrypi.com/software/

[[File:Step_1.png |center| 450px]]
* Step 2: Insert the '''sim card''' into the '''adapter''' and plug it into the computer.
[[File:Step_2.1.jpg |center| 250px]]
[[File:Step_2.2.jpg |center| 250px]]
[[File:Step_2.3.jpg |center| 250px]]

* Step 3: Choose '''Raspberry Pi OS Lite(64-bit)''' as the Operating System.

[[File:Rasp_Step_3.png |center| 450px]]

* Step 4: Choose storage space

(If nothing is available it’s because the sim wasn’t recognized. Unplug it and insert again.)

[[File:Rasp_Step_4.png |center| 450px]]

* Step 5: Advanced Options

Click the gear icon at the right bottom of the interface.

[[File:Rasp_Step_5.png |center| 450px]]

- Step 5.1 Set username and password

Here we set the username and password of the Raspberry Pi. They will be used in later steps so remember to take notes of them lest you forget.

- Step 5.2 Configure wireless LAN

[[File:Rasp_Step_5.2.png |center| 450px]]

This is where you specify the WIFI that is going to be connected to Raspberry Pi. These specifications can be altered later.
(Note that you must choose the '''Wireless LAN country''' to be the country you are currently in.)

- Step 5.3 Set locale settings

[[File:Rasp_Step_5.3.png |center| 450px]]

Choose the right time zone and set the Keyboard layout as “us”.

* Step 6: Once the above steps are finished, click “write” on the right of the interface.

[[File:Rasp_Step_6.1.png |center| 250px]]
[[File:Rasp_Step_6.2.png |center| 250px]]

The writing and verification process takes a few minutes.

* Step 7:
Unplug the adapter, pull out the sim card and gently place it into the Raspberry Pi board;

Then connect the keyboard and monitor to the Raspberry Pi;

Turn on the monitor and then plug in the power cable.

When the starting process is over, you will be able to see the interface shown below:

'''Insert Picture Later'''

Now the Raspberry Pi computer is ready to use!

= Extracting Data from MPPT =

<syntaxhighlight lang="python">
tar -xvf arduino-1.8.19-linuxarm.tar.xz
The first thing to do is using crontab
The password of Raspberry Pi has been changed to techschool.
</syntaxhighlight>

In this section, we'll go through the procedure of reading data from MPPT.

== What is MPPT ==
[[File:MPPT.jpg |center| 500px]]
MPPT stands for Maximum Power Point Tracking, which is a technique used in photovoltaic (solar) systems to optimize the power output from solar panels or arrays. MPPT is particularly important in situations where the amount of available solar energy varies, such as when clouds pass over the panels or when the angle of sunlight changes throughout the day.

Solar panels have what's known as a "maximum power point," which is the voltage and current combination that results in the highest power output from the panel. However, this point can shift based on factors like temperature, shading, and the angle of the sunlight. MPPT algorithms and controllers continuously adjust the electrical load on the solar panel to keep it operating at or near this maximum power point, thus maximizing the energy harvest from the available sunlight.

Here's how MPPT works:

Measuring Inputs: MPPT systems constantly monitor the output voltage and current of the solar panel or array.

Calculating Power: By multiplying the output voltage and current, the system calculates the instantaneous power being produced by the panel.

Adjusting Load: The MPPT algorithm compares the calculated power to previous readings and adjusts the electrical load on the panel. It does this by varying the voltage at which the solar panel operates, typically by adjusting a DC-DC converter. This process is done in a way that tries to keep the panel's output at or close to its maximum power point.

Optimizing Harvest: By dynamically adjusting the load, the MPPT system allows the solar panel to operate at its optimal voltage and current levels, even as external conditions change. This maximizes the power output of the panel and, consequently, the amount of energy harvested from the sunlight.

MPPT technology is widely used in solar power systems, from small off-grid setups to large-scale solar farms. It increases the efficiency of energy conversion and ensures that as much energy as possible is extracted from the available sunlight, leading to greater overall system efficiency and improved energy production.

== Connect MPPT to the battery and Raspberry Pi ==

[[File:Battery12V-8AH.jpg |center| 300px]]
At the bottom left of the MPPT, you will be able to see two wires under the label '''BATT'''. You should carefully connect the red wire and black wire to the positive and negative of the battery respectively. Then, use ''' VE. Direct to USB interface''' to connect the MPPT to the Raspberry Pi.

* Find the port to read data from.
Since we have connected the MPPT to Raspberry Pi through a USB portal, we can use the following command to find the address of the USB portal:

As is shown in the above image, there's a USB portal "/dev/ttyUSB0" at the right bottom of the interface in the red frame. This is where we shall extract reading from the MPPT.

After this step is finished, we are all set to read in data from MPPT.

== Extract and Process Data ==

In this section, we shall write a Python program to extract, process and save the readings from MPPT.

* The data that needs to be extracted.

https://www.victronenergy.com/upload/documents/VE.Direct-Protocol-3.33.pdf

We can view all the units used by the serial interface from the VEDirect Protocol. However, in this project, we are only interested in the below quantities/states:

1. Main voltage (V)

2. Panel voltage (VPV)

3. Panel power (PPV)

4. Load current (IL)

5. Load output state (LOAD)

6. Yield total (H19)

7. Yield today (H20)

8. Maximum power today(H21)

9. Yield yesterday (H22)

10. Maximum power yesterday (H23)

11. Error code (ERR)

12. State of operation (CS)

13. Firmware version (FW)

14. Product ID (PID)

15. Serial number (SER#)

16. Day sequence number (HSDS)

17. Tracker operation mode (MPPT)

* Step 1: Read the state of the MPPT

Use the below code:
<syntaxhighlight lang="python">
import datetime
from vedirect import VEDirect
port=
</syntaxhighlight>

= Secure Shell =
A Raspberry Pi is a small, affordable, single-board computer. We can configure and interact with it if we connect it to a keyboard and monitor.
'''Insert a picture '''

However, it's usually more convenient to access the Raspberry Pi from a remote PC. To this end, we need to use a secure shell(SSH) to connect the Raspberry Pi and the remote PC.

== Enabling SSH on the Raspberry Pi ==
* Type the command '''sudo raspi-config ''' in the terminal and the following interface will appear:
''' Insert a picture '''

* Choose ''' 3 Interface Options ''' and press enter.
''' Insert a picture '''
* Select SSH (Secure Shell) and then select Enable SSH.

Now the SSH has been enabled.

== Connect the PC to Raspberry Pi ==

= Use VE. Direct Bluetooth Smart Dongle to Configure and Monitor the Components =
== Basics about VE.Direct Bluetooth Smart Dongle==
Some introductions are to be included.
''' Insert a picture here. '''

== Key Parameters ==

* Battery voltage

* Max charge current

* Absorption voltage

* Float voltage

* Equalization voltage

= Extract and Visualize Data from Database =
== DB Browser for SQLite ==

DB Browser for SQLite is an open-source graphical user interface (GUI) tool that allows users to manage and interact with SQLite databases. This software provides a user-friendly interface for performing tasks such as creating, editing, and deleting tables, indexes, views, and triggers within SQLite databases. It enables users to run SQL queries against their databases, view and modify data, and perform various database management operations without needing to use the command-line interface.

Step 1: Download DB Browser for SQLite
Download link:
https://sqlitebrowser.org/dl/

Step 2: Familiarize with the interface of the DB Browser for SQLite
* Open the '''bird.db''' file in the database, and then the below interface will be shown.
[[File:Interface_1.PNG |center| 600px]]
* As is shown above, the database contains two parts: '''Tables''' and '''Indices'''.

* Click on the '''Browse Data''' highlighted in the red box and the following interface will show.

[[File:DB_Browser_Interface.PNG |center| 600px]]

* Demonstrated above are the contents of the table "detections".

* Each row is a record of one bird detection while each column contains distinct information of the records such as Date, Time, name of the Species, etc.

== Structured Query Language ==

Step 3: Learning the basics of SQL
SQL, which stands for Structured Query Language, is a domain-specific programming language used for managing and manipulating relational databases.
Here is a link for a brief tutorial for SQL language: https://www.w3schools.com/sql/default.asp

Step 4: Understand some relevant Python libraries

* '''sqlite3''' is a

<syntaxhighlight lang="python">
pip
</syntaxhighlight>

= Adding an SSD to improve performance =

* USB 3.0
USB 3.0 ports, also known as SuperSpeed USB ports, are considered unique due to their significantly improved data transfer speeds and enhanced capabilities compared to previous USB standards. One of the most salient features is its faster data transfer speed.

'''Tip''': You can quickly identify a USB 3.0 port by remembering this:
''' The USB 3.0 port is blue.'''

[[File:USB_3.jpg |center| 600px]]

* Kington A400S Series
Due to the large volume of data involved, we need to attach an ''' SSD(Solid-State Drive)''' to the Raspberry Pi. It is a type of data storage device used in computers and other electronic devices. In this project, we chose the '''SA400S37/480G''' model.

[[File:Kingston_SSD.jpg |center| 600px]]

The product specifications can be found in the link below:

https://www.scorptec.com.au/product/hard-drives-&-ssds/solid-state-drives-(ssd)/71426-sa400s37-480g?gclid=Cj0KCQjw0bunBhD9ARIsAAZl0E3uxry4rd_yIg2gIJG1NaU3FaXsMTMprgEl4MVEWMaWSeJv-Mz61i0aAiQxEALw_wcB

* Configuring the SSD
Step 1: Download the '''Raspberry Pi imager software''': https://downloads.raspberrypi.org/imager/imager_latest.exe

Step 2: Connect the SSD enclosure to your PC, then run the imager software.

Step 3: Select "Raspberry Pi OS (Other)". Then choose "Raspberry Pi OS (64-bit)".
[[File:Raspberry_1.png |center| 600px]]
[[File:Raspberry_2.png |center| 600px]]

Step 4: Click '''Write''' and wait for it to download, flash and verify.
If everything clicks, you will see the interface shown below:
[[File:Raspberry_3.png |center| 600px]]

Step 5: Unplug the SSD drive, set up the Raspberry Pi 4, and plug in the SSD to one of the blue USB3 ports.
'''Important: Always remember to remove the microSD card from the Raspberry Pi. The Pi needs to boot from the SSD inserted in the USB 3.0 port'''
If you forgot to do so, the new Kingston SSD won't take effect and you are left with the microSD card.

Step 6: Connect your Raspberry Pi to the Internet and open a terminal.

Step 7: Run <code>sudo apt update</code> then <code>sudo apt upgrade</code> in the terminal. This will do a full update of do a full update of all software.

Step 8: Open up a new terminal and run <code>lsusb -t</code>.
You should see '''Driver=uas''' among the results.
[[File:Scrot_2.png |center| 600px]]

Step 9: Check TRIM: Run the code <code>sudo fstrim -v /</code>. If you see the below message in the red box, then the TRIM isn't enabled for the drive and you need to enable it.
[[File:Scrot_3.png |center| 600px]]

Step 10: Run the command <code>lsblk -D</code>. Have a look for the 'sda' drive, and the two columns 'DISC-GRAN' and 'DISC-MAX'. If both of these are NOT zero, then your drive is capable of TRIM.

Step 11: If both the column "DISC-GRAN" and "DISC-MAX" under the 'sda' drive is zero as shown below:
[[File:Scrot_4.png |center| 600px]]
One possible cause is you didn't remove the microSD card from the Raspberry Pi as mentioned in Step 5. Shut down Raspberry Pi, remove the microSD card and reboot.

Step 12: Enable TRIM support: run the command <code>sudo su</code>. Until you close this terminal, everything from now on will be run as "super user" (admin). The command prompt should have also changed to show "root@raspberrypi".
[[File:Scrot_5.png |center| 600px]]

Step 13: Copy and paste the following command to the terminal and run it:
<code>find /sys/ -name provisioning_mode -exec grep -H . {} + | sort</code>.

Step 14: At the end of the result, there should be "provisioning_mode". It's likely to be set to "full", but we need it set to "unmap". If yours shows "unmap" already, you can skip this next step.

Step 15: Run the following command: <code>echo unmap > /sys/devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb2/2-1/2-1:1.0/host0/target0:0:0/0:0:0:0/scsi_disk/0:0:0:0/provisioning_mode</code>.

Step 16: After running the above command, run the "find" command in step 13 again. You should see the "provisioning_mode" has been changed to "unmap".

Step 17: Run the command <code>sudo fstrim -v /</code> again and you should see the below message:

[[File:Scrot_6.png |center| 600px]]

Step 18: If you get a similar output, then TRIM is working on the drive. However, when you reboot the Pi, it will revert back. To set the TRIM setting permanently, there are a few more steps we need to do.

Step 19: Run the command <code>lsusb</code> in the terminal. This will list all attached USB devices. Find the one associated with the SSD.(For me it's the first one in the red box.)
[[File:Scrot_7.png |center| 600px]]

Step 20: Take note of the two codes separated by a colon (:) after "ID", they will be important to later steps.
[[File:Scrot_8.png |center| 600px]]

Step 21: Run the following command <code>mousepad /etc/udev/rules.d/10-trim.rules</code> in the terminal. A text editor shown below should pop up.
[[File:Scrot_9.png |center| 600px]]

Step 22: Copy and paste this line into the empty text file: '''ACTION=="add|change", ATTRS{idVendor}=="174c", ATTRS{idProduct}=="1153", SUBSYSTEM=="scsi_disk", ATTR{provisioning_mode}="unmap"'''

Step 23: Replace "idVendor" and "idProduct" in the above line with the two codes we took note of in '''Step 20''' respectively. They should both have a length of 4. Close the mousepad and save the file.

Step 24: This code will enable TRIM by changing the provisioning mode to "unmap", just like we did manually earlier. Now we just need to schedule the TRIM process to be run periodically. Type <code>sudo systemctl enable fstrim.timer</code> into the terminal. This will enable a weekly timer, which is the preferred way to TRIM SSDs on Linux distributions (as opposed to continuous TRIM).

Step 25: At the end, we can type the command <code>sudo curl https://raw.githubusercontent.com/TheRemote/PiBenchmarks/master/Storage.sh | sudo bash</code>. This will give your drive a performance score, and if you fill in the prompts at the end, it will be published publicly on pibenchmarks.com.
[[File:Scrot_10.png |center| 600px]]

= Configure the UR41 Router from Milesight =
When you receive a new router, you need to configure it.

There are two ways of doing that: '''Wired Access''' and '''Wireless Access'''.

As the model we use in this project is UR41, which lacks a Wi-Fi Antenna, the '''Wireless Access''' approach isn't viable.
'''Insert a Picture Here'''

Here we used Raspberry Pi to configure the router via the '''Wired Access''' approach:

Step 1: Find an Ethernet cable and connect the router to the Raspberry Pi.
'''Insert two pictures here'''

Step 2: Open up Raspberry Pi and set the IP Address, Username and Password using the default setting. (You can find them in the '''Quick Start Guide'''.)
'''Insert a picture here'''

Step 3: Open a browser type the default IP address in the Address bar and press enter. The following interface should show up.
[[File:Login_0.png |center| 300px]]

Step 4: Enter the username and password then press enter. You'll see the following interface.

[[File:Login_1.png |center| 300px]]
The configuration is completed.

= Additional Tips and Tricks =

== Using Crontab to Schedule Events ==
Once the BirdNET-Pi system is deployed in the field, we expect it to upload data on a regular basis. To achieve this goal, we need to utilize Crontab to schedule the uploading. Crontab is a time-based job scheduler in Unix-like operating systems. It allows you to schedule tasks or commands to run automatically at specific intervals or times. These scheduled tasks are often referred to as "cron jobs."

'''INSERT A FEW PICTURES HERE'''

== Using Only Keyboard to Switch Tab==
To move to tab selection, press '''Ctrl + Tab'''.

== Taking a Delayed Screenshot Using Scrot==
'''Insert a Picture here'''

File:Login 1.png

2023-09-13T00:04:48Z

Bencheng:

2023-08-30T06:44:36Z

Bencheng: /* Adding an SSD to improve performance */