FYP2 Progress Report 3

    From week 10 to week 12, the environment of Raspberry Pi 4 is set up again to make sure it is compatible with the touchless GUI and speaker identification models. Raspbian 64-bit OS is installed so Debian 11 (bullseye) is being used. Then, the relevant python libraries are installed to execute the touchless GUI successfully on the Raspberry Pi 4. Besides, touchless GUI is created by using Qt framework in Python (pyqt5). The tricky part while designing the touchless GUI is repaint() function is used to prevent the GUI is blocked by the other events.

    In order to embed the speaker identification model into the touchless GUI, another stage is deployed which is the wake word detector. Hence, this can make sure a 2-stages system is built so the speaker identification model will only be triggered if the result of the wake word detector is correct. The result of the speaker identification model will then be displayed in the end as shown in the Figure below.

resultRaspPi.png

 

    Even though the desired result has been achieved, the touchless GUI is continuously explored to exploit its potential. For example, making the touchless GUI autorun in full screen after booting. At the same time, IEEE journal, presentation slides and FYP report are being prepared.

 

 

 

References:

1. https://arxiv.org/pdf/1602.07360.pdf (SqueezeNet)

2. https://arxiv.org/pdf/2007.10319.pdf (MCUNet)

3. https://github.com/gmalivenko/pytorch2keras (pytorch2keras)

4. https://github.com/rouyunpan/mcunet (MCUNet GitHub Repository)

5. https://github.com/Picovoice/porcupine (wake word detector GitHub Repository)

6. https://build-system.fman.io/pyqt5-tutorial (Simple pyqt5 tutorial link)

7. https://stackoverflow.com/questions/4510712/qlabel-settext-not-displaying-text-immediately-before-running-other-method (repaint())