News

FIT BUT scientists are developing an app for psychotherapists. Using deep learning to analyze therapy sessions

To offer psychotherapists systematic feedback on individual therapies and to improve the overall quality of psychotherapeutic care in the Czech Republic - this should be achieved by the new DeePsy application enabling automatic speech processing. Researchers from the BUT Speech@FIT group and their colleagues from Masaryk University are currently working on its development. The application should be completed in June next year.

In their practice, psychotherapists lack feedback that would allow them to continuously evaluate their work. "Psychotherapy is a demanding activity in which therapists process a considerable amount of information. They analyse some information consciously, but much more is processed unconsciously and intuitively. They can thus easily miss, for example, subtle signals of a client's discomfort or even deterioration. Clients are usually solving their own problems rather than evaluating the professionalism of the therapist's performance. In addition, some research has revealed a declining level or stagnation of psychotherapeutic qualities over time," explains Pavel Matějka from the BUT Speech@FIT group.

Manual transcription of individual sessions and their subsequent analysis are too time-consuming. That's why experts from Masaryk University turned to researchers from FIT BUT, who specialise in automatic processing and mining of information from speech. The test version of the DeePsy application, which works on the principle of deep learning, offers psychotherapists automatic transcription of sessions and analysis of their content.

Graphs comparing client and therapist speech show who spoke more during the session and what the average number of words per minute was. Keyword analysis can also reveal what emotions were prevalent in the speech or what proportion of verbs were phrased in past, present or future tense. The app will also assess the frequency of the most used words.

"Research studies show that when the language of the client and therapist differs significantly, either in content or form, it can indicate problems in the therapeutic relationship. DeePsy will alert the therapist to such a mismatch. How this information is handled, however, is up to the therapist. We only provide information to the therapist," adds Matějka.

To extract information from speech, the FIT researchers use automatic speech recognition, natural language processing and machine learning technologies. They trained the neural network algorithm on several thousand hours of audio recordings - from interviews to phone calls to spoken monologues. Yet right from the start, they ran into a problem: "We found that in therapy sessions, speech is very different from regular speech. Clients are usually emotionally distraught, so they repeat words much more often - perhaps three to five times before moving on. It took us a lot more time to come up with a meaningful transcript of the interviews from the start," Matějka adds.

The DeePsy app also includes a client questionnaire system that, together with the audio recordings, allows for systematic feedback to work with clients. "We will also work on evaluating therapist interventions. The algorithm should be able to recognise whether the therapist frequently asks questions, interprets, provides information or makes recommendations," says Matějka.

The web application, which is being developed as part of a Czech Technology Agency project, is currently being tested by researchers together with therapists at the Psychosomatic Clinic and the Therapeutic Port. It should be ready in June next year. "We hope that it will provide psychotherapists with user-friendly and useful feedback that will enable them to improve the quality of psychotherapeutic care in the Czech Republic," Matějka concludes.

[img]

BUT launched the first interfaculty quantum link in the Czech Republic connecting FIT and FEEC

In 2021, the Faculty of Electrical Engineering and Communication of the Brno University of Technology opened a new Quantum Security Laboratory, where you can find equipment used to ensure communication resistant to attacks by quantum computers (find more details here). Now the scientists have transferred the quantum link from the laboratory environment to a real operational network connecting the Faculty of Electrical Engineering and Communication (FEEC) and the Faculty of Information Technology (FIT), i.e. two campuses located in different parts of Brno. This connection represents a further step towards building a quantum network and strengthening the cybersecurity research.


In addition to the aforementioned faculties, the university's rectorate as well as the Computing and Information Services Centre (CISC), which prepared a suitable route on the existing optical infrastructure, participated in the construction of the link. The new encrypted connection corresponds to a real installation and will primarily serve research and education.

More here
[img]

FIT researchers work on preventing laser dazzling of pilots by developing a security system that finds the attacker

The pilot is preparing for landing on the runway when a blinding green beam illuminates the entire cockpit. It was just hit from the ground by an attacker using lasers. Each year, the police register several dangerous incidents that could potentially result in a tragedy. Therefore, the Václav Havel Airport in cooperation with the Czech Police reached out to researchers from the FIT BUT, CTU and the University of Defence. The goal is to design a system of aerial protection against low-power lasers.

More in this article.

[img]

FIT intern at CERN is developing particle accelerator monitoring software

It started with an interest in nuclear physics, chemistry and energy, and continued with an internship at the European Organization for Nuclear Research (CERN) in Geneva. Since March, FIT student Silvie Němcová has been working as an intern in a team developing software that is part of CERN's critical infrastructure. "For me, it is a great opportunity to combine IT with my other interests, while participating in a project which includes interesting experiments," she says.

More in this article.

[img]

Research means constant learning. It is a great job for the curious, says graduate working in Singapore

Jakub Pružinec, an FIT graduate, has been working in the distant Singapore for over two years. At Nanyang Technological University (NTU), he is a research assistant in the HP-NTU Corporate Lab, a new laboratory created in collaboration between the university and HP. "You get a taste of both, the academia and the industry," Jakub Pružinec says. 
More information here.

[img]
Back to top