Gorka Azkune
Human-Computer Interaction
Nowadays, computers affect all aspect of our daily lives. It is more and more common even for a person that does not have a computer to come into contact with a technological device or a certain computing system daily. On this daily tasks, the ways and needs of the interaction between human and computer are changing constantly, and thus, Human-Computer Interaction (HCI) is an important factor to take into account when designing a computer system. The purpose of HCI is to develop new interacti...Read More
Main Researcher:
hci_tabs
Contracts
- Inteligencia Artificial Centrada en el Lenguaje
Consulting project for Evolutio.
(2024 - 2024) 
Scientific advice in the construction of a personal assistant
(2021 - 2022)
(2022 - 2022)
Scientific advice in the construction of a personal assistant
(2020 - 2021)
Project that aims to develop an artificial intelligence system that answers frequently asked questions about procedures and services of the Basque Administration
(2021 - 2021)
Scientific advice in the construction of a personal assistant
(2019 - 2020)
Conversational QA agents that learn after deployment (Google faculty research awards 2019)
(2020 - 2020)- Asesoría sobre sistemas de diálogo voice2text
(2020 - 2020) - Dialogo-sistemen artearen egoera
Survey on dialogue systems for Basque
(2019 - 2019) - Informe del estado del arte de sistemas de diálogo.
(2019 - 2019)
Projects
- CLARIAH-EUS-gArA
(20240901 - 20250901)
(2024 - 2026)
The HiTZ Chair of Artificial Intelligence and Language Technology has an ambitious program to strengthen leadership in this technology and place the country at the technological forefront.
(2024 - 2026)
Learning commonsense knowledge for natural language understanding.
(2022 - 2025)- ICL4LANG: Aprendizaje En contexto como nuevo paradigma para investigar tecnologías del lenguaje escalables y de alta precisión adaptadas a las necesidades industriales del País Vasco
(2023 - 2025) 
Research on Language Technology to foster the presence of Basque in the digital landscape.
(2023 - 2025)
(2023 - 2025)- VIRPAT1.0
(2022 - 2023) 
Automated surveillance of key questions on COVID-19 in scientific publications
(2020 - 2021)
Learning to Interact with Humans by Lifelong Interaction with Humans
(2017 - 2020) All HiTZ projects
News
Publications
Paula Ontalvilla, Aitor Ormazabal, Gorka Azkune
Improving the Efficiency of Visually Augmented Language Models (2025)
COLING 2025
Gorka Azkune, Ander Salaberria, Eneko Agirre
Grounding spatial relations in text-only language models (2024)
Neural Networks. Volume 170, February 2024, Pages 215-226
Janire Arana, Mikel Idoyaga, Maitane Urruela, Elisa Espina, Aitziber Atutxa, Koldo Gojenola
A Virtual Patient Dialogue System Based on Question-Answering on Clinical Records (2024)
THE 2024 JOINT INTERNATIONAL CONFERENCE ON COMPUTATIONAL LINGUISTICS, LANGUAGE RESOURCES AND EVALUATION, LREC-Coling 2024, Torino
Margot Madina, Itziar Gonzalez-Dios, and Melanie Siegel.
LanguageTool as a CAT tool for Easy-to-Read in Spanish (2024)
Madina, M., Gonzalez-Dios, I., & Siegel, M. (2024, May). LanguageTool as a CAT tool for Easy-to-Read in Spanish. In Proceedings of the 3rd Workshop on Tools and Resources for People with REAding DIfficulties (READI)@ LREC-COLING 2024 (pp. 93-101).
Margot Madina, Itziar Gonzalez-Dios, Melanie Siegel
Towards Reliable E2R Texts: A Proposal for Standardized Evaluation Practices (2024)
Madina, M., Gonzalez-Dios, I., & Siegel, M. (2024, July). Towards reliable E2R texts: a proposal for standardized evaluation practices. In International Conference on Computers Helping People with Special Needs (pp. 224-231). Cham: Springer Nature Switzerland.
Imanol Miranda, Ander Salaberria, Eneko Agirre, Gorka Azkune
BiVLC: Extending Vision-Language Compositionality Evaluation with Text-to-Image Retrieval (2024)
38th Conference on Neural Information Processing Systems (NeurIPS 2024)
Blanca Calvo Figueras and Rodrigo Agerri
Critical Questions Generation: Motivation and Challenges (2024)
In Proceedings of the 28th Conference on Computational Natural Language Learning, pages 105–116, Miami, FL, USA. Association for Computational Linguistics.
Jon Ander Campos
Leveraging Feedback in Conversational Question Answering Systems (2023)
-.
Arantxa Otegi, Iñaki San Vicente, Xabier Saralegi, Anselmo Peñas, Borja Lozano, Eneko Agirre
Information retrieval and question answering: A case study on COVID-19 scientific literature (2022)
Knowledge-Based Systems, Volume 240.
Cristina Aceta, Izaskun Fernandez, Aitor Soroa
KIDE4I: A Generic Semantics-Based Task-Oriented Dialogue System for Human-Machine Interaction in Industry 5.0 (2022)
Applied Sciences 12, no. 3: 1192
Aitor Almeida, Unai Bermejo, Aritz Bilbao, Gorka Azkune, Unai Aguilera, Mikel Emaldi, Fadi Dornaika, Ignacio Arganda-Carreras
A Comparative Analysis of Human Behavior Prediction Approaches in Intelligent Environments (2022)
Sensors, vol 22, Issue 3, pp 701
Cristina Aceta
Generic semantics-based task-oriented dialogue system framework for human-machine interaction in industrial scenarios (2022)
-
Jan Deriu, Alvaro Rodrigo, Arantxa Otegi, Guillermo Echegoyen, Sophie Rosset, Eneko Agirre, Mark Cieliebak
Survey on Evaluation Methods for Dialogue Systems (2021)
Artificial Intelligence Review, vol. 54, pages 755-810. https://doi.org/10.1007/s10462-020-09866-x
Cristina Aceta, Izaskun Fernandez, Aitor Soroa
TODO: A Core Ontology for Task-Oriented Dialogue Systems in Industry 4.0 (2021)
Cristina Aceta and Izaskun Fernández and Aitor Soroa. (2021). "TODO: A Core Ontology for Task-Oriented Dialogue Systems in Industry 4.0". Studies on the Semantic Web. IOS Press Ebooks. 10.3233/SSW210031.
Cristina Aceta, Izaskun Fernandez, Aitor Soroa
Ontology Population Reusing Resources for Dialogue Intent Detection: Generic and Multilingual Approach (2021)
Cristina Aceta and Izaskun Fernández and Aitor Soroa. Ontology Population Reusing Resources for Dialogue Intent Detection: Generic and Multilingual Approach (2021) In: Proceedings of Recent Advances in Natural Language Processing
Unai Bermejo, Aitor Almeida, Aritz Bilbao-Jayo, Gorka Azkune
Embedding-based real-time change point detection with application to activity segmentation in smart home time series data (2021)
Expert Systems with Applications, Volume 185 (online first) december 2021 115641
Adrián Núñez-Marcos, Gorka Azkune, Ignacio Arganda-Carreras
Egocentric Vision-based Action Recognition: A survey (2021)
Neurocomputing, Volume 472, December 2021, pp. 175-197. URL: https://doi.org/10.1016/j.neucom.2021.11.081 ISSN: 0925-2312
Adrián Núñez-Marcos, Gorka Azkune, Ignacio Arganda-Carreras
Exploiting Egocentric Cues for Action Recognition for Ambient Assisted Living Applications (2021)
"Emerging Technologies in Biomedical Engineering and Sustainable TeleMedicine" liburuko kapitulua
Arantxa Otegi, Aitor Agirre, Jon Ander Campos, Aitor Soroa, Eneko Agirre
Conversational Question Answering in Low Resource Scenarios: A Dataset and Case Study for Basque (2020)
Proceedings of The 12th Language Resources and Evaluation Conference, pp. 429–435. European Language Resources Association. ISBN: 979-10-95546-34-4
Adrián Nuñez-Marcos, Gorka Azkune, Eneko Agirre, Diego López-de-Ipiña, Ignacio Arganda-Carreras
Using External Knowledge to Improve Zero-shot Action Recognition in Egocentric Videos (2020)
International Conference on Image Analysis and Recognition (ICIAR)
C. Pradel, D. Sileo, A. Rodrigo, A. Peñas, E. Agirre.
Question Answering when Knowledge Bases are Incomplete? (2020)
Proceedings of Conference and Labs of the Evaluation Forum.
Gorka Azkune, Aitor Almeida, Eneko Agirre
Cross-environment activity recognition using word embeddings for sensor and activity representation (2020)
Neurocomputing (available online 1 September 2020)
Jan Deriu, Katsiaryna Mlynchyk, Philippe Schläpfer, Alvaro Rodrigo, Dirk von Grünigen, Nicolas Kaiser, Kurt Stockinger, Eneko Agirre, Mark Cieliebak
A Methodology for Creating Question Answering Corpora Using Inverse Data Annotation (2020)
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 897-911.
Arantxa Otegi, Jon Ander Campos, Gorka Azkune, Aitor Soroa, Eneko Agirre
Automatic Evaluation vs. User Preference in Neural Textual Question Answering over COVID-19 Scientific Literature (2020)
Proceedings of the 1st Workshop on NLP for COVID-19 (Part 2) at EMNLP 2020
Jan Deriu, Don Tuggener, Pius von Däniken, Jon Ander Campos, Alvaro Rodrigo, Thiziri Belkacem, Aitor Soroa, Eneko Agirre, Mark Cieliebak
Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems (2020)
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). (Pages 3971–3984). Honorable Mention Paper (Top 1%).
Jon Ander Campos, Kyunghyun Cho, Arantxa Otegi, Aitor Soroa, Eneko Agirre, Gorka Azkune
Improving Conversational Question Answering Systems after Deployment using Feedback-Weighted Learning (2020)
Proceedings of the 28th International Conference on Computational Linguistics (COLING), pages 2561–2571. Outstanding Paper (Top 1%).
Jon Ander Campos, Arantxa Otegi, Aitor Soroa, Jan Deriu, Mark Cieliebak, Eneko Agirre
DoQA - Accessing Domain-Specific FAQs via Conversational QA (2020)
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7302–7314
Anselmo Peñas, Mathilde Veron, Camille Pradel, Arantxa Otegi, Guillermo Echegoyen, Alvaro Rodrigo
Continuous Learning for Question Answering (2019)
Proceedings of the 10th International Workshop on Spoken Dialog Systems (IWSDS 2019) - DSLL Special Session
Eneko Agirre, Arantxa Otegi, Camille Pradel, Sophie Rosset, Anselmo Peñas, Mark Cieliebak
LIHLITH: Learning to Interact with Humans by Lifelong Interaction with Humans (2019)
Procesamiento Del Lenguaje Natural, vol. 63, pp. 147-150. ISSN: 1989-7553
Eneko Agirre, Anders Jonsson, Anthony Larcher
Framing Lifelong Learning as Autonomous Deployment: Tune Once Live Forever (2019)
Dialogue Systems and Lifelong Learning special session at Tenth International Workshop on Spoken Dialogue Systems Technology (IWSDS)
Jon Ander Campos, Arantxa Otegi, Aitor Soroa, Jan Deriu, Mark Cieliebak, Eneko Agirre
Conversational QA for FAQs (2019)
NeurIPS 3rd Conversational AI Workshop: “Today's Practice and Tomorrow's Potential”
hci_tabs_full
- Inteligencia Artificial Centrada en el Lenguaje
Consulting project for Evolutio.
(2024 - 2024)
Scientific advice in the construction of a personal assistant
(2021 - 2022)
(2022 - 2022)
Scientific advice in the construction of a personal assistant
(2020 - 2021)
Project that aims to develop an artificial intelligence system that answers frequently asked questions about procedures and services of the Basque Administration
(2021 - 2021)
Scientific advice in the construction of a personal assistant
(2019 - 2020)
Conversational QA agents that learn after deployment (Google faculty research awards 2019)
(2020 - 2020)- Asesoría sobre sistemas de diálogo voice2text
(2020 - 2020) - Dialogo-sistemen artearen egoera
Survey on dialogue systems for Basque
(2019 - 2019) - Informe del estado del arte de sistemas de diálogo.
(2019 - 2019)
- CLARIAH-EUS-gArA
(20240901 - 20250901)
(2024 - 2026)
The HiTZ Chair of Artificial Intelligence and Language Technology has an ambitious program to strengthen leadership in this technology and place the country at the technological forefront.
(2024 - 2026)
Learning commonsense knowledge for natural language understanding.
(2022 - 2025)- ICL4LANG: Aprendizaje En contexto como nuevo paradigma para investigar tecnologías del lenguaje escalables y de alta precisión adaptadas a las necesidades industriales del País Vasco
(2023 - 2025)
Research on Language Technology to foster the presence of Basque in the digital landscape.
(2023 - 2025)
(2023 - 2025)- VIRPAT1.0
(2022 - 2023)
Automated surveillance of key questions on COVID-19 in scientific publications
(2020 - 2021)
Learning to Interact with Humans by Lifelong Interaction with Humans
(2017 - 2020) All HiTZ projects
Paula Ontalvilla, Aitor Ormazabal, Gorka Azkune
Improving the Efficiency of Visually Augmented Language Models (2025)
COLING 2025
Gorka Azkune, Ander Salaberria, Eneko Agirre
Grounding spatial relations in text-only language models (2024)
Neural Networks. Volume 170, February 2024, Pages 215-226
Janire Arana, Mikel Idoyaga, Maitane Urruela, Elisa Espina, Aitziber Atutxa, Koldo Gojenola
A Virtual Patient Dialogue System Based on Question-Answering on Clinical Records (2024)
THE 2024 JOINT INTERNATIONAL CONFERENCE ON COMPUTATIONAL LINGUISTICS, LANGUAGE RESOURCES AND EVALUATION, LREC-Coling 2024, Torino
Margot Madina, Itziar Gonzalez-Dios, and Melanie Siegel.
LanguageTool as a CAT tool for Easy-to-Read in Spanish (2024)
Madina, M., Gonzalez-Dios, I., & Siegel, M. (2024, May). LanguageTool as a CAT tool for Easy-to-Read in Spanish. In Proceedings of the 3rd Workshop on Tools and Resources for People with REAding DIfficulties (READI)@ LREC-COLING 2024 (pp. 93-101).
Margot Madina, Itziar Gonzalez-Dios, Melanie Siegel
Towards Reliable E2R Texts: A Proposal for Standardized Evaluation Practices (2024)
Madina, M., Gonzalez-Dios, I., & Siegel, M. (2024, July). Towards reliable E2R texts: a proposal for standardized evaluation practices. In International Conference on Computers Helping People with Special Needs (pp. 224-231). Cham: Springer Nature Switzerland.
Imanol Miranda, Ander Salaberria, Eneko Agirre, Gorka Azkune
BiVLC: Extending Vision-Language Compositionality Evaluation with Text-to-Image Retrieval (2024)
38th Conference on Neural Information Processing Systems (NeurIPS 2024)
Blanca Calvo Figueras and Rodrigo Agerri
Critical Questions Generation: Motivation and Challenges (2024)
In Proceedings of the 28th Conference on Computational Natural Language Learning, pages 105–116, Miami, FL, USA. Association for Computational Linguistics.
Jon Ander Campos
Leveraging Feedback in Conversational Question Answering Systems (2023)
-.
Arantxa Otegi, Iñaki San Vicente, Xabier Saralegi, Anselmo Peñas, Borja Lozano, Eneko Agirre
Information retrieval and question answering: A case study on COVID-19 scientific literature (2022)
Knowledge-Based Systems, Volume 240.
Cristina Aceta, Izaskun Fernandez, Aitor Soroa
KIDE4I: A Generic Semantics-Based Task-Oriented Dialogue System for Human-Machine Interaction in Industry 5.0 (2022)
Applied Sciences 12, no. 3: 1192
Aitor Almeida, Unai Bermejo, Aritz Bilbao, Gorka Azkune, Unai Aguilera, Mikel Emaldi, Fadi Dornaika, Ignacio Arganda-Carreras
A Comparative Analysis of Human Behavior Prediction Approaches in Intelligent Environments (2022)
Sensors, vol 22, Issue 3, pp 701
Cristina Aceta
Generic semantics-based task-oriented dialogue system framework for human-machine interaction in industrial scenarios (2022)
-
Jan Deriu, Alvaro Rodrigo, Arantxa Otegi, Guillermo Echegoyen, Sophie Rosset, Eneko Agirre, Mark Cieliebak
Survey on Evaluation Methods for Dialogue Systems (2021)
Artificial Intelligence Review, vol. 54, pages 755-810. https://doi.org/10.1007/s10462-020-09866-x
Cristina Aceta, Izaskun Fernandez, Aitor Soroa
TODO: A Core Ontology for Task-Oriented Dialogue Systems in Industry 4.0 (2021)
Cristina Aceta and Izaskun Fernández and Aitor Soroa. (2021). "TODO: A Core Ontology for Task-Oriented Dialogue Systems in Industry 4.0". Studies on the Semantic Web. IOS Press Ebooks. 10.3233/SSW210031.
Cristina Aceta, Izaskun Fernandez, Aitor Soroa
Ontology Population Reusing Resources for Dialogue Intent Detection: Generic and Multilingual Approach (2021)
Cristina Aceta and Izaskun Fernández and Aitor Soroa. Ontology Population Reusing Resources for Dialogue Intent Detection: Generic and Multilingual Approach (2021) In: Proceedings of Recent Advances in Natural Language Processing
Unai Bermejo, Aitor Almeida, Aritz Bilbao-Jayo, Gorka Azkune
Embedding-based real-time change point detection with application to activity segmentation in smart home time series data (2021)
Expert Systems with Applications, Volume 185 (online first) december 2021 115641
Adrián Núñez-Marcos, Gorka Azkune, Ignacio Arganda-Carreras
Egocentric Vision-based Action Recognition: A survey (2021)
Neurocomputing, Volume 472, December 2021, pp. 175-197. URL: https://doi.org/10.1016/j.neucom.2021.11.081 ISSN: 0925-2312
Adrián Núñez-Marcos, Gorka Azkune, Ignacio Arganda-Carreras
Exploiting Egocentric Cues for Action Recognition for Ambient Assisted Living Applications (2021)
"Emerging Technologies in Biomedical Engineering and Sustainable TeleMedicine" liburuko kapitulua
Arantxa Otegi, Aitor Agirre, Jon Ander Campos, Aitor Soroa, Eneko Agirre
Conversational Question Answering in Low Resource Scenarios: A Dataset and Case Study for Basque (2020)
Proceedings of The 12th Language Resources and Evaluation Conference, pp. 429–435. European Language Resources Association. ISBN: 979-10-95546-34-4
Adrián Nuñez-Marcos, Gorka Azkune, Eneko Agirre, Diego López-de-Ipiña, Ignacio Arganda-Carreras
Using External Knowledge to Improve Zero-shot Action Recognition in Egocentric Videos (2020)
International Conference on Image Analysis and Recognition (ICIAR)
C. Pradel, D. Sileo, A. Rodrigo, A. Peñas, E. Agirre.
Question Answering when Knowledge Bases are Incomplete? (2020)
Proceedings of Conference and Labs of the Evaluation Forum.
Gorka Azkune, Aitor Almeida, Eneko Agirre
Cross-environment activity recognition using word embeddings for sensor and activity representation (2020)
Neurocomputing (available online 1 September 2020)
Jan Deriu, Katsiaryna Mlynchyk, Philippe Schläpfer, Alvaro Rodrigo, Dirk von Grünigen, Nicolas Kaiser, Kurt Stockinger, Eneko Agirre, Mark Cieliebak
A Methodology for Creating Question Answering Corpora Using Inverse Data Annotation (2020)
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 897-911.
Arantxa Otegi, Jon Ander Campos, Gorka Azkune, Aitor Soroa, Eneko Agirre
Automatic Evaluation vs. User Preference in Neural Textual Question Answering over COVID-19 Scientific Literature (2020)
Proceedings of the 1st Workshop on NLP for COVID-19 (Part 2) at EMNLP 2020
Jan Deriu, Don Tuggener, Pius von Däniken, Jon Ander Campos, Alvaro Rodrigo, Thiziri Belkacem, Aitor Soroa, Eneko Agirre, Mark Cieliebak
Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems (2020)
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). (Pages 3971–3984). Honorable Mention Paper (Top 1%).
Jon Ander Campos, Kyunghyun Cho, Arantxa Otegi, Aitor Soroa, Eneko Agirre, Gorka Azkune
Improving Conversational Question Answering Systems after Deployment using Feedback-Weighted Learning (2020)
Proceedings of the 28th International Conference on Computational Linguistics (COLING), pages 2561–2571. Outstanding Paper (Top 1%).
Jon Ander Campos, Arantxa Otegi, Aitor Soroa, Jan Deriu, Mark Cieliebak, Eneko Agirre
DoQA - Accessing Domain-Specific FAQs via Conversational QA (2020)
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7302–7314
Anselmo Peñas, Mathilde Veron, Camille Pradel, Arantxa Otegi, Guillermo Echegoyen, Alvaro Rodrigo
Continuous Learning for Question Answering (2019)
Proceedings of the 10th International Workshop on Spoken Dialog Systems (IWSDS 2019) - DSLL Special Session
Eneko Agirre, Arantxa Otegi, Camille Pradel, Sophie Rosset, Anselmo Peñas, Mark Cieliebak
LIHLITH: Learning to Interact with Humans by Lifelong Interaction with Humans (2019)
Procesamiento Del Lenguaje Natural, vol. 63, pp. 147-150. ISSN: 1989-7553
Eneko Agirre, Anders Jonsson, Anthony Larcher
Framing Lifelong Learning as Autonomous Deployment: Tune Once Live Forever (2019)
Dialogue Systems and Lifelong Learning special session at Tenth International Workshop on Spoken Dialogue Systems Technology (IWSDS)
Jon Ander Campos, Arantxa Otegi, Aitor Soroa, Jan Deriu, Mark Cieliebak, Eneko Agirre
Conversational QA for FAQs (2019)
NeurIPS 3rd Conversational AI Workshop: “Today's Practice and Tomorrow's Potential”
