This PhD will be developed within the framework of an ambitiuous initiative of the HiTZ center funded, among others, by the Basque and Spanish Governments, to improve the performance of Large Language Models on languages with low-resource corpora, including Basque. The motivation is that the amount of digital text available for most of the languages is orders of magnitude smaller than the text available for the largest languages. Current techniques for building Large Language Models like GPT, PaLM or Llama require massive amounts of text, and if fact, their performance for smaller languages is significantly worse.

The PhD topic is open and will look for sinergies with the aforementioned projects.

The student will join a thriving team of other PhDs and researchers focused on the limitations of current Large Language Models like GPT, and how to overcome them.