ghana-speech-phoneme-asr: 42 Languages, One Model, IPA Output
Introduction Most ASR models output words. This one outputs phonemes — the actual sounds of speech in IPA (International Phonetic...
Read more
Recently, there has been a realization that language technologies have been leaving certain languages behind - including most African languages. While Google Translate offers translation services in several African languages, no Ghanaian languages are included, and even for the included languages the quality has been generally found to be quite poor. Major challenges boil down to lack of good (indeed often any) training data, as well as lack of adoption of major language technologies for local problems.
Ghana NLP is an Open Source Initiative focused on Natural Language Processing (NLP) of Ghanaian Languages, & its Applications to Local Problems. While we will begin work on Ghanaian languages initially, likely focusing on Twi due to number of speakers, our ultimate goal is for our tools to be applicable throughout the West African subregion and beyond.
Every project here is built and sustained by the Ghana NLP community — researchers, engineers and volunteers working on the languages they speak. Everything is open and free to build on.
We build the datasets, models and benchmarks that Ghanaian languages are missing, and we publish what we find. The work is open: our corpora, models and evaluation code are released for anyone to build on, and the research is done by the community itself.
Our most recent paper benchmarks 19 open-weight and proprietary large language models translating between English and 43 Ghanaian languages — the most comprehensive evaluation of its kind so far. The headline finding is a sobering one: no model and no language reached both high performance and high consistency, so these systems are not yet reliably usable for Ghanaian language translation at scale. The benchmark is public and community-extensible. Read the paper on arXiv
We use platforms given to us by event organizers to present trending subjects in the industry alongside discuss some projects we've been able to accomplish.
We attended the launch of Ghana's National Artificial Intelligence Strategy, alongside government, industry and academic stakeholders shaping how AI is built and applied in Ghana. Our interest there is the one we have carried throughout: that Ghanaian languages are part of the foundation, so the systems built on this strategy are usable by everyone in the country.
Here is our news wall, where you will see what's trending with the GhanaNLP and the community at large.
Introduction Most ASR models output words. This one outputs phonemes — the actual sounds of speech in IPA (International Phonetic...
Read moreIntroduction Building speech recognition for Ghanaian languages starts with one thing: data. Today we’re introducing ghana-speech — a dataset with...
Read moreIntroduction In our previous blog post we introduced a preliminary Twi embedding model based on fastText and visualized it using...
Read moreIntroduction In our previous blog post we introduced a preliminary Twi embedding model based on fastText and visualized it using...
Read more