I know it’s not much, but I’m deciding to publish the open-source version of Bleta-8B, an Albanian language model (LLM) that I developed. Bleta was trained with materials and datasets in Albanian.
Below is the pattern on Hugging Face, which is available in various formats.
However, I must point out that the Bee is not perfect and can sometimes hallucinate 😄.
Anyone who wants to contribute to develop it further is welcome.
Modeli Hugging Face : https://huggingface.co/klei1/bleta-8b
Chat UI: https://trydialogo.up.railway.app/bot/37dd95d4-352e-4512-965a-e48718b8a8ca
Bleta-8B model gjuhësor në shqip (LLM)
byu/klei10 inalbania
Posted by klei10
9 Comments
Dukt shume interesante. Faleminderit dhe respekte per punen.
E provova pak respekte te medhaja eshte shume e mire
Çfarë dataset ke përdoruar?
A bazohet tek llama 8b?
Respekte!
Restecp
https://preview.redd.it/puxe7as2u4hd1.jpeg?width=1440&format=pjpg&auto=webp&s=4d32f57b6dec7455ce2ae7931312b87cfe046c98
Lot
Përgëzime. Shumë ide e mirë. Bëra një provë të vogël dhe pas 5 pyetjeve vendosi tbeje një pushim 😊.
Ben dot edhe një model 2b? Do ishte interesante një apo Android offline që flet shqip.
Sa të ka kushtuar training?