multlingual

[EMNLP 2023] 💬 Language Identification with Support for More Than 2000 Labels

[NeurIPS 2024] 🕸 GlotCC Dataset and Pipline

A translation frontend for the Global African Storybook Project

Meta_doc : basic document management (DM) system, with a search by metadata. Access to documents through a classification plan. The metadata categories as well as the types of relationships between documents are part of the Dublin Core repository. The ressource URL or attached documents URL are inside the field "text".

BayLing-MLingual: 2500-way multilingual QA across 50 languages without LLM retraining

Automaginarium is a configurable universe generator built with Multilingual, where cellular automata, rule spaces, and imagination meet.

Rust implementation of the langid library for language identification. Easily classify text with a simple API. 🌍🔍

Vaulta AI is a voice-driven banking agent that authenticates users through a guided state machine before enabling AI-powered financial assistance via real-time streaming and conversational intelligence.

Fine-tuning Meta Llama-3.2-1B-Instruct using QLoRA for multilingual instruction following across English, Hindi, Telugu, Tamil, and Kannada. Includes complete training, evaluation, PEFT adapters, reproducible pipeline, and comprehensive benchmarking against the base model using quality, behavior, and multilingual metrics.

Multi-Encoder for ahk, text parsing, python, c++, java, and other languages like arabic, chinese, russian, or advanced text parsing for certain languages