DBRX, the state-of-the-art open LLM by Databricks

DBRX, the state-of-the-art open LLM by Databricks, is a revolutionary software product that has set new benchmarks in the field of language learning models (LLMs). Released on March 27, 2024, DBRX surpasses GPT-3.5 and competes with Gemini 1.0 Pro in performance. It boasts a fine-grained mixture-of-experts architecture, which leads to faster inference and smaller size compared to other models. The base and finetuned models of DBRX are available on Hugging Face, and it’s integrated into Databricks’ GenAI-powered products. DBRX was trained on a new dataset using Databricks tools, showing significant improvements in compute-efficiency and model quality.