Eclipsing the Llama 2 frontier, balancing language and coding.
A top-scoring 7B chat model using CrystalCoder checkpoint.
Coming soon...
7B English language model with the LLaMA architecture.
Instruction following model finetuned from LLM360-Amber.
Safety-finetuned instruction model using AmberChat as the base.
The recent surge in open-source Large Language Models (LLMs), such as LLaMA, Falcon, and Mistral, provides diverse options for AI practitioners and researchers. However, most LLMs have only released partial artifacts...
In recent months, the open-source large language model (LLM) community has seen tremendous model contributions. However, model weight releases and overview technical reports do not contain enough information to cover the complexity of LLM training...
The LLM360 Pre-Training Guide provides complete details and considerations for anyone leading a pre-training project. The Guide is divided into three categories: Project Planning, Initial Training Decision, Ensuring Success. Learning and procedural steps were ...
Coming Soon...
Great to see LLM360 in the top 5 on the ‘Openness of instruction-tuned LLMs’ scoreboard along with @BigscienceW, @laion_ai, and @togethercompute.
— LLM360 (@llm360) February 7, 2024
Check out the work from @Radboud_Uni here: https://t.co/g2Lf4yNPMz pic.twitter.com/t0MELYPpvK
1/3 We are releasing CrystalChat 🔮 — a top-scoring 7B chat model, fully open source!
— LLM360 (@llm360) January 11, 2024
As always, CrystalChat is released under Apache 2.0, along with all training data, checkpoints, and implementation details.
Grab the model here: https://t.co/n78jhxpVhA pic.twitter.com/jPXgEL0Xq5
2/3 Choosing models without knowing the training data is becoming riskier and riskier (e.g. @nytimes vs @openai).
— LLM360 (@llm360) January 11, 2024
CrystalChat makes all that information available — with more to come!
Check out how CrystalChat compares to SOTA models and performs on the major benchmarks below. pic.twitter.com/paTKmPCHph
Your feedback drives the evolution of LLM360. Share your experiences, results, and how we can improve to serve the AI community better.
