this post was submitted on 18 Jul 2023
24 points (100.0% liked)
LocalLLaMA
2953 readers
22 users here now
Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Is there any actual information here other than the number 2 being added to the name?
I gather it's better optimized for Windows, which is a welcome enough improvement imo. Other than that, they just go on about how "safe" it is.
I understand the concern about "AI safety" (at least in theory), but I wouldn't exactly call it a selling point.
Double the training data, double the trained context (4096 now), a chat tuned varient, the omission of the 35b model for now (it apparently isn't "safe" enough), and commercial use is allowed (not that most of the people using llama cares about licensing).
Thanks, that sounds more exciting than just "safety" haha.
It also appears on the HF leaderboard now so you can get a very general idea of how (at least the 70b model) compares: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
There's a few things, one of the biggest is the commercial license and the 4k context
Nice, thanks for the info!