doodlebob

I'd be super interested to see what the levels look like in farm raised vs wild caught

I'm pretty sure that's their plan tbh but damn it I don't wanna wait! Lol

I really want to see if someone comes out with a dock which has a better speaker. Something you can just pop the voice preview hardware on top of would be nice

Man, I hope someone designs a dock for this with a better speaker for music!!!

I ordered some I have 4 other PCBs

My main problem with this is that the speaker isn't as loud as with the original board...

I think they mentioned on their discord that it's in the pipeline

I really wish there was an update feature built into OWUI!

I also suggest inovelli, they're solid

Do you know if there is openai API compatibility? More specifically I'd like to get home assistant to interact with the LLM via the custom OpenAI hacs addon

I think you're right. Saw a post on Reddit basically mentioning the same things I'm seeing.

It looks like autoawq supports it but it might be an issue with how oobabooga implements it or something...

I have two 3090 Turbo GPUs and it seems like oobabooga doesn't split the load between the two cards when I try to run TheBloke/dolphin-2.7-mixtral-8x7b-AWQ.

Does anyone know how to make text generation webui use both cards? Do I need an nvlink between the two cards?

I tried this but much prefer to use oogabooga text generation webui. Couldn't get your solution to work in unraid for whatever reason