Rez

joined 2 years ago
[–] [email protected] 2 points 2 months ago (1 children)

Thank you so much for the suggestion! I tried Q8 of the model you mentioned, and I am very impressed with the results! The output itself was exactly what I wanted, the speed was a little on the slower side. Loading my previous conversation with a context of over 15k tokens took about 10 minutes to get the first response, but the later messages were much faster. The web ui loses connection almost every time though, and I just manually copy the response from the terminal window in to the web ui to save it for future context. I am currently downloading the Q6 model, and might experiment with going even lower for faster speeds and more stability, if the quality of the output doesn't degrade too much.

8
Psychoanalysis (sh.itjust.works)
 

Hi, I don't have much experience with running local AIs, but have tried to use ChatGPT for psychoanalysis purposes and the smarter, but limited for free users model is amazing. I don't like giving such personal information to OpenAI though, so I'd like to set something similar up locally, if possible. I am running Fedora Linux, and have had the best results with KoboldCpp, as it was by far the easiest to set up. I have a Ryzen 7600, 32 GB of ram, and a 7800 xt (16 GB vram). The two things I mostly want from this setup is the smartest model possible, as I've tried some and the responses just don't feel as insightful or though provoking as ChatGPT's, and I also really like the way it handles memory. I don't need "real time" conversation speed, if it means I can get the smarter responses that I am looking for. What models/setups would you recommend? Generally, I've been going for newer + takes up more space = better, but I'm kind of disappointed with the results, although the largest models I've tried have only been around 16 GB, is my setup capable of running bigger models? I've been hesitant to try, as I don't have fast internet and downloading a model usually means keeping my pc running overnight.

PS, I am planning to use this mostly as a way to grow/reflect, not dealing with trauma or loneliness. If you are struggling and are considering AI for help, never forget that it can not replace connections with real human beings.

[–] [email protected] 6 points 8 months ago

I need this on a shirt!

[–] [email protected] 4 points 9 months ago (1 children)

No, I've met a lot of people like you, but honestly, I have a hard time understanding why you feel that way. I'm in a couple of small group chats with people I'm friends with in real life. A group chat makes it easier to organize meeting up and sharing pictures with everyone after. Besides that, in a group chat I feel less pressure to reply, because if I'm not interested in a topic or have nothing to say, someone else will pick up and the person who started it won't feel ignored. In the same way, I feel I am able to share more easily, as I am not putting pressure on any one person to respond and I don't risk feeling rejected, but often a person who I wouldn't have expected to be intressed responds to my message that I would have not sent them personally so I feel like I get to know them better. I have no shame in admitting that I often mute these group chats when I'm trying to focus on something or am not interested in the current topic. However, I also know what it means to be in a group chat where I know almost no one and they are talking about thinks that only relate to them, so maybe that's the majority of the experience you've had?

[–] [email protected] 4 points 9 months ago (1 children)

Yes, it's really good! I do think that it can become a bit repetitive towards the end, but it's worth it for the beginning moments of exploration and discovery. If you haven't played a similar game like Morrowind before, I'd recommend looking for a guide that would explain character creation and skills. I never played the original, so I am no purist and would encourage you to check out some QoL mods and definitely turn on smaller dungeons in the settings, even for a first playtrough. Have fun, if you decide to try it!

[–] [email protected] 38 points 10 months ago (11 children)

Wouldn't the answer be "10" in that case?

[–] [email protected] 10 points 10 months ago (1 children)

I bought The Farmer Was Replaced yestarday, so I'll probably be finishing it over the weekend. It's a cute programming incremental game, but if you have 0 experience with writing code the later challenges might get too difficult

[–] [email protected] 36 points 10 months ago (42 children)

What is tardy supposed to mean?

[–] [email protected] 1 points 10 months ago

4get.ca is pretty decent

[–] [email protected] 3 points 10 months ago

Unless we are about to discover immortality!

[–] [email protected] 1 points 1 year ago (1 children)

Link to the github project?

[–] [email protected] 16 points 1 year ago* (last edited 1 year ago) (1 children)
  1. tux

Tux is not software, it's a software mascot :D

[–] [email protected] 2 points 1 year ago (16 children)

It's there, almost all the way to the right, about 1/3 from the top.

 

I have a laptop with a Ryzen 7 5700U, 16 GB ram, running Fedora 38 linux.
I'm looking to run a local uncensored LLM, I'd like to know what would be the best model and software to run it.
I'm currently running KoboldAI and Erebus 2.7b. It's okay in terms of speed, but I'm wondering if there's anything better out there. I guess, I would prefer something that is not web-ui based to lower the overhead, if possible.
I'm not very well versed in all the lingo yet, so please keep it simple.
Thanks!

 

I think we all draw a line between privacy and convenience and I think I found mine and settled into a comfort zone of sorts. I use Fedora 38. My browser is Mozilla Firefox with it's "strict" setting. uBlock origin and uMatrix. When I need/want to use a site that doesn't work due to blocked connections I relax the restrictions in uMatrix or temporarily disable it entirely if I get frustrated or I'm in a hurry. I watch videos on YouTube. Don't use social media, but I do use Facebook messenger (although I prefer to use Signal with the handful of people I can). I use a Xiaomi phone with custom ad blocking DNS (I'd like to get a Pixel with GrapheneOS someday). I look for an app on F-Droid first, but install it through Google Play if I can't find what I need there. I use Qwant and DuckDuckGo. I use ReVanced. I do not use a VPN. I think that's all the relevant information. My question is: how easy do you think it still is for big tech to track me? Are there any suggestions you would have for a person like me that wouldn't sacrifice too much convenience?

view more: next ›