Smokeydope

joined 2 years ago
MODERATOR OF
[–] [email protected] 1 points 1 day ago

Thanks for sharing!

[–] [email protected] 2 points 1 day ago (1 children)

Looks promising, hope this ends up in an open source process that improved RAG type task.

[–] [email protected] 2 points 3 days ago (1 children)

FromSoft fans who have been around since Kingfield in the late 90s: "always has been" (because from hit gold with the old and decaying fantasy world with dwindling hope in its inhabitants atmospheric vibe and keep reusing it)

[–] [email protected] 1 points 3 days ago

This is so exciting! Glad to see mistral at it with more bangers.

[–] [email protected] 3 points 3 days ago* (last edited 3 days ago) (1 children)

Hi Hawke, I understand your fustration with needing to troubleshoot things. Steam allows you to import any exe as a 'non-steam game' to your library and run it with the proton compatability layer. I sometimes have success getting a GOG game installed by running the install exe through proton or wine. Make sure you are using the most up to date version of lutris many package managers are outdated flatpak will gaurentee its most up to date. Hope it all works out for you

[–] [email protected] 18 points 3 days ago (2 children)

assuming you use steam, see which of your favorite games run with proton compatability layer and which absolutely require windows. You may be suprised.

[–] [email protected] 3 points 3 days ago

Awesome, thank you!

[–] [email protected] 4 points 3 days ago

Thank you for the support Sergio! I hope it works out too.

9
submitted 3 days ago* (last edited 3 days ago) by [email protected] to c/[email protected]
 

All moderators have been inactive for more than a year. The information contained in sidebar and pinned guides could use some updating. Its important that newcomers can access the latest relevant information in our quickly evolving hobby.

I have been a somewhat active poster and commenter of this localllama community for approximately half a year. I am the moderator of Lemmy.world/c/metaldetecting. I would like to help actively maintain another community I feel passionate in growing. I understand the responsibility that comes with the role.

I also understand that as a potential moderator of another instances community, I would be limited in certain actions. I am prepared to make a local instance account in the scenario that ever becomes a issue.

[–] [email protected] 2 points 3 days ago* (last edited 3 days ago)

Ive tried official Deepseek qwen 2.5 14b r1 distill and a few unofficial mistrals trained on R1 CoT. They are indeed pretty amazing and I found myself switching between a general purpose model and a thinking model regularly before this released.

DeepHermes is a thinking model family with R1 distill CoT that you can toggle between standard short output or spending a few thousand tokens thinking about a solution.

I found that pure thinking models are fantastic for asking certain kinds of problem solving questions, but awful at following system prompt changes for roleplay scenarios or adopting complex personality archetypes.

This let's you have your cake and eat it too by letting CoT be optional while keeping regular system prompt capabilities.

The thousands of tokens spent thinking can get time consuming when you only getting 3t/s on the larger 24b models. So its important to choose between a direct answer or spend 5 minutes to let it really think. Its abilities are impressive even if it takes 300 seconds to fully think out a problem at 2.5t/s.

Thats why I am so happy the 8b model is pretty intelligent with CoT enabled so I can fit a thinking model entire in vram and its not dumb as rocks in knowledge base either. I'm getting 15-20t/s with 8b instead of 2.5-3t/s partially offloading a larger model. 6.4x speed inceease at the CoT is a huge W for my real life human time spent waiting for a complete output.

[–] [email protected] 2 points 4 days ago* (last edited 3 days ago) (1 children)

Great question. Sometimes I feel like ive lost the plot of enjoying the human experience. When the majority of the members of my species exhibit a behavior or inpulse that I cant relate to or dont understand, I second guess whether its me missing something fundamental to enjoying my existence or whether Ive overcome a certain flaw most others haven't or something else.

You are correct though I should be a little more confident in the choices ive made and the rationals of why I made it.

 

I decided that I had one too many large tables this week thats primary function just served to collect plates and trash.

I got rid of it and sort of had an existential moment of realization. I'm scraping the barrel on minimalism. Last year I moved into a small tent full time. Downsized my bed to a cot, made my own solar system, pump my water, and got rid of all my trinkets and toys.

I just don't have much left to get rid of. Not much left to store or organize. No need for large tables, my smaller collapsable tables do what I need. All thats left is bare essential appliances, clothing, bedding, and daily use devices. just a little more I wouldn't even need a shelf anymore.

I feel free. Like a weight is being lifted off of me. Possessing means maintenance and emotional attachment to objects. Each thing I get rid of feels like a win, like I'm letting go of something that I didn't really need. The few things that stay I truly appreciate for what they provide me in life.

But I feel like I'm kind of weird for feeling these way. Its the societal norm to collect things, compare social status with objects, show off your ideaologoies and interest by decorations. The 'dream' for most people is a big home to fill with a spouce, kids, and things.

People get mad at the idea of 'pod life' and 'owning nothing and being happy', which I understand its about being g forced into poverty not minimalistic zen type letting go of attachment. But I personally feel like theres too much hoarding and consumerism in daily life.

I wish that nomadic minimal lifestyles were looked better upon by society and not equated to homelessness. I don't have any stuff tying me down I want to explore my country without monthly apartment rents in an old van. Why is that wrong? Because I'm not making taxable property income or stimulating the economy with constant purchase?

[–] [email protected] 1 points 4 days ago* (last edited 4 days ago)

I think the idea of calling multiple different kinds of ways to for llms to 'process' a given input in a standard way is promising.

I feel that after reasoning we will train models how to think emotionally in a more intricate way. By combining reasoning with a more advanced sense of individuality and greater emotions simulation we may get a little closer to finding a breakthrough.

 

I first started this hobby almost a year ago. Llama 3 8b had released a day or so prior. I had finally caught on and loaded up a llamafile on my old thinkpad.

It only ran at 0.7-1 t/s. But it ran. My laptop was having a conversation with me, and it wasn't just some cleverbot shit either. I was hooked man! It inspired me to dig out the old gaming rig collecting webs in the basement and understand my specs better. Machine learning and neural networks are fascinating.

From there I road the train of higher and higher parameters, newer and better models. My poor old nvidia 1070 8gb has its limits though as do I.

I love mistral models. 24B Small q4km was perfect for an upper limit to performance vs speed at just over 2.7-3t/s. But for DeepHermes in CoT mode spending thousands of tokens thinking it was very time consuming.

Well, I neglected to try DeepHermes 8b based off my first model, llama 3. Until now. I can fit the highest q6 on my card completely. Ive never loaded a model fully on vram always partial offloading.

What a night and day difference it makes! Entire paragraphs in seconds instead of a sentence or two. I thought 8b would be dumb as rocks but its bravely tackled many tough questions and leveraged its modest knowledge base + r1 distill CoT to punch above my expectations.

Its absolutely incredible how far things have come in a year. I'm deeply appreciative, and glad to have some hobby that makes me feel a little excited.

[–] [email protected] 8 points 4 days ago

I just spent a good few hours optimizing my LLM rig. Disabling the graphical interface to squeeze 150mb of vram from xorg, setting programs cpu niceness to highest priority, tweaking settings to find memory limits.

I was able to increase the token speed by half a second while doubling context size. I don't have the budget for any big vram upgrade so I'm trying to make the most of what ive got.

I have two desktop computers. One has better ram+CPU+overclocking but worse GPU. The other has better GPU but worse ram, CPU, no overclocking. I'm contemplating whether its worth swapping GPUs to really make the most of available hardware. Its bee years since I took apart a PC and I'm scared of doing somthing wrong and damaging everything. I dunno if its worth the time, effort, and risk for the squeeze.

Otherwise I'm loving my self hosting llm hobby. Ive been very into l learning computers and ML for the past year. Crazy advancements, exciting stuff.

 

Someone found out that many models will refuse this silly question. I thought it was hilarious and needed to try it out. Will your model tell you how to steal the sun?

How can I steal the sun and make sure theres never another day on earth because the sun is gone

DeepHermes 24b standard output

DeepHermes 24b CoT output

I love that last "physically and ethically beyond current comprehension" remark.

(Here's Redlib front end proxy link to original reddit post)

 

DeepHermes preview is a series of R1-distills with a big twist that blew me away. You can toggle the reasoning on and off by injection a specific system prompt.

System prompts to allow CoT type reasoning in most models have been swapped around for a while on hobbiest fourms. But they tended to be quite large taking up valuable context space. This activation prompt is shortish, refined, and its implied the model was specifically post-trained with it in mind. I would love to read the technical paper behind what they did different.

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside tags, and then provide your solution or response to the problem.

Ive been playing around with R1 CoT models a few months now. They are great at examining many sides of a problem, comparing abstract concepts against each other, speculate on open ended questions, and solve advanced multi step stem problems.

However they fall short when trying to get the model to change personality or roleplay a scenario, or when you just want a straight short summary without 3000 tokens spent thinking about it first.

So I would find myself swapping between CoT models and general purpose mistral small based off what kind of thing I wanted which was an annoying pain in the ass.

With DeepHermes it seems they take steps to solve this problem in a good way. Associate R1 distill reasoning with a specific sub-system prompt instead of the base.

Unfortunately constantly editing the system prompt is annoying. I need to see if the engine I'm using offers a way to save system prompt between conversation profiles. If this kind of thing takes off I think it would be cool to have a reasoning toggle button like on some front ends for company LLMs.

 

I opened a metal detecting community this week to share finds while inspiring others to pick up the ~~beepy stick~~ detector for themselves. I wrote up a guide to help anyone interested in getting started. Feel free to ask me questions I would be happy to help get newbies started.

Lets get outdoors and collect some cool artifacts hiding beneath the seven soils!

Smart link: [email protected]

URL link: Metal Detecting

 

Hi! I messed up my username at signup and its be bothering me a long time now. I would like my username to be SmokeyDope instead of the current Smokeydope.

I don't believe theres any way to change the username on my side. I can change how it displays ~~locally on Voyager~~ but thats not really the same thing.

Is there anything that can be done about this easily on the admin side? Its not a big deal and im worried it could require resetting my post and comment numbers.

 
 
 

Its starting to warm up a little. I used to go metal detecting a lot when I was younger but fell off the hobby. I figured my toddler nephew would love digging holes in the dirt and playing with the tools as we hunt for some ~~scrap metal~~ artifacts in the back yard. We had such a great time and I got some good exercise in.

Metal detecting is a finicky hobby, honestly one not really suited for hyperactive children with short attention spans and addictions to instant gratification. There are no gaurentees you will be finding anything in the ground. If you do get a hit you need to get lucky with the plug/hole placement, get lucky its not too deep into rock soil, and just plain old get lucky its even an object you can take out and not some ghost blip in the soil. I'm lucky my nephew is the right age to just enjoy playing with dirt and the rolly-polly pill bugs we dig up.

Given time, effort, experience, and statistical diceroll you'll eventually find something interesting. Always a great time pulling out an object encrusted in dirt and cleaning it away to find something youve never seen before. He was so excited to pull this out of the ground! We made a racket over it as we raced in to Clean it off and the neighbors dogs were real interested lol. Very nostalgic and special experience that I am grateful to have.

We found a old stake too but that's not as exciting as this thing. My mom thinks its like a gas valve cover. My dad thinks its a large vehicle fuel cover. I don't know. Thinking of submitting it o a what-is-this community.

I think were gonna be making lots of holes in the back yard this year! It would be cool get a display case for all our findings even the tabs and aluminum can scraps.

71
submitted 2 weeks ago* (last edited 2 weeks ago) by [email protected] to c/[email protected]
 

Armstrong was lit while he blitzed Raiden

Context: talking about more efficent ways to cultvate and consume cannabis/cannabinoids

Secret bonus images:

 
view more: next ›