brucethemoose

joined 1 year ago
1
submitted 10 minutes ago* (last edited 7 minutes ago) by [email protected] to c/[email protected]
 

This is one of the "smartest" models you can fit on a 24GB GPU now. It feels big and insightful, like a better (albeit dry) Llama 3.3 70B with thinking, and with a bit more world knowledge than QwQ 32B, but comfortably fits thanks the new exl3 quantization!

Quantization Loss

You need to use a backend that support exl3, like (at the moment) text-gen-web-ui or (soon) TabbyAPI.

[–] [email protected] 1 points 42 minutes ago* (last edited 41 minutes ago)

“Just an organizational problem” is a hell of a problem though.

We’d already be transcendent if it weren’t for that little thing, heh.

Organization aside, it’s also (IMO) a productivity issue without enough automation to take care of elders, or good enough healthcare to keep them “young.” Unless you want to force old people to work.

[–] [email protected] 2 points 46 minutes ago* (last edited 45 minutes ago) (1 children)

Open borders are good because they balance age demographics between countries that skew too old, and poorer countries struggling to support massive birthrates. It gives the immigrants opportunity, their relatives back home wealth, and the “host” country young productivity. It also ties countries together culturally.

I’m not sure where you’re going with that.

And on automation, another big problem is just… enshittification. It’s like we’ve burned all these efficiency gains with horrendous systems, with workers grinding away doing basically nothing useful.

Runaway capitalism 100% did that. It also diverts so much production to be wasted by billionaires.

…But, like, mass communism wave could still have similar problems, minus the billionaires. Lots of other systems would too, depending on where you look.

I think a lot of society just needs to be “simplified” and more a-la-carte instead of ideologically driven. I often cite TSMC as an example, which shifted between straight up despotic, state sponsored socialism, democratic capitalism with a lot of private investment, and stuff in between (mixed with a lot of international cooperation) to get to a kind of “best case” where they are today. Could do better, of course (maybe as a worker/researcher owned coop?)

…I’m going way off topic though.

[–] [email protected] 3 points 1 hour ago* (last edited 44 minutes ago)

Yeah, there’s an extremely unfortunate intersection with a very bad line of thinking, polluting the argument.

If those eugenics guys really cared, they wouldn’t be trying to firebomb immigration, parent welfare, or wealth redistribution to young people. They just want to purge ‘others’ like a WH40K meme.

[–] [email protected] 9 points 1 hour ago* (last edited 59 minutes ago) (5 children)

Hard disagree.

This video (from kurzgesagt) completely changed my perspective: https://youtu.be/Ufmu1WD2TSk

For this exact reason cited in the OP article.

But the bigger problem with Walsh’s argument is that it only makes sense if you care about the quantity of human life more than the quality of human life.

The video illustrates it better than I can, but basically, underpopulation is societally destabilizing and makes people miserable. It reduces quality of life.

It works if we live in a utopian future where people are living longer working lives, staying young longer, automation is reducing job loads, governments are smart, immigration is free and open, global warming isn’t a looming crisis, AI will solve all sorts of problems…

But we don’t.

In the near term, we need a big mass of young people to take care of retired people, otherwise those young people are utterly miserable because they have to work their butts off to support a huge retired population. Again, you can wave your hands and say “automation! immigration! reduced hours!” but that fantasy is clearly not where the world is headed to. Technology is much closer to addressing overpopulation issues, and then we can worry about plateauing birthrates once we got robot butlers taking care of our elders and making their stuff.

The US hasn’t dealt with this because we are privileged enough to have a massive influx of immigrants (who skew young), but we are royally screwing that up.

I despise how this article tries to write it off as an ideological belief, like you’re a Musk loving fool for thinking this.

…I realize I’m probably posting this in the wrong sub. And I’d love to be wrong, but that article is not selling it for me.

[–] [email protected] 2 points 1 hour ago* (last edited 1 hour ago)

Chatbots are text completion models, improv machines basically, so they don’t really have that ability. You could look at logprobs I guess (aka is it guessing a bunch of words pretty evenly?), but that’s unreliable. Even adding a “I don’t know” token wouldn’t work because that’s not really trainable into text datasets: they don't know when they don’t know, it’s all just modeling what next word is most likely.

Some non-autoregressive architectures would be better, but unfortunately “cutting edge” models people interact with like ChatGPT are way more conservatively developed than you’d think. Like, they’ve left tons of innovations unpicked.

[–] [email protected] 18 points 6 hours ago* (last edited 6 hours ago) (1 children)

The memo says the Defense Department is returning to the Biden-era medical policy for transgender service members due to a court order that struck down Hegseth’s restrictions as unconstitutional. The administration is appealing the move, but a federal appeals court in California denied the department’s effort to halt the policy while its challenge is pending.

So the court ordered them too.

The article is making it out like the DoD is "defying" Hegseth, but that seems like a misrepresentaion, as it seems he has to go along with this.

I guess it's a "win" because the DoD isn't openly defying an order...

[–] [email protected] 13 points 6 hours ago* (last edited 6 hours ago)

Yeah, that's the thing. Even if you buy the idea of Trump's policies (which TBH have a few grains of truth), the implementations of them are so full of nonsense. Like, ok, get Canada into the US, let's just roll with that for the sake of argument... It might make Canada and the US stronger, like the openness between the states does. It would consolidate many federal functions. Canda could retain their culture like individual states do. Sounds plausible.

...And your plan is to get them to join as one state, and only if they grovel to you, by harassing them on Twitter, offering zero details? Like, what world is he living in?

[–] [email protected] 3 points 6 hours ago* (last edited 6 hours ago)

Oh yeah, its more than that. Low weight helps acceleration, braking (so safety), handling, range, wear on every component, and most of all, cost. The same sized tires will need less pressure, wear much less, and grip harder. If the car is lighter, you don't need as stiff a chassis, nor as much braking to lock the wheels, less battery, motor, which means you can take even more weight off the car... You get where I'm going.

Racecars are fast because they are light, not because they have big engines and expensive bodies. Little 1500lb cars can lap a $3 million 1500hp (and quite heavy, because of all the stuff in it) Bugatti around a track.

Heavy cars can handle OK, but the cost is big.

[–] [email protected] 54 points 6 hours ago* (last edited 6 hours ago)

So... where is that outrage from preppers and gun enthusaists of the government barging into their homes?

Can you image if Biden, Obama, or even Bush did this?

There would literally be a massive armed mob outside the White House.

Turns out guns are useless in the face of propaganda, I guess.

[–] [email protected] 2 points 6 hours ago

Robinson declined to release her name or age, only confirming that she has been in the U.S. about six years, but has no legal status. Her daughters were born in the U.S. Their father lives in Detroit.

[–] [email protected] 5 points 10 hours ago* (last edited 10 hours ago) (3 children)

+1

Weight is everything. Removing it makes almost literally every aspect of a car better, and it’s usually a terrible negative for EVs.

[–] [email protected] 5 points 22 hours ago* (last edited 22 hours ago) (1 children)

I think OP means "the mediocre, least bad intersection between critical mass and topical discussion."

Like, you can probably find users/subs about universities/fields and actually find people in them to respond. Lemmy is great, but good luck finding a mass of discussion around a niche location/field.

Reddit is horrible and deteriorating, yes, but still.

 

The U.S. expects Ukraine's response Wednesday to a peace framework that includes U.S. recognition of Crimea as part of Russia and unofficial recognition of Russian control of nearly all areas occupied since the 2022 invasion, sources with direct knowledge of the proposal tell Axios.

What Russia gets under Trump's proposal:

  • "De jure" U.S. recognition of Russian control in Crimea.
  • "De-facto recognition" of the Russia's occupation of nearly all of Luhansk oblast and the occupied portions of Donetsk, Kherson and Zaporizhzhia.
  • A promise that Ukraine will not become a member of NATO. The text notes that Ukraine could become part of the European Union.
  • The lifting of sanctions imposed since 2014.
  • Enhanced economic cooperation with the U.S., particularly in the energy and industrial sectors.

What Ukraine gets under Trump's proposal:

  • "A robust security guarantee" involving an ad hoc group of European countries and potentially also like-minded non-European countries. The document is vague in terms of how this peacekeeping operation would function and does not mention any U.S. participation.
  • The return of the small part of Kharkiv oblast Russia has occupied.
  • Unimpeded passage of the Dnieper River, which runs along the front line in parts of southern Ukraine.
  • Compensation and assistance for rebuilding, though the document does not say where the funding will come from.

Whole article is worth a read, as it’s quite short/dense as Axios usually is. For those outside the US, this is an outlet that’s been well sourced in Washington for years.

 

Seems there's not a lot of talk about relatively unknown finetunes these days, so I'll start posting more!

Openbuddy's been on my radar, but this one is very interesting: QwQ 32B, post-trained on openbuddy's dataset, apparently with QAT applied (though it's kinda unclear) and context-extended. Observations:

  • Quantized with exllamav2, it seems to show lower distortion levels than nomal QwQ. Its works conspicuously well at 4.0bpw and 3.5bpw.

  • Seems good at long context. Have not tested 200K, but it's quite excellent in the 64K range.

  • Works fine in English.

  • The chat template is funky. It seems to mix up the and <|think|> tags in particular (why don't they just use ChatML?), and needs some wrangling with your own template.

  • Seems smart, can't say if it's better or worse than QwQ yet, other than it doesn't seem to "suffer" below 3.75bpw like QwQ does.

Also, I reposted this from /r/locallama, as I feel the community generally should going forward. With its spirit, it seems like we should be on Lemmy instead?

 

So I had a clip I wanted to upload to a lemmy comment:

  • Tried it as an (avc) mp4... Failed.
  • OK, too big? I shrink it to 2MB, then 1MB. Failed.
  • VP9 Webm maybe? 2MB, 1MB, failed. AV1? Failed.
  • OK, fine, no video. Lets try an animated AVIF. Failed. It seems lemmy doesn't even take static AVIF images
  • WebP animation then... Failed. Animated PNG, failed.

End result, I have to burden the server with a massive, crappy looking GIF after trying a dozen formats. With all due respect, this is worse than some aging service like Reddit that doesn't support new media formats.

For reference, I'm using the web interface. Is this just a format restriction of lemmy.world, or an underlying software support issue?

 

53% of Americans approve of Trump so far, according to a newly released CBS News/YouGov poll conducted Feb. 5 to 7, while 47% disapproved.

A large majority, 70%, said he was doing what he promised in the campaign, per the poll that was released on Sunday.

Yes, but: 66% said he was not focusing enough on lowering prices, a key campaign trail promise that propelled Trump to the White House.

44% of Republicans said Musk and DOGE should have "some" influence, while just 13% of Democrats agreed.

41
submitted 3 months ago* (last edited 3 months ago) by [email protected] to c/[email protected]
 

Here's the Meta formula:

  • Put a Trump friend on your board (Ultimate Fighting Championship CEO Dana White).
  • Promote a prominent Republican as your chief global affairs officer (Joel Kaplan, succeeding liberal-friendly Nick Clegg, president of global affairs).
  • Align your philosophy with Trump's on a big-ticket public issue (free speech over fact-checking).
  • Announce your philosophical change on Fox News, hoping Trump is watching. In this case, he was. "Meta, Facebook, I think they've come a long way," Trump said at a Mar-a-Lago news conference, adding of Kaplan's appearance on the "Fox and Friends" curvy couch: "The man was very impressive."
  • Take a big public stand on a favorite issue for Trump and MAGA (rolling back DEI programs).
  • Amplify that stand in an interview with Fox News Digital. (Kaplan again!)
  • Go on Joe Rogan's podcast and blast President Biden for censorship.
17
submitted 3 months ago* (last edited 3 months ago) by [email protected] to c/[email protected]
 

Taboola's data, shared exclusively with Axios, shows Musk has outpaced his closest peers — Jeff Bezos and Mark Zuckerberg — for years, but the gap widened dramatically in 2024.

The spam is already exponential. :(

379
submitted 3 months ago* (last edited 3 months ago) by [email protected] to c/[email protected]
 

Reality check: Trump pledged to end the program in 2016.

Called it. When push comes to shove, Trump is always going to side with the ultra-rich.

 

Trump, who has remained silent thus far on the schism, faces a quickly deepening conflict between his richest and most powerful advisors on one hand, and the people who swept him to office on the other.

All this is stupid. But I know one thing:

Trump is a billionaire.

And I predict his followers are going to learn who he’ll side with when push comes to shove.

Also, Bannon’s take is interesting:

Bannon tells Axios he helped kick off the debate with a now-viral Gettr post earlier this month calling out a lack of support for the Black and Hispanic communities in Big Tech.

 

I think the title explains it all… Even right wing influencers can have their faces eaten. And Twitter views are literally their livelihood.

Trump's conspiracy-minded ally Laura Loomer, New York Young Republican Club president Gavin Wax and InfoWars host Owen Shroyer all said their verification badges disappeared after they criticized Musk's support for H1B visas, railed against Indian culture and attacked Ramaswamy, Musk's DOGE co-chair.

 

I have no idea if anyone on Lemmy is into Avatar lore/fanfiction, but in the spirit of posting content here instead of Reddit... here goes.


A new Avatar series featuring 'twin' Avatars has been leaked, in case you missed it:

https://knightedgemedia.com/2024/12/avatar-seven-havens-twin-earth-avatar-series-will-initially-be-26-episodes-long/

https://lemmy.world/post/23427458

In a nutshell, its allegedly set in a cataclysmic world overrun by spirit vines, and two twins are the 'Avatars' with diametric personalities. Not much is known beyond that, but I've been brainstorming some post-LoK ideas forever.

And now I kinda feel like writing them out. Here's my thought dump for a story:


In the (largely undepicted) three years of canon Korra Alone, Korra (traveling anonymously) makes a stop on Kyoshi Island hoping to reconnect with her spirit. Instead, she meets a humble blacksmith with a bird spirit on his shoulder, and connects with him. They both wrestle with the demons haunting them, and they discover secrets on the island from Kyoshi's era.

Korra dies in 190 AG (at 37), already weakened from her metal poisoning, saving the world froma a cataclysm that leaves much of the world overgrown.

Intially, the story jumps between this period in Korra Alone (174AG) and 206 AG, where Asami Sato is struggles to steer Future Industries in a world dominated by megacorps in the safe 'havens' dotted through the world. While Kyoshi Island has barely changed at all, the 'future' thread has a more cyberpunk feel. Chi based cybernetics are commonplace, but the more augmented someone is, the more their bending is compromised, and bender vs nonbender tensions flare up once more. The world outside the safe havens is a dangerous wasteland. Tech derived from studying spirits has let to the proliferation of holograms, BCIs, and even primitive assistants and virtual environments, and advances in power storage/generation already seen in LoK mean everything is largely electric. Yet the world is still "analog," with tube radios and TVs, no digital electronics, and 'dumb' virtual assistants that are error-prone and incapable of math, giving it a retro feel. There are no guns, of course, but personal weapons like arc casters, flamethrowers, cryo blasters and such all mimic bending.

The Sei'naka clan has risen to power in the Fire Nation, taking advantage of the aftermath of the 100 Years War, the Red Lotus Insurrection, Future Industry's relative benevolence, and even the recently calamity. Now a ruthless corporation bigger than Future Industires, they dominate business and politics wherever they expand.

The White Lotus's search for the Avatar has failed. Asami rather infamously misidentified the Avatar... until one day, she find them.


Once this background is established, the story jumps back to our inseparable twin Avatars, Pavi and Nisha, born deep in the Foggy Swamp. Thanks to their predecessor, they live a harmonious, largely isolated life as members of the Foggy Swamp Tribe on the back of a water Lion Turtle. To her utter shock, they manage to manifest Korra at nine, withh Past Life Korra appearing as a nine-year-old. Dumbfounded, not even sure who the 'real' Avatar is, the girls assume she is just another spirit in the swamp. So Korra makes the decision to go along with this, and let them have a childhood she never had under the White Lotus as she figures out just what's going on with the twin Avatars.

Ultimately, the real world comes crashing into the new Avatars' isolated life, and they react poorly to Korra telling them the truth at 16. Through some more disasters and tragedies, they end up on the streets of Republic City, separated for a time, before meeting friends. The rest of the story revolves around corporate and personal greed (very much like the real wo9rld), conflict (and synergy) between the environment/spirits and technology, rivalries, family, friends across lifetimes, the nature of consciousness, reincarnation and the soul, and a conspiracy going all the way back to Kuruk threading through everything.


Some character profiles I'm working on:

  • Priya: Independent, kind, and resourceful. Priya is a reluctant hero who avoids altercations or fighting, but still believes in helping people using her creativity and wits. She's a talented musician and loves to make up songs with her taanbur (guitar-like instrument). Priya lost most of her leg in an accident from a fallen tree that killed her parents in the Foggy Swamp, but bends roots and muddy water as if they were her own limb. Its eventually revealed that she carries Raava. Once she finds out, Priya in particular is reluctant to accept her role as the Avatar, until a tragedy forces her hand.

  • Nikki is more snarky. She loves her powers and the attention it affords her, but her biggest fear is to be forgotten or not accepted by others. Nikki is awkward but puts on a face of superior confidence to hide the fact that she feels like a fish out of water. Despite her cocky attitude, Nikki is also an innovator, and her wild side is useful at times. Like her sister, she's highly attuned to the swamp, able to connect to and even manifest the collective memories of lost loved ones by touching spirit vines in the swamp. Both are apparently waterbenders with a proclivity for mud. Its eventually revealed that she carries Vaatu inside her. Nikki is missing part of her arm, but bends as a replacement, much line Ming-Hua.

  • Korra: Largely as she is in LoK. Hot blooded, quick to fight, passionate, empathetic, and not very spiritual. In a reversal of roles, Priya and Nikki keep her manifested constantly, and Korra becomes their best friend, learing about thier life in the Foggy Swamp. Later in the story, Korra's almost like a Johnny Silverhand to the new Avatars: manifested at will, a voice constantly in thier heads offering commentary, occasionally butting heads with them in a complex but close and encouraging relationship.

  • Asami Sato: Largely as she was in LoK, driven, collected, strong, smart, loyal. Now she's fifty, with a cybernetic leg from an accident. Asami still altruistic, and retained control of Future Industries through the years, but struggles with pushback from a corporate world driven by expansion and greed, and ultimately has to grapple with some of what her own company has done under her nose.

  • Mako: Largely as he was, brooding, cool, a noir-like detective. Recently retired as police chief, and has been secretly piecing together the conspiracy running through the plot.

  • Ren: The blacksmith Korra meets on Kyoshi Island. Softspoken, painfully shy, air headed and ADD, stocky and green-eyed, Ren nonetheless has a dry wit. He's self depreciating to a fault, but has a soft heart. To Korra's utter shock, Ren is a metalbender and a lavabender, using the combination to effortlessly sculpt armor and weapons, and tinker with delicate electronics. He's terrified of lightning, with a massive scar covering his back that flares up in storms or when anxious. Almost as broken as Korra is at the start, Ren reveals that his father's ancestors were lavabending miners and blacksmiths in the Hundred Years War. His past is initially shrouded in mystery, but its slowly revealed that his mother is the scientist who originally conceived of spirit vine technology, and that Varrick only replicated some of her work. Ren's mom has an 'Oppenheimer moment' and defects from Kuvira's proto Earth Empire. Ren ends up as the only survivor, deeply scarred from a spirit vine "detonation" similar to the LoK finale, that fused his soul to his body, and he's hiding from warlords hunting him for what he knows. Through the story, he grows particularly close to Asami and Korra, and grapples with some of the technology he pioneers.

  • Kaida: CTO of Future Industries, Kaida is the biological daughter of Korra and Ren, who both died when she was 11. Utterly tenacious, hot-blooded, fearless, and a fierce fighter like her mom, Kaida barges into the story literally melting the metal floor in front of reporters harassing her 'mom,' Asami. Fiercely intelligent, impulsive, but with some of her dad's air-headedness, introversion, and love of tinkering with technology, Kaida is almost constantly clad in meteor-metal alloy plate armor she wears as a second skin. She favors a jian, like Korra learned to use on Kyoshi Island. Kaida a talented engineer, but struggles with the tremendous legacy she's been thrust into.

  • Yuri Sei'naka: One of many vying for supremacy in the Sei'naka family, Yuri resembles Azula; A charismatic leader with a ruthless streak, an obsession with perfection, and a fantastically talented firebender, she has Azula's the same sharp yellow eyes and features. Like her twin brother, Yoru, Yuri chose the 'hard' path of bending over advanced cybernetics the wealthy have access too. Nevertheless, she has a good moral compass, and is unconditionally loyal to her brother.. The siblings have an intense rivalry with Kaida, just as thier company rivals Future Industries.

  • Yoru Sei'naka: A firebending and lightning bending prodigy and a cunning strategist, Yoru is mute, having lost his ability to speak in a sparring accident as a kid. Yoru and Yuri are practically inseperable, with Yuri serving as his voice. Tasked with tracking down the unkown Avatar by the matriarch of the clan, and always beholden to his intense sense of honor, Yoru suffers through a tragic 'Zuko' arc through the story.

spoiler

  • Father Glowworm: The ancient spirit survived the death of Yun, and is an ever-present invisible hand through the story, albeit with a newfound distate for humans. The swamp, taboo spirit vine technology, and just how he tunnels between worlds will all tie into crises Priya and Nikki must navigate.

  • I'm still working on other antagonists, but there will be a warlord who tries to capture Ren on Kyoshi Island, a ruthless corporate matriarch of the Sei'naka dynasty (Natsu?), a charismatic rebel like something between Amon and Zaheer, and more. I'm also thinking on a blind airbending thief who rejected his rich family, and a loud, warm Sun Warrior whos people have resettled in Republic City, and an introverted netrunner-like hacker as companions for the Avatar.


  • Other thoughts:

    • I don't like some 'leaked' aspects of the upcoming show, like the twin Avatars being nine and the White Lotus being so involved and 'problematic.' I'd much rather have the twin Avatars be lost, ignorant of thier own nature in the Foggy Swamp because they appear to be waterbenders with a proclivity for mud.

    • On that note, stealing the idea from here, maybe Priya can only bend air and water, while Nikki can only bend earth and fire, reflecting the split of their spirits and personalities.

    • Remnants of the Northern and Southern Water Tribes have drifted to political extremes.

    • The 'wasteland' is populated by spirits, and human opportunists looking to brave it.

    • The Avatars' monkey cat companion is a spirit they befriended in the forest.

    • Spirit Vine technology is taboo and effectively 'lost' after the calamity.

    • The Avatars' Tribe lives atop a Lion Turtle the swamp hid for millenia.

    • The 'nature' of the Foggy Swamp is expanded. For instance, in one chapter, Priya and Nikki manifest and talk to respresentations of their parents, built from the collectively memory of everyone who ever knew them, all connected though vines. It brings up existential questions in Korra's head, and parallels with some of the spirit-based technology the rest of the world has developed.


    ...So, those are my scattered thoughts so far.

    Does that sound like a sane, plausible base for a post-LoK story? Do you think any of it would fit into canon? I particularly like the idea of a 'metal lavabending' canon companion, and maybe some more futuristic elements in the havens that do exist.

    view more: next ›