LocalLLaMA

2854 readers

23 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

Smokeydope@lemmy.world

MonsterBug@sh.itjust.works

Is there a German 7B Vision Model? (swg-empire.de)

submitted 1 month ago* (last edited 1 month ago) by bjoern_tantau@swg-empire.de to c/localllama@sh.itjust.works

3 comments fedilink hide all child comments

I'd like something to describe images for me and also recognise any text contained in them. I've tried llama3. 2-vision, llava and minicpm-v but they all get the text recognition laughably wrong.

Or maybe I should lay my image recognition dreams to rest with my measly 8 GB RAM card.

Edit: gemma3:4b is even worse than the others. It doesn't even find the text and hallucinates others.

top 3 comments

sorted by: hot top controversial new old

[–] Boomkop3@reddthat.com 3 points 1 month ago (1 children)

Perhaps a multi stage approach is a better idea? Find a model that's exclusively for optical character recognition, then feed it's output into an llm

[–] bjoern_tantau@swg-empire.de 2 points 1 month ago (1 children)

Why didn't I think of this? granite3.2-vision seems to do the trick, even though it doesn't know the German letter ß. But I can live without that.

Thanks!

[–] Boomkop3@reddthat.com 1 points 1 month ago* (last edited 1 month ago)

I can't you why you didn't. But I can tell you a trick to come up with better ideas: force yourself to come up with 10 ideas, no matter how stupid. Then only filter them once you're done.

This causes you to take less mental shortcuts. And you end up with better results (usually) at the cost of more mental effort/energy