this post was submitted on 22 Aug 2023
770 points (95.8% liked)

Technology

68918 readers
4108 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

OpenAI now tries to hide that ChatGPT was trained on copyrighted books, including J.K. Rowling's Harry Potter series::A new research paper laid out ways in which AI developers should try and avoid showing LLMs have been trained on copyrighted material.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 25 points 2 years ago (2 children)

AI/LLMs can train on whatever they want but when then these LLMs are used for commercial reasons to make money, an argument can be made that the copyrighted material has been used in a money making endeavour.

And does this apply equally to all artists who have seen any of my work? Can I start charging all artists born after 1990, for training their neural networks on my work?

Learning is not and has never been considered a financial transaction.

[–] [email protected] 5 points 2 years ago* (last edited 2 years ago) (1 children)

Actually, it has. The whole consept of copyright is relatively new, and corporations absolutely tried to have people who learned proprietary copyrighted information not be able to use it in other places.

It's just that labor movements got such non-compete agreements thrown out of our society, or at least severely restricted on humanitarian grounds. The argument is that a human being has the right to seek happiness by learning and using the proprietary information they learned to better their station. By the way, this needed a lot of violent convincing that we have this.

So yes, knowledge and information learned is absolutely withing the scope of copyright as it stands, it's only that the fundamental rights that humans have override copyright. LLMs (and companies for that matter) do not have such fundamental rights.

Copyright by the way is stupid in its current implementation, but OpenAI and ChatGPT does not get to get out of it IMO just because it's "learning". We humans ourselves are only getting out of copyright because of our special legal status.

[–] [email protected] 2 points 2 years ago (2 children)

Ehh, "learning" is doing a lot of lifting. These models "learn" in a way that is foreign to most artists. And that's ignoring the fact the humans are not capital. When we learn we aren't building a form a capital; when models learn they are only building a form of capital.

[–] [email protected] 5 points 2 years ago (2 children)

Artists, construction workers, administrative clerks, police and video game developers all develop their neural networks in the same way, a method simulated by ANNs.

This is not, "foreign to most artists," it's just that most artists have no idea what the mechanism of learning is.

The method by which you provide input to the network for training isn't the same thing as learning.

[–] [email protected] 3 points 2 years ago (1 children)

Artists, construction workers, administrative clerks, police and video game developers all develop their neural networks in the same way, a method simulated by ANNs.

Do we know enough about how our brain functions and how neural networks functions to make this statement?

[–] [email protected] 2 points 2 years ago (1 children)

Do we know enough about how our brain functions and how neural networks functions to make this statement?

Yes, we do. Take a university level course on ML if you want the long answer.

[–] [email protected] 1 points 2 years ago

My friends who took computer science told me that we don't totally understand how machine learning algorithms work. Though this conversation was a few years ago in college. Will have to ask them again

[–] [email protected] 2 points 2 years ago (1 children)

ANNs are not the same as synapses, analogous yes, but different mathematically even when simulated.

[–] [email protected] 1 points 2 years ago

This is orthogonal to the topic at hand. How does the chemistry of biological synapses alone result in a different type of learned model that therefore requires different types of legal treatment?

The overarching (and relevant) similarity between biological and artificial nets is the concept of connectionist distributed representations, and the projection of data onto lower dimensional manifolds. Whether the network achieves its final connectome through backpropagation or a more biologically plausible method is beside the point.

[–] [email protected] 1 points 2 years ago (1 children)

When we learn we aren't building a form a capital; when models learn they are only building a form of capital.

What do you think education is? I went to university to acquire knowledge and train my skills so that I could later be paid for those skills. That was literally building my own human capital.

[–] [email protected] 1 points 2 years ago

Humanities and Art majors are often criticized for not producing such capital.