‘It’s too powerful a technology’
Can you think of a better term? I tried to clarify by saying, “thing that has internalized a ton of content that it can use to generate new content from”, but there’s not a succinct term for that. I would not call an LLM a mind, but I would say minds do this observe patterns->distill information->generate new patterns thing very well. So “mind-like” is all I could come up with.
legal definitions would only allow creativity to come from humans
That would be part of the ethical dilemma we will need to solve, which corporations will be on a very predictable side of. Our laws were written assuming that only humans were capable of creativity and consciousness (however linked, or not, the two might be).