SB 1047 is a California state bill that would make large AI model providers – such as Meta, OpenAI, Anthropic, and Mistral – liable for the potentially catastrophic dangers of their AI systems.
Now this sounds like a complicated debate - but it seems to me like everyone against this bill are people who would benefit monetarily from not having to deal with the safety aspect of AI, and that does sound suspicious to me.
Another technical piece of this bill relates to open-source AI models. […] There’s a caveat that if a developer spends more than 25% of the cost to train Llama 3 on fine-tuning, that developer is now responsible. That said, opponents of the bill still find this unfair and not the right approach.
In regards to the open source models, while it makes sense that if a developer takes the model and does a significant portion of the fine tuning, they should be liable for the result of that…
But should the main developer still be liable if a bad actor does less than 25% fine tuning and uses exploits in the base model?
One could argue that developers should be trying to examine their black-boxes for vunerabilities, rather than shrugging and saying it can’t be done then demanding they not be held liable.
In regards to the open source models, while it makes sense that if a developer takes the model and does a significant portion of the fine tuning, they should be liable for the result of that…
This kind of goes against the model that open source has operated on for a long time, as providing source doesn’t represent liability. So providing a fine-tuned model shouldn’t either.
I didn’t mean in terms of providing. I meant that if someone provided a base model, someone took that, built upon it, then used it for a harmful purpose - of course the person modified it should be liable, not the base provider.
It’s like if someone took a version of Linux, modified it, then used that modified version for an illegal act - you wouldn’t go after the person who made the unmodified version.
Now this sounds like a complicated debate - but it seems to me like everyone against this bill are people who would benefit monetarily from not having to deal with the safety aspect of AI, and that does sound suspicious to me.
In regards to the open source models, while it makes sense that if a developer takes the model and does a significant portion of the fine tuning, they should be liable for the result of that…
But should the main developer still be liable if a bad actor does less than 25% fine tuning and uses exploits in the base model?
One could argue that developers should be trying to examine their black-boxes for vunerabilities, rather than shrugging and saying it can’t be done then demanding they not be held liable.
This kind of goes against the model that open source has operated on for a long time, as providing source doesn’t represent liability. So providing a fine-tuned model shouldn’t either.
I didn’t mean in terms of providing. I meant that if someone provided a base model, someone took that, built upon it, then used it for a harmful purpose - of course the person modified it should be liable, not the base provider.
It’s like if someone took a version of Linux, modified it, then used that modified version for an illegal act - you wouldn’t go after the person who made the unmodified version.
You wouldn’t necessarily punish the person that modified Linux either, you’d punish the person that uses it for a nefarious purpose.
Important distinction is the intention to deceive, not that the code/model was modified to be able to be used for nefarious purposes.