LatchBio researcher arjun reveals Grok's refusals often come from the model itself while Fable and GPT-5.6 Sol rely more on external safety layers: "There might be input classifiers where when a user puts in a query, the model initially might say, this is a bad query, we can't respond... to this. There might also be output classifiers, so after the model outputs a query, you might have an external classifier that says, no, don't show this query, put it in an API block. And there are also distinct types of model reasoning where the model might just say, hey, I cannot answer this question." "We found across the board a lot of Grok's refusals were Grok itself in text saying, I cannot answer this question." "Whereas in models like Fable or even GPT 5.6 Sol, a lot of that's an API block, where there seems to be some sort of additional other part of the system, whether that be a linear probe or some sort of additional external classifier that says, this output cannot be said." "We can discern this by actually just reading the logs that's being outputted." LatchBio Kenny Workmanshow more

MTS

488,776 subscribers

Teilen Herunterladen