NEW: malware developers added nuclear & biological weapons text to to their spyware.
Goal? To trigger LLM safety refusals... so that their spyware wouldn't be analyzed by an AI security scanner.
Cleanest practical example I can think of for why over-indexing on first order safety alignment is risky.
When closed (and open) models ship with aggressive refusals, they will be sprinkled with second-order blindspots that attackers will discover...and exploit.
We are only in the earliest days of attackers leveraging these features, and it wouldn't surprise me if users systems that need to handle complex cybersecurity issues demand that models be less safety-blunted.
In the weeds: @SocketSecurity's post also shows why intention matters in how you design a malware analysis pipeline to avoid prompt manipulation.
H/T to colleagues that shared this with me socket.dev/blog/mini-shai-hu…
ライブ入力いいらしいってんで、google ime から mozkey に変えてみた。
ベースが google ime とおなじなのでダメなら前とおなじ使いかたすればいいしね。
配布されてるのが windows のバイナリのみだったので久々にソースからビルドした。
github.com/koyasi777/mozkey
多少でも実用になりそうなので local llm 用のマシンが欲しくなってきた。
無難にいくなら M5 Pro にメモリ128GB とかなんだろうけど、やっぱ NVIDIA Spark がロマンあるよな。
Ryzen AI Max にもっとつよつよハイエンドモデル出してくれるなら x86 でつぶしが効くのでそっちがいいけど。