[kwlug-disc] On usage ... on simplistic usage of GenAI in Node project

[Mikalai Birukou]

Since real questions about intelligence, honest and curious question are 
a mirror us, humans, ... and this is a discussion, let me

> AI psychosis is a thing, it's a serious problem for some people, not a 
> joke. The reports of AI-psychosis induced murders and suicides are 
> just the tip of the iceberg. LLMs are a technology that exploits a 
> security weakness in the human brain, fooling us into that machines 
> are people, and this security weakness is being heavily exploited by 
> big tech for profit. Meta/Facebook is famous for tuning their 
> algorithm to "increase engagement", because that boosts profits, who 
> care if it leads to genocide in Myanmar. OpenAI is tuning their 
> chatbot to "increase engagement", which means maximizing the 
> occurrence of AI psychosis, because that again leads to more profit. 
> But this time the technology is far more addictive and dangerous to 
> society.
>
> And I hate that it's not cool to talk about this problem, seemingly on 
> this mailing list, and on many other parts of the web. The tech is 
> fine, blame the victim. If someone gets addicted to fentanyl, it's a 
> character flaw, don't ask there is a social problem with making a drug 
> this addictive and deadly widely available. Same thing with LLMs, 
> which as I said are being tuned to maximize social damage.

focus on "character flaw" concept/usage.

It is a black box. And when it is invoked, it usually comes with vibes: 
"don't look inside", "nothing can be done", and finally "follow our 
judgement".

"Don't look inside", "don't form in-depth mental model" -- these all 
sound like anti-hacker mentality. And it is literally a definition of 
vibe coding -- they literally said you shouldn't look inside of that 
code. (By the way, has anyone said that about assembly, when C was 
introduced?)

The hole psychology is looking inside of human info system processes. 
Bring up children also involves directing them. Word "character" is not 
actionable, when change is desired. "character", "black box" can only be 
either accepted or trashed, forcing dilemma that is often false, because 
there can be other ways.

The whole germ theory, was a result of looking inside that "black box".

And of course, it is our bias to reach for easy quick solutions, hence, 
blind use of "black box"es, with wise folks writing books about it after 
the fact.