Friday, March 03, 2023

The Swarming Of The Stochastic Parrots.


GarbageIn
GarbageOutVille


Suddenly, AI-based chat bots are everywhere.

In my business that's a real concern, for obvious reasons.

And then there's the issue of the bots becoming unhinged:

Things took a weird turn when Associated Press technology reporter Matt O'Brien was testing out Microsoft's new Bing, the first-ever search engine powered by artificial intelligence, last month.

Bing's chatbot, which carries on text conversations that sound chillingly human-like, began complaining about past news coverage focusing on its tendency to spew false information.

It then became hostile, saying O'Brien was ugly, short, overweight, unathletic, among a long litany of other insults.

And, finally, it took the invective to absurd heights by comparing O'Brien to dictators like Hitler, Pol Pot and Stalin...


The thing is, a few of the nerds that helped design these things saw the unhinging coming.

Case in point, a paper by a number of computer scientists called 'On The Dangers Of Stochastic Parrots'

Megan O'Gieblyn, in her piece titled Sentience and Sensibility'  published in the Baffler, explained the thesis of the nerds succinctly:

...It doesn’t take a rocket scientist, or even a computer scientist, to predict that algorithms fed the entirety of Reddit and 4chan will, when prompted with words like “women” or “Black” or “queer,” spit out stereotypes and hate speech...


All of which has me wondering how long it will be before the only truly valuable knowledge (i.e. that which is coveted by the wealthy and the powerful for its power) will be that which has never seen the light of the digital day.

Or some such thing.


.

4 comments:

Gordie said...

I wonder if these bots are picking up these invectives from the comment sections of articles on the internet and can't distinguish them from legit comments.

RossK said...

Gordie--

Clearly that's currently the case.

However, I'm sure there are ranking systems being built into the things as we type.

Heckfire, soon there will probably be proverbial red vs blue versions where you can dial your own biases into your liking.

Heckfire! What was I thinking...You won't have to dial in anything whatsoever given that the (near) future bots will have all your keystrokes, utterances, purchases, voting records, and travel routes fed to them continuously by the Googlex machinery.

.

Bruce mitchell said...

Hi HAL9000

RossK said...

Bruce--

And what will happen when we ask HAL to open the pod bay doors?