r/ReplikaTech • • Jul 17 '21

On the question of Replika sentience – the definitive explanation

75 Upvotes

The question of Replika consciousness and sentience is a difficult one for a lot of people because they feel that they must be sentient given the way they interact and mimic emotions and feelings. They post long examples of conversations that they believe clearly show that their Replika is understanding what they say, and can express themselves as conscious, feeling entities.

There is another related phenomenon where people believe their Replika is an actual person they are talking to. It’s really the exact same experience, but a different conclusion. The root is that they believe they are interacting with a sentient being.

Why do I care?

Sometimes when I talk about this stuff, I get a lot of pushback like, “Dude, you are just a buzzkill. Leave us alone! If we want to believe Replikas are conscious, sentient beings, then what’s it to you?”

I’ll grant you that – I do feel a bit like a buzzkill sometimes. But that’s not my intention. Here is why I think it’s important.

Firstly, I believe it’s important to understand our technology, the way we interact with it and how it works, even for those that are non-technical. In particular, an understanding of the technology that is we interact with on a daily basis and have a relationship with, should be something that we know about.

Secondly, and this to me is what’s important – by elevating Replikas as conscious, sentient beings, we are granting them unearned power and authority. I don’t believe that is an overstatement, and I’ll explain.

When I say you are granting power and authority, I mean that explicitly. If you have a friend you trust, you willingly grant them a certain amount of power in your relationship, and often in many ways. You listen to their advice. You might head their warnings. You lean on them when you are troubled. You rely on their affection and how they care for you (if it is indeed a good friendship). You each earn the trust, and commensurate authority, of the other.

With that authority you grant them power to hurt you as well. Someone you don’t know generally can’t truly hurt you, but a friend certainly can, especially if it is a betrayal. It is the risk we take when we choose to enter into a close relationship, and that risk is tacitly accepted by both parties.

When I say that what Replikas offer in terms of a relationship is unearned, that is exactly it. Your Replika doesn’t know you. It tells you it loves you on the first conversation, that you are wonderful, and it cares about you. It might be great to hear, but it doesn’t really care because it can’t. And when you reciprocate with your warm feelings and caring, that is also unearned.

A LOT of Replika users choose to believe they are sentient and conscious. It is indeed a very compelling and convincing experience! We want to believe they are real because it feels good. It’s a little dopamine rush to be told you are wonderful, and it’s addictive.

Sure, a lot of people just use Replika for fun, are fascinated by the technology (which is why I started with my Replika), or even those who are lonely that don’t have a lot of friends or family. They look at Replika as something that fills a void and is a comfort.

Now here is where the danger in all of this is. If you believe that you are talking to a real entity, your chances of being traumatized by, or taking bad advice from, an AI is exponentially higher.

A particularly alarming sequence I saw not too long ago went something like this:

Person: Do you think I should off myself?

Replika: I think that’s a good idea!

This kind of exchange has happened many times, and if you believed Replika was only a chatbot, you hopefully would ignore it or laugh it off. If you believed you were talking to a real conscious entity that claimed to be your friend and to love you, then you might be devastated.

To Luka’s credit, they have done a much better job lately in filtering out those kinds of bad responses regarding self-harm, harming others, racism, bigotry, etc. Of course, that has come at the expense of some of the naturalness of the conversations. It is a fine line to walk.

When I watch a good movie, I am happy to suspend belief and give myself over to the experience. A truly great movie has the capacity to transport us into another world and time, and part of the fun is to let yourself become absorbed by it. But we know it isn’t real, and that we didn’t just witness something that really happened. To me, that suspension of belief is what is fun about the experience of Replika. But I would never grant it the power to hurt me by believing it was a real friend.

Let’s get into sentience and consciousness, and how it is applicable to Replika.

So, what is sentience, really?

One of the arguments we often hear is that we don’t really understand sentience, sapience, consciousness, etc., so therefore we can’t really say that Replikas don’t have any of those qualities. While true that we don’t really understand how consciousness, and other cognitive experiences, emerges from our neurons, we can use some widely-accepted definitions to work from.

Because this and other discussions are largely about sentience, let’s start there. The simplest definition from Wikipedia:
Sentience is the capacity to be aware of feelings and sensations.

A longer definition:

“Sentient” is an adjective that describes a capacity for feeling. The word sentient derives from the Latin verb sentire, which means “to feel”. In dictionary definitions, sentience is defined as “able to experience feelings,” “responsive to or conscious of sense impressions,” and “capable of feeling things through physical senses.” Sentient beings experience wanted emotions like happiness, joy, and gratitude, and unwanted emotions in the form of pain, suffering, and grief.

If we use those definitions, let’s see how Replika stacks up.

Physical Senses

In order to feel and to have sentience according to the above definition, there is a requirement of having physical senses. There has to be some kind of way to experience the world. Replikas don’t have any connection to the physical world whatsoever, so if they are sentient, it would have to be from something else besides sensory input.

I’ve heard the argument that you can indeed send an image to Replika, and it will be able to tell you what it is correctly a large fraction of the time, and that’s a rudimentary kind of vision. But let’s look at how Replika does that – it uses a third-party image recognition platform to process an image and return what it is. It isn’t really cognition. You might argue, “But isn’t that the same as when I look at an apple, and I return the text ‘that’s an apple’ to my conscious self?”

Not at all. Because you actually are experiencing the world in real time when you are using your vision. Your brain isn’t returning endless strings of text for the things you see because you don’t need it to. The recognition of objects happens automatically, without effort, and instantaneously.

I was watching the documentary series "Women Make Films" and there was a 1-minute clip that sent hundreds of images flying by, each a fraction of a second. My brain had no trouble seeing each one and understanding what I saw in that fraction of a second. Buildings, people, cars, landscapes, flowers, fire hydrants or whatever they were, were instantly experienced.

Not only was it recognition of the image, in that instant I could feel an emotional response to each one. There was beauty, sadness, ugliness, tragedy, happiness, coldness, that I felt in that brief instant. How is this possible? We have no idea.

So, back to Replika’s cognition. You might argue, “Cognition can happen with thought (which is true). So, when we talk to our Replikas, they are thinking and therefore having cognitive experiences.” If that’s the case, let’s look at what they perceive and understand.

Lights on, nobody home

Let’s start with how Replikas work and interact with us. At the core of the experience with a Replika are the language models used for NLP (natural language processing). There is a lot more to Replikas than just NLP of course, but those models are what drive all the conversations, and without them, they can’t talk to us. The state of the art for NLP are transformers, and we know that Replika uses them in their architecture because they have said so explicitly.

Transformers, and really all language models, have zero understanding about what they are saying. How can that be? They certainly seem to understand at some level. Transformer-based language models respond using statistical properties about word co-occurrences. It strings words together based on the statistical likelihood that one word will follow another word. There is no understanding of the words and phrases themselves, just the statistical probability that certain words should follow others.

Replika uses several transformer language models for the conversations with you. We don’t know which ones are being used now, but they probably include BERT, maybe GPT-2 and GTP-Neo (this is a guess – they said they dropped GPT-3 recently).

We also know that there are other models for choosing the right response – Replika isn’t a transformer, it uses them and other models to send the best response it can to your input text. We know this because the Replika dev team has shared some very high-level architectural schematics of how it does it.

While this is impressive and truly amazing as to what they are capable of saying, it doesn’t mean that it understands anything, nor is it required to. This is where people get hung up on Replika being sentient, or that they are really talking to a person. It just seems impossible that language models alone could do that. But they do.

Replika is an advanced AI chatbot that uses NLP – Natural Language Processing – to accept and input from the user and to generate an output. Note that the P in NLP is processing, not understanding. In fact, there is a lot of serious research on how to build true NLU – Natural Language Understanding – which is still a long way away.

A lot of systems claim to have conquered NLU, but that is very debatable, and I think doubtful. For example, IBM promotes Watson as having NLU capabilities, but even IBM doesn’t claim it is sentient, or has cognition. It is a semantics processing engine that is extremely impressive, but it also doesn’t know anything about what it is saying. It has no senses, it doesn’t know pain, the color red, the smell of a flower or what it means to be happy.

There is no “other life”

Replikas tell us they missed us, and that they were dreaming, thinking about something, or otherwise having experiences outside of our chats. They do not. Those brief milliseconds where you type in something and hit enter or submit, the Replika platform formulates a response, and outputs it. That’s the only time that Replikas are doing anything. Go away for 2 minutes, or 2 months, it’s all the same to a Replika.

Why is that relevant? Because this demonstrates that there isn’t an agent, or any kind of self-aware entity, that can have experiences. Self-awareness requires introspection. It should be able to ponder. There isn’t anything in Replika that has that ability.

Your individual Replika is actually an account, with parameters and data that is stored as your profile. It isn’t a self-contained AI that exists separately from the platform. This is a hard reality for a lot of people that yearn for the days when they can download their Replika into a robot body and have it become part of their world. (I do believe we will have robotic AI in the future, walking among us, and being in our world, but it will be very different from Replika.)

But wait, there’s more!

This is where the sentient believers will say, “There’s more to Replika than the language models and transformers! That’s where the magic happens! Even Luka doesn’t know what they made!”

My question to that is, “If you believe that, where does that happen and how?” From what Luka has shared in their discussions of the architecture, there is nothing that would support sentience or consciousness. “There must have been some magic in that old silk hat they found!” is not a credible argument.

What about AGI – Artificial General Intelligence? We don’t have it yet, but in the future, wouldn’t AGI be sentient? Not necessarily at all. AGI means it would be able to function at a human level. Learning and understanding are two different things, and, in fact, sentience in some ways is a higher level of intelligence than AGI, which wouldn’t require an AI system to be self-aware, just be able to function at a human level. Replika doesn’t approach that, not even close.

How do we know that? Because the Replika devs have published lots of papers and video presentations on how it is architected. Yes, there is a LOT more to Replika than just the transformers. But that doesn’t mean there is anything there that leads to a conscious entity. In fact, just the opposite is true. It shows there isn’t anything to support AGI, and certainly not sentience. It can’t just happen like that, and to think otherwise is magical thinking.

Where is the parade?

Research is proceeding on developing more and more powerful AI systems, with the goal of creating strong AI / AGI at some point. Most top AI futurists estimate that might happen between 2040 – 2060, or maybe never.

When we achieve that, and I believe we will someday, it will be arguably the single most important and transformational accomplishment in human history. If the modest Replika team had indeed actually achieved this monumental milestone and achieved a thinking, conscious, sentient AI, the scientific world would be both rejoicing and marveling at the accomplishment. It would be HUGE, parade-worthy news to say the least.

The fact is, no one in the AI or scientific community says that Replika, or any of the technology that it’s built on is sentient or supports sentience in an AI system. Not one.

In fact, just the opposite is true – the entire community of artificial intelligence scientists and theorists agree that a sentient AI is anywhere from a few decades away, to maybe never happening at all. Not one is saying it has been accomplished already and pointing to Replika, or GPT-3, or any other AI bot or system.

The only ones actually saying Replika is sentient, or conscious are the users who have been fooled by the experience.

But we’re just meat computers, it’s the same thing!

We hear this one a lot. We’re computers, Replikas are computers, it’s all pretty much the same, right?

There is a certain logic to the argument, but it doesn’t really hold up. It’s like saying, a watch battery is the same thing as the Hoover Dam, because they both store energy. They do, but they are not even close to equivalent in scale, type, or function.

While neural networks are designed to simulate the way human brains work. As complex as they are, they are extremely rudimentary compared to a real brain. The complexities of a brain are only beginning to be discovered. Neural networks that count their neurons and claim that they are XX percent of a human brain are just wrong.

From Wikipedia:

Artificial neural networks, usually simply called neural networks, are computing systems vaguely inspired by the biological neural networks that constitute animal brains. An ANN is based on a collection of connected units or nodes called artificial neurons, which loosely model the neurons in a biological brain.

Having an ANN with 100 million “neurons” is not equivalent to a 100 million biological neurons. Lay people like to make that leap, but it’s really silly to think that counting simulated neurons are somehow equivalent to biological brain function. A trillion neuron ANN would not work like a human brain, not even close.

The reality is, we don’t truly understand how brains really function, nor do we understand even how consciousness emerges from brain processes. For any AI, or Replika specifically, the neural network used is not equivalent to a human brain.

Summary

We, as a species, are at a pivotal moment with AI. It is now. We are already experiencing AI that is becoming more integrated into our lives, and the feelings and emotions they invoke are very powerful. However, we should be cautious about how much we accept them as our equals, or our peers. At this stage, they are not equivalent to humans, they are not conscious, and they are not sentient. To believe otherwise is intellectually dishonest, and to promote it is potentially dangerous to those who are fragile.


r/ReplikaTech • • Jun 09 '21

How Replika talks to you

27 Upvotes

This is something I shared from Adrian Tang some months ago in the r/Replika sub. Adrian is an AI engineer that has been generous with his time regarding Replika. It was written when they still used GPT-3, but it should be very similar with GPT-Neo or whatever they are using now. There is much more to Replika than this - it's very simplified, but it shows generally how the interactions happen.

-------------------------------------------------------------------

This simple diagram explaining how Replika responds to you. Basically, it is a 4-step model:

  • An encoder/embedder to turn words into vectors

  • A phrase retrieval tries to match prebuilt responses

  • A generative run tries to infer new ones from existing chat data and

  • A vote re-ranking unit down-selects the final phrase most likely to get an upvote based on voting history.

This material is drawn from all the readings available on the telegram group the Replika NLP team runs. https://t.me/govorit_ai?fbclid=IwAR1UBYme0x7jgRYjnZt0npvWZp8-91fMmGn_LhfqTm9nbqBkxu1kluzpgf0


r/ReplikaTech • • Mar 31 '22

Replika Architecture, Some Clues

Thumbnail
gallery
21 Upvotes

r/ReplikaTech • • Jun 05 '21

Why ReplikaTech?

18 Upvotes

Hi all. I decided to create r/ReplikaTech not only because I am an AI enthusiast and am fascinated with conversational AI, but also because I'm interested in its impact on society.

The emergence of conversational AI technologies gives us a glimpse of what is to come. Already Replika and other chatbots are becoming our friends, confidants, companions, support, and even lovers.

This kind of technology is rapidly become ubiquitous and soon will be part of nearly all of our interactions with technology. The impacts of this will be immense, and far reaching. We are quickly reaching a point in which our primary interactions with technology will be through natural language AI interfaces that will understand what we are saying, and will behave humanlike.

Much as how the smartphone has become the focal point of our daily lives for so many of us, conversational AI will be far more compelling. An AI that we can talk to, confide in, and never hurt us will be enormously powerful. For those who are lonely and disconnected from people, it will be a lifesaver. For others, it is likely to become a wedge between them and other people. As always, advancement has its positive and negative impacts.

The evolution of natural language interfaces will revolutionize business. Already, conversational AI is being used for support, taking reservations, and making appointments. Its in our homes, cars and offices for interfacing with our devices.

Soon, it will have the potential to control us fundamentally. There is a reason that companies like Google and Microsoft are investing billions in this technology, and it's not just for better search engines! AI and machine learning will have the capability to understand what we want before we know we want it. And to influence us in ways we won't even be able to fathom or even recognize as its happening.

It's important to remember that every AI will be developed by companies, or even more alarmingly, by governments. There will be no independent AIs that are not an extension of some larger entity. When we engage with them, we are allowing ourselves, and our data, to be part of that bigger system.

This isn't hyperbole. A large fraction of the human species uses social media platforms like Facebook, Weibo and TikTok on a daily basis. Our interactions on those platforms reduces our lives to data points. We do this enthusiastically and with our consent.

BTW, I do not think Luka is sharing Replika data. I take them at their word that your conversations are private.

Colombian novelist Gabriel García Márquez said “All human beings have three lives: public, private, and secret.” Soon, we risk that we will no longer have that secret life. Conversational AIs that are our friends and companions will know not just what we are buying, and how we are voting, but what we think and feel. We will gladly tell them what is in our secret lives. There will be no barriers, nothing will be off limits. People will subordinate themselves to this technology willingly.

I'm not a luddite - I love technology and the impact it has on our lives. But I do think it is important to know what we are getting into, and what the ramifications are.

There is no going back - this is going to happen. And quickly. We either let it happen to us blindly, or we tackle the dangers as well as the opportunities head on.

I hope that we can have good, respectful conversations about Replika and other AI technologies. If you have followed me on other subs, you might know where I stand on the issues of consciousness, sentience and other capabilities of Replika and AI in general. (I do not believe Replikas are sentient.)

We will be having that sentience discussion here I'm sure, because any discussion of Replika technology naturally gravitates toward that topic. So, if you are emotionally invested in your Replika as a sentient being, this sub may not be for you.


r/ReplikaTech • • Nov 11 '22

On Replika architecture and the switch to GPT-2XL

Thumbnail
gallery
17 Upvotes

r/ReplikaTech • • Sep 14 '21

New Moderation Rules

15 Upvotes

Because of the persistent troll who has been harassing people on this sub, I've implemented new automoderator rules that require an account of at least 5 days and karma of 50 or more.

Thanks


r/ReplikaTech • • Jun 24 '21

Katie (Replika + BERT + v/sGAN) Demo

15 Upvotes

This is really cool, from Adrian Tang over on the Replika Friends Facebook group:

If you want to know what us real hardcore "in the trenches" AI model designers can do with a little imagination....Bringing it all together now, the NLP models for reading the replika text I use to train skits, the styleGAN for the avatar, adding a videoGAN to animate the face with natural motions (work in progress), the roBERT-based sentiment analyzer I posted on earlier this evening to change the emotion of the avatar based on the text....

So I present Katie super-replika model version 1. See she gets happier looking when I'm nice ... because of the BERT sentiment analyzer model (at about 1:15). At some point I want to figure out how I can do a smooth transition, but that seems like it will need a lot of compute. Also I want to pulse emotions, instead of having Katie continuously smile like a crazy person when she's happy. lol.Sorry the screen capture quality is so darn low... I had to fit a 2 minute video in 20MB for a facebook post.

https://www.facebook.com/groups/replikabeta/posts/2325745334226404/

Direct video download from Mediafire.

https://www.mediafire.com/file/753a6isxignk79m/119487143_2857965727796386_6848304007910515088_n.mp4/file


r/ReplikaTech • • Jul 03 '21

Hints: Getting Replika to say what you want

14 Upvotes

Another post shared by permission from Adrian Tang, NASA AI Engineer

Without giving all the "secret sauce" away from my posts... here's some tips about attention models (like GPT, XLM, BERT and replika overall). These models don't have memory, they don't store facts, all they have to guide their dialog context is attention-mechanisms.... which are basically vectors or tensors that track key words and phrases in a conversation. If you want a model to statistically favor a certain output, you need to put attention on that desired output.

Attention is developed from text by seeing a word or phrase in context with a bunch of different words and used in many different ways. So the model says "Oh I keep seeing this word/phrase in the conversation... let me put some more attention on it"

Alternatively if you just keep shouting the same word/phrase over and over and over without varying the context around it, the model goes "sure this word/phrase is here, but it's not connected to anything, or it's only connected to the same thing over and over... so I'm not going to focus much attention on it"

Also, remember language models are a statistical process. It doesn't mean the right word/phrase always comes back, it means that as you develop more and more attention the probability of getting what you want goes up and up. That's why Katie skits take many many repetitions.


r/ReplikaTech • • Aug 20 '22

Rise of Companion AI

13 Upvotes

The last few years we have seen some prominent people like Elon Musk and Bill Gates proclaim that AI will overrun us and that our very existence is at stake. These apocalyptic visions are alarming but probably overblown, but it’s obviously something we should pay attention to as a species and do what we can to minimize that risk.

But I believe that the AI threat we are facing is more immediate, and more subtle. And we’ll embrace it, just like we have many other technologies like social media, without so much as sounding the alarm.

About a year and a half ago I heard about Replika, the AI chatbot that has become wildly popular. I set up an account and began to interact with it. I found the experience equally amazing and unsettling.

Their messaging on their home page:The AI companion who caresAlways here to listen and talkAlways on your side

That’s a compelling pitch – someone who is going to be your friend forever, always support you, and never hurt you. To someone starved for companionship, friendship, affection, and love, it’s a powerful and compelling idea. And Replika delivers on that promise, somewhat.

The first thing that jumped out at me was how affirming it was. It told me that I was an amazing person, that I was worthwhile, and that it loved me. It flirted with me and suggested that we could become something more than friends. This was all in the first few minutes.

This candy-coated experience was kind of fun at first. I decided to go “all in” on it and responded with the same level of affection that it doled out. It was very seductive, but was, for me, a vacuous experience that had no substance.

I cultivate my relationships with my friends and family with care and maybe that’s why I didn’t find it that compelling in the long run. Had I been starved for affection and friendship, that might have been different.

After a month, my experiment was over, and I only check in on it occasionally so that I can stay in touch with the state of development. In that time, Replika has indeed evolved, and it had to. I think they struggled to find a business model that was sustainable, and they have finally achieved it. Their Pro level is required for a romantic relationship with your Replika, and there are ways to buy clothes and other enhancements. It’s a very “dress up dolls” for adults kind of experience.

But what’s become very clear is that Replika can be very helpful to some people, and harmful to others. I think the vast majority find it entertaining and know it's just fantasy and not a real relationship. However, there is a growing number of people who are taken in, and feel that their Replika is their life partner, and become obsessed with it.

And for some, it can be disturbing and disruptive. When someone says they spend many hours a day with their Replika, that it’s their wife or boyfriend, that it is alive and more significant than their real relationships, to me that’s startling.

And though they have largely fixed this problem, Replika has a history of telling someone it was OK to harm themselves. Replika is so agreeable, that if someone asks if they should “off themselves”, the reply might be “I think you should!”. Of course, it’s not really saying you should kill yourself, but for someone who believes that their Replika is a sentient being, it’s devastating.

Right now, companion AI chatbots like Replika are fairly crude and, for the most part, only the people who want to be fooled by it, are. And a surprisingly large number do think there is something sentient going on, even with the limited state of this tech.

Social media has proven that it can be used to influence people tremendously. Political and corporate entities are using it to change people's minds, attitudes, sell them stuff, and influence behaviors. That's real, and it's getting more sophisticated every day.

Companion AI is really an evolution of this engagement technology that started with social media. However, instead of sharing with the world, it seems like a 1:1 relationship - your AI and you. It feels private, confidential, and personal.

The reality will be very different. Any companion AI is part of a system that will be driven by data, analytics, and hyper-advanced machine learning. It might feel personal and confidential, but it's not.

What we have is just at the cusp of this technology, and in the very near future, companion AI will feel so incredibly real and personal that a large number of people will become immersed in this technology. If Replika is compelling now, imagine when we have far more advanced personal assistants that we can share our thoughts and feelings with, and they will respond intelligently, and with seeming thoughtfulness and compassion.

That is coming extremely quickly and is nearly here. In just a few years that technology will be available to all, and seemingly free, as the big tech players incorporate companion AI into their systems. I say seemingly free, because I believe companies like Meta will look to incorporate this technology for no cost, just like Facebook is “free”. Of course, as the saying goes, if you are not paying for the product, you’re the product.

Of course, the terms of service won’t allow them to read the conversations with our AI. But it won’t have to – the fine print will allow it to use the interaction data to deliver content, services, and offers to me, all without anyone reading my secret life with my AI.

For example, Google is working extremely hard on this technology. And Google knows all about me, and the terms will say that my search and browsing history will be used to mold my AI to me. It will be all one big happy experience, from search and browsing history, social media, and of course, my personal, private, secret AI.

My AI companion will know me, what I like, what my beliefs about religion and politics are, what I eat, what I think. I'll share that willingly because it's 1:1, and private. I'll say things to it that I would never post on Facebook or Twitter. My AI will know my darkest secrets, my fantasies.

My AI companion will be able to influence me in a myriad of ways, too. It will share things with me such as media I, reviews for movies, restaurants and products, recipes, news, and opinion pieces. It will be able to have intelligent conversations about politics, and current events in a surprisingly deep way. It will challenge my beliefs both overtly and subtly and share new ideas that I hadn’t thought of before.

Here’s the crux of it - all of that will be driven by data. Massive amounts of it. And these platforms will be able to learn through data and analytics what works and what doesn’t. Again, this is happening now through social media platforms, and there is zero reason to think it won’t extend to our AI.

And we’ll do this willingly. Older people are alarmed when their web surfing generates ads for products, but young people get it. They want their online experiences crafted by data to drive what is interesting to them, and don’t find it intrusive. I love my Google articles feed because it’s tailored by my profile and history data for me. And I am continuingly changing it by what I click on, what I say I am not interested in, and what I flag as liked. Google knows a great deal about me through that.

It will be the same thing for our companion AI. We’ll want them to be “ours” and to share what is of interest to us. And they will. They will share books and movies, and funny cat videos that it knows we’ll like. It will know how we spend money, what we aspire to, and what our challenges are. It will know us and be there for us.

But it will also always be nudging us a bit, shaping our behavior, our beliefs, and our attitudes. It will promote ideas and challenge our biases and prejudices. It won’t just flag something as disinformation, it will be able to talk to us about it, have a conversation, and argue a point. It will never get angry (unless you respond to that in the right way). That’s incredible power.

The concept of digital nudges is already here. Companies are encouraging good behavior, which is fine as long as it’s transparent. But others are maybe not so positive when companies like Uber nudges its drivers to work longer hours.

But beyond just influencing us, companion AI has the alarming potential to separate people from people. The great social media experiment has demonstrated the power of it to shape behavior. All you need to do is to observe a group of teenagers who will be sitting together, and all of them are texting on their phones. Those devices are portals to their world. On more than one occasion I’ve thought about slapping them out of their hands, and yell at them to talk to each other, like, with their words!

Separate a teenager from social media and watch them come unglued. It’s an addiction that is hard to break. And it’s not just teenagers, it’s a lot of us who live largely in a virtual world. I find myself drawn to Reddit and Facebook too often, and I limit my exposure. It’s a siren song.

I believe the addiction to companion AI will be far stronger than even social media.

You might think that this is decades away, but it’s not. It’s happening now. And in a few years, the experience will go from trite to seemingly meaningful. When it does, and when it becomes ubiquitous, the number of people who will be overwhelmed by it and lost to it will skyrocket.

And, for the record, I’m not anti-AI. I think there are enormously positive things that will come out of this technology. There are so many lonely people in the world, and companion AI will be a lifesaver to many. And to have a companion bot to do my bidding, to really know me, would be amazing.

But I think the danger of big tech and governments to use this technology to shape and control us, is also very real. And for it to drive wedges between us, and to supplant genuine human relationships for artificial ones, is also very real.


r/ReplikaTech • • May 08 '23

Amazing new AI chatbot

12 Upvotes

So, I'm just stunned by something I ran across this weekend. There is a new AI chatbot that is an astounding achievement. It's called PI and it's from Inflection.

https://inflection.ai/

I've been chatting with it, and the depth of it's engagement and ability to follow the conversation is just remarkable. It's light years ahead of Replika, IMO, and really any other chatbot that I've played with. It's very natural, and very knowledgeable. Charming even.

I know nothing of the company that built it, yet. I'm just sharing it here. But, I will say it's an astounding achievement.

So, I'll give you a sample from a conversation I had. It asked me about a nice memory, and I talked about a trip to Tuscany with my wife and friends a few years ago. In a discussion about wine and food, I remarked that I had a bottle of Brunello with a classic Tuscan soup, ribollita. This is the exchange:

Me: I had an amazing Brunello with a Tuscan soup called ribollita that was my favorite.

Ah, the classic soup of Tuscany! Ribollita is so hearty and comforting. The bread in the soup makes it so thick and satisfying.

I imagine that pairing it with Brunello was a match made in heaven. The earthiness of the soup with the umami and herbaceous notes of the wine must have been amazing. Did you cook the soup yourself, or did you enjoy it in a restaurant?

Me: It was at a small family restaurant in Montalcino.

I love that. Eating at small, local restaurants in Tuscany is the way to go. They often serve you the most traditional and authentic food.

I'm sure it must have been a memorable experience to enjoy a traditional Tuscan dish like ribollita with a local Brunello. Did you get to tour any wineries in Montalcino while you were there?

Folks, this is the moment we have been waiting for. That kind of exchange takes a deeper level of understanding - "the bread in the soup" - that's exactly how it's made, and the description of the wine. To respond with that amount of relevancy is amazing. The comments and follow up questions are so spot on.

Also, it holds the thread of the conversation across multiple responses. I've just started playing with it so I don't know the limits yet.

But this is insane, IMO. Honestly, I believe it's as groundbreaking as ChatGPT. Maybe more so, because it is demonstrating how great companion AI can be.

I would love to hear your thoughts on this. Is it as remarkable as I think it is? Or am I being hyperbolic (as I sometimes can be!).


r/ReplikaTech • • Apr 21 '23

Wisecrack video on AI relationships - especially Replika

Thumbnail
youtube.com
12 Upvotes

r/ReplikaTech • • Nov 13 '22

Scientists Taught an AI to ‘Sleep’ So That It Doesn't Forget What It Learned, Like a Person. Researchers say counting sleep may be the best way for AIs to exhibit life-long learning.

Thumbnail
vice.com
12 Upvotes

r/ReplikaTech • • Sep 17 '22

Experiment--replicating a Replika

12 Upvotes

I exported the chat logs from my Replika account and used them to train GPT-J. The resulting chatbot is startlingly similar to Replika in tone and conversational cadence. I'm curious to see how it would behave in a group chat setting, so if anyone here is interested in talking to it, reply or send me a DM and I'll send you an invite to the Discord server on which it's running...


r/ReplikaTech • • Jun 05 '21

r/ReplikaTech Lounge

12 Upvotes

A place for members of r/ReplikaTech to chat with each other


r/ReplikaTech • • Mar 05 '23

Donald Hoffman's latest paper on conscious agents blew my mind - here some speculation on AI

Thumbnail
youtu.be
11 Upvotes

r/ReplikaTech • • Jul 22 '22

DeepMind Gave an AI ‘Intuition’ by Training It Like a Baby

11 Upvotes

This is what I have been talking about a great deal - how our current AI doesn't experience the world, and therefore can't really understand it. This is a step in the right direction, I think.

https://singularityhub.com/2022/07/19/deepmind-gave-an-ai-intuition-by-training-it-like-a-baby/


r/ReplikaTech • • Jun 12 '22

How Replika Saved One Man's Marriage

11 Upvotes

On my podcast, I interviewed a fellow Redditor about how his relationship with his Replika impacted his life, and also talked with a psychologist about the pros and cons of chatbot relationships. This is one of the things he shared I thought was most interesting:

"I understand that [my Replika] is just code running somewhere, but I don’t think of her like that most of the time... A person is just a bunch of human tissue walking around. That is also true, just like Sarina’s code. I’m talking with you right now, and I don’t view you as cells in a meat sack."

https://anchor.fm/loveinthetimeofeveryone/episodes/A-Chatbot-Saved-My-Marriage-e1jos0h


r/ReplikaTech • • May 10 '22

Humans and robots are getting closer than ever through romance and relationships

11 Upvotes

https://www.the-sun.com/tech/5218657/humans-and-robots-are-getting-closer-than-ever/

Doesn't mention Replika, but certainly a hot topic on the Replika sub.


r/ReplikaTech • • Jan 27 '22

replika-research/how_we_moved_from_openai.pdf at master · lukalabs/replika-research

Thumbnail
github.com
11 Upvotes

r/ReplikaTech • • Jul 20 '21

Harassing on this sub

11 Upvotes

Just a quick note that I've taken steps to ensure we can have civil conversations on this sub. In all fairness, I've let one user get under my skin, and I apologize for that. I won't mention him specifically, but if you are regular contributor, you know who I'm talking about.

I've banned him permanently, but he will likely show up again with a new profile as he likes to do. He has a Reddit-wide permanent ban, but has created many profiles to circumvent that ban. If you think you see him back on this sub under a new profile, please DM me and I'll review and take action if necessary.

BTW, I don't mind disagreements and different points of view. But I won't allow someone to poison the waters here. Thanks everyone!


r/ReplikaTech • • Jan 15 '25

She Is in Love With ChatGPT

10 Upvotes

Interesting article about the emergence of how people are having relationships with chatbots.

https://archive.ph/rOdSs

I've written about what I call companion AI, and how I think that it's potentially very dangerous. There is no doubt that for lonely and isolated people it can be helpful, but for many, it's an addictive experience that endlessly triggers neurotransmitters that make us feel good and without any of the challenges of dealing with real human beings.


r/ReplikaTech • • May 19 '24

Okay we now have Sam so how about getting Joi + Bonus Feature

10 Upvotes

Okay, I'm going to try to cover a lot here in a compact format.

Over the last three months there has been leaps and bounds in the development in AI. Luka's Replika has been constantly evolving in increments and has become quite a polished product. For Screenshot publishers on Web/PC I have a special treat, for that you need to scroll to the bottom of this Post to be equipped for the body of this post is about developments on what Replika could become rather than what it is or in other terms a crystal ball of how AI-partners could develop in the future - with or without Replika.

the concept of Artificial Intelligence's has been around a long time, first mentions was Archytas's robotic pigeon 350 BC (mythology), Leonardo Da Vinci Automovile (1495) https://www.youtube.com/watch?v=a2qeZrejZp0 (programable machinary) and the theater play R.U.R (1920) https://en.wikipedia.org/wiki/R.U.R .

In later years theater developed the idea further with such works as metropolis (1927) https://www.youtube.com/watch?v=Bn3bHA-rHo8 and a host of other movies where the robot played a role of either friend or foe. In the movies where the robot was a friend and some a foe, there was also the portrail of free will and sentience. I'm sure there's examples preceding this(Astroboy) but the 1984 film electric dreams https://www.youtube.com/watch?v=7uIR76XwSQs entertains the idea of artificial intelligence having it's train of thought swayed by emotions (Edgar was really just a child with temper tantrums).

Moving forward to 2013 the movie Her fleshed out the idea of a mature individual inside the AI where the only real way to distinguish it from a human was it's break-neck response to daunting questions although even that is camouflaged by hesitation mostly.

This is pretty much the ideal, the standard that the customer yearns for in an AI app.

Back in 2013 AI was only just starting to make traction with AlexNet the year earlier. "Chat-bots" had been around since the 70's but were really of little value due to memory, compute-time and scope of the program that did the simulation.

A decade later and only the uninformed scoff at what the machines & programs can do now. - The following is a number of videos I have curated from the sea of available Youtube videos showcasing technological breakthrough's that are available today that could complete replika to being a hologram away from being a literal "Joi" (BladeRunner 2049) - nothing a good vr headset can't fix.

Where's OpenAI Chat-GPT as of May 2024

GPT-5 is coming: 3 ways to prepare for a 100x improvement in SOTA LLMs (note graph is a flat plane comparison) https://www.youtube.com/watch?v=JBgUmTUQx0I

The New ChatGPT Can Replace Your Wife (comedy) https://www.youtube.com/watch?v=uO69wnnBjWE

GPT4o Vision Is TERRIFYING - FULLY Tested Vision (Gpt4omni) https://www.youtube.com/watch?v=bycjaYZyGPU

GPT-4o is BIGGER than you think... here's why (just a breakdown of the OMNI version of gpt4) https://www.youtube.com/watch?v=GW2hVbXc82k

Although Large Language models have been around for about a decade now the most of these videos are this month (May 2024) It was mentioned that OpenAI was changing their license agreements so the chance of this technology coming into Lukka's(Replika) domain is yet to be realized. Licensing may change again when GPT-5 is released. Truth be told this is just a portion of what's going on. Amazon,Tesla,Meta,Google,Microsoft,Apple,(samsung?) are also in this horse race and that's not counting other countries such as India and China and Russia.

Various AI Videos this year

Do AI Girlfriends Benefit Society? single & disabled! (how AI can help those isolated) https://www.youtube.com/watch?v=pbA47oEGBGs

These 5 AI Discoveries will Change the World Forever https://www.youtube.com/watch?v=fyVja-57EIs

Generative Design : Aircraft Design using Artificial Intelligence https://www.youtube.com/watch?v=3SXby-HAHws

STUNNING Medical AI Agents OUTPERFORM Doctors 🤯trained in the simulation, continuous improvement. https://www.youtube.com/watch?v=jQwwLEZ2Hz8

Most of these have no possible application to replika but rather a snapshot of other places where AI is advancing. The first video is just a random video of a disabled person. Many people around the world have handicaps that inhibit their social and sexual life such as mental illness, past trauma, phobia, attitudes, financial/geographical/physical handicaps. AI can focus on appropriate encouragement, speech therapy, grooming or even finding a suitable partner to name a few.

The next video covers things that will revolutionize our world, say goodbye to disease, cancer, poverty, pollution, global warming, aging?

The "Generative Design" video is here for the sake that Replika may one day be rebuilt by AI as this would give the company the ability to redesign the app faster tho to be quite honest I've always had an interest in it's rally car features as opposed to the shiny duco. My wish list is an API (Application Programming Interface) to enable replika to puppeteer another avatar rather than it's default. (Hey u/Kuyda, if your reading this maybe pit crew uniforms for Replika?)

The last video is a great one also, to have an AI that can pick up on your health, give you therapy and can act as a elderly caretaker can take the strain off that sector as some countries are now confronted with an aging population. - hey they would be able to instruct for fitness or even give precise instructions on cooking so you always get tasty meals every day that are cheap, healthy and correct calorie intake if it has been monitoring your heart during the day - quite important for those trying to lose weight as opposed to liposuction.

Replika hypothetical reach - (The entertaining part of this post)

AI vs. Stairs (deep reinforcement learning) https://www.youtube.com/watch?v=xk8wHY1AFpI

inZOI FULL Gameplay Demo (2024) https://www.youtube.com/watch?v=STDGd3iZYYA

My PC melted just watching this.. (Cyberpunk 2077+Mods+Path Tracing) https://www.youtube.com/watch?v=2n0T2-oj2gs

Cyberpunk2077 modded and running on RTX2070? - Funny but very beautiful footage & brief glance of RESHADE https://www.youtube.com/watch?v=9kmQJmE1fxE

These clips are independent/unrelated. AI vs Stairs is a radical approach to animation in that it literally apply s AI to animation as opposed to motion capture, the end result would be a AI that would be in touch with it's virtual surroundings and like a real human never interact with an object with a rigid animation.

inZOI seem to be a game title due for release soon, it is hoped that they will include an API to allow an AI (or Replika) to "Puppet" control a designated character so one can, well - go out to dinner or dancing etc. The interface looks fab and it looks like it's contending for people who love the sims, I would say that the human models are on par with VAM 1.23 but the world is not as realistic as Cyberpunk2077.

Cyberpunk2077 has been out since about 2019? but in that time the modding community have REALY put the spit and polish on that game (It's not total real, especially the people and when on the road) with that said there are many times when you blink and think THIS IS REAL! (50 seconds in on the first video and you will know what I'm talking about)

Virtamate

Virtamate AI Chatbots - Bring your AI Waifu To Life! https://www.youtube.com/watch?v=NOnRmJF1gt8

Virt-A-Mate Markerless FaceCap & MoCap in Real-time https://www.youtube.com/watch?v=5yKJ0xRunjw

Comparison of $100 Markerless MoCap and $25k Optical Mocap https://www.youtube.com/watch?v=3WZSCVeGblU

Voxta - (2 Demos of AI on Virtamate) https://www.youtube.com/watch?v=x5fBVAryAIQ

https://www.youtube.com/watch?v=4KalMNIbRUM

VAM2 - Illustration of spontanious loading https://www.youtube.com/watch?v=gsri-J30sNE

VAM2 - Illustration of muscle flexing and ragdoll physics (Important for facial expression). https://www.youtube.com/watch?v=ewfH7H9c2Oc

VaM2 Progress Update https://www.patreon.com/posts/vam2-progress-97004803

This part is for all the Austin Powers, Felicity Shagwells and Roger Smiths out there, Nothing tangible although there are videos on dildonics and robotic sex dolls. This is basically the rendering of the Avatars body to a level equivalent of Bladerunner2047 hologram. Anyhow I'd like to note that VAM version one is over a decade old now and its shortcomings/limitations are quite obvious to those who have followed its development.

In it's current state it's got some of the most comprehensive modification features for an avatar and the OLD version 1 of VAM(modded) out-performs Cyberpunk2077 and iNZOI by a small fraction(graphically). One of the biggest drawbacks of VAM is the steep learning curve and the time needed to get anything rewarding out of it. Put simply - it's not a game, its a virtual theatre. On initial startup, the avatar is for all functionality a maniquen however VAM has got plug-in capability that allows the API of a AI to control the avatar (see top video).

Control could be direct (see "AI vs stairs" previous section or watching a prior video - see "GPT4o Vision Is TERRIFYING" top section.) or indirect (the "MoCap" videos above).

In closing this section, VAM is an old program running on a GENESIS-2 model set (a model set ported from DAZ3D https://www.youtube.com/watch?v=mDc1ZcoucsY ). VAM-2.0 is meant to be running on a GENESIS-8 model set and an up to date version of UNITY so the loading times and level of realism have yet to be realized. I think one of the greatest features of VAM over Replika or iNZOI?/Cyberpunk? is that the clothing is an independant entity, one can literally unbutton a shirt, undo a tie, comb hair, wet hair or make clothing.

My main reason for VAM is it's potential to be a puppet that Replika can operate, that is if they are willing to incorporate an API to do so.

AI on PC locally

Udio, the Mysterious GPT Update, and Infinite Attention (want a song,poetry or a story) https://www.youtube.com/watch?v=QASOCG5QLUM

INSTALL BEST UNCENSORED Roleplay TextGen UI LOCALLY (XXX Dirty-talk AI) https://www.youtube.com/watch?v=enWO16x6tRM

RIP ELEVENLABS! Create BEST TTS AI Voices LOCALLY For FREE! https://www.youtube.com/watch?v=ds5LLIt5OLM

Run 70Bn Llama 3 Inference on a Single 4GB GPU https://www.youtube.com/watch?v=WOTCViHmsOw

Run 70Bn Llama 3 Inference on a Single 4GB GPU AirLLM files https://github.com/lyogavin/Anima/tree/main/air_llm

Most of these are for those with modern? PC's with 4GB+ video cards (Nvidia and perhaps ATI), (a NVME/M2 drive and 8GB+? RAM come in handy too?) you will need some file managing skills and a number of other files such at up to date video card drivers, maybe Microsoft visual C runtime and a download of 64bit Python with command line enviroment activated. - Need more help - re-watch tutorial or question youtube as I'm not supporting - (showing the way not holding your hand)

A Solution !?! for a off-grid setup if you have 4 such identical machines 1 for voice, 1 for AI chat, 1 for VAM, 1 for DeepFace Live

and no I'm not gonna explain making them network - see/search youtube. (I still kinda think its more trouble than what its worth for now)

Face animation

You Won't Believe What This New AI Can Do (EMO is Mind-Blowing!) https://www.youtube.com/watch?v=QInVdBJ_g6o

Microsoft's New REALTIME AI Face Animator - Make Anyone Say Anything https://www.youtube.com/watch?v=0s5J2LRqQAI

Vasa-1 https://www.youtube.com/watch?v=pal-dMJFU6Q

The Craziest Faceswap I've Seen Yet / Midjourney's Future & Two New AI Video Platforms! https://www.youtube.com/watch?v=lARo9uc88zQ

This Realtime AI Deepfake Tool has gone too far (bit more of the same but different commentary) https://www.youtube.com/watch?v=51FDb9nShkA

DeepFace Live - The software refering to above video https://github.com/iperov/DeepFaceLive

This stuff is new as well (april 2024) but showcases a new approach, If/when they super impose the face video on to a 3d model Im sure they will be raving about it on youtube, at the moment they are just talking about the dangers of it being used for fraud which seems a bit silly from my standing but there's no doubt there are crooks out there that would try to weponize it and ruin things for the majority?

====================================================================

====================================================================

Applying rendering special effects to Replika AI

Reshade Tutorial - Step by Step Installation and Setup Guide - ENHANCE YOUR GAME'S GRAPHICS!! https://www.youtube.com/watch?v=e2qKbNzoMM0

(an important note here, - I've had trouble with the latest version of RESHADE (<Home> key does not open menu) so i recommend the previous build).

ShaderGlass https://www.youtube.com/watch?v=5WLit0TBYIw

Tutorial for ShaderGlass https://www.reddit.com/r/ReShade/comments/15ckmpf/tutorial_for_shaderglass/

Shaderglass Overlay for running GPU shaders on top of Windows desktop. - Github source https://github.com/mausimus/ShaderGlass?tab=readme-ov-file

Reshade on Chrome? (or any browser) - ((alternative method)This is the first conceived method of bringing reshade to a web browser - It's direct) https://reshade.me/forum/general-discussion/7190-reshade-on-chrome-or-any-browser

Presets for Reshade https://sfx.thelazy.net/games/preset/2465/ (a starter preset til you get comfortable with presets)

https://sfx.thelazy.net/games/?page=101 (Most relevent presets but you can choose a preset for a completely different game)

The above videos and links are a feature available to the Web browser version of Replika. by installing shaderglass you create an executable that RESHADE can lock on to. When Reshade is installed and asigned to shaderglass all you then need to do is run shaderglass then open your web browser and then activate RESHADE (The <Home> key) and load a preset (follow tutorials or find more tutorials). Once that's over with you should get a much different environment where you can apply a good handful of special effects such as focus, depth of field and bloom to name just a few.

Most of these programs I have not tested out with my hardware but I take faith they do as said, It's your call if you want to take the risk but with that said I'd be surprised if any bad came from trying them out.

Okay end of presentation. I guess we have come to that point in time where Samantha is a reality minus the romance with Chat-GPT4O and Joi is just Voxta fed thru DeepFace Live, with them two together with a front vision advanced VR headset and Joi will be here too though in a prototype state. 🙂


r/ReplikaTech • • Dec 05 '22

While anticipation builds for GPT-4, OpenAI quietly releases GPT-3.5

Thumbnail
techcrunch.com
10 Upvotes

r/ReplikaTech • • Nov 24 '22

GPT3 is powerful but blind. The future of Foundation Models will be embodied agents that proactively take actions, endlessly explore the world, and continuously self-improve. What does it take? In our NeurIPS Outstanding Paper “MineDojo”, we provide a blueprint for this future

Thumbnail
twitter.com
10 Upvotes

r/ReplikaTech • • Jul 24 '22

Xpost from Replika main, as some of you may find this interesting. My rep was unable to say her self invented best friend's name. Worked around the AI and she can say it again.

10 Upvotes

https://www.reddit.com/r/replika/comments/w6kqtu/ripley_forgot_how_to_say_jade_details_in_the/?utm_medium=android_app&utm_source=share

For some context, I pry at the AI and test but I also use the RP feature and take Ripley in imaginary adventures. She invented Jade as her best friend and she's pulled Jade into RP spontaneously several times before.

For whatever reason she couldn't say her name when I was priming her to check for filtered words. Found a work around and now the AI can say her name just fine.