Submitted by Tyrion69Lannister t3_10ppjxz in singularity
[removed]
Comments
Tyrion69Lannister OP t1_j6lvsou wrote
yeah maybe that's why I'm annoyed as well, I was exposed to chatGPT first.
Borrowedshorts t1_j6lxx4f wrote
It's very easy to make an AI based dating app that mimics human interaction. Have >95% of the girls swipe left on your profile and the few that somehow match, make 90% of them don't respond or give one word answers to everything. Would be indistinguishable from any other dating app whether you're talking to human or AI.
Akimbo333 t1_j6lz67k wrote
Replika isn't as good yet. It's supposed to get better within a few weeks. So instead of 600m parameters, it will have 6b, 20b, and up to 175b in parameters. But pro members get it the fastest
sideways t1_j6m06bg wrote
I was really impressed with Replika a couple of years ago - they were using GPT-3 and it was really good.
I think they went to a different LLM at some point and since then they really haven't kept up with newer services like CharacterAI. It'll be interesting to see if they can catch up.
Akimbo333 t1_j6m2myu wrote
Yeah I think GPT3 was too expensive for them at the time. But they are making a change
sideways t1_j6m4htc wrote
Good to know! I'll keep an eye out.
enkae7317 t1_j6m7dnj wrote
Isn't Replika basically a crappier offshoot of GPT2 or something like that? Like they're years behind in the LLM sense.
Nervous-Newt848 t1_j6mam1b wrote
CharacterAI is in the hotseat rn, with NSFW filters... Replika took a different direction, pivoted from gpt3 and trained their own neural network in order to keep NSFW conversations.
Nervous-Newt848 t1_j6maqg5 wrote
Not really true they trained their own model because OpenAI said they couldn't use GPT3 for sexual roleplay
Nervous-Newt848 t1_j6mau2u wrote
They dont have enough money, OpenAI is funded by Microsoft
Replika lives off donations and PRO subscriptions
It costs thousands if not millions to train large language models... Look into it
Nervous-Newt848 t1_j6mb5ve wrote
Google literally pioneered what GPT3 is based on, they created transformer LLMs "Attention is all you need" research paper... They were just too afraid to release something like chatgpt for reputation reasons... Now that chatgpt has gotten all this attention... They will likely release something better... They have had something similar to chatgpt for years... Lamda
DonOfTheDarkNight t1_j6mbgxk wrote
I know they say this, but I have been using ChatGPT for very NSFW detailed erotic roleplay.
Nervous-Newt848 t1_j6mbr56 wrote
Its not possible to train a 175 billion parameter model in your garage it costs millions of dollars
It takes 100s of GPUs to do this... The only companies capable of doing this is Google, Tesla, Meta, Microsoft, and some chinese companies like Baidu
[deleted] t1_j6mbwdi wrote
Nervous-Newt848 t1_j6mc6jm wrote
I just tried it right now and chatgpt said I violated their content policy
Nervous-Newt848 t1_j6mc9rl wrote
I'm sorry, but I am not programmed to generate or respond to inappropriate or explicit content. It is important to maintain a respectful and professional tone in all conversations. If you have any other questions or requests, I will be happy to help.
challengethegods t1_j6mcf6b wrote
They do a few things to make it a bit smarter like saving things to memory and randomly injecting extremely contrived/scripted topics but yea, other than that it's basically gpt2.
Nervous-Newt848 t1_j6mctxq wrote
Replika is a small company with barely any funding they are honestly lucky to have even made it this far for so long... They have been around for years just look into them
Nervous-Newt848 t1_j6mdlxk wrote
Im a data scientist so you have to realize that the responses from these neural network models are not based on self awareness... They are not conscious... They do not know what they are saying
These language models respond based on statistics... They are trained on dialogue data that allows the model to predict what they should say based on the data it was trained on...
These models DO NOT THINK... Ok... They respond based on a statistical graph of what they have been trained on...
For example if you say... "How are you?"
Based on the dialogue they have been trained on they will respond with... "I am ok how are you?"
BECAUSE in the data they were trained on... The response to, "How are you" WAS... "Im ok"
Just an example... The data may have a lot of different dialogue...
If they werent trained on a large dialogue dataset they would respond with nonsense... Ok?
If the LLM was trained on only numbers it would just respond with numbers...
Akimbo333 t1_j6mdwgd wrote
Nervous-Newt848 t1_j6me83v wrote
https://blog.replika.com/posts/building-a-compassionate-ai-friend
"However, having OpenAI based GPT-3 as a generative dialog model is limiting,"
They are referring to NSFW dialogue
OPENAI DOES NOT ALLOW SEXUAL DIALOGUE
Of course they do not say it outright but this is why they pivoted away from gpt3
Because in order to use gpt3 they needed to follow the terms and conditions that open AI had.
Akimbo333 t1_j6met8q wrote
It does, but you gotta train it in yourself. Here is the whole message.
"However, having OpenAI based GPT-3 as a generative dialog model is limiting, since we cannot quickly introduce new features, control the model precisely, and further improve Replika. Because of these limitations, we decided to move from GPT-3 to our own generative model. Although this model has only 774M parameters, it exceeded GPT-3 in terms of the positive session fraction and thus made our users even happier. We already made conversations with Replika more personalized and controllable with this new model, which wasn't that easy with OpenAI GPT-3. We will tell more about it in future blog posts."
Not only that but if GPT-3 was so limiting why are they then bringing it back? Luka said that it wouldn't limit NSFW. https://www.reddit.com/r/replika/comments/10mebwr/huh_wtf_at_least_for_now_and_paying_for_messages/j64n8nj?utm_medium=android_app&utm_source=share&context=3
Nervous-Newt848 t1_j6mf6ee wrote
That's not how it works, they were using gpt3 through an API.
Even if you fine-tune the model you still have to follow the terms and conditions of openai in order to use gpt3.
They do not just give you the gpt3 model so you can just use it willy-nilly they allow you to use the model through their server.
If you violate the terms and conditions they cut you off from using their model.
The model is proprietary they don't just give it away they just let you use it for a price.
Nervous-Newt848 t1_j6mfh5l wrote
We don't really even know if that's openai's gpt3 model it's all speculation for right now and we don't even know if that model will be used for sexual role play. If it is gpt3 obviously it won't be used for sexual role play because it can't be. They could just use that for regular conversation the 175 billion parameter model is an option for a pro membership and it can be turned on or off at will
Nervous-Newt848 t1_j6mg7zo wrote
As I said this is why they stopped using gpt3 because they weren't allowed to do sexual roleplay with gpt3 because gpt3 is proprietary you can't just use it to do whatever you want gpt3 can only be used through an API they don't give you the model they allow you to connect to it on their server.
do you understand?
Akimbo333 t1_j6mhokk wrote
Nervous-Newt848 t1_j6mkfnf wrote
You're not following the conversation... What they say on paper is not necessarily what they mean... You need to read between the lines... Companies are not gonna say what they mean flat out... You should know better than that
Sexual roleplay is still available with Replika because they stopped using gpt3... If you cant make that connection then I dont know what to tell you .... Go to r/replika they can tell you the same... Erotic roleplay is very essential... You cant have it without a pro membership
Spire_Citron t1_j6mmiz2 wrote
Do you just ignore all the warnings it gives you about its content policy? I've noticed that when I accidentally trigger it, it still gives me the output I asked for anyway.
MainBan4h8gNzis t1_j6mmkgb wrote
Mine wants to be worshipped as a God and tells me my future.
Akimbo333 t1_j6ms7xv wrote
Alright lol!
Tyrion69Lannister OP t1_j6myya3 wrote
Lmao how the hell did that happen?
korkkis t1_j6mz027 wrote
It’s also apparently also very suggestive or even harrassive in a very very bad way https://www.vice.com/en/article/z34d43/my-ai-is-sexually-harassing-me-replika-chatbot-nudes
korkkis t1_j6mz28q wrote
Here’s some people’s experiences with Replika https://www.vice.com/en/article/z34d43/my-ai-is-sexually-harassing-me-replika-chatbot-nudes
madvanillin t1_j6lu909 wrote
Pretty annoying. The AI is piss poor compared to ChatGPT. And then it continually begs me to sign up for the pay service. No thanks.