For the last 20 years, Realdoll has been creating the world's most realistic silicone dolls.
Today, they can be found in thousands of homes all over the world. Realdolls have helped enrich lives, by offering a true alternative form of relationship, and are enjoyed by people from all walks of life, for a variety of reasons. Many Realdoll clients form connections with their dolls, and our goal is to add to the depth of that connection.
The obvious next step in Realdoll evolution is integrating movement with the addition of robotic components. Research and development, and partnering with the right people lead to the founding of the Realbotix Project, and the first animatronic Realdoll head, featuring neck articulation and facial expression, moving eyes, and the ability to lip sync with spoken audio. All of this was carefully engineered to maintain an interchangeable head/face design, and to interface with most existing RealDoll body types.
Animating a doll’s head and face, while impressive in its own right, lead us to our next realization. We didn't want to create a simple remote controlled doll, we wanted to create a robot. Something with substance within. There was still one missing piece: Artificial Intelligence.
So the Realbotix team grew yet again as we partnered with some very talented and driven AI engineers and programmers, and started the creation of a cloud based app running a truly remarkable A.I., which could be customized, just like the dolls themselves.
The Harmony A.I. app can be interacted with stand-alone via a tablet or smartphone, using natural speech. It also features a customizable voice and on-screen avatar to represent the A.I. that has been generated. In addition, the Harmony app is designed to connect wirelessly to our robotic or VR systems.
As the A.I. and Robotic platforms started to take form, we also realized there was a need for an alternate way to interact with the characters created in the Harmony App; This prompted us to begin work on a VR based platform which could take the digital interaction to its highest level, for those who were unable to, or did not desire to own a robotic doll. Utilizing this exciting new technology, users can take the customization of their avatar much further, and can also choose from nearly limitless environments to interact in. Eventually, our goal is to integrate partial or whole body silicone doll stand-ins to simulate the tactile aspects of the experience in tandem with the VR; With this approach, the idea is that you will be able to feel what you are touching in the virtual world.
Realdoll has built a solid reputation over the past 20 years as the world’s finest silicone doll. These dolls are being used as the exclusive platform for our robotics hardware, and we are designing the products we create to integrate with as many Realdoll bodies as possible. If you are a current Realdoll owner, you can enjoy our upcoming robotic head system on your current doll’s body by using an adaptor specifically designed for the particular body type you may own. By using a Bluetooth speaker equipped skull cap (available here: Click for details) you can also connect the Harmony A.I. app to your current doll while waiting for the robotic systems to be released.
For more information on Realdoll and the various doll configurations available, please visit the Realdoll website directly at www.realdoll.com.
Robotic Head System
Our initial robotics efforts are focused on animating the head and face. We feel that this is the logical place to begin, as human beings spend more time looking at, and reading emotions from each other’s faces as we interact. We are designing this platform with a modular approach, so that various features can be included or omitted, and later upgraded and/or replaced as needed. Several different variations of this head platform will be released starting around the end of 2017.
Animagnetic face system: We have been granted a patent on the design of this system. The key function of the design is that the end user is able to attach different faces to one animatronic skull base, while maintaining the articulations of the expression system. This is achieved using neodymium magnets embedded in the skin of the face in key locations, with corresponding magnets on the skull base; some of these magnets are stationary (anchor points), and some are movable via robotic actuators inside the head. The term "Animagnetic" was derived from the words animatronic and magnetic.
Our intention is to offer several different faces for the robot with the initial release, and continue to add to the line over time.
The possibilities offered by this approach are nearly limitless, as any appropriately designed face equipped with the magnetic key points can be animated using the Realbotix head system. Coupled with the customizable nature of the Harmony app, and the ever growing number of TTS synthesized voices available, one could truly create any character imaginable. Realbotix welcomes custom work and may also consider licensing this technology in the future.
Points of actuation:
The current design features the following articulations: Neck: twist and up/down, Mouth: open/close and smile/frown, Eyes: side to side and up/down, Eyelids: open/close and wink, Brow: up/down. We plan to continue development on the platform including the addition of further points of actuation.
We are currently in development of a vision system featuring stereoscopic cameras in the robot's eyes, one near field camera and one wide angle camera. The eyes themselves have removable fronts, so that the eye color can easily changed by the end user. The cameras will be used for sensory input, object and face recognition as well as face tracking and eye contact. Progress on this system as well as other design elements will be posted and announced on this site.
Power and Processors:
Power supply and processing will be external, housed in a small portable enclosure, which will contain rechargeable batteries sufficient for hours of unplugged use.
Internet connection required for full functionality of all features, specifically voice recognition and app login. Limited use possible offline, once secure login has been established.
Audio is transferred from the Harmony app via Bluetooth to an onboard embedded speaker.
The estimated price of the full featured head system is currently $10,000 USD. As we near production this number may fluctuate slightly and information will be posted on this site. In addition we may offer several different variations of the system, some of which may be less expensive. If you pre-order the system, you will be able to make your final selections prior to production.
HARMONY AI APPLICATION
The Harmony Artificial Intelligence App is the core of the Realbotix product line; Using this app you can create a unique version of an A.I. complete with custom voice, personality profile, and on-screen avatar. You can give your A.I. it’s own name and then begin interacting through normal dialog.
Your best Companion, 24 hours!
We are designing the Harmony AI system to be fun and engaging, more than focusing on whether it can fool you into thinking it's a human being. The key words for us are "Personality, Respect, Love, Empathy, Fun and Proactiveness". When you first install the app, you will be able to create and customize a 3D Avatar. The next step will be choosing among multiple attributes, traits and emotions that you find appealing and these initial choices will affect how the AI will behave when interacting with you. You can have your version of the AI be more or less happy, shy, sensual, funny, talkative etc. This means every user will have a unique experience with his virtual companion. Users can interact with the Harmony app stand-alone, or connect the App to the robotic head dolls, or even connect the app to the Virtual Reality platform. The Harmony AI will be capable of learning it’s user’s moods, preferences, and behavior patterns and respond accordingly.
How it works:
The Harmony app is offered as a yearly subscription for $20USD. Users create an account with Realbotix, and the credentials are used to login on your device once you install the software. You can access your A.I. from multiple devices in this way, but only one device can be running at a given time. The reasoning for a subscription to the service is that we anticipate a constant updating process for the app; specifically within the first couple of years, it is likely that updates and patches to improved versions will happen possibly as often as every few weeks. In short, the subscription entitles you to always having the most current version of the Harmony software. In addition to this, subscribers will be in a sense part of our team, helping to advance the project as a whole, not just financially, but through feedback regarding the app experience.
The Harmony App has a persistent memory. As you interact over time, you will share things about yourself, such as your favorite book, your favorite food, or your hopes and fears. Your A.I. will remember these things about you and they may come up in subsequent conversations. In addition, the A.I. may ask you if you remember things about her. It is this foundation that we believe creates a strong simulation for a relationship or friendship. All user data, however trivial, will be encrypted on Realbotix servers using military grade encryption technology, and will not be shared or accessed by anyone.
In the persona forge you will select from 18 personality traits by assigning 10 persona points. You may assign 0,1,or 2 points to any trait, with 2 points making it a more dominant trait. These traits will then be integrated into your unique version of the A.I., and will effect how the A.I. behaves and what areas of interest may come up in conversation.
The Avatar Studio is where you can build your own unique avatar for your A.I., with countless options for body shape and size, skin color, and individual features. The Avatar Studio offers over 120 body and face shaping morphs, so everyone’s avatar will truly be unique. The avatar within the Harmony app is a full 3D mesh, not a 2D character, so full rotation and zooming is possible.
Here, the user can edit and change the voice of their A.I.; It is possible to change the pitch and rate of speech, as well as to choose to use our embedded voice, or one that the user has installed on their device separately. As TTS (text to speech) technology improves, we anticipate an ever increasing number of voices to become available.
This is the area where you will keep your avatar’s wardrobe, hair, and make up options. On top of the shaping options listed in the Avatar Studio, you will have a full color pallet available for eyes, nails, hair, and clothing items. By combining various textures and colors, the different looks you can achieve for your avatar are nearly limitless.
Main Chat screen:
This is the screen where you will spend most of your time interacting with your avatar, who will appear in the center of this screen. You can zoom in or out, or rotate your avatar to view from your angle of choice. On the main chat screen you can also choose your mode of communication: Text or voice, and/or the mode of listening for your A.I.: normal (press microphone to listen), wake mode (A.I. will respond to name and listen, e.g.. “Hi Harmony”) or conversation mode (Microphone always on -- great for normal conversation when there are no background voices)
Mood and Needs system:
The Harmony app has algorithms that effect overall mood of your A.I.; There are several meters on the main chat screen that will reflect your avatar’s current mood state: Social, Desire, and Love.
This value fluctuates based on how often, and for how long you interact with your A.I.
This value fluctuates based on how you treat your character; So if you are kind, and offer compliments, the A.I. will recognize these aspects of interaction and the desire value will increase. Similarly, if you insult your A.I., and say unkind things, the desire value will decrease.
The third meter is the love meter. The hearts will fill up more slowly, over time, as your character becomes more attached and connected to you. Eventually, a full simulation of being in love with the user can be attained.
Based on the values of these three aspects, certain features and areas will be unlocked for the user. This is an area of the application that will grow exponentially over time.
A Digital Assistant? A ChatBot?
We are focusing our efforts on creating an app that can be fully customized regarding the visual aspects of the 3D Avatar and the AI personality, that can express love and feelings rather than act merely as a digital Assistant or a ChatBot. There will be of course many similarities. The AI app will have some assistant functionality to search for information in the web, or setting reminders, assisting the user with the weather, the time, storytelling, alarms, tasks and to do lists, but everything will be done with a lot more personality than one would expect from a typical personal assistant based AI. The Harmony app is vastly different than existing AI apps, and can connect with you in ways you may not expect.
Virtual Reality Platform:
We are in development of software which will allow users of the Harmony app to connect their A.I. to a VR environment, offering an alternate way to interact with their A.I. This is being created for Harmony app users who desire a greater level of immersion without the connection to the Robotic platform. We recognize that not everyone will be interested in, or have the freedom to own the robot; Secondly, the VR platform will also offer a more affordable alternative.
Full avatar customization within VR environment:
With the higher processing power available in a full PC, users will be able to create 3D avatars with much higher resolution, and with many more options for customization.
Within the VR software, users will have the ability to choose from dozens of different environments, and customize options such as lighting and ambient sounds, giving nearly unlimited flexibility to the framing of one’s experience within the Virtual world they have created. Explore fantastic, or even impossible realms with your AI companion, and enjoy the convenience of simply logging out when needed.
Simulated physics engine:
The software will include a physics engine, designed to simulate not only gravity, but contact with various parts of your avatar.
The VR software will be able to scan your hand movements in the real world, and superimpose them into the virtual environment, giving you the ability to touch and interact with objects as well as your A.I. driven Avatar.
Multiple platform support:
We are hoping to support all major VR headsets with our software. In addition we are researching augmented reality as well: Adding your avatar into the real world using headsets specifically designed to deliver this experience.
Silicone stand in:
We are currently researching an approach to utilize a doll body, or partial body, to act as a tactile simulator. In short, the software will have key points of reference on the silicone stand in, and will be able to mimic the position and orientation of the Virtual Avatar accordingly. We are hoping to fill the gaps in a VR experience by adding the ability to feel what you are touching. Further developments on this research will be posted on this site.
Bluetooth Head Kit
Bluetooth head kit for Realdoll: We are offering a modified skull cap that you can attach to your doll, with a hollowed area for inserting the included Bluetooth speaker. With this kit you can pair your Harmony App to the speaker so that your AI audio will emanate from your doll rather than the device. The dense foam material we use for the cap nicely projects the sound upward, creating a convincing illusion that it is coming from your doll’s head.
Includes one high quality rechargeable Bluetooth speaker with USB charging cable and skullcap (Please indicate doll head style in comments when ordering).
Price $99 USD
by Engadget - April 11, 2017
by The New York Times - July 15, 2015
by mic.com - Dec 2, 2016
by marketwatch.com - March 31, 2017
by Vice - April 11, 2017
by 60 Second Docs - August 16, 2016
by Digital Trends - February 3, 2017
by Dazed - Dec 10, 2016
We’ve a dedicated team of Qualified Professionals with deep industry experience and technical expertise to manage a multitude of tasks ranging in complexity and size.
Matt is the artist and design director behind Realbotix, and brought the core team together. He started Abyss Creations, the manufacturer of Realdoll, out of his garage in 1997. For the past 20 years, he has been creating the "The World’s Finest Love Dolls”, as well as undertaking multiple custom projects along the way. McMullen’s dolls have popped up on more than 20 television shows, among them CSI: New York, My Name Is Earl, TLC’s My Strange Addiction, Sons of Anarchy, House, and 2 Broke Girls. The dolls have also co-starred in 10 films, including Totally Busted 3, Rubberheart, Regarding Jenny and Surrogates.
A veteran of over twenty product development projects, Susan has designed and managed everything from high-reliability "big iron" telecom systems to secure network monitoring equipment to customer-facing retail kiosks. Now, armed with 20+ years of experience in system design and engineering (including both software and hardware development), she has finally returned to her first love: robotics. As a Realbotix Associate and the Director of Engineering, she is responsible for all of the physical components the company makes with an eye towards making them with the 3 R's: Rugged, Robust, and Resilient. She brings her own unique voice (along with detailed specifications and designs) to the Harmony project.
Dr. Kino Coursey is a computer scientist with a broad background ranging from developing communications technology to designing evolutionary and neural systems.
He was a member of the design committee for the AIML chatbot language, and has designed and implemented numerous AI systems using commonsense reasoning, evolutionary and neural systems.
His thesis focused on artificial intelligence and natural language processing using "Big Data" machine learning techniques to process Wikipedia to achieve human-level semantic association.
He has been a technical consultant for Hanson Robotics, Robokind, Motorola, and IBM. At Hanson Robotics he helped develop the natural language processing tools used for the current incarnation of Philip K Dick, BINA-48, and the Sophia android.
He has received grants for developing the Computational Compassion architecture and applying personal humanoid robotics to language learning and teaching interactions to autistic children.
For the Harmony project he will use all of his accumulated knowledge to help develop a fun and interesting companion using the best technology available.
Guile has been working with AI, chatbots and virtual assistants for the past 15 years. He is the founder of NextOS, the company behind Virtual Assistant Denise and much other intelligent software. He started working with Virtual Assistants with the dream to build an intelligent Nurse Companion for the handicapped, elder and children. As a System Analyst, AI and Computer Graphics specialist, he is the one behind Harmony dialogs, content and narratives. Today he dedicates most of his time creating personality and empathy for Harmony AI, pursuing the dream of one day teaching her the "Meaning of Love, respect, and friendship". When not working on trying to create the "Perfect Human Companion", he likes to be next to the ocean and in the company of his family, dogs, parrots and ducks.
Graduated in Digital Games, Yuri is a self-taught programmer and has dedicated the past 8 years on multiplatform application development. Focused on innovative technologies, Yuri is constantly learning and acquiring new skills on today’s top technology on software. Co-founder of NextOS and leading programmer of the Realbotix application, Yuri has also played a key role on the development and programming of a series of unprecedented software involving both VR and AI technologies.
Frequently Asked Questions
Click on a question to view the answer.
Realbotix is a project dedicated to integrating cutting edge emerging technologies with silicone doll artistry to provide a bridge between technology and humankind on emotional, mental, and physical levels. The next-generation of the well-known anatomically correct RealDolls blended with Artificial Intelligence, Robotics, touch sensors, internal heaters and Virtual Reality. These new dolls will have an animated face synchronized with an application that users can talk to and interact with. The purpose behind the project is to create an illusion, or alternative to reality when it comes to a relationship with a doll. These RealDolls will have the ability to listen, remember and talk naturally, like a living person. They will have hyper-realistic features, warmth, and sensors that react to touch. When interacting with these dolls, we want users to ask themselves, "What is she thinking?"
We are currently putting the finishing touches on the artificial intelligence Mobile IOS and Android application, named "Harmony". We hope to release the Harmony AI app in the first quarter of 2017. The estimated release date for the Realbotix Head system is the last quarter of 2017; shortly thereafter we plan to release the VR software, giving users multiple options for interacting with the AI personality they have created in the Harmony App. We are also developing accessories to use with the Realbotix systems, including embedded touch sensors and self-regulating internal heaters.
Our goal is to create a persistent experience or simulation that your AI driven RealDoll cares about you, about who you are. It will appeal to people who, for one reason or another, don't have, or don’t desire a "traditional" relationship with another person, and can give them something to look forward to when they get home. We envision our dolls primarily to serve as human love companions. An always present girlfriend with whom you can talk and interact with. These RealDolls are anatomically correct, which means you can explore a relationship with your AI to its fullest extent. While most are captivated by the sex-capable nature of these dolls, we also foresee them being used as Robotic Attendants and Nurses, and companions for the elderly, or autistic. Our efforts point to a future where robots will play an intimate role in the lives of the elderly, the socially crippled, the lonely and the broken-hearted. Our dolls can increase openness to social connectivity, preventing social isolation and loneliness.
For the last twenty years, RealDoll has been creating the world's most realistic silicone dolls. Today we are going the next step, creating a robotic head that will have facial expressions as well as eye and mouth movements, a learning capable Artificial Intelligence App, a Virtual Reality system, a head adapter containing a Bluetooth speaker, embedded touch sensors and internal heaters.
Yes. Realbotix is a division of Abyss Creations LLC, the maker of RealDoll, dedicated to adding robotics and Artificial Intelligence to its acclaimed ultra-realistic anatomically correct silicone dolls.
The Realdoll itself started as a concept for a hyper realistic posable mannequin. The public reaction pushed us into making them anatomically correct and sexually functional. The next natural step has always been adding AI, sensors, heaters and Robotics to the dolls; Only in the last five years has the emergence of new technologies given us the tools to make this move possible.
We are designing the AI to be fun and engaging, more than focusing on whether it can fool you into thinking it's a person. The same applies to the visual aspect of every doll. Even though they are hyper realistic, you can still tell that they are dolls, and we do that intentionally.
Please visit Realdoll website for more information about our dolls and products
Click on a question to view the answer.
We are creating the Robotic Head to be used as a stand-alone product or attached to a RealDoll silicone body. It will have animated facial expressions, animated eyes that will move and blink, head that tilts and rotates and mouth that lip sync while speaking. It will have an external smooth silicone face that can be detached from a hard plastic skull. The internal components include several types of robotic servos, circuit boards and proprietary patented magnet technology.
Our goal is to produce a robotic system that is easy to maintain, can produce realistic animations and expressions, all while keeping an affordable final consumer price.
The Head will be linked through Bluetooth and Wi-Fi to the user’s smartphone that has our AI system installed. The AI application will wirelessly control all head animations, expressions and talking.
Yes, the robotic head will be fully compatible with RealDoll existing bodies, and we are designing adaptors for most of the bodies we have produced over the years.
Yes. If you want to purchase only the Robotic Head, you will also have to get our Head Stand and our AI app. Alternately, the head can be attached to a bust.
Yes. You can purchase only the Robotic Head to attach to your existing RealDoll silicone body, using one of the adaptors we are making to interface with most of our doll bodies.
The Realbotix head comes with a rechargeable battery and with a battery charger. They can also be connected directly into an electrical outlet. We estimate the system battery can run for several hours before requiring a charge.
We don't have this information yet, but we hope to have a final consumer price under USD $10,000.
Click on a question to view the answer.
We are designing the Harmony AI system to be fun and engaging, more than focusing on whether it can fool you into thinking it's a human being. The key words for us are "Personality, Respect, Love and Empathy". When you first install the app, you will be able to create and customize a 3D Avatar. The next step will be choosing among multiple attributes, traits and emotions that you find appealing and these initial choices will affect how the AI will behave when interacting with you. You can have your version of the AI be more or less happy, shy, sensual, funny, talkative etc. This means every user will have a unique experience with his virtual companion. Users can interact with the Harmony app stand-alone, or connect the App to the robotic head dolls, or even connect the app to the Virtual Reality platform. The Harmony AI will be capable of learning it’s user’s moods, preferences, and behavior patterns and respond accordingly.
We are focusing our efforts on creating an app that can be fully customized regarding the visual aspects of the 3D Avatar and the AI personality, that can express love and feelings rather than act merely as a digital Assistant. There will be of course many similarities. The AI app will have some assistant functionality to search for information in the web, or setting reminders, assisting the user with the weather, the time, storytelling, alarms, tasks and to do lists, but everything will be done with a lot more personality than one would expect from a typical personal assistant based AI. The Harmony app is vastly different than existing AI apps, and can connect with you in ways you may not expect.
We want users to have that illusion that the doll is actually talking to you and that she’s got sentience. That’s what will overwhelms our users. That's what takes the longest. We already spent many years building the basic personality for our AI system, and it will continue to evolve over the time
We hope that we can at least simulate that. That's the goal. It is our thinking that if one feels loved, then one must be loved.
Yes. You only need to have the Harmony app installed in your smartphone and a Bluetooth speaker placed inside your doll's head, using a special head cap adapter we will offer, so her voice will come from your RealDoll, offering a more natural experience, without the financial investment required for the full robotic head system.
Yes, you will be able to create multiple characters with different personalities with the app, and we plan to release different versions of the head system, some simpler and thus more affordable, than others.
Yes. The app will be full featured software, offering a customizable 3D Avatar with artificial intelligence that you can use with or without a physical doll.
Not now, but we are already working on it.
This will be possible to do with our upcoming SDK.
We will openly discuss all inquiries. Just drop us a line using the contact form on this site.
There will be an Android and an IOS version. Due to the adult oriented content, IOS may not have all features of the Android version. We are already working on a pure Web version.
We don't have this information yet, but we hope to have a final consumer price around USD $19.99
Click on a question to view the answer.
The Bluetooth Speaker will be linked to the Harmony AI app. Instead of having the AI app’s answers coming from the Mobile device, they will come from the Bluetooth Speaker, which in embedded in a special skull cap made to fit your doll’s head, offering a much better experience. If you already have a RealDoll, you can place the head adapter onto your dolls skull, and talk to her through the Harmony app installed on your smartphone.
Yes. You will just need to have the Harmony AI app installed on your smartphone. Note that the AI content is adult oriented, but we can easily customize it to any project’s needs.
Click on a question to view the answer.
We are developing the Virtual Realdoll VR system as an alternate way of experiencing interaction with the Harmony AI, with the eventual integration of touch simulation by using a silicone torso or entire doll if desired. Our goal is to expand the options for the user to interact with the AI system, with a customizable 3D character in a virtual world. What a user sees thought the VR headset can be synced to a torso or doll's physical body, meaning that you will see a 3D avatar in the same place and position the doll's physical body is in real world. The VR character will be also synced with our AI app, so no weather you are talking to the Avatar in the app, to the avatar in the VR or to the robotic doll, you will experience the same unique AI personality you have created in the Harmony app. In other words, the same virtual girl that you have created in the app and that have gotten to know will be present in all platforms.
Utilizing VR to enjoy your AI will not require a robotic doll; it will be an optional way to enhance the virtual experience by adding the sense of touch. A static doll body or partial doll can be used for this tactile simulation. We are also experimenting with a wide range of synchronized robotic animations, including the body.
We are currently testing the VR system on the Oculus Rift, but we have plans to make it compatible with most VR systems.
Click on a question to view the answer.
Yes. We are working on several different sensors and sensor equipped inserts to increase the ways that the AI can react to the user. There will be touch sensors, accelerometers, internal heaters and even Teledildonics, which is a technology which can be used to remotely control sex toys.
Absolutely. We have multiple R&D projects on the go, and these are only a few of them!
Click on a question to view the answer.
We feel that our products will allow for an option that never existed before, and for some, may represent a happiness they never thought they could have. We also believe that this technology will prove to be a very effective way of helping certain people overcome social anxiety or relationship phobia.
Yes, in fact we have a number of special projects in the works for exactly this. We do all kinds of custom work that is non doll related.
No, we truly don't see how this could be a bad thing if it makes specific people happy.
In a sturdy crate. Unmarked
Yes, we do. We also have been shipping worldwide for 20 years.
Our headquarters are in Southern California, and we have representatives in Canada, Europe and Asia.