I left Adobe to build a new kind of AI Film Studio to create genre-defining stories, reinvent how they’re made, and open source the software studio we make to the world for free.
For music composition we are using AI for some diegetic music and some simple background music and also for title sequences. But for primary composition where music is a character and it needs to augments the scene we are using composers. We may sometimes contract individual instrumentalists like a lead violinist but we are not using full orchestras.
For sound FX and foley we are using traditional SFX libraries and foley libraries augmented with custom sounds.
For environmental see are using libraries. Basically little AI for music and sound.
For actors, we are going full AI for visuals to maximize the perfect fit for the character and then for voice we are training custom models with the permission of the voice actor.
I really appreciate you taking the time to respond. I am a voice actor. Most of the voice acting industry is staunchly opposed to helping train the voice acting models so I fear the models are capturing the least of the talent in this niche. I also believe live actors and and voice actors are also artists.
They certainly are. In general, Any story, scene, or art related to telling a story that is done initially by technology will always be better if we add the human element. We are always looking to use human input where we can. After all, the stories we are trying to tell are about human connection and human stories.
With AI, a story can be told 100% with technology - and eventually it is feasible that it can do it as well as humans. But that isn't the most important point. I believe that we can always choose which world we want to live in- even if it's not the most efficient, profitable, or optimized. We can, and should, choose to live in the most rewarding and connected manner.
And that, will always, mean that we should purposefully choose to have the human touch.
I truly appreciate the art being owned by the artists. My question is this, are there any actors or composers, or are they replaced with Ai?
For music composition we are using AI for some diegetic music and some simple background music and also for title sequences. But for primary composition where music is a character and it needs to augments the scene we are using composers. We may sometimes contract individual instrumentalists like a lead violinist but we are not using full orchestras.
For sound FX and foley we are using traditional SFX libraries and foley libraries augmented with custom sounds.
For environmental see are using libraries. Basically little AI for music and sound.
For actors, we are going full AI for visuals to maximize the perfect fit for the character and then for voice we are training custom models with the permission of the voice actor.
I really appreciate you taking the time to respond. I am a voice actor. Most of the voice acting industry is staunchly opposed to helping train the voice acting models so I fear the models are capturing the least of the talent in this niche. I also believe live actors and and voice actors are also artists.
They certainly are. In general, Any story, scene, or art related to telling a story that is done initially by technology will always be better if we add the human element. We are always looking to use human input where we can. After all, the stories we are trying to tell are about human connection and human stories.
With AI, a story can be told 100% with technology - and eventually it is feasible that it can do it as well as humans. But that isn't the most important point. I believe that we can always choose which world we want to live in- even if it's not the most efficient, profitable, or optimized. We can, and should, choose to live in the most rewarding and connected manner.
And that, will always, mean that we should purposefully choose to have the human touch.