A Lot Of People Try To Explain This Without Knowing Anything About How Voice Synthesis Works, So Here's

A long infographic with visual aids starting with the conversation:
"Is Miku AI?"
"No."
"Are vocal synths ethical?"
"Yes."
"How so?"
First section is Compensation.
Hatsune Miku is made out of recordings by Saki Fujita. Saki Fujita is contracted to record Miku samples, and is paid for her work.

Section: Recording Method.
This is why Miku is not AI: Saki Fujita records from a list of sounds. It's necessary to have at least one recording per sound Miku should be able to sing. (Visual aid has examples of these sounds, such as "kaka".)
She can also sing the recording list a second time in a different octave, so that she sounds more natural.
Section: Labelling.
The samples Saki Fujita sung are then labelled with what sound they make. These sounds are then reproduced by the engine. This is how Vocal Synth software such as VOCALOID and UTAU work. This model is called "concatenative". (Visual aid shows how "kaka" is split into "k" and "a", which is how it looks in the VOCALOID software.)

Section: User interfacing.
These voicebanks are very flat. Users must adjust the vocals themselves in order to produce singing. This is referred to as "tuning". If you listen to "Tuning BLANK in the style of Vocaloid producers", you can see there are countless ways to tune Hatsune Miku. It is considered a form of artistic expression.
Compare Scratchin' Melodii's original songs to the updated versions. This is the result of hiring an experienced Vocaloid tuner.
Question: How do AI Vocal Synths work?
Answer: They are actually extremely similar!

Section: Compensation.
Let's use the Synthesizer V Studio library "Solaria". Solaria is made out of recordings by Emma Rowley. Emma Rowley is contracted to record Solaria samples, and paid for her work.
Section: Recording.
Emma Rowley then records several hours of singing data. This is the substance of the library.
Section: Base model.
The AI needs a base to understand what it's interpreting. Unlike images, there is a large amount of volunteer voice data out there. It's typically assumed that base models are trained ethically. (Visual aid shows Dreamtonics, the developer company behind Synthesizer V, asking a university "Can I use this voice data you made for TTS research?" and observing a person saying "Hi! Here is a few hours of singing data you can use for voice technology.")

Section: Labelling.
Labelling is also the same. The singing is broken up into phonemes the engine will interpret.
Header Section: Deep Learning.
In casual speech, "AI" refers to computer learning/sorting algorithms. "Diffusion" AI is the result of DNN; Deep Neural Network. It is the most drastic difference between concatenative and AI voicebanks.
Section: Teaching the base model.
The computer must be taught what the sounds are. The concept it builds is the "base model". (Visual guide is a cartoon of two computers talking. "Here's a british man saying 'bath'." "Added to my concept of 'a'." "Here's a Japanese girl saying 'baka'." "Added to my concept of 'a'.")
Section: Training the voice model.
Emma Rowley's recordings are then made into a reference point. This will make it so it will only render based on what it knows about Emma Rowley's singing. (Visual aid is a similar cartoon where a person talks to a computer while giving it a drive. Computer: "Now that I know what 'a' is, how should it sound?" Person: "I've labelled every time Emma Rowley says 'a'. Use this!")

Section: Diffusion.
The Solaria model uses everything it learned from Emma Rowley's recordings and the base mdoel to determine how 'a' sounds based on what note it's sung on, what's next to it, etcetera.
Section: Interfacing.
Tuners have been mixed on this; it sounds much clearer, yet the AI also has voice pitch models, so there's not as much as an incentive to develop your own personal flair.
Question: Are voice changers ethical?
Answer: Oh geez.

Section: ARE they ethical?
We don't need to break this down a third time. Voice changers are the generative AI of voice synthesis. It requires a lot less work of both the developer and the user, a simple applicator of everything the machine knows onto a piece of audio. What are the ranges of ethics?
Vocaloid 6 is packaged with a voice changer. It is only for AI libraries, voiced by people who agreed to this and were compensated. This is definitely ethical.
If you bought Hatsune Miku, you're nominally permitted to use the results as you see fit. Is tuning Miku and then creating a voice changer of her singing ethical? I genuinely don't know.
There's also a question of art. If you were to project the voice actor onto your own personal tuning work, isn't that still artistic expression? A voice is different from an art style. Where is human expression being interrupted by automation? I can't make an explainer for those subjective concepts.
I hope you're now educated enough to think on it yourself. End of image transcription.

A lot of people try to explain this without knowing anything about how voice synthesis works, so here's my breakdown on No, Hatsune Miku Is Not AI, And No, AI Voice Synthesis Is Not Bad.

More Posts from Zero0logy and Others

zero0logy

1 year ago

Stretch neck Tyler !!

2K notes View Post

zero0logy

2 years ago

HAVE THIS MEME I DID ( i know its not canon but i thought it would be funny 💀)

I did this because i was absolutely bored out of my mind : )

All characters belong to! : @yoel-o-fellow

Tags

twitter memes Octavius Ruggabour Ballentine Ruggabour Marvin Ruggabour idk why i put marvin for the cat He looks like a cat person to me! Octavius is just done And ballty...Is just Ballty! The Ruggabours

0 notes View Post

zero0logy

10 months ago

I’m back on the art grind : )

Tags

my art oc art oc artwork sorry for not posting do not repost without my permission zero0logy or being active 😞 Gray oc If you can guess who this drawing is based off of ill give you a free biscuit

2 notes View Post

zero0logy

11 months ago

A redraw of something I did a while ago… I was too lazy to finish the rest :/

Tags

my art vocaloid kagamine rin rin kagamine vocaloid 02 zero0logy

12 notes View Post

zero0logy

1 year ago

YES. YES. YES AND YES.

Have Noot proposing to you 👍

Daddymare belongs to Jokublog

Tags

undertale raaaghhh dreamtale nightmare sans bad sanses dreamtale nightmare AAAAAAA utmv i'm gonna explode i would marry him IM SCREAMINH

2K notes View Post

zero0logy

3 months ago

💙 Thank You for Helping Us Hold On

My name is Mosab, and I am writing this today with deep gratitude. Life here in Gaza has changed forever. I have lost 25 of my family members, and there are no words to describe the pain of losing the people who once made my world whole.

Each day is a struggle, filled with uncertainty. But something has kept us going—your kindness.

Because of people like you, we have reached $3,300 in donations. I never imagined that strangers would care enough to help, but here you are, proving that humanity still exists even in the darkest of times.

What Our Life Looks Like Right Now:

💔 The grief is unbearable. 25 people—gone, in an instant. 🥀 Dreams feel out of reach. Right now, survival is the only thing we can focus on.

Even $5 can make a difference. If you can’t donate, just sharing this post could mean everything to us.

I don’t know what the future holds, but I do know that because of you, we still have a reason to keep going. Thank you, from the bottom of my heart.

With love, Mosab & Family ❤️

Chuffed

Donate to Help Mosab saving who's left of his family

My name is Mosab Elderawi, and I am a survivor of the war in Gaza. Life as I knew it has been completely destroyed. I have lost my home, my

1K notes View Post

zero0logy

7 months ago

Hi, For five months I've been trying to find a friend to create a campaign for me. I was even able to create a campaign through my friend Brooke Cole so that the campaign would be reliable and the donation would be protected for everyone. My children are living under bombardment in the war 😭 Please consider them your children and help them 🙏🙏 Stand by my side to save and protect my children. They haven't gone to school for a year 🙏😢😢 Donate to save my children's lives 🍉 🙏🇵🇸 We live in very difficult and desperate circumstances, and what is worst of all is that the fear that haunts me increases day by day. Help me provide them with basic life needs

Guys please help this family. They’re only 22% from their goal. If they can reach 50% by November, I will be so delighted.

The link in their GFM is in their bye-ohs, but I’ll put the link here, just in case.

https://gofund.me/0d082b91

Tags

free help a family family in need zero0logy

1 note View Post

zero0logy

1 year ago