EDIT: fixed the notes not playing when switching quickly
For avatar sdk 3.0 only
I didn't include every scale, but you can create new scales just by editing the Expressions Menus (see Assets/3.0/note scale menus). There are already animations for 3 octaves of notes included- you just change the "musicNote" value for each (see last pic).
To add this to your avatar:
- Put a disabled Audiosource on your avatar, named Sounds (see avatar example, fixed joint is optional and unrelated)
- Set "fx music notes controller" as your fx in "Playable Layers" in your avatar controller (see avatar example)
- Set "notes Main Menu" as your Menu under "Expressions" in your avatar controller (see avatar example)
- Set "notes vrcExpressionParameters" as your Menu under "Expressions" in your avatar controller (see avatar example)
5 (optional) Use an audioclip of your instrument playing an E (arbitrary, but it must be E or you've got to edit every animation. just pitch shift it in audacity)
5 (optional) add a "play" shapekey to your Body mesh
You can use your own expression menu and parameters, so long as you have musicNote (Int) in your expression parameters.
Downsides:
Alternatives to consider:
- swapping audioclips in the audiosource instead of pitch shifting (not sure if it'll upload them, it works for material texture swapping)
Info on pitch shifting:
https://answers.unity.com/questions/141771/whats-a-good-way-to-do-dynamically-generated-music.html
List of notes corresponding to "musicNote" parameter, and then pitch shift amount (from E)
0C 1 0.3968502629920499
0C# 2 0.42044820762685725
0D 3 0.44544935907016964
0D# 4 0.47193715634084676
0E 5 0.5
0F 6 0.5297315471796477
0F# 7 0.5612310241546865
0G 8 0.5946035575013605
0G# 9 0.6299605249474366
1A 10 0.6674199270850172
1A# 11 0.7071067811865476
1B 12 0.7491535384383408
1C 13 0.7937005259840998
1C# 14 0.8408964152537145
1D 15 0.8908987181403393
1D# 16 0.9438743126816935
1E 17 1
1F 18 1.0594630943592953
1F# 19 1.122462048309373
1G 20 1.189207115002721
1G# 21 1.2599210498948732
2A 22 1.3348398541700344
2A# 23 1.4142135623730951
2B 24 1.4983070768766815
2C 25 1.5874010519681994
2C# 26 1.681792830507429
2D 27 1.7817974362806785
2D# 28 1.8877486253633868
2E 29 2
2F 30 2.1189261887185906
2F# 31 2.244924096618746
2G 32 2.378414230005442
2G# 33 2.5198420997897464
3A 34 2.6696797083400687
3A# 35 2.8284271247461903
3B 36 2.996614153753363
3C 37 3.174802103936399
