⬩➤ Look into Meta’s Multimodal Input SDK for split hand-tracking / controller input.

****⬩➤ The design in the concept image is made with Mixed Reality in mind. Overlaying weapons or fake hands on top of your real life hands/controllers still looks kind of janky, even in professional releases. It will look and feel more natural to have attacks coming directly out of the player’s real hands. The tradeoff is losing 1 controller, which is a debatable choice, because of the aim for MMORPG-style combat depth (which usually involves many keybinds). We may need to switch to method that lets us use both controllers, but there are creative solutions with only 1.

⬩➤ The controller hand displays a HUD with 3 abilities (trigger, A, and B) and their cooldowns. To get much more out of this, the joystick controls which set of 3 abilities are active. Tilt it up, you get one set, tilt down, it swaps to another, and so on. So we will have up to 4 sets of 3, or 12 abilities.

⬩➤ Health, mana, and some other relevant information will be here.

⬩➤ Side button = menu