Topic: Fighting game based on real-time motion capture

Hello,

We are a start-up company focus on fitness games, and we try to make a fighting game based on real-time motion capture.

What we currently have
1. Use the camera to capture the movement in real time and transmit the rotation of the joint to Unity to display the human movement.
2. Base on pose recognition. As picture shows. After making the shock wave pose, the program recognizes and sends a message to Unity. Unity gives some effects and starts to accumulate power.  After player push out with both hands, and launch a shock wave in Unity.
https://i.postimg.cc/YjV4JCBr/1.png
https://i.postimg.cc/2VZqmNC4/2.png
https://i.postimg.cc/233bcBJ9/3.png

Now we want to make the game on UFE. Our current thinking is
1. Use 2D Fighter scene and 3D characters
2. Modify the source code, use motion capture data to drive the character
3. The player punches or kicks, which is the normal attack of the character, and the blow is judged by the box
4. Using pose recognition, the game character starts to accumulate energy, and uses some preset actions when making moves

I want to ask a few questions
1. Is the above idea possible?
2. The second step, using motion capture data to drive the character, how to do this, could you please give some tips.

Many thanks!

Share

Thumbs up Thumbs down

Re: Fighting game based on real-time motion capture

This sounds like a huge challenge when you don't use premade animations of any kind.
@MisterMind The main developer is gonna have to weigh in here.
I can't even imagine how you would go about when to create the active hitboxes that hit the other character.

Share

Thumbs up Thumbs down

Re: Fighting game based on real-time motion capture

Other then the use of auto hitboxes, I don't know how UFE could be of any help for this project.

Like UFE? Please rate and review us on the Asset Store!
Questions about the Forum? Check out our Karma FAQ.
Don't forget to check our discord channel.