Facial Tracking/ Motion Tracking

jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Facial Tracking/ Motion Tracking

Post by jeffroig »

I am interested in sharing my knowledge with others about facial tracking/ Motion Tracking.
I dont want to put alot of time into something if no one else is interested.
So if you are interested then send a reply to this thread and once I see that we have atleast 10 people that are interested I will then begin some lessons into this subject.
..
User avatar
LeonRegis
Captain
Posts: 1946
Joined: 18 Aug 2009, 17:36
Type the number ten into the box: 0
Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???

Re: Facial Tracking/ Motion Tracking

Post by LeonRegis »

I'm interested, since might I'll use in my future animations... Bur can we achieve smooth and realistic animations?

Cya
Be the change you want to see in the world. - Mohandas Gandhi
User avatar
tahnoak
Master Chief Petty Officer
Posts: 339
Joined: 02 Sep 2009, 01:31

Re: Facial Tracking/ Motion Tracking

Post by tahnoak »

Count me in too. I'd be interested in learning more about that.
User avatar
clintonman
Captain
Posts: 5659
Joined: 21 May 2009, 21:08
Type the number ten into the box: 0
Location: California

Re: Facial Tracking/ Motion Tracking

Post by clintonman »

Sounds interesting to me. What exactly did you have in mind?
Clinton Reese

http://clintons3d.com
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

To give you am idea on the topics I would like to cover here it is.
I will be starting with the software I use and you can download demo versions of it that are fully functional for 30 days.
Then move onto using the software, little tricks I have learned.
Then onto techniques of various types of motion capture.
Everything that I will be doing you can do with a web cam or video camera.
My plan is to show everyone that is interested how to do motion capture for a low cost and still good a good result.
No we wont be needing a motion capture suit or any elaborate camera and software so low cost software and you can get the desired results.
There is no cost to this, I just want to help everyone I can get up to speed so we can all create animations that we enjoy and have wanted to do for some time.
..
User avatar
Breech Block
Master Chief Petty Officer
Posts: 482
Joined: 13 Jun 2009, 20:31

Re: Facial Tracking/ Motion Tracking

Post by Breech Block »

I have recently acquired 4 webcams with the intention of using them to turn my garage into a motion capture studio using the same software. However, I was completly unaware that they could be used for capturing facial data. I would be very keen to learn how to to this and would much appreciate your sharing of knowledge and techniques.
v3rd3
Lieutenant Commander
Posts: 1191
Joined: 21 May 2009, 20:04

Re: Facial Tracking/ Motion Tracking

Post by v3rd3 »

I would be interested in these tuts.... :D
User avatar
marcel
Captain
Posts: 2247
Joined: 21 May 2009, 19:52
Type the number ten into the box: 0
Location: paris - France

Re: Facial Tracking/ Motion Tracking

Post by marcel »

jeffroig wrote:I am interested in sharing my knowledge with others about facial tracking/ Motion Tracking.
I dont want to put alot of time into something if no one else is interested.
So if you are interested then send a reply to this thread and once I see that we have atleast 10 people that are interested I will then begin some lessons into this subject.
If you post an example, many people can be interested, like me.
Design - illustration - Animation
http://www.crea-vision.fr
User avatar
Tommy
Master Chief Petty Officer
Posts: 403
Joined: 28 Jun 2009, 14:05
Type the number ten into the box: 0
Location: Sweden, Göteborg

Re: Facial Tracking/ Motion Tracking

Post by Tommy »

I'm also very interested in motion capture and to learn more. Which software do you use?
"Carpe diem"
User avatar
Steinie
Captain
Posts: 2958
Joined: 21 May 2009, 17:38
Type the number ten into the box: 10

Re: Facial Tracking/ Motion Tracking

Post by Steinie »

Count me in! Great that you want to do this Jeff.
We just need two more...
Prodigy, maybe announce this on the Main Page too?
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

Good to see the positive responses.
Here is a basic sample of head tracking using 4 markers and a webcam.
The process is simple and easy.

<object width="425" height="344"><param name="movie" value="http://www.youtube.com/v/BwMynAw4JJw&hl ... ram><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/BwMynAw4JJw&hl=en_US&fs=1&" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="425" height="344"></embed></object>[/youtube]
..
User avatar
Tommy
Master Chief Petty Officer
Posts: 403
Joined: 28 Jun 2009, 14:05
Type the number ten into the box: 0
Location: Sweden, Göteborg

Re: Facial Tracking/ Motion Tracking

Post by Tommy »

I'm impressed that this is possible. Now I have been really interested!
"Carpe diem"
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

This is just the basic tracking as things progress in the training I would like to show more detailed tracking.
..
Karthogen
Master Chief Petty Officer
Posts: 454
Joined: 03 Jun 2009, 14:12

Re: Facial Tracking/ Motion Tracking

Post by Karthogen »

That would be nice to see. If you get a chance to do a few tutorials.
User avatar
Steinie
Captain
Posts: 2958
Joined: 21 May 2009, 17:38
Type the number ten into the box: 10

Re: Facial Tracking/ Motion Tracking

Post by Steinie »

Pretty impressive!
Three questions.
How many tracking markers can this handle?
Can you apply tracking markers around the mouth (let's say 6 of them) to capture
detailed mouth movement?
Are you on the left or the right? :lol:
User avatar
RAYMAN
Captain
Posts: 2547
Joined: 21 May 2009, 18:56

Re: Facial Tracking/ Motion Tracking

Post by RAYMAN »

Here is another one sitting on the fence watching.... :)
Peter
User avatar
LeonRegis
Captain
Posts: 1946
Joined: 18 Aug 2009, 17:36
Type the number ten into the box: 0
Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???

Re: Facial Tracking/ Motion Tracking

Post by LeonRegis »

Amazing! I have the same questions of Steinie.... Also: We can track moves with just one camera? And we can put this in all body parts?

Thank you!
Be the change you want to see in the world. - Mohandas Gandhi
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

Lets see there is a total of 22 marker points for the face.
So yes the mouth is covered as well as the eyes and brow and cheeks.

As for body capturing the points are at each joint.

I am the better looking of the two...HAHAHA
..
User avatar
Finis
Captain
Posts: 5410
Joined: 21 May 2009, 18:26
Type the number ten into the box: 0
Location: America!

Re: Facial Tracking/ Motion Tracking

Post by Finis »

The facial tracking with markers was done with the same software you noted before? The two camera, no markers, high contrast needed one? The versatility to use markers or not would be good.
I prefer dangerous freedom over peaceful servitude. -- Thomas Jefferson/Jean Jacques Rousseau
User avatar
marcel
Captain
Posts: 2247
Joined: 21 May 2009, 19:52
Type the number ten into the box: 0
Location: paris - France

Re: Facial Tracking/ Motion Tracking

Post by marcel »

Now we need to learn also to be an actor :D
Design - illustration - Animation
http://www.crea-vision.fr
User avatar
LeonRegis
Captain
Posts: 1946
Joined: 18 Aug 2009, 17:36
Type the number ten into the box: 0
Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???

Re: Facial Tracking/ Motion Tracking

Post by LeonRegis »

Thank you for the answer Jeff! And about hands? I think we can reach smooth and cool moves, right?

Thank you! :worship:
Be the change you want to see in the world. - Mohandas Gandhi
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

Marcel,
You shouldnt have any problem in that department as acting should come natural for you.

I use two different softwares for my motion capture.

Let me put together some documentation and I will start the training.

I will leave it up to those interested as to what date would be good to start. Just dont choose today... The date with the most nominations will be it so each person put a date in and we will decide.
..
User avatar
LeonRegis
Captain
Posts: 1946
Joined: 18 Aug 2009, 17:36
Type the number ten into the box: 0
Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???

Re: Facial Tracking/ Motion Tracking

Post by LeonRegis »

For me it's ok between 3 or 6 days from now...
Be the change you want to see in the world. - Mohandas Gandhi
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

Here is a list of supplies you will need.
Software:
Zign Tracker (Demo Available)
Shoot3d (IPISoft) (Demo Available)
Virtual Dub (Free Video Editing software from sourceforge)
TrueSpace with BVH import or Poser or any other software that can import BVH files into it.

Hardware other than computer:
WebCam(s) of some sort or digital camera(s) with the ability to record movies.

Office Supplies:
White or Green or Red Adhesive dots or you can use adhesive white mailing labels and cut small squares.

Clothing:
Dark colored long sleeve shirt and dark pants (blue jeans will work)

Once you have these supplies together submit a message here letting me know and once we have 10 people ready to go then we can start.

Note: All of the softwares indicated above have public demos so you dont need to spend any money on software.
..
User avatar
Steinie
Captain
Posts: 2958
Joined: 21 May 2009, 17:38
Type the number ten into the box: 10

Re: Facial Tracking/ Motion Tracking

Post by Steinie »

If the Demo has a 30 trial period shouldn't we wait to download it
until the beginning of class?
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

Download it now but do not install it until we begin.
..
User avatar
LeonRegis
Captain
Posts: 1946
Joined: 18 Aug 2009, 17:36
Type the number ten into the box: 0
Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???

Re: Facial Tracking/ Motion Tracking

Post by LeonRegis »

I have the softwares... one webcam, one digital camera and one video camera, ie, three cameras. I have dark t-shirts, but they have things write, it will disturb the software? I have black pants but with some lines in another color, it will disturb the software? About the markers, can I pick white paper cut in squares or circles and then glue with tape? I can also paint the markers in another color...

Thank you!
Be the change you want to see in the world. - Mohandas Gandhi
v3rd3
Lieutenant Commander
Posts: 1191
Joined: 21 May 2009, 20:04

Re: Facial Tracking/ Motion Tracking

Post by v3rd3 »

Just a thought but many of us are heading into the Xmas season which will be very busy.

Would deferring the course to January (post hangover) work?
User avatar
LeonRegis
Captain
Posts: 1946
Joined: 18 Aug 2009, 17:36
Type the number ten into the box: 0
Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???

Re: Facial Tracking/ Motion Tracking

Post by LeonRegis »

I agree with v3rd3, after December 09 I'll be too busy. If we do it before, for me it's okay. How long would be the learning curve? If you think it's too big we can do it calmly in january.

Cya
Be the change you want to see in the world. - Mohandas Gandhi
User avatar
Tommy
Master Chief Petty Officer
Posts: 403
Joined: 28 Jun 2009, 14:05
Type the number ten into the box: 0
Location: Sweden, Göteborg

Re: Facial Tracking/ Motion Tracking

Post by Tommy »

I would also would like to wait until january. I have much work to do before the school semester ends before Christmas.

The middle of january would suit me. The spring semester has started and everything has settled.
"Carpe diem"
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

How does the date of January 16, 2010 sound to everyone.
Thats on a Saturday and Friday evening I can post the lesson so that Saturday you will have all day to work with it.
..
User avatar
Steinie
Captain
Posts: 2958
Joined: 21 May 2009, 17:38
Type the number ten into the box: 10

Re: Facial Tracking/ Motion Tracking

Post by Steinie »

Two thumbs up from me. :bananacool2:
I'm a banana what do you expect?
User avatar
LeonRegis
Captain
Posts: 1946
Joined: 18 Aug 2009, 17:36
Type the number ten into the box: 0
Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???

Re: Facial Tracking/ Motion Tracking

Post by LeonRegis »

For it's okay! :bananathumb:
Be the change you want to see in the world. - Mohandas Gandhi
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

One comment I would like to make so we are all clear on this.
I do not work for or support or endorse a software company.
The software I use is what I have found works for me purely by trial and error, you may find software that will work better for you.
The software I will be teaching on is low cost and easily obtained and can be learned easily, this will give you the basics and get you started on your way to being better at what you want to do.

Does everyone agree with the January 16, 2010 date?
..
User avatar
Breech Block
Master Chief Petty Officer
Posts: 482
Joined: 13 Jun 2009, 20:31

Re: Facial Tracking/ Motion Tracking

Post by Breech Block »

jeffroig wrote:How does the date of January 16, 2010 sound to everyone.
Perfect for me. :bananacool2:
User avatar
RAYMAN
Captain
Posts: 2547
Joined: 21 May 2009, 18:56

Re: Facial Tracking/ Motion Tracking

Post by RAYMAN »

perfect for me !
User avatar
marcel
Captain
Posts: 2247
Joined: 21 May 2009, 19:52
Type the number ten into the box: 0
Location: paris - France

Re: Facial Tracking/ Motion Tracking

Post by marcel »

perfect for me !
Design - illustration - Animation
http://www.crea-vision.fr
User avatar
tahnoak
Master Chief Petty Officer
Posts: 339
Joined: 02 Sep 2009, 01:31

Re: Facial Tracking/ Motion Tracking

Post by tahnoak »

I will be on travel for work but will try and follow along until I get back home. :(
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

I have been working intensively with the IPI Desktop Motion Capture software and have found some issues that will more than likely cause problems in your computers as it did in the four of mine I have been testing it with.
Issues range from unsupported video card, internal errors and crashes upon exporting and the blue screen of death on on computer. After finding out and learning that it is a very picky piece of software as to the hardware you use I started using a new piece of software that is very stable and does a very excellent job in motion capture and I have not had a single problem with it. Please take the time to check out http://www.innovision-systems.com/Produ ... raq2D.html Download the trial software. We will also be learing MotionBuilder, you can download a 30 day evaluation of it from Autodesk's website. I apologize for any confusion here, I am just glad that I found the errors before the class so each of us can work together as a team. I will also be posting so very useful links that I have researched about Motion Capture and the methods and various software that is available for this. The Zign Track software for facial movement is still a go and we will have a great time learning how this all works together. Until then I hope each and everyone has a very Merry Christmas and a Happy New Year..
Your Friend and Animator
Jeff Roig :)
..
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

Here are some useful links that you should take the time to check out.

http://www.motion-capture.de/ http://mo ... urn false;
..
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

Great News! I have been in conversation with the programmer of the software called DgeeMe.
For those that dont know of this software it is a video based motion capture program that is FREE.
The best thing is that it exports BVH motion files that can be used in TS or your favorite software.
To cut to the chase, the programmer is releasing a new and improved version in mid January and it will have improved support for this and have tutorials to help.
Below is a link for the past version of DgeeMe that has no time limits and is free to use.
Check it out and get familuar with it as I have found it very useful and easy to use.
I am trying to get the programmer to let us be testers of the software before he release it so we can help improve it for animators.
Here is a link were you can download the software. http://www.mediafire.com/?sharekey=02d8 ... e37b913e74

I am not the most experienced person with this software so we will all need to work together to figure out all the bugs.
Let me know what you think.
..
User avatar
LeonRegis
Captain
Posts: 1946
Joined: 18 Aug 2009, 17:36
Type the number ten into the box: 0
Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???

Re: Facial Tracking/ Motion Tracking

Post by LeonRegis »

A truly great news!
Be the change you want to see in the world. - Mohandas Gandhi
v3rd3
Lieutenant Commander
Posts: 1191
Joined: 21 May 2009, 20:04

Re: Facial Tracking/ Motion Tracking

Post by v3rd3 »

jeff, I would be more than happy to work through this as a tester.

Thanks for setting this up.
User avatar
richlevy
Senior Chief Petty Officer
Posts: 162
Joined: 17 Aug 2009, 20:08

Re: Facial Tracking/ Motion Tracking

Post by richlevy »

Cool little program! Nice find. I have some free time over the next few weeks so this might prove to be a nice diversion.

Thanks!

Rich
My Flickr site, here you can see some of the photography I do:
http://www.flickr.com/photos/rich-l/" onclick="window.open(this.href);return false;
jeffroig
Chief Warrant Officer
Posts: 662
Joined: 22 May 2009, 10:49
Type the number ten into the box: 0

Re: Facial Tracking/ Motion Tracking

Post by jeffroig »

Just to let you know when you do the calibration point 1 should be at the feet or base, point 2 should be the right, point 3 should be the left and point 4 should be the head. Choose the default 2d calibration and use 1.75. The programmer is working on some issues with the BVH export.
..

Return to “Jeffroig's Corner”