Facial Tracking/ Motion Tracking
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Facial Tracking/ Motion Tracking
I am interested in sharing my knowledge with others about facial tracking/ Motion Tracking.
I dont want to put alot of time into something if no one else is interested.
So if you are interested then send a reply to this thread and once I see that we have atleast 10 people that are interested I will then begin some lessons into this subject.
I dont want to put alot of time into something if no one else is interested.
So if you are interested then send a reply to this thread and once I see that we have atleast 10 people that are interested I will then begin some lessons into this subject.
..
-
LeonRegis
- Captain
- Posts: 1946
- Joined: 18 Aug 2009, 17:36
- Type the number ten into the box: 0
- Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???
Re: Facial Tracking/ Motion Tracking
I'm interested, since might I'll use in my future animations... Bur can we achieve smooth and realistic animations?
Cya
Cya
Be the change you want to see in the world. - Mohandas Gandhi
-
tahnoak
- Master Chief Petty Officer
- Posts: 339
- Joined: 02 Sep 2009, 01:31
Re: Facial Tracking/ Motion Tracking
Count me in too. I'd be interested in learning more about that.
-
clintonman
- Captain
- Posts: 5659
- Joined: 21 May 2009, 21:08
- Type the number ten into the box: 0
- Location: California
Re: Facial Tracking/ Motion Tracking
Sounds interesting to me. What exactly did you have in mind?
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
To give you am idea on the topics I would like to cover here it is.
I will be starting with the software I use and you can download demo versions of it that are fully functional for 30 days.
Then move onto using the software, little tricks I have learned.
Then onto techniques of various types of motion capture.
Everything that I will be doing you can do with a web cam or video camera.
My plan is to show everyone that is interested how to do motion capture for a low cost and still good a good result.
No we wont be needing a motion capture suit or any elaborate camera and software so low cost software and you can get the desired results.
There is no cost to this, I just want to help everyone I can get up to speed so we can all create animations that we enjoy and have wanted to do for some time.
I will be starting with the software I use and you can download demo versions of it that are fully functional for 30 days.
Then move onto using the software, little tricks I have learned.
Then onto techniques of various types of motion capture.
Everything that I will be doing you can do with a web cam or video camera.
My plan is to show everyone that is interested how to do motion capture for a low cost and still good a good result.
No we wont be needing a motion capture suit or any elaborate camera and software so low cost software and you can get the desired results.
There is no cost to this, I just want to help everyone I can get up to speed so we can all create animations that we enjoy and have wanted to do for some time.
..
-
Breech Block
- Master Chief Petty Officer
- Posts: 482
- Joined: 13 Jun 2009, 20:31
Re: Facial Tracking/ Motion Tracking
I have recently acquired 4 webcams with the intention of using them to turn my garage into a motion capture studio using the same software. However, I was completly unaware that they could be used for capturing facial data. I would be very keen to learn how to to this and would much appreciate your sharing of knowledge and techniques.
-
v3rd3
- Lieutenant Commander
- Posts: 1191
- Joined: 21 May 2009, 20:04
Re: Facial Tracking/ Motion Tracking
I would be interested in these tuts.... 
-
marcel
- Captain
- Posts: 2247
- Joined: 21 May 2009, 19:52
- Type the number ten into the box: 0
- Location: paris - France
Re: Facial Tracking/ Motion Tracking
If you post an example, many people can be interested, like me.jeffroig wrote:I am interested in sharing my knowledge with others about facial tracking/ Motion Tracking.
I dont want to put alot of time into something if no one else is interested.
So if you are interested then send a reply to this thread and once I see that we have atleast 10 people that are interested I will then begin some lessons into this subject.
Design - illustration - Animation
http://www.crea-vision.fr
http://www.crea-vision.fr
-
Tommy
- Master Chief Petty Officer
- Posts: 403
- Joined: 28 Jun 2009, 14:05
- Type the number ten into the box: 0
- Location: Sweden, Göteborg
Re: Facial Tracking/ Motion Tracking
I'm also very interested in motion capture and to learn more. Which software do you use?
"Carpe diem"
-
Steinie
- Captain
- Posts: 2958
- Joined: 21 May 2009, 17:38
- Type the number ten into the box: 10
Re: Facial Tracking/ Motion Tracking
Count me in! Great that you want to do this Jeff.
We just need two more...
Prodigy, maybe announce this on the Main Page too?
We just need two more...
Prodigy, maybe announce this on the Main Page too?
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
Good to see the positive responses.
Here is a basic sample of head tracking using 4 markers and a webcam.
The process is simple and easy.
<object width="425" height="344"><param name="movie" value="http://www.youtube.com/v/BwMynAw4JJw&hl ... ram><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/BwMynAw4JJw&hl=en_US&fs=1&" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="425" height="344"></embed></object>[/youtube]
Here is a basic sample of head tracking using 4 markers and a webcam.
The process is simple and easy.
<object width="425" height="344"><param name="movie" value="http://www.youtube.com/v/BwMynAw4JJw&hl ... ram><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/BwMynAw4JJw&hl=en_US&fs=1&" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="425" height="344"></embed></object>[/youtube]
..
-
Tommy
- Master Chief Petty Officer
- Posts: 403
- Joined: 28 Jun 2009, 14:05
- Type the number ten into the box: 0
- Location: Sweden, Göteborg
Re: Facial Tracking/ Motion Tracking
I'm impressed that this is possible. Now I have been really interested!
"Carpe diem"
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
This is just the basic tracking as things progress in the training I would like to show more detailed tracking.
..
-
Karthogen
- Master Chief Petty Officer
- Posts: 454
- Joined: 03 Jun 2009, 14:12
Re: Facial Tracking/ Motion Tracking
That would be nice to see. If you get a chance to do a few tutorials.
-
Steinie
- Captain
- Posts: 2958
- Joined: 21 May 2009, 17:38
- Type the number ten into the box: 10
Re: Facial Tracking/ Motion Tracking
Pretty impressive!
Three questions.
How many tracking markers can this handle?
Can you apply tracking markers around the mouth (let's say 6 of them) to capture
detailed mouth movement?
Are you on the left or the right?
Three questions.
How many tracking markers can this handle?
Can you apply tracking markers around the mouth (let's say 6 of them) to capture
detailed mouth movement?
Are you on the left or the right?
-
RAYMAN
- Captain
- Posts: 2547
- Joined: 21 May 2009, 18:56
Re: Facial Tracking/ Motion Tracking
Here is another one sitting on the fence watching....
Peter
Peter
-
LeonRegis
- Captain
- Posts: 1946
- Joined: 18 Aug 2009, 17:36
- Type the number ten into the box: 0
- Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???
Re: Facial Tracking/ Motion Tracking
Amazing! I have the same questions of Steinie.... Also: We can track moves with just one camera? And we can put this in all body parts?
Thank you!
Thank you!
Be the change you want to see in the world. - Mohandas Gandhi
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
Lets see there is a total of 22 marker points for the face.
So yes the mouth is covered as well as the eyes and brow and cheeks.
As for body capturing the points are at each joint.
I am the better looking of the two...HAHAHA
So yes the mouth is covered as well as the eyes and brow and cheeks.
As for body capturing the points are at each joint.
I am the better looking of the two...HAHAHA
..
-
Finis
- Captain
- Posts: 5410
- Joined: 21 May 2009, 18:26
- Type the number ten into the box: 0
- Location: America!
Re: Facial Tracking/ Motion Tracking
The facial tracking with markers was done with the same software you noted before? The two camera, no markers, high contrast needed one? The versatility to use markers or not would be good.
I prefer dangerous freedom over peaceful servitude. -- Thomas Jefferson/Jean Jacques Rousseau
-
marcel
- Captain
- Posts: 2247
- Joined: 21 May 2009, 19:52
- Type the number ten into the box: 0
- Location: paris - France
Re: Facial Tracking/ Motion Tracking
Now we need to learn also to be an actor 
Design - illustration - Animation
http://www.crea-vision.fr
http://www.crea-vision.fr
-
LeonRegis
- Captain
- Posts: 1946
- Joined: 18 Aug 2009, 17:36
- Type the number ten into the box: 0
- Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???
Re: Facial Tracking/ Motion Tracking
Thank you for the answer Jeff! And about hands? I think we can reach smooth and cool moves, right?
Thank you!
Thank you!
Be the change you want to see in the world. - Mohandas Gandhi
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
Marcel,
You shouldnt have any problem in that department as acting should come natural for you.
I use two different softwares for my motion capture.
Let me put together some documentation and I will start the training.
I will leave it up to those interested as to what date would be good to start. Just dont choose today... The date with the most nominations will be it so each person put a date in and we will decide.
You shouldnt have any problem in that department as acting should come natural for you.
I use two different softwares for my motion capture.
Let me put together some documentation and I will start the training.
I will leave it up to those interested as to what date would be good to start. Just dont choose today... The date with the most nominations will be it so each person put a date in and we will decide.
..
-
LeonRegis
- Captain
- Posts: 1946
- Joined: 18 Aug 2009, 17:36
- Type the number ten into the box: 0
- Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???
Re: Facial Tracking/ Motion Tracking
For me it's ok between 3 or 6 days from now...
Be the change you want to see in the world. - Mohandas Gandhi
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
Here is a list of supplies you will need.
Software:
Zign Tracker (Demo Available)
Shoot3d (IPISoft) (Demo Available)
Virtual Dub (Free Video Editing software from sourceforge)
TrueSpace with BVH import or Poser or any other software that can import BVH files into it.
Hardware other than computer:
WebCam(s) of some sort or digital camera(s) with the ability to record movies.
Office Supplies:
White or Green or Red Adhesive dots or you can use adhesive white mailing labels and cut small squares.
Clothing:
Dark colored long sleeve shirt and dark pants (blue jeans will work)
Once you have these supplies together submit a message here letting me know and once we have 10 people ready to go then we can start.
Note: All of the softwares indicated above have public demos so you dont need to spend any money on software.
Software:
Zign Tracker (Demo Available)
Shoot3d (IPISoft) (Demo Available)
Virtual Dub (Free Video Editing software from sourceforge)
TrueSpace with BVH import or Poser or any other software that can import BVH files into it.
Hardware other than computer:
WebCam(s) of some sort or digital camera(s) with the ability to record movies.
Office Supplies:
White or Green or Red Adhesive dots or you can use adhesive white mailing labels and cut small squares.
Clothing:
Dark colored long sleeve shirt and dark pants (blue jeans will work)
Once you have these supplies together submit a message here letting me know and once we have 10 people ready to go then we can start.
Note: All of the softwares indicated above have public demos so you dont need to spend any money on software.
..
-
Steinie
- Captain
- Posts: 2958
- Joined: 21 May 2009, 17:38
- Type the number ten into the box: 10
Re: Facial Tracking/ Motion Tracking
If the Demo has a 30 trial period shouldn't we wait to download it
until the beginning of class?
until the beginning of class?
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
Download it now but do not install it until we begin.
..
-
LeonRegis
- Captain
- Posts: 1946
- Joined: 18 Aug 2009, 17:36
- Type the number ten into the box: 0
- Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???
Re: Facial Tracking/ Motion Tracking
I have the softwares... one webcam, one digital camera and one video camera, ie, three cameras. I have dark t-shirts, but they have things write, it will disturb the software? I have black pants but with some lines in another color, it will disturb the software? About the markers, can I pick white paper cut in squares or circles and then glue with tape? I can also paint the markers in another color...
Thank you!
Thank you!
Be the change you want to see in the world. - Mohandas Gandhi
-
v3rd3
- Lieutenant Commander
- Posts: 1191
- Joined: 21 May 2009, 20:04
Re: Facial Tracking/ Motion Tracking
Just a thought but many of us are heading into the Xmas season which will be very busy.
Would deferring the course to January (post hangover) work?
Would deferring the course to January (post hangover) work?
-
LeonRegis
- Captain
- Posts: 1946
- Joined: 18 Aug 2009, 17:36
- Type the number ten into the box: 0
- Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???
Re: Facial Tracking/ Motion Tracking
I agree with v3rd3, after December 09 I'll be too busy. If we do it before, for me it's okay. How long would be the learning curve? If you think it's too big we can do it calmly in january.
Cya
Cya
Be the change you want to see in the world. - Mohandas Gandhi
-
Tommy
- Master Chief Petty Officer
- Posts: 403
- Joined: 28 Jun 2009, 14:05
- Type the number ten into the box: 0
- Location: Sweden, Göteborg
Re: Facial Tracking/ Motion Tracking
I would also would like to wait until january. I have much work to do before the school semester ends before Christmas.
The middle of january would suit me. The spring semester has started and everything has settled.
The middle of january would suit me. The spring semester has started and everything has settled.
"Carpe diem"
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
How does the date of January 16, 2010 sound to everyone.
Thats on a Saturday and Friday evening I can post the lesson so that Saturday you will have all day to work with it.
Thats on a Saturday and Friday evening I can post the lesson so that Saturday you will have all day to work with it.
..
-
Steinie
- Captain
- Posts: 2958
- Joined: 21 May 2009, 17:38
- Type the number ten into the box: 10
Re: Facial Tracking/ Motion Tracking
Two thumbs up from me.
I'm a banana what do you expect?
I'm a banana what do you expect?
-
LeonRegis
- Captain
- Posts: 1946
- Joined: 18 Aug 2009, 17:36
- Type the number ten into the box: 0
- Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???
Re: Facial Tracking/ Motion Tracking
For it's okay! 
Be the change you want to see in the world. - Mohandas Gandhi
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
One comment I would like to make so we are all clear on this.
I do not work for or support or endorse a software company.
The software I use is what I have found works for me purely by trial and error, you may find software that will work better for you.
The software I will be teaching on is low cost and easily obtained and can be learned easily, this will give you the basics and get you started on your way to being better at what you want to do.
Does everyone agree with the January 16, 2010 date?
I do not work for or support or endorse a software company.
The software I use is what I have found works for me purely by trial and error, you may find software that will work better for you.
The software I will be teaching on is low cost and easily obtained and can be learned easily, this will give you the basics and get you started on your way to being better at what you want to do.
Does everyone agree with the January 16, 2010 date?
..
-
Breech Block
- Master Chief Petty Officer
- Posts: 482
- Joined: 13 Jun 2009, 20:31
Re: Facial Tracking/ Motion Tracking
Perfect for me.jeffroig wrote:How does the date of January 16, 2010 sound to everyone.
-
RAYMAN
- Captain
- Posts: 2547
- Joined: 21 May 2009, 18:56
Re: Facial Tracking/ Motion Tracking
perfect for me !
-
marcel
- Captain
- Posts: 2247
- Joined: 21 May 2009, 19:52
- Type the number ten into the box: 0
- Location: paris - France
Re: Facial Tracking/ Motion Tracking
perfect for me !
Design - illustration - Animation
http://www.crea-vision.fr
http://www.crea-vision.fr
-
tahnoak
- Master Chief Petty Officer
- Posts: 339
- Joined: 02 Sep 2009, 01:31
Re: Facial Tracking/ Motion Tracking
I will be on travel for work but will try and follow along until I get back home. 
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
I have been working intensively with the IPI Desktop Motion Capture software and have found some issues that will more than likely cause problems in your computers as it did in the four of mine I have been testing it with.
Issues range from unsupported video card, internal errors and crashes upon exporting and the blue screen of death on on computer. After finding out and learning that it is a very picky piece of software as to the hardware you use I started using a new piece of software that is very stable and does a very excellent job in motion capture and I have not had a single problem with it. Please take the time to check out http://www.innovision-systems.com/Produ ... raq2D.html Download the trial software. We will also be learing MotionBuilder, you can download a 30 day evaluation of it from Autodesk's website. I apologize for any confusion here, I am just glad that I found the errors before the class so each of us can work together as a team. I will also be posting so very useful links that I have researched about Motion Capture and the methods and various software that is available for this. The Zign Track software for facial movement is still a go and we will have a great time learning how this all works together. Until then I hope each and everyone has a very Merry Christmas and a Happy New Year..
Your Friend and Animator
Jeff Roig
Issues range from unsupported video card, internal errors and crashes upon exporting and the blue screen of death on on computer. After finding out and learning that it is a very picky piece of software as to the hardware you use I started using a new piece of software that is very stable and does a very excellent job in motion capture and I have not had a single problem with it. Please take the time to check out http://www.innovision-systems.com/Produ ... raq2D.html Download the trial software. We will also be learing MotionBuilder, you can download a 30 day evaluation of it from Autodesk's website. I apologize for any confusion here, I am just glad that I found the errors before the class so each of us can work together as a team. I will also be posting so very useful links that I have researched about Motion Capture and the methods and various software that is available for this. The Zign Track software for facial movement is still a go and we will have a great time learning how this all works together. Until then I hope each and everyone has a very Merry Christmas and a Happy New Year..
Your Friend and Animator
Jeff Roig
..
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
Here are some useful links that you should take the time to check out.
http://www.motion-capture.de/ http://mo ... urn false;
http://www.motion-capture.de/ http://mo ... urn false;
..
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
Great News! I have been in conversation with the programmer of the software called DgeeMe.
For those that dont know of this software it is a video based motion capture program that is FREE.
The best thing is that it exports BVH motion files that can be used in TS or your favorite software.
To cut to the chase, the programmer is releasing a new and improved version in mid January and it will have improved support for this and have tutorials to help.
Below is a link for the past version of DgeeMe that has no time limits and is free to use.
Check it out and get familuar with it as I have found it very useful and easy to use.
I am trying to get the programmer to let us be testers of the software before he release it so we can help improve it for animators.
Here is a link were you can download the software. http://www.mediafire.com/?sharekey=02d8 ... e37b913e74
I am not the most experienced person with this software so we will all need to work together to figure out all the bugs.
Let me know what you think.
For those that dont know of this software it is a video based motion capture program that is FREE.
The best thing is that it exports BVH motion files that can be used in TS or your favorite software.
To cut to the chase, the programmer is releasing a new and improved version in mid January and it will have improved support for this and have tutorials to help.
Below is a link for the past version of DgeeMe that has no time limits and is free to use.
Check it out and get familuar with it as I have found it very useful and easy to use.
I am trying to get the programmer to let us be testers of the software before he release it so we can help improve it for animators.
Here is a link were you can download the software. http://www.mediafire.com/?sharekey=02d8 ... e37b913e74
I am not the most experienced person with this software so we will all need to work together to figure out all the bugs.
Let me know what you think.
..
-
LeonRegis
- Captain
- Posts: 1946
- Joined: 18 Aug 2009, 17:36
- Type the number ten into the box: 0
- Location: Brazil/Earth/Orion Arm/Milky Way/4th Dimension/This Universe/Multiverse???/Singularity???
Re: Facial Tracking/ Motion Tracking
A truly great news!
Be the change you want to see in the world. - Mohandas Gandhi
-
v3rd3
- Lieutenant Commander
- Posts: 1191
- Joined: 21 May 2009, 20:04
Re: Facial Tracking/ Motion Tracking
jeff, I would be more than happy to work through this as a tester.
Thanks for setting this up.
Thanks for setting this up.
-
richlevy
- Senior Chief Petty Officer
- Posts: 162
- Joined: 17 Aug 2009, 20:08
Re: Facial Tracking/ Motion Tracking
Cool little program! Nice find. I have some free time over the next few weeks so this might prove to be a nice diversion.
Thanks!
Rich
Thanks!
Rich
My Flickr site, here you can see some of the photography I do:
http://www.flickr.com/photos/rich-l/" onclick="window.open(this.href);return false;
http://www.flickr.com/photos/rich-l/" onclick="window.open(this.href);return false;
-
jeffroig
- Chief Warrant Officer
- Posts: 662
- Joined: 22 May 2009, 10:49
- Type the number ten into the box: 0
Re: Facial Tracking/ Motion Tracking
Just to let you know when you do the calibration point 1 should be at the feet or base, point 2 should be the right, point 3 should be the left and point 4 should be the head. Choose the default 2d calibration and use 1.75. The programmer is working on some issues with the BVH export.
..
