
Term 2 — Week 3: 3D Tracking & Roto

This assignment is trying to let us use our imagination to add any elements we want to the video based on this scenery and the hot air balloon model we made.
So the story I made was about a hot air balloon that gradually appeared with particle effects and then flew away, and then alarmed the three cats hiding behind the mountain
The model of the hotballoon is made by MAYA
Since I wanted to have an artificially controlled gradual effect, I recreated the shader in blender to control its opacity
As we all know, rendering is a very essential step in film and animation productions. This report provides a two-fold perspective on the achievements and challenges of real-time rendering by reviewing the history and the technical background of the process as well as demonstrating the interactivity and wider possibilities of the previsualization of film the Lion King shoot and unity’s real-time rendering work Enemies, thus exploring how real-time rendering is influencing the film industry.
I chose this as the topic of my report because I found the direction interesting and the scope of its application very broad and challenging.
Before preparing this paper, my understanding of real-time rendering was only on some software applications, such as blender’s real-time rendering, but as my research progressed, I discovered that it is a very large and deep area that relies on the wisdom of previous generations to explore step by step. For example, the concept of ray tracing is not a recent one, as it has been explored as a research topic since the 1980s, but due to the lack of hardware computing power at the time, ray tracing progressed slowly until 2018, which is also considered to be the first year of ray tracing, This was the year that Star Wars short films with cinematic visual effects based on real-time ray tracing came to the spotlight.
Research :
The literature on this topic has been a great help in understanding and discovering the subject, Real Time Rendering, a book providing a detailed overview of the development, the categories as well as stages of rendering. I chose this book as a foundation because it is a must-read for real-time rendering, with challenging and enjoyable units on mathematical theories, graphics rendering pipelines, lighting, collision detection and more.
Contents :
I have divided the content into three main sections, the definition of real-time rendering, the hardware development background, and Application of real-time rendering in film. What ‘s more, I have selected two directions that I find typical with regards to the application, the first of which is real-time rendering as pre-visualization, which belongs to the pre-production stage of animation. the second one is latest Film productions based on real-time rendering such as Enemies.
The conclusion I come to is that real-time rendering redefines what is being worked on. Its real-time and interactive nature allows directors to preview the final film effect directly. Which also reduces time and production costs and increases the efficiency of collaboration across departments. This has the potential to re-divide the content of different positions. But to render out relying on high precision operations still requires offline rendering.
I’ve always wanted to make some cute and fluffy characters, what’s more, this is my first attempt to create my personal cat by blender. I learned about blender’s sculpting system and methods of topology, as well as the particle system for making hair.
Especially the method of using different vertex groups to make multiple layers of hair to make the character more vivid.
After trying many times, I found that the hair with such parameters is the most suitable
reference : Hair — Blender Manual
This class showed us how to compose the final movie by adding some rain effects , the background and correcting the color.
Render:
Select Render > Render Sequence and render the animation from within Maya.
Composition:
Finally, the background image and the falling rain were synthesized through After effects
This course has learned about the node of rotopaint, which is mainly used to erase unnecessary parts of the material. Among them, you should also pay attention to the use of the node Cornerpin (generating Cornerpin with location information through tracking points).
The Full Nodes:
Rotopaint:
Add shadow:
Reference resources:
https://pixabay.com/videos/minecraft-green-screen-fox-lowpoly-43551/
https://pixabay.com/videos/dance-green-screen-mindcraft-steve-46012/
http://3png.com/a-29180402.html
Tutorial:
Add shadow:
how to create shadow in nuke ( green screen) |shadow in nuke | nuke shadow tutorial
Advanced skeleton
This lesson continues to use blendshape to make facial expressions, so I want to try more methods about facial binding, so I tried the plug-in advanced skeleton
tutorial:
Method1:
Method 2:
We can use this method to track B when A is front B.
2D Tracking, Roto, Screen replace in Nuke
Roto: keylight
Dissolve node
Dissolve creates a weighted average of two inputs.
Multiply node: add it before merge node –the value can control the homepage and the original video
The effect of page scrolling: set keyframes of Transform node, add motionblur
The full node