top of page

Current Trends of VFX

Week 1- The Age of the Image and the Trend of the Lens

To kick off the first week, we had a discussion about the module and in its self the current trends in VFX. In this modern age the possibilities of VFX is endless; with time green screens have been a big trend in the world of moviemaking/vfx and still is, nowadays you have the use of LED screens. LED screens enables artists to create a CGI background before filming, improved colour balance, contrast, and generally display; and it's really easy to move around and quick saving quite some time. Virtual sets can be pricey, but is worth the investment with time it'll save time and money as artists don't need to build new sets. I had a brief google search and one of the latest tv series The Mandalorian used LED screens in their filming.  

The Mandalorian

Behind the scenes making of The Mandalorian

Camera is connected to the background, so if the camera moves the background does too to fit its field of view,

Advances some time ago (think prequels-era Star Wars) enabled cameras to display a rough pre-visualization of what the final film would look like, instantly substituting CG backgrounds and characters onto monitors. Sure, that helps with composition and camera movement, but the world of the film isn’t there, the way it is with practical sets and on-site shoots. [Click Here to see full article]

After our discussions we watched a documentary called Age of the image on BBC. James Foxx the presenter on this documentary discusses how images have transformed the world around us in this day and age. A key factor James mentioned was people will travel from all parts of the world to see the famous painting of the Mona Lisa and a huge number of people don't even look the painting directly with the eyes but look through a phone or take a selfie with it. The documentary then goes on to answer questions; as well as talking about the last century from the begin till the modern age where artists can design anything with the use of CGI. 

- - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - -

Week 2- The Photographic truth claim: Can we believe what we see?

Plato had a theory called Plato's analogy of the cave.  In the allegory, Socrates describes a group of people who have lived chained to the wall of a cave all of their lives, facing a blank wall. The people watch shadows projected on the wall from objects passing in front of a fire behind them and give names to these shadows. The shadows are the prisoners' reality but are not accurate representations of the real world. Socrates explains how the philosopher is like a prisoner who is freed from the cave and comes to understand that the shadows on the wall are not reality at all. A philosopher aims to understand and perceive the higher levels of reality. However, the other inmates of the cave do not even desire to leave their prison, for they know no better life.

Image showing Plato's theory

What you think is meant by the theory: The Photographic Truth-Claim?

"It appears that as photography has gone digital and it has become so much easier to manipulate images critique of what the truth is has caused many critics to question the truthfulness and honesty of digital photographs. Tom Gunning claims that traditional methods of photography are more truthful. That they are more honest and a closer reflection of reality than modern methods. He appears to believe that light affecting chemicals on paper is somehow less open to manipulation than digital data about about light. Gunning also talks about a photograph’s indexicality and how closely a photograph resembles the person or object that it represents."

​

References

AlisonJR. (November 27th 2014). Photographic Truth Claim. Available: https://ajrphotographs.wordpress.com/2014/11/27/photographic-truth-claim/. Last accessed 9th November 2020.

The image shows the traditional green screen and with the use of various software’s such as Photoshop, After Effects and various others. Allow artists to create a scene which looks like it was taken in reality. When it comes to pictures a simple image can be altered with the use of Photoshop/Lightroom and can completely transform an image, making whatever taken look digitally altered.

Here is another photo of how pictures we’re once taken, black and white with no colour. It’s incredible to see how taking pictures has evolved.

- - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - -

Write a definition of VFX compositing. What is it and how does it work?

​

“VFX Compositing is the process/technique of combining of visual elements from separate sources into single images, often to create the illusion that all those elements are parts of the same scene.” Now day’s almost every single film/tv series have some sort of VFX compositing in production. Below are some images I sourced that shows pre and post production of VFX compositing.

Wikipedia. (NA). 

​

With what VFX compositing allow artists to do within the VFX scene is incredible, almost everything in this modern age uses some sort of VFX. A few examples of this for instance is the use of VFX on TV, Adverts, Billboards.. these are just a few. I can just see the world of VFX evolving even more beyond what it has already. It's crazy when you think about how far VFX has come, you now have analogue artefacts/digital characteristics, which is basically the use dust, lens flares, noise elements just a few to mention. By adding these elements it helps artists come up with a more photorealistic effect. Analogue artefacts help the orientation within a scene allowing the final composite to be more convincing to the human eye; making it look as though it was captured in real time.

​

References

Compositing. Available: https://en.wikipedia.org/wiki/Compositing. Last accessed 9th November 2020.

​

- - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - -

Blogpost on Photorealism

​

Photorealism is a form of art from paintings, drawings, graphic media and various others mimicking the realism of the real world. Photorealism is technically a from of CGI; doesn’t only need to be a form of an image but can be a video, Oscar winning films such as Lion King was shot and looks like it has complete photorealism. Nevertheless there is the obstacle of making the images to realistic as if this was supposed to happen it would disrupt the illusion of reality and fall into the category of ‘uncanny valley’. I’ll now go through some examples Lion King (2019) was made completely through CGI, everything within this movie looked real from the characters to the scenery. The movement of animals also looked completely real; if someone watched a clip from the film they would easily be able to mistake it for something being shot straight of a camera. With the way the industry is moving it’ll be really interesting to see how VFX artists will elevate there skills further especially with all the new tools at there disposal breaking boundaries using photorealism.

With the use of CGI, artists are able to recreate photorealism synthetic humans 

Two images from The Lion King movie, showing the photorealism artists are able to achieve

- - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - -

Week 5-  A digital Index : Bringing truth into VFX via the capture of movement

Blogpost on  Comparing motion capture to key frame animation

​

​

Motion capture uses data results to generate movement, key frame animation uses drawings to generate movement to a model. The downside to key frame animation is drawing can take a lot of time to create.  Motion capture uses sensors placed on the models body; these sensors convert the movements made from the model and converts them into data. The advantage of using motion capture is that it enables artists to create their desired goal without wasting time or having the need to model or key frame the necessities from scratch, as well as being able to capture accurate human movements. There can also be a disadvantage to motion capture such as the cost and that if any of the sensors fall off within the process of gathering data, it will jumble up the data recorded making it invalid to use.

 

 “The moves appeared real enough, but the figure lost the illusion of life. There was a certain authority in the movement and a presence that came out of the whole action, but it was impossible to become emotionally involved with this eerie”.

Frank Thomas and Ollie Johnston. p. 323; Disney Animation – The Illusion of Life

​

This conveys a feel of the uncanny valley, as CGI artists would be able to replicate human facial movements identically compared to how key frame animation. A really good example is Lion King (2019) if you compare the film to the animated version released in 1994, the characters movements are extremely different. The Lion King (2019) character movements replicate exactly how the creatures would move in real life, whereas if you compared the key frame animation of The Lion King (1994) character movements you’d be able to see a significant difference.

​

References

Frank Thomas and Ollie Johnston. p. 323; Disney Animation – The Illusion of Life

- - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - -

Week 6 : Digital Index: Reality capture ( LIDAR) & VFX

Blogpost on Writing a post on reality capture 

​

To simplify reality capture, it’s basically scanning the most accurate data when it comes to real world conditions. Most used type of reality capture uses laser scanners, UAV photogrammetry to produce simple images. These files sizes range from a few hundred megabytes to monstrous 100s of gigabytes of data. The advantage of reality capture allows artists to alter RGB values for each individual point for the scan taken. These file scans can then be imported into programmes such as Autodesk Maya allowing artists to then get a true material/texture effect from the reality capture file. “Like all new technologies,  reality capture solutions grew  from adaptations to  existing technologies. In this case, reality capture tools stemmed from traditional survey (which is still the foundation and key element in collecting accurate data that is in project coordinates and can be easily utilized during any project phase).” (Smith, B.)

To summarise 3 reasons to try RC allows quicker analysis of existing and as-built conditions, new technology allow anyone to collect and process data as well as  3D data improves communication and level of understanding.

​

References

Smith, B. (NA). REALITY CAPTURE 101: WHAT IT IS AND WHY YOU NEED TO USE IT. Available: https://www.aecnext.com/realitycapture101/. Last accessed 23 Nov 2020.

- - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - -

Assignment 2- Essay Question

For assignment 2 I decided to go with 'Option 2' as I found it the most interesting of all 3 options. Below I've included the essay question as well as all my research and references used for this essay question. 

While I was picking my essay option, I was doing some research and found the video above quite interesting and thought I'd reference it on my site.

- - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - -

Presentation

- - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - - - - - - - - - - - - -  - - -  - - - - - - - - - - -  - - -  - - - - - - - -

Essay

Assignment 2: New Trends of Capture and Real-Time Filmmaking lead us to consider if the traditional approaches to 3D Modelling, Animation and Rendering are still be needed?

 

 

For assignment 2 I decided to go with option 2- “New Trends of Capture and Real-Time Filmmaking lead us to consider if the traditional approaches to 3D Modelling, Animation and Rendering are still be needed?”.  The visual effects industry has developed vastly and continues to do so, in this essay I will discussing visual effects manipulating the realism of photographic images in comparison to imprint of reality but mainly focusing on the new trends of capture and real time; and if the traditional approaches such as 3D modelling, animation and rendering are still needed in this new age of visual effects.

 

Visual Effects has opened a new realm in terms of what artists can create, and not only within VFX but also within photography. Cameras have developed tremendously from 1685 when Johann Zahn invented the first ever camera; in modern age there are over 15 different types of cameras which all do the same thing but all have their own unique capabilities. https://en.wikipedia.org/wiki/List_of_camera_types [List of camera types]. Black and white images/videos in an old era has come a long way, creating surreal images/videos in this new age, we can now create memories with a click of a few buttons/settings. Visual effects subsequently allowed artists to enhance what they create by producing imagery digitally. An example of this is the destruction of buildings in movies such as 2012 or clever camera manipulation seen in a film such as Inception. All these effects used look as though they we’re captured in reality when in fact they are all man made within editing software’s. I found an extremely interesting video on Youtube about the making of the film 2012, within this video it goes in depth of all the various techniques used to create this outstanding film. https://www.youtube.com/watch?v=5aMXmxQBsoA&ab_channel=TheCGChannel [Making of 2012]. As remarkable as visual effects is with the use of editing programs; there is also another side to visual effects where makers can use different techniques such as: keyframe animation, motion capture, 3D scanning, modelling and rendering to create.

 

3D scanning is the process of analysing real world objects and environments to collect data on its appearance and shape. The collected data is used to construct 3D models/environments; which is a massively used within the industry. I found an example of a scene that was fabricated with the use of 3D scanning in a well known tv series called Gotham. https://vimeo.com/167931020. [CoSA VFX Gotham Season 2 - VFX Reel]

I’ve also included a few screenshots of a breakdown pre and post production of a few elements of 3D scanning being used within a scene. On the other hand to 3D scanning you’ve got modelling, however modelling requires more time and then needs to be textured; once the model is created it can be altered and more can be added whereas with 3D scanned objects you can not alter. Rendering is a process of generating photorealistic and non photorealistic images from 2D or 3D with the use of a computer program, this is called render/rendered once the artist has completed their project.

If you’ve watched Gotham Season 2 you’ll remember this iconic shot because it’s the first time Mr. Freeze gets into action. It’s a great combination of frost effects and a 360 degrees “bullet-time”-like camera movement.

Picture3.png

Here’s another Skanect screengrab. The object next to the hand is the Structure Sensor.

Here’s the actress captured by CoSa VFX with a Structure Sensor and Skanect. The small cubes are the depth sensor’s path around the actress.

Picture4.png

And here’s the result with that poor guy that had a bad wake-up from cryosleep.

[HOW 3D SCANNING WAS USED TO CREATE THE VISUAL EFFECTS FOR GOTHAM]

Going back to the words of Paul Delaroche, I don’t agree with his statement of painting as a medium being dead. The reason why is because no matter how many new methods are released overtime every technique has its own unique purpose just like how above I mentioned many types of different cameras, each and every one has its own significant purpose. Just how a painting would have it’s own unique style in comparison to something being drawn etc…

 

Keyframe animation and motion capture are both alike but yet quite different in their own ways. Keyframe animations are extremely easy to execute in programs such as Autodesk Maya; this is because you can create a rig character which you can pose joints and keyframe which will unlock the specific movement in a 3D space. After each keyframe has been set within Maya it will automatically interpret the in between movement allowing animators to refine the core pose which can be exaggerated as much as the animator pleases. Motion capture is a digital representation of an actor which captures subtle behaviour patterns which are often lost when animators transfer character movements into keyframe animation. To use motion capture you need cameras 360° around the actor, you could have as many cameras as you like; the more cameras you have the more of an accurate reading you’ll get.

 

The film ‘The Polar Express’ was the first ever movie to be made using performance capture technology; also known as motion capture. Robert Zemeckis the director of the movie was known for using technology in his movies, he asked Tom Hanks to play 6 different roles within The Polar Express: The Conductor, Hobo, Scrooge puppet, Santa, Father and the hero boy. Animators went through a lot of work during the production of this movie from creating every single strand of hair for each character to animating the hair moving and to also designing each costume which every character would play. Once the step of the costume was created it would then need to be scanned into the computer for animation. It’s crazy to see how far modern technology has come saving money and more importantly time.

https://www.youtube.com/watch?v=YwLCqVGHpTM&ab_channel=EditG

Edit G. (January 17th 2007). The Polar Express_Behind the Scenes.

 

https://www.youtube.com/watch?v=voVPO8w9-x4&ab_channel=UnrealEngine

Unreal Engine. (24th October 2018). Virtual Production: A New Era of Filmmaking | Unreal Engine.

I watched a video from Unreal Engine, within this video it was a snipet behind the scenes of how far production has come. They also mention how with the use of game engines it has become a huge part of virtual production, allowing creators to enhance the render quality. Using game engine has allowed creators to more accurately simulate the real world in terms of lighting. The main advantage of using this is allowing the creators to create and being able to adust in real time. This allows them to not waste any time by going back and forth and they are able to create eveything exactly how the director perceives. The use of LED screens also significantly improve the production of films by allowing the actors on set to see souroundings of the scene being shot, whereas if LED screens were not available they would have to use greenscreens. Greenscreens are still used vastly while filming, however the downside of using LED screens is the cost that goes into purchasing; but the effects it allows the actors to experience in real time is phenomenal. The Mandalorian was one of the first tv series to use LED screens while filming. As well as all the positives I mentioned above LED screens make the lighting better, filming smooher.

https://www.youtube.com/watch?v=Ufp8weYYDE8&ab_channel=Insider

Insider. (11th June 2020). Why 'The Mandalorian' Uses Virtual Sets Over Green Screen | Movies Insider.

I watched the video above, on The Mandalorian using virtual sets over green screen and found it quite intresting on how LED screens we’re used allowing the creators to create a lot of shots they otherwise wouldn’t have been able to achieve with the use of a green screen; by this I mean if they wanted to record a different angle within a scene; the use of the LED screens would allow the creators to achieve the desired angles they we’re going for whereas with the use of a green screen that’d not be possible. The LED screen would allow a 360° angle within the scene allowing the cameraman to record from any angle without the need of altering anything because the scene has already been rendered on the screens.

https://www.youtube.com/watch?v=ysIOi_MP_cs&ab_channel=HiveDivision

Hive Division. (24th July 2020). LED Wall Virtual Production - Bye Bye Green

I found the video above quite interesting going into more depth on the use of green screens and how it benefits the actors on set as well as the production team, further adding giving a true sense of lighting while filming within the current scene.

 

It’s surreal to say there was once a man called Plato, and he had his theory about the cave.
To simplify, Plato basically said that everything we see isn't always real and our senses can easily fool us. We can see examples of this in photographs (photoshop), film (vfx) and other forms of media. 

Below shows an image illustrating the theory.

Wikimedia Commons. (24th October 2018). An Illustration of The Allegory of the Cave, from Plato’s Republic.jpg.

"Traditional and digital photography can both lessen, ignore or undo the indexical"- Gunning, T. (2004) ‘What’s the Point of an Index? or, Faking Photographs’, Plenary Session II, Digital Aesthetics, 1(25), pp. 39-48

 

TED (2019)  'Why most visual effects suck—but some don't?  Available at: https://www.ted.com/talks/wren_weichman_why_most_visual_effects_suck_but_some_don_t (Accessed: 8th January 2021)

I came across this video online, and found it really interesting, Wren Weichman talks about the power of vfx.

 

All in all I feel as though the traditional approaches to 3D Modelling, Animation and Rendering will always be needed as a fundamental. It may be getting updated with all the new tech being developed and allowing creators to do certain tasks more rapidly but within the industry to date all these ‘traditional’ approaches are still being used to a certain degree and the classic quote ‘If it isn’t broke, don't fix it’ comes to mind. As well as my point above not every production have the budget to use all the new technology so they would have to use the traditional approach.

 

References

 

List of camera types. Available: https://en.wikipedia.org/wiki/List_of_camera_types. Last accessed 3rd January 2021.

 

Making of 2012 (March 2010). Making of 2012. Available: https://www.youtube.com/watch?v=5aMXmxQBsoA&ab_channel=TheCGChannel. Last accessed 3rd January 2021.

 

CoSA VFX. (24th May 2016). CoSA VFX Gotham Season 2 - VFX Reel. Available: https://vimeo.com/167931020. Last accessed 5th January 2021.

 

Nick Lievendag. (6th July 2016). HOW 3D SCANNING WAS USED TO CREATE THE VISUAL EFFECTS FOR GOTHAM. Available: https://3dscanexpert.com/3d-scanning-gotham-visual-effects/. Last accessed 5th January 2021.

 

Abbie Willett. (May 8th 2014). Comparing the aesthetic qualities of Motion Capture and Keyframe animation!. Available: https://www.youtube.com/watch?v=_73JWyjAVDQ&ab_channel=AbbieWillett. Last accessed 5th January 2021.

 

Edit G. (January 17th 2007). The Polar Express_Behind the Scenes. Available: https://www.youtube.com/watch?v=YwLCqVGHpTM&ab_channel=EditG. Last accessed 8th January 2021.

 

Unreal Engine. (24th October 2018). Virtual Production: A New Era of Filmmaking | Unreal Engine. Available: https://www.youtube.com/watch?v=voVPO8w9-x4&ab_channel=UnrealEngine. Last accessed 8th January 2021.

 

Insider. (11th June 2020). Why 'The Mandalorian' Uses Virtual Sets Over Green Screen | Movies Insider. Available: https://www.youtube.com/watch?v=Ufp8weYYDE8&ab_channel=Insider. Last accessed 7th January 2021.

 

Hive Division. (24th July 2020). LED Wall Virtual Production - Bye Bye Green Screen. Available: https://www.youtube.com/watch?v=ysIOi_MP_cs&ab_channel=HiveDivision. Last accessed 5th January 2021.

 

Wikimedia Commons. (24th October 2018). An Illustration of The Allegory of the Cave, from Plato’s Republic.jpg. Available: https://commons.wikimedia.org/wiki/File:An_Illustration_of_The_Allegory_of_the_Cave,_from_Plato%E2%80%99s_Republic.jpg. Last accessed 9th January 2021.

 

Gunning, T. (2004) ‘What’s the Point of an Index? or, Faking Photographs’, Plenary Session II, Digital Aesthetics, 1(25), pp. 39-48

 

TED (2019)  'Why most visual effects suck—but some don't?  Available at: https://www.ted.com/talks/wren_weichman_why_most_visual_effects_suck_but_some_don_t (Accessed: 8th January 2021)

bottom of page