Yoshi Sodeoka: human audio visualizer

Roxanne Vardi and Pau Waelder

A multifaceted artist, Yoshi Sodeoka creates a wide range of audiovisual artistic works that include video art, animated gifs, music videos, and editorial illustrations. Influenced from an early stage in his career in noise music and glitch art, as well as avant garde movements such as Op Art, his work is characterized by breaking down the structure of the musical score and visual integrity of the image to find new forms of artistic expression.

A multifaceted artist, Yoshi Sodeoka creates a wide range of audiovisual artistic works that include video art, animated gifs, music videos, and editorial illustrations. Influenced from an early stage in his career in noise music and glitch art, as well as avant garde movements such as Op Art, his work is characterized by breaking down the structure of the musical score and visual integrity of the image to find new forms of artistic expression. His projects, developed individually or in close collaboration with other artists, materialize in fields as diverse as music (Psychic TV, Tame Impala, Oneohtrix Point Never, Beck, The Presets, Max Cooper), illustration (New York Times, Wired, The Atlantic, M.I.T Technology Review) fashion (Adidas, Nike), and advertising (Apple, Samsung). His work has been exhibited internationally, including at Centre Pompidou, Tate Britain, the Museum of Modern Art, the Cleveland Museum of Art, Deitch Projects, La Gaîté Lyrique, the Museum of Moving Image, the Baltimore Museum of Art, and Laforet Museum Harajuku.

In the following conversation, Sodeoka discusses his work and influences, focusing on the two artworks from the series Synthetic Liquid recently commissioned by Niio.

Could you elaborate on how your background in music influences your artistic practice when creating new media artworks?

At the beginning of my abstract video art projects, music and sounds usually come first. I guess in a way, I’m trying to be a human audio visualizer. I usually start by picking up some interesting sounds that I want to work with. That could either come from a friend or from myself. It really depends on how I feel. I’ve been a long time user of Logic (a MIDI sequencer software) so I usually cook up something quick in that. I’ve always played electric guitar since a young age, and I still have a collection of synthesizers and instruments. I’ve been a big fan of experimental noise and ambient music. I am lucky to have some really talented music friends that provide me with the exact sounds I’m looking for if I’m not in the mood to do my own. Anyhow, then I would try to come up with the idea of what sort of visuals go well with that sound. Experimental/Noise music is just a perfect fit with the videos I make.

Yoshi Sodeoka, Synthetic Liquid 7, 2022.

Why are you interested in glitch and noise?

I feel that everything is broken anyway, nothing is complete. In computer glitches, something interesting happens, in terms of color and composition. I am mainly interested in these colors and shapes. For me it comes from an aesthetic reason, I am not a conceptual glitch artist. I use it for everything.

However, these particular artworks I created for the commission look more organized, with more neutral colors. It relates to how I feel about the project or what influences me at a particular time, but I really can’t tell why.

“If you depend on the programs and machines you are using, then your creative process becomes shaped by the vision of the person who made that software or those machines.”

The neo-psychedelic style of both commissioned works from your Synthetic Liquid series with its kaleidoscope of colors resembles the aesthetic used by Futurist artists in the early twentieth century, and you have also mentioned your interest in Op Art. Would you say your work relates to these avant garde movements?

Yes, to some certain extent. I like Futurism, particularly in its more abstract manifestations. And in this particular work that I’m presenting in Niio, I should say I’ve been more influenced by Op art. I like the work of Bridget Riley and Victor Vasarely, among others. I just like the idea of making video versions of Op art. I enjoy seeing those visual triggers: Op Art makes you question what you are seeing. The arrangement of colors and shapes make your brain think. I like the idea of trying to make animated Op Art, because when you see it your mind goes someplace else, and this is fascinating to me. When you look at a landscape, for instance, you feel calm, whereas with Op Art there is a different feeling.

Yoshi Sodeoka, Synthetic Liquid 8, 2022.

Can you tell us about your artistic process and about the different digital softwares that you use in the creation of your video works and the process of moving from analog practices to digital practices? 

Sound and visuals are strongly connected. My interest in experimental noise is that it does not have a structure, which goes well with abstract videos. I have been playing music since I was 12 years old, and at the same time I studied painting. Doing both at the same time from a very young age, when I discovered video art there was no question that I wanted to do that. 

I’ve used a lot of analog setups in the past. But I use less of it now. I still like a pure analog setup, but I’m just in a different phase. I like to keep it simple with fewer gears in my studio at the moment. I incorporate the ideas that I have learned from working on analog videos into the digital video-making process. One of the things that are fascinating about what I can do with analog video is video feedback. I try to simulate that in the digital setting. The exact process might be different. But the concept is the same either in analog or digital. 

 “I imagine that the future of computing will be more organic and fluid.” 

I still have a video analog setup in my studio. For me it started to get kind of boring, and to break out of it one of the solutions was to buy more gears. I feel that the parameter is very limited because if you buy gear, then your creative process becomes shaped by the vision of the person who made that gear. I don’t like that, so I use my own video feedback technique with After Effects, which not many people do, and therefore it feels like it is my own tool and my own technique.

I also randomize a lot of elements in my audio production, working with a set of parameters. I set a tone, add notes from here to here, and allow a bit of randomness. But that’s as far as I go. I don’t use a coding environment such as PureDate to make audio compositions, but I use audio production software and randomize it, which is similar in a way. 

“I like the idea of creating Op Art, because it makes you question what you are seeing”

When experiencing your works, one cannot help but think of the beginning of the creation of everything with the representation of fluids and water.

Ha, I’m not sure. When people think of computers and technologies, they don’t really think of liquids and water. Machines are always dry and hard things. But I imagine that the future of computing will be more organic and fluid. People are using liquid elements in computing and I am fascinated by it. My videos feel very organic, particularly because they have an analog component, so it is not only about zeros and ones. I want to make everything organic as much as possible. It’s not easy, but I take it as my challenge to make things look more organic.

You have recently also been active in the NFT space, could you please share your experience with us on these projects and how you imagine NFTs becoming part of the more traditional art industry as a whole?

It’s been such a crazy ride with NFTs! I’ve sold plenty of work as I’ve never had before. And I’ve made a lot of new friends, and I discovered a lot of great artists I’ve heard of before. Overall it’s been a good experience for me. But I’m not a big fanatic of it either. I’m staying pretty low-key about it. Things come and go and I have no idea where this is going, honestly. I just focus on making good art, which has always been my thing.

What do you get when you buy an NFT?

Pau Waelder

Quick Dive is a series of articles that offer a brief overview of a certain topic in a clear and concise manner. This article can be read in 6 minutes.

Image generated with OpenAI’s DALL-E 2

When Beeple’s famous artwork EVERYDAYS: THE FIRST 5000 DAYS was sold as an NFT at Christie’s on 11 March 2021 for $69.3 million, the collector Vignesh Sundaresan (a.k.a. MetaKovan) received a 21,069 x 21,069 pixels image in JPEG format. Soon after, links to download Beeple’s image began appearing on Twitter. Anyone could get a copy of the artwork and see it on their computer, but no one, except Sundaresan, could say they own it.

So, what does it mean to own an NFT?

As this example shows, the non-fungible token (NFT) is not the artwork: Beeple’s artwork (the large JPEG file) was circulating online because it is stored in a file sharing network called IPFS, which is public and accessible to anyone. The NFT is a register on the Ethereum blockchain (in this case) that points to the artwork and to the wallet of its owner. The contents of the collector’s wallet are also publicly available, and therefore anyone can check the wallet and see the artwork there.

Owning an NFT means having a proof of ownership of a digital artwork that is secured by the structure of the blockchain (it cannot be forged) and is also publicly certifiable. In a way, it can be described as a certificate of ownership chiseled in stone in a public monument. It is actually more complicated than that, but let’s stay with the idea that you own the NFT (as long as it stays in your wallet) and that the NFT is a unique register that refers to an artwork that you bought. 

Larva Labs, Autoglyph (2019). Generative drawing minted as an on-chain NFT

And why isn’t the artwork inside the NFT?

It would probably be simpler if the NFT, instead of being a proof of purchase, would actually contain the artwork. In some cases, it does: these are called on-chain NFTs:

– Certain artworks are made of a few lines of code that produce a visual composition. These lines of code are added to the data that constitutes the non-fungible token, and therefore are also secured by the blockchain: the artwork (or rather the code that makes the artwork) is in this way stored permanently. 

– However, not all artworks can be on-chain: the blockchain was designed to record cryptocurrency transactions, with a limited amount of information. Each register on the blockchain costs money (gas fees) and to create an NFT with the information contained in a high resolution image or video is the equivalent of numerous transactions, which entail much higher costs.

For this reason, most NFTs are off-chain, which means that, as in the case of Beeple’s JPEG, the image is stored somewhere online, and the NFT points to it.

Auriea Harvey, The Mystery [v5-dv1] (2021). Digital sculpture and downloadable files.

What you get when you buy an NFT is not always the same

Since Beeple’s NFT made the headlines, the market for NFTs has moved fast and creators have come up with increasingly diverse and imaginative ways of selling their artworks as digital images or videos, software, prints and sculptures, and even performance pieces. 

To name a few, these are some of the things you can get when you buy an NFT:

(1) An image or a video stored on the IPFS network that you and anyone can download.

(2) The same as above, only the file on the IPFS network is in low resolution and you get access to a high resolution version that only you can download.

(3) A code-based artwork stored on the IPFS network that runs on its own data or takes data from somewhere else. Sometimes you cannot download the artwork, just run it on your browser, and it may stop working at some point.

(4) A virtual sculpture in the form of an image or video, alongside the file that you can download in order to 3D print a physical version of the sculpture.

(5) A code-based artwork that changes according to certain rules embedded in the NFT’s smart contract. These rules can include, for instance, that the artwork changes over time, or that it changes if another artwork is bought, or that it ceases to exist if the NFT is not transferred to another wallet after a certain amount of time.

(6) An artwork that was generated the moment you bought it by a program set to run a pre-defined number of times (e.g. 50-1,000 times). Your artwork is then unique but part of a limited series of similar artworks. The image you bought may be available in a similar way as (1) or (2).

(7) An artwork that grants access to other things, such as downloadable files, a Discord server, a club membership, or anything the creators have come up with. 

With so many different possibilities, it is advisable to find out what you will get with that NFT you are willing to buy. The information that is made available to collectors varies from marketplace to marketplace, and even from one artist and project to another in the same marketplace. 

Most simply assume that what you see is what you get: the image or video that caught your eye is what you will own, plain and simple. Even then, you should check whether the artwork is unique or part of a limited edition. When there is something more than what you see, read the description carefully and find out what else is there, maybe some downloadable content or conditions attached to the ownership of the artwork. 

The platform Feral File offers detailed information about the what the artwork is and what the collector will receive.

What to do once you bought the NFT

If you really like the artwork you bought, there are two main concerns you should take into account: how to view the artwork, and how to preserve it.

Preserving a copy of the artwork is more important than you may think. Resources such as IPFS may always be there, or they may not, and the file could get lost. Preservation is a concern to NFT creators, and this is why solutions such as on-chain NFTs are being developed. Until there is a better way to preserve artworks minted as NFTs, the best option is to go to the IPFS link and download the file, and also download any files made available by the marketplace or the creator. Where you store those files is up to you: you can put them in a USB stick inside a sock under your mattress, or use a cloud-based storage.

– If you love the artwork, you will want to see it. The marketplace grid is not a proper place for an artwork, nor is it the web browser (unless it was created for this space). The artwork needs a screen, certainly, but a dedicated screen. Currently marketplaces do not offer tools to view your NFTs outside of the browser, so it is up to each collector to find a way to properly display the artworks they own.

Niio offers a solution for both of these issues. You can sync your wallet to your account and automatically access the artworks you have bought, which you can copy to your personal space in a cloud-based storage system. Once the artworks are added to your account, you can easily display them on any screen using the Niio app.

The NFT market has experienced a fast-paced development in just a year and a half and still needs to consolidate practices, formats, and standards. In the meantime, collecting NFTs will continue to require finding out exactly what one is buying, and using smart tools to preserve and display the art.

Depicting the impossible: Eric Lerner’s Virtual Worlds

By Roxanne Vardi

This interview is part of a series of three editorial articles that dive deeper into the different software, technicalities, and processes that go into creating digital artworks, in order to offer our readers a deeper understanding of digital art as a medium.

We speak to Eric Lerner as part of a collaboration with Render Studio, a collective creative experimentation for a digital reality. Render Studio is inspired by art, design, nature and technology and aims to explore dimensions of virtuality, interactivity and motion. Eric Lerner’s series Tokonoma is featured on Niio this month.

Eric Lerner is a new media artist, animation director and professor at the Bezalel Academy of Arts and Design where he teaches art and animation for video games.

Part of your artistic practice deals with 3D animation. Could you give us an in-depth analysis of this digital art technique? Where do you see 3D animation going in the next five years?

3D animation or CGI animation refers to many different techniques and values but often will have similarity within the use of virtual “polygons” to calculate and produce an image. This constantly evolving technical practice has seen use in practically every modern art form; from film to games, graphic design to art. It is an extremely wide and flexible field of techniques that can produce a limitless variety of different styles, therefore It is difficult to lay clear borders or boundaries to 3D as an art form.

For me, the ability to create realistic looking imagery of physically impossible scenarios is where the true power and interest lays. This has of course been in use for cinema and VFX for many years but the types of narrative popular cinema usually portrays very often lacks the type of deep meaning and context that art makes possible; through more complex forms of expression, new fantastical realities can be created and used to invoke and provoke thought and experience, and with the democratization and  wide availability of 3D tools, artists anywhere are free to explore their style and visual expression in new and exciting ways. However, as the benchmark for quality rises, the entry level for artists to find their initial steps within these techniques rapidly becomes less achievable, requiring extensive study and practice; this might distance newcomers to the media. I would suggest to them that exploration of unique, even unconventional style, would be more important than technical prowess.

Eric Lerner, RedBrickWall1, 2022.

We are currently seeing a huge advancement in real time 3D rendering which allows for interactive media. To achieve the visual fidelity of what recently was only available to highly resourceful creation agents through pre-rendered processes only. This is already providing the gaming industry with hollywood style visuals for video games, but also has huge potential for art installations and exhibitions to create extremely immersive experiences that engulf viewers in an alternative reality.

Looking even further, I believe we’ll see these tools become available in more mobile setups such as smartphones and small headgear combinations. Furthermore, the interactive possibilities and AI generated content will be able to provide real time creation of completely unique experiences; entire detailed worlds created by direction of artists and then explored by viewers and users, possibly even as a one of a kind, single use experience – quite similar to our own reality.

Eric Lerner, Tokonoma I, 2022.

“For me, the ability to create realistic looking imagery of physically impossible scenarios is where the true power and interest lays.

Towards the creation of many of your artworks you create 3D animations which you then turn into live action videos? Could you elaborate on some of the complexities of this practice and your use of a handheld camera technique?

A process I’ve been researching and expanding on involves first shooting a live action clip, usually of empty (of people) urban or forest areas. Later I will “track” the footage (this is a process that follows hundreds of points of movement in a video in order to mimic the original movement of the camera, through a mathematical process of figuring out the parallax strength in the scene, thus producing a sort of “depth map” of the film scene). With a digital copy of the original camera movement, I can “film” 3D objects within CGI creation environments using the same exact movement of the original, often handheld footage. This eventually produces the illusion of the 3D object being present during the original shoot, even if the object itself doesn’t appear realistic in its own nature.

While this technique has been long used in film VFX, I find that it can bring to life many different types of narrative (with my favorite being surreal imagery) and its magic is quite captivating. While a relatively high end technique, it can still be produced by a single artist, and its creative possibilities are extremely interesting; it brings to life impossible objects and affects the mind very effectively, producing a magical realism that can turn everyday scenes into dreamscapes.

Eric Lerner, Pools of Reflection I, 2022.

Could you share some of your early experiences working in the NFT space, and provide us with your anticipations of NFTs as an accepted traditional art medium?

When NFT first started getting attention in the art world, I was very excited by the prospect that it promised a new form of livelihood for artists, specifically for more left-field, alternative arenas of art (alternative to fine arts, mostly). Unfortunately, it quickly became apparent that a lot of people were entering the field as a quick cash grab and a lot of artists were being exploited, had their work stolen or just became obsessed with the financial aspect of this new “business” as a “get rich quick” scheme. While the technology itself was interesting, it was being used in poor taste and the original promise was mostly lost.

I feel the technology can eventually be used in decent (morally) ways but i’m not sure we are there yet. As more and more companies jump on the NFT bandwagon to use in their services, products and promotions, it’s unclear where the public’s view of NFTs will end up, but for art, either fine arts or more broad, alternative fields of art, there is still a hopeful promise for creators and collectors but more importantly, experiences of art that are yet to come to be.

Eric Lerner, Pools of Reflection II, 2022.

In Modernist Painting, Clement Greenberg suggests that the role of the Modern Artist is to bring attention to the flatness of the surface because the essence of visual arts is the optical experience. Today, through advanced technologies and softwares artists are able to create three dimensional pictorial spaces. Is it your opinion that contemporary artists working in the digital space should create experiences of visual worlds within themselves pushing our everyday reality into new realms introduced by web3 and the metaverse?

Yes, as I previously stated, the advancement of technology and its ability to create believable and emotional 3D experiences, for example, might be the starting point for a new breed of artwork where the experience is far from a single image or even a single interactive experience but rather a unique and personal experience each time it is activated, with a much broader scope than previously imagined.

That said, and pardon the controversial statement, but I find currently web3 promises to be extremely familiar, reminding me of grandiose promises made when web 2.0 was “introduced”. The main difference being the actual possibility of these ideas to come to life with technology reaching a point where they become possible. But to be truly interesting, I find these ideas need to go deeper into realms of data that might not be completely acceptable by the masses meant to enjoy them – either because they are built upon personal data or because they expose hidden truths; either way i believe these experiences have got to be personalize to be effective, otherwise they remain very 2.0 or just end up as good storytelling, which isn’t new but always very, very effective.

“I will often learn a new technique, and my immediate thought would be: How can I use this in a surprising way?.”

Eric Lerner, Gabriel in the Dreamscape, 2022.

You have stated that in the creation of your artworks you wish to explore the craft of art making in itself, and that through this investigation you are able to push the boundaries of what is possible. Could you elaborate further on this process in which your subject matter comes from technical ideas and your aims when creating new artworks?

When looking at this process in its truthful form, it is mostly a process of using the technical boundaries as limitations in order to create a “fenced” playground, which counterintuitively very often brings creative freedom. I will often learn a new technique, and my immediate thought would be: “How can I use this in a surprising way?”. For me, this usually directs into areas of magical realism where impossible events are plainly portrayed; So I will often use a technique to create unexpected yet [hopefully] intriguing moments, a tiny bit of awe for the viewer.

Unfortunately, this will often not do much in terms of context or narrative, areas which I find only inspiration derived from other narrative sources or life experiences can bring any meaningful context. This is where having your head stuck in a technical realm does little to help, or maybe even bring damage to the process. I aim to grow in these areas and I push my students to emphasize their efforts on these areas as I find them the most meaningful in a visual experience.

Shi Zheng: the screen as a membrane

Roxanne Vardi

Shi Zheng is a multidisciplinary artist based in Shanghai and New York. Shi Zheng’s works range from audio-visual installations and digital music to live performances. The artist’s body of work explores the overlapping space between the real and the virtual by creating immersive spaces, which resonate as meditative spiritual experiences. In turn, these perceptual experiences created by Shi Zheng open up spaces for deep introspection.

Shi Zheng’s two newly commissioned artworks by Niio expose the artist’s ongoing interest in technology, machine vision, digital voyage and ‘latent time’. Marvelous Cloud #1 and Marvelous Cloud #2 are part of Shi Zheng’s ongoing Nimbus series, which he started working on in 2015. Nimbus is defined as a cloud, an aura, or an atmosphere. In Latin ‘nimbus’ refers to a dark cloud. In Shi Zheng’s works, the clouds are made visible by light, which instills in them a sense of aura of gaseous floating. The Nimbus series represents the artist’s construction of virtual realities where virtual clouds live inside of the screen space, thus setting his viewers into imagined virtual spaces that mimic reality. However, here, the reality is entirely generated from virtual cameras of computer programs and noise algorithms. Ultimately, the viewer is able to experience the virtual landscape that computers share with human eyes.

Shi Zheng’s works have been exhibited at a wide range of galleries, museums and institutions including TANK Shanghai, MOCA Yinchuan, Ars Electronica, and Institute of Contemporary Arts London. In 2013, Shi Zheng, together with Nenghuo, Wang Zhipeng, and Weng Wei, founded the artistic new media art group RMBit.

In your works, through computer technology, you explore the possibility to extend your viewer’s audio and visual experience. Could you elaborate on this process and the anticipated result of the interaction with your artworks?

In my Audio-Visual installations, I’ve always thought that sound and image are the two sides of one being. They are intertwined and can’t be separated from each other. In these works, there is no discernible narrative. I did not intend to let the work convey a specific message or language. Instead, sound and image as two different materials, are presented to create a purely perceptual environment. So in my work, I hope to create an immersive space in which the viewer can generate thoughts through their experience.

Shi Zheng, Marvelous Cloud #1, 2022.

As an artist that creates both electronic music and digital imagery, what is it about these two artistic practices and their association that interests you most?

For me, the most exciting part is the space, where the acoustic field created by the sound and the light diffused from the screen are composed into an immersive space that surrounds the audience. So I often prefer to describe my video works as spatial installations. The audience can resonate with surround sound and projection when facing the visual content. If we imagine the screen as a membrane, this immersive audiovisual experience is an attempt to make the membrane disappear.

“If we imagine the screen as a membrane, this immersive audiovisual experience is an attempt to make the membrane disappear.”

Also, I feel it is very interesting to create sound and video simultaneously, especially when considering them as a whole. It’s like the sound is an echo of the image, or the image is some kind of generator of the sound. For instance, in the work Nimbus, although the work visually portrays an ever-changing “cloud,” the sound embodies another part of it. So in terms of this relationship, as I mentioned earlier, sound and image are two sides of the same being.

Your Marvelous Clouds series display whimsical lights of nature and trace their boundless metamorphosis. Could you dive deeper into the artistic techniques that are involved in the creation of these artworks?

Marvelous Cloud is inspired by the clouds in J.M.W. Turner’s paintings as well as the “sublime” embodied in his work. The images of clouds in his work often appear in different colors under the illumination of light. I often focus on the flow of things rather than the still images, looking at how these dematerialized gaseous objects are shaped by light under flowing motion. So when I simulate virtual clouds in computer software, different modules and algorithms can help me transform the original realistic clouds into more abstract ones. In addition, I can control the distance of the light in the virtual space, which gives me a lot of possibilities in terms of color.

Shi Zheng, Marvelous Cloud #2, 2022.

“Sound and image are the two sides of one being.”

The clusters of clouds and gas which originate from natural light in your Nimbus series can be interpreted as an aura, an ignis, or a fatuus which together generate a meditative almost spiritual experience. Can this experience be interpreted as intentional?

Yes. It was also the first time I tried to create this meditative spiritual experience in my work. During the creation of Nimbus in 2015, I had the opportunity to visit the Rothko room at the TATE Modern. Rothko’s Black on Maroon series was displayed in the dimly lit gallery, which immensely impressed me. When I returned to the studio to continue working on Nimbus, the intense spiritual experience continued to influence me, and I couldn’t help but bring them into my work.

Shi Zheng, Nimbus, 2015.

You have stated that you do not only see yourself as the creator of your artworks, which display computer-generated virtual worlds, but also as a wanderer wanting to share the experience of these lonesome lands with your viewers. Is there an attempt to connect to your viewers through this shared experience?

I have always felt that making art is a sharing experience and that artists have their own way of seeing the world. I started to learn about virtual worlds from Second Life, and since then, my work has always had a sort of “wanderer” perspective. Whenever I create a new work or build a new “world,” I feel like I’m in a “sandbox” environment. Imagining this “sandbox” as a glass container, I can observe the real world through this container and also reflect on ourselves through the mirror reflection. I suppose the superposition of the real and the virtual is what I want to share with the audience through my artwork.

“I started to learn about virtual worlds from Second Life, and since then, my work has always had a sort of “wanderer” perspective.”

Digital Collage: an interview with Nico Tone

By Pau Waelder & Roxanne Vardi

With a history that spans more than a century, collage has evolved as an artistic technique from the pieces of newspaper glued to a canvas to a wide array of forms of appropriating content using digital tools. We sat down with Tal Keren, who established the Nico Tone collective and acts as the senior artist, on their use of found images to create digital collages in their latest series of artworks.

This interview is part of a series of three editorial articles that dive deeper into the different software, technicalities, and processes that go into creating digital artworks, in order to offer our readers a deeper understanding of digital art as a medium.

We speak to Nico Tone as part of a collaboration with Render Studio, a collective creative experimentation for a digital reality. Render Studio is inspired by art, design, nature and technology and aims to explore dimensions of virtuality, interactivity and motion. Nico Tone’s series Cornucopia,  Vintage Matchbox Series and Cosmoscapes are all featured on Niio this summer, and were all created for Render Studio. 

Towards these series, Nico Tone looked at archives of vintage matchbox illustrations from around the world. Can you please explain the complexity of turning older images into novel digital artworks, and the different technicalities that go into this process?

We were very lucky to find many archives of designs and illustrations of matchboxes that were scanned in a good quality. So it wasn’t a problem to take these images from the server, and to put them into different folders. Each of the folders we create is categorized under a different topic such as animals, flowers and space. We took images of each subject and with the use of Photoshop, we cut the illustrations and then used the program After Effects in which we placed all the cut images. To make these series we needed to create many small animations. I equate this process to Lego: animating each image separately so with each artwork we can use the same animations but in different colors, sizes and placements. We also created many animated GIFs towards the creation of the final artworks. We use between 50-70 illustrations collected by the group from vintage matchboxes to create one coherent artwork. From some matchboxes we just take one element or illustration, and for others we can take all of them. We also looked at the reference of stamps and of vintage bills for the Vintage Matchbox series. The artworks are conceived to be symmetrical at first glance so that the compositions are like mirrors, but then the illustrations break that symmetry.

Nico Tone, Vintage Tales I, 2022

In your search for these images, do you have a specific website that you explore or do you start every exploration from scratch using search engines such as Google search?

We tend to use specific links that we are familiar with, and we were very careful about the copyrighting of the images, so even when we found an image that we liked we needed to do a lot of research on the image’s legal copyright conditions.

Do you take these images and try to think about what the different illustrations meant historically, and play with these existing narratives or do you really use these images just as a starting point to create something completely new?

The history of the different illustrations is usually taken into account. It is very important and interesting to know the history of the images. But when we create the artworks, the main focus is on how it looks,  and how something new can be created from these materials. It may reference and remind us of the history, but the outcome is not the history itself, it’s something else, a new world that combines everything together. Each design comes from a different culture and country, and we take everything and mix it up into a new narrative. This type of work is similar to the process of globalization, which is experienced everywhere. Keep in mind  that the vintage illustrations are very small, so we have to work with a lot of small details. This was also a challenge, to try to think what can be done, and how something new can be created from these small historical illustrations.

“Each design comes from a different culture and country, and we take everything and mix it up into a new narrative. This type of work is similar to the process of globalization, which is experienced everywhere.”

Can you elaborate on the different softwares used in creating this series of works?

As I mentioned, for the creation of these works we use Photoshop and After Effects. I make use of a digital tablet and a pen. For the space series, Wandering Stars, we needed to create the backgrounds, so we used the Ipad with a program called Procreate to create them in high quality.

Nico Tone, Wandering Stars I, 2022

In your works you combine subject matters taken from different cultures and different time periods into one coherent whole. How do advanced technical softwares help in creating these new collated narratives?

The size of the illustrations make the available opportunities very limited, but on the other hand this is also a good thing because this also creates abstract boundaries where we need to be very creative. We try to create everything that is supposed to be alive in real life as breathing. Most of the animations are not fast, but instead are very slow and calm. It is like looking into an aquarium, or like when you’re diving and looking at the fish as a spectator. So the focus is on creating something that will be nice to be with. Even when portraying wild animals, we don’t want to represent them as scary but instead as calm and pleasing. Most of the animations portray movement, where the GIFs are created in a loop of movement. For this process, we take the image, for example the head of the bear, and break it apart into different pieces, and then move these different pieces one by one.

Present in your collage works, there also seems to be little stories or narratives, so that upon closer inspection over time, one can see some particular things happening or maybe even expect some things to happen which were not necessarily visible at first glance.

Yes, the artworks are all created in loops. But within those loops of 1.5-2 minutes there exist even smaller loops. These are created purposefully so that the narrative of the work is constantly changing. We like to create small surprises in the artworks, so that every time you see the work you can see something different. Like the half moon in Shell City that jumps out and back into the coffee cup, or the butterfly in Vintage Tales II that flies and lands on top of the boat. Also, as you mentioned, there are little stories that we create firstly for ourselves, where the viewer needs to see the work a couple of times to notice these. For example, in Shell Flower, there is a turtle that is biting into a plant on top of the car. In general, we think about the movement that you see the first time that you see the work, whereas there are other elements that one would only see after a couple of times that one has seen the work.

Nico Tone, Shell Animals, 2022

You mentioned that you would like viewers to take the time to see the artworks, or to live with them. What do you think of how we usually consume images which is really the opposite, fast-paced and ephemeral?

I think that because we are confronted daily with many images and videos that nothing really infiltrates us or touches us anymore. I believe that if you take the time and look at one artwork you will start feeling and sensing its power. This is what we try to achieve. We would like viewers to look at our works for a while, and not just a couple of seconds. I am in favor of technology, but I think that the subject matter that we choose to portray is usually more natural. We try to combine technology and nature for a long term relationship as opposed to a short one.

“We like to create small surprises in the artworks, so that every time you see the work you can see something different.”

You don’t use much text in your compositions, is this done purposefully?

We feel that when you incorporate text in the works, it gives it a more radical feeling or meaning which we want to leave more open. We don’t want our viewers to relate an artwork to one culture or to one language, but instead wish for every viewer to have their own take and perception of the artwork.

Your artworks show many references to Art Historical collage practices such as those initiated by Cubist and Dadaist artists from the early Twentieth century. What do you see as the role of the digital artist in this lineage?

When we are presented with a new technology, we have a new opportunity to do new things. So that we are aware of the history, and what the artists did in the past, but now we can do those same things with different techniques and challenges. I don’t like to create political artworks. The use of technological advancements for me comes out in the small nuances, when we say that we can use technology but in a positive way. The collage method and the digital tools give us the opportunity to portray what we are trying to say. Taking elements from history and from different cultures and with that to advance towards something more positive and more colorful, and to show the similarities between these different cultures. I like the idea that when you put different and seemingly opposite things together in a collage, such as a polar bear next to a tiger, suddenly it can make sense to see these two elements presented side by side.

Nico Tone, Wandering Stars III, 2022. The Mondrian Hotel, Seoul.

You present your artworks on very large screens, which are sometimes a couple of stories high. What do you need to consider, digitally, when your art is presented on such large scale?

On very large screens every detail is seen and scrutinized. Everything needs to be meticulous and have meaning. It is like putting all your imperfections out there, enlarged for the world to see. We have to simultaneously consider both the viewer looking at the collosal screen from very close, and one looking from far away. This does not happen on a normal size screen where a viewer must come relatively close to it. The short distance viewer will be very focused in a limited space inside the artwork and must gain value from that spot alone. He or she will see every detail in that limited scope. The viewer looking from afar will see the big picture. We aspire to convey the message or story of the artwork for both these types of viewers. From a technical standpoint, these colossal screens have very irregular formats and colors that we need to consider. We commonly need to make adjustments in the artworks to fit these unique screens. It is both scary and extremely satisfying to present our works on these huge screens.  

Snow Yunxue Fu: liminality and the experience of simultaneity

By Pau Waelder & Roxanne Vardi

Snow Yunxue Fu is an artist working primarily with 3D software in a post-photographic framework creating experiences of experimental abstraction for her viewers that translate the concept of liminality into the digital space. She is also a curator and assistant professor at NYU Tisch school of the arts.

Fu’s practice combines historical and philosophical painterly explorations of the universal aesthetic and definitive nature of the techno sublime through topographical computer-generated images and installations

Following the release of two new artworks commissioned by Niio recently featured in our curated artcast Snow Yunxue Fu: Liminality we spoke with the artist about her art practice and her exploration of the techno sublime experienced through the digital space.

Your work, Resolution, initially displays a human-like form which turns into a liquid matter and is later shattered into small particles accompanied by a pulsed sound wave. Would you consider the reference to human creation as present in this work?

Yes, definitely, I think one of the reasons why I was very interested in working with fluid simulation in 3D was this idea of manipulating water. Water, in the physical world, is such an important element. Relating to this piece, human bodies are made in a high percentage of water, and I think of the way that kind of occupies our veins and our different organs. It is this idea that in everyday life, moving around, we think of the human as one entity. When I was studying oil painting, what was really interesting to me early on was the notion of the figurative as representational instead of abstract. But to me, I think there is so much abstraction, even when we are seeing inside of our body. So the work kind of came out of that, in a way, this idea of forming the human body, which is something that we recognize immediately, but then kind of breaking that into millions of pieces, so to speak, to refer to the number of small components that make up each one of us. That also still changes every day as our cells regenerate. The birth of a human being too is very much that, but conceptually too, even within the physicality of ourselves there is this subliminal quality which is sometimes hard for us to remember.

There is also an element in the work that speaks of the separation between what is nature and what is human-made. Many different cultures maintain this division, but really there is this idea that even our very own atom was once out in the universe. Technologically, in contemporary culture, we feel that we are the center of the world, but in the scale of things we are just a very small part. This matter exchange is definitely also part of the work. The water that we drink was once a part of a river and so forth.

Snow Yunxue Fu, Resolution, 2020.

You have often pointed to the Sublime represented in classical paintings to portray transcendent physical landscapes as a reference in your new media artworks. How do you relate the art historical use of the Sublime to virtual spaces?

I first encountered the idea of the sublime in classical paintings with Caspar David Friedrich, who is this very iconic figure. But then there was also this very personal experience for me, it’s actually something that always interested me, even as a very young person. I come from the inland of China, so I didn’t see or experience the ocean at a young age, as this is a very unique experience for inlanders. So when I finally did there were these moments when I thought that ‘the ocean is so big’. Also, I created a VR piece that I made in 2018 of a cave, that was actually another experience I had when I was five years old, where I went into one of those Karst caves. This is when I realized that all of the rocks are actually made out of calcium and salt accumulations and water again. I had this sort of physical reaction where I was simultaneously fascinated by how beautiful everything was and the kind of concept that this rock existed long before me and will exist long after me, but then I was simultaneously also scared to death as a five year old little girl. I think this combination that anything could fall on me or that water could rise enough so that I couldn’t get out was terrifying. What I was experiencing was a memorable experience of my own mortality. Relating that back to paintings and to art, I kind of picked that up from Caspar David Friedrich’s paintings. In a sense, he already depicted the broadness of the environment, but honestly, the pictorial frame is still very limited. So when I understood that I could do this with VR, I jumped on the opportunity. With a lot of Eastern Chinese landscape paintings, the way that human figures have been depicted, is such tiny scale compared to the vast mountains, which is many times a lot less about the perspective compared to Western oil painting, and more so about our experience and place in the world.

So I drew that connection to these historical gestures of trying to find one’s place in the world or kind of humanity’s place in the world in terms of scale. Earlier I mentioned that technology, especially digital spaces, kind of give me this very strong visual language to be able to kind of depict that vastness. So, I just kind of jumped into that counter effort to push against that idea where online culture makes us feel like we are the central attention of the world. Another group of artists that I relate to is the Land Art Earth Work group of artists from the 1960’s and 70’s. These artists went right out into nature, and created artworks that were kind of ephemeral. Like Andy Goldsworthy, who sometimes brought back natural elements into the gallery museum space as installations. In a sense, I feel like my practice relates to that as well, where the digital space becomes a mirror of the physical world. Even the vast cave that I made is really a very small model, so I think of my digital work being sort of this theater space, of what is happening out in nature. But of course, there is also this imaginary aspect that landscape or water is so hard to control. It takes different technologies and different sorts of machines for us to do this, but at least with simulation, the imagery of it becomes something that we can control such as waterbending. So there is that interactivity which is almost imagined because it only happens in the digital space, but it’s this desire for the fluidity, or a highlight of this underlying connection that we have to the larger world that is already going on. Mentally there is immersion with digital artworks. 3D or digital works can be considered epistemological models of the world. There is so much wealth of knowledge of how things work. Once we gain that knowledge, the question should be ‘how do we coexist in harmony?’ Since we are doing a lot of harm, we should ask ourselves what some of the ways are to live in harmony. That is a main question in my work.

“I drew that connection to these historical gestures of trying to find one’s place in the world or kind of humanity’s place in the world in terms of scale.”

Snow Yunxue Fu, Karst, 2019.

The experience of the Digital Sublime can bring up emotional responses which are either utopian or dystopian. Do you have a preferred response which you wish to relay to the viewers of your artworks?

This question is very efficient in terms of talking about the subject, the setup of utopia and dystopia, and the liminal. For me it’s something in between. I am frequently also asked whether I am in favor of the digital space completely taking over. I am not necessarily for this, the digital space really has vast implications, 3D simulation is a huge part of our life, so what this space can present to us again to me is this kind of mirroring or window-like looking out of what is possible within our immediate understanding. To me that is the reason why I am interested in depicting the Sublime in the digital space, it’s that simultaneity. I have also recently been working on projects where I create web3, Metaverse spaces, but I think that they exist because of the reference or relationship that they have with the physical world. So, technology can be used for very interesting and strong messages, but can possibly also be used to create damages and for these dystopic-like reasons. The way that I want my viewers to experience my work is to understand the simultaneity, it’s kind of a feedback loop of seeing the work, which helps us understand what is physical. So they don’t even necessarily kind of separate these any more, but it’s a fruitful way for us to gain more understanding. Nevertheless, I think there is certainly a huge possibility of dystopic implications.

“The way that I want my viewers to experience my work is to understand the simultaneity, it’s kind of a feedback loop of seeing the work, which helps us understand what is physical.”

Snow Yunxue Fu, Conjoin (Chapter 3), 2020.

Both your works Resolution as well as Conjoin portray to the viewer experiences of deconstruction and reconstruction turning the at once seemingly figurative shapes in the works into abstract elements. Would you consider this to be analogous to the human experience between the physical and the virtual worlds?

Yes, totally. I think maybe another aspect to be brought into this dialogue which we also discussed earlier is the limitation of human perception. So there is a lot going on, whether we kind of study it via science, philosophy or  any other sort of discipline. We try to sort of understand that something that is beyond what just meets the eye. As human beings we are really interesting, because we not only understand a concept in our brain but we are sensory beings. We can travel or go somewhere and once we are there we can experience things such as the air, the smell, and everything else, which is crucial. But then simulation is interesting too, especially the direction in which this technology is going. There are actually also simulations of sensory, which is being promised and introduced now. So that it’s not only what meets the eye and the ear, but in the future we will be able to wear gloves and to touch a surface that is for example supposed to be perceptually cold, or hot, or sharp or smooth. So, I think the translation again here is really fruitful and meaningful. This is one of the reasons why it attracts me so much to create works in this space. What I am sort of dreading in a way is that kind of space of open-endedness which gets formulated by big social media companies such as Meta. Right now what one artist can do is still very exploratory. I think that that is valuable, to protect that open space instead of having the Facebook version of what the Metaverse will be, which is probably what we don’t really want.

Could you elaborate on the concept of liminality in the digital world?

For me, the interest in terms of liminality in the digital world was always there. The way that I was able to corner it in my own practice, was when I looked into the work of Anthropologist Victor Turner. His research of the liminal and the liminoid helped me with the verbal language, to try to paint a faint picture of what I was trying to talk about. Turner defined liminal as change, periods of in-between changes so that you are not where you used to be, but you are not yet where you will be in the future. So, it’s the middle stage of a rite of passage. Liminoid is slightly different, it is a more playful and experimental space, less of a consequence, with the liminal things will change, there is an outcome. But the more you look into it the boundary blurs. For example, one can go about their everyday business, or go to a football game, and cheer, but this will not necessarily change the outcome of the game. The blurring of the lines breaks down very easily also when you are playing a video game, where you step in, play a role, and then you step out. We enable different versions of ourselves online, we choose to reveal as much as we want.  The Internet can be an intimate space. But, one could also have a complete other version of themselves online. Most of us are in between both extremes. Liminality to me is that complicated relationship that one has with that. It’s a transformative experience.  When we think of a transformative experience, we think of an incident that happens really fast. There is also the way that the internet changes us individually and as a society as a whole. The pandemic catalyzed that even more so. There is that societal change, but what I am interested in, which is not the common narrative that people connect to online spaces, is that this could be an opportunity for us to discuss, dive into, and interact and have a more authentic understanding of the world. A window of opportunity to reveal what cannot be seen by the eye, in this sensory way. This is what liminaility means to me, that back and forth force.

In the physical world there are many cultural and societal rules. The introduction of Zoom was a positive experience for me, as for a while the hierarchies that we were used to seeing in the physical world such as the human body changed. Personally, I am a small person and come off as very young, thus people usually project a certain way of talking to me. But when everyone was meeting online, especially during the pandemic, we all became squares. This disrupted the hierarchy which is very hard to break, which is a positive example of disruption. To reference Resolution, I think that there is so much more communality in humans that we have with each other such as our DNA and our molecules. This fundamental connection helps me to relate to a value system where we should all be treated equally. This possibility of a new configuration arises with the metaverse, that’s why the metaverse is portrayed in a utopian way. The potential of the unknown is what I am interested in, coming back to liminality, it’s not formulated yet, it’s open, we are listening to each other and trying to understand what humanity is all together.