Technical Progress

Experiments

Using a hacked web-cam I experimented using IR camera.  

There is some quality issues with the hacked camera. I think a higher resolution camera would have better results. See the left image vs my hacked web camera on the right. 

Research

New Prototypes:

Pipeline Updates:

  1. Researched IR and thermal cameras but still not sure which camera is best suited given time, money and tech specs. Miguel is meeting with the MIT PI from Camera Culture tomorrow to get a better sense of the best camera for our needs.
  2. I need to do some stitching together of code to get all the video distortions complete
  3. I need to use GPU particles systems rather than CPU systems to get the "edges" of the video mesh to "speak" to the particles 

Flow Fields in Three.js

What is a flow field? Think of your Processing window as a grid. In each cell of the grid lives an arrow pointing in some direction—you know, a vector. As a vehicle moves around the screen, it asks, ‘Hey, what arrow is beneath me? That’s my desired velocity!’
— Dan Shiffman, Nature of Code

We are using Flow Fields to elucidate the environment with the movements of the microbes.

I am using a paper called "Computational Fluid Dynamics of Sponge Aquiferous Systems" as a scientific reference and pulling some artistic license as to how microbes may move in an urban environment. 

Taxonomical Mapping

Notes on Mandelbrot:

https://www.youtube.com/watch?v=x81lv4xfyNo

http://www.fractalforums.com/3d-fractal-generation/true-3d-mandlebrot-type-fractal/

http://tilde.club/~david/m/#zoom=6.292011834319527,3.4&lookAt=-0.6,0&iterations=85&superSamples=1&escapeRadius=10.0&colorScheme=pickColorGrayscale

https://github.com/coded-aesthetics/mandelbro

http://www.coded-aesthetics.com/

https://processing.org/examples/mandelbrot.html

http://blog.hvidtfeldts.net/index.php/generative-art-links/

http://sub.blue/fractal-lab

http://davideriboli.isiaurbino.net/arte-generativa

INFOGRAPHIC INSPIRATION

Diatoms:

Microbe Inspiration

Video Manipulating - ofxBlur

I am using ofxBlur to render the image only when there is movement in the camera. 

First I took a video in the street using ofxBlur:

Then I run the blur video through the three.js video tool using Edge Detection and Blur effect:

Then I ran that video again through my tool using the mesh distortion and the edge detection:


Hyperlaspe.js

Hyperlapse.js library with three.js --> mapping the video to a 3D plane geometry with 3D particles being able to fly through the plane. This is generative so you can go anywhere in the world: New York, Venice, Australia, Tokyo.

Thesis II - Update

There is a vast negative space around us, and we think it’s empty, the same way we imagined life before germ theory. It’s not empty. It’s more alive than anything we build. This is a project in shifting what Foucault called “the liminal horizon” so that you understand the whole world differently when you look away from what we’ve shown you.
— Kevin Slavin

FINAL PIECE CONCEPT & FORM:

My final piece for the thesis show and main representation of my research will be a web-based visualization tool that is meant to be an evocative art piece. I am intending for this piece to capture the imagination of the audience.

I am building a web-based experience that is a cross between a film, video-game, and data visualization, enabling the user to imagine the microbial nature of the city.

I am asking the user to reimagine what it means to be human in the vast metropolis that is New York City. Who are the “companion species” that live among us? How might the world appear from a microbes point of view?

The web site will be built out to include information about the data collection, analysis and preliminary findings based on the data-set from New York City.

 

CURRENT PROTOTYPE (MAR 2016):

I am using three.js to build a custom web-tool. The user will be able to select a path or journey through the city (say 5th Ave and 10th St, to 5th Ave and Washington Square Park). Then using hyperlapse.js and Google Street Images, a video of the path will be made. The video is then mapped to a 3D mesh in 3D space. Various custom filters (which are part of my visualization tool-kit) can be applied to the video to make the city appear as if the microbial world is coming to life. Finally 3D particle systems are applied to the 3D video that further seek to illustrate the microbial nature of New York City. 

Ideation II

Using thermal cameras to show the human body - applying particles to a scene that is mapped by thermal radiation:

Some kind of "invisible" ink only visible when shown under UV light:

Thermochromatic paper:

Mapping shapes to microbes -- a "design taxonomy" for the microbes:

There is something aesthetically that I love about Sol Lewitt and his contemporaries. Something about the micro and the macro that has always been very appealing to me.  

Sol Lewitt Wall Drawing 1180

Sol Lewitt Wall Drawing 1180

Peering into the microbial world

Biological Immaterials - Ideation

I borrowed a small microscope to begin looking into the microbial world:

Experiments with a micropscope

Experiments with a micropscope

PERFORMANCE

GOOGLE EARTH & MICROSCOPIC

MICROSCOPIC TEXTURES

GOOGLE STREET VIEW

KALAIDESCOPE