Introduction: What is your project about? Which fascination sparked it?
My project is about projecting on objects. What do you need for projection mapping? Is there a difference in a Windows environment or Apple. Which software is accessible to work with. What resources do you need to create a projection mapping and what tutorials are valuable to make this possible?
Goal of the project: what is the project meant to achieve? (awareness of something, a new or different perspective on a topic, a material exploration, a catalogue of techniques, a tutorial, a new evocative aesthetic experience, other)
I want to learn about new perspectives to present something.
Relevance: why is this project important to other people who might read about it? What might other people learn from your project and documentation?
For other people it can also lead to new perspectives to present a product or data in an alternative way.
Context: which other projects are related to this idea? Where do you get inspiration from? (include at least 3 references with NAME, TITLE, YEAR of project and WEBLINKS if applicable.
(Youtube 2018) How we made an interactive, projection-mapped topographic installation. https://www.youtube.com/watch?v=07hiEtggHXw
Expected outcomes: what do you intend to deliver at the end of the project?
My goal for the next two weeks is to show a visual on an object by projecting.
Activities and planning: list the activities you will undertake, and describe when you plan to do what for the duration of the project.
In this order:
Find out how my projector works
Find out which software i need for my hardware
Find a programme that support my computer and beamer
make the magic happen
Foundational skills and knowledge: state the knowledge and skills you already have that will help you do this project on your own. List at least 2 tutorials you found that will help you get started.
- Making the object
- Visual skills
Tutorials:
- Projector en calibrate without sensor
- Software tutorials
Learning goals: which new skills do you need to learn to make this project successful? What kind of person might be a useful sparring partner in that?
I want to learn to get other insights in showing a visual
A handy sparring partner is Moritz as he has a lot of experience with mapping and projecting. I could ask him for help as soon as I really get stuck. He has already given me several software and tutorials to start with.
Since I'm working on my projector a lot at home and I live with Duy, I can use it if I need help or other insights. I hope to be able to show him why I chose this project.
Materials: which materials do you expect to use? Where will you get them? What's the cost? Are they the most sustainable option available?
Projector (200/300 euro)
Kinect 2.0 (20/30 euro)
Some open source software
Some materials from the makerslab
Find out how the projector works combined with HEAVYM!
Projector + HeavyM +??????
Projector + HeavyM + Microphone sensor in macbook?
End Result!!!
Bought a cheap projector!
This is where the first problems started. The most suitable projection mapping tools are made for Windows. This is because people with a Windows PC can use a kinect and people with a macbook cannot. This means that there is no way for me to calibrate.
Why do I need a Kinect?
A Kinect is made for the XBOX game console. The Kinect has multiple cameras so it can track depth and movement. As soon as someone connects his Kinect to the computer, he can also use these sensors/cameras to calibrate an object. This means that the device remembers and follows an object. This way I can project on an object while it is moving.
I tried to make a DIY calibration device but these sensors are very expensive. So I have to find another way to solve my own fascination for projection pretty soon.
SOLUTION:
HEAVYM!
It is a program with live mapping. This means that I can connect my projector and project shapes live into my objects. This way I don't have any problems with calibration anymore. Better said. This program is all I need to realize my project.
I am excited after I found out that the kinect had dropped out of my project. The only drawback is that movement is no longer possible in my final design. I simply don't have the resources for it
Connecting my beamer to my macbook was done using HDMI. The program HEAVYm recognized my beamer right away and as soon as I started to draw some shapes they were immediately projected on the wall. Really a plug and play program which makes it very accessible for the user.
The next thing I noticed was that my mouse point was visible on my computer screen as well as on the wall. That meant that I can draw LIVE on the wall. I immediately grabbed a white shoebox and placed it a bit oblique in front of the wall.
Using HEAVYM and only my mouse I could colour every corner of the shoebox by making shapes.
The quality looks good. It has to be good enough to realize my project.
NOOOO! The kinect software is only for Windows.........
With this tool in the program you can easily have your shapes animated. The program is very user friendly and even if you are not satisfied with the result a step back is done. So far it is much more accessible than was hoped for beforehand.
Use the sequence bar behind to make a timeline of animations. You can click then on and off the have influence on the visuals.
MY FIRST PROJECTION EVER!
I used a shoebox because it's 3D when you tilt it. Then I exhibited an Adidas shoe on it. It is an example for people who are interested in my project to release a new sneaker in a special way.
I'm very happy with the first result. Still, it's a bit boring to see the same rhythm of visuals all the time. As a next step, I'm going to try to add something extra to my end result.
what can I do to make my project even more interesting?
I thought what if MUSIC could affect my VISUALS!
But how?
I found something about a program called Ableton. Its a live DJ performing program. It is possible to link the program to HEAVYm so that the projector responds to certain sounds. If this is possible I have my own DJ live set, for example at festivals or in discotheques. Don't dream too far ahead first but see what kind of program it is
As soon as I opened the program I had all my doubts. It looks very difficult with many technical terms and almost nothing of the program I can understand right away. If, as a CMDer, I can't understand it after some research. How can I recommend this tool to people who want to present something in a low-threshold way?
In HEAVYm I suddenly saw that my laptop microphone can be turned on in the program. HEAVYm converts it into three different tones. Mid tones - high tones and Bass.
Now I can link any shape to the Bass - Mid - High tones that are picked up from the microphone of my macbook.
/Imagine! Adidas comes up with a new ID shoe! Made specifically for your taste. I start a jazz up tempo song on my spotify come into the exhibition and I see this!
Collaboration
Moritz has helped me on my way with a whole list of possibilities with regard to projection mapping. Each time I discussed with him where I was in my process and whether he thought it was cool what I was doing. He helped me a lot to understand the calibration and what was needed to realize something like that. He has experience with very large projection shows for big brands. I try everything with less resources in miniature.
I also asked duyh and he gave me some feedback about the visuals. He helped me to make them i bit more interesting.