Game Development, Audio Tools and Engines, Business and Life in Japan

Game Development, Audio Tools and Engines, Business and Life in Japan

AudioPaint

Share it

This page describes a tool I wrote many years ago (in the case of AudioPaint, it was created in 2002). You will probably need to fiddle around to make it work on a recent machine (hunt down old MFC libraries etc…) and I don’t give any guarantee of any sort about its state or usefulness. To make it short: you are on your own!

 

What is AudioPaint?

AudioPaint generates sounds from pictures. The program reads JPEG, GIF, PNG and BMP files and translates each pixel color and position into frequency, amplitude and pan information. AudioPaint can therefore be considered as a massive additive synthesizer.

 

How does it work?

A picture is actually processed as a big frequency / time grid. Each line of the picture is an oscillator, and the taller the picture is, the higher the frequency resolution is. While the vertical position of a pixel determines its frequency, its horizontal position corresponds to its time offset.

By default, the color of a pixel is used to determine its pan, the red and green components controlling the amplitude of the left and right channels respectively (the brighter the color, the louder the sound), and the blue component is not used. The action of each component can be modified in the Routing section of the Audio Settings window. Starting with version 2.0, AudioPaint can also convert the color components into HSB values, and use hue, saturation and brightness instead of red, green and blue.

 

How to use AudioPaint?

Depending of the picture, several hundreds (or even thousands) of oscillators can be generated simultaneously. Due to the large amount of data to process, AudioPaint is not real-time. Once you chose your picture and the parameters, you generate a sound. Then you can save it as a .WAV file for further processing in a sound editor such as Sound Forge / Wavelab etc…. or to import it as an audio track in a sequencer (Sonar, Acid etc…).

Of course the sounds generated will vary depending on the type of picture used. I tested AudioPaint with pictures taken by the Hubble Space Telescope and available at the Hubble Heritage Gallery of Images. The results are complex and fascinating futuristic soundscapes, especially with long durations. Generative graphics, which usually exhibits a lot of colors while having a geometric composition, work especially well.

But you can really try any type of picture: maps from Google are also a good starting point for your sonic exploration, as well as paintings of Picasso, Monet and other great artists. Starting with AudioPaint 2.0, it is even possible to acquire random (but suitable) pictures from the Internet directly from the program.

And of course, don’t hesitate to create pictures especially for AudioPaint, in PhotoShop or a similar graphic package. By playing with geometrical shapes and colors, you can create very interesting sounds.

 

Sound Examples

Here are a few sounds generated with AudioPaint. There has been no post-processing and no effects added.

  • Instant Noodles : generative curves with a 5-tone scale for instant Chinese music.
  • Crystal : a 3D mathematical function using a 7-tone scale.
  • NanoProbe : geometric construct with linear frequency scale.
  • Mercury Rain : generative clouds of points for granular synthesis.
  • Aurorae : ethereal drone made from curves contained in a narrow frequency band.
  • Cosmic Ray : generated from the picture of a constellation.
  • Magical : interlaced curves playing on a magical scale.
  • Ghosts from Space : the mysterious sound of Supernova Remnant Cassiopeia A.
  • Martian Soundscape : a 3-minute soundscape generated from a picture of Mars.
  •  

    Download

    Click here to download AudioPaint. Unzip the file and run the installer. Make sure you read the documentation (the AudioPaint.pdf file).
    If you can’t run this program, please update Microsoft .Net Framework to version 2.0 or higher.

     

    26 Comments to AudioPaint

    1. Asterios says:

      Thank you very much for this unique experimental synth!
      I have used it to add some (sfx) parts on my track Worlds into worlds:
      https://soundcloud.com/astrofaros/worlds-into-worlds
      Asterios (Astrofaros)

    2. luca ferrero says:

      hello!
      Thank you very much for this program!
      I got a question for you:
      i’d like to set the waveform and the scale.
      how to create a file .slc and file for the waveform ?
      is there any documentation ?

      thanks for your help
      luca – from italy

    3. Dave Eyre says:

      Thankyou for this wonderful software, I’ve been having great fun experimenting with it and used it to create several video soundtracks, this is perhaps my most successful effort to date
      https://www.youtube.com/watch?v=FlkPMrKU83Y

      • Nico says:

        Thank you for the kind words, always love to see what people are doing with AudioPaint! This would not be out of place in an old Star Trek episode!

    4. Dave Eyre says:

      Thankyou Nico, more rocking side to side in your chair :)

      https://www.youtube.com/watch?v=s3b62fqvZDs

    5. Martin says:

      Hello,
      Audiopaint = WOW! Just started experimenting with this and it’s really nice. Wondering what is the licence status? I mean if I have my own software and want to include Audiopaint also (AS IS, with docs and everything…credits of course also) can I do it? any limitations ? And as a .NET developer myself, GREAT WORK ! :-)

    6. […] we might say that spectrograms are to mp3s as phonautograms are to WAVs.  I’ve been using AudioPaint myself to convert digital scans of spectrographic images into playable sound files (Photosounder […]

    7. Kez says:

      Hey Nico,

      Most fantastic piece of software I have came across when dealing with audio effects and conversions into audio of some of my very own photography. I find natures patterns create some of the best sounds to work with.

      I do have trouble trying to get some images to encode to audio though (normally really large images in either oscillators or length). I have a dual core system yet it only runs on one core.

      One task I would like to see done to it as a final “tweak” to something already amazing is to make it run on modern x64 systems on multiple CPU cores to increase the encoding speeds for really large files (1000’s of oscillators like 10 megapixel images and more).

    8. rohit says:

      is there any program to do the reverse procedure….i wanted to transmit and recieve image or video on fm band so i would be using it there

    9. Nico says:

      Hi Rohit, this is an “artistic” interpretation of an image as a sound in which information is lost so it is not suitable for transmission.

    10. Mace says:

      Just confirming that Audio Paint runs without any issue on Windows 10.

    11. William says:

      Hi I’d really love to use your software, theres only one problem… I can’t use the installer. I don’t know if it’s because the program was made in 2011 or if I’m doing something wrong. It would be very very much appreciated if someone could help me with this. thank you

    12. William says:

      Hi I’d really love to use your software, theres only one problem… I can’t use the installer. I don’t know if it’s because the program was made in 2011 or if I’m doing something wrong. It would be very very much appreciated if someone could help me with this. thank you.

      • Léo says:

        Hi William, I had some trouble too to install the soft on Windows 10, i think your problem is the same, u need to dl the 3.5 Net Framework, and the launch the setup.
        It then works perfectly for me !
        Sry for the bad english, and Thanks from France Nicolas for a incredible soft!

    13. Adrien says:

      Could you make a version that works for mac? my family only buys apple products sadly.

    14. Gustfu says:

      Hi, is there a way to automatically import images into the Batch processor when a new image is moved into the folder? I’m trying to send real time image that updates every 5 seconds into the software and automatically convert them to wave files.

    15. Yogita says:

      Can I download Audiopaint also on my android phone?

    16. choopikoon says:

      like this!!!! what the f!?

    17. Dan says:

      Hi, could you update Audio paint?
      X64 architecture and additional features

    18. Nicoletta says:

      Hei! Is it possible to install it on Mac? Thank you :)

    19. Tara says:

      Thank you so much. This is essential tool for healing. Gratitude.

    20. […] воспользоваться программой для Windows под названием AudioPaint. Проблема заключается в том, что Windows я уже много лет не […]

    21. […] A collection of uncomfortably harsh scifi and horror flick inspired sound effects released into the public domain (CC 3.0). The two most popular tracks are Teleporter and Warp Speed. “Teleporter” was used in the indie ear training game Key Seeker. The sound pack was created using Audio Paint […]

    22. abda says:

      Hey, for some reason I am unable to install the program on my new computer; when I run the .msi it asks me to install DotNet, so I download DotNet; run the .msi again and get the same thing. How could I fix this?

    Leave a Reply to Nico Cancel reply

    Your email address will not be published. Required fields are marked *

    You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

    © 2024: Nicolas Fournel