Tesseract.art: Music-to-Painting Generative AI Platform
A creative AI research platform that develops pipelines converting musical input into generative visual artwork, introducing the concept of Synthaesthetic Art.
Published at NeurIPS 2024 Workshop. Introduced Synthaesthetic Art as a new field exploring cross-modal generative AI.
Tesseract.art is a creative AI research platform exploring cross-modal generative AI that links sound, image, and motion. The platform develops pipelines converting musical input into generative visual artwork.
Concept: Synthaesthetic Art
The project introduces Synthaesthetic Art — a new creative research direction exploring the intersection of multiple sensory modalities through generative AI. The work investigates how AI systems can translate between auditory, visual, and kinetic domains to create novel artistic experiences.
Technical Approach
The platform combines:
- Generative AI and diffusion models for image synthesis
- Audio signal processing for musical feature extraction
- Robotics integration for physical output
- Real-time processing pipelines for live performance
Research Impact
Published at the NeurIPS 2024 Workshop, establishing a framework for understanding and developing cross-modal generative AI systems in creative contexts.