AI for Creators
Discovering new pathways for AI to enhance the creative pursuits of artists and
creators of all kinds, enabling rich experiences and undiscovered avenues
for creative human pursuits from visual arts, sound and music.
Our Approach
Current research is focused on where AI can impact various mediums to increase creative and artistic capacity in all dimensions. Across several research areas we are committed to supporting creators and exploring technology that can serve as a foundation for human creativity. We are working towards the controllability and real-time functionality of AI foundation models with efficiency and speed for editing, restoration, creation, and the fine grain control needed by professional creators in music, sound, 2D and 3D.
Related Publications
Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the generator with gradients that make its d…
Despite the recent advancements, conditional image generation still faces challenges of cost, generalizability, and the need for task-specific training. In this paper, we propose Manifold Preserving Guided Diffusion (MPGD), a training-free conditional generation framework th…
Consistency Models (CM) (Song et al., 2023) accelerate score-based diffusion model sampling at the cost of sample quality but lack a natural way to trade-off quality for speed. To address this limitation, we propose Consistency Trajectory Model (CTM), a generalization encomp…
JOIN US
Shape the Future of AI with Sony AI
We want to hear from those of you who have a strong desire
to shape the future of AI.
