プロジェクトタイトル：LISTEN ARCHITECTURE ／ 聴く建築
副題：Hearing Experience of architectural space ／ 建築空間の体験を聴く
コンセプト：
プロジェクトの出発点は建築、音楽の関係を建築や音楽自身の構造や素材の問題だけであると考えずに、人間が建築、音楽をどのように体験し、認知するかつまり（近年大きく進んだ研究領域である認知科学による）認知的視点をくわえ、建築、音楽を構造と認知のレベルにおいてをつなぐ方法を模索しようとするものであった。そして、そこではこのような試みが必然的に出会うであろうクロスモダリティーの周辺に広がる新たなアスペクト掘り起こしながらプロジェクトはすすめられてきた。レアリゼーション：
自ら開発した、建築空間と音楽作品を同時生成する自己開発したコンピュータプログラムを使い、目で見、耳で聴きながら実験をくりかえし、建築と音楽はモダリティーは異なるが、その知覚認知、及びに美的秩序の認知のレベルでの深層構造において共通の基盤を持つという仮説を具体的に芸術として表現するためのシステムを開発中である。作品はこの我々が開発を続けようやくプロトタイプの段階まで完成した、建築空間と音楽表現を同時生成するコンピュータプログラム(図１,２,３）を使い、部分的にはさらに発展させ、建築空間と音楽の認知、体験をインタラクティブつなぐ多次元のマッピングをおこなうものである。
ソフトウェア：
ソフトウェアは現在、WEBアプリとして開発されているが、まだ公開していない。ユーザーは建築のエレメント（例えば、柱、床、壁、屋根など）を組み合わせ、パッチを製作し、そのパッチから建築空間が作られるが、それらは3DCGアニメーションソフトのBLENDERのためのファイルとPNGファイルを生成する。そしてそのパッチを選択しBUILDのコマンドを与えると、その建築用パッチから、音楽、つまりMIDI-File,サウンドファイル(Mp3)、楽譜（pdf形式）が自動生成される。これらはすべて、WEB上でレンダリングされ、ユーザーにファイルのみが送られる。（図１、２、３参照）
図１、重要⽂化財、伊是名（いぜな）島、銘苅家（めかる）住宅の構造の⽣成プログラム
 図２、⾃動⽣成された銘苅家住宅（⼀部）
図３、⾃動⽣成された銘苅家住宅に対応する⾳楽
作品とプレゼンテーション：
プレゼンテーションは以下の２部から構成される第一部) プレゼンテーションは前もって作家（建築家、作曲家）により準備、構成、作曲された作品
一つの建築物を様々な視点、角度から、距離、視野から体験し、それを映写し、それに対応する音構成がStringQurtett同時に演奏され,聴衆は建築と音楽をひとつのシークエンスとして体験する、映像、音楽は、固定され、演奏のためのマテリアルは前もって演奏家にわたされる）１２分～１５分
第二部) プレゼンテーションは舞台上のオペレーターにより、リアルタイムに建築物へのパースペクティブが順次選択され、CGと楽譜がその場で自動生成され映写され、StringQurtettにより初見演奏される １０分程度
requirement：
2. Projectors（1920×1080 or more／HDMI）, 2 Screens, 音楽家（弦楽四重奏）、Computer(持ち込み）、HDMIケーブル
LISTEN ARCHITECTURE
Hearing Experience of Architectural Space
Kiyoshi Furukawa,HaruyukiFujii,Takayuki Hamano,Yuki Kobayashi
Concept:
This project aims to explore the method of linking architecture and music on the levels of its structure and cognition by utilizing the multi-level perspectives of cognition (an area of research vastly advanced in recent years), encompassing human experience and cognition on the two subjects. The project has been advancing outside the boundaries of cross modality, as we see this an inevitable outcome in our attempts in seeking the topic above.
Realization:
Utilizing the self-developed computer program for simultaneously auto-generating architectural spaces and musical works, we are developing a system that expresses the perceptual perception, as well as to decode the link between our hypothesis that both architecture and music have the same fundamental structure of aesthetical order. Throughout this process of development, we have reiterated countless experiments using our eyes and ears. The work is finally in the stage of being able to present a prototype. Our computer program (figures 1, 2, and 3) auto-generates both architectural space and music by maturating parts by parts, perceiving spatiality and musicality, as well as offering interactive experiences by mapping multidimensionality.
Software:
The software, as of now, is being developed as a web application, and it is not yet publicly released. The user constructs the architectural elements (e.g. pillar, floor, wall, roof, etc.) by creating a patch. The patch, which utilized the files for 3D-CG animation software BLENDER and PNG files, create the architectural space. After selecting the patch and delivering the BUILD commands, music – the MIDI file, mp3 sound files, and the musical scores in PDF format – is automatically generated. These are all rendered online, and only the files will be delivered to the user. Refer to figures 1, 2, 3.
 Figure 1: Generative program for the structures of the Mekaru residency (important national treasure, Izena Island)  Figure 2: Automatically generated figure of Mekaru residency (partial figure)
 Figure 3: Music corresponding to the automatically generated Mekaru residency.
Work and Presentation:
The presentation will be structured in two sections as explained below:
(Part 1) The presentation will encompass one work that has been prepared, structured, and composed by the artists (architect/composer), and will explore the experiences in the realms of visual, angled perspectives, distance, and the outlooks. As these subjects are to be projected, while the string quartet simultaneously performs the structural sounds, the audiences experience both the architectural and the musical aspects of the work as one sequence. The projection and the music is fixed, and materials for performance will be handed to the instrumentalists in advance. (Approximately 12 to 15 minutes)
(Part 2) The presentation enfolds with the operator on stage sequentially selecting the architectural perspectives. The outcomes are automatically generated in the medium of computer graphic and musical scores, and the string quartet will perform accordingly at first glance.
Technical and Instrumental Requirements:
Two projectors (1920 x 1080 or more/HDMI), two screens, string quartet, computer (personal), and HDMI cable
Artists:
Kiyoshi Furukawa : Born 1959 in Tokyo, Japan. Studied composition with Y. Irino in Japan and with I. Yun and G. Ligeti at the Music Academy in Berlin and Hamburg. Guest composer at Stanford University, USA. Artist in residence at the ZKM Center for Art and Media Technology in Karlsruhe, Germany. He has been awarded numerous awards and scholarships. Since 2000 he has been assigned as a Professor at the Tokyo National University of the Arts. ( http://brain-dreams-music.tumblr.com, http://furukawalab.org, https://itunes.apple.com/jp/app/small-fish/id428493363?mt=8)
Haruyuki Fujii, Dr.Eng.: Born in Tokyo in 1959. Professor of architecture and design science at Tokyo Institute of Technology. Research architect focusing on design computing and cognition. Studied architectural and environment design at Waseda University, Japan. Studied philosophy and computational linguistics at Carnegie Mellon University, USA. Was a visiting scholar at Key Centre of Design Computing and Cognition in the University of Sydney.
Takayuki Hamano (1985) is an artist of media art born in Tokyo. He has studied composition, computer music and real-time image processing at the Sonology Department of Kunitachi College of Music in Tokyo. Then he has completed studying Sonology at the Royal Conservatory in The Hague. During those periods, he has created musical and installation works including physical performances. He is currently a researcher at JST-ERATO Okanoya Emotional Information Project. He also teaches at the department of media arts in Tamagawa University.
Yuki Kobayashi (1987) is a resercher of computational design born in Aichi, Japan. He has studied architectural design with Prof. S. Takamatsu and theoretical computer science with Prof. N. Katoh at Kyoto University. He was awarded Young CAADRIA Award 2014. He has worked as an assistant professor at Tokyo Institute of Technology since 2015.