The VisiSonics 5/64 Audio/Visual Camera

VisiSonics 5/64 音視頻聲學(xué)相機(jī)

The VisiSonics 5/64 Audio/Visual Camera consists of 5 video cameras and 64 microphones mounted on the surface of an aluminum sphere. The spherical architecture and associated algorithms allow the creation of an omni-directional acoustic image of the environment. The 5 HD video cameras simultneously generate an associated omni-directional panoramic video stream of the captured environment. Audio and video are synchronized and co-registered as a combined stream using patented algorithms. The convergence of audio and video capture allows for the visualization of sound sources and their interaction with the environment to be understood in real-time.

VisiSonics 5/64 音視頻聲學(xué)相機(jī)由5個(gè)攝像機(jī)和64個(gè)麥克風(fēng)組成，安裝在一個(gè)鋁合金球體表面。該球形結(jié)構(gòu)和相關(guān)算法精準(zhǔn)地復(fù)原了環(huán)境全景聲像圖，該5個(gè)高清視頻攝像頭同步工作從而捕獲了全方位的環(huán)境視覺(jué)景觀，采用了獨(dú)特的專利算法能使音視頻完美地結(jié)合起來(lái)，音視頻的同步獲取實(shí)現(xiàn)了聲源的可視化，并且能對(duì)環(huán)境狀況進(jìn)行實(shí)時(shí)解析。

With the “Audio Camera,” and the FINDr software, users can capture, store, retrieve and process real-time integrated and synchronized audio and visual information. The captured data incorporates all aspects of the audio-visual world that an individual would experience if he or she were physically present where the Audio/Visual Camera were located. The processing software and storage system allows you to do this in real-time or to record sessions for post analysis.

使用聲學(xué)相機(jī)和FINDr 軟件，用戶可以錄制、存儲(chǔ)、檢索和處理實(shí)時(shí)集成和同步音視頻資料，捕獲的數(shù)據(jù)包含了音視頻的全部信息，如果他或她在現(xiàn)場(chǎng)則能深刻地體驗(yàn)到這些。處理軟件和存儲(chǔ)系統(tǒng)能夠讓你實(shí)時(shí)地做這些事情，也可以錄制下來(lái)供事后分析。

Audio Camera Applications

聲學(xué)相機(jī)應(yīng)用

·Noise Source Identification

噪聲源識(shí)別

·Ambisonics

環(huán)境高保真度立體聲

·Architectural Acoustics and Room Measurement

建筑聲學(xué)和室內(nèi)音質(zhì)測(cè)量

·Telepresence

遠(yuǎn)場(chǎng)呈現(xiàn)

·Cross-Modal Attention and Saliency

跨模式備注和顯著性

·Psychophysics

心理物理學(xué)

·Audio-Visual Tracking

音視頻跟蹤

·Audio/Visual Recording and Analysis

音視頻記錄和分析

·Meeting Recording

會(huì)議記錄

·Intelligibility

清晰度

·Noise Measurement

噪聲測(cè)量

5/64 Audio/Visual Camera In-Depth

5/64音視頻全景聲學(xué)相機(jī)

The AudioCamera’s spherical microphone architecture provides an omni-directional acoustic image of the environment. 

 聲學(xué)相機(jī)的球面麥克風(fēng)架構(gòu)提供了一個(gè)全方位的環(huán)境聲學(xué)圖像。

The microphone signals are conditioned using individualized pre-amp circuits and then converted to digital by a dedicated analog to digital converter. The digitized acoustic data are sampled at 44.1 kHz per channel and collected by an internal high performance Field Programmable Gate Array (FPGA) based processor where they are managed, formatted and converted into a single USB 3.0 data stream. FINDr software, operating on a standard PC with an internal NVIDIA GPU, accepts the USB data stream and performs the user selected functions in real-time. 

麥克風(fēng)信號(hào)使用個(gè)性化的前置放大器電路，然后由專用的模擬數(shù)字轉(zhuǎn)換器轉(zhuǎn)換為數(shù)字信號(hào)。數(shù)字化的聲學(xué)數(shù)據(jù)以每通道44.1 kHz采樣，并由一個(gè)內(nèi)部高性能現(xiàn)場(chǎng)可編程門陣列(FPGA)基于處理器收集，在那里他們被管理，格式化和轉(zhuǎn)換成一個(gè)單一的USB 3.0數(shù)據(jù)流。FINDr軟件在內(nèi)置NVIDIA GPU的標(biāo)準(zhǔn)PC上運(yùn)行，接受USB數(shù)據(jù)流并實(shí)時(shí)執(zhí)行用戶選擇的功能。

The auditory scene can be decomposed into its spherical harmonic components up to order 7. This allows for increased spatial isolation of acoustic sources in the environment. Additionally, the scene can be decomposed into filtered plane-waves, and can be beamformed into multiple real-time beams. A resolution of up to two degrees is possible for higher frequency beams. 

聽(tīng)覺(jué)場(chǎng)景可以分解成高達(dá)7階的球面諧波分量。這使得聲源在環(huán)境中的空間隔離度提高。另外，可以將場(chǎng)景分解為濾波后的平面波，并可以將其波束形成多個(gè)實(shí)時(shí)波束。高頻波束的分辨率可以達(dá)到2度。

The video camera array generates an associated omni-directional panoramic visual scene that is synchronized with the live audio stream.

視頻攝像機(jī)陣列（全景聲學(xué)相機(jī)）生成了一個(gè)與實(shí)時(shí)音頻流同步的相關(guān)全方位即全景視覺(jué)場(chǎng)景。

 Five video cameras are integrated into the VisiSonics 5/64 Audio/Visual Camera to facilitate the panoramic scene capture. Each of the color video cameras has a resolution of 1328×1048 pixels. The captured video is synchronized with the audio data via an internal FPGA processor. The multi-camera image streams are collected via an internal USB 3.0 interface and sent to a laptop over a single USB 3.0 cable.

VisiSonics 5/64音頻/視頻攝像頭集成了五個(gè)攝像頭，以便于全景場(chǎng)景捕捉。每臺(tái)彩色攝像頭的分辨率為1328×1048像素。捕獲的視頻通過(guò)內(nèi)部FPGA處理器與音頻數(shù)據(jù)同步。多攝像頭圖像流通過(guò)內(nèi)部USB 3.0接口收集，并通過(guò)一根USB 3.0電纜傳輸?shù)焦P記本電腦。

 Included with the all Audio Cameras is the Frequency Identification and Noise Detector (FINDr) software.

所有的聲學(xué)相機(jī)里都包含頻率識(shí)別和噪聲探測(cè)器（FINDr）軟件。

 With FINDr, you have the ability to visualize and analyze your recorded data. The FINDr software gives you instant access to an integrated audio/video panorama, and breaks down the data for you in helpful graphs for both time and frequency domain analysis. 

使用FINDr，您可以可視化和分析記錄的數(shù)據(jù)。FINDr軟件使您能夠即時(shí)訪問(wèn)集成的音頻/視頻全景圖，并將數(shù)據(jù)分解為有用的圖形，以便進(jìn)行時(shí)域和頻域分析。

See our Software page for more information.