Smart
Jukebox
Small
flexible display project
OVERVIEW
An
affective music recommendation system based on user’s emotion extracted via color analysis of a
photo taken by a user.
사용자가 촬영한 사진의 색상 분석을 통한 감성 분석 기반 음악 추천 시스템
background research
원통형 형태 기반의 제품, 시장, 연구 조사
The background research
was inspired by a design principle “form follows function”. It is a principle
associated with 20th-century modernist architecture and industrial design which
says that the shape of a building or object should be primarily relate to its
intended function or purpose. To design an interactive system for
cylindrical-formed devices, I did research on recent trends through the
investigation of product, market, and related studies, focusing on the
cylindrical form.
Background research는 form follows function에 기초하여 cylinder 형태를 가진 market, product, research trend 분야에 걸쳐 조사하였다.
System Design
Cylinder 형태에 적합한 반응형 콘텐츠 제안
1. Emotion
extraction : How to analyze the color information of user’s photo
사용자 감성 기반 음악 추천을 위한 감성 도출 방법: 사용자 촬영 이미지의 색상을 분석하는 방법
- Using RGB color
histogram to derive the main color information of the image
- Used a RGB color model
and Swain & Ballard’s
color histogram (1991)
- Abstracted the R, G, B
color values of the query image (from a user’s
photo)
RGB color histogram을 활용하여 이미지의 RGB 대표 색상 도출
RGB 색상 모델 , Swain & Ballard(1991)의 색상 히스토그램 활용
질의 이미지(촬영된 사진)의 R,G,B 색상 대표값을 도출
2. Emotion
classification
사용자 감성 기반 음악 추천을 위한 감성 분류 방법
-
Research related to matching emotions by analyzing the color of photographed
images
촬영 이미지의 색상을 분석하여 감성에 매칭하는 관련 연구 조사
-
a scheme of seven emotion classification to be used in this system
본 시스템에서 활용할, 이미지의 색상에 따른 7가지 감성 분류 체계 도출
3. Music
search
사용자 감성 기반 음악 추천을 위한 음원 검색 방법
- Based on the emotion and its vocabulary, we
recommend music through Youtube web search
감성 어휘를 기반으로 하여 유투브 웹 검색을 통해 추천 음악 선별
USER EXPERIENCE
User
scenario in a home party context
INTERACTION
JukeCylinder
features with in-hand motion UI
Dynamic hand gesture UI 중 in-hand motion UI를 활용하여 제어
PROTOTYPING
JukeCylinder
Dynamic Hand Gesture UI
2017
OVERVIEW
context-sensitive user interfaces for SleeveD (A cylindrical portable-sized device)
사용자의 디스플레이 이용 맥락에따라 사용가능한 UI
System DESIGN
In the non-portable mode of the device,
it provides the interaction by recognition of the user's hand movements.
In the portable mode of the device,
the UI that changes dynamically in the context of the user's display usage that provides the interaction by motion recognition by holding the display in the hand.
디스플레이의 정적 사용 맥락에서는 사용자의 손동작 인식에 의한 인터랙션을 제공하고,
디스플레이의 동적 사용 맥락에서는 디스플레이를 손에 쥐고 움직이는 동작 인식에 의한 인터랙션을 제공
Interaction
The same interaction can be selectively used depending on the context of static usage and the context of dynamic usage.
같은 인터랙션을 정적 사용 맥락과 동적 사용 맥락에 따라 선택적으로 이용 가능함
Dynamic Hand Gesture UI
Interactive Interior Solution
2017
OVERVIEW
VOGO, stands for "View One, Get One or more views", is one of our interactive interior solution which can change the interior of the room while variously changing the interior views on a VOGO device as well as obtaining the air purification and the emotional healing effect by cultivating the plant inside the device.
Role
Lead project: research, interaction design, hardware prototyping and programming
with three team members
We propose
A concept 'Interactive Interior Solution' which enable our VOGO device to serve various features with advantageous characteristics of transparent displays.
We develop
We develop scenarios and show various interactive services for VOGO that enable users to grow real plants to get air purification and emotional healing effects and interact with VOGO by changing a variety of interactive views.
Finally we develop a hardware and an interactive software of VOGO, including 'Transparent View', which provides indoor environmental information at the same time cultivating actual plants, and 'Aqua View', which enhances transparent display characteristic and enables to enjoy a virtual aquarium, augmented on the screen with the plants inside.
Our VOGO prototype is embedded with two 55-inch transparent displays - LG Display made this display, and Baanto's IR multi-touch sensors on the device's each side of VOGO. Therefore, multiple users can interact with VOGO using their finger on both sides of VOGO.
Its detail images and demonstration videos are yet to open to public.
If you're interested in the developed prototype and applications, please do not hesitate to contact me.
VOGO
A novel UI development of cylindrical devices with small-sized flexible displays
July 2016 - February 2017
OVERVIEW
Spinning UI is one of the distinctive interaction ways which are designed for providing a fluid interface on cylindrical display devices.
Role
Background Research, Idea Generation, Interaction Design, Prototyping including hardware and software programming
with two team members
We derive
4 Key UI/UX Strategy for Cylindrical Display devices
– Differentiated interface for a new type of displays
– Easy-to-use interface, considering the cylindrical display form factors and usage context
– Emotional interface for providing an aesthetic experience
– Optimized Interface for a seamless and cylinder-spatial content watching
We develop
– Differentiated interface for a new type of displays
– Easy-to-use interface, considering the cylindrical display form factors and usage context
– Emotional interface for providing an aesthetic experience
– Optimized Interface for a seamless and cylinder-spatial content watching
We develop
A fluid interface for cylindrical display devices including two interaction ways:
• 360 degree omni-directional hand-gesture-recognition-based UI
• Spinning UI to rotate the cylinder itself
• 360 degree omni-directional hand-gesture-recognition-based UI
• Spinning UI to rotate the cylinder itself
With Spinning UI and hand-gesture UI which are both available on cylindrical devices,
we present some desirable user scenarios and feasible applications based on the scenarios.
Its images and videos are confidential.
If you're interested in the developed prototype and applications, please do not hesitate to contact me.
If you're interested in the developed prototype and applications, please do not hesitate to contact me.
Spinning UI
Interactive Coloring Application
2016
OVERVIEW
Twosome Coloring is an interactive coloring application for two people in a face-to-face state using a dual-sided transparent display.
Role
Lead Project: background research, idea generation, interaction design, hardware prototyping and software programming
with three team members
with three team members
It allows people to experience a novel interaction technologies and transparent interface by twosome painting activity on a dual-sided transparent display prototype.
Patent
- Method for providing interface using double-sided flexible transparent touch screen, recording medium and apparatus for performing the method.
Domestic patent #10-2016-0081629, Filed June 29, 2016 (with Ji-Hyung Park et al).
Publication
- H. Kim, S.A. LEE, H. Kim, J. Park. Twosome Coloring: Designing a Playful Coloring System on Dual-sided Transparent Surfaces, ISS 2016.
[PDF]
Twosome Coloring
Interactive Media Art Installation
2014-2015
OVERVIEW
See Through U is an interactive media art for emotional communication using a dual-sided
transparent display. The technology has articulate value and has the ability to share emotion
and feelings through its participatory nature, providing an aesthetic experience.
transparent display. The technology has articulate value and has the ability to share emotion
and feelings through its participatory nature, providing an aesthetic experience.
Role
Lead project: research, design, hardware prototyping and software programming
with three team members
People can share their emotion by leaving messages on See-through U in a face-to-face state. This experience enhnces interpersonal communication with emphasises on dual-sidedness being fundamental advantages of transparent displays.
In order to make dual-sided transparent display interfaces more usable, we offer simultaneous interaction and propose visual interface that could foster better emotional experience within a face-to-face collaboration on dual-sided transparent displays.
In order to make dual-sided transparent display interfaces more usable, we offer simultaneous interaction and propose visual interface that could foster better emotional experience within a face-to-face collaboration on dual-sided transparent displays.
Exhibition
H. Kim, H. Kim, B.K. Huh, J. Park. “See Through U”at SiggraphAsia 2015 Art Gallery. (2015)
See Through U
피드 구독하기:
글
(
Atom
)