Resuable Q-learning and Q-learning Development Environment

I designed a resuable Q-learning software which can be applied various problems. However, it is not enough for beginners to use it. To reduce the effort to make actions and states of Q-learning for a problem, IDE for Q-learning was implemented. A user can organize states and actions in the IDE and exports the configuration as a XML file. Then, the Q-learning can import a XML file and create states and actions.

Back to Portfolio

TAME 2010

In 2010, Samsung Electronics and Gatech will create machine learning modules in support of affective behavior, specifically:
A)Using reinforcement (Q-)learning as the basis for adjusting the parameters of TAME and the underlying robotic behaviors, based on direct feedback of the user.
B) Using case-based reasoning (CBR) to store situation-specific affective parameters that can support discontinuous switching of TAME behavior based on user needs and situational requirements.
I am in charge of developing reusable Q-learning component in this project.

Back to Portfolio

Robo-Ray Project

Robo-Ray is the first Samsung humanoid robot. In this project, I involved in architecture design. I implemented a robot simulator which could simulate its intelligent scenario.

Back to Portfolio

Shadow 3D Project

Shadow 3D Project is to develop and make 3D graphics library for Digital TV. I developed Integrated Development Environment such as Scene Editor and Widget Editor. Scene Editor is to construct a scene with various widgets and generate c++ code. Widget Editor is a debug tool to check the widget which is developed with Shadow 3D.

Back to Portfolio

MutiCube Project

This project was the first asynchronous File Transition Layer(FTL) for a flash memory. It was composed with Sector Translation Layer(STL), Block Management Layer(BML), and Low-Level Device diver layer(LLD). In this project, I was responsible for developing Block Management Layer(BML). We had to come up with a new algorithm and implemented it.
Back to Portfolio

DSP Project

Samsung Electronics needed to reduce efforts and cost of developing software for various Digital TV models. My team decided to develop a reusable and OS Independent software platform. It was Digital TV Software Platform(DSP). With this platform, we could save time and cost of producing Digital TV. In this project, I implemented OS Abstraction Layer(OSAL) and two applications such as AnyNet and EPG .
Back to Portfolio

SHADOW Project

This project was to develop a 2D graphic library for linux, windows, and VxWorks. It was used to many Digital TV models and made huge profit in Samsung Electronics.
Back to Portfolio