Category Archives: Techical

각종 Technical Issues

Concept & Implementation of Perceptron

before we go … Reference link Perceptron: Single Layer Perceptron: Multilayer Perceptron: Let’s start by understanding these contents. In Professor Ian’s Data Mining textbook, perceptron is defined as follows. The resulting polynomial ax ^ 2 + bx ^ 2 + cx ^ 2 + dx ^ 2 + ex ^ 2 +… Read More »

658 total views, 6 views today

Hive – Execution Error

reference: $ hive [ERROR] Terminal initialization failed; falling back to unsupported java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected at jline.TerminalFactory.create( at jline.TerminalFactory.get( Troubleshoot: [ERROR] Terminal initialization failed; falling back to unsupported java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but interface was expected Hive has upgraded to Jline2 but jline 0.94 exists in the Hadoop lib. Delete… Read More »

658 total views, 3 views today

Node.js & Development Framework(1) – Node.js

One day, someone introduced me  a framework easy for Full Stack development. Isn’t it good? Say frankly, it’s somewhat so tough to building, customizing & tuning OS / WAS? The names are Node.js & other related framework Let’s start with Node.js Wiki: Let me begin with some good points of Node.js Threading –  Unlikely existing WAS,… Read More »

1,927 total views, 6 views today

Designating metadata store as Maria DB to Hive

Installing Maria DB Installation: Check installed  existing Maria DB by “rpm -qa” command Configuring repository: Add Mariadb.repo Installing by “yum install” command DB Start / Change Password Check Connection / chkconfig on for service control automation Configuring Permission (External Connection): Installing Driver: Getting jdbc URL: Hive Configuration hive-site.xml: 2,496 total views, 4 views today

2,496 total views, 4 views today

R을 기반으로 한 빅데이터 분석 특강 후기R – Lecture Note

* 이 포스팅은 (주) 박영사에서 출판되는 한성대학교 권혁제 교수님의 “Dance with R”  저서 특강 참여 후기입니다. * 포스팅을 고려하지 않은 후기이므로 사진이 없습니다. ㅜㅜ 날씨가 추워지는 어느 날, 회사 벽에 위 그림과 같은 포스터가 붙었다. “Dance with R”  공짜.. 아니 무료 강좌입니다. 저자의 서명이 들어간 저서 증정 이벤트! 도 있다고 한다. 이렇게 좋은 기회를 놓.칠.소.냐.… Read More »

2,294 total views, 5 views today

High CPU usage query & Adding Index

CASE: Specific query is consuming up CPU resource cause CPU Spike(100% usage) when the DB hit count is increased. Type: MSSQL 2012 In such a case, mostly the query is known, so it can be solved by creating index for this query. But in emergency status, when Application Designer is absent and when the instant response is needed by DBA… Read More »

2,075 total views, 5 views today

log truncate interruption – open transaction Case: DB Type: MS SQL 2012 DB Recovery Model: Full One day, Growing DB log size is pressing the Disk space, it almost full. See the status of db files, the log file size has been increased very big though the transaction log backup task has been taking regularly. Once to handle this situation, just trying… Read More »

2,326 total views, 4 views today

Apache Giraph – From installation to Example execution

In this article, let me look into Apache Giraph and let’s run the example “SimpleShortestPathsComputation” First, look at the introduction of Giraph ( Welcome to Apache Giraph! Apache Giraph is an iterative graph processing system built for high scalability. For example, it is currently used at Facebook to analyze the social graph formed by users and their… Read More »

2,812 total views, 7 views today

SSH / Key Setup for Seamless Authentication among AWS EC2 Servers

Prerequisite – In this post, it is supposed the EC servers to be exists the topic is related to the SSHD/SSH & Key concept Conditions – It is supposed that There are two EC servers The account of each server is default account, “ec2-user” URL of each server is, The default pem provided from AWS to… Read More »

3,094 total views, 6 views today

Data Mining Algorithm List Tree

related material: 『Data Mining』-written by Ian H. Witten Basic Data Mining Algorithm ├───Basic rule extraction: 1R ├───Statistical modeling: Simple Bayesian, Gaussian/Normal distribution (Numeric) ├───Divide-and-conquer method: decision trees ├───Association rule mining ├───Linear Model │               ├Mathmatical Prediction: Linear Regression │               ├Linear Category: Logistic Regression │… Read More »

2,429 total views, 3 views today