Project on the HASOC-Offensive Language Identification FIRE 2020 tasks, which includes a message-level classification task that classifying a twitter comment into the offensive (OFF) or Not-offensive (NOT) language. To achieve this goal, in this project, we propose an ensemble model which makes full use of the information of rich sequential patterns. More precisely, the proposed model contains combined model of BERT and SVM. Achieved the F1 values of 0.51 and ranked 5th.