[DS] Focus Point - Image에서 영어 Keyword와 설명 추출

[heehminh]

📌 Description

Image를 URL로 넣었을 때 Image를 설명하는 Text를 추출합니다.

🎈 Goal

$\tiny{구체적인\ 산출물을\ 포함한\ 목표를\ 작성해주세요.}$

• propmt 설정
  
• 작품의 Text 추출
  
• Text에서 keyword 추출
  
• keyword의 간단한 설명 추출

✏️ Todo

$\tiny{목표\ 달성을\ 위해\ 해야할\ 일을\ 세부적으로\ 작성해주세요.}$

• [x] LLaVa 를 이용해 해당 작품의 keyword + 간단한 설명 추출

[heehminh]

LLaVa Demo Site에서 Prompt 검증을 진행 -> 적절한 Prompt를 찾은 후 코드로 구현할 예정

Prompt

Step 1 - What is the most interesting part of this work? What came to your mind when you saw this work? Step 2 - What do you think you drew? What kind of things are there? Step 3 - What does the artist want to say through the work? Why did the artist express the painting this way?

Please appreciate the work from these 3 perspectives and pick 3-4 keywords that impress you, without any additional explanation, and number each word.

Image

Answer

Step 1: The most interesting part of this work is the combination of the night sky filled with stars and the cityscape. When I saw this work, I thought about the contrast between the vastness of the universe and the bustling urban environment.

Step 2: The work features a cityscape with a church steeple and a night sky filled with stars. The artist has skillfully combined the elements of nature and architecture to create a visually striking composition.

Step 3: The artist likely wanted to convey a sense of wonder and awe at the beauty of the night sky, while also highlighting the contrast between the natural world and human-made structures. The choice to depict the night sky with stars and the cityscape together in the same painting may symbolize the coexistence of nature and urban life, or the interconnectedness of the universe and human civilization.

Keywords:

1. Night sky
2. Stars
3. Cityscape
4. Church steeple

[heehminh]

같은 이미지로 진행

Prompt

Step 1 - What is the most interesting part of this work? What came to your mind when you saw this work? Step 2 - What do you think you drew? What kind of things are there? Step 3 - What does the artist want to say through the work? Why did the artist express the painting this way?

Please become a docent at an art museum for young students and appreciate the work. Please proceed with the steps mentioned below. Rather than focusing on the artist, focus on the part of the work itself. Instead of writing answers step by step, organize the answers to the following in one article. Please appreciate the work from these this perspectives and pick 3-4 keywords that impress you and number each word.

Answer

The most interesting part of this work is the combination of the night sky filled with stars and the cityscape below. When I saw this painting, I was struck by the contrast between the vastness of the night sky and the intricate details of the city.

In the painting, there are several elements that stand out, including the church steeple, the mountain range, and the trees. The church steeple and mountain range add depth and dimension to the scene, while the trees provide a sense of life and movement.

The artist likely wanted to convey a sense of awe and wonder at the beauty of the night sky, as well as the intricate and bustling nature of the city. By combining these two elements, the artist creates a striking visual contrast that invites the viewer to contemplate the relationship between nature and human-made structures.

Three keywords that impress me are:

• Night sky: The painting captures the beauty of the night sky, with its vastness and the twinkling of the stars.
• Cityscape: The intricate details of the city, including the church steeple, mountain range, and trees, add depth and dimension to the painting.
• Contrast: The contrast between the night sky and the cityscape creates a striking visual effect that invites the viewer to contemplate the relationship between nature and human-made structures.

[heehminh]

위에 작성한 2가지 prompt는 출력하는데 시간이 20초 이상 소요됨 따라서 간결하게 수정

(1) 단어만 뽑은 버전 - 2초 소요

Prompt

What are the main objects in this picture? Just pick 3 WORDs

Answer

Starry night, mountain, city

[heehminh]

(2) 단어 + 간략한 설명 - 10초 소요

Prompt

What are the main objects in this picture? Pick 3 keywords that impress you and number each word and reason you choose them.

Answer

1. Starry night sky (1) - The night sky is filled with stars, creating a captivating and serene atmosphere.
2. Mountain range (2) - The mountain range in the background adds depth and beauty to the scene, providing a sense of scale and grandeur.
3. Town (3) - The town in the foreground adds a sense of human presence and contrasts with the vastness of the night sky and mountain range.

[heehminh]

단어 + 간략한 설명을 제공하는 프롬프트로 다른 작품 테스트

Prompt

What are the main objects in this picture? Pick 3 keywords that impress you and number each word and reason you choose them.

1. 유명한 명작: 진주 귀고리를 한 소녀 (요하네스 페르메이르)

Image

Answer

1. Woman: The main subject of the image is a woman, who is wearing a blue headscarf and a brown dress.
2. Painting: The image is a painting, which is a form of artwork created using various techniques and materials.
3. Scarf: The woman is wearing a scarf, which is a piece of clothing that is typically worn around the neck and shoulders.

   Issue

   • 이 작품에서는 '진주' 혹은 '귀걸이'를 뽑아야함.
   • 3번째로 뽑은 '스카프'에서도 머리에 맸는데, 목과 어깨에 맸다고 설명함.

2. 신인 작가의 정보가 많이 없는 작품: 휴가 (송지호)

Image

Answer

1. Pink flamingo - The flamingo is a prominent and colorful object in the picture, adding a vibrant touch to the scene.
2. White rabbit - The rabbit is the main subject of the image, lying on a beach chair and enjoying a relaxing moment.
3. Pink beach - The beach is painted in a pink hue, creating a unique and eye-catching backdrop for the scene.

3. 신인 작가의 정보가 많이 없는 작품: Pollen, 녹청자를 품다 (이성미)

Image

Answer

1. Bowl: The bowl is the central object in the picture, and it is filled with various fruits and vegetables. It is a large, brown bowl that stands out against the white background.
2. Grapes: The grapes are a prominent feature in the image, with several bunches of grapes scattered throughout the scene. They add a pop of color and a sense of abundance to the picture.
3. Leaves: The leaves are another key element in the picture, with several large leaves surrounding the bowl and the grapes. They provide a natural and organic touch to the composition, creating a sense of freshness and vitality.