Implement Image Capture with !look(x, y, z) Command

kolbytn / mindcraft

MIT License

2.22k stars 267 forks source link

Implement Image Capture with !look(x, y, z) Command #308

Open DerJanniku opened 2 weeks ago

DerJanniku commented 2 weeks ago

Image Capture Feature for !look Command

Changes

Added captureView function to capture screenshots at specified coordinates.
Implemented metadata generation for captured images, including block type, biome, time of day, and weather.
Enhanced error handling and logging for better debugging.

Features

Capture screenshots at specific coordinates.
Generate detailed metadata about the captured view.
Save screenshots in a 'captures' directory.

Related Issue

Addresses #299: Image capture with !look(x, y, z).

Shandelier commented 1 week ago

managed to execute the code, but it fails to take screenshot (it might be gemini fault):

app-1  | Received.
app-1  | Full response: ""Ok, I'll take a screenshot!  !look
app-1  | ""
app-1  | stopping self-prompt loop
app-1  | parsed command: { commandName: '!look', args: [] }
app-1  | Screenshot capture failed: {}
app-1  | Agent executed: !look and got: Failed to capture view: skills.captureView is not a function

DerJanniku commented 1 week ago

@Shandelier i will look in to it

MaxRobinsonTheGreat commented 5 days ago

I can tell this is AI generated and will not work. bot.screenshot is not a thing, and it needs to send the image to the model, which it does not do. did you even try testing it