eliranwong / letmedoit

An advanced AI assistant that leverages the capabilities of ChatGPT API, Gemini Pro, AutoGen, and open-source LLMs, enabling it both to engage in conversations and to execute computing tasks on local devices.
https://letmedoit.ai
GNU General Public License v3.0
112 stars 24 forks source link
ai api autogen chatgpt gemini google interpreter microsoft multimodal openai rag

LetMeDoIt AI

Welcome to LetMeDoIt AI, your premier virtual assistant designed to revolutionize the way you work! More than a mere chatbot, I am equipped with the capability to conduct meaningful interactions and actively carry out computing tasks as per your directives. My real-time code generation and execution prowess guarantees not only effectiveness but also efficiency in task fulfillment. With an advanced auto-correction feature, I autonomously repair any malfunctioning code segments and automatically install necessary libraries, ensuring uninterrupted workflow. My commitment to your digital safety is paramount, with inbuilt risk assessments and tailored user confirmation protocols to protect your data and device.

With LetMeDoIt AI, you can access OpenAI ChatGPT-4, Google Gemini Pro, and Microsoft AutoGen, local LLMs, all in one place, to enhance your productivity. Read more ...

Developer: Eliran Wong

Website: https://LetMeDoIt.ai

Source: https://github.com/eliranwong/letmedoit

Installation: https://github.com/eliranwong/letmedoit/wiki/Installation

Quick-Guide: https://github.com/eliranwong/letmedoit/wiki/Quick-Guide

Wiki: https://github.com/eliranwong/letmedoit/wiki

Video Demo: https://www.youtube.com/watch?v=Eeat6h_ktbQ&list=PLo4xQ5NqC8SEMM71xC4NNhOHJCFlW-jaJ

Support this project: https://www.paypal.me/letmedoitai

Video Demo

Watch the video

Youtube Playlist: https://www.youtube.com/watch?v=Eeat6h_ktbQ&list=PLo4xQ5NqC8SEMM71xC4NNhOHJCFlW-jaJ

LetMeDoIt Features without OpenAI?

You can utilize Google Gemini or open-source LLMs through Ollama for chat features in the LetMeDoIt AI.

If you're seeking the complete functionality of LetMeDoIt, which includes both chat and task execution features, without the need for an Open AI API key, we offer support for Gemini Pro, Ollama, and Llama.cpp in our related project, FreeGenius AI:

https://github.com/eliranwong/freegenius

Requirements

  1. ChatGPT API key (read https://github.com/eliranwong/letmedoit/wiki/ChatGPT-API-Key)

  2. Python version 3.8-3.11; read Install a Supported Python Version

  3. Supported OS: Windows / macOS / Linux / ChromeOS / Android (Termux)

Recent Additions

Generate tweets

twitter

Run Local LLM Offline

support_localllm

Talk to LetMeDoIt in Multiple Languages

talk_to_letmedoit

Analyze audio

analyze_audio

Search / Analyze Financial Data

search_financial_data

Access Weather Information

test_weather_plugin

Search and Load Old Conversations

search_chat_records_0

System Tray for Quick Access

system_tray

Work with Database Files

work_with_database

Support Android & Termux-API Commands

termux_api_command

Work with text selection in third-party applications

download_youtube_video

Modify your images with simple words

Modify images

Create a map anytime

Map Creation

You can name your assistants!

letmedoit_assistants

LetMeDoIt AI just got smarter with memory retention!

Plugin - memory

memory_after_restarted

Plugin - create statistical graphics

create_statistical_graphics

Plugin - anaylze images

analyze_image_demo

Plugin - anaylze files

integration_autogen_retriever

Execute code with auto-healing and risk assessment

code_management

Examples of LetMeDoIt Built-in Features (selective only):

Examples of Plugin Features (selective only):

Latest LetMeDoIt Plugins allow you to acheive variety of tasks with natural language:

Post a short tweet about LetMeDoIt AI

transcribe "meeting_records.mp3"

What was the average stock price of Apple Inc. in 2023?

Analyze Apple Inc's stock price over last 5 years.

what is the current weather in New York?

tell me the latest news about ChatGPT

search for "joke" in chat records

load chat records with this ID: 2024-01-20_19_21_04

connect /temp/my_database.sqlite and tell me about the tables that it contains

ask Gemini Pro to write an article about Google

ask PaLM 2 to write an article about Google

ask Codey how to use decorators in python

create a team of AI assistants to write a Christmas drama

create a team of AI assistants to build a scalable and customisable python application to remove image noise

join "01.mp3" and "02.mp3" into a single file

Launch VLC player and play music in folder "music_folder"

remove all desktop files with names starting with "Screenshot"

zip "folder1"

Remember, my birthday is January 1st.

send Whatsapp message "come to office 9am tomorrow" to "staff" group

When is my birthday?

Tell me somtheing about LetMeDoIt AI?

I am going to London on Friday. Add it to my outlook calendar

Email an appreciation letter to someone@someone.com

Summarize 'Hello_World.docx'

Give me a summary on https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1171397/CC3_feb20.pdf

Describe the image 'Hello.png' in detail

Compare images insider folder 'images'

Create an app icon for "LetMeDoIt AI"

Make a cartoon verion of image "my_photo.png"

Remove image background of "my_photo.png"

Create a QR code for the website: https://letmedoit.ai

Show me a map with Hype Park Corner and Victoria stations pinned

Create a bar chart that illustrates the correlation between each of the 12 months and their respective number of days

Create a pie chart: Mary £10, Peter 8£, John £15

What is the current time in Hong Kong?

You have a standard deck of 52 playing cards, which is composed of 4 suits: hearts, diamonds, clubs, and spades. Each suit has 13 cards: Ace through 10, and the face cards Jack, Queen, and King. If you draw 5 cards from the deck, in how many ways can you draw exactly 3 cards of one suit and exactly 2 cards of another suit?

read tomato in American English

read tomato in British English

read 中文 in Mandarin

read 中文 in Cantonese

Download https://www.youtube.com/watch?v=CDdvReNKKuk

Download https://www.youtube.com/watch?v=CDdvReNKKuk and convert it into mp3

Edit README.md

Improve my writing according to British English style

Translate your last response into Chinese

!auto

Read more about LetMeDoIt Plugins at https://github.com/eliranwong/letmedoit/wiki/Plugins-%E2%80%90-Overview

Documentation

Read https://github.com/eliranwong/letmedoit/wiki

Install with pip

pip install --upgrade letmedoit

letmedoit

Alternately, you may install "myhand", "cybertask" and "taskwiz":

pip install --upgrade myhand cybertask taskwiz

myhand

cybertask

taskwiz

Tips: You can change the assistant's name regardless of the package you choose to install.

Android Users

pip install --upgrade letmedoit_android

letmedoit

Remarks: Please note that the name of the Android package is "letmedoit_android" but the cli command remains the same, i.e. "letmedoit"

Read more at: https://github.com/eliranwong/letmedoit/wiki/Android-Support

Install with pip and venv (recommended)

macOS / Linux Users

python3 -m venv letmedoit

source letmedoit/bin/activate

pip install --upgrade letmedoit

letmedoit

Windows Users

python -m venv letmedoit

.\letmedoit\Scripts\activate

pip install --upgrade letmedoit

letmedoit

Android Users

cd

python -m venv --system-site-packages letmedoit

source letmedoit/bin/activate

pip install letmedoit_android

letmedoit

Read more at: https://github.com/eliranwong/letmedoit/wiki/Installation

Usage and Options

https://github.com/eliranwong/letmedoit/wiki/Command-Line-Interface-Options

Setup of Multiple Assistants

https://github.com/eliranwong/letmedoit/wiki/Change-Assistant-Name#suggestion-on-setup-of-multiple-assistants

Quick Quide

https://github.com/eliranwong/letmedoit/wiki/Quick-Guide

Upgrade

You can manually upgrade by running:

pip install --upgrade letmedoit

You can also enable Automatic Upgrade Option on macOS and Linux.

Features

LetMeDoIt is an advanced AI assistant that brings a wide range of powerful features to enhance your virtual assistance experience. Here are some key features of LetMeDoIt:

Read more at https://github.com/eliranwong/letmedoit/wiki/Features

Highlight - Plugins

Developers can write their own plugins to add functionalities or to run customised tasks with LetMeDoIt

Read more at https://github.com/eliranwong/letmedoit/wiki/Plugins-%E2%80%90-Overview

Check our built-in plugins at: https://github.com/eliranwong/letmedoit/tree/main/plugins

Highlight - Command Execution

LetMeDoIt AI is now equipped with an auto-healing feature for Python code.

Overview: Command execution enables you to:

  1. Retrieve the requested information from your device.
  2. Perform computing tasks on your device.
  3. Interact with third-party applications.
  4. Construct anything that system commands and Python libraries are capable of executing.

LetMeDoIt goes beyond just being a chatbot by offering a unique and powerful capability - the ability to execute commands and perform computing tasks on your behalf. Unlike a mere chatbot, LetMeDoIt can interact with your computer system and carry out specific commands to accomplish various computing tasks. This feature allows you to leverage the expertise and efficiency of LetMeDoIt to automate processes, streamline workflows, and perform complex tasks with ease. However, it is essential to remember that with great power comes great responsibility, and users should exercise caution and use this feature at their own risk.

Disclaimer

Confirmation Prompt Options for Command Execution

Read more at https://github.com/eliranwong/letmedoit/wiki/Command-Execution

Comparison with ChatGPT

LetMeDoIt offers advanced features beyond standard ChatGPT, including task execution on local devices and real-time access to the internet.

Read https://github.com/eliranwong/letmedoit/wiki/Compare-with-ChatGPT

Comparison with ShellGPT

ShellGPT only supports platform that run shell command-prompt. Therefore, ShellGPT does not support Windows.

In most cases, LetMeDoIt run Python codes for task execution. This makes LetMeDoIt terms of platforms, LetMeDoIt was developed and tested on Windows, macOS, Linux, ChromeOS and Termux (Android).

In addition, LetMeDoIt offers more options for risk managements:

https://github.com/eliranwong/letmedoit/wiki/Command-Execution#confirmation-prompt-options-for-command-execution

Comparison with Open Interpreter

Both LetMeDoIt AI and the Open Interpreter have the ability to execute code on a local device to accomplish specific tasks. Both platforms employ the same principle for code execution, which involves using ChatGPT function calls along with the Python exec() function.

However, LetMeDoIt AI offers additional advantages, particularly in terms of customization and extensibility through the use of plugins. These plugins allow users to tailor LetMeDoIt AI to their specific needs and enhance its functionality beyond basic code execution.

One key advantage of LetMeDoIt AI is the seamless integration with the Open Interpreter. You can conveniently launch the Open Interpreter directly from LetMeDoIt AI by running the command "!interpreter" [read more]. This integration eliminates the need to choose between the two platforms; you can utilize both simultaneously.

Additionally, LetMeDoIt integrates AutoGen Assistants and Builder and Google AI tools, like Gemini Pro, Gemini Pro Vision & PaLM 2, making it convenient to have all these powerful tools in one place.

Comparison with Siri and Others

Unlike popular options such as Siri (macOS, iOS), Cortana (Windows), and Google Assistant (Android), LetMeDoIt offers enhanced power, customization, flexibility, and compatibility.

Read https://github.com/eliranwong/letmedoit/wiki/Features

Integrateion with AutoGen and Open Interpreter

Integration with Google AI Tools

Integration with AutoGen

Launch Open Interpreter from LetMeDoIt AI

integrate_autogen_retriever_1

Mobile Support

LetMeDoIt is also tested on Termux. LetMeDoIt also integrates Termux:API for task execution.

For examples, users can run on Android:

open Google Chrome and perform a search for "ChatGPT"

share text "Hello World!" on Android

Read more at: https://github.com/eliranwong/letmedoit/wiki/Android-Support

Donations

https://www.paypal.me/letmedoitai