search

UncoderIO / Uncoder_IO

An IDE and translation engine for detection engineers and threat hunters. Be faster, write smarter, keep 100% privacy.
https://uncoder.io
Other
133 stars 23 forks source link
datalake edr roota siem sigma threathunting translation uncoder uncoderio xdr

readme

What is Uncoder IO (Public Beta)

:earth_americas: English Українська

Uncoder IO is an open-source version of it's SaaS counterpart https://uncoder.io and its AI co-pilot version Uncoder AI. Since 2018, Uncoder IO has been a fast, private, and easy-to-use online translator for Sigma Rules, maintaining 100% privacy of its users. An open-source Uncoder IO expands use cases into the following:

Uncoder is developed by a team of Detection Engineers, Threat Hunters, and CTI Analysts from Ukraine, Europe, USA, Argentina, and Australia to perform their daily job and nightly cyber defense hobbies faster & better, making their outcomes easier to share for the collective good.

Uncoder IO Overview

Table of Contents:

:heart_eyes_cat: Why Uncoder IO

:pretzel: Roota & Sigma Translation Engine

Uncoder IO supports automated translation of Roota and Sigma rules into multiple SIEM, EDR, XDR, and Data Lake formats.

:pizza: Roota & Sigma Rule Editor

Uncoder IO supports a built-in Sigma and Roota rules autocompletion wizard suggesting code enhancements with latest MITRE ATT&CK and log source dictionaries to streamline the rule creation process. AI or not, Uncoder is here to make it easier to code.

:popcorn: IOC Query Generator

Uncoder IO acts as an open-source IOC packager helping CTI and SOC analysts as well as Threat Hunters to quickly parse any number of IOCs directly from any digital non-binary format (a simple copy-paste of a web page, CSV, OpenIOC, PDF, STIX etc.) and convert them into performance-optimized IOC queries ready to run in a chosen security analytics platform. As Indicators of Compromise sharing is regulated by TLP, it is not advised to share them in Sigma or Roota rules, as the latter are not part of threat intelligence and thus are shared easily without borders. Yet, we need IOC matching just as we need Threat Behavior detections, so Uncoder IO is made to help solve both tasks in an easy-to-use and intuitive manner.

:smile_cat: Full Privacy

Uncoder IO can be run on-prem without a need for an internet connection, thus supporting air-gapped network operation. We do however suggest checking for updates and deploying them regularly. Meanwhile, a SaaS version still ensures 100% privacy with no cookie tracking, no data or code logging, or sharing with third parties. Even with options for Uncoder AI functions, you are always in control of your code and data.

:dna: Supported Language Formats

Roota and Sigma Rules can be translated into the following formats:

IOC-based queries can be generated in the following formats:

The following types of IOCs are supported:

TODO list of languages we will support shortly:

:computer: Installation

Uncoder IO can be installed in a following manner:

  1. Docker container with web server and UI Launch Instructions for Docker container
  2. Docker container API and CLI only (work in progress)
  3. Build from source code directly (for advanced users, can be done following instructions from docker files)
  4. Ready to use as SaaS, privately with no registration or cookies at https://uncoder.io/
  5. Ready to use at SOC Prime SaaS with private AI augmentation, SOC 2 Type II certified environment and supporting ToS on data privacy, GDPR etc. at https://tdm.socprime.com/uncoder-ai

Below are the requirements and launch instructions for the Docker container with web server and UI.

Requirements for Docker Container

Launch Instructions for Docker Container

  1. Download the UncoderIO-main archive and unpack it.
  2. In the CLI, go to the folder where the unpacked files are: 
    cd UncoderIO-main/
  3. Run the following command to launch a Docker container: 
    docker-compose up -d
  4. Open http://localhost:4010/ in your browser and you are ready to go.

:mortar_board: How to Use

:rocket: Translation

  1. Select input type:
    • Roota rule
    • Sigma rule
  2. Paste or upload a rule in the selected language into the input panel.
  3. Select the output (language, content type, and data schema)
  4. Click Translate.

If the input rule cannot be translated, you'll see an error message. When translating a Roota rule, any functions that are not supported in the target language or are not yet supported by Uncoder IO will be listed in the output as a comment.

:flashlight: IOC-based Query Generation

  1. Select IoCs as the input type.
  2. Paste or upload text with Indicators of Compromise in the left panel.
  3. Make parsing configurations:
    • Select all: all listed options are applied
    • Replace (.) [.] {.} with dot
    • Replace hxxp with http: this functionality is case insensitive, so hXXp, HXXP, HXXp, and hXXP are replaced as well
    • Exclude Private & Reserved Networks: private and reserved IP addresses like 224.0.0.0/4 or 127.0.0.0/8 are ignored during IOC recognition
  4. Select the output language.
  5. Make generation settings:
    • Select what IOC types to use for queries:
      • Hash
      • Domain
      • URL
      • IP
    • Set the number of IOCs per query to take into account the performance of your platform
    • Define exceptions: specify hashes, domains, IPs, or URLs (in full or only partially) you want to exclude from your queries
  6. Click Translate.

:coffee: Writing rules

Write a Roota or Sigma rule in the input panel. Benefit from code templates, syntax highlighting, autocomplete suggester with MITRE ATT&CK, and other nice little features that improve coding experience.

:bulb: How to Contribute

Thank you for your interest in the Uncoder IO open-source project! Your contribution really matters in evolving the project and helping us make Uncoder IO even more useful for the global cyber defender community.

We encourage you to commit renders into new platforms. Start with reading these Instructions on Adding New Renders.

To submit your pull request with your ideas or suggestions for changes, take the following steps:

  1. Fork the Uncoder repository and clone your fork to your local environment.
  2. Create a new feature branch, in which you’re going to make your changes.
  3. Сommit your changes to your newly created feature branch.
  4. Push the changes to your fork.
  5. Create a new Pull Request
    a. Clicking the New Pull Request button.
    b. Select your fork along with a feature branch.
    c. Provide a title and a description of your changes. Make sure they are both clear and informative.
    d. Finally, submit your Pull Request and wait for its approval.

Thank you for your contribution to the Uncoder IO project!

:mailbox_with_no_mail: Questions & Feedback

Please submit your technical feedback and suggestions to support@socprime.com or the dedicated Uncoder channel in SOC Prime’s Discord. Also, refer to the guidance for contributors to support the Uncoder IO project or simply report issues.

:wrench: Maintainers

Since 2018, the SOC Prime team has been developing Uncoder from the ground up. The first steps were our support of Sigma rules and the Uncoder IO project, an online yet fully private IDE for detection engineering. Now, the SOC Prime Team shares Uncoder IO as an open-source project.

Uncoder IO project is maintained by SOC Prime, and while any suggestions and reported issues are welcome, the ultimate decision to accept a pull request or not, will be up to SOC Prime's R&D team.

:kissing_heart: Credits

We are genuinely grateful to security professionals who contribute their time, expertise, and creativity to evolve the Uncoder open-source project.

:briefcase: Licenses

Uncoder IO Comunity Edition is licensed under Apache 2.0. Commercial Edition features that are released as open-source can be used non-commercially if you do not have a paid SOC Prime subscription. Commercial use rights are complimentary with SOC Prime SaaS license. Please see LICENSE for details on the Uncoder IO licensing.

:book: Resources & Useful Links

Uncoder IO - free online translation engine for Roota, Sigma, and IOC-based queries
Uncoder AI - SaaS version of Uncoder acting as advanced IDE for detection engineering
Roota.IO - the main website page of the single language for threat detection & response
SOC Prime Platform - the industry-first platform for collective cyber defense
About SOC Prime - learn more about SOC Prime and its mission