openvinotoolkit / openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
https://docs.openvino.ai
Apache License 2.0
7.28k stars 2.27k forks source link

[Good First Issue][JAX FE]: Support jax.lax.logistic operation for JAX #26576

Open rkazants opened 2 months ago

rkazants commented 2 months ago

Context

OpenVINO component responsible for support of JAX/Flax models is called as JAX Frontend (JAX FE). JAX FE converts a JAX/Flax model represented by ClosedJAXpr graph object with operations from jax.lax opset to OpenVINO IR containing operations from OpenVINO opset.

In order to infer JAX/Flax models containing jax.lax.logistic operation by OpenVINO, JAX FE needs to be extended with this operation support.

What needs to be done?

For jax.lax.logistic operation support, you need to implement the corresponding loader into JAX FE op directory and to register it into the dictionary of Loaders. One loader is responsible for conversion (or decomposition) of one type of JAX operation.

Here is an example of loader implementation for jax.lax.reshape operation:

OutputVector translate_reshape(const NodeContext& context) {
    num_inputs_check(context, 1, 1);
    Output<Node> input = context.get_input(0);
    auto new_sizes = context.const_named_param<std::vector<int64_t>>("new_sizes");
    if (context.has_param("dimensions")) {
        auto dimensions = context.const_named_param<std::vector<int64_t>>("dimensions");
        // transpose the input first.
        auto permutation_node = std::make_shared<v0::Constant>(element::i64, Shape{dimensions.size()}, dimensions);
        input = std::make_shared<v1::Transpose>(input, permutation_node);
    }

    auto new_shape_node = std::make_shared<v0::Constant>(element::i64, Shape{new_sizes.size()}, new_sizes);
    Output<Node> res = std::make_shared<v1::Reshape>(input, new_shape_node, false);
    return {res};
};

In this example, translate_reshape expresses jax.lax.reshape using OpenVINO opset. Since jax.lax.reshape performs transposition and tensor reshaping according to JAX documentation, the resulted decomposition contains OpenVINO Transpose and Reshape operations. For Transpose and Reshape nodes, this conversion parses constant parameters dimensions to permute input tensor and new_size that is the target shape of the result.

Once you are done with implementation of the translator, you need to implement the corresponding layer tests test_logistic.py and put it into layer_tests/jax_tests directory. Example how to run some layer test:

export TEST_DEVICE=CPU
export JAX_TRACE_MODE=JAXPR
export 
cd openvino/tests/layer_tests/jax_tests
pytest test_reshape.py

Example Pull Requests

Resources

Contact points

Ticket

No response

sacredvoid commented 2 months ago

Hi @rkazants! I would like to take up this issue.

rkazants commented 2 months ago

Hi @sacredvoid, the task is yours.

Best regards, Roman

sacredvoid commented 2 months ago

Had a doubt, I'm currently on a windows machine, trying to build OpenVino. Is there a guide to properly build openvino for windows? Encountered an issue while building. @rkazants

rkazants commented 2 months ago

Had a doubt, I'm currently on a windows machine, trying to build OpenVino. Is there a guide to properly build openvino for windows? Encountered an issue while building. @rkazants

Hi, checkout our wiki: https://github.com/openvinotoolkit/openvino/wiki

Aman-patel-13 commented 1 month ago

I want to solve this issue could you please assign me. @rkazants

mlukasze commented 1 week ago

@sacredvoid are you working on this task or should we reassign it?

sacredvoid commented 1 week ago

Kindly reassign it, thank you.

mlukasze commented 1 week ago

not a problem, maybe other ticket will be more fisible for you, in more convinient time? :)

Aryan8912 commented 1 week ago

.take

github-actions[bot] commented 1 week ago

Thank you for looking into this issue! Please let us know if you have any questions or require any help.