jafioti / luminal

Deep learning at the speed of light.
https://luminalai.com
Apache License 2.0
1.46k stars 90 forks source link

Yolo v8 #16

Open jafioti opened 8 months ago

AdrianEddy commented 7 months ago

YOLOv9 is out already, might be a better candidate: https://github.com/WongKinYiu/yolov9/

AdrianEddy commented 4 months ago

YOLOv10 https://github.com/THU-MIG/yolov10

jafioti commented 4 months ago

Just finished whisper which involved some work on the conv layers. Should be pretty straightforward to do yolo now. With the current rate of change I expect it'll be outdated in 2 weeks

xnorpx commented 2 months ago

Trying out the Yolo8 example (to compare speed with Candle) and see if I should switch.

Running into:

error: couldn't read `src\../roboto-mono-stripped.ttf`: The system cannot find the file specified. (os error 2)
   --> src/main.rs:190:26
    |
190 |     let font = Vec::from(include_bytes!("../roboto-mono-stripped.ttf") as &[u8]);

Copy in the fonts it compiles (with some warnings)

Then when running there is a dim missmatch

C:\git\luminal\examples\yolo_v8\target\release>yolo_v8.exe
thread 'main' panicked at C:\git\luminal\src\hl_ops\binary.rs:65:9:
assertion `left == right` failed: Dims must match to multiply tensors.
  left: [16, 27]
 right: [16, 1, 1, 1]
stack backtrace:
   0: std::panicking::begin_panic_handler
             at /rustc/051478957371ee0084a7c0913941d2a8c4757bb9/library\std\src\panicking.rs:652
   1: core::panicking::panic_fmt
             at /rustc/051478957371ee0084a7c0913941d2a8c4757bb9/library\core\src\panicking.rs:72
   2: core::panicking::assert_failed_inner
             at /rustc/051478957371ee0084a7c0913941d2a8c4757bb9/library\core\src\panicking.rs:403
   3: core::panicking::assert_failed
   4: luminal::hl_ops::binary::<impl core::ops::arith::Mul for luminal::graph_tensor::GraphTensor>::mul
   5: yolo_v8::model::ConvBlock::new
   6: yolo_v8::model::Yolo::new
   7: petgraph::graph_impl::stable_graph::StableGraph<N,E,Ty,Ix>::add_node
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
xnorpx commented 2 months ago

Btw there is an ongoing Yolo9MIT rewrite here: https://github.com/WongKinYiu/YOLO

jafioti commented 2 months ago

Yeah sorry been backed up, the yolo example isn't complete yet. should be done very soon