IntelRealSense / librealsense

Intel® RealSense™ SDK
https://www.intelrealsense.com/
Apache License 2.0
7.55k stars 4.81k forks source link

RealSense L515 documentation #6292

Closed talbenach closed 4 years ago

talbenach commented 4 years ago

I am trying to find information on the L515 camera beyond the datasheet Intel provides. Some questions that we have are:

  1. The D4xx cameras provide the depth and RGB streams separately, and require the Align function to match IR depth to RGB XY. Is that the same with the L515 or does it provide the depth stream already aligned with the RGB image?
  2. What is the camera's depth accuracy at short ranges - between 25 and 75 cm?
  3. Any papers written describing "best known methods" using this camera? Specifically, in applications that require identification of tags (e.g. Aruco tags) and tracking tools movement?
MartyG-RealSense commented 4 years ago
  1. Like the 400 Series cameras, the L515 uses the OmniVision OV2740 imager component for RGB. The L515 uses an IR laser beam though (the 400 Series used an OmniVision imager for IR). The L515's MEMS component is used to scan the IR laser beam over the entire field-of-view (FOV).

In regard to how depth is generated, the data sheet states:

"The L515 vision ASIC will process the data from the reflected beam captured by the photodiode and will output a depth point representing the accurate distance of a specific point in the scene from the camera. Aggregation of the depth points will generate a point cloud depth data representing the full scene".

If the RGB sensor is separate from the IR laser component and they are in different physical locations on the camera, I would expect depth to color alignment to still need to be configured rather than aligned by default. @dorodnic could clarify how the L515 handles depth-color alignment.

  1. In addition to the L515 data sheet document, there is also an official information web-page.

https://www.intelrealsense.com/lidar-camera-l515/

The FAQ at the base of the page is not working at the time of writing this. When it was working though, it stated that the L515 has a depth error average of < 5 mm at 1 m range.

  1. There are not papers currently available for the L515. A company called LUMOplay recently did an analysis on YouTube of the L515 with a pre-release sample of the camera though, and this may provide useful insights ahead of the L515's release.

https://github.com/IntelRealSense/librealsense/issues/6214

dorodnic commented 4 years ago

Hi @talbenach L515 also has a separate RGB sensor Regarding accuracy I think the data-sheet is the only source of official information. With the release of the product we will continue to publish white-papers like we do for the D400.

JiamingSuen commented 4 years ago

I also have some questions regarding the L515 LiDAR camera.

  1. What is the estimated shipping date for pre-orders made before March 31 given the current COVID-19 status?
  2. Is it possible to provide some sample rosbags of this sensor as addressed in https://github.com/IntelRealSense/librealsense/issues/5430#issuecomment-589986552?
MartyG-RealSense commented 4 years ago

Hi @JiamingSuen

  1. As far as I know, RealSense Store product shipments are not being affected by COVD-19. If you have pre-ordered an L515, when you receive your camera may depend on how early you pre-ordered. The first pre-orders were scheduled to ship on the week of April 27. Some weeks after pre-orders first opened, one customer said that they were quoted a ship date of June.

Currently, pre-orders made after March 31 are scheduled to ship in the week of July 26. Pre-orders are processed in order of when they were received.

  1. Supporting materials such as sample bag files, CAD models and white papers tend to "arrive when they arrive". We make sure to promote the availability of new resources once they are available, but there are usually not firm time estimates available.
MartyG-RealSense commented 4 years ago

Hi @JiamingSuen Do you have further questions about the L515, or is it okay to close this case now, please? Thanks!

JiamingSuen commented 4 years ago

Hi @JiamingSuen Do you have further questions about the L515, or is it okay to close this case now, please? Thanks!

I don't have further questions for now, but I'm not the owner of this issue though.

MartyG-RealSense commented 4 years ago

@JiamingSuen Thanks so much!

@talbenach Thanks for your L515 questions! As it has been a few weeks now without follow-up questions, I will close the case. Feel free to create a new case if you have new questions about the L515 in future.

talbenach commented 4 years ago

Hi Marty,

I have a new question on the 515 camera (which probably should be a new issue anyway…).

We purchased the Intel calibration target for the D400 cameras. Will it be relevant for the L515 camera as well? Is there another method of OEM calibration of the L515 camera?

Thank you very much,

Noam

From: MartyG-RealSense notifications@github.com Sent: Sunday, May 17, 2020 7:36 PM To: IntelRealSense/librealsense librealsense@noreply.github.com Cc: Noam Levy noaml@brainsgate.com; Mention mention@noreply.github.com Subject: Re: [IntelRealSense/librealsense] RealSense L515 documentation (#6292)

Closed #6292https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FIntelRealSense%2Flibrealsense%2Fissues%2F6292&data=01%7C01%7Cnoaml%40brainsgate.com%7C6306bf8dfce543cc423608d7fa805392%7Cba1b9a8211954a63b7107dab2a24ddaf%7C0&sdata=Up5PSYNnjQgTTTS6uo%2FmO%2BUVt5KGoq1CgWtkRhk9ab8%3D&reserved=0.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FIntelRealSense%2Flibrealsense%2Fissues%2F6292%23event-3344722237&data=01%7C01%7Cnoaml%40brainsgate.com%7C6306bf8dfce543cc423608d7fa805392%7Cba1b9a8211954a63b7107dab2a24ddaf%7C0&sdata=jVptE%2BX2fOkDXzD2bXpchpDmT9CRA%2Bge%2BE2nNcW8XWU%3D&reserved=0, or unsubscribehttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAGGZS4XYTD3BVGPKEMADXX3RSAG5PANCNFSM4MPANWDA&data=01%7C01%7Cnoaml%40brainsgate.com%7C6306bf8dfce543cc423608d7fa805392%7Cba1b9a8211954a63b7107dab2a24ddaf%7C0&sdata=gXFl10zeIhg2JtQ6qBSRWsN8v0YnQdrH2%2BsEbz%2FGd%2FQ%3D&reserved=0.

MartyG-RealSense commented 4 years ago

Intel's press release when the L515 was officially announced stated that the L515 retains its depth accuracy throughout its lifespan without the need for calibration.

https://newsroom.intel.com/news/intel-realsense-lidar-camera-technology-redefines-computer-vision/

image

talbenach commented 4 years ago

Thank you Marty,

Does you answer applies to the intrinsic parameters of the RGB camera as well?

From: MartyG-RealSense notifications@github.com Sent: Monday, May 18, 2020 11:16 AM To: IntelRealSense/librealsense librealsense@noreply.github.com Cc: Noam Levy noaml@brainsgate.com; Mention mention@noreply.github.com Subject: Re: [IntelRealSense/librealsense] RealSense L515 documentation (#6292)

The L515 camera is designed so that it should never need recalibrating during its lifetime.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FIntelRealSense%2Flibrealsense%2Fissues%2F6292%23issuecomment-630021748&data=01%7C01%7Cnoaml%40brainsgate.com%7Cfff87ffa7f254450654e08d7fb03c029%7Cba1b9a8211954a63b7107dab2a24ddaf%7C0&sdata=zKLpY6NbrIwJO2HjbRtx%2BXuIuGgePOz0Enf6CRm7VsA%3D&reserved=0, or unsubscribehttps://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAGGZS4TE7WWIZ6MFCBEI43DRSDVFJANCNFSM4MPANWDA&data=01%7C01%7Cnoaml%40brainsgate.com%7Cfff87ffa7f254450654e08d7fb03c029%7Cba1b9a8211954a63b7107dab2a24ddaf%7C0&sdata=wiWfP1yTp8lo0sbW41BVXHFNDGMpjeMVbj9KqinHyUM%3D&reserved=0.

MartyG-RealSense commented 4 years ago

The information about calibration refers to the L515 retaining its depth accuracy throughout its lifespan. The L515 uses the OV2740 imager component for the RGB like the 400 Series cameras do, but I have no information on whether the RGB imager in the L515 ever needs calibration.

@dorodnic Could you provide advice on this point please?

5trobl commented 3 years ago

@MartyG-RealSense Does the CustomRW application for the D400 series work for the L515 as well?

5trobl commented 3 years ago

Apparently it doesn't, alas: https://github.com/IntelRealSense/librealsense/issues/7640#issuecomment-715595242

Well as long as the L515 RGB is properly calibrated (unlike the D435 RGB w/o any distortion) and it won't decalibrate in a lifetime then it's fine.