serpapi / public-roadmap

Public Roadmap for SerpApi, LLC (https://serpapi.com)
54 stars 5 forks source link

[Google Scholar API] Add support for `device=mobile` #1440

Open martin-serpapi opened 8 months ago

martin-serpapi commented 8 months ago

A customer requested that we add support for mobile devices with our Google Scholar API. Currently this is not supported:

image

Playground | Inspect

Intercom

oldrich-s commented 7 months ago

What is the status on this issue? It would allow to get complete abstracts from Google Scholar, which is only available on mobile devices.

This issue is related:

https://github.com/serpapi/public-roadmap/issues/653

See this example:

Query:

fetch(
    `https://scholar.google.com/scholar?q=info:BO4xSR3bSkUJ:scholar.google.com/&output=qabs&scirp=2&hl=en`,
    {
      method: 'GET',
      headers: {
        'Accept':
          'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7',
        'Accept-Encoding': 'gzip, deflate, br, zstd',
        'Accept-Language': 'en',
        'Sec-Fetch-Dest': 'document',
        'Sec-Fetch-Mode': 'navigate',
        'Sec-Fetch-Site': 'none',
        'Sec-Fetch-User': '?1',
        'Upgrade-Insecure-Requests': '1',
        'User-Agent':
          'Mozilla/5.0 (iPhone; CPU iPhone OS 16_6 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Mobile/15E148 Safari/604.1',
      },
    },
  )

Response:

<div class="gs_qabs_cont">
  <div class="gs_qabs_panel" data-trk="/scholar_url?url=https://www.sciencedirect.com/science/article/pii/S0958946513002011&amp;hl=en&amp;sa=T&amp;oi=qabs-ggp-view&amp;ct=res&amp;d=4993044055722159620&amp;ei=J7ETZu3fGprUy9YPm4qaeA&amp;qabs=1&amp;at=Influence+of+formwork+surface+on+the+orientation+of+steel+fibres+within+self%C2%A0%E2%80%A6 [https://www.google-analytics.com/collect?v=1&amp;tid=UA-127192577-1&amp;aip=1&amp;cid=16370571150943005165&amp;dr=https%3A%2F%2Fscholar.google.com&amp;t=pageview&amp;dl=https://www.sciencedirect.com/science/article/pii/S0958946513002011&amp;dt=Influence+of+formwork+surface+on+the+orientation+of+steel+fibres+within+self%C2%A0%E2%80%A6">
    <div>
      <div](https: //www.google-analytics.com/collect?v=1&amp;tid=UA-127192577-1&amp;aip=1&amp;cid=16370571150943005165&amp;dr=https%3A%2F%2Fscholar.google.com&amp;t=pageview&amp;dl=https://www.sciencedirect.com/science/article/pii/S0958946513002011&amp;dt=Influence+of+formwork+surface+on+the+orientation+of+steel+fibres+within+self%C2%A0%E2%80%A6%22%3e%3cdiv%3e%3cdiv) class="gs_qabs_lgo" dir="ltr" style="background-color:#ffffff;text-align:center">sciencedirect.com
    </div>
    <div class="gs_qabs_abs">
      <div class="gs_qabs_err gs_alrt"></div>
      <h3 class="gs_qabs_title">Influence of formwork surface on the orientation of steel fibres within self-compacting concrete and on the mechanical properties of cast structural elements</h3>
      <div class="gs_qabs_au">
        <div class="gs_qabs_au2">Oldřich Švec, Giedrius Žirgulis, John E Bolander, Henrik Stang</div>
      </div>
      <div class="gs_qabs_auw">
        <a href="javascript:void(0)" class="gs_qabs_aux" role="presentation">
          <svg viewBox="0 0 40 36">
            <rect x="8" y="21" width="4" height="4" />
            <rect x="18" y="21" width="4" height="4" />
            <rect x="28" y="21" width="4" height="4" />
          </svg>
        </a>
      </div>
      <div class="gs_qabs_pub">Cement and Concrete Composites 50, 60-72, 2014</div>
      <div class="gs_qabs_snippet">
        <div>
          <div>
            <div class="gsh_csp">The influences of formwork surface on the final orientation of steel fibres immersed in self-compacting concrete and on the resulting mechanical response of the cast structural elements are investigated. Experimental observations of fibre orientation within cast slabs, obtained via computed tomography, indicate that fibres tend to orient according to the flow patterns during casting, but such tendencies are suppressed near rough formwork surfaces. Fibre orientation, in turn, affects the mechanical properties of the concrete as demonstrated by the load testing of beams extracted from the cast slabs. These processes and results are simulated using a computational fluid dynamics model of the casting process, in tandem with a lattice model of the fracture of the beam specimens. The computational fluid dynamics model determines the coordinates of each fibre within the concrete, which serve as input to the lattice model. Through comparisons with the experimental data, it is shown that these simulations correctly predict the phenomena of interest. We conclude the paper by highlighting a relationship between the number and orientation of the immersed steel fibres crossing the fracture plane and the mechanical response of the structural elements.</div>
          </div>
        </div>
      </div>
      <div class="gs_qabs_src">
        <a href=https://www.sciencedirect.com/science/article/pii/S0958946513002011 data-clk="hl=en&amp;sa=T&amp;oi=qabs-ggp&amp;ct=res&amp;cd=0&amp;d=4993044055722159620&amp;ei=J7ETZu3fGprUy9YPm4qaeA">View at sciencedirect.com</a>
      </div>
    </div>
  </div>
  <ul class="gs_qabs_gsl">
    <li class="gs_qabs_gslg">
      <a href=https://www.sciencedirect.com/science/article/pii/S0958946513002011 data-clk="hl=en&amp;sa=T&amp;oi=qabs-gga&amp;ct=res&amp;cd=0&amp;d=4993044055722159620&amp;ei=J7ETZu3fGprUy9YPm4qaeA">
        <span class="gs_qabs_gslp">[HTML]</span> sciencedirect.com </a>
    </li>
    <li>
      <a href="/scholar?cites=4993044055722159620&amp;as_sdt=2005&amp;sciodt=0,5&amp;hl=en">Cited by 120</a>
    </li>
    <li>
      <a href="/scholar?q=related:BO4xSR3bSkUJ:scholar.google.com/&amp;hl=en&amp;as_sdt=0,5">Related articles</a>
    </li>
    <li>
      <a href="/scholar?cluster=4993044055722159620&amp;hl=en&amp;as_sdt=0,5">All 6 versions</a>
    </li>
  </ul>
</div>
</div>
schaferyan commented 6 months ago

Another user requested this:

Intercom