Get a panic when parse html page

[aaronchen2k]

Get a fatal panic when executing htmlquery.QueryAll on webpage from url https://baidu.com OR local file baidu.html as below script. https://github.com/aaronchen2k/deeptest/blob/main/cmd/test/htmlquery_test.go

It works well if use a html string like: https://github.com/aaronchen2k/deeptest/blob/main/internal/server/modules/v1/helper/mock/html.go

Thanks!

[zhengchun]

May be the http response is gzip mode. you should decompress gzip before parsing .

[aaronchen2k]

May be the http response is gzip mode. you should decompress gzip before parsing .

In this test script test/htmlquery_test.go' , I read html from a local file, still cause a fatal panic. Please help to check, thanks.

html := fileUtils.ReadFile("baidu.html")

[zhengchun]

The local baidu.html file is good on my local test code.

test code below:

    f, err := os.Open("./baidu.html")
    if err != nil {
        panic(err)
    }
    doc, err := htmlquery.Parse(f)
    if err != nil {
        panic(err)
    }
    //  "//form[@id=1]/input[@id=\"kw\"]/@class" is invalid. changed to @id="1", 
    expression := `//form[@id="1"]/input[@id="kw"]/@class`
    list, err := htmlquery.QueryAll(doc, expression)
    if err != nil {
        panic(err)
    }
    fmt.Println(len(list))

[aaronchen2k]

The local baidu.html file is good on my local test code.

test code below:

  f, err := os.Open("./baidu.html")
  if err != nil {
      panic(err)
  }
  doc, err := htmlquery.Parse(f)
  if err != nil {
      panic(err)
  }
  //  "//form[@id=1]/input[@id=\"kw\"]/@class" is invalid. changed to @id="1", 
  expression := `//form[@id="1"]/input[@id="kw"]/@class`
  list, err := htmlquery.QueryAll(doc, expression)
  if err != nil {
      panic(err)
  }
  fmt.Println(len(list))

Thank you for feedback! I update the codes, now there is no error, but why the list always nil?

[aaronchen2k]

up

[zhengchun]

your query xpath is not correct. The local html file no any form with id=1 attribute. //form[@id="form"]/input[@id="kw"]/@class. You can use chrome develop tool(Inspect) or https://www.freeformatter.com/xpath-tester.html to test your xpath.