src-d / style-analyzer

Lookout Style Analyzer: fixing code formatting and typos during code reviews
GNU Affero General Public License v3.0
32 stars 21 forks source link

~60 parsing errors during report generation #715

Open m09 opened 5 years ago

m09 commented 5 years ago

I remember that we had killed all parsing errors at some point. They seem to be back.

Errors ``` $ grep imaginary logs.txt *[master] WARNING:FeaturesExtractor:could not parse file examples/universal/server/server.js with error 'missed some imaginary tokens: "{p"', skipping WARNING:FeaturesExtractor:could not parse file lib/reporter/markdown.js with error 'missed some imaginary tokens: " if (flak"', skipping WARNING:FeaturesExtractor:could not parse file test/reporter/test-reporter-markdown.js with error 'missed some imaginary tokens: "expe"', skipping WARNING:FeaturesExtractor:could not parse file lib/reporter/markdown.js with error 'missed some imaginary tokens: " if (flak"', skipping WARNING:FeaturesExtractor:could not parse file test/reporter/test-reporter-markdown.js with error 'missed some imaginary tokens: "expe"', skipping WARNING:FeaturesExtractor:could not parse file .storybook/config.js with error 'missed some imaginary tokens: " u"', skipping WARNING:FeaturesExtractor:could not parse file examples/ssr-next/pages/index.js with error 'missed some imaginary tokens: "/B"', skipping WARNING:FeaturesExtractor:could not parse file scripts/build.js with error 'missed some imaginary tokens: " WARNING:FeaturesExtractor:could not parse file test/byteSize.test.js with error 'missed some imaginary tokens: ").t"', skipping WARNING:FeaturesExtractor:could not parse file addons/events/src/components/Event.js with error 'missed some imaginary tokens: "/s"', skipping WARNING:FeaturesExtractor:could not parse file addons/storyshots/storyshots-core/stories/directly_required/index.js with error 'missed some imaginary tokens: "an"', skipping WARNING:FeaturesExtractor:could not parse file addons/storyshots/storyshots-core/stories/required_with_context/Button.stories.js with error 'missed some imaginary tokens: "an"', skipping WARNING:FeaturesExtractor:could not parse file addons/storysource/src/StoryPanel.js with error 'missed some imaginary tokens: "}; WARNING:FeaturesExtractor:could not parse file docs/src/components/Homepage/MainLinks/index.js with error 'missed some imaginary tokens: "/s"', skipping WARNING:FeaturesExtractor:could not parse file examples-native/crna-kitchen-sink/storybook/stories/index.js with error 'missed some imaginary tokens: "xt"', skipping WARNING:FeaturesExtractor:could not parse file examples/cra-kitchen-sink/src/stories/index.stories.js with error 'missed some imaginary tokens: "an"', skipping WARNING:FeaturesExtractor:could not parse file examples/mithril-kitchen-sink/src/stories/addon-notes.stories.js with error 'missed some imaginary tokens: "an"', skipping WARNING:FeaturesExtractor:could not parse file examples/official-storybook/stories/other-demo.stories.js with error 'missed some imaginary tokens: "an"', skipping WARNING:FeaturesExtractor:could not parse file examples/riot-kitchen-sink/src/stories/addon-notes.stories.js with error 'missed some imaginary tokens: " { WARNING:FeaturesExtractor:could not parse file examples/svelte-kitchen-sink/src/stories/addon-notes.stories.js with error 'missed some imaginary tokens: " }), WARNING:FeaturesExtractor:could not parse file examples/vue-kitchen-sink/src/stories/addon-notes.stories.js with error 'missed some imaginary tokens: " { WARNING:FeaturesExtractor:could not parse file lib/cli/generators/EMBER/template/stories/index.stories.js with error 'missed some imaginary tokens: " cont"', skipping WARNING:FeaturesExtractor:could not parse file lib/cli/generators/METEOR/template/stories/index.stories.js with error 'missed some imaginary tokens: "an"', skipping WARNING:FeaturesExtractor:could not parse file lib/cli/generators/REACT/template/stories/index.stories.js with error 'missed some imaginary tokens: "an"', skipping WARNING:FeaturesExtractor:could not parse file lib/cli/generators/REACT_NATIVE/template/storybook/stories/index.js with error 'missed some imaginary tokens: "xt"', skipping WARNING:FeaturesExtractor:could not parse file lib/cli/generators/REACT_SCRIPTS/template/src/stories/index.js with error 'missed some imaginary tokens: "an"', skipping WARNING:FeaturesExtractor:could not parse file lib/cli/generators/SFC_VUE/template/src/stories/index.stories.js with error 'missed some imaginary tokens: " meth"', skipping WARNING:FeaturesExtractor:could not parse file lib/cli/generators/WEBPACK_REACT/template/stories/index.stories.js with error 'missed some imaginary tokens: "an"', skipping WARNING:FeaturesExtractor:could not parse file lib/cli/test/fixtures/update_package_organisations/stories/index.js with error 'missed some imaginary tokens: "tt"', skipping WARNING:FeaturesExtractor:could not parse file examples/polymer-cli/src/stories/addon-notes.stories.js with error 'missed some imaginary tokens: "s: ` WARNING:FeaturesExtractor:could not parse file lib/cli/generators/VUE/template/stories/index.stories.js with error 'missed some imaginary tokens: " meth"', skipping WARNING:FeaturesExtractor:could not parse file scripts/test.js with error 'missed some imaginary tokens: "{c"', skipping WARNING:FeaturesExtractor:could not parse file tests/pure/es.array.from.js with error 'missed some imaginary tokens: "['𠮷'"', skipping WARNING:FeaturesExtractor:could not parse file tests/pure/es.string.iterator.js with error 'missed some imaginary tokens: "en"', skipping WARNING:FeaturesExtractor:could not parse file tests/pure/web.url-search-params.js with error 'missed some imaginary tokens: " ou"', skipping WARNING:FeaturesExtractor:could not parse file tests/tests/es.array.from.js with error 'missed some imaginary tokens: "['𠮷'"', skipping WARNING:FeaturesExtractor:could not parse file tests/tests/es.string.iterator.js with error 'missed some imaginary tokens: "en"', skipping WARNING:FeaturesExtractor:could not parse file tests/tests/esnext.string.code-points.js with error 'missed some imaginary tokens: "d"', skipping WARNING:FeaturesExtractor:could not parse file tests/tests/web.url-search-params.js with error 'missed some imaginary tokens: " ou"', skipping WARNING:FeaturesExtractor:could not parse file tests/wpt-url-resources/urltestdata.js with error 'missed some imaginary tokens: " WARNING:FeaturesExtractor:could not parse file tests/pure/esnext.string.code-points.js with error 'missed some imaginary tokens: " ass"', skipping WARNING:FeaturesExtractor:could not parse file spec/text-editor-component-spec.js with error 'missed some imaginary tokens: " WARNING:FeaturesExtractor:could not parse file src/text-editor-component.js with error 'missed some imaginary tokens: " t"', skipping WARNING:FeaturesExtractor:could not parse file spec/text-editor-component-spec.js with error 'missed some imaginary tokens: " WARNING:FeaturesExtractor:could not parse file fixtures/attribute-behavior/src/App.js with error 'missed some imaginary tokens: "/s"', skipping WARNING:FeaturesExtractor:could not parse file fixtures/unstable-async/suspense/src/api/data.js with error 'missed some imaginary tokens: " }, WARNING:FeaturesExtractor:could not parse file fixtures/unstable-async/suspense/src/index.js with error 'missed some imaginary tokens: " s"', skipping WARNING:FeaturesExtractor:could not parse file packages/accounts-password/password_tests.js with error 'missed some imaginary tokens: "{t"', skipping WARNING:FeaturesExtractor:could not parse file packages/accounts-password/password_tests.js with error 'missed some imaginary tokens: "{t"', skipping WARNING:FeaturesExtractor:could not parse file test/cases/parsing/bom/bomfile.js with error 'missed some imaginary tokens: ""', skipping WARNING:FeaturesExtractor:could not parse file benchmark/es/string-repeat.js with error 'missed some imaginary tokens: " WARNING:FeaturesExtractor:could not parse file test/known_issues/test-http-path-contains-unicode.js with error 'missed some imaginary tokens: " WARNING:FeaturesExtractor:could not parse file test/parallel/test-buffer-bytelength.js with error 'missed some imaginary tokens: "UT"', skipping WARNING:FeaturesExtractor:could not parse file test/parallel/test-fs-symlink.js with error 'missed some imaginary tokens: "}; WARNING:FeaturesExtractor:could not parse file test/parallel/test-http2-altsvc.js with error 'missed some imaginary tokens: ".f"', skipping WARNING:FeaturesExtractor:could not parse file test/parallel/test-icu-stringwidth.js with error 'missed some imaginary tokens: ", 2"', skipping WARNING:FeaturesExtractor:could not parse file test/parallel/test-string-decoder-end.js with error 'missed some imaginary tokens: "].m"', skipping WARNING:FeaturesExtractor:could not parse file test/parallel/test-string-decoder.js with error 'missed some imaginary tokens: "e"', skipping WARNING:FeaturesExtractor:could not parse file test/parallel/test-tls-env-bad-extra-ca.js with error 'missed some imaginary tokens: ", ```
m09 commented 5 years ago

They seem also present in 0.1.0 (even 94 instead of 59) so maybe we did not kill them after all.

$ xzgrep -c imaginary 0.1.0/quality/logs.txt.xz
94
$ grep -c imaginary untagged/quality/logs.txt
59
zurk commented 5 years ago

Yes, that is True. We do not kill them all. It is all related to bad positions and it was hard to kill them. I hope it should be better with v2.7.1 driver