Error when jekyll-building

Description

When trying to build the open.ribose.com project, an error would occur.

From the source, it seems that project['site'] is returning nil.

Steps to reproduce / Actual results

Here's the trace:

# bundle exec jekyll build --trace
Configuration file: /opt/ribose/src/open.ribose.com/_config.yml
 Theme Config file: /opt/ribose/bundle/gems/jekyll-theme-open-project-1.0.10/_config.yml
            Source: /opt/ribose/src/open.ribose.com
       Destination: /opt/ribose/src/open.ribose.com/_site
 Incremental build: disabled. Enable with --incremental
      Generating...
           Warning: Excerpt modified in _projects/Metanorma/_samples/draft-camelot-holy-grenade.md!
                    Found a Liquid block containing separator ' ' and has been modified with the appropriate closing tag.
                    Feel free to define a custom excerpt or excerpt_separator in the document's Front Matter if the generated excerpt is unsatisfactory.
Invalid theme folder: _data
bundler: failed to load command: jekyll (/opt/ribose/bundle/bin/jekyll)
NoMethodError: undefined method `[]' for nil:NilClass
  /opt/ribose/bundle/gems/jekyll-theme-open-project-helpers-1.0.3/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:83:in `block in fetch_and_read_projects'
  /opt/ribose/bundle/gems/jekyll-theme-open-project-helpers-1.0.3/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:78:in `each'
  /opt/ribose/bundle/gems/jekyll-theme-open-project-helpers-1.0.3/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:78:in `fetch_and_read_projects'
  /opt/ribose/bundle/gems/jekyll-theme-open-project-helpers-1.0.3/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:54:in `read'
  /opt/ribose/bundle/gems/jekyll-3.8.3/lib/jekyll/site.rb:164:in `read'
  /opt/ribose/bundle/gems/jekyll-3.8.3/lib/jekyll/site.rb:69:in `process'
  /opt/ribose/bundle/gems/jekyll-3.8.3/lib/jekyll/command.rb:28:in `process_site'
  /opt/ribose/bundle/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:65:in `build'
  /opt/ribose/bundle/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:36:in `process'
  /opt/ribose/bundle/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:18:in `block (2 levels) in init_with_program'
  /opt/ribose/bundle/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `block in execute'
  /opt/ribose/bundle/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `each'
  /opt/ribose/bundle/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `execute'
  /opt/ribose/bundle/gems/mercenary-0.3.6/lib/mercenary/program.rb:42:in `go'
  /opt/ribose/bundle/gems/mercenary-0.3.6/lib/mercenary.rb:19:in `program'
  /opt/ribose/bundle/gems/jekyll-3.8.3/exe/jekyll:15:in `<top (required)>'
  /opt/ribose/bundle/bin/jekyll:29:in `load'
  /opt/ribose/bundle/bin/jekyll:29:in `<top (required)>'

FYR, I bundle update-ed jekyll-theme-open-project-helpers from 1.0.2 to 1.0.3, but the same error occurred.

Expected results

It would build the site without errors.

@ribose-jeffreylau

At first look, it seems that in your _projects/ dir one project’s index.md file does not specify the full required YAML frontmatter, namely the site key. Are you building from exactly the same source as in current version of https://github.com/riboseinc/open.ribose.com/?

Hi @strogonoff , yes. I could reproduce this on my local macos environment.

I ran the build step a few more times. I even git-cleaned to start over, and found out that it was also emitting a different error than the one shown. Here's the complete trace, after git-cleaning:


$ git status
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean
$ git rev-parse HEAD
e52c0d50713fe34436ff6c47ef815d35361fe2d4
$ bundle exec jekyll build --trace
Configuration file: /Users/localuser/share/src/open.ribose.com/_config.yml
 Theme Config file: /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-1.0.7/_config.yml
            Source: /Users/localuser/share/src/open.ribose.com
       Destination: /Users/localuser/share/src/open.ribose.com/_site
 Incremental build: disabled. Enable with --incremental
      Generating...
Invalid theme folder: _data
bundler: failed to load command: jekyll (/Users/localuser/.rbenv/versions/2.4.4/bin/jekyll)
Errno::ENOENT: No such file or directory @ rb_sysopen - /Users/localuser/share/src/open.ribose.com/_projects/Metanorma/.git/info/sparse-checkout
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:154:in `initialize'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:154:in `open'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:154:in `git_sparse_checkout'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:81:in `block in fetch_and_read_projects'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:78:in `each'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:78:in `fetch_and_read_projects'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:54:in `read'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:164:in `read'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:69:in `process'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/command.rb:28:in `process_site'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:65:in `build'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:36:in `process'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:18:in `block (2 levels) in init_with_program'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `block in execute'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `each'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `execute'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/program.rb:42:in `go'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary.rb:19:in `program'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/exe/jekyll:15:in `<top (required)>'
  /Users/localuser/.rbenv/versions/2.4.4/bin/jekyll:23:in `load'
  /Users/localuser/.rbenv/versions/2.4.4/bin/jekyll:23:in `<top (required)>'
$ git status
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean
$ bundle exec jekyll build --trace
Configuration file: /Users/localuser/share/src/open.ribose.com/_config.yml
 Theme Config file: /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-1.0.7/_config.yml
            Source: /Users/localuser/share/src/open.ribose.com
       Destination: /Users/localuser/share/src/open.ribose.com/_site
 Incremental build: disabled. Enable with --incremental
      Generating...
Invalid theme folder: _data
bundler: failed to load command: jekyll (/Users/localuser/.rbenv/versions/2.4.4/bin/jekyll)
Errno::ENOENT: No such file or directory @ rb_sysopen - /Users/localuser/share/src/open.ribose.com/_projects/RNP/.git/info/sparse-checkout
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:154:in `initialize'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:154:in `open'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:154:in `git_sparse_checkout'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:81:in `block in fetch_and_read_projects'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:78:in `each'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:78:in `fetch_and_read_projects'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:54:in `read'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:164:in `read'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:69:in `process'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/command.rb:28:in `process_site'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:65:in `build'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:36:in `process'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:18:in `block (2 levels) in init_with_program'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `block in execute'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `each'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `execute'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/program.rb:42:in `go'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary.rb:19:in `program'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/exe/jekyll:15:in `<top (required)>'
  /Users/localuser/.rbenv/versions/2.4.4/bin/jekyll:23:in `load'
  /Users/localuser/.rbenv/versions/2.4.4/bin/jekyll:23:in `<top (required)>'
$ git status
On branch master
Your branch is up to date with 'origin/master'.

Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git checkout -- <file>..." to discard changes in working directory)

    modified:   _projects/Metanorma/index.md

Untracked files:
  (use "git add <file>..." to include in what will be committed)

    _projects/Metanorma/.gitignore
    _projects/Metanorma/404.html
    _projects/Metanorma/Gemfile
    _projects/Metanorma/Gemfile.lock
    _projects/Metanorma/Jenkinsfile
    _projects/Metanorma/LICENSE
    _projects/Metanorma/OPS.adoc
    _projects/Metanorma/README.adoc
    _projects/Metanorma/Rakefile
    _projects/Metanorma/_config.yml
    _projects/Metanorma/_layouts/
    _projects/Metanorma/_pages/
    _projects/Metanorma/_samples/
    _projects/Metanorma/_sass/
    _projects/Metanorma/about.md
    _projects/Metanorma/project-nav.html
    _projects/Metanorma/scripts.html
    _projects/Metanorma/title.html

no changes added to commit (use "git add" and/or "git commit -a")
$ bundle exec jekyll build --trace
Configuration file: /Users/localuser/share/src/open.ribose.com/_config.yml
 Theme Config file: /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-1.0.7/_config.yml
            Source: /Users/localuser/share/src/open.ribose.com
       Destination: /Users/localuser/share/src/open.ribose.com/_site
 Incremental build: disabled. Enable with --incremental
      Generating...
           Warning: Excerpt modified in _projects/Metanorma/_samples/draft-camelot-holy-grenade.md!
                    Found a Liquid block containing separator ' ' and has been modified with the appropriate closing tag.
                    Feel free to define a custom excerpt or excerpt_separator in the document's Front Matter if the generated excerpt is unsatisfactory.
Invalid theme folder: _data
bundler: failed to load command: jekyll (/Users/localuser/.rbenv/versions/2.4.4/bin/jekyll)
NoMethodError: undefined method `[]' for nil:NilClass
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:83:in `block in fetch_and_read_projects'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:78:in `each'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:78:in `fetch_and_read_projects'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-helpers-1.0.2/lib/jekyll-theme-open-project-helpers/project_data_reader.rb:54:in `read'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:164:in `read'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:69:in `process'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/command.rb:28:in `process_site'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:65:in `build'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:36:in `process'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:18:in `block (2 levels) in init_with_program'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `block in execute'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `each'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `execute'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary/program.rb:42:in `go'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/mercenary-0.3.6/lib/mercenary.rb:19:in `program'
  /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-3.8.3/exe/jekyll:15:in `<top (required)>'
  /Users/localuser/.rbenv/versions/2.4.4/bin/jekyll:23:in `load'
  /Users/localuser/.rbenv/versions/2.4.4/bin/jekyll:23:in `<top (required)>'
$ git status
On branch master
Your branch is up to date with 'origin/master'.

Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git checkout -- <file>..." to discard changes in working directory)

    modified:   _projects/Metanorma/index.md

Untracked files:
  (use "git add <file>..." to include in what will be committed)

    _projects/Metanorma/.gitignore
    _projects/Metanorma/404.html
    _projects/Metanorma/Gemfile
    _projects/Metanorma/Gemfile.lock
    _projects/Metanorma/Jenkinsfile
    _projects/Metanorma/LICENSE
    _projects/Metanorma/OPS.adoc
    _projects/Metanorma/README.adoc
    _projects/Metanorma/Rakefile
    _projects/Metanorma/_config.yml
    _projects/Metanorma/_layouts/
    _projects/Metanorma/_pages/
    _projects/Metanorma/_samples/
    _projects/Metanorma/_sass/
    _projects/Metanorma/about.md
    _projects/Metanorma/project-nav.html
    _projects/Metanorma/scripts.html
    _projects/Metanorma/title.html

no changes added to commit (use "git add" and/or "git commit -a")

@ribose-jeffreylau

Suggested steps:

As you posted above, git status shows
```
modified:   _projects/Metanorma/index.md
```
Please post here full contents of that file.

Try cloning & building inside a new directory and let me know if that works.

$ cd ~
$ git clone git@github.com:riboseinc/open.ribose.com.git new-attempt
$ cd new-attempt
$ bundle exec jekyll serve

Please run jekyll --version, ruby --version, git --version and post what they report

@strogonoff

Here's the content. The command is run straight after the above posted steps.

$ cat _projects/Metanorma/index.md
---
layout: home
hero_include: home-hero.html
---

Here is the new attempt:

$ cd tmp
/Users/localuser/tmp
$ git clone git@github.com:riboseinc/open.ribose.com.git new-attempt
Cloning into 'new-attempt'...
remote: Counting objects: 412, done.
remote: Compressing objects: 100% (51/51), done.
remote: Total 412 (delta 38), reused 62 (delta 22), pack-reused 329
Receiving objects: 100% (412/412), 88.54 KiB | 189.00 KiB/s, done.
Resolving deltas: 100% (185/185), done.
$ cd new-attempt
/Users/localuser/tmp/new-attempt
$ bundle exec jekyll serve
Could not find jekyll-theme-open-project-1.1.2 in any of the sources
Run `bundle install` to install missing gems.
$ bundle
Fetching gem metadata from https://rubygems.org/...........
Using concurrent-ruby 1.0.5
Using i18n 0.9.5
Using minitest 5.11.3
Using thread_safe 0.3.6
Using tzinfo 1.2.5
Using activesupport 5.2.0
Using public_suffix 3.0.2
Using addressable 2.5.2
Using bundler 1.16.4
Using colorator 1.1.0
Using colorize 0.8.1
Using eventmachine 1.2.7
Using http_parser.rb 0.6.0
Using em-websocket 0.5.1
Using ffi 1.9.25
Using ethon 0.11.0
Using forwardable-extended 2.6.0
Using git 1.4.0
Using mercenary 0.3.6
Using mini_portile2 2.3.0
Using nokogiri 1.8.2
Using parallel 1.12.1
Using typhoeus 1.3.0
Using yell 2.0.7
Using html-proofer 3.8.0
Using rb-fsevent 0.10.3
Using rb-inotify 0.9.10
Using sass-listen 4.0.0
Using sass 3.5.6
Using jekyll-sass-converter 1.5.2
Using ruby_dep 1.5.0
Using listen 3.1.5
Using jekyll-watch 2.0.0
Using kramdown 1.17.0
Using liquid 4.0.0
Using pathutil 0.16.1
Using rouge 3.1.1
Using safe_yaml 1.0.4
Using jekyll 3.8.3
Using jekyll-data 1.0.0
Using jekyll-feed 0.9.3
Using jekyll-seo-tag 2.4.0
Using jekyll-theme-open-project-helpers 1.0.3
Fetching jekyll-theme-open-project 1.1.2
Installing jekyll-theme-open-project 1.1.2
Bundle complete! 9 Gemfile dependencies, 44 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
$ bundle exec jekyll serve
Configuration file: /Users/localuser/tmp/new-attempt/_config.yml
 Theme Config file: /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-1.1.2/_config.yml
            Source: /Users/localuser/tmp/new-attempt
       Destination: /Users/localuser/tmp/new-attempt/_site
 Incremental build: disabled. Enable with --incremental
      Generating...
Invalid theme folder: _data
jekyll 3.8.3 | Error:  No such file or directory @ rb_sysopen - /Users/localuser/tmp/new-attempt/_projects/Metanorma/.git/info/sparse-checkout
$ git status
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean
$ bundle exec jekyll serve
Configuration file: /Users/localuser/tmp/new-attempt/_config.yml
 Theme Config file: /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-1.1.2/_config.yml
            Source: /Users/localuser/tmp/new-attempt
       Destination: /Users/localuser/tmp/new-attempt/_site
 Incremental build: disabled. Enable with --incremental
      Generating...
Invalid theme folder: _data
jekyll 3.8.3 | Error:  No such file or directory @ rb_sysopen - /Users/localuser/tmp/new-attempt/_projects/RNP/.git/info/sparse-checkout
$ git status
On branch master
Your branch is up to date with 'origin/master'.

Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git checkout -- <file>..." to discard changes in working directory)

    modified:   _projects/Metanorma/index.md

Untracked files:
  (use "git add <file>..." to include in what will be committed)

    _projects/Metanorma/.gitignore
    _projects/Metanorma/404.html
    _projects/Metanorma/Gemfile
    _projects/Metanorma/Gemfile.lock
    _projects/Metanorma/Jenkinsfile
    _projects/Metanorma/LICENSE
    _projects/Metanorma/OPS.adoc
    _projects/Metanorma/README.adoc
    _projects/Metanorma/Rakefile
    _projects/Metanorma/_config.yml
    _projects/Metanorma/_layouts/
    _projects/Metanorma/_pages/
    _projects/Metanorma/_samples/
    _projects/Metanorma/_sass/
    _projects/Metanorma/about.md
    _projects/Metanorma/project-nav.html
    _projects/Metanorma/scripts.html
    _projects/Metanorma/title.html

no changes added to commit (use "git add" and/or "git commit -a")
$ cat _projects/Metanorma/index.md
---
layout: home
hero_include: home-hero.html
---

Here are the version infos:

$ pwd
/Users/localuser/tmp/new-attempt
$ bundle exec jekyll --version
jekyll 3.8.3
$ ruby --version
ruby 2.4.4p296 (2018-03-28 revision 63013) [x86_64-darwin17]
$ git --version
git version 2.18.0

Hope it helps. Thanks!

@ribose-jeffreylau I can't reproduce this error. On a clean clone I can run directly.

$ bundle exec jekyll --version
jekyll 3.8.3
$ ruby --version
ruby 2.4.3p205 (2017-12-14 revision 61247) [x86_64-darwin17]
$ git --version
git version 2.18.0

However, I noticed that the difference is this:

$ git status
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean

It seems that your _projects/Metanorma clone has failed?

@ribose-jeffreylau thanks for the detailed traces.

It’s becoming clear that somehow during the build on your machine Git fails to perform a sparse clone, even though your main Git binary reports a fresh version that already supports the feature (they added it back in 1.7.0 I think).

A regular (non-sparse) clone ends up fetching a bunch of uncalled-for files from projects’ repos, ending up overwriting _projects/Metanorma/index.md and subsequently causing the error you originally posted in this issue.

Perhaps Ruby bindings for Git somehow pick up another Git binary on your machine. I’ll keep looking into this.

All these hassles push me towards restructuring our framework with submodules approach in mind (#1), even though I’m not a fan of it either :)

(My intuition is that build-time data collection will be better in the long run. E.g. with scheduled builds there’d be no need for “chore” submodule commits whenever dependencies update, and there’re other reasons. That said, if we don’t arrive at a reliable and feasible implementation that doesn’t cause issues like this one I’ll give up the idea of build-time pull)

I spent over an hour debugging with @ribose-jeffreylau , we couldn't figure out what exactly caused the difference between machines.

However, it is clear that the "overwriting" of an existing file already in the Git repo (i.e. '/_projects/Metanorma/index.md' from 'open.ribose.com') by the actual project Git repo's (i.e. '/_projects/Metanorma/index.md' from 'metanorma.com') is causing problems.

The second issue is that the "data" is mixed with Jekyll's handling. For example, '/_projects/Metanorma/index.md' from 'open.ribose.com' is not an actual page, but it is just used to store data attributes. A lot of code in the helper is used to extract attributes from these files. The better way is to use real YAML to store these files, without having them entering the Jekyll system.

This means:

we have '/projects/{project-name}.yaml' files in the hub 'open.ribose.com'
we have '/software/{software-name}.yaml' files in project sites like 'metanorma.com'
we have '/specs/{software-name}.yaml' files in project sites like 'metanorma.com'

Then the hub can directly access these YAML files via the Git cloned copy, rather than having to "pretend to be collections" in Jekyll, then "extract data from these fake pages", then dynamically inserting this content back into Jekyll collections.

Instead, the helper can read all the YAML files, and then only generate a Jekyll collection once.

Regarding submodule, we can always add the submodules first, then if we need to always build the latest project sites, we can add a task that pulls the project sites from their latest master, and then build. This is easy to do, and is much, much preferable than making fake Jekyll collections.

@strogonoff could you help us do this? Thanks!

@ronaldtse Absolutely, I’m looking into this, it could be that Ruby bindings for Git end up using a wrong Git binary (without sparse checkout support) on Jeffrey’s machine.

You’re right about the data structure and “fake collections”, I agree that it’s suboptimal (https://github.com/riboseinc/jekyll-theme-open-project/issues/2). That said I’d rather address the problem Jeffrey’s having directly rather than indirectly by using another data structure as a workaround.

@strogonoff I don't see using a proper data structure as a "workaround", converting the fake collections into proper YAML files (and outside of Jekyll) would be the right thing to do 👍

@ronaldtse I’m with you on data structure refactor. Good thing to do as it’d save a bit of template filtering and improve maintainability. I’ve researched it before, there’s a Jekyll plugin for reading collection data from YAML and I’m going to tackle https://github.com/riboseinc/jekyll-theme-open-project/issues/2 this week or next.

It is a workaround as far as Jeffrey’s issue is concerned. If we refactor data structure, we’d still have sparse clones not working on his machine. Might eliminate one symptom but the bug would remain.

@strogonoff I believe Jekyll by default can read in collections via YAML. However, the data hierarchy with the project and hub should really be handled completely separately (not linked to Jekyll), and only fed into Jekyll once the data hierarchy (projects, hub, etc) is completely loaded into YAML of appropriate format.

The sparse checkout is having problems probably because of the overlapping file paths between two repos (hub has the same file path as the project). A workaround we tried yesterday was to move the clones to another collection (e.g. _build rather than _projects) and keep the project information (links, description) in _projects. This mostly worked but the reading back in of collection data was not straightforward.

If we can move the hub/project data to a full Ruby YAML solution (not via Jekyll collections), I believe this issue will be gone.

@ronaldtse we seem to be in general agreement about what should be done, we just disagree on why it should be done😂 Should we move to https://github.com/riboseinc/jekyll-theme-open-project/issues/2 further discussion on storing and loading open project data?

The overlapping file paths issue is caused by sparse Git clone not working on Jeffrey’s machine. Meaning his Jekyll build clones whole repos, rather than only the specific directories required for successful build of the dependant site (called “sparse” checkout). Changing how the data is integrated would sidestep this issue (meaning full clones won’t overwrite paths), but perhaps if we identify why Jeffrey’s environment is inconsistent with CI/prod we’ll see the quickest way to ensure that full clones just don’t happen for him as they shouldn’t in the first place.

@ribose-jeffreylau Could you please fetch the newest version of open.ribose.com repo and try building it from scratch once more?

When you run bundle, make it bundle --full-index to skip gem cache, as a new version of this gem was just released in an attempt to make cloning work consistently across environments.

@strogonoff

Changing how the data is integrated would sidestep this issue (meaning full clones won’t overwrite paths)

I'd consider the workaround to "obsolete" the issue 😉

Thanks for all the help!

Thanks @strogonoff . Here's the trace:

$ bundle exec jekyll serve --trace
Configuration file: /Users/localuser/share/src/open.ribose.com/_config.yml
 Theme Config file: /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-1.1.4/_config.yml
            Source: /Users/localuser/share/src/open.ribose.com
       Destination: /Users/localuser/share/src/open.ribose.com/_site
 Incremental build: disabled. Enable with --incremental
      Generating...
Invalid theme folder: _data
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
                    done in 29.774 seconds.
 Auto-regeneration: enabled for '/Users/localuser/share/src/open.ribose.com'
    Server address: http://127.0.0.1:4000
  Server running... press ctrl-c to stop.
      Regenerating: 4 file(s) changed at 2018-09-06 18:04:48
                    _projects/Riffol/_software/riffol/assets/symbol.svg
                    _projects/Riffol/_software/riffol.md
                    _projects/Riffol/assets/css/style.scss
                    _projects/Riffol/assets/symbol.svg
Invalid theme folder: _data
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
                    ...done in 27.793866 seconds.

      Regenerating: 67 file(s) changed at 2018-09-06 18:05:16
                    _projects/Metanorma/.git/FETCH_HEAD
                    _projects/Metanorma/_software/asciidoctor-rfc/assets/symbol.svg
                    _projects/Metanorma/_posts/2018-08-24-metanorma-wins-stevie-awards.adoc
                    _projects/Metanorma/_software/metanorma-acme/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-cli/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-csand/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-csd/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-gb/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-iec/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-iso/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-m3d/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-rsd/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-sample/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-standoc/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-iec.md
                    _projects/Metanorma/_software/asciidoctor-rfc.md
                    _projects/Metanorma/_software/metanorma-gb.md
                    _projects/Metanorma/_software/metanorma-rsd.md
                    _projects/Metanorma/_software/metanorma-m3d.md
                    _projects/Metanorma/_software/metanorma-standoc.md
                    _projects/Metanorma/_software/metanorma-iso.md
                    _projects/Metanorma/_software/metanorma-csd.md
                    _projects/Metanorma/_software/metanorma-sample.md
                    _projects/Metanorma/_software/metanorma.md
                    _projects/Metanorma/_software/metanorma-acme.md
                    _projects/Metanorma/_software/metanorma-cli.md
                    _projects/Metanorma/_software/metanorma/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-csand.md
                    _projects/Metanorma/_specs/metanorma-model-standoc.md
                    _projects/Metanorma/_specs/metanorma-model-iso.md
                    _projects/Metanorma/_specs/metanorma-model-csd.md
                    _projects/Metanorma/_specs/metanorma-model-csand
                    _projects/Metanorma/_specs/metanorma-model-gb.md
                    _projects/Metanorma/_specs/metanorma-model-m3d.md
                    _projects/Metanorma/_specs/draft-ribose-asciirfc.md
                    _projects/Metanorma/_specs/metanorma-model-rsd.md
                    _projects/Metanorma/assets/css/theme-b.scss
                    _projects/Metanorma/assets/css/theme-c.scss
                    _projects/Metanorma/assets/css/theme-a.scss
                    _projects/Metanorma/assets/css/style.scss
                    _projects/Metanorma/assets/iba18_gold_winner.svg
                    _projects/Metanorma/assets/symbol.svg
                    _projects/Metanorma/.git/index
                    _projects/Metanorma/_software/asciidoctor-rfc/.git/FETCH_HEAD
                    _projects/Metanorma/_software/asciidoctor-rfc/.git/ORIG_HEAD
                    _projects/Metanorma/_software/asciidoctor-rfc/.git/index
                    _projects/RNP/_software/rnp/.git/FETCH_HEAD
                    _projects/RNP/_software/rnp/docs/navigation.adoc
                    _projects/RNP/_software/rnp/docs/README.md
                    _projects/RNP/_software/rnp/.git/ORIG_HEAD
                    _projects/RNP/_software/rnp/.git/index
                    _projects/Riffol/_software/riffol/.git/FETCH_HEAD
                    _projects/Riffol/_software/riffol/.git/ORIG_HEAD
                    _projects/Riffol/_software/riffol/.git/index
                    _projects/RNP/.git/FETCH_HEAD
                    _projects/RNP/_software/homebrew-rnp.md
                    _projects/RNP/_software/homebrew-rnp/assets/symbol.svg
                    _projects/RNP/.git/index
                    _projects/Riffol/.git/FETCH_HEAD
                    _projects/Riffol/_software/riffol/assets/symbol.svg
                    _projects/Riffol/_software/riffol.md
                    _projects/Riffol/assets/css/style.scss
                    _projects/Riffol/assets/symbol.svg
                    _projects/Riffol/.git/index
                    _projects/Metanorma/.git/ORIG_HEAD
                    _projects/RNP/.git/ORIG_HEAD
                    _projects/Riffol/.git/ORIG_HEAD
Invalid theme folder: _data
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git"
"/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git"
                    ...done in 24.809654 seconds.

      Regenerating: 63 file(s) changed at 2018-09-06 18:05:41
                    _projects/Metanorma/.git/FETCH_HEAD
                    _projects/Metanorma/_posts/2018-08-24-metanorma-wins-stevie-awards.adoc
                    _projects/Metanorma/_software/asciidoctor-rfc/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-acme/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-cli/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-csand/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-csd/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-gb/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-iec/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-iso/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-m3d/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-rsd/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-sample/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-standoc/assets/symbol.svg
                    _projects/Metanorma/_software/metanorma-iec.md
                    _projects/Metanorma/_software/asciidoctor-rfc.md
                    _projects/Metanorma/_software/metanorma-gb.md
                    _projects/Metanorma/_software/metanorma-rsd.md
                    _projects/Metanorma/_software/asciidoctor-rfc/.git/FETCH_HEAD
                    _projects/Metanorma/_software/metanorma-m3d.md
                    _projects/Metanorma/_software/metanorma-standoc.md
                    _projects/Metanorma/_software/metanorma-iso.md
                    _projects/Metanorma/_software/metanorma-csd.md
(... skipped)

So it seems that the Git sparse clone error has gone. However, jekyll seems to want to re-generate files forever and ever. Perhaps this issue can be closed and a new one opened?

Jeffrey, great.

Seems that the incompatibility was caused by Git not creating the info directory.

I’ll file an issue or feel free to do it, I don’t think I had infinite regeneration happen for me.

(The many repo paths output were caused by a print statement that went into gem release unintentionally, next version will clean it up.)

On 6 Sep 2018, at 7:13 PM, Jeffrey Lau notifications@github.com wrote:

Thanks @strogonoff . Here's the trace:

$ bundle exec jekyll serve --trace Configuration file: /Users/localuser/share/src/open.ribose.com/_config.yml Theme Config file: /Users/localuser/.rbenv/versions/2.4.4/lib/ruby/gems/2.4.0/gems/jekyll-theme-open-project-1.1.4/_config.yml Source: /Users/localuser/share/src/open.ribose.com Destination: /Users/localuser/share/src/open.ribose.com/_site Incremental build: disabled. Enable with --incremental Generating... Invalid theme folder: _data "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" done in 29.774 seconds. Auto-regeneration: enabled for '/Users/localuser/share/src/open.ribose.com' Server address: http://127.0.0.1:4000 Server running... press ctrl-c to stop. Regenerating: 4 file(s) changed at 2018-09-06 18:04:48 _projects/Riffol/_software/riffol/assets/symbol.svg _projects/Riffol/_software/riffol.md _projects/Riffol/assets/css/style.scss _projects/Riffol/assets/symbol.svg Invalid theme folder: _data "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" ...done in 27.793866 seconds.
  Regenerating: 67 file(s) changed at 2018-09-06 18:05:16
                _projects/Metanorma/.git/FETCH_HEAD
                _projects/Metanorma/_software/asciidoctor-rfc/assets/symbol.svg
                _projects/Metanorma/_posts/2018-08-24-metanorma-wins-stevie-awards.adoc
                _projects/Metanorma/_software/metanorma-acme/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-cli/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-csand/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-csd/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-gb/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-iec/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-iso/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-m3d/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-rsd/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-sample/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-standoc/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-iec.md
                _projects/Metanorma/_software/asciidoctor-rfc.md
                _projects/Metanorma/_software/metanorma-gb.md
                _projects/Metanorma/_software/metanorma-rsd.md
                _projects/Metanorma/_software/metanorma-m3d.md
                _projects/Metanorma/_software/metanorma-standoc.md
                _projects/Metanorma/_software/metanorma-iso.md
                _projects/Metanorma/_software/metanorma-csd.md
                _projects/Metanorma/_software/metanorma-sample.md
                _projects/Metanorma/_software/metanorma.md
                _projects/Metanorma/_software/metanorma-acme.md
                _projects/Metanorma/_software/metanorma-cli.md
                _projects/Metanorma/_software/metanorma/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-csand.md
                _projects/Metanorma/_specs/metanorma-model-standoc.md
                _projects/Metanorma/_specs/metanorma-model-iso.md
                _projects/Metanorma/_specs/metanorma-model-csd.md
                _projects/Metanorma/_specs/metanorma-model-csand
                _projects/Metanorma/_specs/metanorma-model-gb.md
                _projects/Metanorma/_specs/metanorma-model-m3d.md
                _projects/Metanorma/_specs/draft-ribose-asciirfc.md
                _projects/Metanorma/_specs/metanorma-model-rsd.md
                _projects/Metanorma/assets/css/theme-b.scss
                _projects/Metanorma/assets/css/theme-c.scss
                _projects/Metanorma/assets/css/theme-a.scss
                _projects/Metanorma/assets/css/style.scss
                _projects/Metanorma/assets/iba18_gold_winner.svg
                _projects/Metanorma/assets/symbol.svg
                _projects/Metanorma/.git/index
                _projects/Metanorma/_software/asciidoctor-rfc/.git/FETCH_HEAD
                _projects/Metanorma/_software/asciidoctor-rfc/.git/ORIG_HEAD
                _projects/Metanorma/_software/asciidoctor-rfc/.git/index
                _projects/RNP/_software/rnp/.git/FETCH_HEAD
                _projects/RNP/_software/rnp/docs/navigation.adoc
                _projects/RNP/_software/rnp/docs/README.md
                _projects/RNP/_software/rnp/.git/ORIG_HEAD
                _projects/RNP/_software/rnp/.git/index
                _projects/Riffol/_software/riffol/.git/FETCH_HEAD
                _projects/Riffol/_software/riffol/.git/ORIG_HEAD
                _projects/Riffol/_software/riffol/.git/index
                _projects/RNP/.git/FETCH_HEAD
                _projects/RNP/_software/homebrew-rnp.md
                _projects/RNP/_software/homebrew-rnp/assets/symbol.svg
                _projects/RNP/.git/index
                _projects/Riffol/.git/FETCH_HEAD
                _projects/Riffol/_software/riffol/assets/symbol.svg
                _projects/Riffol/_software/riffol.md
                _projects/Riffol/assets/css/style.scss
                _projects/Riffol/assets/symbol.svg
                _projects/Riffol/.git/index
                _projects/Metanorma/.git/ORIG_HEAD
                _projects/RNP/.git/ORIG_HEAD
                _projects/Riffol/.git/ORIG_HEAD
Invalid theme folder: _data "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Metanorma/_software/asciidoctor-rfc/.git" "/Users/localuser/share/src/open.ribose.com/_projects/RNP/_software/rnp/.git" "/Users/localuser/share/src/open.ribose.com/_projects/Riffol/_software/riffol/.git" ...done in 24.809654 seconds.
  Regenerating: 63 file(s) changed at 2018-09-06 18:05:41
                _projects/Metanorma/.git/FETCH_HEAD
                _projects/Metanorma/_posts/2018-08-24-metanorma-wins-stevie-awards.adoc
                _projects/Metanorma/_software/asciidoctor-rfc/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-acme/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-cli/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-csand/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-csd/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-gb/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-iec/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-iso/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-m3d/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-rsd/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-sample/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-standoc/assets/symbol.svg
                _projects/Metanorma/_software/metanorma-iec.md
                _projects/Metanorma/_software/asciidoctor-rfc.md
                _projects/Metanorma/_software/metanorma-gb.md
                _projects/Metanorma/_software/metanorma-rsd.md
                _projects/Metanorma/_software/asciidoctor-rfc/.git/FETCH_HEAD
                _projects/Metanorma/_software/metanorma-m3d.md
                _projects/Metanorma/_software/metanorma-standoc.md
                _projects/Metanorma/_software/metanorma-iso.md
                _projects/Metanorma/_software/metanorma-csd.md
(... skipped) So it seems that the Git sparse clone error has gone. However, jekyll seems to want to re-generate files forever and ever. Perhaps this issue can be closed and a new one opened?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

@ronaldtse No objection. Build on Jeffrey’s machine would’ve kept pulling unnecessary files during cloning in meantime though, so I’m glad we’ve dealt with that issue specifically.

Going to bump other sites to this version of the gem so that build works across RO network.

On 6 Sep 2018, at 7:00 PM, Ronald Tse notifications@github.com wrote:

@strogonoff

Changing how the data is integrated would sidestep this issue (meaning full clones won’t overwrite paths)

I'd consider the workaround to "obsolete" the issue 😉

Thanks for all the help!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

Thanks @strogonoff. I have no idea what happened but when I re-ran jekyll build, the infinite regeneration was gone. I'll mark this as closed then.

@ribose-jeffreylau Great! I filed #7 for jekyll serve issue anyway, will see if I spot it.

riboseinc / jekyll-theme-open-project-helpers